Marcus A. Brubaker

Assistant Professor, EECS Department
Member, Centre for Vision Research
External Advisory Committee, IC@L
Core Member, VISTA
Research Scientist, Google DeepMind
Faculty Affiliate, Vector Institute
Faculty Member, NEXT AI
Status-Only Assistant Professor, CS Department, University of Toronto

Website | Email

2023 – 2024 Research Highlights

Invertible Transformations for Generative Modelling

This research program we explored invertible transformations for constructing novel forms of generative models.  Invertible transformations allow for constructing highly expressive generative models which are capable of efficient sampling and exact density modeling.  Further, by virtue of representing the transformation of a complex data distribution into a simple, known distribution, they allow for effective incorporation of domain specific knowledge.  In the past year I published the first introduction and review article on the topic of invertible generative models known as Normalizing Flows.  Further, I have published several papers exploring novel applications and models build upon normalizing flows, including the first normalizing flow model shown to model high resolution data.  I also ran a tutorial at ECCV 2020 on the topic.

Research Interests

• Computer Vision
• Machine Learning
• Bayesian Statistics
• Computational Biology

Selected Publications

• Reconstructive latent-space neural radiance fields for efficient 3D scene representations. Aumentado-Armstrong, T.; Mirzaei, A.; Brubaker, M. A.; Kelly, J.; Levinshtein, A.; … arXiv preprint arXiv:2310.17880. 2023.
• Reference-guided controllable inpainting of neural radiance fields. Mirzaei, A.; Aumentado-Armstrong, T.; Brubaker, M. A.; Kelly, J.; Levinshtein, A.; … IEEE/CVF International Conference on Computer Vision (ICCV). 2023.
• Watch your steps: Local image and scene editing by text instructions. Mirzaei, A.; Aumentado-Armstrong, T.; Brubaker, M. A.; Kelly, J.; Levinshtein, A.; … European Conference on Computer Vision (ECCV). 2024.
• Dual-camera joint deblurring-denoising. Shekarforoush, S.; Walia, A.; Brubaker, M. A.; Derpanis, K. G.; Levinshtein, A. arXiv preprint arXiv:2309.08826. 2023.
• PolyOculus: Simultaneous multi-view image-based novel view synthesis. Yu, J. J.; Aumentado-Armstrong, T.; Forghani, F.; Derpanis, K. G.; Brubaker, M. A. European Conference on Computer Vision (ECCV). 2024.