Nithin Gopalakrishnan Nair

Ph.D. Student at Johns Hopkins University

SmallSize.png

I am a third year PhD student in the Department of Electrical and Computer Engineering at VIU Lab , Johns Hopkins University. I am advised by Dr. Vishal M Patel.

I work on problems in Computer Vision. My research areas include Face recognition and Deep Generative Modelling with a special emphasis on Plug and Play models and efficient architectures for generation, enabling training and inference of generative models on low compute resources.

Prior to joining JHU, I obtained my Bachelor’s and Master’s dual degree (B.Tech& M.Tech) in Electrical Engineering from Indian Institute of Technology, Madras. At IIT Madras, I worked with Dr AN Rajagopalan at the IPCV Lab, on image reconstruction. In my free time, I enjoy running and hiking.

News

Apr 2024 I started my summer internship at Nvidia Research!
Jul 2023 Our work Steered Diffusion is accepted at ICCV 2023. Steered diffusion enables zero-shot conditional sampling using pre-trained unconditional diffusion models.
May 2023 I started my summer internship at Adobe Seattle on Diffusion based Image editing.
Feb 2023 Our work Unite and Conquer is accepted at CVPR 2023. Unite and Conquer enables plug and play multimodal generation using diffusion models.
Oct 2022 Our work AT-DDPM is accepted at WACV 2023. AT-DDPM achieves state of the art performance in atmospheric turbulence mitigation.

Selected Publications

  1. steered.png
    Steered Diffusion: A Generalized Framework for Plug-and-Play Conditional Image Synthesis
    Nithin Gopalakrishnan Nair, Anoop Cherian, Suhas Lohit, Ye Wang, Toshiaki Koike-Akino, Vishal M. Patel, and Tim K. Marks
    In Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), Oct 2023
  2. multi.png
    Unite and Conquer: Plug & Play Multi-Modal Synthesis Using Diffusion Models
    Nithin Gopalakrishnan Nair, Wele Gedara Chaminda Bandara, and Vishal M Patel
    In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Jun 2023
  3. binoising.png
    Diffuse-Denoise-Count: Accurate Crowd-Counting with Diffusion Models
    Yasiru Ranasinghe, Nithin Gopalakrishnan Nair, Wele Gedara Chaminda Bandara, and Vishal M Patel
    In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, Mar 2024
  4. ddpmcd.png
    DDPM-CD: Remote Sensing Change Detection using Denoising Diffusion Probabilistic Models
    Wele Gedara Chaminda Bandara, Nithin Gopalakrishnan Nair, and Vishal M Patel
    arXiv preprint arXiv:2206.11892, Mar 2022