Trust but Verify: Programmatic VLM Evaluation in the Wild
Responsibly Building the Next Generation of Multimodal Foundational Models, NeurIPS 2024
Viraj Prabhu, Senthil Purushwalkam, An Yan, Caiming Xiong, Ran Xu
Paper
Data
xGen-MM (BLIP-3): A Family of Open Large Multimodal Models
Emergent Visual Abilities and Limits of Foundation Models, ECCV 2024
Le Xue, Manli Shu,, Anas Awadalla,, Jun Wang, An Yan, Senthil Purushwalkam, Honglu Zhou, Viraj Prabhu, Yutong Dai, Michael S Ryoo, Shrikant Kendre, Jieyu Zhang, Can Qin, Shu Zhang, Chia-Chih Chen, Ning Yu, Juntao Tan, Tulika Manoj Awalgaonkar, Shelby Heinecke, Huan Wang, Yejin Choi, Ludwig Schmidt, Zeyuan Chen, Silvio Savarese, Juan Carlos Niebles, Caiming Xiong, Ran Xu
Project page
We're Not Using Videos Effectively: An Updated Video Domain Adaptation Baseline
TMLR 2024
Simar Kareer, Vivek Vijaykumar, Harsh Maheshwari, Judy Hoffman, Prithvijit Chattopadhyay, Viraj Prabhu
Paper
Code
Translating Labels to Solve Annotation Mismatches Across Object Detection Datasets
ICLR 2024
Yuan-Hong Liao, David Acuna, Rafid Mahmood, James Lucas, Viraj Prabhu, Sanja Fidler
Paper
AUGCAL: Sim-to-Real Adaptation by Improving Uncertainty Calibration on Augmented Synthetic Images
ICLR 2024
Prithvijit Chattopadhyay, Bharat Goyal, Bogi Ecsedi, Viraj Prabhu, Judy Hoffman
Paper
LANCE: Stress-testing Visual Models by Generating Language-guided Counterfactual Images
NeurIPS 2023
Viraj Prabhu, Sriram Yenamandra, Prithvijit Chattopadhyay, Judy Hoffman
Paper
Code
Project Page
News
Bridging the Sim2Real gap with CARE: Supervised Detection Adaptation with Conditional Alignment and Reweighting
TMLR 2023
Viraj Prabhu, David Acuna, Yuan-Hong Liao, Rafid Mahmood, Marc T. Law, Judy Hoffman, Sanja Fidler, James Lucas
Paper
Battle of the Backbones: A Large-Scale Comparison of Pretrained Models across Vision Tasks
NeurIPS 2023 (Datasets & Benchmarks)
Micah Goldblum, Hossein Souri, Renkun Ni, Manli Shu, Viraj Prabhu, Gowthami Somepalli, Prithivijit Chattopadhyay, Adrien Bardes, Mark Ibrahim, Judy Hoffman, Rama Chellappa, Andrew Gordon Wilson, Tom Goldstein
Paper
Code
FACTS: First Amplify Correlations and Then Slice to Discover Bias
ICCV 2023
Sriram Yenamandra, Pratik Ramesh, Viraj Prabhu, Judy Hoffman
Paper
ICON2: Reliably Benchmarking Inequity in Detection by Identifying and Controlling for Confounders
Safe and Secure Autonomous Driving, CVPR 2023
Sruthi Sudhakar, Viraj Prabhu, Olga Russakovsky, Judy Hoffman
Paper
Adapting Self-Supervised Vision Transformers by Probing Attention-Conditioned Masking Consistency
NeurIPS 2022
Viraj Prabhu*, Sriram Yenamandra*, Aaditya Singh, Judy Hoffman (* = equal contribution)
Paper
News
Can domain adaptation make object recognition work for everyone?
Learning with Limited Labelled Data, CVPR 2022
Viraj Prabhu, Ramprasaath R. Selvaraju, Judy Hoffman, Nikhil Naik
Paper
AUGCO: Augmentation Consistency-guided Self-training for Source-free Domain Adaptive Segmentation
Computer Vision in the Wild, ECCV 2022 (spotlight)
Viraj Prabhu*, Shivam Khare*, Deeksha Kartik, Judy Hoffman (* = equal contribution)
Paper
Video
UDIS: Unsupervised Discovery of Bias in Deep Visual Recognition Models
BMVC 2021
Arvind Krishnakumar, Viraj Prabhu, Sruthi Sudhakar, Judy Hoffman
Paper
Code
Mitigating Bias in Visual Transformers via Targeted Alignment
BMVC 2021
Sruthi Sudhakar, Viraj Prabhu, Arvind Krishnakumar, Judy Hoffman
Paper
Selective Entropy Optimization via Committee Consistency for Unsupervised Domain Adaptation
ICCV 2021
Viraj Prabhu, Shivam Khare, Deeksha Kartik, Judy Hoffman
Paper
Project Page
Code
Video
Slides
Poster
Active Domain Adaptation via Clustering Uncertainty-weighted Embeddings
ICCV 2021
Viraj Prabhu, Arjun Chandrasekaran, Kate Saenko, Judy Hoffman
Paper
Project Page
Code
Video
Slides
Poster
Open Set Medical Diagnosis
Machine Learning for Health, NeurIPS 2019
Viraj Prabhu, Anitha Kannan, Geoffrey J. Tso, Namit Katariya, Manish Chablani, David Sontag, Xavier
Amatriain
Paper
Few-shot Learning for Dermatological Disease Diagnosis
MLHC 2019
(spotlight)
Viraj Prabhu, Anitha Kannan, Murali Ravuri, Manish Chablani, David Sontag, Xavier Amatriain
Paper
Do Explanations make VQA Models more Predictable to a Human?
EMNLP 2018
Arjun Chandrasekaran*, Viraj Prabhu*, Deshraj Yadav*, Prithvijit Chattopadhyay*, Devi Parikh (* = equal contribution)
Paper
The Promise of Premise: Harnessing Question Premises in Visual Question Answering
EMNLP 2017
Aroma Mahendru*, Viraj Prabhu*, Akrit Mohapatra*, Dhruv Batra, Stefan Lee (* = equal contribution)
Paper
Code
Dataset
Evaluating Visual Conversational Agents via Cooperative Human-AI Games
HCOMP
2017
Prithvijit Chattopadhyay*, Deshraj Yadav*, Viraj Prabhu, Arjun Chandrasekaran, Abhishek Das, Stefan
Lee, Dhruv Batra, Devi Parikh (* = equal contribution)
Paper
Code