Publications

Rohan Pandey, Rulin Shao, Paul Pu Liang, Ruslan Salakhutdinov, Louis-Philippe Morency. Cross-modal Attention Congruence Regularization for Vision-Language Relation Alignment. ACL 2023

Himanshu Thakur, Atishay Jain, Praneetha Vaddamanu, Paul Pu Liang, Louis-Philippe Morency. Language Models Get a Gender Makeover: Mitigating Gender Bias with Few-Shot Data Interventions. ACL 2023

Xiang Fan, Yiwei Lyu, Paul Pu Liang, Ruslan Salakhutdinov, Louis-Philippe Morency.  Nano: Nested Human-in-the-Loop Reward Learning for Few-shot Language Model Control. ACL Findings 2023

Lingjing Kong, Martin Q Ma, Guangyi Chen, Eric P Xing, Yuejie Chi, Louis-Philippe Morency, Kun Zhang. Understanding Masked Autoencoders via Hierarchical Latent Variable Models. CVPR 2023

Paul Pu Liang, Yiwei Lyu, Gunjan Chhablani, Nihal Jain, Zihao Deng, Xingbo Wang, Louis-Philippe Morency, Ruslan Salakhutdinov. MultiViz: Towards Visualizing and Understanding Multimodal Models. ICLR 2023

Alex Wilf, Martin Ma, Paul Pu Liang, Amir Zadeh, Louis-Philippe Morency. Face-to-Face Contrastive Learning for Social Intelligence Question-Answering. FG 2023

Cheng-Fu Yang, Yao-Hung Hubert Tsai, Wan-Cyuan Fan, Ruslan Salakhutdinov, Louis-Philippe Morency, Yu-Chiang, Frank Wang. Paraphrasing Is All You Need for Novel Object Captioning. NeurIPS 2022

Paul Pu Liang, Yiwei Lyu, Xiang Fan, Jeffrey Tsaw, Yudong Liu, Dani Yogatama, Louis-Philippe Morency, Ruslan Salakhutdinov. High-Modality Multimodal Transformer: Quantifying Modality & Interaction Heterogeneity for High-Modality Representation Learning. TMLR 2022

Paul Pu Liang, Yiwei Lyu, Xiang Fan, Arav Agarwal, Yun Cheng, Louis-Philippe Morency, Ruslan Salakhutdinov. MultiZoo & MultiBench: A Standardized Toolkit for Multimodal Deep Learning. JMLR Open Source Software 2022

Yuxin Xiao, Paul Pu Liang, Umang Bhatt, Willie Neiswanger, Ruslan Salakhutdinov, Louis-Philippe Morency. Uncertainty Quantification with Pre-trained Language Models: A Large-scale Empirical Analysis. EMNLP Findings 2022