Publications

A. K. Vail, J. Girard, L. Bylsma, J. Cohn, J. Fournier, H. Swartz, L.-P. Morency. Goals, Tasks, and Bonds: Toward the Computational Assessment of Therapist Versus Client Perception of Working Alliance. FG, 2021.

A. Vail, J. Girard, L. Bylsma, J. Cohn, J. Fournier, H. Swartz, L.-P. Morency. Toward Causal Understanding of Therapist-Client Relationships: A Study of Language Modality and Social Entrainment. ICMI, 2022.

Paul Pu Liang, Yun Cheng, Xiang Fan, Chun Kai Ling, Suzanne Nie, Richard Chen, Zihao Deng, Nicholas Allen, Randy Auerbach, Faisal Mahmood, Ruslan Salakhutdinov, Louis-Philippe Morency. Quantifying & Modeling Multimodal Interactions: An Information Decomposition Framework. NeurIPS 2023

Paul Pu Liang*, Zihao Deng*, Martin Ma*, James Zou, Louis-Philippe Morency, Ruslan Salakhutdinov. Factorized Contrastive Learning: Going Beyond Multi-view Redundancy. NeurIPS 2023

Dong Won Lee, Chaitanya Ahuja, Paul Pu Liang, Sanika Natu, Louis-Philippe Morency. Multimodal Lecture Presentations Dataset: Understanding Multimodality in Educational Slides. ICCV 2023

Chaitanya Ahuja, Pratik Joshi, Ryo Ishii, Louis-Philippe Morency. Continual Learning for Personalized Co-speech Gesture Generation. ICCV 2023

Paul Pu Liang, Yun Cheng, Ruslan Salakhutdinov, Louis-Philippe Morency. Multimodal Fusion Interactions: A Study of Human and Automatic Quantification. ICMI 2023

T. Wörtwein, N. B. Allen, L. B. Sheeber, R. P. Auerbach, J. F. Cohn, L.-P. Morency. Neural Mixed Effects for Nonlinear Personalized Predictions. In Proceedings of the 2023 International Conference on Multimodal Interaction (ICMI’23).

Alexandria K Vail, Jeffrey M Girard, Lauren M Bylsma, Jay Fournier, Holly A Swartz, Jeffrey F Cohn, Louis-Philippe Morency. Representation Learning for Interpersonal and Multimodal Behavior Dynamics: A Multiview Extension of Latent Change Score Models. ICMI 2023

Leena Mathur, Maja Mataric, Louis-Philippe Morency. Expanding the Role of Affective Phenomena in Multimodal Interaction Research. ICMI 2023

Maneesh Bilalpur, Saurabh Hinduja, Laura Cariola, Lisa Sheeber, Nicholas Allen, Louis-Philippe Morency, Jeffrey F Cohn. SHAP-based Prediction of Mother’s History of Depression to Understand the Influence on Child Behavior. ICMI 2023

Rohan Pandey, Rulin Shao, Paul Pu Liang, Ruslan Salakhutdinov, Louis-Philippe Morency. Cross-modal Attention Congruence Regularization for Vision-Language Relation Alignment. ACL 2023

Himanshu Thakur, Atishay Jain, Praneetha Vaddamanu, Paul Pu Liang, Louis-Philippe Morency. Language Models Get a Gender Makeover: Mitigating Gender Bias with Few-Shot Data Interventions. ACL 2023

Xiang Fan, Yiwei Lyu, Paul Pu Liang, Ruslan Salakhutdinov, Louis-Philippe Morency.  Nano: Nested Human-in-the-Loop Reward Learning for Few-shot Language Model Control. ACL Findings 2023

Lingjing Kong, Martin Q Ma, Guangyi Chen, Eric P Xing, Yuejie Chi, Louis-Philippe Morency, Kun Zhang. Understanding Masked Autoencoders via Hierarchical Latent Variable Models. CVPR 2023

Paul Pu Liang, Yiwei Lyu, Gunjan Chhablani, Nihal Jain, Zihao Deng, Xingbo Wang, Louis-Philippe Morency, Ruslan Salakhutdinov. MultiViz: Towards Visualizing and Understanding Multimodal Models. ICLR 2023

Alex Wilf, Martin Ma, Paul Pu Liang, Amir Zadeh, Louis-Philippe Morency. Face-to-Face Contrastive Learning for Social Intelligence Question-Answering. FG 2023

Cheng-Fu Yang, Yao-Hung Hubert Tsai, Wan-Cyuan Fan, Ruslan Salakhutdinov, Louis-Philippe Morency, Yu-Chiang, Frank Wang. Paraphrasing Is All You Need for Novel Object Captioning. NeurIPS 2022

Paul Pu Liang, Yiwei Lyu, Xiang Fan, Jeffrey Tsaw, Yudong Liu, Dani Yogatama, Louis-Philippe Morency, Ruslan Salakhutdinov. High-Modality Multimodal Transformer: Quantifying Modality & Interaction Heterogeneity for High-Modality Representation Learning. TMLR 2022

Paul Pu Liang, Yiwei Lyu, Xiang Fan, Arav Agarwal, Yun Cheng, Louis-Philippe Morency, Ruslan Salakhutdinov. MultiZoo & MultiBench: A Standardized Toolkit for Multimodal Deep Learning. JMLR Open Source Software 2022

Yuxin Xiao, Paul Pu Liang, Umang Bhatt, Willie Neiswanger, Ruslan Salakhutdinov, Louis-Philippe Morency. Uncertainty Quantification with Pre-trained Language Models: A Large-scale Empirical Analysis. EMNLP Findings 2022

T. Wörtwein, L. B. Sheeber, N. B. Allen, J. F. Cohn, L.-P. Morency. Beyond Additive Fusion: Learning Non-Additive Multimodal Interactions. Findings of the Association for Computational Linguistics: EMNLP 2022 (F-EMNLP ’22).

Samuel Yu, Peter Wu, Paul Pu Liang, Ruslan Salakhutdinov, Louis-Philippe Morency. PACS: A Dataset for Physical Audiovisual Commonsense Reasoning. ECCV 2022

Yiwei Lyu, Paul Pu Liang, Zihao Deng, Ruslan Salakhutdinov, Louis-Philippe Morency. DIME: Fine-grained Interpretations of Multimodal Models via Disentangled Local Explanations. AIES 2022

Arish Alreja, Michael James Ward, Qianli Ma, Mark Richardson, Brian Russ, Stephan Bickel, Nelleke Van Wouwe, Jorge A González-Martínez, Lisa S Parker, Joseph Neimat, Charles Schroeder, Louis-Phillipe Morency, Avniel Singh Ghuman. A Multimodal Approach to Investigate the Neural Mechanisms of Real World Social Vision. bioRxiv (2021).

Yao-Hung Hubert Tsai, Tianqin Li, Weixin Liu, Peiyuan Liao, Ruslan Salakhutdinov, Louis-Philippe Morency. Learning Weakly-supervised Contrastive Representations. ICLR 2022

Tsai, Y. H. H., Li, T., Ma, M. Q., Zhao, H., Zhang, K., Morency, L. P., & Salakhutdinov, R. Conditional Contrastive Learning with Kernel. International Conference on Learning Representations 2022.

P. P. Liang, Y. Lyu, X. Fan, Z. Wu, Y. Cheng, J. Wu, L. Chen, P. Wu, M. Lee, Y. Zhu, R. Salakhutdinov, L.-P. Morency. MultiBench: Multiscale Benchmarks for Multimodal Representation Learning. NeurIPS 2021 Datasets and Benchmarks Track

Y.-H. H. Tsai*, M. Q. Ma*, M. Yang, H. Zhao, L.-P. Morency, R. Salakhutdinov. Self-supervised Representation Learning with Relative Predictive Coding. International Conference on Learning Representations (ICLR) 2021.

Y.-H. H. Tsai, Y. Wu, R. Salakhutdinov, L.-P. Morency. Self-supervised Learning from a Multi-view Perspective. International Conference on Learning Representations (ICLR) 2021

P. Wu, P. P. Liang, J. Shi, R. Salakhutdinov, S. Watanabe, L.-P. Morency. Understanding the Tradeoffs in Client-side Privacy for Downstream Speech Tasks. Asia Pacific Signal and Information Processing Association Annual Summit and Conference 2021

P. P. Liang, C. Wu, L.-P. Morency, R. Salakhutdinov. Towards Understanding and Mitigating Social Biases in Language Models. ICML 2021

P. P. Liang*, T. Liu*, A. Cai, M. Muszynski, R. Ishii, N. Allen, R. Auerbach, D. Brent, R. Salakhutdinov, L.-P. Morency. Learning Language and Multimodal Privacy-Preserving Markers of Mood from Mobile Data. ACL 2021

T. Wörtwein, L. B. Sheeber, N. B. Allen, J. F. Cohn, L.-P. Morency. Human-Guided Modality Informativeness for Affective States. In Proceedings of the 2021 International Conference on Multimodal Interaction (ICMI ’21).

J. Girard*, A. Vail*, E. Liebenthal, K. Brown, C. Kilciksiz, L. Pennant, E. Liebson, D. Öngür, L.-P. Morency, J. Baker. Computational Analysis of Spoken Language in Acute Psychosis and Mania. Schizophrenia Research, 2021. (*equal contribution)

Lee, D. W., Ahuja, C., Morency, L. P. Crossmodal clustered contrastive learning: Grounding of spoken language to gestures. ICMI 2021 Generation and Evaluation of Non-verbal Behaviour for Embodied Agents Workshop

Tsai, Y. H. H., Ma, M. Q., Zhao, H., Zhang, K., Morency, L. P., & Salakhutdinov, R. Conditional contrastive learning: Removing undesirable information in self-supervised representations. arXiv preprint arXiv:2106.02866.

Y. Lyu*, P. P. Liang*, H. Pham*, E. Hovy, B. Póczos, R. Salakhutdinov, L.-P. Morency. StylePTB: A Compositional Benchmark for Fine-grained Controllable Text Style Transfer, NAACL 2021

P. P. Liang, I. Li, E. Zheng, Y. C. Lim, R. Salakhutdinov, L.-P. Morency. Towards Debiasing Sentence Representations, ACL 2020

V. Cirik, T. Berg-Kirkpatrick, L.-P. Morency. Refer360°: A Referring Expression Recognition Dataset in 360° Images, ACL 2020

Kostoulas, T., Muszynski, M., Chaspari, T., & Amelidis, P. (2020, October). Multimodal Affect and Aesthetic Experience. In Proceedings of the 2020 International Conference on Multimodal Interaction (pp. 888-889).

Liu, T., Liang, P. P., Muszynski, M., Ishii, R., Brent, D., Auerbach, R. P., Allen N.B., Morency, L. P. (2020). Multimodal Privacy-preserving Mood Prediction from Mobile Data: A Preliminary Study. In Proceedings of the 34th Conference on Neural Information Processing Systems: Machine Learning for Mobile Health workshop.

V. Lin*, J. M. Girard*, M. A. Sayette, L.-P. Morency (2020). Toward Multimodal Modeling of Emotional Expressiveness. In Proceedings of the 2020 International Conference on Multimodal Interaction (ICMI) (pp. 548-557).

Ishii, R., Ren, X., Muszynski, M., & Morency, L. P. (2020, October). Can Prediction of Turn-management Willingness Improve Turn-changing Modeling?. In Proceedings of the 20th ACM International Conference on Intelligent Virtual Agents (pp. 1-8).

Tsai, Y. H. H.*, Ma, M.*, Yang, M.*, Salakhutdinov, R., & Morency, L. P. (2020, November). Multimodal Routing: Improving Local and Global Interpretability of Multimodal Language Analysis. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP) (pp. 1823-1833).

V. Lin, J. M. Girard, L.-P. Morency (2020). Context-Dependent Models for Predicting and Characterizing Facial Expressiveness. In Proceedings of the AAAI-20 Workshop on Affective Content Analysis.

Ishii, R., Ahuja, C., Nakano, Y. I., & Morency, L. P. (2020, October). Impact of Personality on Nonverbal Behavior Generation. In Proceedings of the 20th ACM International Conference on Intelligent Virtual Agents (pp. 1-8).

Muszynski, M., Zelazny, J., Girard, J. M., & Morency, L. P. (2020, October). Depression Severity Assessment for Adolescents at High Risk of Mental Disorders. In Proceedings of the 2020 International Conference on Multimodal Interaction (pp. 70-78).

Ahuja, C., Lee, D. W., Ishii, R., & Morency, L. P. (2020). No gestures left behind: Learning relationships between spoken language and freeform gestures. Proceedings of Findings at the Conference on Empirical Methods in Natural Language Processing, 2020.

Ahuja, C., Lee, D. W., Nakano, Y. I., & Morency, L. P. (2020). Style Transfer for Co-Speech Gesture Animation: A Multi-Speaker Conditional-Mixture Approach. In proceedings of European Conference on Computer Vision 2020

T. Wörtwein and L.-P. Morency. Simple and Effective Approaches for Uncertainty Prediction in Facial Action Unit Intensity Regression. FG 2020

Tsai, Y. H. H., Bai, S., Yamada, M., Morency, L. P., & Salakhutdinov, R. (2019, November). Transformer Dissection: An Unified Understanding for Transformer’s Attention via the Lens of Kernel. In Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing and the 9th International Joint Conference on Natural Language Processing (EMNLP-IJCNLP) (pp. 4335-4344).

Ahuja, C., Ma S., Morency, L. P., & Sheikh Y. (2019); To React or not to React: End-to-End Visual Pose Forecasting for Personalized Avatar during Dyadic Conversations. ICMI 2019

J.M. Girard, G. Shandar, Z. Liu, J.F. Cohn, L. Yin, L.-P. Morency. Reconsidering the Duchenne smile: Indicator of positive emotion or artifact of smile intensity? ACII 2019

Liang, P. P.*, Liu, Z.*, Tsai, Y. H. H., Zhao, Q., Salakhutdinov, R., & Morency, L. P. (2019, July). Learning Representations from Imperfect Time Series Data via Tensor Rank Regularization. In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics (ACL) (pp. 1569-1576).

Tsai, Y. H. H.*, Bai, S.*, Liang, P. P., Kolter, J. Z., Morency, L. P., & Salakhutdinov, R. (2019, July). Multimodal Transformer for Unaligned Multimodal Language Sequences. In Proceedings of the 57th Annual Meeting of the Association for Computational Linguistics (ACL) (pp. 6558-6569).

M.K. Hasan, W. Rahman, A. Zadeh, J. Zhong, M.I. Tanveer, L.-P. Morency. UR-FUNNY: A Multimodal Language Dataset for Understanding Humor. arXiv 2019

A. Zadeh, Y.-C. Lim, P.P. Liang, L.-P. Morency. Variational Auto-Decoder. arXiv 2019

Y.-H.H. Tsai, S.K. Divvala, L.-P. Morency, R. Salakhutdinov, A. Farhadi. Video Relationship Reasoning using Gated Spatio-Temporal Energy Graph. CVPR 2019

A. Zadeh, M. Chan, P.P. Liang, E. Tong, L.-P. Morency. Social-IQ: A Question Answering Benchmark for Artificial Social Intelligence. CVPR 2019

P.P. Liang*, Y.-C. Lim*, Y-H.H. Tsai, R. Salakhutdinov, L.-P. Morency. Strong and Simple Baselines for Multimodal Utterance Embeddings. NAACL 2019

Y.-H.H. Tsai*, P.P. Liang*, A. Zadeh, L.-P. Morency, R. Salakhutdinov. Learning Factorized Multimodal Representations. ICLR 2019

H. Pham*, P.P. Liang*, T. Manzini, L.-P. Morency, B. Póczos. Found in Translation: Learning Robust Joint Representations by Cyclic Translations Between Modalities. AAAI 2019

Y. Wang, Y. Shen, Z. Liu, P.P. Liang, A. Zadeh, L.-P. Morency. Words Can Shift: Dynamically Adjusting Word Representations Using Nonverbal Behaviors. AAAI 2019

D. Fried*, R. Hu*, V. Cirik*, A. Rohrbach, J. Andreas, L.-P. Morency, T. Berg-Kirkpatrick, K. Saenko, D. Klein, T. Darrell. Speaker-Follower Models for Vision-and-Language Navigation. NeurIPS 2018

Y.-H.H. Tsai*, P.P. Liang*, A. Zadeh, L.-P. Morency, R. Salakhutdinov. Learning Multimodal Representations using Factorized Deep Generative Models. NeurIPS 2018 Workshop on Bayesian Deep Learning

P.P. Liang, Z. Liu, A. Zadeh, L.-P. Morency. Modeling Spatiotemporal Multimodal Language with Recurrent Multistage Fusion. NeurIPS 2018 Workshop on Modeling and Decision-making in the Spatiotemporal Domain

H. Pham*, P.P. Liang*, T. Manzini, L.-P. Morency, B. Póczos. Learning Robust Joint Representations for Multimodal Sentiment Analysis. NeurIPS 2018 Workshop on Interpretability and Robustness in Audio, Speech and Language

V.Sharma, A. Kalra, V. Vaibhav, S. Chaudhary, L. Patel and L.P. Morency. Attend and Attack: Attention Guided Adversarial Attacks on Visual Question Answering Models. NeurIPS 2018 Workshop on Security in Machine Learning

P.P. Liang, Z. Liu, A. Zadeh, L.-P. Morency. Multimodal Language Analysis with Recurrent Multistage Fusion. EMNLP 2018

P.P. Liang, A. Zadeh, L.-P. Morency. Multimodal Local-Global Ranking Fusion for Emotion Recognition. ICMI 2018

A.K. Vail, E. Liebson, J.T. Baker, L.-P. Morency. Toward Objective, Multifaceted Characterization of Psychotic Disorders: Lexical, Structural, and Disfluency Markers of Spoken Language. ICMI 2018.

H. Pham, T. Manzini, P.P. Liang, and B. Póczos. Seq2Seq2Sentiment: Multimodal Sequence to Sequence Models for Sentiment Analysis. ACL 2018 Grand Challenge and Workshop on Human Multimodal Language

Z. Liu, Y. Shen, V.B. Lakshminarasimhan, P.P. Liang, A. Zadeh, and L.-P. Morency. Efficient Low-rank Multimodal Fusion with Modality-Specific Factors. ACL 2018

A. Zadeh, P.P. Liang, J. Vanbriesen, S. Poria, E. Tong, E. Cambria, M. Chen, and L.-P. Morency. Multimodal Language Analysis In The Wild: Cmu-mosei Dataset and Interpretable Dynamic Fusion Graph. ACL 2018

V.Cirik, L.-P.Morency, T. Berg-Kirkpatrick. Visual Referring Expression Recognition: What Do Systems Actually Learn? NAACL 2018

D. Hazarika, S. Poria, A. Zadeh, E. Cambria, L.-P. Morency, and R. Zimmermann. “Conversational Memory Network for Emotion Recognition in Dyadic Dialogue Videos. NAACL 2018

T. Baltrusaitis, A. Zadeh, Y.C. Lim, and L.-P. Morency. OpenFace 2.0: Facial Behavior Analysis Toolkit. FG 2018.

A. Zadeh, P.P. Liang, S. Poria, P. Vij, E. Cambria, L.-P. Morency. Multi-attention Recurrent Network for Human Communication Comprehension. AAAI 2018

A. Zadeh, P.P. Liang, N. Mazumder, S. Poria, E. Cambria, L.-P. Morency. Memory Fusion Network for Multi-view Sequential Learning. AAAI 2018

V. Cirik, L.-P. Morency. Using Syntax to Ground Referring Expressions in Natural Images. AAAI 2018

C. Ahuja, L.-P. Morency. Lattice Recurrent Unit: Improving Convergence and Statistical Efficiency for Sequence Modeling. AAAI 2018

M. Chen*, S. Wang*, P.P. Liang*, T. Baltrušaitis, A. Zadeh, L.-P. Morency, Multimodal Sentiment Analysis with Word-level Fusion and Reinforcement Learning, ICMI, 2017

H. Yu, L. Gui, M. Madaio, A. Ogan, J. Cassell, L.-P. Morency, Temporally Selective Attention Model for Social and Affective State Recognition in Multimedia Content, In Proceedings of the ACM Multimedia, (ACM MM), 2017

B. Nojavanasghari, C.E. Hughes and L.-P. Morency. Exceptionally Social: Design of an Avatar-Mediated Interactive System for Promoting Social Skills in Children with Autism. In Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems, 2017

T. Baltrusaitis, L. Li, L.-P. Morency. Local-Global Ranking for Facial Expression Intensity Estimation. In Proceedings of International Conference on Affective Computing and Intelligent Interaction (ACII), 2017 (to appear)

A. K. Vail, T. Baltrusaitis, L. Pennant, E. Liebson, J. T. Baker, L.-P. Morency. Visual Attention in Schizophrenia: Eye Contact and Gaze Aversion during Clinical Interactions. ACII, 2017.

B. Nojavanasghari, C. Hughes, T. Baltrusaitis and L.-P. Morency. Hand2Face: Automatic Synthesis and Recognition of Hand Over Face Occlusions. In Proceedings of International Conference on Affective Computing and Intelligent Interaction (ACII), 2017 (to appear)

A. Zadeh*, M. Chen*, S. Poria, E. Cambria and L.-P. Morency. Tensor fusion network for multimodal sentiment analysis. In Proceedings of the 2017 Conference on Empirical Methods in Natural Language Processing (EMNLP), 2017

C. Buengeler, F. Klonek, N. Lehmann-Willenbrock, L.-P. Morency and R. Poppe, Killer Apps: Developing Novel Applications That Enhance Team Coordination, Communication, and Effectiveness, Small Group Research, Volume 48, Issue 5, 2017, pp. 591 – 620

T. Wörtwein and S. Scherer. What really matters — An information gain analysis of questions and reactions in automated PTSD screenings. In Proceedings of International Conference on Affective Computing and Intelligent Interaction (ACII), 2017

T.-Y. Hu, C. Raman, S. Medina, L. Gui, T. Baltrusaitis, R. Frederking, L.-P. Morency, A. W Black, M. Eskenazi, Integrating Verbal and Nonvebval Input into a Dynamic Response Spoken Dialogue System, In Proceedings of the AAAI Conference on Artificial Intelligence – Demo Track, 2017

I. Masi, W. AbdAlmageed, F. Chan, J. Choi, S. Harel, J. Kim, K. Kim, J. Leksut, S. Rawls, Y. Wu, T. Hassner, G. Medioni, L.-P. Morency, P. Natarajan, R. Nevatia. Learning Pose-Aware Models for Pose-Invariant Face Recognition in the Wild. IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI)

T. Baltrusaitis, C. Ahuja, and L.-P. Morency. Multimodal Machine Learning: A Survey and Taxonomy. IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI)

A. Zadeh, Y. Lim, T. Baltrusaitis and L.-P. Morency. Convolutional Experts Constrained Local Model for 3D Facial Landmark Detection. ICCV Workshop on 3D Face Tracking in-the-wild, 2017.

T. Wörtwein, T. Baltrusaitis, J. Baker and L.-P. Morency. Computational Analysis of Acoustic Descriptors in Psychotic Patients. In Proceedings of the Annual Conference of the International Speech Communication Association (Interspeech), 2017

H. Wang, A. Meghawat, L.-P. Morency and E. Xing. Select-Additive Learning: Improving Generalization in Multimodal Sentiment Analysis. In Proceedings of the IEEE International Conference on Multimedia & Expo (ICME), 2017

S. Ghosh, M. Chollet, E. Laksana, L.-P. Morency and S. Scherer, Affect-LM: A Neural Language Model for Customizable Affective Text Generation, In Proceedings of the Annual Meeting of the Association for Computational Linguistics (ACL), 2017

S. Poria, E. Cambria, D. Hazarika, N. Mazumder, A. Zadeh and L.-P. Morency, Context-Dependent Sentiment Analysis in User-Generated Videos, In Proceedings of the Annual Meeting of the Association for Computational Linguistics (ACL), 2017

E. Tong*, A. Zadeh*, C. Jones and L.-P. Morency, Combating Human Trafficking with Very Deep Multimodal Models, In Proceedings of the Annual Meeting of the Association for Computational Linguistics (ACL), 2017

W. Pei, T. Baltrušaitis, D. Tax and L.-P. Morency. Temporal Attention-Gated Model for Robust Sequence Classification. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2017

E. Laksana, T. Baltrusaitis, L.-P. Morency and J. Pestian. Investigating Facial Behavior Indicators of Suicidal Ideation. In Proceedings of the IEEE Conference on Automatic Face and Gesture Recognition (FG), 2017

K. Kim, F.-J. Chang, J. Choi, L.-P. Morency, R. Nevatia and G. Medioni. Local-Global Landmark Confidences for Face Recognition. In Proceedings of the IEEE Conference on Automatic Face and Gesture Recognition (FG), 2017

Y. Li, T. Baltrusaitis and L.-P. Morency. Constrained Ensemble Initialization for Facial Landmark Tracking in Video. In Proceedings of the IEEE Conference on Automatic Face and Gesture Recognition (FG), 2017

L. Gui, T. Baltrusaitis and L.-P. Morency. Curriculum Learning for Facial Expression Recognition. In Proceedings of the IEEE Conference on Automatic Face and Gesture Recognition (FG), 2017

A. Zadeh, R. Zellers, E. Pincus, L.-P. Morency, Multimodal Sentiment Intensity Analysis in Videos: Facial Gestures and Verbal Messages, IEEE Intelligent Systems, Volume 31, Issue 6, Nov-Dec 2016

S. Park, H. Shim, M. Chatterjee, K. Sagae and L.-P. Morency, Multimodal Analysis and Prediction of Persuasiveness in Online Social Multimedia, ACM Transactions on Interactive Intelligent Systems (TiiS), Volume 6, Issue 3, October 2016

A. Rizzo, G. Lucas, J. Gratch, G. Stratou, L.-P. Morency, K. Chavez, R. Shilling, and S. Scherer, Automatic Behavior Analysis During a Clinical Interview with a Virtual Human, In Proceedings of the Annual Conference on Medicine Meets Virtual Reality (NextMed/MMVR), J. D. Westwood et al. (Ed), IOS Press, 2016

Yu, S. Zhang and L.-P. Morency, Unsupervised Text Recap Extraction for TV Series, In Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP), 2016

E. Wood, T. Baltrušaitis, L.-P. Morency, P. Robinson, A. Bulling, Learning an Appearance-based Gaze Estimator from one million Synthesised Images, In Proceedings of the Symposium on Eye Tracking Research & Applications (ETRA), 2016

A. Rizzo, G. Lucas, J. Gratch, G. Stratou, L.-P. Morency, R. Shilling, A. Hartholt and S. Scherer, Clinical interviewing by a virtual human agent with automatic behavior analysis, In Proceedings of the International Conference on Disability, Virtual Reality & Associated Technologies (ICDVRAT), 2016 ** Best Paper Award **

M. Chollet, N. Chandrashekhar, A. Shapiro, L.-P. Morency and S. Scherer,  Manipulating the Perception of Virtual Audiences Using Crowdsourced Behaviors, In Proceedings of the International Conference on Intelligent Virtual Agents (IVA), 2016

S. Ghosh, E. Laksana, L.-P. Morency and S. Scherer, An Unsupervised Approach to Glottal Inverse Filtering, In Proceedings of the European Signal Processing Conference (EUSIPCO), 2016

B. Nojavanasghari, D. Gopinath, J. Koushik, T. Baltrušaitis and L.-P. Morency. Deep Multimodal Fusion for Persuasiveness Prediction. In Proceedings of the ACM International Conference on Multimodal Interaction (ICMI), 2016

B. Nojavanasghari, T. Baltrušaitis, C. Hughes and L.-P. Morency. Emoreact: A Multimodal Approach and Dataset for Recognizing Emotional Responses in Children. In Proceedings of the ACM International Conference on Multimodal Interaction (ICMI), 2016

S. Ghosh, E. Laksana, L.-P. Morency and S. Scherer, Representation Learning for Speech Emotion Recognition, In Proceedings of the Annual Conference of the International Speech Communication Association (Interpseech), 2016

E. Wood, T. Baltrušaitis, L.-P. Morency, P. Robinson and A. Bulling, A 3D Morphable Model of the Eye Region, In Proceedings of the Annual Conference of the European Association of Computer Graphics (EuroGraphics), 2016

K. Kim, T. Baltrusaitis, A. Zadeh, L.-P. Morency and G. Medioni, Holistically Constrained Local Model: Going Beyond Frontal Poses for Facial Landmark Detection, In Proceedings of the British Machine Vision Conference (BMVC), 2016

E. Wood, T. Baltrušaitis, L.-P. Morency, P. Robinson and Andreas Bulling, A 3D Morphable Eye Region Model for Gaze Estimation, In Proceedings of the European Conference on Computer Vision (ECCV), 2016

S. Rajagopalan, L.-P. Morency, T. Baltrus̆aitis and R. Goecke, Extending Long Short-Term Memory for Multi-View Structured Learning, In Proceedings of the European Conference on Computer Vision (ECCV), 2016

J. Pestian, M. Sorter, B. Connolly, K. B. Cohen, C. McCullumsmith, J. Gee, L.-P. Morency, S. Scherer, L. Rohlfs, A Machine Learning Approach to Identifying the Thought Markers of Suicidal Subjects: A Prospective Multicenter Trial, Journal on Suicide and Life-Threatening Behavior, 2016

M. Roemmele, S.-M. Morgens, A. S. Gordon, L.-P. Morency, Recognizing Human Actions in the Motion Trajectories of Shapes, In Proceedings of the International Conference on Intelligent User Interfaces (IUI), 2016

S. Ghosh, E. Laksana, L.-P. Morency and S. Scherer, Learning Representations of Affect from Speech, In Proceedings of the International Conference on Learning Representations Workshop (ICLR-W), 2016

S. Vijay, T. Baltrusaitis, L.-P. Morency, L. Pennant, D. Öngür and J. Baker, Computational Study of Psychosis Symptoms and Facial Expressions, CHI  Computing and Mental Health Workshop, 2016

L. Chen, X. Li,  Z. Xia, Z. Song, A. Dubrawski and L.P. Morency, Riding an emotional roller-coaster: A multimodal study of young child’s math problem solving activities, In Proceedings of the Educational Data Mining Conference (EDM), 2016

V. Venek, S. Scherer, L.-P. Morency, A. Rizzo and J. Pestian, Adolescent Suicidal Risk Assessment in Clinician-Patient Interaction, IEEE Transactions on Affective Computing, January 2016

T. Baltrušaitis, P. Robinson and L.-P. Morency, OpenFace: An Open Source Facial Behavior Analysis Toolkit, In Proceedings of the IEEE Winter Conference on Applications of Computer Vision (WACV), 2016

M. Chollet, T. Wörtwein, L.-P. Morency and S. Scherer, A Multimodal Corpus for the Assessment of Public Speaking Ability and Anxiety, In Proceedings of the 10th Language Resources and Evaluation Conference (LREC), 2016

S. Stratou and L.-P. Morency, MultiSense – Context-Aware Nonverbal Behavior Analysis Framework: A Psychological Distress Use Case, IEEE Transactions on Affective Computing, 2016

T.Wörtwein, M. Chollet, A. Shapiro, S. Scherer, and L.-P. Morency. Exploring Feedback Strategies to Improve Public Speaking: An Interactive Virtual Audience Framework. ACM International Joint Conference on Pervasive and Ubiquitous Computing (Ubicomp), 2015

H.S. Shim, S. Park, M. Chatterjee, S. Scherer, K. Sagae, and L.-P. Morency. Acoustic and Para-verbal Indicators of Persuasiveness in Social Multimedia. In Proceedings of the 40th IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2015.

S.Scherer, L.-P. Morency, J. Gratch, and J. Pestian. Reduced Vowel Space is a Robust Indicator of Psychological Distress: A Cross-Corpus Analysis. In Proceedings of the 40th IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2015

T.Wörtwein, L.-P. Morency and S. Scherer, Automatic Assessment and Analysis of Public Speaking Anxiety: A Virtual Audience Case Study. In Proceedings of International Conference on Affective Computing and Intelligent Interaction (ACII), 2015

K. Bousmalis, S. Zafeiriou, L.-P. Morency, M. Pantic and Z. Ghahramani, Variational Infinite Hidden Conditional Random Fields, IEEE Transaction on Pattern Analysis and Machine Intelligence (TPAMI), Volume 37, Issue 9, September 2015, Pages 1917-1929

G. Stratou, L.-P. Morency, D. Devault, A. Hartholt, E. Fast, M. Lhommet, G. Lucas, F. Morbini, K. Georgila, S. Scherer, J. Gratch, S. Marsella, D. Traum and A. Rizzo, A Demonstration of the Perception System in SimSensei, a Virtual Human Application for Healthcare Interviews, Demo Paper at the sixth International Conference on Affective Computing and Intelligent Interaction (ACII), 2015 **Best demo paper award**

A. Rizzo, R. Shilling, E. Forbell, S. Scherer, J. Gratch, and L.-P. Morency, Autonomous Virtual Human Agents for Healthcare Information Support and Clinical Interviewing, Luxton, D.D. (Ed). Artifical Intelligence in Mental Healthcare Practice. Academic Press, 2015, pp. 53 – 80.

S. Ghosh, E. Laksana, S. Scherer, and L.-P. Morency, A Multi-label Convolutional Neural Network Approach to Cross-Domain Action Unit Detection. In Proceedings of International Conference on Affective Computing and Intelligent Interaction (ACII), 2015

V. Cirik, L.-P. Morency and E. Hovy, Chess Q&A : Question Answering on Chess Games, NIPS Workshop on Reasoning, Attention, Memory (RAM), 2015

L. Gui and L.-P. Morency, Learning and Transferring Deep ConvNet Representations with Group-Sparse Factorization, ICCV Workshop on Machine Learning for Intelligent Image and Video Processing, 2015

M. Ziaeefard, R. Bergevin and L.-P. Morency, Time-slice Prediction of Dyadic Human Activities. In Proceedings of the British Machine Vision conference (BMVC), 2015

C.-C. Chiu, L.-P. Morency and S. Marsella. Predicting Co-verbal Gestures: A Deep and Temporal Modeling Approach. In Proceedings of the International Conference on Intelligent Virtual Agents (IVA), 2015.

M.Chatterjee, S. Park, S. Scherer and L.-P. Morency. Combining Two Perspectives on Classifying Multimodal Data for Recognizing Speaker Traits. In Proceedings of the ACM International Conference on Multimodal Interaction (ICMI), 2015 *** Best Paper Award ***

T. Wörtwein, M. Chollet, B. Schauerte, L.-P. Morency, R. Stiefelhagen and S. Scherer. Multimodal Public Speaking Performance Assessment. In Proceedings of the ACM International Conference on Multimodal Interaction (ICMI), 2015

S. Park, S. Scherer, J. Gratch, P. Carnevale and L.-P. Morency. I Can Already Guess Your Answer : Predicting Respondent Reactions during Dyadic Negotiation. IEEE Transactions on Affective Computing, Volume 6, Issue 2, April-June 2015, Pages 86-96

M. Worsley, L.-P. Morency, S. Scherer and P. Blikstein. Exploring Behavior Representation for Learning Analytics. In Proceedings of the ACM International Conference on Multimodal Interaction (ICMI), 2015

J. Gratch, S. Hill, L.-P. Morency, D. Pynadath, and D. Traum. Exploring the implications of virtual human research for human-robot teams. In Proceedings of the International Conference on Human-Computer Interaction (HCII), 2015.

S. Scherer, J. Gratch, A. Rizzo and L.-P. Morency. Self-reported symptoms of depression and PTSD are associated with reduced vowel space in screening interviews. IEEE Transactions on Affective Computing, June 2015

S. Scherer, G. Stratou, G. Lucas, M. Mahmoud, J. Boberg, J. Gratch, A. Rizzo and L.-P. Morency, Automatic Audiovisual Behavior Descriptors for Psychological Disorder Analysis, Image and Vision Computing Journal, Elsevier, Volume 32, Issue 10, October 2014, Pages 648–658

M. Chatterjee, H. S. Shim, S. Park, K. Sagea and L.-P. Morency, Verbal Behaviors and Persuasiveness in Online Multimedia Content. In Proceedings of the AFNLP Special Interest Group on Natural Language Processing for Social Media (SocialNLP), 2014

L.-P. Morency, A. Shapiro and S. Marsella. Modeling Human Communication Dynamics for Virtual Human. Coverbal synchrony in Human-Machine Interaction, Matej Rojc and Nick Campbell, Editors, Science Publishers/CRC Press, 2014

G. Lucas, J. Gratch, A. King and L.-P. Morency, It’s only a computer: Virtual humans increase willingness to disclose, Computers in Human Behavior, Volume 37, August 2014, Pages 94–100

L.-P. Morency. The Role of Context in Affective Behavior Understanding. Social Emotions in Nature and Artifact: Emotions in Human and Human-Computer Interaction, Jonathan Gratch and Stacy Marsella, Editors, Oxford University Press, 2014

T. Baltrusaitis, P. Robinson and L.-P. Morency, Continuous Conditional Neural Fields for Structured Regression. In Proceedings of the 13th European Conference on Computer Vision (ECCV), 2014

K.Bousmalis, S. Zafeiriou, L.–P. Morency, M. Pantic and Z. Ghahramani, Variational Hidden Conditional Random Fields with Coupled Dirichlet Process Mixtures. In Proceedings of the European Conference on Machine Learning and Knowledge Discovery in Databases (ECML/PKDD), 2014

S. Park, P. Shoemark and L.-P. Morency, Toward Crowdsourcing Micro-Level Behavior Annotations: The Challenges of Interface, Training, and Generalization. In Proceedings of the International Conference on Intelligent User Interfaces (IUI), 2014

G. Stratou, S. Scherer, J. Gratch and L.-P. Morency, Automatic Nonverbal Behavior Indicators of Depression and PTSD: The Effect of Gender, Journal on Multimodal User Interfaces, June 2014

D. Devault, A. Rizzo and L.-P. Morency, SimSensei: A Virtual Human Interviewer for Healthcare Decision Support. In Proceedings of the Thirteenth International Conference on Autonomous Agents and Multiagent Systems (AAMAS), 2014

J.Gratch, G. Lucas, A. King, and L.-P. Morency, It’s Only a Computer: The Impact of Human-agent Interaction in Clinical Interviews. In Proceedings of the Thirteenth International Conference on Autonomous Agents and Multiagent Systems (AAMAS), 2014

C.Miller, F. Quek and L.-P. Morency, Search Strategies for Pattern Identification in Multimodal Data: Three Case Studies. In Proceedings of the International Conference on Multimedia Retrieval (ICMR), 2014

M. Chatterjee, G. Stratou, S. Scherer and L.-P. Morency, Context-based Signal Descriptors of Heart-rate Variability for Anxiety Assessment, In Proceedings of the 2014 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2014

S. Park, M. Chatterjee, H. S. Shim, K. Sagea and L.-P. Morency, Computational Analysis of Persuasiveness in Social Multimedia: A Novel Dataset and Multimodal Prediction Approach. In Proceedings of the ACM International Conference on Multimodal Interaction (ICMI), 2014

S. Ghosh, M. Chatterjee, L.-P. Morency, A Multimodal Context-based Approach for Distress Assessment. In Proceedings of the ACM International Conference on Multimodal Interaction (ICMI), 2014

S. Scherer, Z. Hammal, Y. Yang, L.-P. Morency and J. Cohn, Dyadic Behavior Analysis in Depression Severity Assessment Interviews. In Proceedings of the ACM International Conference on Multimodal Interaction (ICMI), 2014

A. B. Zadeh, K. Sagea and L.-P. Morency, Towards Learning Nonverbal Identities from the Web: Automatically Identifying Visually-Accentuated Words. In Proceedings of the 14th International Conference on Intelligent Virtual Agents (IVA), 2014

M. Khademi and L.-P. Morency, Relative Facial Action Unit Detection. In Proceedings of the IEEE Winter conference on Applications of Computer Vision (WACV), 2014

J. Gratch, R. Artstein, G. Lucas, G. Stratou, S. Scherer, A. Nazarian, R. Wood, J. Boberg, D. DeVault, S. Marsella, D. Traum, S. Rizzo, L.-P. Morency, The Distress Analysis Interview Corpus of human and computer interviews. In Proceedings of the Ninth International Conference on Language Resources and Evaluation (LREC), 2014

T. Baltrusaitis, P. Robinson and L.-P. Morency. Constrained Local Neural Fields for Robust Facial Landmark Detection in the Wild. ICCV Workshop on 300 Faces in the Wild, 2013

Y. Song, L.-P. Morency and R. Davis. Action Recognition by Hierarchical Sequence Summarization. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2013

Z. Yu, S. Scherer, D. Devault, J. Gratch, G. Stratou, L.-P. Morency and J. Cassell. Multimodal Prediction of Psychological Disorders: Learning Verbal and Nonverbal Commonalities in Adjacency Pairs. Workshop on the Semantics and Pragmatics of Dialogue (SemDial), 2013

V. P. Rosas, R. Mihalcea and L.-P. Morency. Utterance-Level Multimodal Sentiment Analysis. In  Proceedings of the Annual Meeting of the Association for Computational Linguistics (ACL), 2013

A. S. Gordon, J. R. Hobbs, K. Ovchinnikova, M. Roemmele, and L.-P. Morency. Abduction of Mental States with a Formal Theory of Commonsense Psychology.  In Proceedings of the CogSci Workshop Mental Model Ascription by Language-Enabled Intelligent Agents, 2013

S.Scherer, G. Stratou, J. Boberg, J. Gratch, A. Rizzo and L.-P. Morency. Automatic Behavior Descriptors for Psychological Disorder Analysis. In Proceedings of the IEEE Conference on Automatic Face and Gesture Recognition (FG), 2013 *** Best paper award ***

J.-C. Levesque, C. Gagne and L.-P. Morency. Sequential Emotion Recognition using Latent-Dynamic Conditional Neural Fields. In Proceedings of the IEEE Conference on Automatic Face and Gesture Recognition (FG), 2013

Y. Song, L.-P. Morency and R. Davis. Distribution-Sensitive Learning for Imbalanced Datasets. In Proceedings of the IEEE Conference on Automatic Face and Gesture Recognition (FG), 2013

K. Bousmalis, S. Zafeiriou, L.-P. Morency, M. Pantic and Z. Ghahramani. Variational Hidden Conditional Random Fields with Coupled Dirichlet Process Mixtures. In Proceedings of the European Conference on Machine Learning (ECML), 2013

S.Scherer, J. Pestian, and L.-P. Morency. Investigating the Speech Characteristics of Suicidal Adolescents. In Proceedings of International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2013

J. Kane, S. Scherer, M. Aylett, L.-P. Morency, and C. Gobl. Speaker and Language Independent Voice Quality Classification Applied to Unlabelled Corpora of Expressive Speech. In Proceedings of International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2013

F. Weninger, C. Wagner, M. Wollmer, B. Schuller and L.-P. Morency. Speaker Trait Characterization In Web Videos: Uniting Speech, Language, And Facial Features. In Proceedings of the International Conference on Acoustics, Speech, and Signal Processing (ICASSP), 2013

S.Scherer, G. Stratou, J. Gratch and L.-P. Morency. Investigating Voice Quality as a Speaker-Independent Indicator of Depression and PTSD. In Proceedings of the 14th Annual Conference of the International Speech Communication Association (Interspeech), 2013

J. Kane, S. Scherer, L.-P. Morency, and C. Gobl. A comparative study of glottal open quotient estimation techniques. In Proceedings of the 14th Annual Conference of the International Speech Communication Association (Interspeech), 2013

E. Nouri, S. Park, S. Scherer, J. Gratch, P. Carnevale, L.-P. Morency and D. Traum. Prediction of Strategy and Outcome as Negotiation Unfolds by Using Basic Verbal and Behavioral Features. In Proceedings of the 14th Annual Conference of the International Speech Communication Association (Interspeech), 2013

D. DeVault, K. Georgila, R. Artstein, F. Morbini, D. Traum, S. Scherer, A. Rizzo, L.-P. Morency. Verbal Indicators of Psychological Distress in Interactive Dialogue with a Virtual Human. In Proceedings of the 14th Annual Meeting of the Special Interest Group on Discourse and Dialogue (SigDial), 2013

G. Mohammadi, S. Scherer, A. Vinciarelli and L.-P. Morency. Who is Persuasive? The Role of Perceived Personality and Communication Modality in Social Multimedia. In Proceedings of the ACM International Conference on Multimodal Interaction (ICMI), 2013

S. Scherer, G. Stratou, J. Gratch and L.-P. Morency. Audiovisual Behavior Descriptors for Depression Assessment. In Proceedings of the ACM International Conference on Multimodal Interaction (ICMI), 2013

M. Mahmoud, P. Robinson and L.-P. Morency. Automatic Multimodal Descriptors of Rhythmic Body Movement. In Proceedings of the ACM International Conference on Multimodal Interaction (ICMI), 2013

Y. Song, L.-P. Morency and R. Davis. Learning a Sparse Codebook of Facial and Body Expressions for Audio-Visual Emotion Recognition. In Proceedings of the ACM International Conference on Multimodal Interaction (ICMI), 2013

I.de Kok, L.-P. Morency and D. Heylen. Speaker-Adaptive Multimodal Prediction Model for Listener Responses. In Proceedings of the ACM International Conference on Multimodal Interaction (ICMI), 2013

C. Miller, L.-P. Morency and F. Quek. Interactive Relevance Search and Modeling: Support for Expert-Driven Analysis of Multimodal Data. In Proceedings of the ACM International Conference on Multimodal Interaction (ICMI), 2013

D.Ozkan and L.-P. Morency. Prediction of Visual Backchannels in the Absence of Visual Context Using Mutual Influence. In Proceedings of the Conference on Intelligent Virtual Agents (IVA), 2013

L. Batrinca, G. Stratou, A. Shapiro, L.-P. Morency, and S. Scherer. Cicero – Towards a Multimodal Virtual: Audience Platform for Public Speaking Training. In Proceedings of the Conference on Intelligent Virtual Agents (IVA), 2013

A. Hartholt, D. Traum, S. Marsella, A. Shapiro, G. Stratou, A. Leuski, L.-P. Morency and J. Gratch. All Together Now: Introducing the Virtual Human Toolkit. In Proceedings of the Conference on Intelligent Virtual Agents (IVA) 2013

G. Stratou, S. Scherer, J. Gratch and L.-P. Morency. Automatic Nonverbal Behavior Indicators of Depression and PTSD: Exploring Gender Differences. In Proceedings of International Conference on Affective Computing and Intelligent Interaction (ACII), 2013

S. Park, S. Scherer, J. Gratch, P. Carnevale, and L.-P. Morency. Mutual Behaviors during Dyadic Negotiation: Automatic Prediction of Respondent Reactions. In Proceedings of International Conference on Affective Computing and Intelligent Interaction (ACII), 2013

J. Gratch, L.-P. Morency, S. Scherer, G. Stratou, J. Boberg, S. Koenig, T. Adamson and A. Rizzo. User-State Sensing for Virtual Health Agents and TeleHealth Applications. In Proceedings of Medicine Meets Virtual Reality (MMVR), 2013

M. Wollmer, F. Weninger, T. Knaup, B. Schuller, C. Sun, K. Sagae and L.-P. Morency. YouTube Movie Reviews: In, Cross, and Open-domain Sentiment Analysis in an Audiovisual Context. IEEE Intelligent Systems, Special Issue on Concept-Level Opinion and Sentiment Analysis, March 2013

V. P. Rosas, R. Mihalcea, and L.-P. Morency. Multimodal Sentiment Analysis of Spanish Online Videos, IEEE Intelligent Systems, Special Issue on Concept-Level Opinion and Sentiment Analysis, January 2013

K. Bousmalis, L.-P. Morency, S. Zafeiriou and M. Pantic. Infinite Hidden Conditional Random Fields. IEEE Transactions on Neural Networks and Learning Systems, Volume 24, Issue 1, November 2012

D. Ozkan and L.-P. Morency. Latent Mixture of Discriminative Experts. IEEE Transactions on Multimedia, Volume 15, Issue 2, November 2012

G. Stratou, A. Ghosh, P. Debevec and L.-P. Morency. Exploring the Effect of Illumination on Automatic Expression Recognition using the ICT-3DRFE Database. Image and Vision Computing, Elsevier, Volume 30, Issue 10, October 2012

D.Ozkan, S. Scherer and L.-P. Morency. Step-wise Emotion Recognition using Concatenated-HMM. In Proceedings of the 2nd International Audio/Visual Emotion Challenge and Workshop (AVEC), in conjunction with International Conference on Multimodal Interfaces (ICMI), Santa Monica, October, 2012

S. Park, G. Mohammadi, R. Artstein, and L.-P. Morency. Crowdsourcing Micro-Level Multimedia Annotations: The Challenges of Evaluation and Interface. In the Proceedings of the International ACM Workshop on Crowdsourcing for Multimedia held in conjunction with ACM Multimedia 2012 (CrowdMM), Nara, November, 2012

S. Finkelstein, S. Scherer, A. Ogan, L.-P. Morency and J. Cassell. Investigating the Influence of Virtual Peers as Dialect Models on Students’ Prosodic Inventory. In Proceedings of the Interspeech Workshop on Child, Computer and Interaction (WOCCI), 2012

S. Scherer, N. Weibel, S. Oviatt, and L.-P. Morency. Multimodal Prediction of Expertise and Leadership in Learning Groups. In Proceedings of the 1st International Workshop on Multimodal Learning Analytics (MLA), in conjunction with International Conference on Multimodal Interfaces (ICMI), 2012

S. Scherer, D. Ozkan and L.-P. Morency. Investigating the influence of pause fillers for automatic backchannel prediction. In Proceedings of the Interspeech Workshop on Feedback Behaviors in Dialog, 2012

T.Baltrusaitis, P. Robinson and L.-P. Morency. 3D Constrained Local Model for Rigid and Non-Rigid Facial Tracking. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2012

Y.Song, L.-P. Morency and R. Davis. Multi-View Latent Variable Discriminative Models For Action Recognition. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2012

S. Kang, J. Gratch, C. Sidner, R. Artstein, L. Huang and L.-P. Morency. Towards building a Virtual Counselor: Modeling Nonverbal Behavior during Intimate Self-Disclosure. In Proceedings of the Eleventh International Conference on Autonomous Agents and Multiagent Systems (AAMAS), 2012

A. Sadeghipour, L.-P. Morency and S. Kopp. Gesture-based Object Recognition using Histograms of Guiding Strokes. In Proceedings of the British Machine Vision Conference (BMVC), 2012

C. Sun and L.-P. Morency. Dialogue Act Recognition Using Reweighted Speaker Adaptation. In Proceedings of the 13th Annual SIGdial Meeting on Discourse and Dialogue (SigDial), 2012

S. Scherer, S. Marsella, G. Stratou, Y. Xu, F. Morbini, A. Egan, A. Rizzo, and L.-P. Morency. Perception Markup Language: Towards a Standardized Representation of Perceived Nonverbal Behaviors. In Proceedings of the Conference on Intelligent Virtual Agents (IVA), 2012

S. Park, J. Gratch, and L.-P. Morency. I Already Know Your Answer: Using Nonverbal Behaviors to Predict Immediate Outcomes in a Dyadic Negotiation. In Proceedings of the 14th ACM International Conference on Multimodal Interaction (ICMI), 2012

Y. Song, L.-P. Morency and R. Davis. Multimodal Human Behavior Analysis: Learning Correlation and Interaction Across Modalities. In Proceedings of the ACM International Conference on Multimodal Interactions (ICMI), 2012

C. Miller, L.-P. Morency and F. Quek. Structural and Temporal Inference Search (STIS): Pattern Identification in Multimodal Data. In Proceedings of the ACM International Conference on Multimodal Interactions (ICMI), 2012

M. Burzo, D. McDuff, R. Mihalcea, L.-P. Morency, A. Narvaez and V. Perez-Rosas. Towards Sensing the Influence of Visual Narratives on Human Affect. In Proceedings of the ACM International Conference on Multimodal Interactions (ICMI), 2012

L.-P. Morency. Computational Study of Human Communication Dynamics. In Proceedings of the 2011 joint ACM workshop on Human gesture and behavior understanding (J-HGBU), Arizona, USA, 2011 [Invited paper]

D. Ozkan and L.-P. Morency. Modeling Wisdom of Crowds Using Latent Mixture of Experts. In 49th Annual Meeting of the Association for Computational Linguistics: Human Language Technologies (ACL HLT), 2011

G. Ramirez, T. Baltrusaitis, and L.-P. Morency. Modeling Latent Discriminative Dynamic of Multi-Dimensional Affective Signals. Audio/Visual Emotion Challenge and Workshop (AVEC), 2011 **Winner of the vision-only sub-challenge**

C. Sun, L.-P. Morency. Towards Speaker Adaptation for Dialogue Act Recognition. SEMDIAL workshop on the semantics and pragmatics of dialogue, Los Angeles, USA, September 2011

L. Huang, L.-P. Morency and Jonathan Gratch. A Multimodal End-of-Turn Prediction Model: Learning from Parasocial Consensus Sampling. In Proceedings of the Tenth International Conference on Autonomous Agents and Multiagent Systems (AAMAS), 2011

G. Stratou, A. Ghosh, P. Debevec and L.-P. Morency. Effect of Illumination on Automatic Expression Recognition: A Novel 3D Relightable Facial Database. In Proceedings of the IEEE International Conference on Automatic Face and Gesture Recognition (FG), 2011

K. Bousmalis, L.–P. Morency and M. Pantic. Modeling Hidden Dynamics of Multimodal Cues for Spontaneous Agreement and Disagreement Recognition. In Proceedings of the IEEE International Conference on Automatic Face and Gesture Recognition (FG), 2011

S. Kang, C. Sidner, J. Gratch, R. Artstein, L. Huang and L.-P. Morency. Modeling Nonverbal Behavior of a Virtual Counselor during Intimate Self-Disclosure. In Proceedings of the Conference on Intelligent Virtual Agents (IVA), 2011

L. Huang, L.-P. Morency and J. Gratch, Virtual Rapport 2.0. In Proceedings of the Conference on Intelligent Virtual Agents (IVA), Iceland, 2011

M. Hoque, L.-P. Morency and R. Picard. Are you friendly or just polite? – Analysis of smiles in spontaneous face-to-face interactions. In Proceedings of the conference on Affective Computing and Intelligent Interaction (ACII), Memphis, USA, 2011

L.-P. Morency, R. Mihalcea and P. Doshi. Towards Multimodal Sentiment Analysis: Harvesting Opinions from The Web. In Proceedings of the International Conference on Multimodal Interfaces (ICMI), 2011

J. Chen, A. Demski, T. Han, L.-P. Morency, D. Pynadath, N. Rafidi and P. Rosenbloom. Fusing Symbolic and Decision-Theoretic Problem Solving + Perception in a Graphical Cognitive Architecture. In Proceedings of the conference on Biologically Inspired Cognitive Architectures (BICA), 2011

L.-P. Morency. Modeling Human Communication Dynamics. IEEE Signal Processing Magazine, Volume 27, Issue 6, September 2010

D. Ozkan and L.-P. Morency. Consensus of Self-Based Feature Selection for Nonverbal Behavior Analysis. In Proceedings of the First Workshop on Human Behavior Understanding (HBU), in conjunction with International Conference on Pattern Recognition (ICPR), Istanbul-Turkey, August 22-26, 2010

L. Huang, L.-P. Morency and J. Gratch. Parasocial Consensus Sampling: Combining Multiple Perspectives to Learn Virtual Human Behavior. In Proceedings of the 9th International Conference on Autonomous Agents and Multiagent Systems (AAMAS), 2010 *** Best paper award, Virtual Human track ***

D. Traum and L.-P. Morency. Integration of Visual Perception in Dialogue Understanding for Virtual Humans in Multi-Party interaction. In Proceedings of the International Workshop on Interacting with ECAs as Virtual Characters, 2010

D. Ozkan, K. Sagae and L.-P. Morency. Latent Mixture of Discriminative Experts for Multimodal Prediction Modeling. In Proceedings of the International Conference on Computational Linguistics (COLING), 2010

I. de Kok , D. Ozkan, D. Heylen, L.-P. Morency. Learning and Evaluating Response Prediction Models using Parallel Listener Consensus. In Proceedings of the International Conference on Multimodal Interfaces (ICMI), 2010

S. Kang, C. Sidner, J. Gratch and L.-P. Morency. Turn-taking patterns in self-disclosure interactions with Virtual Agents. Proceedings of the Conference on Intelligent Virtual Agents (IVA), Philadelphia, USA, 2010

L.-P. Morency, J. Whitehill and Javier Movellan. Monocular Head Pose Estimation using Generalized Adaptive View-based Appearance Model. Image and Vision Computing. Elsevier, Volume 28, Issue 5, May 2010

L. Huang, L.-P. Morency and Jonathan Gratch. Learning Backchannel Prediction Model from Parasocial Consensus Sampling: A Subjective Evaluation. Proceedings of the Conference on Intelligent Virtual Agents (IVA), Philadelphia, USA, 2010

L.-P. Morency, I. de Kok and J. Gratch. A Probabilistic Multimodal Approach for Predicting Listener Backchannels. Journal of Autonomous Agents and Multi-Agent Systems, Springer, Volume 20, Issue 1, January 2010

L.-P. Morency. Co-occurrence Graphs: Contextual Representation for Head Gesture Recognition during Multi-Party Interactions. In Proceedings of the ICMI-MLMI Workshop on Use of Context for Visual Processing, Boston, MA, 2009

L.-P. Morency, J. Whitehill and Javier Movellan.  Generalized Adaptive View-based Appearance Model: Integrated Framework for Monocular Head Pose Estimation. 8th International Conference on Automatic Face and Gesture Recognition (FG), September 2008 **Best paper award**

L.-P. Morency, I. de Kok and J. Gratch.  Context-based Recognition during Human Interactions: Automatic Feature Selection and Encoding Dictionary. 10th International Conference on Multimodal Interfaces (ICMI), October 2008 **Best paper award**

L.-P. Morency, I. de Kok and J. Gratch.  Predicting Listener Backchannels: A Probabilistic Multimodal Approach. Conference on Intelligent Virtual Agents (IVA), September 2008 **Best paper award**

X. Sun, L.-P. Morency, D. Okanohara, Y Tsuruoka and Jun’ichi Tsujii.  Modeling Latent-Dynamic in Shallow Parsing: A Latent Conditional Model with Improved Inference. The 22nd International Conference on Computational Linguistics (COLING), August 2008

J. Hendler, P. Cimiano, D. Dolgov, A. Levin, P. Mika, B. Milch, L.-P. Morency, B. Motik, J. Neville, E. B. Sudderth, and L. von Ahn. AI’s 10 to Watch. Intelligent Systems, IEEE press, May/June 2008

L.-P. Morency. Real-Time Head Pose Estimation Using A Webcam: Monocular Adaptive View-Based Appearance Model. Proceedings of the 27th Army Science Conference, December 2008

A. Rahimi, L.-P. Morency, and T. Darrell. Reducing Drift in Differential Tracking. Computer Vision and Image Understanding, Elsevier, Volume 109, Issue 2, February 2008

A. Quattoni, S. Wang, L.-P. Morency, M. Collins, and T. Darrell. Hidden Conditional Random Fields. IEEE Transactions on Pattern Analysis and Machine Intelligence (TPAMI), Volume 29, Issue 10, October 2007

L.-P. Morency and T. Darrell. Conditional Sequence Model for Context-based Recognition of Gaze Aversion. In Proceedings of the 4th Joint Workshop on Machine Learning and Multimodal Interaction, June 2007

L.-P. Morency, C. Sidner, and T. Darrell. Visual Feedback Recognition for Embodied Agent: The role of contextual information. Engineering Approaches to Conversational Informatics, Toyoaki Nishida, Editor. John Wiley & Sons, 2007

L.-P. Morency, C. Sidner, C. Lee, and T. Darrell. Head Gestures for Perceptual Interfaces: The Role of Context in Improving Recognition. Artificial Intelligence. Elsevier, Volume 171, Issue 8-9, June 2007