Interpersonal Dynamics
The success of video-sharing and social network websites has led to an increased posting of online multimedia content, with a large proportion of these videos being human-centric. The sheer amount of such data promotes research on behavior understanding that can discover the affective and social states within human-centric multimedia content. We can model personality and social interaction via temporal modeling and multimodal fusion.
Rapport: Rapport is a harmonious relationship in which people are coordinated and understand each other. The power of rapport in social interactions has inspired us to develop the intelligent virtual agent that induces the subjective feeling and many of the behavioral benefits of the psychological concept of rapport. Moreover, we develop the system of automatic detection for remote peer tutoring.
Persuasiveness: Persuasiveness is a high-level personality trait that quantifies the influence a speaker has on the beliefs, attitudes, intentions, motivations, and behavior of the audience. With social multimedia becoming an important channel in propagating ideas and opinions, analyzing persuasiveness is very important. Inspired by the success of deep learning techniques, we study the persuasiveness prediction with deep multimodal fusion that combines signals from the visual, acoustic, and text modalities effectively.
Publications
A. Rizzo, G. Lucas, J. Gratch, G. Stratou, L.-P. Morency, K. Chavez, R. Shilling, and S. Scherer, Automatic Behavior Analysis During a Clinical Interview with a Virtual Human, In Proceedings of the Annual Conference on Medicine Meets Virtual Reality (NextMed/MMVR), J. D. Westwood et al. (Ed), IOS Press, 2016
A. Rizzo, G. Lucas, J. Gratch, G. Stratou, L.-P. Morency, R. Shilling, A. Hartholt and S. Scherer, Clinical interviewing by a virtual human agent with automatic behavior analysis, In Proceedings of the International Conference on Disability, Virtual Reality & Associated Technologies (ICDVRAT), 2016 ** Best Paper Award **
G. Stratou, L.-P. Morency, D. Devault, A. Hartholt, E. Fast, M. Lhommet, G. Lucas, F. Morbini, K. Georgila, S. Scherer, J. Gratch, S. Marsella, D. Traum and A. Rizzo, A Demonstration of the Perception System in SimSensei, a Virtual Human Application for Healthcare Interviews, Demo Paper at the sixth International Conference on Affective Computing and Intelligent Interaction (ACII), 2015 **Best demo paper award**
A. Rizzo, R. Shilling, E. Forbell, S. Scherer, J. Gratch, and L.-P. Morency, Autonomous Virtual Human Agents for Healthcare Information Support and Clinical Interviewing, Luxton, D.D. (Ed). Artifical Intelligence in Mental Healthcare Practice. Academic Press, 2015, pp. 53 – 80.
M. Ziaeefard, R. Bergevin and L.-P. Morency, Time-slice Prediction of Dyadic Human Activities. In Proceedings of the British Machine Vision conference (BMVC), 2015
C.-C. Chiu, L.-P. Morency and S. Marsella. Predicting Co-verbal Gestures: A Deep and Temporal Modeling Approach. In Proceedings of the International Conference on Intelligent Virtual Agents (IVA), 2015.
S. Park, S. Scherer, J. Gratch, P. Carnevale and L.-P. Morency. I Can Already Guess Your Answer : Predicting Respondent Reactions during Dyadic Negotiation. IEEE Transactions on Affective Computing, Volume 6, Issue 2, April-June 2015, Pages 86-96
J. Gratch, S. Hill, L.-P. Morency, D. Pynadath, and D. Traum. Exploring the implications of virtual human research for human-robot teams. In Proceedings of the International Conference on Human-Computer Interaction (HCII), 2015.
L.-P. Morency, A. Shapiro and S. Marsella. Modeling Human Communication Dynamics for Virtual Human. Coverbal synchrony in Human-Machine Interaction, Matej Rojc and Nick Campbell, Editors, Science Publishers/CRC Press, 2014
G. Lucas, J. Gratch, A. King and L.-P. Morency, It’s only a computer: Virtual humans increase willingness to disclose, Computers in Human Behavior, Volume 37, August 2014, Pages 94–100
S. Scherer, Z. Hammal, Y. Yang, L.-P. Morency and J. Cohn, Dyadic Behavior Analysis in Depression Severity Assessment Interviews. In Proceedings of the ACM International Conference on Multimodal Interaction (ICMI), 2014
E. Nouri, S. Park, S. Scherer, J. Gratch, P. Carnevale, L.-P. Morency and D. Traum. Prediction of Strategy and Outcome as Negotiation Unfolds by Using Basic Verbal and Behavioral Features. In Proceedings of the 14th Annual Conference of the International Speech Communication Association (Interspeech), 2013
S. Park, S. Scherer, J. Gratch, P. Carnevale, and L.-P. Morency. Mutual Behaviors during Dyadic Negotiation: Automatic Prediction of Respondent Reactions. In Proceedings of International Conference on Affective Computing and Intelligent Interaction (ACII), 2013