Facial Behavior Analysis
As an important channel of nonverbal communication, the facial reveals a wealth of information about an individual’s affective and cognitive state (e.g., emotions, intentions, and engagement). Thus, automated analysis of facial behavior has the potential to enhance fields ranging from human-computer interaction and consumer electronics to science and healthcare.
Our work explores all aspects of facial behavior including head pose, head motion, facial expression, and eye gaze. For example, automatic detection and analysis of facial Action Units is an essential building block in nonverbal behavior and emotion recognition systems. In addition to Action Units, head pose and gesture also play a significant role in emotion and social signal perception and expression. Finally, gaze direction is important when evaluating things like attentiveness, social skills, and mental health, as well as the intensity of emotions. In our work, we develop methods to analyze the modalities mentioned above, especially in challenging real-world environments.
Publications
L. Gui, T. Baltrusaitis and L.-P. Morency. Curriculum Learning for Facial Expression Recognition. In Proceedings of the IEEE Conference on Automatic Face and Gesture Recognition (FG), 2017
T. Baltrušaitis, P. Robinson and L.-P. Morency, OpenFace: An Open Source Facial Behavior Analysis Toolkit, In Proceedings of the IEEE Winter Conference on Applications of Computer Vision (WACV), 2016
S. Ghosh, E. Laksana, S. Scherer, and L.-P. Morency, A Multi-label Convolutional Neural Network Approach to Cross-Domain Action Unit Detection. In Proceedings of International Conference on Affective Computing and Intelligent Interaction (ACII), 2015
M. Khademi and L.-P. Morency, Relative Facial Action Unit Detection. In Proceedings of the IEEE Winter conference on Applications of Computer Vision (WACV), 2014
G. Stratou, A. Ghosh, P. Debevec and L.-P. Morency. Exploring the Effect of Illumination on Automatic Expression Recognition using the ICT-3DRFE Database. Image and Vision Computing, Elsevier, Volume 30, Issue 10, October 2012