3-Dimensional Character Animations
Open Source HapFACS 3.0 software for realistic facial expression generationOur HapFACS 3.0 open source software for facial expression generation based on Ekman’s (1992) Facial Action Coding Systems (FACS) – the current standard on facial coding of the human face – enables:
(1) researchers on 3-dimensional animated characters – without expertise in computer graphics nor in FACS – to design a set of FACS-based facial expressions a collection of virtual characters, and to integrate their expressive avatars in their applications; and
(2) researchers on facial expression recognition to experiment with realistically generated expressions at the level of 49 individual Action Units (AUs), including bilateral (49 AUs) and unilateral (14 AUs). Over 20 research labs have used our open source software.
Publication: Amini, R., Lisetti, C., & Ruiz, G. (2015). HapFACS 3.0: Open-Source FACS-Based Facial Expression Generator for 3D speaking virtual characters. IEEE Trans. on Affective Computing, Vol. 6(4), pp 348-360.
3D Virtual Avatars Signing in American Sign LanguageWith funding from the National Science Foundation, and in collaboration with the Institute for Disabilities Research and Training (IDRT), we designed 3D Signing Virtual Agents that can dynamically sign in American Sign Language (ASL). We generated signing animations on 3D characters during real-time motion capture of human signers ASL gestures and of their facial expressions.