The Krasnow Institute for Advanced Study, of George Mason University

George Mason University

Krasnow Institute > Monday Seminars > Abstracts

AFFECTIVE ANIMATED AGENTS:
Some Computer Vision and Graphics Issues

Thomas S. Huang
Department of Electrical and Computer Engineering
Coordinated Science Laboratory
Beckman Institute for Advanced Science and Technology
University of Illinois at Urbana-Champaign

A conventional computer agent exchanges information with the human user. An affective agent exchanges, in addition to information, affects (emotion, cognitive states, etc.) with the human user. When an affective agent manifests itself as a displayed talking head, we call it an Affective Animated Agent (A3). An A3 has three major components. First, through multimodality sensors (video cameras, audio microphones, etc.) it tries to understand the human user and recognize his or her affective state. Then, through reasoning and learning, it decides how to respond. Finally, the response is manifested by synthesized speech and an expressive talking head. This talk will concentrate on two problems related to computer vision and graphics. The first is the recognition of human emotion by combining cues from facial expressions and tone of voice. The second is the synthesis of an expressive talking head and expressive speech. Some preliminary results will be presented, but the main objective of this talk is to present some of the challenging research issues in A3, and to stimulate interest.

Back to Top

The Krasnow Institute for Advanced Study
Mail Stop 2A1, George Mason University, Fairfax, VA 22030
Phone: (703) 993-4333 Fax: (703) 993-4325
Email: krasnow-webmaster@gmu.edu