NDLI: Multimodal Affect: Perceptually Evaluating an Affective Talking Head

Please wait, while we are loading the content...

Multimodal Affect: Perceptually Evaluating an Affective Talking Head

Content Provider	ACM Digital Library
Author	Castillo, Susana Legde, Katharina Cunningham, Douglas W.
Copyright Year	2015
Description	Author Affiliation: Brandenburg University of Technology, Cottbus, Deutschland(Brandenburg university of technology, Cottbus, Deutschlan (Castillo, Susana; Cunningham, Douglas W.); Legde, Katharina)
Abstract	Many tasks such as driving or rapidly sorting items can be best achieved by direct actions. Other tasks such as giving directions, being guided through a museum, or organizing a meeting are more easily solved verbally. Since computers are increasingly being used in all aspects of daily life, it would be of great advantage if we could communicate verbally with them. Although advanced interactions with computers are possible, a vast majority of interactions are still based on the WIMP (Window, Icon, Menu, Point) metaphor [Hevner and Chatterjee 2010] and are, therefore, via simple text and gesture commands. The field of affective interfaces is working toward making computers more accessible by giving them (rudimentary) natural-language abilities, including using synthesized speech, facial expressions, and virtual body motions. Once the computer is granted a virtual body, however, it must be given the ability to use it to nonverbally convey socio-emotional information (such as emotions, intentions, mental state, and expectations) or it will likely be misunderstood. Here, we present a simple affective talking head along with the results of an experiment on the multimodal expression of emotion. The results show that although people can sometimes recognize the intended emotion from the semantic content of the text even when the face does not convey affect, they are considerably better at it when the face also shows emotion. Moreover, when both face and text convey emotion, people can detect different levels of emotional intensity.
Starting Page	1
Ending Page	17
Page Count	17
File Format	PDF
ISSN	15443558
e-ISSN	15443965
DOI	10.1145/2811265
Volume Number	12
Issue Number	4
Journal	ACM Transactions on Applied Perception (TAP)
Language	English
Publisher	Association for Computing Machinery (ACM)
Publisher Date	2015-09-08
Publisher Place	New York
Access Restriction	One Nation One Subscription (ONOS)
Subject Keyword	Affective interfaces Emotion Facial animation Speech
Content Type	Text
Resource Type	Article
Subject	Experimental and Cognitive Psychology Theoretical Computer Science Computer Science

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Toward Perceptually Realistic Talking Heads: Models, Methods, and McGurk

Evaluating Animated Characters: Facial Motion Magnitude Influences Personality Perceptions

Evaluating the perceptual realism of animated facial expressions

Emotional Chinese talking head system

A multimodal approach of generating 3D human-like talking agent

Primal emotional-affective expressive foundations of human facial expression

Evaluation of real-world and computer-generated stylized facial expressions

Classifying pretended and evoked facial expressions of positive and negative affective states using infrared measurement of skin temperature

Exploring Cross-Modality Affective Reactions for Audiovisual Emotion Recognition

Multimodal Affect: Perceptually Evaluating an Affective Talking Head

Similar Documents

Toward Perceptually Realistic Talking Heads: Models, Methods, and McGurk

Evaluating Animated Characters: Facial Motion Magnitude Influences Personality Perceptions

Evaluating the perceptual realism of animated facial expressions

Emotional Chinese talking head system

A multimodal approach of generating 3D human-like talking agent

Primal emotional-affective expressive foundations of human facial expression

Evaluation of real-world and computer-generated stylized facial expressions

Classifying pretended and evoked facial expressions of positive and negative affective states using infrared measurement of skin temperature

Exploring Cross-Modality Affective Reactions for Audiovisual Emotion Recognition

Multimodal Affect: Perceptually Evaluating an Affective Talking Head