NDLI: Analyses of a Multimodal Spontaneous Facial Expression Database

Please wait, while we are loading the content...

Analyses of a Multimodal Spontaneous Facial Expression Database

Content Provider	IEEE Xplore Digital Library
Author	Wang, Shangfei Liu, Zhilei Wang, Zhaoyu Wu, Guobing Shen, Peijia He, Shan Wang, Xufa
Copyright Year	2010
Abstract	Creating a large and natural facial expression database is a prerequisite for facial expression analysis and classification. It is, however, not only time consuming but also difficult to capture an adequately large number of spontaneous facial expression images and their meanings because no standard, uniform, and exact measurements are available for database collection and annotation. Thus, comprehensive first-hand data analyses of a spontaneous expression database may provide insight for future research on database construction, expression recognition, and emotion inference. This paper presents our analyses of a multimodal spontaneous facial expression database of natural visible and infrared facial expressions (NVIE). First, the effectiveness of emotion-eliciting videos in the database collection is analyzed with the mean and variance of the subjects' self-reported data. Second, an interrater reliability analysis of raters' subjective evaluations for apex expression images and sequences is conducted using Kappa and Kendall's coefficients. Third, we propose a matching rate matrix to explore the agreements between displayed spontaneous expressions and felt affective states. Lastly, the thermal differences between the posed and spontaneous facial expressions are analyzed using a paired-samples t-test. The results of these analyses demonstrate the effectiveness of our emotion-inducing experimental design, the gender difference in emotional responses, and the coexistence of multiple emotions/expressions. Facial image sequences are more informative than apex images for both expression and emotion recognition. Labeling an expression image or sequence with multiple categories together with their intensities could be a better approach than labeling the expression image or sequence with one dominant category. The results also demonstrate both the importance of facial expressions as a means of communication to convey affective states and the diversity of the displayed manifestations of felt emotions. There are indeed some significant differences between the temperature difference data of most posed and spontaneous facial expressions, many of which are found in the forehead and cheek regions.
Starting Page	34
Ending Page	46
Page Count	13
File Size	1216471
File Format	PDF
ISSN	19493045
Volume Number	4
Issue Number	1
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2013-01-01
Publisher Place	U.S.A.
Access Restriction	One Nation One Subscription (ONOS)
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Face recognition Image sequences Labeling Image segmentation Emotion recognition database construction analysis Spontaneous facial expression
Content Type	Text
Resource Type	Article
Subject	Human-Computer Interaction Software

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

A Natural Visible and Infrared Facial Expression Database for Expression Recognition and Emotion Inference

DISFA: A Spontaneous Facial Action Intensity Database

Facial Expression Recognition in the Encrypted Domain Based on Local Fisher Discriminant Analysis

Automatic facial expression recognition using features of salient facial patches

Fully automated recognition of spontaneous facial expressions in videos using random forest classifiers

Exploring Cross-Modality Affective Reactions for Audiovisual Emotion Recognition

Thermal Analysis of Facial Muscles Contractions

Component-Based Recognition of Facesand Facial Expressions

Multimodal emotion recognition in speech-based interaction using facial expression, body gesture and acoustic analysis

Analyses of a Multimodal Spontaneous Facial Expression Database

Similar Documents

A Natural Visible and Infrared Facial Expression Database for Expression Recognition and Emotion Inference

DISFA: A Spontaneous Facial Action Intensity Database

Facial Expression Recognition in the Encrypted Domain Based on Local Fisher Discriminant Analysis

Automatic facial expression recognition using features of salient facial patches

Fully automated recognition of spontaneous facial expressions in videos using random forest classifiers

Exploring Cross-Modality Affective Reactions for Audiovisual Emotion Recognition

Thermal Analysis of Facial Muscles Contractions

Component-Based Recognition of Facesand Facial Expressions

Multimodal emotion recognition in speech-based interaction using facial expression, body gesture and acoustic analysis

Analyses of a Multimodal Spontaneous Facial Expression Database