NDLI: An approach to automatic recognition of spontaneous facial actions

Content Provider	IEEE Xplore Digital Library
Author	Braathen, B. Bartlett, M.S. Littlewort, G. Smith, E. Movellan, J.R.
Copyright Year	2002
Description	Author affiliation: Inst. for Neural Comput., Univ. of California, San Diego, CA, USA (Braathen, B.; Bartlett, M.S.; Littlewort, G.; Smith, E.; Movellan, J.R.)
Abstract	Presents work on a project for the automatic recognition of spontaneous facial actions. Spontaneous facial expressions differ substantially from posed expressions, similar to how spontaneous speech differs from directed speech. Previous methods for automatic facial expression recognition assumed images were collected in controlled environments in which the subjects deliberately faced the camera. Since people often nod or turn their heads, automatic recognition of spontaneous facial behavior requires methods for handling out-of-image-plane head rotations. There are many promising approaches to address the problem of out-of-image plane rotations. In this paper, we explore an approach based on 3D warping of images into canonical views. A front-end system was developed that jointly estimates camera parameters, head geometry and 3D head pose across entire sequences of video images. First, a small set of images was used to estimate camera parameters and 3D face geometry. Markov-chain Monte-Carlo methods were then used to recover the most likely sequence of 3D poses given a sequence of video images. Once the 3D pose was known, we warped each image into frontal views with a canonical face geometry. We evaluated the performance of the approach as a front-end for a spontaneous expression recognition system using support vector machines and hidden Markov models. This system employed general-purpose learning mechanisms that can be applied to recognition of any facial movement. We showed that 3D tracking and warping, followed by machine learning techniques directly applied to the warped images, is a viable and promising technology for automatic facial expression recognition. One exciting aspect of the approach presented is that information about movement dynamics emerged out of filters which were derived from the statistics of images.
Sponsorship	IEEE Comput. Soc
Starting Page	360
Ending Page	365
File Size	308828
Page Count	6
File Format	PDF
ISBN	0769516025
DOI	10.1109/AFGR.2002.1004180
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2002-05-21
Publisher Place	USA
Access Restriction	Subscribed
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Face recognition Magnetic heads Cameras Geometry Speech Image recognition Parameter estimation Automatic control Support vector machines Hidden Markov models
Content Type	Text
Resource Type	Article

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in