NDLI: Learning and synthesizing MPEG-4 compatible 3-D face animation from video sequence

Please wait, while we are loading the content...

Learning and synthesizing MPEG-4 compatible 3-D face animation from video sequence

Content Provider	IEEE Xplore Digital Library
Author	Wen Gao Yiqiang Chen Rui Wang Shiguang Shan Dalong Jiang
Copyright Year	1991
Abstract	We present a new system that applies an example-based learning method to learn facial motion patterns from a video sequence of individual facial behavior such as lip motion and facial expressions, and using that to create vivid three-dimensional (3-D) face animation according to the definition of MPEG-4 face animation parameters. The system consists of three key modules, face tracking, pattern learning, and face animation. In face tracking, to reduce the complexity of the tracking process, a novel coarse-to-fine strategy combined with a Kalman filter is proposed for localizing key facial landmarks in each image of the video. The landmarks' sequence is normalized into a visual feature matrix and then fed to the next step of process. In pattern learning, in the pretraining stage, the parameters of the camera that took the video are requested with the training video data so the system can estimate the basic mapping from a normalized two-dimensional (2-D) visual feature matrix to the representation in 3-D MPEG-4 face animation parameter space, in assistance with the computer vision method. In the practice stage, considering that in most cases camera parameters are not provided with video data, the system uses machine learning technology to complement the incomplete 3-D information for the mapping that information is needed in face orientation presentation. The example-based learning in this system integrates several methods including clustering, HMM, and ANN to make a better conversion from a 2-D to 3-D model and better estimation of incomplete 3-D information for good mapping; this will be used to drive face animation thereafter. In face animation, the system can synthesize face animation following any type of face motion in video. Experiments show that our system produces more vivid face motion animation, compared to other early systems.
Sponsorship	IEEE Circuits and Systems Society
Starting Page	1119
Ending Page	1128
Page Count	10
File Size	1004845
File Format	PDF
ISSN	10518215
Volume Number	13
Issue Number	11
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2003-11-01
Publisher Place	U.S.A.
Access Restriction	One Nation One Subscription (ONOS)
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Facial animation MPEG 4 Standard Video sequences Cameras Face detection Space technology Hidden Markov models Learning systems Two dimensional displays Computer vision
Content Type	Text
Resource Type	Article
Subject	Electrical and Electronic Engineering Media Technology

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Learning and synthesizing mpeg-4 compatible 3-d face animation from video sequence (2003)

Estimation and Analysis of Facial Animation Parameter Patterns

Optimizing facial animation parameters for MPEG-4

Speech-driven facial animation with realistic dynamics

FAP extraction using three-dimensional motion estimation

An MPEG-4 facial animation parameters generation system

Estimation of Personalized Facial Gesture Patterns

Emotion recognition based on MPEG-4 facial animation parameters (2002)

HMM recognition of expressions in unrestrained video intervals

Learning and synthesizing MPEG-4 compatible 3-D face animation from video sequence

Similar Documents

Learning and synthesizing mpeg-4 compatible 3-d face animation from video sequence (2003)

Estimation and Analysis of Facial Animation Parameter Patterns

Optimizing facial animation parameters for MPEG-4

Speech-driven facial animation with realistic dynamics

FAP extraction using three-dimensional motion estimation

An MPEG-4 facial animation parameters generation system

Estimation of Personalized Facial Gesture Patterns

Emotion recognition based on MPEG-4 facial animation parameters (2002)

HMM recognition of expressions in unrestrained video intervals

Learning and synthesizing MPEG-4 compatible 3-D face animation from video sequence