NDLI: Realtime face analysis and synthesis using neural network

Content Provider	IEEE Xplore Digital Library
Author	Morishima, S.
Copyright Year	2000
Description	Author affiliation: ATR Media Integration Commun. Lab., Seikei Univ., Tokyo, Japan (Morishima, S.)
Abstract	Describes recent research results about how to generate an avatar's face in a real-time process, exactly copying a real person's face. It is very important for the synthesis of a real avatar to precisely duplicate the emotions and impressions included in the original face image and voice. A face-fitting tool from multi-angle camera images is introduced in order to make a real 3D face model with real texture and geometry that is very close to the original. When an avatar is speaking something, the voice signal is very essential for deciding the mouth shape features, so a real-time mouth shape control mechanism is proposed by conversion from speech parameters to lip shape parameters using a multi-layered neural network. For dynamic modeling of facial expressions, a muscle structure constraint is introduced to generate a facial expression naturally with just a few parameters. We also tried to obtain muscle parameters automatically in order to decide an expression from a local motion vector on the face calculated by optical flow in a video sequence. Finally, an approach is presented that enables the modeling of the emotions appearing on faces. A system with this approach helps us to analyze, synthesize and code face images at the emotional level.
Starting Page	13
Ending Page	22
File Size	763324
Page Count	10
File Format	PDF
ISBN	0780362780
ISSN	10893555
DOI	10.1109/NNSP.2000.889356
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2000-12-11
Publisher Place	Australia
Access Restriction	Subscribed
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Network synthesis Neural networks Shape control Avatars Mouth Muscles Cameras Solid modeling Geometry Speech
Content Type	Text
Resource Type	Article

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in