NDLI: Lifelike talking faces for interactive services

Content Provider	IEEE Xplore Digital Library
Author	Cosatto, E. Ostermann, J. Graf, H.P. Schroeter, J.
Copyright Year	1963
Abstract	Lifelike talking faces for interactive services are an exciting new modality for man-machine interactions. Recent developments in speech synthesis and computer animation enable the real-time synthesis of faces that look and behave like real people, opening opportunities to make interactions with computers more like face-to-face conversations. This paper focuses on the technologies for creating lifelike talking heads, illustrating the two main approaches: model-based animations and sample-based animations. The traditional model-based approach uses three-dimensional wire-frame models, which can be animated from high-level parameters such as muscle actions, lip postures, and facial expressions. The sample-based approach, on the other hand, concatenates segments of recorded videos, instead of trying to model the dynamics of the animations in detail. Recent advances in image analysis enable the creation of large databases of mouth and eye images, suited for sample-based animations. The sample-based approach tends to generate more naturally looking animations at the expense of a larger size and less flexibility than the model-based animations. Beside lip articulation, a talking head must show appropriate head movements, in order to appear natural. We illustrate how such "visual prosody" is analyzed and added to the animations. Finally, we present four applications where the use of face animation in interactive services results in engaging user interfaces and an increased level of trust between user and machine. Using an RTP-based protocol, face animation can be driven with only 800 bits/s in addition to the rate for transmitting audio.
Sponsorship	IEEE Publication
Starting Page	1406
Ending Page	1429
Page Count	24
File Size	1417019
File Format	PDF
ISSN	00189219
Volume Number	91
Issue Number	9
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2003-09-01
Publisher Place	U.S.A.
Access Restriction	Subscribed
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Facial animation Magnetic heads Speech synthesis Man machine systems Muscles Image segmentation Videos Image analysis Image databases Mouth
Content Type	Text
Resource Type	Article
Subject	Computer Science Electrical and Electronic Engineering

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Sample-based synthesis of talking heads

Talking faces

Realistic facial expression synthesis for an image-based talking head

Sample-based synthesis of photo-realistic talking heads

Face analysis for the synthesis of photo-realistic talking heads

Combination of facial movements on a 3D talking head

Photo-realistic talking-heads from image samples

AUT-Talk: A Farsi Talking Head

Realistic speech animation of synthetic faces

Lifelike talking faces for interactive services

Similar Documents

Sample-based synthesis of talking heads

Talking faces

Realistic facial expression synthesis for an image-based talking head

Sample-based synthesis of photo-realistic talking heads

Face analysis for the synthesis of photo-realistic talking heads

Combination of facial movements on a 3D talking head

Photo-realistic talking-heads from image samples

AUT-Talk: A Farsi Talking Head

Realistic speech animation of synthetic faces

Lifelike talking faces for interactive services