NDLI: Speech driven facial animation

Please wait, while we are loading the content...

Experimental evaluation of vision and speech based multimodal interfaces

Perceptive user interfaces workshop

Sketch based interfaces: early processing for sketch understanding

Towards reliable multimodal sensing in aware environments

Estimating focus of attention based on gaze and sound

A real-time head nod and shake detector

Recognizing movements from the ground reaction force

Human-robot interface based on the mutual assistance between speech and vision

Speech driven facial animation

Visually prototyping perceptual user interfaces through multimodal storyboarding

A pneumatic tactile alerting system for the driving environment

The Infocockpit: providing location and place to aid human memory

A visual modality for the augmentation of paper

An experimental multilingual speech translation system

Naturally conveyed explanations of device behavior

A robust algorithm for reading detection

Design issues for vision-based computer interaction systems

Visual panel: virtual mouse, keyboard and 3D controller with an ordinary piece of paper

Signal level fusion for multimodal perceptual user interface

A multimodal presentation planner for a home entertainment environment

Audio-video array source separation for perceptual user interfaces

A perceptual user interface for recognizing head gesture acknowledgements

Hand tracking for human-computer interaction with Graylevel VisualGlove: turning back to the simple way

Physiological data feedback for application in distance education

Perception and haptics: towards more accessible computers for motion-impaired users

Robust finger tracking for wearable computer interfacing

The Bayes Point Machine for computer-user frustration detection via pressuremouse

Privacy protection by concealing persons in circumstantial video image

Using eye movements to determine referents in a spoken dialogue system

Bare-hand human-computer interaction

An automatic sign recognition and translation system

User and social interfaces by observing human faces for intelligent wheelchairs

Multimodal optimizations: can legacy systems defeat them?

First steps towards automatic recognition of spontaneous facial action units

Using multimodal interaction to navigate in arbitrary virtual VRML worlds

A video joystick from a toy

WebContext: remote access to shared context

Speech driven facial animation

Content Provider	ACM Digital Library
Author	Kakumanu, P. Goshtasby, A. Garcia, O. N. Esposito, A. Bryll, R. Gutierrez-Osuna, R.
Abstract	The results reported in this article are an integral part of a larger project aimed at achieving perceptually realistic animations, including the individualized nuances, of three-dimensional human faces driven by speech. The audiovisual system that has been developed for learning the spatio-temporal relationship between speech acoustics and facial animation is described, including video and speech processing, pattern analysis, and MPEG-4 compliant facial animation for a given speaker. In particular, we propose a perceptual transformation of the speech spectral envelope, which is shown to capture the dynamics of articulatory movements. An efficient nearest-neighbor algorithm is used to predict novel articulatory trajectories from the speech dynamics. The results are very promising and suggest a new way to approach the modeling of synthetic lip motion of a given speaker driven by his/her speech. This would also provide clues toward a more general cross-speaker realistic animation.
Starting Page	1
Ending Page	5
Page Count	5
File Format	PDF
DOI	10.1145/971478.971488
Language	English
Publisher	Association for Computing Machinery (ACM)
Publisher Date	2001-11-15
Publisher Place	New York
Access Restriction	Subscribed
Subject Keyword	Lip-syncing Computer vision Mpeg-4 Facial animation Speech processing
Content Type	Text
Resource Type	Article

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Automated lip synchronized speech driven facial animation

Voice puppetry

An MPEG-4 facial animation system driven by synthetic speech

Speech-driven cartoon animation with emotions

Inner lip feature extraction for MPEG-4 facial animation

Database Construction for Speech to Lip-readable Animation Conversion

Speech Driven Facial Animation (2001)

Speech Driven Facial Animation (2001)

Speech driven mpeg-4 facial animation for turkish.

Speech driven facial animation

Similar Documents

Automated lip synchronized speech driven facial animation

Voice puppetry

An MPEG-4 facial animation system driven by synthetic speech

Speech-driven cartoon animation with emotions

Inner lip feature extraction for MPEG-4 facial animation

Database Construction for Speech to Lip-readable Animation Conversion

Speech Driven Facial Animation (2001)

Speech Driven Facial Animation (2001)

Speech driven mpeg-4 facial animation for turkish.

Speech driven facial animation