NDLI: Using deformable templates to infer visual speech dynamics

Content Provider	IEEE Xplore Digital Library
Author	Hennecke, M.E. Prasad, K.V. Stork, D.G.
Copyright Year	1994
Description	Author affiliation: Dept. of Electr. Eng., Stanford Univ., CA, USA (Hennecke, M.E.; Prasad, K.V.)
Abstract	The visual image of a talker provides information complementary to the acoustic speech waveform, and enables improved recognition accuracy, especially in environments corrupted by high acoustic noise or multiple talkers. Because most of the phonologically relevant visual information is from the mouth and lips, it is important to infer accurately and robustly their dynamics; moreover it is desirable to extract this information without the use of invasive markers or patterned illumination. We describe the use of deformable templates for speechreading, in order to infer the dynamics of lip contours throughout an image sequence. Template computations can be done relatively quickly and the resulting small number of shape description parameters are quite robust to visual noise and variations in illumination. Such templates delineate the inside of the mouth, so that the teeth and the tongue can also be found.
Starting Page	578
Ending Page	582
File Size	467949
Page Count	5
File Format	PDF
ISBN	0818664053
ISSN	10586393
DOI	10.1109/ACSSC.1994.471518
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	1994-10-31
Publisher Place	USA
Access Restriction	Subscribed
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Mouth Noise robustness Lighting Acoustic waves Speech enhancement Image recognition Speech recognition Acoustic noise Lips Data mining
Content Type	Text
Resource Type	Article
Subject	Signal Processing Computer Networks and Communications

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Automatic speech recognition system using acoustic and visual signals

Lip modeling for visual speech recognition

Locating and tracking facial speech features

Integration of acoustic and visual speech signals using neural networks

A probabilistic principal component analysis based hidden Markov model for audio-visual speech recognition

Speaker independent audio-visual continuous speech recognition

Speech recognition using noise-adaptive prototypes

What can visual speech synthesis tell visual speech recognition?

RBF neural network mouth tracking for audio-visual speech recognition system

Using deformable templates to infer visual speech dynamics

Similar Documents

Automatic speech recognition system using acoustic and visual signals

Lip modeling for visual speech recognition

Locating and tracking facial speech features

Integration of acoustic and visual speech signals using neural networks

A probabilistic principal component analysis based hidden Markov model for audio-visual speech recognition

Speaker independent audio-visual continuous speech recognition

Speech recognition using noise-adaptive prototypes

What can visual speech synthesis tell visual speech recognition?

RBF neural network mouth tracking for audio-visual speech recognition system

Using deformable templates to infer visual speech dynamics