NDLI: Recognition of visual speech elements using adaptively boosted hidden Markov models

Content Provider	IEEE Xplore Digital Library
Author	Say Wei Foo Yong Lian Liang Dong
Copyright Year	1991
Abstract	The performance of automatic speech recognition (ASR) system can be significantly enhanced with additional information from visual speech elements such as the movement of lips, tongue, and teeth, especially under noisy environment. In this paper, a novel approach for recognition of visual speech elements is presented. The approach makes use of adaptive boosting (AdaBoost) and hidden Markov models (HMMs) to build an AdaBoost-HMM classifier. The composite HMMs of the AdaBoost-HMM classifier are trained to cover different groups of training samples using the AdaBoost technique and the biased Baum-Welch training method. By combining the decisions of the component classifiers of the composite HMMs according to a novel probability synthesis rule, a more complex decision boundary is formulated than using the single HMM classifier. The method is applied to the recognition of the basic visual speech elements. Experimental results show that the AdaBoost-HMM classifier outperforms the traditional HMM classifier in accuracy, especially for visemes extracted from contexts.
Sponsorship	IEEE Circuits and Systems Society
Starting Page	693
Ending Page	705
Page Count	13
File Size	533047
File Format	PDF
ISSN	10518215
Volume Number	14
Issue Number	5
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2004-05-01
Publisher Place	U.S.A.
Access Restriction	One Nation One Subscription (ONOS)
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Speech recognition Hidden Markov models Automatic speech recognition Speech enhancement Lips Tongue Teeth Working environment noise Boosting Speech synthesis
Content Type	Text
Resource Type	Article
Subject	Electrical and Electronic Engineering Media Technology

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Lips detection for audio-visual speech recognition system

Bimodal fusion in audio-visual speech recognition

Stream-weighted HMM for audio-visual ASR: a study on connected digit recognition

Improved Speech Presence Probabilities Using HMM-Based Inference, With Applications to Speech Enhancement and ASR

Adaptive Regression Based Framework for In-Car Speech Recognition

Audio-visual modeling for bimodal speech recognition

Robust Audio-Visual Speech Recognition Based on Late Integration

Robust distributed speech recognition using speech enhancement

Hidden Markov model with noise-adaptive codebook for noisy speech recognition

Recognition of visual speech elements using adaptively boosted hidden Markov models

Similar Documents

Lips detection for audio-visual speech recognition system

Bimodal fusion in audio-visual speech recognition

Stream-weighted HMM for audio-visual ASR: a study on connected digit recognition

Improved Speech Presence Probabilities Using HMM-Based Inference, With Applications to Speech Enhancement and ASR

Adaptive Regression Based Framework for In-Car Speech Recognition

Audio-visual modeling for bimodal speech recognition

Robust Audio-Visual Speech Recognition Based on Late Integration

Robust distributed speech recognition using speech enhancement

Hidden Markov model with noise-adaptive codebook for noisy speech recognition

Recognition of visual speech elements using adaptively boosted hidden Markov models