NDLI: Asymmetrically boosted HMM for speech reading

Content Provider	IEEE Xplore Digital Library
Author	Pei Yin Essa, I. Rehg, J.M.
Copyright Year	2004
Description	Author affiliation: GVU Center, Georgia Inst. of Technol., Atlanta, GA, USA (Pei Yin; Essa, I.; Rehg, J.M.)
Abstract	Speech reading, also known as lip reading, is aimed at extracting visual cues of lip and facial movements to aid in recognition of speech. The main hurdle for speech reading is that visual measurements of lip and facial motion lack information-rich features like the Mel frequency cepstral coefficients (MFCC), widely used in acoustic speech recognition. These MFCC are used with hidden Markov models (HMM) in most speech recognition systems at present. Speech reading could greatly benefit from automatic selection and formation of informative features from measurements in the visual domain. These new features can then be used with HMM to capture the dynamics of lip movement and eventual recognition of lip shapes. Towards this end, we use AdaBoost methods for automatic visual feature formation. Specifically, we design an asymmetric variant of AdaBoost M2 algorithm to deal with the ill-posed multi-class sample distribution inherent in our problem. Our experiments show that the boosted HMM approach outperforms conventional AdaBoost and HMM classifiers. Our primary contributions are in the design of (a) boosted HMM and (b) asymmetric multi-class boosting.
Sponsorship	IEEE Comput. Soc
File Size	366942
File Format	PDF
ISBN	0769521584
ISSN	10636919
DOI	10.1109/CVPR.2004.1315240
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2004-06-27
Publisher Place	USA
Access Restriction	Subscribed
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Hidden Markov models Speech recognition Mel frequency cepstral coefficient Acoustic measurements Face recognition Frequency measurement Motion measurement Shape Algorithm design and analysis Boosting
Content Type	Text
Resource Type	Article
Subject	Computer Vision and Pattern Recognition Software

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Asymmetrically Boosted HMM for Speech Reading

Boosted audio-visual HMM for speech reading

HMM Voice Recognition Algorithm Coding

Boosted audio-visual HMM for speech reading

Boosting Thai Syllable Speech Recognition Using Acoustic Models Combination

HMM based isolated Kannada digit recognition system using MFCC

Bangla triphone HMM based word recognition

Phoneme recognition using Boosted Binary Features

English digits speech recognition system based on Hidden Markov Models

Asymmetrically boosted HMM for speech reading

Similar Documents

Asymmetrically Boosted HMM for Speech Reading

Boosted audio-visual HMM for speech reading

HMM Voice Recognition Algorithm Coding

Boosted audio-visual HMM for speech reading

Boosting Thai Syllable Speech Recognition Using Acoustic Models Combination

HMM based isolated Kannada digit recognition system using MFCC

Bangla triphone HMM based word recognition

Phoneme recognition using Boosted Binary Features

English digits speech recognition system based on Hidden Markov Models

Asymmetrically boosted HMM for speech reading