NDLI: Automatic Lipreading with Limited Training Data

Content Provider	IEEE Xplore Digital Library
Author	Wang, S.L. Lau, W.H. Liew, A.W.C. Leung, S.H.
Copyright Year	2006
Description	Author affiliation: Sch. of Info. Security Eng., Shanghai Jiaotong Univ. (Wang, S.L.)
Abstract	Speech recognition solely based on visual information such as the lip shape and its movement is referred to as lipreading. This paper presents an automatic lipreading technique for speaker dependent (SD) and speaker independent (SI) speech recognition tasks. Since the visual features are derived according to the frame rate of the video sequence, spline representation is then employed to translate the discrete-time sampled visual features into continuous domain. The spline coefficients in the same word class are constrained to have similar expression and can be estimated from the training data by the EM algorithm. In addition, an adaptive multi-model approach is proposed to overcome the variation caused by different speaking style in speaker-independent recognition task. The experiments are carried out to recognize the ten English digits and an accuracy of 96% for speaker dependent recognition and 88% for speaker independent recognition have been achieved, which shows the superiority of our approach compared with other classifiers investigated
Sponsorship	IEEE CPS
Starting Page	881
Ending Page	884
File Size	119375
Page Count	4
File Format	PDF
ISBN	0769525210
ISSN	10514651
DOI	10.1109/ICPR.2006.301
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2006-08-20
Publisher Place	China
Access Restriction	Subscribed
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Training data Hidden Markov models Speech recognition Spline Data mining Automatic speech recognition Data security Information security Shape Video sequences
Content Type	Text
Resource Type	Article
Subject	Computer Vision and Pattern Recognition

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

An Automatic Lipreading System for Spoken Digits With Limited Training Data

Learning and recognizing human dynamics in video sequences

Gestures and Lip Shape Integration for Cued Speech Recognition

A real-time automatic lipreading system

A two level classifier process for audio segmentation

Unusual Event Detection via Multi-camera Video Mining

Extraction of visual features for lipreading

Direct training of subspace distribution clustering hidden Markov model

Towards a practical lipreading system

Automatic Lipreading with Limited Training Data

Similar Documents

An Automatic Lipreading System for Spoken Digits With Limited Training Data

Learning and recognizing human dynamics in video sequences

Gestures and Lip Shape Integration for Cued Speech Recognition

A real-time automatic lipreading system

A two level classifier process for audio segmentation

Unusual Event Detection via Multi-camera Video Mining

Extraction of visual features for lipreading

Direct training of subspace distribution clustering hidden Markov model

Towards a practical lipreading system

Automatic Lipreading with Limited Training Data