NDLI: Visual speech recognition: a solution from feature extraction to words classification

Content Provider	IEEE Xplore Digital Library
Author	Da Silveira, L.G. Facon, J. Borges, D.L.
Copyright Year	2003
Description	Author affiliation: Faculdade Cambury, Cambury Coll., Goiania, Brazil (Da Silveira, L.G.)
Abstract	Audio-visual speech recognition has been an active area of research lately. A bit, and yet unsolved part of this problem is the visual only recognition, or lip reading. Considering an image sequence of a person pronouncing a word, a full image analysis solution would have to segment the mouth area, extract relevant features, and use them to be able to classify the word from those visual features. We approach this problem by proposing a segmentation technique for the lips contours together with a set of features based on the extracted contours which is able to perform lip reading with promising results. We have collected visual speech sequences in our lab and show the results for a set of ten words in Brazilian Portuguese, spoken by different speakers in more than 150 samples. The approach can be extended and applied to other spoken languages as well.
Sponsorship	Brazilian Comput. Soc. (SBC) Univ. Sao Paulo (Pro-Reitoria de CCultura e Extensao Univ) Brazilian Nat. Res. Council (CNPq) Brazilian Commission for Higher Educ (CAPES) State of Sao Paulo Res. Found. (FAPESP)
Starting Page	399
Ending Page	405
File Size	401867
Page Count	7
File Format	PDF
ISBN	0769520324
ISSN	15301834
DOI	10.1109/SIBGRA.2003.1241036
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2003-10-12
Publisher Place	Brazil
Access Restriction	Subscribed
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Speech recognition Feature extraction Mouth Lips Automatic speech recognition Active shape model Image sequences Image segmentation Vocabulary Image recognition
Content Type	Text
Resource Type	Article

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Visual information assisted Mandarin large vocabulary continuous speech recognition

Active shape lip modeling

Statistical active model for mouth components segmentation

Wrapping snakes for improved lip segmentation

Lip reading from scale-space measurements

Lip modeling for visual speech recognition

HMM-based audio-visual speech recognition integrating geometric- and appearance-based visual features

Large vocabulary audio-visual speech recognition using active shape models

Automatic Extraction Of The Lips Shape Via Statistical Lips Modelling and Chromatic Feature

Visual speech recognition: a solution from feature extraction to words classification

Similar Documents

Visual information assisted Mandarin large vocabulary continuous speech recognition

Active shape lip modeling

Statistical active model for mouth components segmentation

Wrapping snakes for improved lip segmentation

Lip reading from scale-space measurements

Lip modeling for visual speech recognition

HMM-based audio-visual speech recognition integrating geometric- and appearance-based visual features

Large vocabulary audio-visual speech recognition using active shape models

Automatic Extraction Of The Lips Shape Via Statistical Lips Modelling and Chromatic Feature

Visual speech recognition: a solution from feature extraction to words classification