NDLI: Synergy of Lip-Motion and Acoustic Features in Biometric Speech and Speaker Recognition

Content Provider	IEEE Xplore Digital Library
Author	Faraj, M.-l. Bigun, J.
Copyright Year	1968
Abstract	This paper presents the scheme and evaluation of a robust audio-visual digit-and-speaker-recognition system using lip motion and speech biometrics. Moreover, a liveness verification barrier based on a person's lip movement is added to the system to guard against advanced spoofing attempts such as replayed videos. The acoustic and visual features are integrated at the feature level and evaluated first by a support vector machine for digit and speaker identification and, then, by a Gaussian mixture model for speaker verification. Based on ap300 different personal identities, this paper represents, to our knowledge, the first extensive study investigating the added value of lip motion features for speaker and speech-recognition applications. Digit recognition and person-identification and verification experiments are conducted on the publicly available XM2VTS database showing favorable results (speaker verification is 98 percent, speaker identification is 100 percent, and digit identification is 83 percent to 100 percent).
Sponsorship	IEEE Computer Society Technical Committee on Distributed Process IEEE Computer Society Technical Committee on VLSI IEEE Technical Committee on Computer Architecture IEEE Computer Society
File Size	602840
File Format	PDF
ISSN	00189340
Volume Number	56
Issue Number	9
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2007-09-01
Publisher Place	U.S.A.
Access Restriction	One Nation One Subscription (ONOS)
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Speech recognition Hidden Markov models Support vector machines Protocols Biometrics Motion control biometrics speaker recognition motion estimation normal image flow normal image velocity lip reading lip motion GMM SVM
Content Type	Text
Resource Type	Article
Subject	Theoretical Computer Science Computational Theory and Mathematics Software Hardware and Architecture

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Unsupervised speaker change detection using SVM training misclassification rate

Support Vector Machine Training for Improved Hidden Markov Modeling

VLSI Design for SVM-Based Speaker Verification System

New scheme based on GMM-PCA-SVM modelling for automatic speaker recognition

Robust Biometric Person Identification Using Automatic Classifier Fusion of Speech, Mouth, and Face Experts

Enhancing GMM speaker identification by incorporating SVM speaker verification for intelligent web-based speech applications

Speech recognition in reverberant and noisy environments employing multiple feature extractors and i-vector speaker adaptation

Discriminative Analysis of Lip Motion Features for Speaker Identification and Speech-Reading

Multistream Articulatory Feature-Based Models for Visual Speech Recognition

Synergy of Lip-Motion and Acoustic Features in Biometric Speech and Speaker Recognition

Similar Documents

Unsupervised speaker change detection using SVM training misclassification rate

Support Vector Machine Training for Improved Hidden Markov Modeling

VLSI Design for SVM-Based Speaker Verification System

New scheme based on GMM-PCA-SVM modelling for automatic speaker recognition

Robust Biometric Person Identification Using Automatic Classifier Fusion of Speech, Mouth, and Face Experts

Enhancing GMM speaker identification by incorporating SVM speaker verification for intelligent web-based speech applications

Speech recognition in reverberant and noisy environments employing multiple feature extractors and i-vector speaker adaptation

Discriminative Analysis of Lip Motion Features for Speaker Identification and Speech-Reading

Multistream Articulatory Feature-Based Models for Visual Speech Recognition

Synergy of Lip-Motion and Acoustic Features in Biometric Speech and Speaker Recognition