NDLI: Performance enhancement for audio-visual speaker identification using dynamic facial muscle model

Content Provider	Springer Nature Link
Author	Asadpour, Vahid Towhidkhah, Farzad Homayounpour, Mohammad Mehdi
Copyright Year	2006
Abstract	Science of human identification using physiological characteristics or biometry has been of great concern in security systems. However, robust multimodal identification systems based on audio-visual information has not been thoroughly investigated yet. Therefore, the aim of this work to propose a model-based feature extraction method which employs physiological characteristics of facial muscles producing lip movements. This approach adopts the intrinsic properties of muscles such as viscosity, elasticity, and mass which are extracted from the dynamic lip model. These parameters are exclusively dependent on the neuro-muscular properties of speaker; consequently, imitation of valid speakers could be reduced to a large extent. These parameters are applied to a hidden Markov model (HMM) audio-visual identification system. In this work, a combination of audio and video features has been employed by adopting a multistream pseudo-synchronized HMM training method. Noise robust audio features such as Mel-frequency cepstral coefficients (MFCC), spectral subtraction (SS), and relative spectra perceptual linear prediction (J-RASTA-PLP) have been used to evaluate the performance of the multimodal system once efficient audio feature extraction methods have been utilized. The superior performance of the proposed system is demonstrated on a large multispeaker database of continuously spoken digits, along with a sentence that is phonetically rich. To evaluate the robustness of algorithms, some experiments were performed on genetically identical twins. Furthermore, changes in speaker voice were simulated with drug inhalation tests. In 3 dB signal to noise ratio (SNR), the dynamic muscle model improved the identification rate of the audio-visual system from 91 to 98%. Results on identical twins revealed that there was an apparent improvement on the performance for the dynamic muscle model-based system, in which the identification rate of the audio-visual system was enhanced from 87 to 96%.
Starting Page	919
Ending Page	930
Page Count	12
File Format	PDF
ISSN	01400118
Journal	Medical and Biological Engineering and Computing
Volume Number	44
Issue Number	10
e-ISSN	17410444
Language	English
Publisher	Springer-Verlag
Publisher Date	2006-09-26
Publisher Place	Berlin, Heidelberg
Access Restriction	One Nation One Subscription (ONOS)
Subject Keyword	Biometry Speaker identification Multistream hidden Markov models Visual feature extraction Neurosciences Computer Applications Imaging Radiology Human Physiology Biomedical Engineering
Content Type	Text
Resource Type	Article
Subject	Biomedical Engineering Computer Science Applications

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Analysis of swallowing sounds using hidden Markov models

Integration strategies for audio-visual speech processing: applied to text-dependent speaker recognition

Eye feature extraction for diagnosing the facial phenotype associated with fetal alcohol syndrome

Audio-Visual Biometrics

Online apnea–bradycardia detection based on hidden semi-Markov models

Emarati speaker identification

Classification of multichannel EEG patterns using parallel hidden Markov models

Force enhancement following stretch of activated muscle: Critical review and proposal for mechanisms

AUDIO-VISUAL SPEAKER IDENTIFICATION USING COUPLED HIDDEN MARKOV MODELS

Performance enhancement for audio-visual speaker identification using dynamic facial muscle model

Similar Documents

Analysis of swallowing sounds using hidden Markov models

Integration strategies for audio-visual speech processing: applied to text-dependent speaker recognition

Eye feature extraction for diagnosing the facial phenotype associated with fetal alcohol syndrome

Audio-Visual Biometrics

Online apnea–bradycardia detection based on hidden semi-Markov models

Emarati speaker identification

Classification of multichannel EEG patterns using parallel hidden Markov models

Force enhancement following stretch of activated muscle: Critical review and proposal for mechanisms

AUDIO-VISUAL SPEAKER IDENTIFICATION USING COUPLED HIDDEN MARKOV MODELS

Performance enhancement for audio-visual speaker identification using dynamic facial muscle model