NDLI: Joint Analysis of the Emotional Fingerprint in the Face and Speech: A single subject study

Content Provider	IEEE Xplore Digital Library
Author	Busso, C. Narayanan, S.S.
Copyright Year	2007
Description	Author affiliation: Southern California Univ., Los Angeles (Busso, C.; Narayanan, S.S.)
Abstract	In daily human interaction, speech and gestures are used to express an intended message, enriched with verbal and non-verbal information. Although many communicative goals are simultaneously encoded using the same modalities such as the face or the voice, listeners are generally good at decoding each aspect of the message. This encoding process includes an underlying interplay between communicative goals and channels, which is yet not well understood. In this direction, this paper explores the interplay between linguistic and affective goals in speech and facial expression. We hypothesize that when one modality is constrained by the articulatory speech process, other channels with more degrees of freedom are used to convey the emotions. The results presented here support this hypothesis, since it is observed that facial expression and prosodic speech tend to have a stronger emotional modulation when the vocal tract is physically constrained by the articulation to convey other linguistic communicative goals.
Starting Page	43
Ending Page	47
File Size	245323
Page Count	5
File Format	PDF
ISBN	9781424412747
DOI	10.1109/MMSP.2007.4412814
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2007-10-01
Publisher Place	Greece
Access Restriction	Subscribed
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Speech analysis Fingerprint recognition Hidden Markov models Humans Information analysis Decoding Audio databases Face Viterbi algorithm Speech processing
Content Type	Text
Resource Type	Article

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Modeling state durations in hidden Markov models for automatic speech recognition

Viterbi Algorithm for multi-pattern joint decoding

Speech Animation Using Coupled Hidden Markov Models

On efficient Viterbi decoding for hidden semi-Markov models

Approximate Viterbi decoding for 2D-hidden Markov models

Using hidden Markov models to define linguistic units

A joint decoding algorithm for multiple-example-based addition of words to a pronunciation lexicon

Fast search algorithms for continuous speech recognition

On a study of decreasing the processing time in the speech recognition system using the HMM (hidden Markov model) algorithm

Joint Analysis of the Emotional Fingerprint in the Face and Speech: A single subject study

Similar Documents

Modeling state durations in hidden Markov models for automatic speech recognition

Viterbi Algorithm for multi-pattern joint decoding

Speech Animation Using Coupled Hidden Markov Models

On efficient Viterbi decoding for hidden semi-Markov models

Approximate Viterbi decoding for 2D-hidden Markov models

Using hidden Markov models to define linguistic units

A joint decoding algorithm for multiple-example-based addition of words to a pronunciation lexicon

Fast search algorithms for continuous speech recognition

On a study of decreasing the processing time in the speech recognition system using the HMM (hidden Markov model) algorithm

Joint Analysis of the Emotional Fingerprint in the Face and Speech: A single subject study