NDLI: On the Acoustics of Emotion in Audio: What Speech, Music, and Sound have in Common

Content Provider	PubMed Central
Author	Weninger, Felix Florian, Eyben Schuller, Björn W. Mortillaro, Marcello Scherer, Klaus R.
Copyright Year	2013
Abstract	Without doubt, there is emotional information in almost any kind of sound received by humans every day: be it the affective state of a person transmitted by means of speech; the emotion intended by a composer while writing a musical piece, or conveyed by a musician while performing it; or the affective state connected to an acoustic event occurring in the environment, in the soundtrack of a movie, or in a radio play. In the field of affective computing, there is currently some loosely connected research concerning either of these phenomena, but a holistic computational model of affect in sound is still lacking. In turn, for tomorrow’s pervasive technical systems, including affective companions and robots, it is expected to be highly beneficial to understand the affective dimensions of “the sound that something makes,” in order to evaluate the system’s auditory environment and its own audio output. This article aims at a first step toward a holistic computational model: starting from standard acoustic feature extraction schemes in the domains of speech, music, and sound analysis, we interpret the worth of individual features across these three domains, considering four audio databases with observer annotations in the arousal and valence dimensions. In the results, we find that by selection of appropriate descriptors, cross-domain arousal, and valence regression is feasible achieving significant correlations with the observer annotations of up to 0.78 for arousal (training on sound and testing on enacted speech) and 0.60 for valence (training on enacted speech and testing on music). The high degree of cross-domain consistency in encoding the two main dimensions of affect may be attributable to the co-evolution of speech and music from multimodal affect bursts, including the integration of nature sounds for expressive effects.
Related Links	http://dx.doi.org/10.3389/fpsyg.2013.00292
Starting Page	292
File Format	PDF
ISSN	16641078
e-ISSN	16641078
Journal	Frontiers in Psychology
Volume Number	4
Language	English
Publisher	Frontiers Media S.A.
Publisher Date	2013-01-01
Access Restriction	Open
Rights Holder	Frontiers Media S.A.
Subject Keyword	Research in Higher Education
Content Type	Text
Resource Type	Article
Subject	Psychology

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

On the Acoustics of Emotion in Audio: What Speech, Music and Sound have in Common

Sound frequency affects speech emotion perception: results from congenital amusia

Music and speech prosody: a common rhythm

Investigating Sound Design in Film: A Commentary on Kock and Louven

Arousing the Sound: A Field Study on the Emotional Impact on Children of Arousing Sound Design and 3D Audio Spatialization in an Audio Story

Effects of Compression on Speech Acoustics, Intelligibility, and Sound Quality

An Analysis of Sound Exposure in a University Music Rehearsal

Expression of emotion in music and vocal communication: Introduction to the research topic

Emotion recognition in audio records

On the Acoustics of Emotion in Audio: What Speech, Music, and Sound have in Common

Similar Documents

On the Acoustics of Emotion in Audio: What Speech, Music and Sound have in Common

Sound frequency affects speech emotion perception: results from congenital amusia

Music and speech prosody: a common rhythm

Investigating Sound Design in Film: A Commentary on Kock and Louven

Arousing the Sound: A Field Study on the Emotional Impact on Children of Arousing Sound Design and 3D Audio Spatialization in an Audio Story

Effects of Compression on Speech Acoustics, Intelligibility, and Sound Quality

An Analysis of Sound Exposure in a University Music Rehearsal

Expression of emotion in music and vocal communication: Introduction to the research topic

Emotion recognition in audio records

On the Acoustics of Emotion in Audio: What Speech, Music, and Sound have in Common