NDLI: A Multimodal Database for Affect Recognition and Implicit Tagging

Please wait, while we are loading the content...

A Multimodal Database for Affect Recognition and Implicit Tagging

Content Provider	IEEE Xplore Digital Library
Author	Soleymani, M. Lichtenauer, J. Pun, T. Pantic, M.
Copyright Year	2010
Abstract	MAHNOB-HCI is a multimodal database recorded in response to affective stimuli with the goal of emotion recognition and implicit tagging research. A multimodal setup was arranged for synchronized recording of face videos, audio signals, eye gaze data, and peripheral/central nervous system physiological signals. Twenty-seven participants from both genders and different cultural backgrounds participated in two experiments. In the first experiment, they watched 20 emotional videos and self-reported their felt emotions using arousal, valence, dominance, and predictability as well as emotional keywords. In the second experiment, short videos and images were shown once without any tag and then with correct or incorrect tags. Agreement or disagreement with the displayed tags was assessed by the participants. The recorded videos and bodily responses were segmented and stored in a database. The database is made available to the academic community via a web-based system. The collected data were analyzed and single modality and modality fusion results for both emotion recognition and implicit tagging experiments are reported. These results show the potential uses of the recorded modalities and the significance of the emotion elicitation protocol.
Starting Page	42
Ending Page	55
Page Count	14
File Size	2279356
File Format	PDF
ISSN	19493045
Volume Number	3
Issue Number	1
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2012-01-01
Publisher Place	U.S.A.
Access Restriction	One Nation One Subscription (ONOS)
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Databases Videos Physiology Humans Cameras Tagging Emotion recognition affective computing. EEG physiological signals facial expressions eye gaze implicit tagging pattern classification
Content Type	Text
Resource Type	Article
Subject	Human-Computer Interaction Software

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

A multimodal database for affect recognition and implicit tagging (2012).

Multimodal Emotion Recognition in Response to Videos

DEAP: A Database for Emotion Analysis ;Using Physiological Signals

Affect recognition based on physiological changes during the watching of music videos

Continuous emotion detection using EEG signals and facial expressions

FEEDB: A multimodal database of facial expressions and emotions

DECAF: MEG-Based Multimodal Database for Decoding Affective Physiological Responses

Exploring Cross-Modality Affective Reactions for Audiovisual Emotion Recognition

Multimodal emotion recognition in response to videos (Extended abstract)

A Multimodal Database for Affect Recognition and Implicit Tagging

Similar Documents

A multimodal database for affect recognition and implicit tagging (2012).

Multimodal Emotion Recognition in Response to Videos

DEAP: A Database for Emotion Analysis ;Using Physiological Signals

Affect recognition based on physiological changes during the watching of music videos

Continuous emotion detection using EEG signals and facial expressions

FEEDB: A multimodal database of facial expressions and emotions

DECAF: MEG-Based Multimodal Database for Decoding Affective Physiological Responses

Exploring Cross-Modality Affective Reactions for Audiovisual Emotion Recognition

Multimodal emotion recognition in response to videos (Extended abstract)

A Multimodal Database for Affect Recognition and Implicit Tagging