NDLI: Enhancing intelligence in multimodal emotion assessments

Content Provider	Springer Nature Link
Author	Gonçalves, Vinícius P. Costa, Eduardo P. Valejo, Alan Filho, Geraldo P. R. Johnson, Thienne M. Pessin, Gustavo Ueyama, Jó
Copyright Year	2016
Abstract	Computer systems are a part of everyday life, since they influence human behavior and stimulate changes in the emotional states of the users. The assessment of users’ emotions during their interaction with computer systems can help to provide tailorable website interfaces and better recommendations systems. However, emotions are complex and difficult to identify or assess. Previous studies have shown that, in a real-world scenario, the use of single sensors do not provide an accurate emotional assessment. Hence, in this study, we propose a framework that takes into account multiple sensors so that conclusions can be drawn about the emotional state of the user at the time of interaction. The proposed multi-sensing approach includes several inputs from users (such as speech, facial movements, and everyday activities), and uses an artificial intelligent strategy to map these different responses into one or more emotional states. The Componential Emotion Theory and Scherer’s Emotional Semantic Space are used to underpin the theoretical framework. The experimental results show that the combination of outputs generated by multiple sensors provides a more accurate assessment of emotional states than when the sensors are treated individually.
Starting Page	470
Ending Page	486
Page Count	17
File Format	PDF
ISSN	0924669X
Journal	Applied Intelligence
Volume Number	46
Issue Number	2
e-ISSN	15737497
Language	English
Publisher	Springer US
Publisher Date	2016-09-08
Publisher Place	New York
Access Restriction	One Nation One Subscription (ONOS)
Subject Keyword	Affective computing Computational intelligence Emotion recognition Human computer interaction Multiple sensors Logical sensors Machine learning Multimodal emotion Components Real-time Game Artificial Intelligence (incl. Robotics) Mechanical Engineering Manufacturing, Machines, Tools
Content Type	Text
Resource Type	Article
Subject	Artificial Intelligence

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Detecting changing emotions in human speech by machine and humans

Mandarin emotion recognition combining acoustic and emotional point information

Extracting Logical Schema from the Web

An affective learning agent with Petri-net-based implementation

Detecting small group activities from multimodal observations

Data Mining and Machine Oriented Modeling: A Granular Computing Approach

Multi levels semantic architecture for multimodal interaction

Qualitative Geometry for Shape Recognition

Guest Editorial: Machine Learning Policies

Enhancing intelligence in multimodal emotion assessments

Similar Documents

Detecting changing emotions in human speech by machine and humans

Mandarin emotion recognition combining acoustic and emotional point information

Extracting Logical Schema from the Web

An affective learning agent with Petri-net-based implementation

Detecting small group activities from multimodal observations

Data Mining and Machine Oriented Modeling: A Granular Computing Approach

Multi levels semantic architecture for multimodal interaction

Qualitative Geometry for Shape Recognition

Guest Editorial: Machine Learning Policies

Enhancing intelligence in multimodal emotion assessments