NDLI: Visuo-auditory Multimodal Emotional Structure to Improve Human-Robot-Interaction

Please wait, while we are loading the content...

Perception and Action as Two Sides of the Same Coin. A Review of the Importance of Action-Perception Links in Humans for Social Robot Design and Research

Regression Analysis of Multi-Rendezvous Recharging Route in Multi-Robot Environment

Visuo-auditory Multimodal Emotional Structure to Improve Human-Robot-Interaction

Investigation on People Living with Seal Robot at Home : Analysis of Owners’ Gender Differences and Pet Ownership Experience

Experiments on Stochastic Resonance Toward Human Mimetic Tactile Data Processing

Survey-Based Discussions on Morally Contentious Applications of Interactive Robotics

Two-Hand-Arm Manipulation Based on Tri-axial Tactile Data

International Journal of Social Robotics : Volume 3

International Journal of Social Robotics : Volume 2

International Journal of Social Robotics : Volume 1

Visuo-auditory Multimodal Emotional Structure to Improve Human-Robot-Interaction

Content Provider	Springer Nature Link
Author	Prado, José Augusto Simplício, Carlos Lori, Nicolás F. Dias, Jorge
Copyright Year	2011
Abstract	We propose an approach to analyze and synthesize a set of human facial and vocal expressions, and then use the classified expressions to decide the robot’s response in a human-robot-interaction. During a human-to-human conversation, a person senses the interlocutor’s face and voice, perceives her/his emotional expressions, and processes this information in order to decide which response to give. Moreover, observed emotions are taken into account and the response may be aggressive, funny (henceforth meaning humorous) or just neutral according to not only the observed emotions, but also the personality of the person. The purpose of our proposed structure is to endow robots with the capability to model human emotions, and thus several subproblems need to be solved: feature extraction, classification, decision and synthesis. In the proposed approach we integrate two classifiers for emotion recognition from audio and video, and then use a new method for fusion with the social behavior profile. To keep the person engaged in the interaction, after each iterance of analysis, the robot synthesizes human voice with both lips synchronization and facial expressions. The social behavior profile conducts the personality of the robot. The structure and work flow of the synthesis and decision are addressed, and the Bayesian networks are discussed. We also studied how to analyze and synthesize the emotion from the facial expression and vocal expression. A new probabilistic structure that enables a higher level of interaction between a human and a robot is proposed.
Starting Page	29
Ending Page	51
Page Count	23
File Format	PDF
ISSN	18754791
Journal	International Journal of Social Robotics
Volume Number	4
Issue Number	1
e-ISSN	18754805
Language	English
Publisher	Springer Netherlands
Publisher Date	2011-12-20
Publisher Place	Dordrecht
Access Restriction	One Nation One Subscription (ONOS)
Subject Keyword	Visual perception Auditory perception Emotion recognition Multimodal interaction Social behavior profile Bayesian networks Control, Robotics, Mechatronics
Content Type	Text
Resource Type	Article
Subject	Philosophy Control and Systems Engineering Social Psychology Electrical and Electronic Engineering Human-Computer Interaction

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Visuo-auditory multimodal emotional structure to improve human-robot-interaction (2011).

A Bank of Unscented Kalman Filters for Multimodal Human Perception with Mobile Service Robots

Emotional Postures for the Humanoid-Robot Nao

Inference of Human Beings’ Emotional States from Speech in Human–Robot Interactions

Recognizing Emotional Body Language Displayed by a Human-like Social Robot

A Survey of Using Vocal Prosody to Convey Emotion in Robot Speech

A Feasibility Study Evaluating the Emotionally Expressive Robot SAM

A Survey on Perception Methods for Human–Robot Interaction in Social Robots

Robot emotional state through bayesian visuo-auditory perception.

Visuo-auditory Multimodal Emotional Structure to Improve Human-Robot-Interaction

Similar Documents

Visuo-auditory multimodal emotional structure to improve human-robot-interaction (2011).

A Bank of Unscented Kalman Filters for Multimodal Human Perception with Mobile Service Robots

Emotional Postures for the Humanoid-Robot Nao

Inference of Human Beings’ Emotional States from Speech in Human–Robot Interactions

Recognizing Emotional Body Language Displayed by a Human-like Social Robot

A Survey of Using Vocal Prosody to Convey Emotion in Robot Speech

A Feasibility Study Evaluating the Emotionally Expressive Robot SAM

A Survey on Perception Methods for Human–Robot Interaction in Social Robots

Robot emotional state through bayesian visuo-auditory perception.

Visuo-auditory Multimodal Emotional Structure to Improve Human-Robot-Interaction