NDLI: Emotional head motion predicting from prosodic and linguistic features

Content Provider	Springer Nature Link
Author	Yang, Minghao Jiang, Jinlin Tao, Jianhua Mu, Kaihui Li, Hao
Copyright Year	2016
Abstract	Emotional head motion plays an important role in human-computer interaction (HCI), which is one of the important factors to improve users’ experience in HCI. However, it is still not clear how head motions are influenced by speech features in different emotion states. In this study, we aim to construct a bimodal mapping model from speech to head motions, and try to discover what kinds of prosodic and linguistic features have the most significant influence on emotional head motions. A two-layer clustering schema is introduced to obtain reliable clusters from head motion parameters. With these clusters, an emotion related speech to head gesture mapping model is constructed by a Classification and Regression Tree (CART). Based on the statistic results of CART, a systematical statistic map of the relationship between speech features (including prosodic and linguistic features) and head gestures is presented. The map reveals the features which have the most significant influence on head motions in long or short utterances. We also make an analysis on how linguistic features contribute to different emotional expressions. The discussions in this work provide important references for realistic animation of speech driven talking-head or avatar.
Starting Page	5125
Ending Page	5146
Page Count	22
File Format	PDF
ISSN	13807501
Journal	Multimedia Tools and Applications
Volume Number	75
Issue Number	9
e-ISSN	15737721
Language	English
Publisher	Springer US
Publisher Date	2016-03-03
Publisher Place	New York
Access Restriction	One Nation One Subscription (ONOS)
Subject Keyword	Visual prosody Head gesture Prosody clustering Multimedia Information Systems Computer Communication Networks Data Structures, Cryptology and Information Theory Special Purpose and Application-Based Systems
Content Type	Text
Resource Type	Article
Subject	Computer Networks and Communications Hardware and Architecture Software Media Technology

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Hand gesture recognition with jointly calibrated Leap Motion and depth sensor

Head motion synthesis from speech using deep neural networks

Gesture based human motion and game principles to aid understanding of science and cultural practices

Graph-based multimodal clustering for social multimedia

Motion dense sampling and component clustering for action recognition

Incremental visual objects clustering with the growing vocabulary tree

Cultural-based visual expression: emotional analysis of human face via Peking Opera Painted Faces (POPF)

Learned features versus engineered features for multimedia indexing

Head and facial gestures synthesis using PAD model for an expressive talking avatar

Emotional head motion predicting from prosodic and linguistic features

Similar Documents

Hand gesture recognition with jointly calibrated Leap Motion and depth sensor

Head motion synthesis from speech using deep neural networks

Gesture based human motion and game principles to aid understanding of science and cultural practices

Graph-based multimodal clustering for social multimedia

Motion dense sampling and component clustering for action recognition

Incremental visual objects clustering with the growing vocabulary tree

Cultural-based visual expression: emotional analysis of human face via Peking Opera Painted Faces (POPF)

Learned features versus engineered features for multimedia indexing

Head and facial gestures synthesis using PAD model for an expressive talking avatar

Emotional head motion predicting from prosodic and linguistic features