NDLI: Body movements and laughter recognition: experiments in first encounter dialogues

Please wait, while we are loading the content...

Analysis of gesture frequency and amplitude as a function of personality in virtual agents

Annotation and analysis of listener's engagement based on multi-modal behaviors

Fitmirror: a smart mirror for positive affect in everyday user morning routines

Deictic gestures in coaching interactions

Assessment of users' interests in multimodal dialog based on exchange unit

Increasing robustness of multimodal interaction via individual interaction histories

Automatic annotation of gestural units in spontaneous face-to-face interaction

Attitude recognition of video bloggers using audio-visual descriptors

Body movements and laughter recognition: experiments in first encounter dialogues

On data driven parametric backchannel synthesis for expressing attentiveness in conversational agents

Body movements and laughter recognition: experiments in first encounter dialogues

Content Provider	ACM Digital Library
Author	Wilcock, Graham Trong, Trung Ngo Jokinen, Kristiina
Abstract	This paper reports work on automatic analysis of laughter and human body movements in a video corpus of human-human dialogues. We use the Nordic First Encounters video corpus where participants meet each other for the first time. This corpus has manual annotations of participants' head, hand and body movements as well as laughter occurrences. We employ machine learning methods to analyse the corpus using two types of features: visual features that describe bounding boxes around participants' heads and bodies, automatically detecting body movements in the video, and audio speech features based on the participants' spoken contributions. We then correlate the speech and video features and apply neural network techniques to predict if a person is laughing or not given a sequence of video features. The hypothesis is that laughter occurrences and body movement are synchronized, or at least there is a significant relation between laughter activities and occurrences of body movements. Our results confirm the hypothesis of the synchrony of body movements with laughter, but we also emphasise the complexity of the problem and the need for further investigations on the feature sets and the algorithm used.
Starting Page	20
Ending Page	24
Page Count	5
File Format	PDF
ISBN	9781450345620
DOI	10.1145/3011263.3011264
Language	English
Publisher	Association for Computing Machinery (ACM)
Publisher Date	2016-11-12
Publisher Place	New York
Access Restriction	Subscribed
Subject Keyword	Deep learning Gesturing Body movement Laughter
Content Type	Text
Resource Type	Article

Central Library (ISO-9001:2015 Certified)
Indian Institute of Technology Kharagpur
Kharagpur, West Bengal, India | PIN - 721302

See location in the Map
03222 282435
Mail: support@ndl.gov.in

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in