NDLI: Multimodal sensing of affect intensity

Please wait, while we are loading the content...

Understanding people by tracking their word use (keynote)

Trust me: multimodal signals of trustworthiness

Adaptive review for mobile MOOC learning via implicit physiological signal sensing

Personalized unknown word detection in non-native language reading using eye gaze

Meeting extracts for discussion summarization based on multimodal nonverbal information

Automatic recognition of self-reported and perceived emotion: does joint modeling help?

Deep learning driven hypergraph representation for image-based emotion recognition

Analyzing the articulation features of children's touchscreen gestures

Understanding the impact of personal feedback on face-to-face interactions in the workplace

Social signal processing for dummies

Multimodal system for public speaking with real time feedback: a positive computing perspective

EmotiW 2016: video and group-level emotion recognition challenges

The influence of appearance and interaction strategy of a social robot on the feeling of uncanniness in humans

Emotion recognition in the wild challenge 2016

1st international workshop on embodied interaction with smart environments (workshop summary)

Learning to generate images and their descriptions (keynote)

Semi-situated learning of verbal and nonverbal content for repeated human-robot interaction

Visuotactile integration for depth perception in augmented reality

Discovering facial expressions for states of amused, persuaded, informed, sentimental and inspired

Getting to know you: a multimodal investigation of team behavior and resilience to stress

Personality classification and behaviour interpretation: an approach based on feature categories

Towards a listening agent: a system generating audiovisual laughs and smiles to show interest

Reach out and touch me: effects of four distinct haptic technologies on affective touch in virtual reality

Asynchronous video interviews vs. face-to-face interviews for communication skill measurement: a systematic study

Metering "black holes": networking stand-alone applications for distributed multimodal synchronization

Multimodal biofeedback system integrating low-cost easy sensing devices

Emotion recognition in the wild from videos using images

Viewing support system for multi-view videos

ASSP4MI2016: 2nd international workshop on advancements in social signal processing for multimodal interaction (workshop summary)

Embodied media: expanding human capacity via virtual reality and telexistence (keynote)

Towards building an attentive artificial listener: on the perception of attentiveness in audio-visual feedback tokens

Exploring multimodal biosignal features for stress detection during indoor mobility

Do speech features for detecting cognitive load depend on specific languages?

Measuring the impact of multimodal behavioural feedback loops on social interactions

Multiscale kernel locally penalised discriminant analysis exemplified by emotion recognition in speech

Sound emblems for affective multimodal output of a robotic tutor: a perception study

Using touchscreen interaction data to predict cognitive workload

Context and cognitive state triggered interventions for mobile MOOC learning

Towards a multimodal adaptive lighting system for visually impaired children

A telepresence system using a flexible textile display

A deep look into group happiness prediction from images

Engaging children with autism in a shape perception task using a haptic force feedback interface

ERM4CT 2016: 2nd international workshop on emotion representations and modelling for companion systems (workshop summary)

Help me if you can: towards multiadaptive interaction platforms (ICMI awardee talk)

Sequence-based multimodal behavior modeling for social agents

An IDE for multimodal controls in smart buildings

Training on the job: behavioral analysis of job interviews in hospitality

Analyzing mouth-opening transition pattern for predicting next speaker in multi-party meetings

Estimating self-assessed personality from body movements and proximity in crowded mingling scenarios

Automatic detection of very early stage of dementia through multimodal interaction with computer avatars

Exploration of virtual environments on tablet: comparison between tactile and tangible interaction techniques

Native vs. non-native language fluency implications on multimodal interaction for interpersonal skills training

Multimodal affective feedback: combining thermal, vibrotactile, audio and visual signals

Large-scale multimodal movie dialogue corpus

Video-based emotion recognition using CNN-RNN and C3D hybrid networks

Modeling user's decision process through gaze behavior

International workshop on multimodal virtual and augmented reality (workshop summary)

Emotion spotting: discovering regions of evidence in audio-visual emotion expressions

MobileSSI: asynchronous fusion for social signal interpretation in the wild

Niki and Julie: a robot and virtual human for studying multimodal social interaction

Immersive virtual reality with multimodal interaction and streaming technology

LSTM for dynamic emotion and group emotion recognition in the wild

Multimodal positive computing system for public speaking with real-time feedback

International workshop on social learning and multimodal interaction for designing artificial agents (workshop summary)

Semi-supervised model personalization for improved detection of learner's emotional engagement

Language proficiency assessment of English L2 speakers based on joint analysis of prosody and native language

A demonstration of multimodal debrief generation for AUVs, post-mission and in-mission

Multimodal interaction with the autonomous Android ERICA

Multi-clue fusion for emotion recognition in the wild

Prediction/Assessment of communication skill using multimodal cues in social interactions

1st international workshop on multi-sensorial approaches to human-food interaction (workshop summary)

Driving maneuver prediction using car sensor and driver physiological signals

Training deep networks for facial expression recognition with crowd-sourced label distribution

Laughter detection in the wild: demonstrating a tool for mobile social signal processing and visualization

Ask Alice: an artificial retrieval of information agent

Multi-view common space learning for emotion recognition in the wild

Player/Avatar body relations in multimodal augmented reality games

International workshop on multimodal analyses enabling artificial agents in human- machine interaction (workshop summary)

On leveraging crowdsourced data for automatic perceived stress detection

Deep multimodal fusion for persuasiveness prediction

Design of multimodal instructional tutoring agents using augmented reality and smart learning objects

HoloNet: towards robust emotion recognition in the wild

Computational model for interpersonal attitude expression

Investigating the impact of automated transcripts on non-native speakers' listening comprehension

Comparison of three implementations of HeadTurn: a multimodal interaction technique with gaze and head turns

AttentiveVideo: quantifying emotional responses to mobile video advertisements

Group happiness assessment using geometric features and dataset balancing

Assessing symptoms of excessive SNS usage based on user behavior and emotion

Speaker impact on audience comprehension for academic presentations

Effects of multimodal cues on children's perception of uncanniness in a social robot

Young Merlin: an embodied conversational agent in virtual reality

Happiness level prediction with sequential inputs via multiple regressions

Kawaii feeling estimation by product attributes and biological signals

EmoReact: a multimodal approach and dataset for recognizing emotional responses in children

Multimodal feedback for finger-based interaction in mobile augmented reality

Video emotion recognition in the wild based on fusion of multimodal features

Multimodal sensing of affect intensity

Bimanual input for multiscale navigation with pressure and touch gestures

Smooth eye movement interaction using EOG glasses

Wild wild emotion: a multimodal ensemble approach

Enriching student learning experience using augmented reality and smart learning objects

Intervention-free selection using EEG and eye tracking

Active speaker detection with audio-visual co-training

Audio and face video emotion recognition in the wild using deep neural networks and small datasets

Automated recognition of facial expressions authenticity

Automated scoring of interview videos using Doc2Vec multimodal feature extraction paradigm

Detecting emergent leader in a meeting environment using nonverbal visual features only

Automatic emotion recognition in the wild using an ensemble of static and dynamic representations

Improving the generalizability of emotion recognition systems: towards emotion recognition in the wild

Estimating communication skills using dialogue acts and nonverbal features in multiple discussion datasets

Stressful first impressions in job interviews

Multi-sensor modeling of teacher instructional segments in live classrooms

Multimodal sensing of affect intensity

Content Provider	ACM Digital Library
Author	Bhatia, Shalini
Abstract	Most research on affect intensity has relied on the Affect Intensity Measure (AIM) of self-report that asks respondents to rate how often they react to situations with strong emotions. The AIM gives an indication of how strongly or weakly individuals tend to experience emotions in their everyday life. In this PhD project, I plan to quantify the affect intensity on a continuous scale using multiple modalities of video and audio on real-world, clinically validated depression datasets. Most of the work in this area treats the problem as a binary classification problem, mainly due to the lack of dimensional data. As the depression severity of a subject increases, as seen in the case of melancholia, the facial movements become very subtle. In order to quantify depression in general, and subtypes such as melancholia in particular, we need to reveal these subtle changes. To do this, I propose to use video magnification approaches. Inspired by the success of deep learning in video classification, I plan on using deep learning for information fusion over multiple modalities, such as Convolutional Neural Networks and Long Short Term Memory Networks. Using the common approach to video classification, i.e. local feature extraction, fixed size video level description and training a classifier on the resulting bag of words representation, I present preliminary results on the classification of melancholic and non-melancholic depressed subjects and healthy controls, which will serve as a baseline for future development in depression classification and analysis. I have also compared the sensitivity and specificity of classification in depression sub-types. .
Starting Page	567
Ending Page	571
Page Count	5
File Format	PDF
ISBN	9781450345569
DOI	10.1145/2993148.2997622
Language	English
Publisher	Association for Computing Machinery (ACM)
Publisher Date	2016-10-31
Publisher Place	New York
Access Restriction	Subscribed
Subject Keyword	Deep learning Lstm Multimodal Depression Affect
Content Type	Text
Resource Type	Article

Central Library (ISO-9001:2015 Certified)
Indian Institute of Technology Kharagpur
Kharagpur, West Bengal, India | PIN - 721302

See location in the Map
03222 282435
Mail: support@ndl.gov.in

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in