NDLI: A generic framework for the inference of user states in human computer interaction : How patterns of low level behavioral cues support complex user states in HCI

Please wait, while we are loading the content...

A generic framework for the inference of user states in human computer interaction : How patterns of low level behavioral cues support complex user states in HCI

A three-component framework for empathic technologies to augment human interaction

Discrediting signals. A model of social evaluation to study discrediting moves in political debates

Conceptual analysis of social signals: the importance of clarifying terminology

Journal on Multimodal User Interfaces : Volume 6, Issue 1-2, July 2012

Journal on Multimodal User Interfaces : Volume 5

Journal on Multimodal User Interfaces : Volume 4

Journal on Multimodal User Interfaces : Volume 3

Journal on Multimodal User Interfaces : Volume 2

Journal on Multimodal User Interfaces : Volume 1

A generic framework for the inference of user states in human computer interaction : How patterns of low level behavioral cues support complex user states in HCI

Content Provider	Springer Nature Link
Author	Scherer, Stefan Glodek, Michael Layher, Georg Schels, Martin Schmidt, Miriam Brosch, Tobias Tschechne, Stephan Schwenker, Friedhelm Neumann, Heiko Palm, Günther
Copyright Year	2012
Abstract	The analysis of affective or communicational states in human-human and human-computer interaction (HCI) using automatic machine analysis and learning approaches often suffers from the simplicity of the approaches or that very ambitious steps are often tried to be taken at once. In this paper, we propose a generic framework that overcomes many difficulties associated with real world user behavior analysis (i.e. uncertainty about the ground truth of the current state, subject independence, dynamic realtime analysis of multimodal information, and the processing of incomplete or erroneous inputs, e.g. after sensor failure or lack of input). We motivate the approach, that is based on the analysis and spotting of behavioral cues that are regarded as basic building blocks forming user state specific behavior, with the help of related work and the analysis of a large HCI corpus. For this corpus paralinguistic and nonverbal behavior could be significantly associated with user states. Some of our previous work on the detection and classification of behavioral cues is presented and a layered architecture based on hidden Markov models is introduced. We believe that this step by step approach towards the understanding of human behavior underlined by encouraging preliminary results outlines a principled approach towards the development and evaluation of computational mechanisms for the analysis of multimodal social signals.
Starting Page	117
Ending Page	141
Page Count	25
File Format	PDF
ISSN	17837677
Journal	Journal on Multimodal User Interfaces
Volume Number	6
Issue Number	3-4
e-ISSN	17838738
Language	English
Publisher	Springer-Verlag
Publisher Date	2012-04-05
Publisher Place	Berlin, Heidelberg
Access Restriction	One Nation One Subscription (ONOS)
Subject Keyword	Multimodal information fusion Nonverbal behavioral cue detection Layered architecture Fuzzy data processing Human-computer interaction User Interfaces and Human Computer Interaction Signal, Image and Speech Processing Image Processing and Computer Vision
Content Type	Text
Resource Type	Article
Subject	Signal Processing Human-Computer Interaction

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Nonverbal interaction contextualized in collaborative virtual environments

Emergent leaders through looking and speaking: from audio-visual data to multimodal recognition

Multimodal user interface for the communication of the disabled

An open source integrated framework for rapid prototyping of multimodal affective applications in digital entertainment

Multimodal HCI: exploratory studies on effects of first impression and single modality ratings in retrospective evaluation

Run-time model based framework for automatic evaluation of multimodal interfaces

Interactive design of multimodal user interfaces : Reducing technical and visual complexity

An audio-visual dataset of human–human interactions in stressful situations

Combining feature-level and decision-level fusion in a hierarchical classifier for emotion recognition in the wild

A generic framework for the inference of user states in human computer interaction : How patterns of low level behavioral cues support complex user states in HCI

Similar Documents

Nonverbal interaction contextualized in collaborative virtual environments

Emergent leaders through looking and speaking: from audio-visual data to multimodal recognition

Multimodal user interface for the communication of the disabled

An open source integrated framework for rapid prototyping of multimodal affective applications in digital entertainment

Multimodal HCI: exploratory studies on effects of first impression and single modality ratings in retrospective evaluation

Run-time model based framework for automatic evaluation of multimodal interfaces

Interactive design of multimodal user interfaces : Reducing technical and visual complexity

An audio-visual dataset of human–human interactions in stressful situations

Combining feature-level and decision-level fusion in a hierarchical classifier for emotion recognition in the wild

A generic framework for the inference of user states in human computer interaction : How patterns of low level behavioral cues support complex user states in HCI