NDLI: A pattern mining method for interpretation of interaction

Please wait, while we are loading the content...

Integrating sketch and speech inputs using spatial information

Automatic detection of interaction groups

Understanding the effect of life-like interface agents through users' eye movements

Probabilistic grounding of situated speech using plan recognition and reference resolution

Audio-visual cues distinguishing self- from system-directed speech in younger and older adults

Synthetic characters as multichannel interfaces

Using observations of real designers at work to inform the development of a novel haptic modeling system

The contrastive evaluation of unimodal and multimodal interfaces for voice otput communication aids

The "puzzle" of sensory perception: putting together multisensory information

Distributed pointing for multimodal collaboration over sketched diagrams

Meeting room configuration and multiple camera calibration in meeting analysis

Analyzing and predicting focus of attention in remote collaborative tasks

Augmenting conversational dialogue by means of latent semantic googling

Identifying the intended addressee in mixed human-human and human-computer interaction from non-verbal features

XfaceEd: authoring tool for embodied conversational agents

A comparison of two methods of scaling on form perception via a haptic interface

Agent-based architecture for implementing multimodal learning environments for visually impaired children

Interactive humanoids and androids as ideal interfaces for humans

Contextual recognition of head gestures

A multimodal perceptual user interface for video-surveillance environments

Gaze-based selection of standard-size menu items

Human-style interaction with a robot for cooperative learning of scene objects

Multimodal multispeaker probabilistic tracking in meetings

A first evaluation study of a database of kinetic facial expressions (DaFEx)

An initial usability assessment for symbolic haptic rendering of music parameters

Perceiving ordinal data haptically under workload

Socially aware computation and communication

Combining environmental cues & head gestures to interact with wearable devices

Inferring body pose using speech content

Region extraction of a gaze object using the gaze point and view image sequences

A look under the hood: design and development of the first SmartWeb system demonstrator

A probabilistic inference of multiparty-conversation structure based on Markov-switching models of gaze patterns, head directions, and utterances

Hapticat: exploration of affective touch

Tangible user interfaces for 3D clipping plane interaction with volumetric data: a case study

Virtual tangible widgets: seamless universal interaction with personal sensing devices

A joint particle filter for audio-visual speaker tracking

A transformational approach for multimodal web user interfaces based on UsiXML

The connector: facilitating context-aware communication

A pattern mining method for interpretation of interaction

A user interface framework for multimodal VR interactions

A study of manual gesture-based selection for the PEMMI multimodal transport management interface

Multimodal output specification / simulation platform

Recognition of sign language subwords based on boosted hidden Markov models

Migratory MultiModal interfaces in MultiDevice environments

Gesture-driven American sign language phraselator

Exploring multimodality in the laboratory and the field

Interactive vision to detect target objects for helper robots

A pattern mining method for interpretation of interaction

Content Provider	ACM Digital Library
Author	Sumi, Yasuyuki Hirano, Yasushi Morita, Tomoyuki Kajita, Shoji Mase, Kenji
Abstract	This paper proposes a novel mining method for multimodal interactions to extract important patterns of group activities. These extracted patterns can be used as machine-readable event indices in developing an interaction corpus based on a huge collection of human interaction data captured by various sensors. The event indices can be used, for example, to summarize a set of events and to search for particular events because they contain various pieces of context information. The proposed method extracts simultaneously occurring patterns of primitive events in interaction, such as gaze and speech, that in combination occur more consistently than randomly. The proposed method provides a statistically plausible definition of interaction events that is not possible through intuitive top-down definitions. We demonstrate the effectiveness of our method for the data captured in an experimental setup of a poster-exhibition scene. Several interesting patterns are extracted by the method, and we examined their interpretations.
Starting Page	267
Ending Page	273
Page Count	7
File Format	PDF
ISBN	1595930280
DOI	10.1145/1088463.1088509
Language	English
Publisher	Association for Computing Machinery (ACM)
Publisher Date	2005-10-04
Publisher Place	New York
Access Restriction	Subscribed
Subject Keyword	Multimodal interaction patterns Behavior mining Interaction corpus Activity patterns
Content Type	Text
Resource Type	Article

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

A design pattern mining method for interaction design

Mining a Multimodal Corpus for Non-Verbal Signals Sequences Conveying Attitudes

Multimodal interaction analysis in a smart house

Studying Multimodal Communication

Evaluating multimodal interaction patterns in

Sequential pattern mining of multi modal data streams in dyadic interactions.

Event Specific Multimodal Pattern Mining for Knowledge Base Construction

*5 ATR Intelligent Robotics and Communication Laboratories

Activity theory as a tool for identifying design patterns in cross-modal collaborative interaction.

A pattern mining method for interpretation of interaction

Similar Documents

A design pattern mining method for interaction design

Mining a Multimodal Corpus for Non-Verbal Signals Sequences Conveying Attitudes

Multimodal interaction analysis in a smart house

Studying Multimodal Communication

Evaluating multimodal interaction patterns in

Sequential pattern mining of multi modal data streams in dyadic interactions.

Event Specific Multimodal Pattern Mining for Knowledge Base Construction

*5 ATR Intelligent Robotics and Communication Laboratories

Activity theory as a tool for identifying design patterns in cross-modal collaborative interaction.

A pattern mining method for interpretation of interaction