NDLI: A study of manual gesture-based selection for the PEMMI multimodal transport management interface

Please wait, while we are loading the content...

Integrating sketch and speech inputs using spatial information

Automatic detection of interaction groups

Understanding the effect of life-like interface agents through users' eye movements

Probabilistic grounding of situated speech using plan recognition and reference resolution

Audio-visual cues distinguishing self- from system-directed speech in younger and older adults

Synthetic characters as multichannel interfaces

Using observations of real designers at work to inform the development of a novel haptic modeling system

The contrastive evaluation of unimodal and multimodal interfaces for voice otput communication aids

The "puzzle" of sensory perception: putting together multisensory information

Distributed pointing for multimodal collaboration over sketched diagrams

Meeting room configuration and multiple camera calibration in meeting analysis

Analyzing and predicting focus of attention in remote collaborative tasks

Augmenting conversational dialogue by means of latent semantic googling

Identifying the intended addressee in mixed human-human and human-computer interaction from non-verbal features

XfaceEd: authoring tool for embodied conversational agents

A comparison of two methods of scaling on form perception via a haptic interface

Agent-based architecture for implementing multimodal learning environments for visually impaired children

Interactive humanoids and androids as ideal interfaces for humans

Contextual recognition of head gestures

A multimodal perceptual user interface for video-surveillance environments

Gaze-based selection of standard-size menu items

Human-style interaction with a robot for cooperative learning of scene objects

Multimodal multispeaker probabilistic tracking in meetings

A first evaluation study of a database of kinetic facial expressions (DaFEx)

An initial usability assessment for symbolic haptic rendering of music parameters

Perceiving ordinal data haptically under workload

Socially aware computation and communication

Combining environmental cues & head gestures to interact with wearable devices

Inferring body pose using speech content

Region extraction of a gaze object using the gaze point and view image sequences

A look under the hood: design and development of the first SmartWeb system demonstrator

A probabilistic inference of multiparty-conversation structure based on Markov-switching models of gaze patterns, head directions, and utterances

Hapticat: exploration of affective touch

Tangible user interfaces for 3D clipping plane interaction with volumetric data: a case study

Virtual tangible widgets: seamless universal interaction with personal sensing devices

A joint particle filter for audio-visual speaker tracking

A transformational approach for multimodal web user interfaces based on UsiXML

The connector: facilitating context-aware communication

A pattern mining method for interpretation of interaction

A user interface framework for multimodal VR interactions

A study of manual gesture-based selection for the PEMMI multimodal transport management interface

Multimodal output specification / simulation platform

Recognition of sign language subwords based on boosted hidden Markov models

Migratory MultiModal interfaces in MultiDevice environments

Gesture-driven American sign language phraselator

Exploring multimodality in the laboratory and the field

Interactive vision to detect target objects for helper robots

A study of manual gesture-based selection for the PEMMI multimodal transport management interface

Content Provider	ACM Digital Library
Author	Chen, Fang Shi, Yu Taib, Ronnie Wu, Mike Lichman, Serge Choi, Eric Epps, Julien Ruiz, Natalie
Abstract	Operators of traffic control rooms are often required to quickly respond to critical incidents using a complex array of multiple keyboards, mice, very large screen monitors and other peripheral equipment. To support the aim of finding more natural interfaces for this challenging application, this paper presents PEMMI (Perceptually Effective Multimodal Interface), a transport management system control prototype taking video-based manual gesture and speech recognition as inputs. A specific theme within this research is determining the optimum strategy for gesture input in terms of both single-point input selection and suitable multimodal feedback for selection. It has been found that users tend to prefer larger selection areas for targets in gesture interfaces, and tend to select within 44% of this selection radius. The minimum effective size for targets when using 'device-free' gesture interfaces was found to be 80 pixels (on a 1280x1024 screen). This paper also shows that feedback on gesture input via large screens is enhanced by the use of both audio and visual cues to guide the user's multimodal input. Audio feedback in particular was found to improve user response time by an average of 20% over existing gesture selection strategies for multimodal tasks.
Starting Page	274
Ending Page	281
Page Count	8
File Format	PDF
ISBN	1595930280
DOI	10.1145/1088463.1088510
Language	English
Publisher	Association for Computing Machinery (ACM)
Publisher Date	2005-10-04
Publisher Place	New York
Access Restriction	Subscribed
Subject Keyword	Multimodal fusion Speech Multimodal output generation Manual gesture Multimodal interaction
Content Type	Text
Resource Type	Article

Central Library (ISO-9001:2015 Certified)
Indian Institute of Technology Kharagpur
Kharagpur, West Bengal, India | PIN - 721302

See location in the Map
03222 282435
Mail: support@ndl.gov.in

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in