NDLI: The contrastive evaluation of unimodal and multimodal interfaces for voice otput communication aids

Please wait, while we are loading the content...

Integrating sketch and speech inputs using spatial information

Automatic detection of interaction groups

Understanding the effect of life-like interface agents through users' eye movements

Probabilistic grounding of situated speech using plan recognition and reference resolution

Audio-visual cues distinguishing self- from system-directed speech in younger and older adults

Synthetic characters as multichannel interfaces

Using observations of real designers at work to inform the development of a novel haptic modeling system

The contrastive evaluation of unimodal and multimodal interfaces for voice otput communication aids

The "puzzle" of sensory perception: putting together multisensory information

Distributed pointing for multimodal collaboration over sketched diagrams

Meeting room configuration and multiple camera calibration in meeting analysis

Analyzing and predicting focus of attention in remote collaborative tasks

Augmenting conversational dialogue by means of latent semantic googling

Identifying the intended addressee in mixed human-human and human-computer interaction from non-verbal features

XfaceEd: authoring tool for embodied conversational agents

A comparison of two methods of scaling on form perception via a haptic interface

Agent-based architecture for implementing multimodal learning environments for visually impaired children

Interactive humanoids and androids as ideal interfaces for humans

Contextual recognition of head gestures

A multimodal perceptual user interface for video-surveillance environments

Gaze-based selection of standard-size menu items

Human-style interaction with a robot for cooperative learning of scene objects

Multimodal multispeaker probabilistic tracking in meetings

A first evaluation study of a database of kinetic facial expressions (DaFEx)

An initial usability assessment for symbolic haptic rendering of music parameters

Perceiving ordinal data haptically under workload

Socially aware computation and communication

Combining environmental cues & head gestures to interact with wearable devices

Inferring body pose using speech content

Region extraction of a gaze object using the gaze point and view image sequences

A look under the hood: design and development of the first SmartWeb system demonstrator

A probabilistic inference of multiparty-conversation structure based on Markov-switching models of gaze patterns, head directions, and utterances

Hapticat: exploration of affective touch

Tangible user interfaces for 3D clipping plane interaction with volumetric data: a case study

Virtual tangible widgets: seamless universal interaction with personal sensing devices

A joint particle filter for audio-visual speaker tracking

A transformational approach for multimodal web user interfaces based on UsiXML

The connector: facilitating context-aware communication

A pattern mining method for interpretation of interaction

A user interface framework for multimodal VR interactions

A study of manual gesture-based selection for the PEMMI multimodal transport management interface

Multimodal output specification / simulation platform

Recognition of sign language subwords based on boosted hidden Markov models

Migratory MultiModal interfaces in MultiDevice environments

Gesture-driven American sign language phraselator

Exploring multimodality in the laboratory and the field

Interactive vision to detect target objects for helper robots

The contrastive evaluation of unimodal and multimodal interfaces for voice otput communication aids

Content Provider	ACM Digital Library
Author	Baljko, Melanie
Abstract	For computational Augmentative and Alternative Communication (AAC) aids, it has often been asserted that multimodal interfaces have benefits over unimodal ones. Several such benefits have been described informally, but, to date, few have actually been formalized or quantified. In this paper, some of the special considerations of this application domain are described. Next, the hypothesized benefits of semantically nonredundant multimodal input actions over unimodal input actions are described formally. The notion of information rate, already well established as a dependent variable in evaluations of AAC devices, is quantified in this paper, using the formalisms provided by Information Theory (as opposed to other, idiosyncratic approaches that have been employed previously). A comparative analysis was performed between interfaces that afford unimodal input actions and those that afford semantically nonredundant multimodal input actions. This analysis permitted generalized conclusions, which have been synthesized with those of another, recently-completed analysis in which unimodal and semantically redundant multimodal input actions were compared. A reinterpretation of Keates and Robinson's empirical data (1998) shows that their criticism of multimodal interfaces for AAC devices, in part, was unfounded.
Starting Page	301
Ending Page	308
Page Count	8
File Format	PDF
ISBN	1595930280
DOI	10.1145/1088463.1088515
Language	English
Publisher	Association for Computing Machinery (ACM)
Publisher Date	2005-10-04
Publisher Place	New York
Access Restriction	Subscribed
Subject Keyword	Multimodal interfaces Interventions for communication disorders Augmentative and alternative communication (aac) Voice output communication aids (voca) Speech generating devices (sgd)
Content Type	Text
Resource Type	Article

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

The information-theoretic analysis of unimodal interfaces and their multimodal counterparts

Indirect text entry using one or two keys

A straight-talking case study

The contrastive evaluation of unimodal and multimodal interfaces for voice output communication aids (2005)

The Speech-Generating Device (SGD) Mentoring Program: Training Adults who use an SGD to Mentor

Augmentative and alternative communication with digital assistant for autistic children

Voice output communication aid application for personal digital assistant for autistic children

Development and Study of Support Applications for Autistic Children

17 Ways to Say Yes: Toward Nuanced Tone of Voice in AAC and Speech Technology

The contrastive evaluation of unimodal and multimodal interfaces for voice otput communication aids

Similar Documents

The information-theoretic analysis of unimodal interfaces and their multimodal counterparts

Indirect text entry using one or two keys

A straight-talking case study

The contrastive evaluation of unimodal and multimodal interfaces for voice output communication aids (2005)

The Speech-Generating Device (SGD) Mentoring Program: Training Adults who use an SGD to Mentor

Augmentative and alternative communication with digital assistant for autistic children

Voice output communication aid application for personal digital assistant for autistic children

Development and Study of Support Applications for Autistic Children

17 Ways to Say Yes: Toward Nuanced Tone of Voice in AAC and Speech Technology

The contrastive evaluation of unimodal and multimodal interfaces for voice otput communication aids