NDLI: Capturing user tests in a multimodal, multidevice informal prototyping tool

Please wait, while we are loading the content...

A system for fast, full-text entry for small electronic devices

Learning and reasoning about interruption

TorqueBAR: an ungrounded haptic feedback device

Georgia tech gesture toolkit: supporting experiments in gesture recognition

Capturing user tests in a multimodal, multidevice informal prototyping tool

Where is "it"? Event Synchronization in Gaze-Speech Input Systems

Combining speech and haptics for intuitive and efficient navigation through image databases

Demo: a multi-modal training environment for surgeons

Multimodal user interfaces: who's the user?

Mutual disambiguation of 3D multimodal interaction in augmented and virtual reality

Providing the basis for human-robot-interaction: a multi-modal attention system for a mobile robot

Towards tangibility in gameplay: building a tangible affective interface for a computer game

Architecture and implementation of multimodal plug and play

Large vocabulary sign language recognition based on hierarchical decision trees

Eyetracking in cognitive state detection for HCI

Interactive skills using active gaze tracking

Demo: playingfFantasyA with senToy

New techniques for evaluating innovative interfaces with eye tracking

Selective perception policies for guiding sensing and computation in multimodal systems: a comparative analysis

Multimodal biometrics: issues in design and testing

SmartKom: adaptive and flexible multimodal access to multiple applications

Hand motion gestural oscillations and multimodal discourse

A multimodal learning interface for grounding spoken language in sensory perceptions

Error recovery in a blended style eye gaze and speech interface

Crossmodal attention and multisensory integration: implications for multimodal interface design

Toward a theory of organized multimodal integration patterns during human-computer interaction

Sensitivity to haptic-audio asynchrony

A framework for rapid development of multimodal interfaces

Pointing gesture recognition based on 3D-tracking of face, hands and head orientation

A computer-animated tutor for spoken and written language learning

Using an autonomous cube for basic navigation and input

A multi-modal approach for determining speaker location and focus

Untethered gesture acquisition and recognition for a multimodal conversational system

Augmenting user interfaces with adaptive speech commands

GWindows: robust stereo vision for gesture-based control of windows

Distributed and local sensing techniques for face-to-face collaboration

A visually grounded natural language interface for reference to spatial scenes

Perceptual user interfaces using vision-based eye tracking

Sketching informal presentations

Gestural communication over video stream: supporting multimodal interaction for remote collaborative physical tasks

The role of spoken feedback in experiencing multimodal interfaces as human-like

Real time facial expression recognition in video using support vector machines

Modeling multimodal integration patterns and performance in seniors: toward adaptive processing of individual differences

Auditory, graphical and haptic contact cues for a reach, grasp, and place task in an augmented environment

Mouthbrush: drawing and painting by hand and mouth

XISL: a language for describing multimodal interaction scenarios

IRYS: a visualization tool for temporal analysis of multimodal interaction

Towards robust person recognition on handheld devices using face and speaker identification technologies

Algorithms for controlling cooperation between output modalities in 2D embodied conversational agents

Towards an attentive robotic dialog partner

Capturing user tests in a multimodal, multidevice informal prototyping tool

Content Provider	ACM Digital Library
Author	Landay, James A. Sinha, Anoop K.
Abstract	Interaction designers are increasingly faced with the challenge of creating interfaces that incorporate multiple input modalities, such as pen and speech, and span multiple devices. Few early stage prototyping tools allow non-programmers to prototype these interfaces. Here we describe CrossWeaver, a tool for informally prototyping multimodal, multidevice user interfaces. This tool embodies the informal prototyping paradigm, leaving design representations in an informal, sketched form, and creates a working prototype from these sketches. CrossWeaver allows a user interface designer to sketch storyboard scenes on the computer, specifying simple multimodal command transitions between scenes. The tool also allows scenes to target different output devices. Prototypes can run across multiple standalone devices simultaneously, processing multimodal input from each one. Thus, a designer can visually create a multimodal prototype for a collaborative meeting or classroom application. CrossWeaver captures all of the user interaction when running a test of a prototype. This input log can quickly be viewed visually for the details of the users' multimodal interaction or it can be replayed across all participating devices, giving the designer information to help him or her analyze and iterate on the interface design.
Starting Page	117
Ending Page	124
Page Count	8
File Format	PDF
ISBN	1581136218
DOI	10.1145/958432.958457
Language	English
Publisher	Association for Computing Machinery (ACM)
Publisher Date	2003-11-05
Publisher Place	New York
Access Restriction	Subscribed
Subject Keyword	Informal prototyping Pen and speech input Multidevice Multimodal Mobile interface design Sketching
Content Type	Text
Resource Type	Article

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Capturing User Tests in a Multimodal, Multidevice Informal Prototyping Tool (2003)

J.A.: Capturing user tests in a multimodal, multidevice informal prototyping tool (2003)

DENIM: an informal tool for early stage web site design

Sketching informal presentations

UISKEI: a sketch-based prototyping tool for defining and evaluating user interface behavior

Visually Prototyping Perceptual User Interfaces through Multimodal Storyboarding (2001)

Visually Prototyping Perceptual User Interfaces through Multimodal Storyboarding (2001)

A design pattern for multimodal and multidevice user interfaces

DENIM: finding a tighter fit between tools and practice for Web site design

Capturing user tests in a multimodal, multidevice informal prototyping tool

Similar Documents

Capturing User Tests in a Multimodal, Multidevice Informal Prototyping Tool (2003)

J.A.: Capturing user tests in a multimodal, multidevice informal prototyping tool (2003)

DENIM: an informal tool for early stage web site design

Sketching informal presentations

UISKEI: a sketch-based prototyping tool for defining and evaluating user interface behavior

Visually Prototyping Perceptual User Interfaces through Multimodal Storyboarding (2001)

Visually Prototyping Perceptual User Interfaces through Multimodal Storyboarding (2001)

A design pattern for multimodal and multidevice user interfaces

DENIM: finding a tighter fit between tools and practice for Web site design

Capturing user tests in a multimodal, multidevice informal prototyping tool