NDLI: “GazeToTalk”: a nonverbal interface with meta-communication facility (Poster Session)

Please wait, while we are loading the content...

Design issues of iDICT: a gaze-assisted translation aid

Text input methods for eye trackers using off-screen targets

Effective eye-gaze input into Windows

Comparing interfaces based on what users watch and do

Extended tasks elicit complex eye movement patterns

The effects of a simulated cellular phone conversation on search for traffic signs in an elderly sample

Gazetracker: software designed to facilitate eye movement analysis

An interactive model-based environment for eye-movement protocol analysis and visualization

Analysis of eye tracking movements using FIR median hybrid filters

Identifying fixations and saccades in eye-tracking protocols

Visual fixations and level of attentional processing

“Saccade pickers” vs. “fixation pickers”: the effect of eye tracking instrumentation on research

Binocular eye tracking in virtual reality for inspection training

User performance with gaze contingent multiresolutional displays

Evaluating variable resolution displays with visual search: task performance and eye movements

“GazeToTalk”: a nonverbal interface with meta-communication facility (Poster Session)

Using eye tracking to investigate graphical elements for fully sighted and low vision users (poster session)

Eye-movement-contingent release of speech and “SEE”- multi-modalities eye tracking system (poster session)

What eye-movements tell us about ratios and spatial proportions

Technical aspects in the recording of scanpath eye movements (poster session)

Hand eye coordination patterns in target selection

Pupillary responses to emotionally provocative stimuli

The response of eye-movement and pupil size to audio instruction while viewing a moving target

“GazeToTalk”: a nonverbal interface with meta-communication facility (Poster Session)

Content Provider	ACM Digital Library
Author	Suzuki, Kaoru Fukui, Kazuhiro Chino, Tetsuro
Abstract	We propose a new human interface (HI) system named “GazeToTalk” that is implemented by vision based gaze detection, acoustic speech recognition (ASR), and animated human-like agent CG with facial expressions and gestures. The “GazeToTalk” system demonstrates that eye-tracking technologies can be utilized to improve HI effectively by working with other non-verbal messages such as facial expressions and gestures.Conventional voice interface system have the following serious drawbacks. (1) They cannot distinct between input voice and other noise, and (2) cannot understand who is the intended hearer of each utterance. A “push-to-Wk” mechanism can be used to ease these problems, but it spoils the advantages of voice interfaces (e.g. contact-less, suitability in hand-busy situation).In real human dialogues, besides exchanging content messages, people use non-verbal messages such as gaze, facial expressions and gestures to establish or maintain conversations, or recover from problems that arise in the conversation.The “GazeToTalk” system simulates this kind of “meta-communication” facility by utilizing vision based gaze detection, ASR, and human-like agent CG. When the user intends to input voice commands, he gazes on the agent on the display in order to request to talk, just as in daily human-human dialogues. This gaze is recognized by the gaze detection module and the agent shows a particular facial expression and gestures as a feedback to establish an “eye-contact.” Then the system accepts or rejects speech input from the user depending on the state of the “eye-contact.”This mechanism allows the “GazeToTalk” system to accept only intended voice input and ignore another voices and environmental noises successfully, without forcing any arbitrary operation to the user. We also demonstrate an extended mechanism to treat more flexible “eye contact” variations.The preliminary experiments suggest that in the context of meta-communication, nonverbal messages can be utilized to improve HI in terms of naturalness, friendliness and tactfulness.
File Format	PDF
ISBN	1581132808
DOI	10.1145/355017.355034
Language	English
Publisher	Association for Computing Machinery (ACM)
Publisher Date	2000-11-08
Publisher Place	New York
Access Restriction	Subscribed
Content Type	Text
Resource Type	Article

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

A spatially-adaptive bus interface for low-switching communication (poster session)

Speech Communication Session 2aSC: Linking Perception and Production (Poster Session) (2013)

A communication support interface based on learning awareness for collaborative learning

The body's surface as a multimedia interface: closed-eyes nonverbal telehaptic communication

Nonverbal communication with a humanoid robot via head gestures

Speech Communication Session 2aSC: Linking Perception and Production (Poster Session) (2013)

Speech communication session 2asc: linking perception and production (poster session) (2013).

Visual feedback on nonverbal communication: A design exploration with healthcare professionals

Session III. Poster Session

“GazeToTalk”: a nonverbal interface with meta-communication facility (Poster Session)

Similar Documents

A spatially-adaptive bus interface for low-switching communication (poster session)

Speech Communication Session 2aSC: Linking Perception and Production (Poster Session) (2013)

A communication support interface based on learning awareness for collaborative learning

The body's surface as a multimedia interface: closed-eyes nonverbal telehaptic communication

Nonverbal communication with a humanoid robot via head gestures

Speech Communication Session 2aSC: Linking Perception and Production (Poster Session) (2013)

Speech communication session 2asc: linking perception and production (poster session) (2013).

Visual feedback on nonverbal communication: A design exploration with healthcare professionals

Session III. Poster Session

“GazeToTalk”: a nonverbal interface with meta-communication facility (Poster Session)