NDLI: Eye-movement-contingent release of speech and “SEE”- multi-modalities eye tracking system (poster session)

Please wait, while we are loading the content...

Design issues of iDICT: a gaze-assisted translation aid

Text input methods for eye trackers using off-screen targets

Effective eye-gaze input into Windows

Comparing interfaces based on what users watch and do

Extended tasks elicit complex eye movement patterns

The effects of a simulated cellular phone conversation on search for traffic signs in an elderly sample

Gazetracker: software designed to facilitate eye movement analysis

An interactive model-based environment for eye-movement protocol analysis and visualization

Analysis of eye tracking movements using FIR median hybrid filters

Identifying fixations and saccades in eye-tracking protocols

Visual fixations and level of attentional processing

“Saccade pickers” vs. “fixation pickers”: the effect of eye tracking instrumentation on research

Binocular eye tracking in virtual reality for inspection training

User performance with gaze contingent multiresolutional displays

Evaluating variable resolution displays with visual search: task performance and eye movements

“GazeToTalk”: a nonverbal interface with meta-communication facility (Poster Session)

Using eye tracking to investigate graphical elements for fully sighted and low vision users (poster session)

Eye-movement-contingent release of speech and “SEE”- multi-modalities eye tracking system (poster session)

What eye-movements tell us about ratios and spatial proportions

Technical aspects in the recording of scanpath eye movements (poster session)

Hand eye coordination patterns in target selection

Pupillary responses to emotionally provocative stimuli

The response of eye-movement and pupil size to audio instruction while viewing a moving target

Eye-movement-contingent release of speech and “SEE”- multi-modalities eye tracking system (poster session)

Content Provider	ACM Digital Library
Author	Liu, Weimin
Abstract	A novel research method, the eye-movement-contingent release of speech method, was developed to examine the use and nature of the sound code in visual word recognition in reading. A new multi-modalities eye tracking system (“SEE”) was developed to implement the eye-movement-contingent release of speech method. The SEE system provides the experimenter synchronized orthogonal manipulations of visual and auditory signals, accurate measurement of oculomotor responses, post-hoc data replay facilities and statistical analysis tool.A new method, eye-movement-contingent release of speech, was developed to study the use of sound codes during visual word recognition. This new method examines effects of spoken -rather then visual/orthographic- words on the concurrent recognition of visual words. Speech is to be presented while text are viewed and presentation of the speech signal is coordinated with the viewing of a preselected visual target word. During sentence reading, the reader's eye positions are continuously sampled, and a real time fixation detection algorithm is developed to present the auditory signal when a certain pre-specified eye position criterion (called boundary) is fulfilled. The auditory stimuli are presented from eye tracking data, that is, eye movement are contingent on the change of heard/seen stimuli, so that the location of the eye position during visual object perception is calculated relative to the auditory presentation of speech.“SEE”-multi-modalities eye tracking system was developed to implement this new method. SEE system was mainly built on a fifth-generation Dual-Purkinje SRI eye tracker but also provides general API supports for use with other eye trackers (i.e. ICAN and SM systems). SEE software toolkit was installed on an IBM compatible personal computer, which was connected with the eye tracker through an Analogue-to-Digital converter.SEE software toolkit is a 32-bit windows application running under Windows 95/98/NT/2000. It consists of two running phases: real-time data collection phase and post-hoc analysis phase. Data collection phase includes modules of calibration, real time eye data processing and raw data recording. Real time data processing module has sub-modules to process the raw data to filter noise, detect fixation/saccade, and manually/dynamically recalibrate to correct drift over time. Post-hoc analysis phase provides replay and statistic analysis. SEE software toolkit also provides visual and audio stimuli presentation.Calibration. During the calibration, the reader is instructed to fixate a consequential displayed series of 5-9 target points on the screen whose coordinates are known; the raw data from the eye tracker are collected for each point over a period of time and are used to calculate parameters of a mapping transformation equation. After successful calibration, the raw digital stream are continuously mapped to X/Y coordinates on the display.Eye-movement-contingent control. Movements of the eyes control the release of visual and acoustic information. Visual and/or sound boundaries are pre-defined in the sentence for contingent control. When a reader's eye moves across the release boundary, a visual and/or speech signal is presented. In the following illustration table, visual/sound boundary are defined at space before `yellow' and `stripe' respectively. * indicates the fixation location; ( ) indicates the spoken duration.
Starting Page	113
Ending Page	114
Page Count	2
File Format	PDF
ISBN	1581132808
DOI	10.1145/355017.355037
Language	English
Publisher	Association for Computing Machinery (ACM)
Publisher Date	2000-11-08
Publisher Place	New York
Access Restriction	Subscribed
Content Type	Text
Resource Type	Article

Central Library (ISO-9001:2015 Certified)
Indian Institute of Technology Kharagpur
Kharagpur, West Bengal, India | PIN - 721302

See location in the Map
03222 282435
Mail: support@ndl.gov.in

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in