NDLI: Perceptual impact of gesture control of spatialization

Content Provider	ACM Digital Library
Author	Mcadams, S. Marentakis, G.
Copyright Year	2014
Abstract	In two experiments, visual cues from gesture control of spatialization were found to affect auditory movement perception depending on the identifiability of auditory motion trajectories, the congruency of audiovisual stimulation, the sensory focus of attention, and the attentional process involved. Visibility of the performer’s gestures improved spatial audio trajectory identification, but it shifted the listeners’ attention to vision, impairing auditory motion encoding in the case of incongruent stimulation. On the other hand, selectively directing attention to audition resulted in interference from the visual cues for acoustically ambiguous trajectories. Auditory motion information was poorly preserved when dividing attention between auditory and visual movement feedback from performance gestures. An auditory focus of attention is a listener strategy that maximizes performance, due to the improvement caused by congruent visual stimulation and its robustness to interference from incongruent stimulation for acoustically unambiguous trajectories. Attentional strategy and auditory motion calibration are two aspects that need to be considered when employing gesture control of spatialization.
Starting Page	1
Ending Page	21
Page Count	21
File Format	PDF
ISSN	15443558
e-ISSN	15443965
DOI	10.1145/2536764.2536769
Volume Number	10
Issue Number	4
Journal	ACM Transactions on Applied Perception (TAP)
Language	English
Publisher	Association for Computing Machinery (ACM)
Publisher Date	2013-10-01
Publisher Place	New York
Access Restriction	One Nation One Subscription (ONOS)
Subject Keyword	3D audio Multimodal integration Auditory movement Gesture control
Content Type	Text
Resource Type	Article
Subject	Experimental and Cognitive Psychology Theoretical Computer Science Computer Science

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

“Writing with music”: Exploring the use of auditory feedback in gesture interfaces

Comparison of auditory, visual, and audiovisual navigation in a 3D space

Perceptual plasticity in spatial auditory displays

A perceptual framework for the auditory display of scientific data

Perceptual auditory design: Comments on Edwards and Mitsopoulos, ICAD 1998

Top-Down Influences in the Detection of Spatial Displacement in a Musical Scene

Perceptual Tolerance to Stereoscopic 3D Image Distortion

Using Audio Cues to Support Motion Gesture Interaction on Mobile Devices

Perceptually motivated guidelines for voice synchronization in film

Perceptual impact of gesture control of spatialization

Similar Documents

“Writing with music”: Exploring the use of auditory feedback in gesture interfaces

Comparison of auditory, visual, and audiovisual navigation in a 3D space

Perceptual plasticity in spatial auditory displays

A perceptual framework for the auditory display of scientific data

Perceptual auditory design: Comments on Edwards and Mitsopoulos, ICAD 1998

Top-Down Influences in the Detection of Spatial Displacement in a Musical Scene

Perceptual Tolerance to Stereoscopic 3D Image Distortion

Using Audio Cues to Support Motion Gesture Interaction on Mobile Devices

Perceptually motivated guidelines for voice synchronization in film

Perceptual impact of gesture control of spatialization