NDLI: Curve shape and curvature perception through interactive sonification

Content Provider	ACM Digital Library
Author	Shelley, Simon Hollowood, Jacqueline Alonso-arevalo, Miguel A. Kohlrausch, Armin Sharples, Sarah Pettitt, Michael Hermes, Dik
Copyright Year	2012
Abstract	In this article we present an approach that uses sound to communicate geometrical data related to a virtual object. This has been developed in the framework of a multimodal interface for product design. The interface allows a designer to evaluate the quality of a 3-D shape using touch, vision, and sound. Two important considerations addressed in this article are the nature of the data that is sonified and the haptic interaction between the user and the interface, which in fact triggers the sound and influences its characteristics. Based on these considerations, we present a number of sonification strategies that are designed to map the geometrical data of interest into sound. The fundamental frequency of various sounds was used to convey the curve shape or the curvature to the listeners. Two evaluation experiments are described, one involves partipants with a varied background, the other involved the intended users, i.e. participants with a background in industrial design. The results show that independent of the sonification method used and independent of whether the curve shape or the curvature were sonified, the sonification was quite successful. In the first experiment participants had a success rate of about 80% in a multiple choice task, in the second experiment it took the participants on average less than 20 seconds to find the maximum, minimum or inflection points of the curvature of a test curve.
Starting Page	1
Ending Page	19
Page Count	19
File Format	PDF
ISSN	15443558
e-ISSN	15443965
DOI	10.1145/2355598.2355600
Volume Number	9
Issue Number	4
Journal	ACM Transactions on Applied Perception (TAP)
Language	English
Publisher	Association for Computing Machinery (ACM)
Publisher Date	2012-10-22
Publisher Place	New York
Access Restriction	One Nation One Subscription (ONOS)
Subject Keyword	Sonification Haptics Modal synthesis Sound synthesis
Content Type	Text
Resource Type	Article
Subject	Experimental and Cognitive Psychology Theoretical Computer Science Computer Science

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Crystallization sonification of high-dimensional datasets

The Role of Sound Source Perception in Gestural Sound Description

Model-based sonification revisited---authors' comments on Hermann and Ritter, ICAD 2002

Interactive sonification of curve shape and curvature data.

After direct manipulation---direct sonification

Data sonification from the desktop: Should sound be part of standard data analysis software?

Aging and the haptic perception of 3D surface shape

Cross-Modal Associations between Color and Haptics

Perceptual characterization of motion evoked by sounds for synthesis control purposes

Curve shape and curvature perception through interactive sonification

Similar Documents

Crystallization sonification of high-dimensional datasets

The Role of Sound Source Perception in Gestural Sound Description

Model-based sonification revisited---authors' comments on Hermann and Ritter, ICAD 2002

Interactive sonification of curve shape and curvature data.

After direct manipulation---direct sonification

Data sonification from the desktop: Should sound be part of standard data analysis software?

Aging and the haptic perception of 3D surface shape

Cross-Modal Associations between Color and Haptics

Perceptual characterization of motion evoked by sounds for synthesis control purposes

Curve shape and curvature perception through interactive sonification