NDLI: Learning the Correspondence between Continuous Speeches and Motions

Content Provider	IEEE Xplore Digital Library
Author	Natsuki, O. Arata, N. Yoshiaki, I.
Copyright Year	2005
Description	Author affiliation: Kyoto Inst. of Technol. (Natsuki, O.; Arata, N.)
Abstract	Summary form only given. Roy (1999) developed a computational model of early lexical learning to address three questions: First, how do infants discover linguistic units? Second, how do they learn perceptually-grounded semantic categories? And third, how do they learn to associate linguistic units with appropriate semantic categories? His model coupled speech recordings with static images of objects, and acquired a lexicon of shape names. Kaplan et al. (2001) presented a model for teaching names of actions to an enhanced version of AIBO. The AIBO had built-in speech recognition facilities and behaviors. In this paper, we try to build a system that learns the correspondence between continuous speeches and continuous motions without a built-in speech recognizer nor built-in behaviors. We teach RobotPHONE to respond to voices properly by taking its hands. For example, one says 'bye-bye' to the RobotPHONE holding its hand and waving. From continuous input, the system must segment speech and discover acoustic units which correspond to words. The segmentation is done based on recurrent patterns which was found by incremental reference interval-free continuous DP (IRIFCDP) by Kiyama et al. (1996) and Utsunomiya et al. (2004), and we accelerate the IRIFCDP using ShiftCDP (Itoh and Tanaka, 2004). The system also segments motion by the accelerated IRIFCDP, and it memorizes co-occurring speech and motion patterns. Then, it can respond to taught words properly by detecting taught words in speech input by ShiftCDP. We gave a demonstration with a RobotPHONE at the conference. We expect that it can learn words in any languages because it has no built-in facilities specific to any language
Starting Page	202
Ending Page	202
File Size	73058
Page Count	1
File Format	PDF
ISBN	0780392264
DOI	10.1109/DEVLRN.2005.1490983
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2005-07-19
Publisher Place	Japan
Access Restriction	Subscribed
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Pediatrics Educational robots Shape Computational modeling Education Natural languages Shoulder Speech recognition Neck Acceleration
Content Type	Text
Resource Type	Article

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Learning the correspondence between continuous speeches and motions.

Kanji learning system based on the letter shape recognition method

ACORNS - towards computational modeling of communication and recognition skills

'Early recognition' of words in continuous speech

Evaluation of Tangible Learning Companion/Robot for English Language Learning

A natural language instruction system for humanoid robots integrating situated speech recognition, visual recognition and on-line whole-body motion generation

Embodied communications between humans and robots emerging from entrained gestures

Distribution and Recognition of Gestures in Human-Robot Interaction

Mouth Shape Sequence Recognition Based on Speech Phoneme Recognition

Learning the Correspondence between Continuous Speeches and Motions

Similar Documents

Learning the correspondence between continuous speeches and motions.

Kanji learning system based on the letter shape recognition method

ACORNS - towards computational modeling of communication and recognition skills

'Early recognition' of words in continuous speech

Evaluation of Tangible Learning Companion/Robot for English Language Learning

A natural language instruction system for humanoid robots integrating situated speech recognition, visual recognition and on-line whole-body motion generation

Embodied communications between humans and robots emerging from entrained gestures

Distribution and Recognition of Gestures in Human-Robot Interaction

Mouth Shape Sequence Recognition Based on Speech Phoneme Recognition

Learning the Correspondence between Continuous Speeches and Motions