NDLI: A recursive dialogue game for personalized computer-aided pronunciation training

Content Provider	ACM Digital Library
Author	Wu, Chuan-Hsun Lee, Lin-Shan Su, Pei-Hao
Copyright Year	2015
Abstract	Learning languages in addition to the native language is very important for all people in the globalized world today, and computer-aided pronunciation training (CAPT) is attractive since the software can be used anywhere at any time, and repeated as many times as desired. In this paper, we introduce the immersive interaction scenario offered by spoken dialogues to CAPT by proposing a recursive dialogue game to make CAPT personalized. A number of tree-structured sub-dialogues are linked sequentially and recursively as the script for the game. The system policy at each dialogue turn is to select in real-time along the dialogue the best training sentence for each specific individual learner within the dialogue script, considering the learner's learning status and the future possible dialogue paths in the script, such that the learner can have the scores for all pronunciation units considered reaching a predefined standard in a minimum number of turns. The purpose here is that those pronunciation units poorly produced by the specific learner can be offered with more practice opportunities in the future sentences along the dialogue, which enables the learner to improve the pronunciation without having to repeat the same training sentences many times. This makes the learning process for each learner completely personalized. The dialogue policy is modeled by Markov decision process (MDP) with high-dimensional continuous state space, and trained with fitted value iteration using a huge number of simulated learners. These simulated leaners have the behavior similar to real learners, and were generated from a corpus of real learner data. The experiments demonstrated very promising results and a real cloud-based system is also successfully implemented.
Starting Page	127
Ending Page	141
Page Count	15
File Format	PDF
ISSN	23299290
e-ISSN	23299304
DOI	10.1109/TASLP.2014.2375572
Volume Number	23
Issue Number	1
Journal	IEEE/ACM Transactions on Audio, Speech and Language Processing (TASLP)
Language	English
Publisher	Association for Computing Machinery (ACM)
Publisher Date	2015-01-01
Access Restriction	One Nation One Subscription (ONOS)
Subject Keyword	Markov decision process Computer-aided pronunciation training (CAPT) Computer-assisted language learning Dialogue game Reinforcement learning
Content Type	Text
Resource Type	Article
Subject	Instrumentation Computational Mathematics Signal Processing Electrical and Electronic Engineering Acoustics and Ultrasonics Speech and Hearing Media Technology

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

A Recursive Dialogue Game for Personalized Computer-Aided Pronunciation Training

A dialogue game framework with personalized training using reinforcement learning for computer-assisted language learning

Automatic Pronunciation Scoring with Score Combination by Learning to Rank and Class-Normalized DP-Based Quantization

Automatic pronunciation scoring with score combination by learning to rank and class-normalized DP-based quantization

Supervised detection and unsupervised discovery of pronunciation error patterns for computer-assisted language learning

A Recursive Dialogue Game for Personalized Computer-Aided Pronunciation Training (2014)

A two-pass framework of mispronunciation detection and diagnosis for computer-aided pronunciation training

HMM-based emphatic speech synthesis for corrective feedback in computer-aided pronunciation training

A dialogue game framework with personalized training using reinforcement learning for computer-assisted language learning (2013)

A recursive dialogue game for personalized computer-aided pronunciation training

Similar Documents

A Recursive Dialogue Game for Personalized Computer-Aided Pronunciation Training

A dialogue game framework with personalized training using reinforcement learning for computer-assisted language learning

Automatic Pronunciation Scoring with Score Combination by Learning to Rank and Class-Normalized DP-Based Quantization

Automatic pronunciation scoring with score combination by learning to rank and class-normalized DP-based quantization

Supervised detection and unsupervised discovery of pronunciation error patterns for computer-assisted language learning

A Recursive Dialogue Game for Personalized Computer-Aided Pronunciation Training (2014)

A two-pass framework of mispronunciation detection and diagnosis for computer-aided pronunciation training

HMM-based emphatic speech synthesis for corrective feedback in computer-aided pronunciation training

A dialogue game framework with personalized training using reinforcement learning for computer-assisted language learning (2013)

A recursive dialogue game for personalized computer-aided pronunciation training