NDLI: Gaussian Processes for POMDP-Based Dialogue Manager Optimization

Content Provider	IEEE Xplore Digital Library
Author	Gasic, M. Young, S.
Copyright Year	2014
Abstract	A partially observable Markov decision process (POMDP) has been proposed as a dialog model that enables automatic optimization of the dialog policy and provides robustness to speech understanding errors. Various approximations allow such a model to be used for building real-world dialog systems. However, they require a large number of dialogs to train the dialog policy and hence they typically rely on the availability of a user simulator. They also require significant designer effort to hand-craft the policy representation. We investigate the use of Gaussian processes (GPs) in policy modeling to overcome these problems. We show that GP policy optimization can be implemented for a real world POMDP dialog manager, and in particular: 1) we examine different formulations of a GP policy to minimize variability in the learning process; 2) we find that the use of GP increases the learning rate by an order of magnitude thereby allowing learning by direct interaction with human users; and 3) we demonstrate that designer effort can be substantially reduced by basing the policy directly on the full belief space thereby avoiding ad hoc feature space modeling. Overall, the GP approach represents an important step forward towards fully automatic dialog policy optimization in real world systems.
Starting Page	28
Ending Page	40
Page Count	13
File Size	1889097
File Format	PDF
ISSN	23299290
Volume Number	22
Issue Number	1
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2014-01-01
Publisher Place	U.S.A.
Access Restriction	One Nation One Subscription (ONOS)
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Gaussian processes Optimization Kernel Approximation methods Bayes methods Speech Speech processing statistical dialog systems Gaussian process POMDP
Content Type	Text
Resource Type	Article
Subject	Acoustics and Ultrasonics Signal Processing Instrumentation Speech and Hearing Electrical and Electronic Engineering Computational Mathematics Media Technology

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Gaussian Processes for POMDP-Based Dialogue Manager Optimization

Perception-Based Personalization of Hearing Aids Using Gaussian Processes and Active Learning

Policy optimisation of POMDP-based dialogue systems without state space compression

Constrained Markov Bayesian Polynomial for Efficient Dialogue State Tracking

Bayesian Analysis of Phoneme Confusion Matrices

Perception-based personalization of hearing aids using Gaussian processes and active learning

Bayesian analysis of phoneme confusion matrices

Source and filter estimation for throat-microphone speech enhancement

Constrained Markov Bayesian polynomial for efficient dialogue state tracking

Gaussian Processes for POMDP-Based Dialogue Manager Optimization

Similar Documents

Gaussian Processes for POMDP-Based Dialogue Manager Optimization

Perception-Based Personalization of Hearing Aids Using Gaussian Processes and Active Learning

Policy optimisation of POMDP-based dialogue systems without state space compression

Constrained Markov Bayesian Polynomial for Efficient Dialogue State Tracking

Bayesian Analysis of Phoneme Confusion Matrices

Perception-based personalization of hearing aids using Gaussian processes and active learning

Bayesian analysis of phoneme confusion matrices

Source and filter estimation for throat-microphone speech enhancement

Constrained Markov Bayesian polynomial for efficient dialogue state tracking

Gaussian Processes for POMDP-Based Dialogue Manager Optimization