NDLI: A potential-based method for finite-stage Markov Decision Process

Content Provider	IEEE Xplore Digital Library
Author	Qing-Shan Jia
Copyright Year	2008
Description	Author affiliation: Dept. of Autom., Tsinghua Univ., Beijing (Qing-Shan Jia)
Abstract	Finite-stage Markov decision process (MDP) supplies a general framework for many practical problems when only the performance in a finite duration is of interest. Dynamic programming (DP) supplies a general way to find the optimal policies but is usually practically infeasible, due to the exponentially increasing policy space. Approximating the finite-stage MDP by an infinite-stage MDP reduces the search space but usually does not find the optimal stationary policy, due to the approximation error. We develop a method that finds the optimal stationary policies for the finite-stage MDP. The method is based on performance potentials, which can be estimated through sample paths and thus suits practical application.
Starting Page	5029
Ending Page	5034
File Size	208806
Page Count	6
File Format	PDF
ISBN	9781424420780
ISSN	07431619
DOI	10.1109/ACC.2008.4587291
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2008-06-11
Publisher Place	USA
Access Restriction	Subscribed
Rights Holder	American Automatic Control Council(AACC)
Subject Keyword	Dynamic programming Educational institutions Space stations State estimation Space technology USA Councils Approximation error Decision making Uncertainty State-space methods finite-stage Markov Decision Processes Performance potentials policy iteration stationary policy
Content Type	Text
Resource Type	Article
Subject	Electrical and Electronic Engineering

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Frc06.5 a potential-based method for finite-stage markov decision processes (2008).

Stochastic optimization of controlled partially observable Markov decision processes

Robust Dynamic Programming for Discounted Infinite-Horizon Markov Decision Processes with Uncertain Stationary Transition Matrice

Discounted Optimality for Continuous-Time Markov Decision Processes in Polish Spaces

Metrics for finite markov decision processes norm ferns.

Approximate Robust Policy Iteration for Discounted Infinite-Horizon Markov Decision Processes with Uncertain Stationary Parametric Transition Matrices

A Survey of Approximate Dynamic Programming

Hierarchical Approximate Policy Iteration With Binary-Tree State Space Decomposition

Computing Optimal Stationary Policies for Multi-Objective Markov Decision Processes

A potential-based method for finite-stage Markov Decision Process

Similar Documents

Frc06.5 a potential-based method for finite-stage markov decision processes (2008).

Stochastic optimization of controlled partially observable Markov decision processes

Robust Dynamic Programming for Discounted Infinite-Horizon Markov Decision Processes with Uncertain Stationary Transition Matrice

Discounted Optimality for Continuous-Time Markov Decision Processes in Polish Spaces

Metrics for finite markov decision processes norm ferns.

Approximate Robust Policy Iteration for Discounted Infinite-Horizon Markov Decision Processes with Uncertain Stationary Parametric Transition Matrices

A Survey of Approximate Dynamic Programming

Hierarchical Approximate Policy Iteration With Binary-Tree State Space Decomposition

Computing Optimal Stationary Policies for Multi-Objective Markov Decision Processes

A potential-based method for finite-stage Markov Decision Process