Loading...
Please wait, while we are loading the content...
Similar Documents
Optimal risk probability for first passage models in semi-Markov decision processes
| Content Provider | Semantic Scholar |
|---|---|
| Author | Huang, Yonghui Guo, Xianping |
| Copyright Year | 2009 |
| Abstract | This paper studies the risk minimization problem in semi-Markov decision processes with denumerable states. The criterion to be optimized is the risk probability (or risk function) that a first passage time to some target set doesn't exceed a threshold value. We first characterize such risk functions and the corresponding optimal value function, and prove that the optimal value function satisfies the optimality equation by using a successive approximation technique. Then, we present some properties of optimal policies, and further give conditions for the existence of optimal policies. In addition, a value iteration algorithm and a policy improvement method for obtaining respectively the optimal value function and optimal policies are developed. Finally, two examples are given to illustrate the value iteration procedure and essential characterization of the risk function. |
| Starting Page | 404 |
| Ending Page | 420 |
| Page Count | 17 |
| File Format | PDF HTM / HTML |
| DOI | 10.1016/j.jmaa.2009.05.058 |
| Alternate Webpage(s) | http://www.math.pku.edu.cn/misc/probstat/hsu100/Talks/Prob8----Xianping%20Guo.pdf |
| Alternate Webpage(s) | https://doi.org/10.1016/j.jmaa.2009.05.058 |
| Volume Number | 359 |
| Language | English |
| Access Restriction | Open |
| Content Type | Text |
| Resource Type | Article |
