Loading...
Please wait, while we are loading the content...
Similar Documents
Lumping in Markov Reward Processes
| Content Provider | Scilit |
|---|---|
| Author | Nicola, Victor F. |
| Copyright Year | 2021 |
| Description | Explicit conditions on the transition probabilities for lumping in a discrete-time Markov chain (DTMC) are well known and were given by Kemeny and Snell in 1960. They distinguish between “strong” lumpability for which the process is lumpable for any initial probability distribution on the states and “weak” lumpability for which the process is lumpable only for some initial probability distributions. This chapter obtains conditions for lumping in a continuous-time Markov reward process. It introduces the notion of “proportional dynamics” and gives necessary and sufficient conditions for it to hold. The chapter shows that proportional dynamics for a given measure is sufficient for weak lumpability for the same measure, it also implies unlumpability. It discusses the measures, such as the transient probabilities, the distribution of accumulated reward, the expected accumulated reward, and the instantaneous reward. Book Name: Numerical Solution of Markov Chains |
| Related Links | https://api.taylorfrancis.com/content/chapters/edit/download?identifierName=doi&identifierValue=10.1201/9781003210160-39&type=chapterpdf |
| Ending Page | 666 |
| Page Count | 4 |
| Starting Page | 663 |
| DOI | 10.1201/9781003210160-39 |
| Language | English |
| Publisher | Informa UK Limited |
| Publisher Date | 2021-06-16 |
| Access Restriction | Open |
| Subject Keyword | Book Name: Numerical Solution of Markov Chains Automotive Engineering Markov Reward Proportional Sufficient Accumulated Lumping Distinguish Explicit Transient |
| Content Type | Text |
| Resource Type | Chapter |
