NDLI: Controlled Markov chains with discounted risk-sensitive criteria: Applications to machine replacement

Content Provider	IEEE Xplore Digital Library
Author	Avila-Godoy, G. Brau, A. Fernandez-Gaucherand, E.
Copyright Year	1997
Description	Author affiliation: Dept. of Math., Arizona Univ., Tucson, AZ, USA (Avila-Godoy, G.)
Abstract	We analyze controlled Markov chains (CMC) with a risk-sensitive exponential discounted cost criterion. We present dynamic programming results for the finite horizon problem. We derive an optimality equation for the infinite-horizon case from which the optimal and exponential discounted cost and a utility-optimal policy can be obtained. A value iteration result is also given. These results were previously obtained by Chung and Sobel (1987) and others for a finite state space for the optimization of the set of deterministic Markovian policies. We show that those results are valid for an infinite countable state space and we consider the set of all admissible policies. We apply the results of the previous section to study the consequences of introducing risk sensitivity in an equipment replacement problem. Our interest was kindled by Fernandez-Gaucherand and Marcus (1994) who study risk-sensitivity in a finite horizon equipment replacement problem with partial state information. Finally, we show that there exists an optimal threshold ultimately stationary policy and conclude this paper by showing that the tail of that policy is a stationary risk-neutral optimal policy.
Starting Page	1115
Ending Page	1120
File Size	490758
Page Count	6
File Format	PDF
ISBN	0780341872
ISSN	01912216
DOI	10.1109/CDC.1997.657596
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	1997-12-12
Access Restriction	Subscribed
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	State-space methods Cost function History Mathematics Industrial engineering Risk analysis Dynamic programming Equations Tail Kernel
Content Type	Text
Resource Type	Article

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Controlled Markov chains with exponential risk-sensitive criteria: modularity, structured policies and applications

Controlled Markov chains with risk-sensitive exponential average cost criterion

Markov decision processes with risk-sensitive criteria: dynamic programming operators and discounted stochastic games

Value iteration for controlled Markov chains with risk sensitive cost criterion

Controlled Markov chains with risk-sensitive criteria: some (counter) examples

Recent results in controlled Markov chains with risk sensitive average criteria: the vanishing discount approach

The vanishing discount approach in Markov chains with risk-sensitive criteria

Analysis of a risk-sensitive control problem for hidden Markov chains

A note on some new results on the ergodic control of partially observed Markov chains

Controlled Markov chains with discounted risk-sensitive criteria: Applications to machine replacement

Similar Documents

Controlled Markov chains with exponential risk-sensitive criteria: modularity, structured policies and applications

Controlled Markov chains with risk-sensitive exponential average cost criterion

Markov decision processes with risk-sensitive criteria: dynamic programming operators and discounted stochastic games

Value iteration for controlled Markov chains with risk sensitive cost criterion

Controlled Markov chains with risk-sensitive criteria: some (counter) examples

Recent results in controlled Markov chains with risk sensitive average criteria: the vanishing discount approach

The vanishing discount approach in Markov chains with risk-sensitive criteria

Analysis of a risk-sensitive control problem for hidden Markov chains

A note on some new results on the ergodic control of partially observed Markov chains

Controlled Markov chains with discounted risk-sensitive criteria: Applications to machine replacement