NDLI: Optimal control and optimal sensor activation for Markov decision problems with costly observations

Content Provider	IEEE Xplore Digital Library
Author	Boel, R.K. van Schuppen, J.H.
Copyright Year	2015
Description	Author affiliation: Van Schuppen Control Res., Amsterdam, Netherlands (van Schuppen, J.H.) \|\| Syst. Res. Group, Ghent Univ., Zwijnaarde, Belgium (Boel, R.K.)
Abstract	This paper considers partial observation Markov decision processes. Besides the classical control decisions influencing the transition probabilities of the Markov process, we also consider control actions that can activate the sensors to provide more or less accurate information about the system state, explicitly including the cost of activating sensors. We synthesize control laws that minimize a discounted operating cost of the system over an infinite interval of time, where the instantaneous cost function depends on the current state, the control influencing the transition probabilities, and the control actions activating the sensors. A general computationally efficient optimal solution for this problem is not known. Hence we design supoptimal controllers that only use knowledge of the value function for the full state information Markov decision problem. Our solution guarantees that the discounted cost of operating the plant increases only by a bounded amount with respect to the minimal cost for the full state information problem. A new concept of pinned conditional distributions of the state given the observed history of the plant is required in order to implement these control laws online.
Starting Page	1440
Ending Page	1447
File Size	171086
Page Count	8
File Format	PDF
e-ISBN	9781479977871
DOI	10.1109/CCA.2015.7320814
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2015-09-21
Publisher Place	Australia
Access Restriction	Subscribed
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Maintenance engineering Markov processes Optimal control Inspection Actuators Aerospace electronics Mathematical model partial information control POMDP active sensor control stochastic control suboptimal feedback control
Content Type	Text
Resource Type	Article

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

An Optimal Medium Access Control with Partial Observations for Sensor Networks

An Optimal Medium Access Control with Partial Observations for Sensor Networks

Sample-based potentials estimation for the optimal control of stochastic system

An Optimal Medium Access Control with Partial Observations for Sensor Networks

Semi-Markov Decision Process With Partial Information for Maintenance Decisions

Optimal maintenance policies for three-states POMDP with quality measurement errors

Dynamic activation policies for event capture with rechargeable sensors.

Sleep Control for Tracking in Sensor Networks

Information Space Receding Horizon Control

Optimal control and optimal sensor activation for Markov decision problems with costly observations

Similar Documents

An Optimal Medium Access Control with Partial Observations for Sensor Networks

An Optimal Medium Access Control with Partial Observations for Sensor Networks

Sample-based potentials estimation for the optimal control of stochastic system

An Optimal Medium Access Control with Partial Observations for Sensor Networks

Semi-Markov Decision Process With Partial Information for Maintenance Decisions

Optimal maintenance policies for three-states POMDP with quality measurement errors

Dynamic activation policies for event capture with rechargeable sensors.

Sleep Control for Tracking in Sensor Networks

Information Space Receding Horizon Control

Optimal control and optimal sensor activation for Markov decision problems with costly observations