NDLI: Switching control in multi-mode Markov decision processes

Content Provider	IEEE Xplore Digital Library
Author	Zhiyuan Ren Krogh, B.H.
Copyright Year	2001
Description	Author affiliation: Dept. of Electr. & Comput. Eng., Carnegie Mellon Univ., Pittsburgh, PA, USA (Zhiyuan Ren)
Abstract	This paper presents a switching control strategy for multi-mode Markov decision processes. The system to be controlled is modeled as a finite-state controlled Markov chain with a mode that evolves stochastically. Although the system state is observable, the mode is only partially observable in the sense that we know the system mode only when it is in a given set of observable modes. Given a set of controllers for the system, we consider the problem of determining a switching rule that selects the controller to be applied each time the system mode is observable. The objective is to minimize a long-term average cost from the system while satisfying bounds on the long-term average of other given performance measures. We assume the multi-mode model parameters are unknown a priori, so an adaptive switching rule is required. Algorithms are presented for computing approximations to the optimal switching rule based on estimating the model parameters online. The approach is illustrated for an example of dynamic power management of hard disk drives in computer systems.
Sponsorship	IEEE Control Syst. Soc
Starting Page	2095
Ending Page	2101
File Size	583484
Page Count	7
File Format	PDF
ISBN	0780370619
DOI	10.1109/CDC.2001.980561
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2001-12-04
Publisher Place	USA
Access Restriction	Subscribed
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Control systems Power system modeling Energy management Power system management Optimal control Control system synthesis Hard disks Application software Costs Parameter estimation
Content Type	Text
Resource Type	Article

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Modeling power management for hard disks

Dynamic power management of laptop hard disk

Mode-matching control policies for multi-mode Markov decision processes

Excitation System Parameters Estimation Using Evolutionary Algorithms

Arbitrarily modulated Markov decision processes

Linking software process modeling with Markov decision theory

Parameter estimation of switching piecewise linear system

Highly flexible multi-mode system synthesis

Event-driven power management

Switching control in multi-mode Markov decision processes

Similar Documents

Modeling power management for hard disks

Dynamic power management of laptop hard disk

Mode-matching control policies for multi-mode Markov decision processes

Excitation System Parameters Estimation Using Evolutionary Algorithms

Arbitrarily modulated Markov decision processes

Linking software process modeling with Markov decision theory

Parameter estimation of switching piecewise linear system

Highly flexible multi-mode system synthesis

Event-driven power management

Switching control in multi-mode Markov decision processes