NDLI: A Constrained MDP Approach to Dynamic Quantizer Design for HMM State Estimation

Content Provider	IEEE Xplore Digital Library
Author	Ghasemi, N. Dey, S.
Copyright Year	1991
Abstract	This paper is concerned with dynamic quantizer design for state estimation of hidden Markov models (HMM) using multiple sensors under a sum power constraint at the sensor transmitters. The sensor nodes communicate with a fusion center over temporally correlated flat fading channels modelled by finite state Markov chains. Motivated by energy limitations in sensor nodes, we develop optimal quantizers by minimizing the long term average of the mean square estimation error with a constraint on the long term average of total transmission power across the sensors. Instead of introducing a cost function as a weighted sum of our two objectives, we propose a constrained Markov decision formulation as an average cost problem and employ a linear programming technique to obtain the optimal policy for the constrained problem. Our experimental results assert that the constrained approach is quite efficient in terms of computational complexity and memory requirements for our average cost problem and leads to the same optimal deterministic policies and optimal cost as the unconstrained approach under an irreducibility assumption on the underlying Markov chain and some mild regularity assumptions on the sensor measurement noise processes. We illustrate via numerical studies the performance results for the dynamic quantization scheme. We also study the effect of varying degrees of channel and measurement noise on the performance of the proposed scheme.
Sponsorship	IEEE Signal Processing Society
Starting Page	1203
Ending Page	1209
Page Count	7
File Size	566547
File Format	PDF
ISSN	1053587X
Volume Number	57
Issue Number	3
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2009-03-01
Publisher Place	U.S.A.
Access Restriction	One Nation One Subscription (ONOS)
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Hidden Markov models State estimation Cost function Noise measurement Transmitters Sensor fusion Fading Estimation error Linear programming Computational complexity state estimation linear programming Markov decision process power control
Content Type	Text
Resource Type	Article
Subject	Signal Processing Electrical and Electronic Engineering

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Dynamic Quantizer Design for Hidden Markov State Estimation Via Multiple Sensors With Fusion Center Feedback

HMM-Based Decision Fusion in Wireless Sensor Networks With Noncoherent Multiple Access

Dynamic Quantization for Multisensor Estimation Over Bandlimited Fading Channels

Robustness of policies in constrained Markov decision processes

Structured Threshold Policies for Dynamic Sensor Scheduling—A Partially Observed Markov Decision Process Approach

Power Allocation for Outage Minimization in State Estimation Over Fading Channels

Error Exponents for Neyman–Pearson Detection of Markov Chains in Noise

Probability of Error Analysis for Hidden Markov Model Filtering With Random Packet Loss

Properties of the maximum a posteriori path estimator in hidden Markov models

A Constrained MDP Approach to Dynamic Quantizer Design for HMM State Estimation

Similar Documents

Dynamic Quantizer Design for Hidden Markov State Estimation Via Multiple Sensors With Fusion Center Feedback

HMM-Based Decision Fusion in Wireless Sensor Networks With Noncoherent Multiple Access

Dynamic Quantization for Multisensor Estimation Over Bandlimited Fading Channels

Robustness of policies in constrained Markov decision processes

Structured Threshold Policies for Dynamic Sensor Scheduling—A Partially Observed Markov Decision Process Approach

Power Allocation for Outage Minimization in State Estimation Over Fading Channels

Error Exponents for Neyman–Pearson Detection of Markov Chains in Noise

Probability of Error Analysis for Hidden Markov Model Filtering With Random Packet Loss

Properties of the maximum a posteriori path estimator in hidden Markov models

A Constrained MDP Approach to Dynamic Quantizer Design for HMM State Estimation