NDLI: A minimum discrimination information approach for hidden Markov modeling

Content Provider	IEEE Xplore Digital Library
Author	Ephraim, Y. Dembo, A. Rabiner, L.R.
Copyright Year	1963
Abstract	An iterative approach for minimum-discrimination-information (MDI) hidden Markov modeling of information sources is proposed. The approach is developed for sources characterized by a given set of partial covariance matrices and for hidden Markov models (HMMs) with Gaussian autoregressive output probability distributions (PDs). The approach aims at estimating the HMM which yields the MDI with respect to all sources that could have produced the given set of partial covariance matrices. Each iteration of the MDI algorithm generates a new HMM as follows. First, a PD for the source is estimated by minimizing the discrimination information measure with respect to the old model over all PDs which satisfy the given set of partial covariance matrices. Then a new model that decreases the discrimination information measure between the estimated PD of the source and the PD of the old model is developed. The problem of estimating the PD of the source is formulated as a standard constrained minimization problem in the Euclidean space. The estimation of a new model given the PD of the source is done by a procedure that generalizes the Baum algorithm. The MDI approach is shown to be a descent algorithm for the discrimination information measure, and its local convergence is proved.<>
Sponsorship	IEEE Information Theory Society
Starting Page	1001
Ending Page	1013
Page Count	13
File Size	1284363
File Format	PDF
ISSN	00189448
Volume Number	35
Issue Number	5
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	1989-09-01
Publisher Place	U.S.A.
Access Restriction	One Nation One Subscription (ONOS)
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Hidden Markov models Signal processing algorithms Covariance matrix Speech recognition Speech enhancement Speech processing Maximum likelihood estimation Mutual information Probability distribution Acoustic noise
Content Type	Text
Resource Type	Article
Subject	Library and Information Sciences Information Systems Computer Science Applications

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Maximum likelihood hidden Markov modeling using a dominant sequence of states

On the relations between modeling approaches for speech recognition

Gain-adapted hidden Markov models for recognition of clean and noisy speech

An inequality for rational functions with applications to some statistical estimation problems

Penalized maximum-likelihood estimation of covariance matrices with linear structure

On simultaneous signal estimation and parameter identification using a generalized likelihood approach

Blind Suppression of Nonstationary Diffuse Acoustic Noise Based on Spatial Covariance Matrix Decomposition

Maximum Likelihood Estimation of Transition Probabilities of Jump Markov Linear Systems

A Bayesian estimation approach for speech enhancement using hidden Markov models

A minimum discrimination information approach for hidden Markov modeling

Similar Documents

Maximum likelihood hidden Markov modeling using a dominant sequence of states

On the relations between modeling approaches for speech recognition

Gain-adapted hidden Markov models for recognition of clean and noisy speech

An inequality for rational functions with applications to some statistical estimation problems

Penalized maximum-likelihood estimation of covariance matrices with linear structure

On simultaneous signal estimation and parameter identification using a generalized likelihood approach

Blind Suppression of Nonstationary Diffuse Acoustic Noise Based on Spatial Covariance Matrix Decomposition

Maximum Likelihood Estimation of Transition Probabilities of Jump Markov Linear Systems

A Bayesian estimation approach for speech enhancement using hidden Markov models

A minimum discrimination information approach for hidden Markov modeling