NDLI: Asymptotic MAP criteria for model selection

Content Provider	IEEE Xplore Digital Library
Author	Djuric, P.M.
Copyright Year	1991
Abstract	The two most popular model selection rules in signal processing literature have been Akaike's (1974) criterion (AIC) and Rissanen's (1978) principle of minimum description length (MDL). These rules are similar in form in that they both consist of data and penalty terms. Their data terms are identical, but the penalties are different, MDL being more stringent toward overparameterization. AIC penalizes for each additional model parameter with an equal incremental amount of penalty, regardless of the parameter's role in the model, In most of the literature on model selection, MDL appears in a form that also suggests equal penalty for every unknown parameter. This MDL criterion, we refer to as naive MDL. In this paper, we show that identical penalization for every parameter is not appropriate and that the penalty has to depend on the model structure and type of model parameters. The approach to showing this is Bayesian, and it relies on large sample theory. We derive maximum a posteriori (MAP) rules for several different families of competing models and obtain forms that are similar to AIC and naive MDL. For some families, however, we find that the derived penalties are different. In those cases, our extensive simulations show that the MAP rule outperforms AIC and naive MDL.
Sponsorship	IEEE Signal Processing Society
Starting Page	2726
Ending Page	2735
Page Count	10
File Size	366014
File Format	PDF
ISSN	1053587X
Volume Number	46
Issue Number	10
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	1998-10-01
Publisher Place	U.S.A.
Access Restriction	One Nation One Subscription (ONOS)
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Signal processing Bayesian methods Acoustic distortion Underwater acoustics Image analysis Biomedical imaging Acoustic testing Image processing Codes Frequency
Content Type	Text
Resource Type	Article
Subject	Signal Processing Electrical and Electronic Engineering

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Model Selection Based On Asymptotic Bayes Theory

Frame-Based Time-Scale Filters for Underwater Acoustic Noise Reduction

Frequency domain compensation for inhomogeneous layers in ultrasound holography

Channel Modeling and Threshold Signal Processing in Underwater Acoustics: An Analytical Overview

Three-dimensional image generation and processing in underwater acoustic vision

Model selection based on Bayesian predictive densities and multiple data records

Bayesian Image Modeling of cDNA Microarray Spots

A model selection rule for sinusoids in white Gaussian noise

Bayesian 2-D deconvolution: a model for diffuse ultrasound scattering

Asymptotic MAP criteria for model selection

Similar Documents

Model Selection Based On Asymptotic Bayes Theory

Frame-Based Time-Scale Filters for Underwater Acoustic Noise Reduction

Frequency domain compensation for inhomogeneous layers in ultrasound holography

Channel Modeling and Threshold Signal Processing in Underwater Acoustics: An Analytical Overview

Three-dimensional image generation and processing in underwater acoustic vision

Model selection based on Bayesian predictive densities and multiple data records

Bayesian Image Modeling of cDNA Microarray Spots

A model selection rule for sinusoids in white Gaussian noise

Bayesian 2-D deconvolution: a model for diffuse ultrasound scattering

Asymptotic MAP criteria for model selection