NDLI: Proximal Markov chain Monte Carlo algorithms

Content Provider	Springer Nature Link
Author	Pereyra, Marcelo
Copyright Year	2015
Abstract	This paper presents a new Metropolis-adjusted Langevin algorithm (MALA) that uses convex analysis to simulate efficiently from high-dimensional densities that are log-concave, a class of probability distributions that is widely used in modern high-dimensional statistics and data analysis. The method is based on a new first-order approximation for Langevin diffusions that exploits log-concavity to construct Markov chains with favourable convergence properties. This approximation is closely related to Moreau–Yoshida regularisations for convex functions and uses proximity mappings instead of gradient mappings to approximate the continuous-time process. The proposed method complements existing MALA methods in two ways. First, the method is shown to have very robust stability properties and to converge geometrically for many target densities for which other MALA are not geometric, or only if the step size is sufficiently small. Second, the method can be applied to high-dimensional target densities that are not continuously differentiable, a class of distributions that is increasingly used in image processing and machine learning and that is beyond the scope of existing MALA and HMC algorithms. To use this method it is necessary to compute or to approximate efficiently the proximity mappings of the logarithm of the target density. For several popular models, including many Bayesian models used in modern signal and image processing and machine learning, this can be achieved with convex optimisation algorithms and with approximations based on proximal splitting techniques, which can be implemented in parallel. The proposed method is demonstrated on two challenging high-dimensional and non-differentiable models related to image resolution enhancement and low-rank matrix estimation that are not well addressed by existing MCMC methodology.
Starting Page	745
Ending Page	760
Page Count	16
File Format	PDF
ISSN	09603174
Journal	Statistics and Computing
Volume Number	26
Issue Number	4
e-ISSN	15731375
Language	English
Publisher	Springer US
Publisher Date	2015-05-31
Publisher Place	New York
Access Restriction	One Nation One Subscription (ONOS)
Subject Keyword	Bayesian inference Convex analysis High-dimensional statistics Markov chain Monte Carlo Proximal algorithms Signal processing Statistics and Computing/Statistics Programs Artificial Intelligence (incl. Robotics) Statistical Theory and Methods Probability and Statistics in Computer Science
Content Type	Text
Resource Type	Article
Subject	Statistics and Probability Theoretical Computer Science Computational Theory and Mathematics Statistics, Probability and Uncertainty

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Proximal Markov chain Monte Carlo algorithms

Exact Bayesian inference for the Bingham distribution

Bayesian parameter inference for partially observed stopped processes

Data free inference with processed data products

Split Hamiltonian Monte Carlo

An adaptive sequential Monte Carlo method for approximate Bayesian computation

Parallelizing MCMC for Bayesian spatiotemporal geostatistical models

On population-based simulation for static inference

Noisy Monte Carlo: convergence of Markov chains with approximate transition kernels

Proximal Markov chain Monte Carlo algorithms

Similar Documents

Proximal Markov chain Monte Carlo algorithms

Exact Bayesian inference for the Bingham distribution

Bayesian parameter inference for partially observed stopped processes

Data free inference with processed data products

Split Hamiltonian Monte Carlo

An adaptive sequential Monte Carlo method for approximate Bayesian computation

Parallelizing MCMC for Bayesian spatiotemporal geostatistical models

On population-based simulation for static inference

Noisy Monte Carlo: convergence of Markov chains with approximate transition kernels

Proximal Markov chain Monte Carlo algorithms