NDLI: Gradient Pursuits

Content Provider	IEEE Xplore Digital Library
Author	Blumensath, T. Davies, M.E.
Copyright Year	1991
Abstract	Sparse signal approximations have become a fundamental tool in signal processing with wide-ranging applications from source separation to signal acquisition. The ever-growing number of possible applications and, in particular, the ever-increasing problem sizes now addressed lead to new challenges in terms of computational strategies and the development of fast and efficient algorithms has become paramount. Recently, very fast algorithms have been developed to solve convex optimization problems that are often used to approximate the sparse approximation problem; however, it has also been shown, that in certain circumstances, greedy strategies, such as orthogonal matching pursuit, can have better performance than the convex methods. In this paper, improvements to greedy strategies are proposed and algorithms are developed that approximate orthogonal matching pursuit with computational requirements more akin to matching pursuit. Three different directional optimization schemes based on the gradient, the conjugate gradient, and an approximation to the conjugate gradient are discussed, respectively. It is shown that the conjugate gradient update leads to a novel implementation of orthogonal matching pursuit, while the gradient-based approach as well as the approximate conjugate gradient methods both lead to fast approximations to orthogonal matching pursuit, with the approximate conjugate gradient method being superior to the gradient method.
Sponsorship	IEEE Signal Processing Society
Starting Page	2370
Ending Page	2382
Page Count	13
File Size	758406
File Format	PDF
ISSN	1053587X
Volume Number	56
Issue Number	6
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2008-06-01
Publisher Place	U.S.A.
Access Restriction	One Nation One Subscription (ONOS)
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Matching pursuit algorithms Signal processing Signal processing algorithms Pursuit algorithms Gradient methods Dictionaries Source separation Noise reduction Bayesian methods Approximation algorithms sparse representations/approximations Conjugate gradient optimization gradient optimization matching pursuit (MP) orthogonal matching pursuit (OMP)
Content Type	Text
Resource Type	Article
Subject	Signal Processing Electrical and Electronic Engineering

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Stagewise Weak Gradient Pursuits

Matching Pursuit With Block Incoherent Dictionaries

Denoising using multi-stage randomized orthogonal matching pursuit

On the use of a priori information for sparse signal approximations

Dictionary Preconditioning for Greedy Algorithms

Soft Bayesian pursuit algorithm for sparse representations

Block sparse representations of tensors using Kronecker bases

Sparse Music Representation With Source-Specific Dictionaries and Its Application to Signal Separation

Algorithms for signal separation exploiting sparse representations, with application to texture image separation

Gradient Pursuits

Similar Documents

Stagewise Weak Gradient Pursuits

Matching Pursuit With Block Incoherent Dictionaries

Denoising using multi-stage randomized orthogonal matching pursuit

On the use of a priori information for sparse signal approximations

Dictionary Preconditioning for Greedy Algorithms

Soft Bayesian pursuit algorithm for sparse representations

Block sparse representations of tensors using Kronecker bases

Sparse Music Representation With Source-Specific Dictionaries and Its Application to Signal Separation

Algorithms for signal separation exploiting sparse representations, with application to texture image separation

Gradient Pursuits