NDLI: A two-stage linear discriminant analysis via QR-decomposition

Content Provider	IEEE Xplore Digital Library
Author	Jieping Ye Qi Li
Copyright Year	1979
Abstract	Linear discriminant analysis (LDA) is a well-known method for feature extraction and dimension reduction. It has been used widely in many applications involving high-dimensional data, such as image and text classification. An intrinsic limitation of classical LDA is the so-called singularity problems; that is, it fails when all scatter matrices are singular. Many LDA extensions were proposed in the past to overcome the singularity problems. Among these extensions, PCA+LDA, a two-stage method, received relatively more attention. In PCA+LDA, the LDA stage is preceded by an intermediate dimension reduction stage using principal component analysis (PCA). Most previous LDA extensions are computationally expensive, and not scalable, due to the use of singular value decomposition or generalized singular value decomposition. In this paper, we propose a two-stage LDA method, namely LDA/QR, which aims to overcome the singularity problems of classical LDA, while achieving efficiency and scalability simultaneously. The key difference between LDA/QR and PCA+LDA lies in the first stage, where LDA/QR applies QR decomposition to a small matrix involving the class centroids, while PCA+LDA applies PCA to the total scatter matrix involving all training data points. We further justify the proposed algorithm by showing the relationship among LDA/QR and previous LDA methods. Extensive experiments on face images and text documents are presented to show the effectiveness of the proposed algorithm.
Sponsorship	IEEE Computer Society
Page Count	13
File Size	1207003
Starting Page	929
Ending Page	941
File Format	PDF
ISSN	01628828
Volume Number	27
Issue Number	6
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2005-06-01
Publisher Place	U.S.A.
Access Restriction	One Nation One Subscription (ONOS)
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Linear discriminant analysis Scattering Matrix decomposition Singular value decomposition Principal component analysis Text categorization Feature extraction Scalability Training data Face recognition classification. dimension reduction QR decomposition
Content Type	Text
Resource Type	Article
Subject	Applied Mathematics Artificial Intelligence Computational Theory and Mathematics Computer Vision and Pattern Recognition Software

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Generalizing discriminant analysis using the generalized singular value decomposition

Feature Reduction via Generalized Uncorrelated Linear Discriminant Analysis

Asymmetric Principal Component and Discriminant Analyses for Pattern Classification

An optimization criterion for generalized discriminant analysis on undersampled problems

IDR/QR: an incremental dimension reduction algorithm via QR decomposition

Eigenfeature Regularization and Extraction in Face Recognition

Kernel Uncorrelated and Regularized Discriminant Analysis: A Theoretical and Computational Study

Deterministic Column-Based Matrix Decomposition

KPCA plus LDA: a complete kernel Fisher discriminant framework for feature extraction and recognition

A two-stage linear discriminant analysis via QR-decomposition

Similar Documents

Generalizing discriminant analysis using the generalized singular value decomposition

Feature Reduction via Generalized Uncorrelated Linear Discriminant Analysis

Asymmetric Principal Component and Discriminant Analyses for Pattern Classification

An optimization criterion for generalized discriminant analysis on undersampled problems

IDR/QR: an incremental dimension reduction algorithm via QR decomposition

Eigenfeature Regularization and Extraction in Face Recognition

Kernel Uncorrelated and Regularized Discriminant Analysis: A Theoretical and Computational Study

Deterministic Column-Based Matrix Decomposition

KPCA plus LDA: a complete kernel Fisher discriminant framework for feature extraction and recognition

A two-stage linear discriminant analysis via QR-decomposition