NDLI: Likelihood-Ratio-Based Verification in High-Dimensional Spaces

Content Provider	IEEE Xplore Digital Library
Author	Hendrikse, A. Veldhuis, R. Spreeuwers, L.
Copyright Year	1979
Abstract	The increase of the dimensionality of data sets often leads to problems during estimation, which are denoted as the curse of dimensionality. One of the problems of second-order statistics (SOS) estimation in high-dimensional data is that the resulting covariance matrices are not full rank, so their inversion, for example, needed in verification systems based on the likelihood ratio, is an ill-posed problem, known as the singularity problem. A classical solution to this problem is the projection of the data onto a lower dimensional subspace using principle component analysis (PCA) and it is assumed that any further estimation on this dimension-reduced data is free from the effects of the high dimensionality. Using theory on SOS estimation in high-dimensional spaces, we show that the solution with PCA is far from optimal in verification systems if the high dimensionality is the sole source of error. For moderate dimensionality, it is already outperformed by solutions based on euclidean distances and it breaks down completely if the dimensionality becomes very high. We propose a new method, the fixed-point eigenwise correction, which does not have these disadvantages and performs close to optimal.
Sponsorship	IEEE Computer Society
Page Count	13
File Size	925320
Starting Page	127
Ending Page	139
File Format	PDF
ISSN	01628828
Volume Number	36
Issue Number	1
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2014-01-01
Publisher Place	U.S.A.
Access Restriction	One Nation One Subscription (ONOS)
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Eigenvalues and eigenfunctions Covariance matrices Principal component analysis Estimation Training Euclidean distance Training data fixed-point eigenvalue correction High-dimensional verification eigenvalue bias correction variance correction euclidean distance principle component analysis MarÄ'enko Pastur equation eigenwise correction
Content Type	Text
Resource Type	Article
Subject	Applied Mathematics Artificial Intelligence Computational Theory and Mathematics Computer Vision and Pattern Recognition Software

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Maximum Likelihood Estimation of GEVD: Applications in Bioinformatics

Stacked Extreme Learning Machines

Inferring the eigenvalues of covariance matrices from limited, noisy data

Principal Component Analysis With Complex Kernel: The Widely Linear Model

High Dimensional Semiparametric Scale-Invariant Principal Component Analysis

On the eigenvalues of Euclidean distance matrices

Joint Matrices Decompositions and Blind Source Separation: A survey of methods, identification, and applications

Face recognition using IPCA-ICA algorithm

A comparison of approximations for perturbation study of covariance matrices with application to principal component analysis

Likelihood-Ratio-Based Verification in High-Dimensional Spaces

Similar Documents

Maximum Likelihood Estimation of GEVD: Applications in Bioinformatics

Stacked Extreme Learning Machines

Inferring the eigenvalues of covariance matrices from limited, noisy data

Principal Component Analysis With Complex Kernel: The Widely Linear Model

High Dimensional Semiparametric Scale-Invariant Principal Component Analysis

On the eigenvalues of Euclidean distance matrices

Joint Matrices Decompositions and Blind Source Separation: A survey of methods, identification, and applications

Face recognition using IPCA-ICA algorithm

A comparison of approximations for perturbation study of covariance matrices with application to principal component analysis

Likelihood-Ratio-Based Verification in High-Dimensional Spaces