NDLI: Class separation through variance: a new application of outlier detection

Content Provider	Springer Nature Link
Author	Foss, Andrew Zaïane, Osmar R.
Copyright Year	2010
Abstract	This paper introduces a new outlier detection approach and discusses and extends a new concept, class separation through variance. We show that even for balanced and concentric classes differing only in variance, accumulating information about the outlierness of points in multiple subspaces leads to a ranking in which the classes naturally tend to separate. Exploiting this leads to a highly effective and efficient unsupervised class separation approach. Unlike typical outlier detection algorithms, this method can be applied beyond the ‘rare classes’ case with great success. The new algorithm FASTOUT introduces a number of novel features. It employs sampling of subspaces points and is highly efficient. It handles arbitrarily sized subspaces and converges to an optimal subspace size through the use of an objective function. In addition, two approaches are presented for automatically deriving the class of the data points from the ranking. Experiments show that FASTOUT typically outperforms other state-of-the-art outlier detection methods on high-dimensional data such as Feature Bagging, SOE1, LOF, ORCA and Robust Mahalanobis Distance, and competes even with the leading supervised classification methods for separating classes.
Starting Page	565
Ending Page	596
Page Count	32
File Format	PDF
ISSN	02191377
Journal	Knowledge and Information Systems
Volume Number	29
Issue Number	3
e-ISSN	02193116
Language	English
Publisher	Springer-Verlag
Publisher Date	2010-11-10
Publisher Place	London
Access Restriction	One Nation One Subscription (ONOS)
Subject Keyword	Outlier detection Classification Subspaces Concentration of measure Curse and blessing of dimensionality Business Information Systems Information Systems and Communication Service
Content Type	Text
Resource Type	Article
Subject	Artificial Intelligence Information Systems Human-Computer Interaction Hardware and Architecture Software

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

SVDD-based outlier detection on uncertain data

In-network outlier detection in wireless sensor networks

COID: A cluster–outlier iterative detection approach to multi-dimensional data analysis

Hubness-aware shared neighbor distances for high-dimensional $$k$$ -nearest neighbor classification

Capabilities of outlier detection schemes in large datasets, framework and methodologies

Automatic outlier detection for time series: an application to sensor data

Statistical outlier detection using direct density ratio estimation

Density-preserving projections for large-scale local anomaly detection

Detecting outlying subspaces for high-dimensional data: the new task, algorithms, and performance

Class separation through variance: a new application of outlier detection

Similar Documents

SVDD-based outlier detection on uncertain data

In-network outlier detection in wireless sensor networks

COID: A cluster–outlier iterative detection approach to multi-dimensional data analysis

Hubness-aware shared neighbor distances for high-dimensional $$k$$ -nearest neighbor classification

Capabilities of outlier detection schemes in large datasets, framework and methodologies

Automatic outlier detection for time series: an application to sensor data

Statistical outlier detection using direct density ratio estimation

Density-preserving projections for large-scale local anomaly detection

Detecting outlying subspaces for high-dimensional data: the new task, algorithms, and performance

Class separation through variance: a new application of outlier detection