NDLI: SMOTE for high-dimensional class-imbalanced data

Content Provider	Springer Nature : BioMed Central
Author	Blagus, Rok Lusa, Lara
Abstract	Background Classification using class-imbalanced data is biased in favor of the majority class. The bias is even larger for high-dimensional data, where the number of variables greatly exceeds the number of samples. The problem can be attenuated by undersampling or oversampling, which produce class-balanced data. Generally undersampling is helpful, while random oversampling is not. Synthetic Minority Oversampling TEchnique (SMOTE) is a very popular oversampling method that was proposed to improve random oversampling but its behavior on high-dimensional data has not been thoroughly investigated. In this paper we investigate the properties of SMOTE from a theoretical and empirical point of view, using simulated and real high-dimensional data. Results While in most cases SMOTE seems beneficial with low-dimensional data, it does not attenuate the bias towards the classification in the majority class for most classifiers when data are high-dimensional, and it is less effective than random undersampling. SMOTE is beneficial for k-NN classifiers for high-dimensional data if the number of variables is reduced performing some type of variable selection; we explain why, otherwise, the k-NN classification is biased towards the minority class. Furthermore, we show that on high-dimensional data SMOTE does not change the class-specific mean values while it decreases the data variability and it introduces correlation between samples. We explain how our findings impact the class-prediction for high-dimensional data. Conclusions In practice, in the high-dimensional setting only k-NN classifiers based on the Euclidean distance seem to benefit substantially from the use of SMOTE, provided that variable selection is performed before using SMOTE; the benefit is larger if more neighbors are used. SMOTE for k-NN without variable selection should not be used, because it strongly biases the classification towards the minority class.
Related Links	https://bmcbioinformatics.biomedcentral.com/counter/pdf/10.1186/1471-2105-14-106.pdf
Ending Page	16
Page Count	16
Starting Page	1
File Format	HTM / HTML
ISSN	14712105
DOI	10.1186/1471-2105-14-106
Journal	BMC Bioinformatics
Issue Number	1
Volume Number	14
Language	English
Publisher	BioMed Central
Publisher Date	2013-03-22
Access Restriction	Open
Subject Keyword	Bioinformatics Microarrays Computational Biology Computer Appl. in Life Sciences Algorithms Variable Selection Minority Class Smite Alternative Case Null Case Computational Biology/Bioinformatics
Content Type	Text
Resource Type	Article
Subject	Molecular Biology Biochemistry Computer Science Applications Applied Mathematics Structural Biology
Journal Impact Factor	2.9/2023
5-Year Journal Impact Factor	3.6/2023

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Class prediction for high-dimensional class-imbalanced data

Improved shrunken centroid classifiers for high-dimensional class-imbalanced data

Hellinger distance-based stable sparse feature selection for high-dimensional class-imbalanced data

Randomized boosting with multivariable base-learners for high-dimensional variable selection and prediction

Feature selection for high-dimensional temporal data

Controlling false discoveries in high-dimensional situations: boosting with stability selection

Identification of prognostic and predictive biomarkers in high-dimensional data with PPLasso

Identification of microRNA precursors based on random forest with network-level representation method of stem-loop structure

Grace-AKO: a novel and stable knockoff filter for variable selection incorporating gene network structures

SMOTE for high-dimensional class-imbalanced data

Similar Documents

Class prediction for high-dimensional class-imbalanced data

Improved shrunken centroid classifiers for high-dimensional class-imbalanced data

Hellinger distance-based stable sparse feature selection for high-dimensional class-imbalanced data

Randomized boosting with multivariable base-learners for high-dimensional variable selection and prediction

Feature selection for high-dimensional temporal data

Controlling false discoveries in high-dimensional situations: boosting with stability selection

Identification of prognostic and predictive biomarkers in high-dimensional data with PPLasso

Identification of microRNA precursors based on random forest with network-level representation method of stem-loop structure

Grace-AKO: a novel and stable knockoff filter for variable selection incorporating gene network structures

SMOTE for high-dimensional class-imbalanced data