NDLI: The use of balance-aware subsampling for bioinformatics datasets

Content Provider	IEEE Xplore Digital Library
Author	Wald, R. Khoshgoftaar, T.M. Fazelpour, A.
Copyright Year	2013
Description	Author affiliation: Florida Atlantic Univ., Boca Raton, FL, USA (Wald, R.; Khoshgoftaar, T.M.; Fazelpour, A.)
Abstract	A major challenge facing data-mining practitioners in the field of bioinformatics is class imbalance, which occurs when instances of one class (called the majority class) vastly outnumber instances of the other (minority) classes. This can result in models with increased bias towards the majority class (minority-class instances predicted as being in the majority class). Data sampling, a process which changes the dataset through removing or adding instances to improve the class balance, can be used to improve the performance of such models on imbalanced data. However, it is not clear what target balance level should be used with data sampling, and what influence class imbalance alone has on classification performance (compared to other issues such as difficulty of learning from the data and dataset size). To resolve this, we propose the Balance-Aware Subsampling technique, which allows researchers to directly compare different balance levels of a dataset while keeping all other factors (such as dataset size and the actual dataset in question) constant. Thus, any changes in performance can be attributed solely to the chosen balance level. We demonstrate this technique using six datasets from the field of bioinformatics, and we also consider three different subsample sizes (that is, the size of the dataset used for building a model) so we can observe the effect of this parameter on classification performance. Our results show that within each level of class imbalance, the average AUC value increases as the subsample size increases. The key exception is the 20:80 (minority:majority) balance level, for which the average AUC value decreases as the subsample size increases from 80 to 120. We also find that within each subsample size, the average AUC value increases as the minority distribution increases, although this does not completely hold for subsample size 40 (in which case, the Näıve Bayes and Random Forest learners show greater performance at the 35:65 balance level than at 50:50), and in general there is not a significant improvement between the 35:65 and 50:50 balance levels. Overall, by using Balance-Aware Subsampling, we are able to directly observe how class imbalance affects performance isolated from all other factors.
Starting Page	325
Ending Page	332
File Size	134157
Page Count	8
File Format	PDF
ISBN	9781479910502
DOI	10.1109/IRI.2013.6642489
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2013-08-14
Publisher Place	USA
Access Restriction	Subscribed
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Data models Training Bioinformatics Support vector machines Biological system modeling Accuracy Niobium Balance-Aware Subsampling Class imbalance sample size
Content Type	Text
Resource Type	Article

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Hidden dependencies between class imbalance and difficulty of learning for bioinformatics datasets

The Class-Imbalance Problem for High-Dimensional Class Prediction

Evaluation of imbalanced datasets using fuzzy support vector machine-class imbalance learning (FSVM-CIL)

An Effective Data Mining Technique for the Multi-Class Protein Sequence Classification

A new fuzzy support vector machines for class imbalance learning

Observing the Effect of the Choice of Classifier on Bioinformatics Data with Varying Levels of Data Quality and Class Balance

Random Forest with 200 Selected Features: An Optimal Model for Bioinformatics Research

Software reliability modeling based on SVM and virtual sample

Study on Cost Prediction Modeling with SVM Based on Sample-Weighted

The use of balance-aware subsampling for bioinformatics datasets

Similar Documents

Hidden dependencies between class imbalance and difficulty of learning for bioinformatics datasets

The Class-Imbalance Problem for High-Dimensional Class Prediction

Evaluation of imbalanced datasets using fuzzy support vector machine-class imbalance learning (FSVM-CIL)

An Effective Data Mining Technique for the Multi-Class Protein Sequence Classification

A new fuzzy support vector machines for class imbalance learning

Observing the Effect of the Choice of Classifier on Bioinformatics Data with Varying Levels of Data Quality and Class Balance

Random Forest with 200 Selected Features: An Optimal Model for Bioinformatics Research

Software reliability modeling based on SVM and virtual sample

Study on Cost Prediction Modeling with SVM Based on Sample-Weighted

The use of balance-aware subsampling for bioinformatics datasets