NDLI: Predicting Classifier Performance with Limited Training Data: Applications to Computer-Aided Diagnosis in Breast and Prostate Cancer

Content Provider	PubMed Central
Author	Ajay, Basavanhally Viswanath, Satish Madabhushi, Anant
Editor	Benjamin, Haibe-kains
Copyright Year	2015
Abstract	Clinical trials increasingly employ medical imaging data in conjunction with supervised classifiers, where the latter require large amounts of training data to accurately model the system. Yet, a classifier selected at the start of the trial based on smaller and more accessible datasets may yield inaccurate and unstable classification performance. In this paper, we aim to address two common concerns in classifier selection for clinical trials: (1) predicting expected classifier performance for large datasets based on error rates calculated from smaller datasets and (2) the selection of appropriate classifiers based on expected performance for larger datasets. We present a framework for comparative evaluation of classifiers using only limited amounts of training data by using random repeated sampling (RRS) in conjunction with a cross-validation sampling strategy. Extrapolated error rates are subsequently validated via comparison with leave-one-out cross-validation performed on a larger dataset. The ability to predict error rates as dataset size increases is demonstrated on both synthetic data as well as three different computational imaging tasks: detecting cancerous image regions in prostate histopathology, differentiating high and low grade cancer in breast histopathology, and detecting cancerous metavoxels in prostate magnetic resonance spectroscopy. For each task, the relationships between 3 distinct classifiers (k-nearest neighbor, naive Bayes, Support Vector Machine) are explored. Further quantitative evaluation in terms of interquartile range (IQR) suggests that our approach consistently yields error rates with lower variability (mean IQRs of 0.0070, 0.0127, and 0.0140) than a traditional RRS approach (mean IQRs of 0.0297, 0.0779, and 0.305) that does not employ cross-validation sampling for all three datasets.
Related Links	http://dx.doi.org/10.1371/journal.pone.0117900
Starting Page	117900
File Format	PDF
ISSN	19326203
e-ISSN	19326203
Journal	PLoS ONE
Issue Number	5
Volume Number	10
Language	English
Publisher	Public Library of Science
Publisher Date	2015-05-01
Access Restriction	Open
Rights Holder	Public Library of Science
Subject Keyword	Biochemistry, Genetics and Molecular Biology(all) Agricultural and Biological Sciences(all) Medicine(all) Research in Higher Education
Content Type	Text
Resource Type	Article
Subject	Multidisciplinary

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Data from: Predicting classifier performance with limited training data: applications to computer-aided diagnosis in breast and prostate cancer (Dataset)

An Integrative Proteomics and Interaction Network-Based Classifier for Prostate Cancer Diagnosis

Computer-Aided Diagnosis for Early-Stage Lung Cancer Based on Longitudinal and Balanced Data

RFMirTarget: Predicting Human MicroRNA Target Genes with a Random Forest Classifier

Predicting Outcomes of Prostate Cancer Immunotherapy by Personalized Mathematical Models

Evaluating the Clinical Impact of a Genomic Classifier in Prostate Cancer Using Individualized Decision Analysis

Integration of Clinical and Gene Expression Data Has a Synergetic Effect on Predicting Breast Cancer Outcome

Predicting mTOR Inhibitors with a Classifier Using Recursive Partitioning and Naïve Bayesian Approaches

Circulating MiR-125b as a Marker Predicting Chemoresistance in Breast Cancer

Predicting Classifier Performance with Limited Training Data: Applications to Computer-Aided Diagnosis in Breast and Prostate Cancer

Similar Documents

Data from: Predicting classifier performance with limited training data: applications to computer-aided diagnosis in breast and prostate cancer (Dataset)

An Integrative Proteomics and Interaction Network-Based Classifier for Prostate Cancer Diagnosis

Computer-Aided Diagnosis for Early-Stage Lung Cancer Based on Longitudinal and Balanced Data

RFMirTarget: Predicting Human MicroRNA Target Genes with a Random Forest Classifier

Predicting Outcomes of Prostate Cancer Immunotherapy by Personalized Mathematical Models

Evaluating the Clinical Impact of a Genomic Classifier in Prostate Cancer Using Individualized Decision Analysis

Integration of Clinical and Gene Expression Data Has a Synergetic Effect on Predicting Breast Cancer Outcome

Predicting mTOR Inhibitors with a Classifier Using Recursive Partitioning and Naïve Bayesian Approaches

Circulating MiR-125b as a Marker Predicting Chemoresistance in Breast Cancer

Predicting Classifier Performance with Limited Training Data: Applications to Computer-Aided Diagnosis in Breast and Prostate Cancer