NDLI: On Comparing Classifiers: Pitfalls to Avoid and a Recommended Approach

Content Provider	Springer Nature Link
Author	Salzberg, Steven L.
Copyright Year	1997
Abstract	An important component of many data mining projects is finding a good classification algorithm, a process that requires very careful thought about experimental design. If not done very carefully, comparative studies of classification and other types of algorithms can easily result in statistically invalid conclusions. This is especially true when one is using data mining techniques to analyze very large databases, which inevitably contain some statistically unlikely data. This paper describes several phenomena that can, if ignored, invalidate an experimental comparison. These phenomena and the conclusions that follow apply not only to classification, but to computational experiments in almost any aspect of data mining. The paper also discusses why comparative analysis is more important in evaluating some types of algorithms than for others, and provides some suggestions about how to avoid the pitfalls suffered by many experimental studies.
Starting Page	317
Ending Page	328
Page Count	12
File Format	PDF
ISSN	13845810
Journal	Data Mining and Knowledge Discovery
Volume Number	1
Issue Number	3
e-ISSN	1573756X
Language	English
Publisher	Kluwer Academic Publishers
Publisher Date	1997-01-01
Publisher Place	Boston
Access Restriction	One Nation One Subscription (ONOS)
Subject Keyword	Data Structures, Cryptology and Information Theory Information Storage and Retrieval Artificial Intelligence (incl. Robotics) Statistics Statistics for Engineering, Physics, Computer Science, Chemistry & Geosciences
Content Type	Text
Resource Type	Article
Subject	Computer Networks and Communications Information Systems Computer Science Applications

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Adaptive Fraud Detection

Building Association-Rule Based Sequential Classifiers for Web-Document Prediction

Bayesian Networks for Data Mining

E-Commerce Recommendation Applications

Tree Structures for Mining Association Rules

Data Squashing by Empirical Likelihood

Personalization of Supermarket Product Recommendations

Statistical Models for Data Mining

Mathematical Programming in Data Mining

On Comparing Classifiers: Pitfalls to Avoid and a Recommended Approach

Similar Documents

Adaptive Fraud Detection

Building Association-Rule Based Sequential Classifiers for Web-Document Prediction

Bayesian Networks for Data Mining

E-Commerce Recommendation Applications

Tree Structures for Mining Association Rules

Data Squashing by Empirical Likelihood

Personalization of Supermarket Product Recommendations

Statistical Models for Data Mining

Mathematical Programming in Data Mining

On Comparing Classifiers: Pitfalls to Avoid and a Recommended Approach