NDLI: Scalable mining for classification rules in relational databases

Content Provider	IEEE Xplore Digital Library
Author	Min Wang Iyer, B. Vitter, J.S.
Copyright Year	1998
Description	Author affiliation: Dept. of Comput. Sci., Duke Univ., Durham, NC, USA (Min Wang)
Abstract	Classification is a key function of many business intelligence toolkits and a fundamental building block in data mining. Immense data may be needed to train a classifier for good accuracy. The state-of-art classifiers need an in-memory data structure of size O(N), where N is the size of the training data, to achieve efficiency. For large data sets, such a data structure will not fit in the internal memory. The best previously known classifier does a quadratic number of I/Os for large N. We propose a novel classification algorithm (classifier) called MIND (MINing in Databases). MIND can be phrased in such a way that its implementation is very easy using the extended relational calculus SQL, and this in turn allows the classifier to be built into a relational database system directly. MIND is truly scalable with respect to I/O efficiency, which is important since scalability is a key requirement for any data mining algorithm. We built a prototype of MIND in the relational database manager DB2 and benchmarked its performance. We describe the working prototype and report the measured performance with respect to the previous method of choice. MIND scales not only with the size of the datasets but also with the number of processors on an IBM SP2 computer system. Even on uniprocessors, MIND scales well beyond the dataset sizes previously published for classifiers. We also give some insights that may have an impact on the evolution of the extended relational calculus SQL.
Starting Page	58
Ending Page	67
File Size	276863
Page Count	10
File Format	PDF
ISBN	0818683074
ISSN	10988068
DOI	10.1109/IDEAS.1998.694358
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	1998-07-10
Publisher Place	UK
Access Restriction	Subscribed
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Relational databases Data mining Management training Computer science Data structures Training data Calculus Scalability Prototypes Remuneration
Content Type	Text
Resource Type	Article

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Rule mining and classification in imperfect databases

Scalable Mining for Classification Rules in Relational Databases (1998)

Scalable Mining for Classification Rules in Relational Databases

A scalable algorithm for mining maximal frequent sequences using sampling

Efficient mining for association rules with relational database systems

Mining Main Points of Knowledge in Relational Databases for Classification

Predator-Miner: ad hoc mining of associations rules within a database management system

Extended MRI-Cube Algorithm for Mining Multi-Relational Patterns

Confidence-Based Concept Discovery in Relational Databases

Scalable mining for classification rules in relational databases

Similar Documents

Rule mining and classification in imperfect databases

Scalable Mining for Classification Rules in Relational Databases (1998)

Scalable Mining for Classification Rules in Relational Databases

A scalable algorithm for mining maximal frequent sequences using sampling

Efficient mining for association rules with relational database systems

Mining Main Points of Knowledge in Relational Databases for Classification

Predator-Miner: ad hoc mining of associations rules within a database management system

Extended MRI-Cube Algorithm for Mining Multi-Relational Patterns

Confidence-Based Concept Discovery in Relational Databases

Scalable mining for classification rules in relational databases