NDLI: Classifying High-Dimensional Text and Web Data Using Very Short Patterns

Content Provider	IEEE Xplore Digital Library
Author	Malik, H.H. Kender, J.R.
Copyright Year	2008
Description	Author affiliation: Dept. of Comput. Sci., Columbia Univ., New York, NY (Malik, H.H.; Kender, J.R.)
Abstract	In this paper, we propose the "democratic classifier", a simple pattern-based classification algorithm that uses very short patterns for classification, and does not rely on the minimum support threshold. Borrowing ideas from democracy, our training phase allows each training instance to vote for an equal number of candidate size-2 patterns. The training instances select patterns by effectively balancing between local, class, and global significance of patterns. The selected patterns are simultaneously added to the model for all applicable classes and a novel power law based weighing scheme adjusts their weights with respect of each class. Results of experiments performed on 121 common text and Web datasets show that our algorithm almost always outperforms state of the art classification algorithms, without any parameter tuning. On 100 real-life Web datasets, the average absolute classification accuracy improvement was as great as 9.4% over SVM, Harmony, C4.5 and KNN. Also, our algorithm ran about 3.5 times faster than the fastest existing pattern-based classification algorithm.
Starting Page	923
Ending Page	928
File Size	290228
Page Count	6
File Format	PDF
ISBN	9780769535029
ISSN	15504786
DOI	10.1109/ICDM.2008.139
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2008-12-15
Publisher Place	Italy
Access Restriction	Subscribed
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Classification algorithms Machine learning algorithms Frequency Qualifications Voting Nominations and elections Support vector machines Support vector machine classification Humans Data mining feature selection Classification interestingness measures text classification pattern-based classification
Content Type	Text
Resource Type	Article

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Support vector machines and the electoral college

Feature selection for linear support vector machines

Feature selection in proteomic pattern data with support vector machines

Active feature selection in optic nerve data using support vector machine

Optimized Representation for Classifying Qualitative Data

Financial Data Mining Based on Support Vector Machines and Ensemble Learning

The interestingness and robustness of knowledge in incremental data mining

A Feature Selection Algorithm Based on SVM Average Distance

A Two-Stage Hybrid Approach for Feature Selection in Microarray Analysis

Classifying High-Dimensional Text and Web Data Using Very Short Patterns

Similar Documents

Support vector machines and the electoral college

Feature selection for linear support vector machines

Feature selection in proteomic pattern data with support vector machines

Active feature selection in optic nerve data using support vector machine

Optimized Representation for Classifying Qualitative Data

Financial Data Mining Based on Support Vector Machines and Ensemble Learning

The interestingness and robustness of knowledge in incremental data mining

A Feature Selection Algorithm Based on SVM Average Distance

A Two-Stage Hybrid Approach for Feature Selection in Microarray Analysis

Classifying High-Dimensional Text and Web Data Using Very Short Patterns