NDLI: Highly discriminative statistical features for email classification

Content Provider	Springer Nature Link
Author	Gomez, Juan Carlos Boiy, Erik Moens, Marie Francine
Copyright Year	2011
Abstract	This paper reports on email classification and filtering, more specifically on spam versus ham and phishing versus spam classification, based on content features. We test the validity of several novel statistical feature extraction methods. The methods rely on dimensionality reduction in order to retain the most informative and discriminative features. We successfully test our methods under two schemas. The first one is a classic classification scenario using a 10-fold cross-validation technique for several corpora, including four ground truth standard corpora: Ling-Spam, SpamAssassin, PU1, and a subset of the TREC 2007 spam corpus, and one proprietary corpus. In the second schema, we test the anticipatory properties of our extracted features and classification models with two proprietary datasets, formed by phishing and spam emails sorted by date, and with the public TREC 2007 spam corpus. The contributions of our work are an exhaustive comparison of several feature selection and extraction methods in the frame of email classification on different benchmarking corpora, and the evidence that especially the technique of biased discriminant analysis offers better discriminative features for the classification, gives stable classification results notwithstanding the amount of features chosen, and robustly retains their discriminative value over time and data setups. These findings are especially useful in a commercial setting, where short profile rules are built based on a limited number of features for filtering emails.
Starting Page	23
Ending Page	53
Page Count	31
File Format	PDF
ISSN	02191377
Journal	Knowledge and Information Systems
Volume Number	31
Issue Number	1
e-ISSN	02193116
Language	English
Publisher	Springer-Verlag
Publisher Date	2011-05-18
Publisher Place	London
Access Restriction	One Nation One Subscription (ONOS)
Subject Keyword	Data mining Dimensionality reduction Email classification Feature extraction Feature selection Business Information Systems Information Systems and Communication Service
Content Type	Text
Resource Type	Article
Subject	Artificial Intelligence Information Systems Human-Computer Interaction Hardware and Architecture Software

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Locality preserving multimodal discriminative learning for supervised feature selection

Email mining: tasks, common techniques, and tools

Classifier-based acronym extraction for business documents

Stability of feature selection algorithms: a study on high-dimensional spaces

An efficient orientation distance–based discriminative feature extraction method for multi-classification

Higher order feature selection for text classification

Extraction of independent discriminant features for data with asymmetric distribution

Pairwise ranking component analysis

On ontology-driven document clustering using core semantic features

Highly discriminative statistical features for email classification

Similar Documents

Locality preserving multimodal discriminative learning for supervised feature selection

Email mining: tasks, common techniques, and tools

Classifier-based acronym extraction for business documents

Stability of feature selection algorithms: a study on high-dimensional spaces

An efficient orientation distance–based discriminative feature extraction method for multi-classification

Higher order feature selection for text classification

Extraction of independent discriminant features for data with asymmetric distribution

Pairwise ranking component analysis

On ontology-driven document clustering using core semantic features

Highly discriminative statistical features for email classification