NDLI: Mp-Dissimilarity: A Data Dependent Dissimilarity Measure

Content Provider	IEEE Xplore Digital Library
Author	Aryal, Sunil Ting, Kai Ming Haffari, Gholamreza Washio, Takashi
Copyright Year	2014
Abstract	Nearest neighbour search is a core process in many data mining algorithms. Finding reliable closest matches of a query in a high dimensional space is still a challenging task. This is because the effectiveness of many dissimilarity measures, that are based on a geometric model, such as lp-norm, decreases as the number of dimensions increases. In this paper, we examine how the data distribution can be exploited to measure dissimilarity between two instances and propose a new data dependent dissimilarity measure called 'mp-dissimilarity'. Rather than relying on geometric distance, it measures the dissimilarity between two instances in each dimension as a probability mass in a region that encloses the two instances. It deems the two instances in a sparse region to be more similar than two instances in a dense region, though these two pairs of instances have the same geometric distance. Our empirical results show that the proposed dissimilarity measure indeed provides a reliable nearest neighbour search in high dimensional spaces, particularly in sparse data. Mp-dissimilarity produced better task specific performance than lp-norm and cosine distance in classification and information retrieval tasks.
Starting Page	707
Ending Page	712
File Size	277882
Page Count	6
File Format	PDF
ISSN	15504786
e-ISBN	9781479943029
DOI	10.1109/ICDM.2014.33
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2014-12-14
Publisher Place	China
Access Restriction	Subscribed
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Accuracy Information retrieval Vectors Educational institutions Approximation methods Data mining Electronic mail mp-dissimilarity distance measure lp-norm
Content Type	Text
Resource Type	Article

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

mp-dissimilarity: A data dependent dissimilarity measure

Information retrieval using a novel concept similarity in formal concept analysis

Overcoming Key Weaknesses of Distance-based Neighbourhood Methods using a Data Dependent Dissimilarity Measure

Tagging Choreographic Data for Data Mining and Classification

Clustering Categorical Data Based on Representatives

Data Mining in Individuality Long-Distance Education System Applied Research

Diversity and separable metrics in over-sampling technique for imbalanced data classification

Selective information retrieval from hierarchical associative knowledge learning memory

Interrelationship mining from a viewpoint of rough sets on two universes

Mp-Dissimilarity: A Data Dependent Dissimilarity Measure

Similar Documents

mp-dissimilarity: A data dependent dissimilarity measure

Information retrieval using a novel concept similarity in formal concept analysis

Overcoming Key Weaknesses of Distance-based Neighbourhood Methods using a Data Dependent Dissimilarity Measure

Tagging Choreographic Data for Data Mining and Classification

Clustering Categorical Data Based on Representatives

Data Mining in Individuality Long-Distance Education System Applied Research

Diversity and separable metrics in over-sampling technique for imbalanced data classification

Selective information retrieval from hierarchical associative knowledge learning memory

Interrelationship mining from a viewpoint of rough sets on two universes

Mp-Dissimilarity: A Data Dependent Dissimilarity Measure