NDLI: On the reliability of diversity and redundancy-based search metrics

Content Provider	IEEE Xplore Digital Library
Author	Tangsomboon, Ake Leelanupab, Teerapong
Copyright Year	2015
Description	Author affiliation: Faculty of Information Technology, King Mongkuts Institute of Technology Ladkrabang (KMITL), Bangkok, Thailand. 10520 (Tangsomboon, Ake; Leelanupab, Teerapong)
Abstract	Traditional approaches to ranking documents in Information Retrieval (IR) are under the assumption that the representation of information needs is clear and well-defined. This representation, which is usually in the form of a search query, is arguably considered ambiguous or underspecified. To deal with this uncertainty, much recent research has focused on creating IR systems that diversify search results so as to satisfy the multiple possible information needs underlying the query. To validate these IR systems, many new evaluation metrics have been proposed to quantify their effectiveness in terms of diversity and redundancy. Among these, a new diversity-based metric, called normalized Coverage Frequency (nCF), has lately been proposed to quantify diversity in a ranking. When a new metric is proposed, its reliability needs to be validated. This paper conducts an empirical experiment to compares and contrast state-of-the-art diversity and redundancy-based metrics, in term of discriminative power and stability of system rankings. Our experiment shows that the nCF is rated the best among all the studied metrics. Moreover, this finding is confirmed by when nCF is interpolated with other redundancy-based metrics (i.e., ERR-SA and A-nDCG). the nCF is considered more relatively robust than another diversity metric, subtopic-recall.
Starting Page	615
Ending Page	620
File Size	231656
Page Count	6
File Format	PDF
e-ISBN	9781467378635
DOI	10.1109/ICITEED.2015.7409020
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2015-10-29
Publisher Place	Thailand
Access Restriction	Subscribed
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Measurement Electrical engineering Redundancy Diversity reception Stability analysis Information technology
Content Type	Text
Resource Type	Article

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Evaluating Diversity and Redundancy-Based Search Metrics Independently

On the reliability and intuitiveness of aggregated search metrics

On efficient link error prediction based on convex metrics

Performance analysis of DSTTD based on diversity-multiplexing trade-off

Analysis and Ranking of Software Engineering metrics

RAID the WSN: Packet-based reliable cooperative diversity

Angular Diversity Reception at 2290 MC Over a 188-Mile Path

A scatter search based approach for the quadratic assignment problem

Reliability Through Redundancy

On the reliability of diversity and redundancy-based search metrics

Similar Documents

Evaluating Diversity and Redundancy-Based Search Metrics Independently

On the reliability and intuitiveness of aggregated search metrics

On efficient link error prediction based on convex metrics

Performance analysis of DSTTD based on diversity-multiplexing trade-off

Analysis and Ranking of Software Engineering metrics

RAID the WSN: Packet-based reliable cooperative diversity

Angular Diversity Reception at 2290 MC Over a 188-Mile Path

A scatter search based approach for the quadratic assignment problem

Reliability Through Redundancy

On the reliability of diversity and redundancy-based search metrics