NDLI: Automatic evaluation of world wide web search services

Please wait, while we are loading the content...

Impact transformation: effective and efficient web retrieval

Term-specific smoothing for the language modeling approach to information retrieval: the importance of a query term

Finding relevant documents using top ranking sentences: an evaluation of two alternative schemes

Novelty and redundancy detection in adaptive filtering

The use of unlabeled data to improve supervised learning for text summarization

Unsupervised document classification using sequential information maximization

Comparing cross-language query expansion techniques by degrading translation resources

Document clustering with cluster refinement and model selection capabilities

Efficient phrase querying with an auxiliary index

Collaborative filtering with privacy via factor analysis

Term selection for searching printed Arabic

Automatic query wefinement using lexical affinities with maximal information gain

The effect of topic set size on retrieval experiment error

Robust temporal and spectral modeling for query By melody

Using self-supervised word segmentation in Chinese information retrieval

A system using implicit feedback and top ranking sentences to help users find relevant web documents

Landmarks in information retrieval: the message out of the bottle

Analysis of lexical signatures for finding lost or related documents

Title language model for information retrieval

Predicting category accesses for a user in a structured information space

Improving realism of topic tracking evaluation

Generic summarization and keyphrase extraction using mutual reinforcement principle and sentence clustering

Topic difference factor extraction between two document sets and its application to text categorization

Statistical cross-language information retrieval using n-best query translations

Document clustering with committees

Compression of inverted indexes For fast query evaluation

Inverted file search algorithms for collaborative filtering

Empirical studies in strategies for Arabic retrieval

Web question answering: is more always better?

Liberal relevance criteria of TREC -: counting on negligible documents?

Video retrieval using an MPEG-7 based inference network

Automatic classification in product catalogs

Indexing, searching, and retrieving of recorded live presentations with the AOF (authoring on the fly) search engine

Is natural language an inconvenience or an opportunity for IR?

Using sampled data and regression to merge search engine results

Two-stage language models for information retrieval

Detecting and Browsing Events in Unstructured text

Bayesian online classifiers for text classification and filtering

Cross-document summarization by concept classification

Text genre classification with genre-revealing and subject-revealing features

Cross-lingual relevance models

Probabilistic combination of text classifiers using reliability indicators: models and results

Set-based model: a new approach for information retrieval

Methods and metrics for cold-start recommendations

Improving stemming for Arabic information retrieval: light stemming and co-occurrence analysis

Predicting query performance

PageRank, HITS and a unified framework for link analysis

UTACLIR -: general query translation framework for several language pairs

The Importance of Prior Probabilities for Entry Page Search

A new family of online algorithms for category ranking

Resolving query translation ambiguity using a decaying co-occurrence model and syntactic dependence relations

Using part-of-speech patterns to reduce query ambiguity

Task orientation in question answering

HyREX: hyper-media retrieval engine for XML

Experiments in high-dimensional text categorization

Query performance analyser -: a web-based tool for IR research and instruction

The relationship between ASK and relevance criteria

Adaptive information extraction for document annotation in amilcare

ICA and SOM in text document analysis

ExWrap: semi-automatic wrapper generation by example

Improving hierarchical text classification using unlabeled data

Souvenir: flexible note-taking tool to pinpoint and share media highlights

Do thumbnail previews help users make better relevance decisions about web search results?

Hierarchical approach to term suggestion device

Amilcare: adaptive information extraction for document annotation

Translingual vocabulary mappings for multilingual information access

The impact of corpus size on question answering performance

GS textplorer -: adaptive framework for information retrieval

Effective collection metasearch in a hierarchical environment: global vs. localized retrieval performance

CuTeX: a system for extracting data from text tables

Experimenting with graphical user interfaces for structured document retrieval

YellowPager: a tool for ontology-based mining of service directories from web sources

The web retrieval task and its evaluation in the third NTCIR workshop

How Many Bits are Needed to Store Term Frequencies?

Non-linear reading for a structured web indexation

Document normalization revisited

User-centered interface design for cross-language information retrieval

Implementation of relevance feedback for content-based music retrieval based on user prefences

Spatial information retrieval and geographical ontologies an overview of the SPIRIT project

A visualisation tool for topic tracking analysis and development

A new method of parameter estimation for multinomial naive bayes text classifiers

Study of category score algorithms for k-NN classifier

Higher precision for two-word queries

The boomerang effect: retrieving scientific documents via the network of references and citations

A logistic regression approach to distributed IR

Automatic metadata generation & evaluation

A critical examination of TDT's cost function

Converting on-line bilingual dictionaries from human-readable to machine-readable form

Modeling (in)variability of human judgments for text summarization

Content-based music indexing and organization

Relative and absolute term selection criteria: a comparative study for English and Japanese IR

Experiments on data fusion using headline information

Building thematic lexical resources by term categorization

Topic structure modeling

Language model for IR using collection information

Automatic evaluation of world wide web search services

Does WT10g look like the web?

Biterm language models for document retrieval

Selecting indexing strings using adaptation

Error correction in a Chinese OCR test collection

User interface effects in past batch versus user experiments

K-tree/forest: efficient indexes for boolean queries

Example-based phrase translation in Chinese-English CLIR

Probabilistic multimedia retrieval

Chinese keyword extraction based on max-duplicated strings of the documents

A hierarchical approach: query large music database by acoustic input

Correlating multilingual documents via bipartite graph modeling

Automatic evaluation of world wide web search services

Content Provider	ACM Digital Library
Author	Soboroff, Ian Chowdhury, Abdur
Abstract	Users of the World-Wide Web are not only confronted by an immense overabundance of information, but also by a plethora of tools for searching for the web pages that suit their information needs. Web search engines differ widely in interface, features, coverage of the web, ranking methods, delivery of advertising, and more. In this paper, we present a method for comparing search engines automatically based on how they rank known item search results. Because the engines perform their search on overlapping (but different) subsets of the web collected at different points in time, evaluation of search engines poses significant challenges to the traditional information retrieval methodology. Our method uses known item searching; comparing the relative ranks of the items in the search engines' rankings. Our approach automatically constructs known item queries using query log analysis and automatically constructs the result via analysis of editor comments from the ODP (Open Directory Project). Additionally, we present our comparison on five (Lycos, Netscape, Fast, Google, HotBot) well-known search services and find that some services perform known item searches better than others, but the majority are statistically equivalent.
Starting Page	421
Ending Page	422
Page Count	2
File Format	PDF
ISBN	1581135610
DOI	10.1145/564376.564474
Language	English
Publisher	Association for Computing Machinery (ACM)
Publisher Date	2002-08-11
Publisher Place	New York
Access Restriction	Subscribed
Subject Keyword	Automatic mean reciprocal ranking Ir evaluation
Content Type	Text
Resource Type	Article

Central Library (ISO-9001:2015 Certified)
Indian Institute of Technology Kharagpur
Kharagpur, West Bengal, India | PIN - 721302

See location in the Map
03222 282435
Mail: support@ndl.gov.in

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in