NDLI: Reordering an index to speed query processing without loss of effectiveness

Please wait, while we are loading the content...

Effects of spam removal on search engine efficiency and effectiveness

Efficient indexing algorithms for approximate pattern matching in text

Reordering an index to speed query processing without loss of effectiveness

Comparing scanning behaviour in web search on small and large screens

Explaining difficulty navigating a website using page view data

Relationship between the nature of the search task types and query reformulation behaviour

Models and metrics: IR evaluation as a user process

Sentence length bias in TREC novelty track judgements

Multi-aspect group formation using facility location analysis

An ontology derived from heterogeneous sustainability indicator set documents

Graph-based concept weighting for medical information retrieval

A study in language identification

An attempt to measure the quality of questions in question time of the Australian Federal Parliament

An English-translated parallel corpus for the CJK Wikipedia collections

Exploiting medical hierarchies for concept-based information retrieval

Finding additional semantic entity information for search engines

Is the unigram relevance model term independent?: classifying term dependencies in query expansion

Pairwise similarity of TopSig document signatures

Putting the public into public health information dissemination: social media and health-related web pages

Reordering an index to speed query processing without loss of effectiveness

Content Provider	ACM Digital Library
Author	Hawking, David Jones, Timothy
Abstract	Following Long and Suel, we empirically investigate the importance of document order in search engines which rank documents using a combination of dynamic (query-dependent) and static (query-independent) scores, and use document-at-a-time (DAAT) processing. When inverted file postings are in collection order, assigning document numbers in order of descending static score supports lossless early termination while maintaining good compression. Since static scores may not be available until all documents have been gathered and indexed, we build a tool for reordering an existing index and show that it operates in less than 20% of the original indexing time. We note that this additional cost is easily recouped by savings at query processing time. We compare best early-termination points for several different index orders on three enterprise search collections (a whole-of-government index with two very different query sets, and a collection from a UK university). We also present results for the same orders for ClueWeb09-CatB. Our evaluation focuses on finding results likely to be clicked on by users of Web or website search engines --- Nav and Key results in the TREC 2011 Web Track judging scheme. The orderings tested are Original, Reverse, Random, and QIE (descending order of static score). For three enterprise search test sets we find that QIE order can achieve close-to-maximal search effectiveness with much lower computational cost than for other orderings. Additionally, reordering has negligible impact on compressed index size for indexes that contain position information. Our results for an artificial query set against the TREC ClueWeb09 Category B collection are much more equivocal and we canvass possible explanations for future investigation.
Starting Page	17
Ending Page	24
Page Count	8
File Format	PDF
ISBN	9781450314114
DOI	10.1145/2407085.2407088
Language	English
Publisher	Association for Computing Machinery (ACM)
Publisher Date	2012-12-05
Publisher Place	New York
Access Restriction	Subscribed
Subject Keyword	Inverted files Efficiency and effectiveness Enterprise search Information retrieval
Content Type	Text
Resource Type	Article

Central Library (ISO-9001:2015 Certified)
Indian Institute of Technology Kharagpur
Kharagpur, West Bengal, India | PIN - 721302

See location in the Map
03222 282435
Mail: support@ndl.gov.in

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in