NDLI: Theoretical evaluation of XML retrieval

Please wait, while we are loading the content...

Theoretical evaluation of XML retrieval

Content Provider	ACM Digital Library
Author	Blanke, Tobias
Abstract	This thesis has developed a theoretical framework to evaluate XML retrieval. XML retrieval deals with retrieving those document parts that specifically answer a query. It is concerned with using the document structure to improve the retrieval of information from documents by only delivering those parts of a document an information need is about. We define a theoretical evaluation methodology based on the idea of 'aboutness' and apply it to XML retrieval models. Situation Theory is used to express the aboutness proprieties of XML retrieval models. We propose a Situation Theory framework to evaluate XML retrieval, which is based on the basic and most general information retrieval question how a document (or in our case an XML element) can be about a query. This framework allows us to compare and analyze the reasoning behaviour of XML retrieval models experimented within INEX evaluation campaigns. We develop a dedicated methodology for the evaluation of XML retrieval and apply this methodology to five XML retrieval models from INEX. For each model we derive functional and qualitative properties that qualify its formal behaviour. We compare this behaviour with the underlying flat document retrieval model as well as with a model we specially design to determine how much an XML retrieval model includes XML structure in its reasoning behaviour. More INEX specific, this thesis further investigates the use of our theoretical evaluation methodology to describe the INEX evaluation methodology. We exemplify theoretical models of user agents and assessment procedures in INEX and derive reasoning assumptions that are included in the specific XML retrieval experimental evaluation, its scales and the ways assessments are done. We point to potential inconsistencies and make suggestions for alternative views on the experimental evaluation dimensions for XML retrieval. Further INEX specifics are discussed when we theoretically analyse filters, as they are used in INEX to deliver only specific answers to an information need. We introduce our theoretical methodology to analyse filters as special aboutness decisions, before applying it to the XML retrieval filtering models. We finally use the theoretical properties of XML retrieval models and their filters to explain experimental results obtained with some of the XML retrieval models within INEX and draw upon all our previous results to demonstrate how theoretical evaluation insights can be used to explain results from mainstream experimental evaluations. We relate our theoretical evaluation results with the experimental ones for XML retrieval to find out how the adjustment of existing flat document retrieval models compares to the creation of completely new ones, especially designed to meet the requirements of XML retrieval. For each of the XML retrieval experimental evaluation tasks, we shall determine the reasoning properties that support a good performance and discuss on this basis the experimental performance of the XML retrieval models. An updated version of the thesis will appear with IOS-Press: Tobias Blanke, Using Situation Theory to evaluate XML Retrieval, IOS-Press: Amsterdam, 2012.
Starting Page	82
Ending Page	83
Page Count	2
File Format	PDF
ISSN	01635840
DOI	10.1145/2215676.2215689
Journal	ACM SIGIR Forum (SIGF)
Volume Number	46
Issue Number	1
Language	English
Publisher	Association for Computing Machinery (ACM)
Publisher Date	1978-08-01
Publisher Place	New York
Access Restriction	One Nation One Subscription (ONOS)
Content Type	Text
Resource Type	Article
Subject	Management Information Systems Hardware and Architecture

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Evaluating XML retrieval effectiveness at INEX

Using topic shifts in content-oriented XML retrieval

Restricted evaluation in information retrieval

Integrating document and data retrieval based on XML

Efficient evaluation of generalized tree-pattern queries on XML streams

Low-cost and robust evaluation of information retrieval systems

A New Theoretical Framework For Information Retrieval

A new theoretical framework for information retrieval

A survey on XML streaming evaluation techniques

Theoretical evaluation of XML retrieval

Similar Documents

Evaluating XML retrieval effectiveness at INEX

Using topic shifts in content-oriented XML retrieval

Restricted evaluation in information retrieval

Integrating document and data retrieval based on XML

Efficient evaluation of generalized tree-pattern queries on XML streams

Low-cost and robust evaluation of information retrieval systems

A New Theoretical Framework For Information Retrieval

A new theoretical framework for information retrieval

A survey on XML streaming evaluation techniques

Theoretical evaluation of XML retrieval