NDLI: Dynamic and fast processing of queries on large-scale RDF data

Content Provider	Springer Nature Link
Author	Yuan, Pingpeng Xie, Changfeng Jin, Hai Liu, Ling Yang, Guang Shi, Xuanhua
Copyright Year	2014
Abstract	As RDF data continue to gain popularity, we witness the fast growing trend of RDF datasets in both the number of RDF repositories and the size of RDF datasets. Many known RDF datasets contain billions of RDF triples (subject, predicate and object). One of the grant challenges for managing these huge RDF data is how to execute RDF queries efficiently. In this paper, we address the query processing problems against the billion triple challenges. We first identify some causes for the problems of existing query optimization schemes, such as large intermediate results, initial query cost estimation errors. Then, we present our block-oriented dynamic query plan generation approach powered with pipelining execution. Our approach consists of two phases. In the first phase, a near-optimal execution plan for queries is chosen by identifying the processing blocks of queries. We group the join patterns sharing a join variable into building blocks of the query plan since executing them first provides opportunities to reduce the size of intermediate results generated. In the second phase, we further optimize the initial pipelining for a given query plan. We employ optimization techniques, such as sideways information passing and semi-join, to further reduce the size of intermediate results, improve the query processing cost estimation and speed up the performance of query execution. Experimental results on several RDF datasets of over a billion triples demonstrate that our approach outperforms existing RDF query engines that rely on dynamic programming based static query processing strategies.
Starting Page	311
Ending Page	334
Page Count	24
File Format	PDF
ISSN	02191377
Journal	Knowledge and Information Systems
Volume Number	41
Issue Number	2
e-ISSN	02193116
Language	English
Publisher	Springer London
Publisher Date	2014-01-19
Publisher Place	London
Access Restriction	One Nation One Subscription (ONOS)
Subject Keyword	Query processing Plan generation Query plan graph Operator Information Systems and Communication Service Business Information Systems
Content Type	Text
Resource Type	Article
Subject	Artificial Intelligence Information Systems Human-Computer Interaction Hardware and Architecture Software

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

A graph-theoretic approach to optimize keyword queries in relational databases

Handling failing RDF queries: from diagnosis to relaxation

Exploiting maximal redundancy to optimize SQL queries

Query indexing with containment-encoded intervals for efficient stream processing

Query processing issues in region-based image databases

Answering linear optimization queries with an approximate stream index

A survey of queries over uncertain data

SPARQL graph pattern rewriting for OWL-DL inference queries

Constrained recommendations for query visualizations

Dynamic and fast processing of queries on large-scale RDF data

Similar Documents

A graph-theoretic approach to optimize keyword queries in relational databases

Handling failing RDF queries: from diagnosis to relaxation

Exploiting maximal redundancy to optimize SQL queries

Query indexing with containment-encoded intervals for efficient stream processing

Query processing issues in region-based image databases

Answering linear optimization queries with an approximate stream index

A survey of queries over uncertain data

SPARQL graph pattern rewriting for OWL-DL inference queries

Constrained recommendations for query visualizations

Dynamic and fast processing of queries on large-scale RDF data