NDLI: Scaling up the performance of more powerful Datalog systems on multicore machines

Content Provider	Springer Nature Link
Author	Yang, Mohan Shkapsky, Alexander Zaniolo, Carlo
Copyright Year	2016
Abstract	Extending RDBMS technology to achieve performance and scalability for queries that are much more powerful than those of SQL-2 has been the goal of deductive database research for more than thirty years. The $$\mathcal {D}e\mathcal {A}\mathcal {L}\mathcal {S}$$ system has made major progress toward this goal, by (1) Datalog extensions that support the more powerful recursive queries needed in advanced applications, and (2) superior performance for both traditional recursive queries and those made possible by the new extensions, while (3) delivering competitive performance with commercial RDBMSs on non-recursive queries. In this paper, we focus on the techniques used to support the in-memory evaluation of Datalog programs on multicore machines. In $$\mathcal {D}e\mathcal {A}\mathcal {L}\mathcal {S}$$ , a Datalog program is represented as an AND/OR tree, and multiple copies of the same AND/OR tree are used to access the tables in the database concurrently during the parallel evaluation. We describe compilation techniques that (1) recognize when the given program is lock-free, (2) transform a locking program into a lock-free program, and (3) find an efficient parallel plan that correctly evaluates the program while minimizing the use of locks and other overhead required for parallel evaluation. Extensive experiments demonstrate the effectiveness of the proposed techniques.
Starting Page	229
Ending Page	248
Page Count	20
File Format	PDF
ISSN	10668888
Journal	The VLDB Journal
Volume Number	26
Issue Number	2
e-ISSN	0949877X
Language	English
Publisher	Springer Berlin Heidelberg
Publisher Date	2016-12-01
Publisher Place	Berlin, Heidelberg
Access Restriction	One Nation One Subscription (ONOS)
Subject Keyword	Parallel Bottom-up evaluation Datalog Multicore AND/OR tree Database Management
Content Type	Text
Resource Type	Article
Subject	Information Systems Hardware and Architecture

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Performance Analysis of Alternative Database Machine Architectures

Parallel construction of wavelet trees on multicore architectures

Demystifying multicore throughput metrics

SkyAlign: a portable, work-efficient skyline algorithm for multicore and GPU architectures

Scalability of write-ahead logging on multicore and multisocket hardware

The Case for Partitioning Virtual Machines on Multicore Architectures

The Architecture of SM3: A Dynamically Partitionable Multicomputer System

Extending the power of datalog recursion

Efficient evaluation of generalized tree-pattern queries on XML streams

Scaling up the performance of more powerful Datalog systems on multicore machines

Similar Documents

Performance Analysis of Alternative Database Machine Architectures

Parallel construction of wavelet trees on multicore architectures

Demystifying multicore throughput metrics

SkyAlign: a portable, work-efficient skyline algorithm for multicore and GPU architectures

Scalability of write-ahead logging on multicore and multisocket hardware

The Case for Partitioning Virtual Machines on Multicore Architectures

The Architecture of SM3: A Dynamically Partitionable Multicomputer System

Extending the power of datalog recursion

Efficient evaluation of generalized tree-pattern queries on XML streams

Scaling up the performance of more powerful Datalog systems on multicore machines