NDLI: Increasing Buffer-Locality for Multiple Relational Table Scans through Grouping and Throttling

Content Provider	IEEE Xplore Digital Library
Author	Lang, C.A. Bhattacharjee, B. Malkemus, T. Padmanabhan, S. Kwai Wong
Copyright Year	2007
Description	Author affiliation: IBM T.J. Watson Res. Center, Yorktown Heights, NY (Lang, C.A.; Bhattacharjee, B.; Malkemus, T.)
Abstract	Decision support (DSS) workloads generally contain multiple large concurrent scan operations. These are often executed as relational table scans which can take up a lot of I/O bandwidth. This is especially true for ad-hoc queries where the workload is not known in advance. Common database management systems have only limited ability to reuse memory buffer content across multiple running queries due to their treatment of queries in isolation. Previous attempts to coordinate scans for better buffer reuse were less than satisfactory due to drifting between scans and the required radical DBMS architecture changes. In this paper, we describe a new mechanism to keep similar table scans closer together during scanning. This is achieved via dynamic grouping and regrouping of scans based on their runtime behavior and via adaptive throttling of scan speeds based on scan group characteristics. The required memory footprint is very small and the effort required to extend existing database management systems is minimal, as shown in our DB2 UDB prototype. Our experiments show significant gains in end-to-end response times as well as average response times for TPC-H workloads.
Starting Page	1136
Ending Page	1145
File Size	7329227
Page Count	10
File Format	PDF
ISBN	1424408024
DOI	10.1109/ICDE.2007.368972
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2006-04-15
Publisher Place	Turkey
Access Restriction	Subscribed
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Decision support systems Memory management Database systems Prototypes Runtime Delay Buffer storage Silicon Bandwidth Technology management
Content Type	Text
Resource Type	Article

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Goal-oriented dynamic buffer pool management for data base systems

Increasing Buffer-Locality for Multiple Index Based Scans through Intelligent Placement and Index Scan Speed Control

Hierarchical storage management for relational databases

Buffer replacement algorithms for multimedia storage systems

MultiMap: Preserving disk locality for multidimensional datasets

A parallel extension for existing relational database management systems

Selective runtime monitoring: Non-intrusive elimination of high-frequency functions

FlashCoop: A Locality-Aware Cooperative Buffer Management for SSD-Based Storage Cluster

Quantifying locality effect in data access delay: memory logP

Increasing Buffer-Locality for Multiple Relational Table Scans through Grouping and Throttling

Similar Documents

Goal-oriented dynamic buffer pool management for data base systems

Increasing Buffer-Locality for Multiple Index Based Scans through Intelligent Placement and Index Scan Speed Control

Hierarchical storage management for relational databases

Buffer replacement algorithms for multimedia storage systems

MultiMap: Preserving disk locality for multidimensional datasets

A parallel extension for existing relational database management systems

Selective runtime monitoring: Non-intrusive elimination of high-frequency functions

FlashCoop: A Locality-Aware Cooperative Buffer Management for SSD-Based Storage Cluster

Quantifying locality effect in data access delay: memory logP

Increasing Buffer-Locality for Multiple Relational Table Scans through Grouping and Throttling