NDLI: Extending RDBMSs To Support Sparse Datasets Using An Interpreted Attribute Storage Format

Content Provider	IEEE Xplore Digital Library
Author	Beckmann, J.L. Halverson, A. Krishnamurthy, R. Naughton, J.F.
Copyright Year	2006
Description	Author affiliation: University of Wisconsin (Beckmann, J.L.)
Abstract	"Sparse" data, in which relations have many attributes that are null for most tuples, presents a challenge for relational database management systems. If one uses the normal "horizontal" schema to store such data sets in any of the three leading commercial RDBMS, the result is tables that occupy vast amounts of storage, most of which is devoted to nulls. If one attempts to avoid this storage blowup by using a "vertical" schema, the storage utilization is indeed better, but query performance is orders of magnitude slower for certain classes of queries. In this paper, we argue that the proper way to handle sparse data is not to use a vertical schema, but rather to extend the RDBMS tuple storage format to allow the representation of sparse attributes as interpreted fields. The addition of interpreted storage allows for efficient and transparent querying of sparse data, uniform access to all attributes, and schema scalability. We show, through an implementation in PostgreSQL, that the interpreted storage approach dominates in query efficiency and ease-of-use over the current horizontal storage and vertical schema approaches over a wide range of queries and sparse data sets.
Starting Page	58
Ending Page	58
File Size	422684
Page Count	1
File Format	PDF
ISBN	0769525709
DOI	10.1109/ICDE.2006.67
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2006-04-03
Publisher Place	USA
Access Restriction	Subscribed
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Relational databases Scalability Medical information systems Demography Query processing Statistics Data engineering
Content Type	Text
Resource Type	Article

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Extending RDBMSs to support sparse datasets using an interpreted attribute storage format (2006)

An implementation of MPEG Query Format over relational-based multimedia database

XLight, An Efficient Relational Schema to Store and Query XML Data

Storage and retrieval of XML data using relational databases

Query processing for temporal databases

An efficient query matching algorithm for relational data semantic cache

Probabilistic Relational Database Applications for Biomedical Informatics

DRXQP: A Dynamic Relational XML Query Processor

Secure query processing using AI techniques

Extending RDBMSs To Support Sparse Datasets Using An Interpreted Attribute Storage Format

Similar Documents

Extending RDBMSs to support sparse datasets using an interpreted attribute storage format (2006)

An implementation of MPEG Query Format over relational-based multimedia database

XLight, An Efficient Relational Schema to Store and Query XML Data

Storage and retrieval of XML data using relational databases

Query processing for temporal databases

An efficient query matching algorithm for relational data semantic cache

Probabilistic Relational Database Applications for Biomedical Informatics

DRXQP: A Dynamic Relational XML Query Processor

Secure query processing using AI techniques

Extending RDBMSs To Support Sparse Datasets Using An Interpreted Attribute Storage Format