NDLI: Extend core UDF framework for GPU-enabled analytical query evaluation

Please wait, while we are loading the content...

Aggregates and priorities in P2P data management systems

Databases on the web: national web domain survey

A family of graph-theory-driven algorithms for managing complex probabilistic graph data efficiently

Scalable queries for large datasets using cloud computing: a case study

An efficient local region and clustering-based ensemble system for intrusion detection

Addressing resource usage in stream processing systems: sizing window effect

Trajectory data analysis using complex networks

A new architectural paradigm for content-based web applications: Borè

A landmark-model based system for mining frequent patterns from uncertain data streams

A predictable storage model for scalable parallel DW

Efficient incremental breadth-depth XML event mining

Using an inference mechanism for helping the data integration

FB-tree: a $B^{+}-tree$ for flash-based SSDs

Semantics-enabled web APIs selection patterns

Query language constructs for provenance

Union rewritings for XPath fragments

Top-k query processing for combinatorial objects using Euclidean distance

Mining semantic data for solving first-rater and cold-start problems in recommender systems

M-TOP: multi-target operator placement of query graphs for data streams

Query answering on trajectory cuboids using prime numbers encodings

A data masking technique for data warehouses

A statically typed query language for property graphs

A clustering-based visualization of colocation patterns

Black-box determination of cost models' parameters for federated stream-processing systems

Scrubbing query results from probabilistic databases

Flexible approximate counting

Online outlier detection for data streams

Query optimization using column statistics in hive

Boosting tuple propagation in multi-relational classification

Answering complex structured queries over the deep web

SciQL: bridging the gap between science and relational DBMS

Cache-conscious data placement in an in-memory key-value store

Extend core UDF framework for GPU-enabled analytical query evaluation

Chimera: data sharing flexibility, shared nothing simplicity

ParallelGDB: a parallel graph database based on cache specialization

An approach towards automatic workflow composition through information retrieval

Extend core UDF framework for GPU-enabled analytical query evaluation

Content Provider	ACM Digital Library
Author	Wu, Ren Hsu, Meichun Zhang, Bin Chen, Qiming
Abstract	To achieve scalable data intensive analytics, we investigate methods to integrate general purpose analytic computation into a query pipeline using User Defined Functions (UDFs). However, an existing UDF cannot act as a block operator with chunk-wise input along the tuple-wise query processing pipeline, therefore unable to deal with the application semantics definable on the set of incoming tuples representing a single object or falling in a time window, and unable to leverage external computation engines for efficient batch processing. To enable the data intensive computation pipeline, we introduce a new kind of UDFs called Set-In Set-Out (SISO) UDFs. A SISO UDF is a block operator for processing the input tuples and returning the resulting tuples chunk by chunk. Operated in the query processing pipeline, a SISO UDF pools a chunk of input tuples, dispatches them to GPUs or an analytic engine in batch, materializes and then streams out the results. This behavior differentiates SISO UDF from all the existing ones, and makes efficient integration of analytic computation and data management feasible. We have implemented the SISO UDF framework by extending the PostgreSQL query engine, and further demonstrated the use of SISO UDF with GPU-enabled analytical query evaluation. Our experiments show that the proposed approach is scalable and efficient.
Starting Page	143
Ending Page	151
Page Count	9
File Format	PDF
ISBN	9781450306270
DOI	10.1145/2076623.2076641
Language	English
Publisher	Association for Computing Machinery (ACM)
Publisher Date	2011-09-21
Publisher Place	New York
Access Restriction	Subscribed
Subject Keyword	Gpu computation Stream analytics Continuous query
Content Type	Text
Resource Type	Article

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Experience in Continuous analytics as a Service (CaaaS)

GPU-Enabled Visual Analytics Framework for Big Transportation Datasets

Continuous analytics: data stream query processing in practice

Multi-Model Based Optimization for Stream Query Processing

Continuous query processing; temporal analytics; dynamic social.

Continuous Constraint Query Evaluation for Spatiotemporal Streams (2007)

Query optimization for distributed data streams.

Continuous Constraint Query Evaluation for Spatiotemporal Streams (2007)

Online View Maintenance for Continuous Query Evaluation

Extend core UDF framework for GPU-enabled analytical query evaluation

Similar Documents

Experience in Continuous analytics as a Service (CaaaS)

GPU-Enabled Visual Analytics Framework for Big Transportation Datasets

Continuous analytics: data stream query processing in practice

Multi-Model Based Optimization for Stream Query Processing

Continuous query processing; temporal analytics; dynamic social.

Continuous Constraint Query Evaluation for Spatiotemporal Streams (2007)

Query optimization for distributed data streams.

Continuous Constraint Query Evaluation for Spatiotemporal Streams (2007)

Online View Maintenance for Continuous Query Evaluation

Extend core UDF framework for GPU-enabled analytical query evaluation