NDLI: Supporting Bulk Synchronous Parallelism in Map-Reduce Queries

Content Provider	IEEE Xplore Digital Library
Author	Fegaras, L.
Copyright Year	2012
Description	Author affiliation: CSE, Univ. of Texas at Arlington, Arlington, TX, USA (Fegaras, L.)
Abstract	One of the major drawbacks of the Map-Reduce (MR) model is that, to simplify reliability and fault tolerance, it does not preserve data in memory across consecutive MR jobs: a MR job must dump its data to the distributed file system before they can be read by the next MR job. This restriction imposes a high overhead to complex MR workflows and graph algorithms, such as PageRank, which require repetitive MR jobs. The Bulk Synchronous Parallelism (BSP) programming model, on the other hand, has been recently advocated as an alternative to the MR model that does not suffer from this restriction, and, under certain circumstances, allows complex repetitive algorithms to run entirely in the collective memory of a cluster. We present a framework for translating complex declarative queries for scientific and graph data analysis applications to both MR and BSP evaluation plans, leaving the choice to be made at run-time based on the available resources. If the resources are sufficient, the query will be evaluated entirely in memory based on the BSP model, otherwise, the same query will be evaluated based on the MR model.
Sponsorship	IEEE Comput. Soc.
Starting Page	1068
Ending Page	1077
File Size	274449
Page Count	10
File Format	PDF
ISBN	9781467362184
e-ISBN	9780769549569
DOI	10.1109/SC.Companion.2012.129
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2012-11-10
Publisher Place	USA
Access Restriction	Subscribed
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Cloud computing Bulk synchronous parallelism Map-reduce
Content Type	Text
Resource Type	Article

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Supporting bulk synchronous parallelism in map-reduce queries.

Processing XML queries and updates on map/reduce clusters

Data analyzing using Map-Join-Reduce in cloud storage

An adaptive load balancing strategy in cloud computing based on Map reduce

Hybrid bulk synchronous parallelism library for clustered smp architectures

Map/reduce on EMF models

A Language Based Security Approach for Securing Map-Reduce Computations in the Cloud

Sharing incremental approaches for adding parallelism to CS curricula (abstract only)

An Implementation of Novel Cloud Computing Model - Improved Map-reduce Model

Supporting Bulk Synchronous Parallelism in Map-Reduce Queries

Similar Documents

Supporting bulk synchronous parallelism in map-reduce queries.

Processing XML queries and updates on map/reduce clusters

Data analyzing using Map-Join-Reduce in cloud storage

An adaptive load balancing strategy in cloud computing based on Map reduce

Hybrid bulk synchronous parallelism library for clustered smp architectures

Map/reduce on EMF models

A Language Based Security Approach for Securing Map-Reduce Computations in the Cloud

Sharing incremental approaches for adding parallelism to CS curricula (abstract only)

An Implementation of Novel Cloud Computing Model - Improved Map-reduce Model

Supporting Bulk Synchronous Parallelism in Map-Reduce Queries