NDLI: Cost-minimizing preemptive scheduling of mapreduce workloads on hybrid clouds

Content Provider	IEEE Xplore Digital Library
Author	Xuanjia Qiu Wai Leong Yeow Chuan Wu Lau, F.C.M.
Copyright Year	2013
Description	Author affiliation: Inst. for Infocomm Res. (I2R), Singapore, Singapore (Wai Leong Yeow) \|\| Dept. of Comput. Sci., Univ. of Hong Kong, Hong Kong, China (Xuanjia Qiu; Chuan Wu; Lau, F.C.M.)
Abstract	MapReduce has become the dominant programming model for processing massive amounts of data on cloud platforms. More and more enterprises are now utilizing hybrid clouds, consisting of private infrastructure owned by themselves and public clouds such as Amazon EC2, to process their spiky MapReduce workloads, which fully utilize their own on-premise resources while outsourcing the tasks only when needed. With disparate workloads of different MapReduce tasks, an efficient scheduling mechanism is in need to enable efficient utilization of the on-premise resources and to minimize the task outsourcing cost, while meeting the task completion time requirements as well. In this paper, a fine-grained model is described to characterize the scheduling of heterogeneous MapReduce workloads, and an online algorithm is proposed for joint task admission control into the private cloud, task outsourcing to the public cloud, and VM allocation to execute the admitted tasks on the private cloud, such that the time-averaged task outsourcing cost is minimized over the long run. The online algorithm features preemptive scheduling of the tasks, where a task executed partially on the on-premise infrastructure can be paused and scheduled to run later. It also achieves desirable properties such as meeting a pre-set task admission ratio and bounding the worst-case task completion time, as proven by our rigorous theoretical analysis.
Sponsorship	IEEE Commun. Soc.
Starting Page	1
Ending Page	6
File Size	460148
Page Count	6
File Format	PDF
ISBN	9781479905898
ISSN	1548615X
e-ISBN	9781479905904
DOI	10.1109/IWQoS.2013.6550284
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2013-06-03
Publisher Place	Canada
Access Restriction	Subscribed
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Cloud computing Outsourcing Heuristic algorithms Optimization Quality of service Scheduling Algorithm design and analysis
Content Type	Text
Resource Type	Article

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Cost-minimizing preemptive scheduling of mapreduce workloads on hybrid clouds.

Cost-Minimizing Preemptive Scheduling of MapReduce Workloads on Hybrid Clouds

A heuristic fault tolerant MapReduce framework for minimizing makespan in Hybrid Cloud Environment

Scheduling service workflows for cost optimization in hybrid clouds

Cost-driven service provisioning in hybrid clouds

Cost-minimizing dynamic migration of content distribution services into hybrid clouds

Cost-Optimal Cloud Service Placement under Dynamic Pricing Schemes

On the Performance-Cost Tradeoff for Workflow Scheduling in Hybrid Clouds

Cost-Minimizing Online VM Purchasing for Application Service Providers with Arbitrary Demands

Cost-minimizing preemptive scheduling of mapreduce workloads on hybrid clouds

Similar Documents

Cost-minimizing preemptive scheduling of mapreduce workloads on hybrid clouds.

Cost-Minimizing Preemptive Scheduling of MapReduce Workloads on Hybrid Clouds

A heuristic fault tolerant MapReduce framework for minimizing makespan in Hybrid Cloud Environment

Scheduling service workflows for cost optimization in hybrid clouds

Cost-driven service provisioning in hybrid clouds

Cost-minimizing dynamic migration of content distribution services into hybrid clouds

Cost-Optimal Cloud Service Placement under Dynamic Pricing Schemes

On the Performance-Cost Tradeoff for Workflow Scheduling in Hybrid Clouds

Cost-Minimizing Online VM Purchasing for Application Service Providers with Arbitrary Demands

Cost-minimizing preemptive scheduling of mapreduce workloads on hybrid clouds