NDLI: Design and Implementation of Effective Checkpointing for Multithreaded Applications on Future Clouds

Content Provider	IEEE Xplore Digital Library
Author	Jangjaimon, I. Nian-Feng Tzeng
Copyright Year	2013
Description	Author affiliation: Center for Adv. Comput. Studies, Univ. of Louisiana at Lafayette, Lafayette, LA, USA (Jangjaimon, I.; Nian-Feng Tzeng)
Abstract	Multithreaded applications are common in high performance cloud computing systems, able to take advantage of elastic resource availability and cost fluctuation inherent to the systems. When applications involve many threads over more cores leased from the RaaS (Resource-as-a-Service) cloud under spot instance pricing for faster execution, resource unavailability are more likely to occur, undercutting execution performance gains potentially offered by those more cores. As a result, checkpointing is required to lower the adverse impact of resource unavailability on execution performance of such multithreaded applications. Given checkpointing often incurs expensive I/O to remote storage, this work presents design and implementation of our adaptive incremental checkpointing (AIC) for multithreaded applications on the RaaS clouds. AIC utilizes the idle cores for adaptive delta compression and remote checkpointing, significantly reducing the expected job turnaround time and the aggregated file size at remote storage. To ensure high compatibility and portability for AIC, we exploit techniques to avoid using kernel-specific data structures. AIC has been evaluated using PARSEC benchmarks on our established testbed, which resembles a multicore system acquired from the RaaS cloud. The results show that AIC noticeably reduces the expected turnaround time (by up to 37%) and the aggregated file size (by up to 8.3×) when compared to a recent multi-level checkpointing scheme with fixed checkpoint intervals.
Starting Page	438
Ending Page	445
File Size	270725
Page Count	8
File Format	PDF
ISSN	21596190
e-ISBN	9780769550282
DOI	10.1109/CLOUD.2013.57
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2013-06-28
Publisher Place	USA
Access Restriction	Subscribed
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Checkpointing Multicore processing Instruction sets Adaptive checkpointing Networked multicore systems Incremental checkpointing Delta compression Fault tolerance Pricing Benchmark testing Silicon Hardware RaaS clouds
Content Type	Text
Resource Type	Article

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Adaptive Incremental Checkpointing via Delta Compression for Networked Multicore Systems

Effective Cost Reduction for Elastic Clouds under Spot Instance Pricing Through Adaptive Checkpointing

Quantifying Thread Vulnerability for Multicore Architectures

Evaluating Scalability of Emerging Multithreaded Applications on Commodity Multicore Server

A user-level library for fault tolerance on shared memory multicore systems

Analyze reuse distance for multithreaded sparse iterative solver

Variation aware cache partitioning for multithreaded programs

FITDOC: Fast Virtual Machines Checkpointing with Delta Memory Compression

Efficient software-based fault tolerance approach on multicore platforms

Design and Implementation of Effective Checkpointing for Multithreaded Applications on Future Clouds

Similar Documents

Adaptive Incremental Checkpointing via Delta Compression for Networked Multicore Systems

Effective Cost Reduction for Elastic Clouds under Spot Instance Pricing Through Adaptive Checkpointing

Quantifying Thread Vulnerability for Multicore Architectures

Evaluating Scalability of Emerging Multithreaded Applications on Commodity Multicore Server

A user-level library for fault tolerance on shared memory multicore systems

Analyze reuse distance for multithreaded sparse iterative solver

Variation aware cache partitioning for multithreaded programs

FITDOC: Fast Virtual Machines Checkpointing with Delta Memory Compression

Efficient software-based fault tolerance approach on multicore platforms

Design and Implementation of Effective Checkpointing for Multithreaded Applications on Future Clouds