NDLI: Lazy Checkpointing: Exploiting Temporal Locality in Failures to Mitigate Checkpointing Overheads on Extreme-Scale Systems

Content Provider	IEEE Xplore Digital Library
Author	Tiwari, D. Gupta, S. Vazhkudai, S.S.
Copyright Year	2014
Description	Author affiliation: Oak Ridge Nat. Lab., Oak Ridge, TN, USA (Tiwari, D.; Gupta, S.; Vazhkudai, S.S.)
Abstract	Continuing increase in the computational power of supercomputers has enabled large-scale scientific applications in the areas of astrophysics, fusion, climate and combustion to run larger and longer-running simulations, facilitating deeper scientific insights. However, these long-running simulations are often interrupted by multiple system failures. Therefore, these applications rely on "check pointing'" as a resilience mechanism to store application state to permanent storage and recover from failures. Unfortunately, check pointing incurs excessive I/O overhead on supercomputers due to large size of checkpoints, resulting in a sub-optimal performance and resource utilization. In this paper, we devise novel mechanisms to show how check pointing overhead can be mitigated significantly by exploiting the temporal characteristics of system failures. We provide new insights and detailed quantitative understanding of the check pointing overheads and trade-offs on large-scale machines. Our prototype implementation shows the viability of our approach on extreme-scale machines.
Starting Page	25
Ending Page	36
File Size	916367
Page Count	12
File Format	PDF
ISBN	9781479922338
DOI	10.1109/DSN.2014.101
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2014-06-23
Publisher Place	USA
Access Restriction	Subscribed
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Checkpointing Computational modeling Lead Supercomputers Analytical models Bandwidth Exponential distribution storage checkpointing resilience system failures locality extreme-scale supercomputing
Content Type	Text
Resource Type	Article

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Lazy checkpointing: Exploiting temporal locality in failures to mitigate checkpointing overheads on extreme-scale systems (2014)

Understanding and Exploiting Spatial Properties of System Failures on Extreme-Scale HPC Systems

Modeling coordinated checkpointing for large-scale supercomputers

Field Data Based Modeling of Sender Based Message Logging Protocols for Supercomputers Checkpointing

Exploiting per user information for supercomputing workload prediction requires care

Characterizing the Impact of Rollback Avoidance at Extreme-Scale: A Modeling Approach

Simulation of a large-scale brewery distribution system

Improving the Computing Efficiency of HPC Systems Using a Combination of Proactive and Preventive Checkpointing

Probabilistic QoS guarantees for supercomputing systems

Lazy Checkpointing: Exploiting Temporal Locality in Failures to Mitigate Checkpointing Overheads on Extreme-Scale Systems

Similar Documents

Lazy checkpointing: Exploiting temporal locality in failures to mitigate checkpointing overheads on extreme-scale systems (2014)

Understanding and Exploiting Spatial Properties of System Failures on Extreme-Scale HPC Systems

Modeling coordinated checkpointing for large-scale supercomputers

Field Data Based Modeling of Sender Based Message Logging Protocols for Supercomputers Checkpointing

Exploiting per user information for supercomputing workload prediction requires care

Characterizing the Impact of Rollback Avoidance at Extreme-Scale: A Modeling Approach

Simulation of a large-scale brewery distribution system

Improving the Computing Efficiency of HPC Systems Using a Combination of Proactive and Preventive Checkpointing

Probabilistic QoS guarantees for supercomputing systems

Lazy Checkpointing: Exploiting Temporal Locality in Failures to Mitigate Checkpointing Overheads on Extreme-Scale Systems