NDLI: Implementation and Evaluation of a Scalable Application-Level Checkpoint-Recovery Scheme for MPI Programs

Please wait, while we are loading the content...

Conference Committees

Automatic Distribution of Rendering Workloads in a Grid Enabled Collaborative Visualization Environment

A High Performance Java Middleware with a Real Application

Modernizing Existing Software: A Case Study

Dynamic Metadata Management for Petabyte-Scale File Systems

Fastpath Optimizations for Cluster Recovery in Shared-Disk Systems

Optimal File-Bundle Caching Algorithms for Data-Grids

VMPlants: Providing and Managing Virtual Machine Execution Environments for Grid Computing

Toward Flexible Messaging for SOAP-Based Services

Supporting Cluster-Based Network Services on Functionally Symmetric Software Architecture

Scientific Computations on Modern Parallel Vector Systems

Early Experience with Aerospace CFD at JAXA on the Fujitsu PRIMEPOWER HPC2500

Analysis and Modeling of Advanced PIM Architecture Design Tradeoffs

The Potential of Computation Regrouping for Improving Locality

Rating Compiler Optimizations for Automatic Performance Tuning

Towards a Systematic, Pragmatic and Architecture-Aware Program Optimization Process for Complex Processors

Coscheduling in Clusters: Is It a Viable Alternative?

Resource Management for Rapid Application Turnaround on Enterprise Desktop Grids

A Geometric Programming Framework for Optimal Multi-Level Tiling

Scalable Line Dynamics in ParaDiS

Big Wins with Small Application-Aware Caches

Performance Evaluation of Parallel Large-Scale Lattice Boltzmann Applications on Three Supercomputing Architectures

Experiences in Design and Implementation of a High Performance Transport Protocol

Improving Throughput for Grid Applications with Network Logistics

Inter-Layer Coordination for Parallel TCP Streams on Long Fat Pipe Networks

A Computational Database System for Generatinn Unstructured Hexahedral Meshes with Billions of Elements

GYRO: A 5-D Gyrokinetic-Maxwell Solver

Advanced Computational Fluid Dynamics Simulations of Proiectiles with Flow Control

Performance Tool Support for MPI-2 on Linux

Language and Compiler Support for Adaptive Applications

Using Information from Prior Runs to Improve Automated Tuning Systems

Realistic Large-Scale Online Network Simulation

Collaborative User-Centric Lambda-Grid over Wavelength-Routed Network

Building Multirail InfiniBand Clusters: MPI-Level Design and Performance Evaluation

Ultrascalable Implicit Finite Element Analyses in Solid Mechanics with over a Half a Billion Degrees of Freedom

A 15.2 TFlops Simulation of Geodynamo on the Earth Simulator

Optimal Blade System Design of a New Concept VTOL Vehicle Uusing the Departmental Computing Grid System

Assessing Fault Sensitivity in MPI Applications

Implementation and Evaluation of a Scalable Application-Level Checkpoint-Recovery Scheme for MPI Programs

RPC-V: Toward Fault-Tolerant RPC for Internet Connected Desktop Grids with Volatile Nodes

QCDOC: A 10 Teraflops Computer for Tightly-Coupled Calculations

A Performance and Scalability Analysis of the BlueGene/L Architecture

Analysis and Performance Results of a Molecular Modeling Application on Merrimac

Predicting and Evaluating Distributed Communication Performance

Performance Evaluation of Task Pools Based on Hardware Synchronization

Will Moore's Law Be Sufficient?

Using Hardware Counters to Automatically Improve Memory Performance

GPU Cluster for High Performance Computing

A Parallel Implementation of 4-Dimensional Haralick Texture Analysis for Disk-Resident Image Datasets

A Parallel Visualization Pipeline for Terascale Earthquake Simulations

VIRACOCHA: An Efficient Parallelization Framework for Large-Scale CFD Post-Processing in Virtual Environments

Kosha: A Peer-to-Peer Enhancement for the Network File System

A Self-Organizing Storage Cluster for Parallel Data-Intensive Applications

The Panasas ActiveScale Storage Cluster: Delivering Scalable High Bandwidth Storage

Realistic Modeling and Svnthesis of Resources for Computational Grids

The Inca Test Harness and Reporting Framework

A Peer-to-Peer Replica Location Service Based on a Distributed Hash Table

Unlocking the Performance of the BlueGene/L Supercomputer

Data Centric Cache Measurement on the Intel ltanium 2 Processor

Runtime Compression of MPI Messanes to Improve the Performance and Scalability of Parallel Applications

High Performance Computing in Context

Toward a High Performance Computing Economy

Computing Opportunities in the Era of Abundant Biological Data

Computing - An Intellectual Lever for Multidisciplinary Discovery

Implementation and Evaluation of a Scalable Application-Level Checkpoint-Recovery Scheme for MPI Programs

Content Provider	ACM Digital Library
Author	Schulz, Martin Bronevetsky, Greg Marques, Daniel Fernandes, Rohit Stodghill, Paul Pingali, Keshav
Abstract	The running times of many computational science applications are much longer than the mean-time-to-failure of current high-performance computing platforms. To run to completion, such applications must tolerate hardware failures. Checkpoint-and-restart (CPR) is the most commonly used scheme for accomplishing this - the state of the computation is saved periodically on stable storage, and when a hardware failure is detected, the computation is restarted from the most recently saved state. Most automatic CPR schemes in the literature can be classified as system-level checkpointing schemes because they take core-dump style snapshots of the computational state when all the processes are blocked at global barriers in the program. Unfortunately, a system that implements this style of checkpointing is tied to a particular platform; in addition, it cannot be used if there are no global barriers in the program. We are exploring an alternative called application-level, non-blocking checkpointing. In our approach, programs are transformed by a pre-processor so that they become self-checkpointing and self-restartable on any platform; there is also no assumption about the existence of global barriers in the code. In this paper, we describe our implementation of application-level, non-blocking checkpointing. We present experimental results on both a Windows cluster and a Compaq Alpha cluster, which show that the overheads introduced by our approach are small.
File Format	PDF
ISBN	0769521533
DOI	10.1109/SC.2004.29
Language	English
Publisher	Association for Computing Machinery (ACM)
Publisher Date	2004-11-06
Access Restriction	Subscribed
Content Type	Text
Resource Type	Article

Central Library (ISO-9001:2015 Certified)
Indian Institute of Technology Kharagpur
Kharagpur, West Bengal, India | PIN - 721302

See location in the Map
03222 282435
Mail: support@ndl.gov.in

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in