NDLI: Team-Based Message Logging: Preliminary Results

Content Provider	IEEE Xplore Digital Library
Author	Meneses, E. Mendes, C.L. Kalé, L.V.
Copyright Year	2010
Abstract	Fault tolerance will be a fundamental imperative in the next decade as machines containing hundreds of thousands of cores will be installed at various locations. In this context, the traditional checkpoint/restart model does not seem to be a suitable option, since it makes all the processors roll back to their latest checkpoint in case of a single failure in one of the processors. In-memory message logging is an alternative that avoids this global restoration process and instead replays the messages to the failed processor. However, there is a large memory overhead associated with message logging because each message must be logged so it can be played back if a failure occurs. In this paper, we introduce a technique to alleviate the demand of memory in message logging by grouping processors into teams. These teams act as a failure unit: if one team member fails, all the other members in that team roll back to their latest checkpoint and start the recovery process. This eliminates the need to log message contents within teams. The savings in memory produced by this approach depend on the characteristics of the application, the number of messages sent per computation unit and size of those messages. We present promising results for multiple benchmarks. As an example, the NPB-CG code running class D on 512 cores manages to reduce the memory overhead of message logging by 62%.
Starting Page	697
Ending Page	702
File Size	298240
Page Count	6
File Format	PDF
ISBN	9781424469871
e-ISBN	9781424469888
DOI	10.1109/CCGRID.2010.110
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2010-05-17
Publisher Place	Australia
Access Restriction	Subscribed
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Protocols Clouds Grid computing Computer science USA Councils Fault tolerance Context modeling Memory management Frequency Resumes Message Logging High Performance Computing Fault Tolerance
Content Type	Text
Resource Type	Article

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Fault Tolerance in Cluster Federations with O2P-CF

Performance comparison of hierarchical checkpoint protocols grid computing

Performance comparison of hierarchical checkpoint protocols grid computing

Hierarchical composition of coordinated checkpoint with pessimistic message logging

High performance grid computing - HPGC

A new, efficient coordinated checkpointing protocol combined with selective sender-based message logging

Fault-Tolerant Protocol for Hybrid Task-Parallel Message-Passing Applications

Performance comparison of hierarchical checkpoint protocols grid computing

A Fault-Tolerance Protocol for Parallel Applications with Communication Imbalance

Team-Based Message Logging: Preliminary Results

Similar Documents

Fault Tolerance in Cluster Federations with O2P-CF

Performance comparison of hierarchical checkpoint protocols grid computing

Performance comparison of hierarchical checkpoint protocols grid computing

Hierarchical composition of coordinated checkpoint with pessimistic message logging

High performance grid computing - HPGC

A new, efficient coordinated checkpointing protocol combined with selective sender-based message logging

Fault-Tolerant Protocol for Hybrid Task-Parallel Message-Passing Applications

Performance comparison of hierarchical checkpoint protocols grid computing

A Fault-Tolerance Protocol for Parallel Applications with Communication Imbalance

Team-Based Message Logging: Preliminary Results