NDLI: MPIWiz:subgroup reproducible replay of mpi applications

Content Provider	ACM Digital Library
Author	Liu, Xuezheng Xue, Ruini Wu, Ming Voelker, Geoffrey Guo, Zhenyu Zheng, Weimin Zhang, Zheng Chen, Wenguang
Abstract	Message Passing Interface (MPI) is a widely used standard for managing coarse-grained concurrency on distributed computers. Debugging parallel MPI applications, however, has always been a particularly challenging task due to their high degree of concurrent execution and non-deterministic behavior. Deterministic replay is a potentially powerful technique for addressing these challenges, with existing MPI replay tools adopting either data-replay or order-replay approaches. Unfortunately, each approach has its tradeoffs. Data-replay generates substantial log sizes by recording every communication message. Order-replay generates small logs, but requires all processes to be replayed together. We believe that these drawbacks are the primary reasons that inhibit the wide adoption of deterministic replay as the critical enabler of cyclic debugging of MPI applications. This paper describes subgroup reproducible replay (SRR), a hybrid deterministic replay method that provides the benefits of both data-replay and order-replay while balancing their trade-offs. SRR divides all processes into disjoint groups. It records the contents of messages crossing group boundaries as in data-replay, but records just message orderings for communication within a group as in order-replay. In this way, SRR can exploit the communication locality of traffic patterns in MPI applications. During replay, developers can then replay each group individually. SRR reduces recording overhead by not recording intra-group communication, and reduces replay overhead by limiting the size of each replay group. Exposing these tradeoffs gives the user the necessary control for making deterministic replay practical for MPI applications. We have implemented a prototype, MPIWiz, to demonstrate and evaluate SRR. MPIWiz employs a replay framework that allows transparent binary instrumentation of both library and system calls. As a result, MPIWiz replays MPI applications with no source code modification and relinking, and handles non-determinism in both MPI and OS system calls. Our preliminary results show that MPIWiz can reduce recording overhead by over a factor of four relative to data-replay, yet without requiring the entire application to be replayed as in order-replay. Recording increases execution time by 27% while the application can be replayed in just 53% of its base execution time.
Starting Page	251
Ending Page	260
Page Count	10
File Format	PDF
ISSN	03621340 15581160
DOI	10.1145/1594835.1504213
Journal	ACM SIGPLAN Notices (SIGP)
Volume Number	44
Issue Number	4
Language	English
Publisher	Association for Computing Machinery (ACM)
Publisher Date	1983-05-01
Publisher Place	New York
Access Restriction	One Nation One Subscription (ONOS)
Subject Keyword	Non-determinism Message passing interface Distributed debugging Record and replay
Content Type	Text
Resource Type	Article
Subject	Computer Graphics and Computer-Aided Design Software

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

MPIWiz: subgroup reproducible replay of mpi applications

Automatic formal verification of MPI-based parallel programs

Formal verification of practical MPI programs

Deterministic replay for message-passing-based concurrent programs

DDOS:taming nondeterminism in distributed systems (SIGP, Vol. 48, Issue. 4)

Nondeterminancy:testing and debugging in message passing parallel programs

An evaluation of the message-passing interface

Replay for concurrent non-deterministic shared-memory applications

Verification of MPI Java programs using software model checking

MPIWiz:subgroup reproducible replay of mpi applications

Similar Documents

MPIWiz: subgroup reproducible replay of mpi applications

Automatic formal verification of MPI-based parallel programs

Formal verification of practical MPI programs

Deterministic replay for message-passing-based concurrent programs

DDOS:taming nondeterminism in distributed systems (SIGP, Vol. 48, Issue. 4)

Nondeterminancy:testing and debugging in message passing parallel programs

An evaluation of the message-passing interface

Replay for concurrent non-deterministic shared-memory applications

Verification of MPI Java programs using software model checking

MPIWiz:subgroup reproducible replay of mpi applications