NDLI: Holistic Debugging of MPI Derived Datatypes

Content Provider	IEEE Xplore Digital Library
Author	Protze, J. Hilbrich, T. Knupfer, A. de Supinski, B.R. Muller, M.S.
Copyright Year	2012
Abstract	The Message Passing Interface (MPI) specifies an API that allows programmers to create efficient and scalable parallel applications. The standard defines multiple constraints for each function parameter. For performance reasons, no MPI implementation checks all of these constraints at runtime. Derived data types are an important concept of MPI and allow users to describe an application's data structures for efficient and convenient communication. Using existing infrastructure we present scalable algorithms to detect usage errors of basic and derived MPI data types. We detect errors that include constraints for construction and usage of derived data types, matching their type signatures in communication, and detecting erroneous overlaps of communication buffers. We implement these checks in the MUST runtime error detection framework. We provide a novel representation of error locations to highlight usage errors. Further, approaches to buffer overlap checking can cause unacceptable overheads for non-contiguous data types. We present an algorithm that uses patterns in derived MPI data types to avoid these overheads without losing precision. Application results for the benchmark suites SPEC MPI2007 and NAS Parallel Benchmarks for up to 2048 cores show that our approach applies to a broad range of applications and that our extended overlap check improves performance by two orders of magnitude. Finally, we augment our runtime error detection component with a debugger extension to support in-depth analysis of the errors that we find as well as semantic errors. This extension to gdb provides information about MPI data type handles and enables gdb -- and other debuggers based on gdb -- to display the content of a buffer as used in MPI communications.
Starting Page	354
Ending Page	365
File Size	716877
Page Count	12
File Format	PDF
ISBN	9781467309752
ISSN	15302075
DOI	10.1109/IPDPS.2012.41
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2012-05-21
Publisher Place	China
Access Restriction	Subscribed
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Runtime Standards Semantics Libraries Benchmark testing Debugging Scalability debugging MPI datatypes runtime error detection
Content Type	Text
Resource Type	Article

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Holistic Debugging of MPI Derived Datatypes

MPI Runtime Error Detection with MUST: A Scalable and Crash-Safe Approach

Supporting Hybrid MPI and OpenSHMEM over InfiniBand: Design and Performance Evaluation

Distributed wait state tracking for runtime MPI deadlock detection

DAME: A Runtime-Compiled Engine for Derived Datatypes

Analysing the influence of InfiniBand choice on OpenMPI memory consumption

MPI runtime error detection with MUST: Advances in deadlock detection

On Scalability for MPI Runtime Systems

MPI performance evaluation and characterization using a compact application benchmark code

Holistic Debugging of MPI Derived Datatypes

Similar Documents

Holistic Debugging of MPI Derived Datatypes

MPI Runtime Error Detection with MUST: A Scalable and Crash-Safe Approach

Supporting Hybrid MPI and OpenSHMEM over InfiniBand: Design and Performance Evaluation

Distributed wait state tracking for runtime MPI deadlock detection

DAME: A Runtime-Compiled Engine for Derived Datatypes

Analysing the influence of InfiniBand choice on OpenMPI memory consumption

MPI runtime error detection with MUST: Advances in deadlock detection

On Scalability for MPI Runtime Systems

MPI performance evaluation and characterization using a compact application benchmark code

Holistic Debugging of MPI Derived Datatypes