NDLI: Understanding the Memory-Utilization of MPI Libraries: Challenges and Designs in Implementing the MPI_T Interface

Please wait, while we are loading the content...

Implementing the MPI-3.0 Fortran 2008 Binding

MPI Collectives and Datatypes for Hierarchical All-to-all Communication

Toward Local Failure Local Recovery Resilience Model using MPI-ULFM

Reproducible MPI Micro-Benchmarking Isn't As Easy As You Think

Exploring the Capabilities of the New MPI_T Interface

Locality-Optimized Mixed Static/Dynamic Scheduling for Improving Load Balancing on SMPs

Mixed-Precision AMG method for Many Core Accelerators

Architecture-Awareness for Real-Time Big Data Systems

Scalable MPI-3.0 RMA on the Blue Gene/Q Supercomputer

Optimal MPI Datatype Normalization for Vector and Index-block Types

Evaluating User-Level Fault Tolerance for MPI Applications

Exploring the effect of noise on the performance benefit of nonblocking allreduce

Understanding the Memory-Utilization of MPI Libraries: Challenges and Designs in Implementing the MPI_T Interface

Tracing Data Movements within MPI Collectives

Design of Multiple PVAS on InfiniBand Cluster System Consisting of Many-core and Multi-core

Locality-Aware Process Mapping for High Performance Collective MPI-IO on FEFS with Tofu Interconnect

Intra-Epoch Message Scheduling To Exploit Unused or Residual Overlapping Potential

Zero-copy, Hierarchical Gather is not possible with MPI Datatypes and Collectives

Comparing, Contrasting, Generalizing, and Integrating Two Current Designs for Fault-Tolerant MPI

A Portable Petascale Framework for Efficient Particle Methods with Custom Interactions

Catching Idlers with Ease: A Lightweight Wait-State Profiler for MPI Programs

Eliminating Costs for Crossing Process Boundary from MPI Intra-node Communication

An Adaptive Zero-Copy Strategy for Ubiquitous High Performance Computing

Evaluation of Asynchronous MPI Communication in Map-Reduce System on the K Computer

PMI Extensions for Scalable MPI Startup

GPU-Aware Intranode MPI_Allreduce

Distributed Behavioral Cartography of Timed Automata

Optimizing Collective Operations in Hybrid Applications

Optimizations to enhance sustainability of MPI applications

Decoupling Architecture for All-to-all Computation

Optimizing One-sided Operations in Open MPI

HPC in Big Data Age: An Evaluation Report for Java-Based Data-Intensive Applications Implemented with Hadoop and OpenMPI

A Graphical Environment for Development of MPI Applications

Understanding the Memory-Utilization of MPI Libraries: Challenges and Designs in Implementing the MPI_T Interface

Content Provider	ACM Digital Library
Author	Arnold, Mark Hamidouche, Khaled Rajachandrasekar, Raghunath Panda, Dhabaleswar K.DK Perkins, Jonathan
Abstract	The MPI Tools information interface (MPI_T), introduced as part of MPI 3.0 standard, has been gaining momentum in both the MPI and performance tools communities. In this paper, we investigate the challenges involved in profiling the memory utilization characteristics of MPI libraries that can be exposed to tools and libraries leveraging the MPI_T interface. We propose three design alternatives to enable such profiling from within MPI, and study their viability in light of these challenges. We analyze the benefits and shortcomings of each of them in detail, with a particular focus on the performance and memory overheads that they introduce. We evaluate the performance and scalability of these designs using micro-benchmarks, MPI-level benchmarks and applications. The overheads of the proposed design amounts to just 0.8% of the MILC application runtime with 4,096 processes. The paper also presents a case study that uses the MPI_T memory profiling information in MVAPICH2 to optimize the memory utilization of UH3D application runs, where memory savings of up to 7.3x was achieved.
Starting Page	97
Ending Page	102
Page Count	6
File Format	PDF
ISBN	9781450328753
DOI	10.1145/2642769.2642782
Language	English
Publisher	Association for Computing Machinery (ACM)
Publisher Date	2014-09-09
Publisher Place	New York
Access Restriction	Subscribed
Subject Keyword	Mvapich Profiling Mpi-3.0 Tools Mpi_t Memory-utilization
Content Type	Text
Resource Type	Article

Central Library (ISO-9001:2015 Certified)
Indian Institute of Technology Kharagpur
Kharagpur, West Bengal, India | PIN - 721302

See location in the Map
03222 282435
Mail: support@ndl.gov.in

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in