NDLI: On the efficacy of GPU-integrated MPI for scientific applications

Please wait, while we are loading the content...

Scalable in situ scientific data encoding for analytical query processing

Virtual TCP offload: optimizing ethernet overlay performance on advanced interconnects

NUMA-aware shared-memory collective communication for MPI

IBIS: interposed big-data I/O scheduler

Anton: a special-purpose machine that achieves a hundred-fold speedup in biomolecular simulations

WuKong: automatically detecting and localizing bugs that manifest at large system scales

A preemption-based runtime to efficiently schedule multi-process applications on heterogeneous clusters with GPUs

Interference and locality-aware task scheduling for MapReduce applications in virtual clusters

Taming massive distributed datasets: data sampling using bitmap indices

Scalanytics: a declarative multi-core platform for scalable composable traffic analytics

Modeling communication in cache-coherent SMP systems: a case-study with Xeon Phi

ACIC: automatic cloud I/O configurator for parallel applications

A 1 PB/s file system to checkpoint three million MPI tasks

On the efficacy of GPU-integrated MPI for scientific applications

A comparative study of high-performance computing on the cloud

I/O acceleration with pattern detection

CamCubeOS: a key-based network stack for 3D torus cluster topologies

Orthrus: a framework for implementing high-performance collective I/O in the multicore clusters

AI-Ckpt: leveraging memory access patterns for adaptive asynchronous incremental checkpointing

VGRIS: virtualized GPU resource isolation and scheduling in cloud gaming

kMemvisor: flexible system wide memory mirroring in virtual environments

MTC envelope: defining the capability of large scale computers in the context of parallel scripting applications

ElastMan: autonomic elasticity manager for cloud-based key-value stores

Correcting soft errors online in LU factorization

COSMIC: middleware for high performance and reliable multiprocessing on xeon phi coprocessors

Supporting parallel soft real-time applications in virtualized environment

Building and scaling virtual clusters with residual resources from interactive clouds

SCDA: SLA-aware cloud datacenter architecture for efficient content storage and retrieval

Load balancing in large-scale epidemiological simulations

Efficient analytics on ordered datasets using MapReduce

A framework for auto-tuning HDF5 applications

On the efficacy of GPU-integrated MPI for scientific applications

Content Provider	ACM Digital Library
Author	Panwar, Lokendra S. Ji, Feng Bisset, Keith R. Aji, Ashwin M. Feng, Wu-chun Murthy, Karthik Dinan, James Mellor-Crummey, John Chabbi, Milind Ma, Xiaosong Balaji, Pavan Thakur, Rajeev
Abstract	Scientific computing applications are quickly adapting to leverage the massive parallelism of GPUs in large-scale clusters. However, the current hybrid programming models require application developers to explicitly manage the disjointed host and GPU memories, thus reducing both efficiency and productivity. Consequently, GPU-integrated MPI solutions, such as MPI-ACC and MVAPICH2-GPU, have been developed that provide unified programming interfaces and optimized implementations for end-to-end data communication among CPUs and GPUs. To date, however, there lacks an in-depth performance characterization of the new optimization spaces or the productivity impact of such GPU-integrated communication systems for scientific applications. In this paper, we study the efficacy of GPU-integrated MPI on scientific applications from domains such as epidemiology simulation and seismology modeling, and we discuss the lessons learned. We use MPI-ACC as an example implementation and demonstrate how the programmer can seamlessly choose between either the CPU or the GPU as the logical communication end point, depending on the application's computational requirements. MPI-ACC also encourages programmers to explore novel application-specific optimizations, such as internode CPU-GPU communication with concurrent CPU-GPU computations, which can improve the overall cluster utilization. Furthermore, MPI-ACC internally implements scalable memory management techniques, thereby decoupling the low-level memory optimizations from the applications and making them scalable and portable across several architectures. Experimental results from a state-of-the-art cluster with hundreds of GPUs show that the MPI-ACC--driven new application-specific optimizations can improve the performance of an epidemiology simulation by up to 61.6% and the performance of a seismology modeling application by up to 44%, when compared with traditional hybrid MPI+GPU implementations. We conclude that GPU-integrated MPI significantly enhances programmer productivity and has the potential to improve the performance and portability of scientific applications, thus making a significant step toward GPUs being 'first-class citizens' of hybrid CPU-GPU clusters.
Starting Page	191
Ending Page	202
Page Count	12
File Format	PDF
ISBN	9781450319102
DOI	10.1145/2462902.2462915
Language	English
Publisher	Association for Computing Machinery (ACM)
Publisher Date	2013-06-17
Publisher Place	New York
Access Restriction	Subscribed
Subject Keyword	Seismology Mpi-acc Mpi Computational epidemiology Gpgpu
Content Type	Text
Resource Type	Article

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

On the efficacy of gpu-integrated mpi for scientific applications.

On the Efficacy of GPU-Integrated MPI for Scientific Applications (2013)

MPI-ACC: An Integrated and Extensible Approach to Data Movement in Accelerator-based Systems

MPI-ACC: Accelerator-Aware MPI for Scientific Applications

Synchronization and Ordering Semantics in Hybrid MPI+GPU Programming

Accelerating financial applications on the GPU

FLAT: a GPU programming framework to provide embedded MPI

Evaluating the acceleration of typical scientific problems on the GPU

Unstructured grid applications on GPU: performance analysis and improvement

On the efficacy of GPU-integrated MPI for scientific applications

Similar Documents

On the efficacy of gpu-integrated mpi for scientific applications.

On the Efficacy of GPU-Integrated MPI for Scientific Applications (2013)

MPI-ACC: An Integrated and Extensible Approach to Data Movement in Accelerator-based Systems

MPI-ACC: Accelerator-Aware MPI for Scientific Applications

Synchronization and Ordering Semantics in Hybrid MPI+GPU Programming

Accelerating financial applications on the GPU

FLAT: a GPU programming framework to provide embedded MPI

Evaluating the acceleration of typical scientific problems on the GPU

Unstructured grid applications on GPU: performance analysis and improvement

On the efficacy of GPU-integrated MPI for scientific applications