NDLI: MVAPICH2-GPU: optimized GPU to GPU communication for InfiniBand clusters

Content Provider	Springer Nature Link
Author	Wang, Hao Potluri, Sreeram Luo, Miao Singh, Ashish Kumar Sur, Sayantan Panda, Dhabaleswar K.
Copyright Year	2011
Abstract	Data parallel architectures, such as General Purpose Graphics Units (GPGPUs) have seen a tremendous rise in their application for High End Computing. However, data movement in and out of GPGPUs remain the biggest hurdle to overall performance and programmer productivity. Applications executing on a cluster with GPUs have to manage data movement using CUDA in addition to MPI, the de-facto parallel programming standard. Currently, data movement with CUDA and MPI libraries is not integrated and it is not as efficient as possible. In addition, MPI-2 one sided communication does not work for windows in GPU memory, as there is no way to remotely get or put data from GPU memory in a one-sided manner.In this paper, we propose a novel MPI design that integrates CUDA data movement transparently with MPI. The programmer is presented with one MPI interface that can communicate to and from GPUs. Data movement from GPU and network can now be overlapped. The proposed design is incorporated into the MVAPICH2 library. To the best of our knowledge, this is the first work of its kind to enable advanced MPI features and optimized pipelining in a widely used MPI library. We observe up to 45% improvement in one-way latency. In addition, we show that collective communication performance can be improved significantly: 32%, 37% and 30% improvement for Scatter, Gather and Allotall collective operations, respectively. Further, we enable MPI-2 one sided communication with GPUs. We observe up to 45% improvement for Put and Get operations.
Starting Page	257
Ending Page	266
Page Count	10
File Format	PDF
ISSN	18652034
Journal	Informatik - Forschung und Entwicklung
Volume Number	26
Issue Number	3-4
e-ISSN	18652042
Language	English
Publisher	Springer-Verlag
Publisher Date	2011-04-12
Publisher Place	Berlin, Heidelberg
Access Restriction	Subscribed
Subject Keyword	MPI Clusters GPGPU CUDA InfiniBand Data Structures, Cryptology and Information Theory Theory of Computation Computer Systems Organization and Communication Networks Computer Hardware Computer Science Software Engineering/Programming and Operating Systems
Content Type	Text
Resource Type	Article
Subject	Computer Science

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Using LAMA for efficient AMG on hybrid clusters

A middleware for efficient stream processing in CUDA

The development of Mellanox/NVIDIA GPUDirect over InfiniBand—a new model for GPU to GPU communications

Optimized HPL for AMD GPU and multi-core CPU usage

Energy consumption of CUDA kernels with varying thread topology

Global optimization model on power efficiency of GPU and multicore processing element for SIMD computing with CUDA

Astrophysical particle simulations with large custom GPU clusters on three continents

Comparing GPU-based multi-volume ray casting techniques

High performance conjugate gradient solver on multi-GPU clusters using hypergraph partitioning

MVAPICH2-GPU: optimized GPU to GPU communication for InfiniBand clusters

Similar Documents

Using LAMA for efficient AMG on hybrid clusters

A middleware for efficient stream processing in CUDA

The development of Mellanox/NVIDIA GPUDirect over InfiniBand—a new model for GPU to GPU communications

Optimized HPL for AMD GPU and multi-core CPU usage

Energy consumption of CUDA kernels with varying thread topology

Global optimization model on power efficiency of GPU and multicore processing element for SIMD computing with CUDA

Astrophysical particle simulations with large custom GPU clusters on three continents

Comparing GPU-based multi-volume ray casting techniques

High performance conjugate gradient solver on multi-GPU clusters using hypergraph partitioning

MVAPICH2-GPU: optimized GPU to GPU communication for InfiniBand clusters