NDLI: PAMI: A Parallel Active Message Interface for the Blue Gene/Q Supercomputer

Content Provider	IEEE Xplore Digital Library
Author	Kumar, S. Mamidala, A.R. Faraj, D.A. Smith, B. Blocksome, M. Cernohous, B. Miller, D. Parker, J. Ratterman, J. Heidelberger, P. Dong Chen Steinmacher-Burrow, B.
Copyright Year	2012
Abstract	The Blue Gene/Q machine is the next generation in the line of IBM massively parallel supercomputers, designed to scale to 262144 nodes and sixteen million threads. With each BG/Q node having 68 hardware threads, hybrid programming paradigms, which use message passing among nodes and multi-threading within nodes, are ideal and will enable applications to achieve high throughput on BG/Q. With such unprecedented massive parallelism and scale, this paper is a groundbreaking effort to explore the design challenges for designing a communication library that can match and exploit such massive parallelism In particular, we present the Parallel Active Messaging Interface (PAMI) library as our BG/Q library solution to the many challenges that come with a machine at such scale. PAMI provides (1) novel techniques to partition the application communication overhead into many contexts that can be accelerated by communication threads, (2) client and context objects to support multiple and different programming paradigms, (3) lockless algorithms to speed up MPI message rate, and (4) novel techniques leveraging the new BG/Q architectural features such as the scalable atomic primitives implemented in the L2 cache, the highly parallel hardware messaging unit that supports both point-to-point and collective operations, and the collective hardware acceleration for operations such as broadcast, reduce, and all reduce. We experimented with PAMI on 2048 BG/Q nodes and the results show high messaging rates as well as low latencies and high throughputs for collective communication operations.
Starting Page	763
Ending Page	773
File Size	741572
Page Count	11
File Format	PDF
ISBN	9781467309752
ISSN	15302075
DOI	10.1109/IPDPS.2012.73
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2012-05-21
Publisher Place	China
Access Restriction	Subscribed
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Message systems Context Hardware Programming Libraries Parallel processing Acceleration Message Rate MPI Message Passing Blue Gene Collective Communication
Content Type	Text
Resource Type	Article

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

The deep computing messaging framework: generalized scalable message passing on the blue gene/P supercomputer

A hardware acceleration unit for MPI queue processing

Self-Consistent MPI Performance Guidelines

Acceleration of an Asynchronous Message Driven Programming Paradigm on IBM Blue Gene/Q

MMPI: A flexible and efficient multiprocessor message passing interface for NoC-based MPSoC

Implementing distributed shared memory on top of MPI: the DSMPI library

Open Issues in MPI Implementation

Open issues in mpi implementation.

MPI collective communications on the blue gene/p supercomputer: algorithms and optimizations

PAMI: A Parallel Active Message Interface for the Blue Gene/Q Supercomputer

Similar Documents

The deep computing messaging framework: generalized scalable message passing on the blue gene/P supercomputer

A hardware acceleration unit for MPI queue processing

Self-Consistent MPI Performance Guidelines

Acceleration of an Asynchronous Message Driven Programming Paradigm on IBM Blue Gene/Q

MMPI: A flexible and efficient multiprocessor message passing interface for NoC-based MPSoC

Implementing distributed shared memory on top of MPI: the DSMPI library

Open Issues in MPI Implementation

Open issues in mpi implementation.

MPI collective communications on the blue gene/p supercomputer: algorithms and optimizations

PAMI: A Parallel Active Message Interface for the Blue Gene/Q Supercomputer