NDLI: Scalable PGAS collective operations in NUMA clusters

Content Provider	Springer Nature Link
Author	Mallón, Damián A. Taboada, Guillermo L. Teijeiro, Carlos González Domínguez, Jorge Gómez, Andrés Wibecan, Brian
Copyright Year	2014
Abstract	The increasing number of cores per processor is turning manycore-based systems in pervasive. This involves dealing with multiple levels of memory in non uniform memory access (NUMA) systems and processor cores hierarchies, accessible via complex interconnects in order to dispatch the increasing amount of data required by the processing elements. The key for efficient and scalable provision of data is the use of collective communication operations that minimize the impact of bottlenecks. Leveraging one sided communications becomes more important in these systems, to avoid unnecessary synchronization between pairs of processes in collective operations implemented in terms of two sided point to point functions. This work proposes a series of algorithms that provide a good performance and scalability in collective operations, based on the use of hierarchical trees, overlapping one-sided communications, message pipelining and the available NUMA binding features. An implementation has been developed for Unified Parallel C, a Partitioned Global Address Space language, which presents a shared memory view across the nodes for programmability, while keeping private memory regions for performance. The performance evaluation of the proposed implementation, conducted on five representative systems (JuRoPA, JUDGE, Finis Terrae, SVG and Superdome), has shown generally good performance and scalability, even outperforming MPI in some cases, which confirms the suitability of the developed algorithms for manycore architectures.
Starting Page	1473
Ending Page	1495
Page Count	23
File Format	PDF
ISSN	13867857
Journal	Cluster Computing
Volume Number	17
Issue Number	4
e-ISSN	15737543
Language	English
Publisher	Springer US
Publisher Date	2014-05-08
Publisher Place	Boston
Access Restriction	One Nation One Subscription (ONOS)
Subject Keyword	Manycore architectures Collective operations NUMA UPC PGAS MPI High performance computing Communication algorithms Processor Architectures Operating Systems Computer Communication Networks
Content Type	Text
Resource Type	Article
Subject	Computer Networks and Communications Software

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Performance analysis of MPI collective operations

Improved MPI collectives for MPI processes in shared address spaces

Malleable applications for scalable high performance computing

The design and implementation of MPI collective operations for clusters in long-and-fast networks

High Performance Computing on Heterogeneous Clusters with the Madeleine II Communication Library

Optimizing MPI collective communication by orthogonal structures

A Software Suite for High-Performance Communications on Clusters of SMPs

A middleware approach for pipelining communications in clusters

Starfish: Fault-Tolerant Dynamic MPI Programs on Clusters of Workstations

Scalable PGAS collective operations in NUMA clusters

Similar Documents

Performance analysis of MPI collective operations

Improved MPI collectives for MPI processes in shared address spaces

Malleable applications for scalable high performance computing

The design and implementation of MPI collective operations for clusters in long-and-fast networks

High Performance Computing on Heterogeneous Clusters with the Madeleine II Communication Library

Optimizing MPI collective communication by orthogonal structures

A Software Suite for High-Performance Communications on Clusters of SMPs

A middleware approach for pipelining communications in clusters

Starfish: Fault-Tolerant Dynamic MPI Programs on Clusters of Workstations

Scalable PGAS collective operations in NUMA clusters