NDLI: NUMA-aware shared-memory collective communication for MPI

Please wait, while we are loading the content...

Scalable in situ scientific data encoding for analytical query processing

Virtual TCP offload: optimizing ethernet overlay performance on advanced interconnects

NUMA-aware shared-memory collective communication for MPI

IBIS: interposed big-data I/O scheduler

Anton: a special-purpose machine that achieves a hundred-fold speedup in biomolecular simulations

WuKong: automatically detecting and localizing bugs that manifest at large system scales

A preemption-based runtime to efficiently schedule multi-process applications on heterogeneous clusters with GPUs

Interference and locality-aware task scheduling for MapReduce applications in virtual clusters

Taming massive distributed datasets: data sampling using bitmap indices

Scalanytics: a declarative multi-core platform for scalable composable traffic analytics

Modeling communication in cache-coherent SMP systems: a case-study with Xeon Phi

ACIC: automatic cloud I/O configurator for parallel applications

A 1 PB/s file system to checkpoint three million MPI tasks

On the efficacy of GPU-integrated MPI for scientific applications

A comparative study of high-performance computing on the cloud

I/O acceleration with pattern detection

CamCubeOS: a key-based network stack for 3D torus cluster topologies

Orthrus: a framework for implementing high-performance collective I/O in the multicore clusters

AI-Ckpt: leveraging memory access patterns for adaptive asynchronous incremental checkpointing

VGRIS: virtualized GPU resource isolation and scheduling in cloud gaming

kMemvisor: flexible system wide memory mirroring in virtual environments

MTC envelope: defining the capability of large scale computers in the context of parallel scripting applications

ElastMan: autonomic elasticity manager for cloud-based key-value stores

Correcting soft errors online in LU factorization

COSMIC: middleware for high performance and reliable multiprocessing on xeon phi coprocessors

Supporting parallel soft real-time applications in virtualized environment

Building and scaling virtual clusters with residual resources from interactive clouds

SCDA: SLA-aware cloud datacenter architecture for efficient content storage and retrieval

Load balancing in large-scale epidemiological simulations

Efficient analytics on ordered datasets using MapReduce

A framework for auto-tuning HDF5 applications

NUMA-aware shared-memory collective communication for MPI

Content Provider	ACM Digital Library
Author	Snir, Marc Li, Shigang Hoefler, Torsten
Abstract	As the number of cores per node keeps increasing, it becomes increasingly important for MPI to leverage shared memory for intranode communication. This paper investigates the design and optimizations of MPI collectives for clusters of NUMA nodes. We develop performance models for collective communication using shared memory, and we develop several algorithms for various collectives. Experiments are conducted on both Xeon X5650 and Opteron 6100 InfiniBand clusters. The measurements agree with the model and indicate that different algorithms dominate for short vectors and long vectors. We compare our shared-memory allreduce with several traditional MPI implementations -- Open MPI, MPICH2, and MVAPICH2 -- that utilize system shared memory to facilitate interprocess communication. On a 16-node Xeon cluster and 8-node Opteron cluster, our implementation achieves on average 2.5X and 2.3X speedup over MVAPICH2, respectively. Our techniques enable an efficient implementation of collective operations on future multi- and manycore systems.
Starting Page	85
Ending Page	96
Page Count	12
File Format	PDF
ISBN	9781450319102
DOI	10.1145/2462902.2462903
Language	English
Publisher	Association for Computing Machinery (ACM)
Publisher Date	2013-06-17
Publisher Place	New York
Access Restriction	Subscribed
Subject Keyword	Multithreading Collective communication Mpi Mpi_allreduce Numa
Content Type	Text
Resource Type	Article

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Improved MPI collectives for MPI processes in shared address spaces

GPU-Aware Intranode MPI_Allreduce

GPU-Aware Intranode MPI_Allreduce

Kernel Assisted Collective Intra-node Communication Among Multicore and Manycore CPUs

Kernel Assisted Collective Intra-node MPI Communication among Multi-Core and Many-Core CPUs

Kernel Assisted Collective Intra-node Communication Among Multicore and Manycore CPUs

Optimization of MPI_Allreduce on the blue Gene/Q supercomputer

MPI Performance Comparison on Distributed and Shared Memory Machines (1996)

Mpi sh: a distributed shared memory implementation of mpi.

NUMA-aware shared-memory collective communication for MPI

Similar Documents

Improved MPI collectives for MPI processes in shared address spaces

GPU-Aware Intranode MPI_Allreduce

GPU-Aware Intranode MPI_Allreduce

Kernel Assisted Collective Intra-node Communication Among Multicore and Manycore CPUs

Kernel Assisted Collective Intra-node MPI Communication among Multi-Core and Many-Core CPUs

Kernel Assisted Collective Intra-node Communication Among Multicore and Manycore CPUs

Optimization of MPI_Allreduce on the blue Gene/Q supercomputer

MPI Performance Comparison on Distributed and Shared Memory Machines (1996)

Mpi sh: a distributed shared memory implementation of mpi.

NUMA-aware shared-memory collective communication for MPI