NDLI: Optimization of MPI persistent communication

Please wait, while we are loading the content...

Dataflow coordination of data-parallel tasks via MPI 3.0

Optimized process placement for collective I/O operations

Design, implementation, and performance evaluation of MPI 3.0 on portals 4.0

Optimization of MPI persistent communication

Optimization of MPI_Allreduce on the blue Gene/Q supercomputer

Combining static and dynamic validation of MPI collective communications

Parallel bucket-brigade communication interface for scientific applications

Run-time creation of the turbulent channel flow database by an HPC simulation using MPI-DB

Multi-parallel prefiltering on the convey HC-1 for supporting homology detection

Parallelizing a multiobjective swarm intelligence approach to phylogenetics using hybrid MPI/OpenMP schemes

Parallelizing a hybrid multiobjective differential evolution for identifying cis-regulatory elements

Parallel strategies for an inverse docking method

Improving MPI applications with a new MPI_Info and the use of the memoization

Improving collective I/O performance by pipelining request aggregation and file access

Analysis of topology-dependent MPI performance on Gemini networks

Revisiting rendezvous protocols in the context of RDMA-capable host channel adapters and many-core processors

In-place algorithms for the symmetric all-to-all exchange with MPI

Runtime message uniquification for accurate communication analysis on incomplete MPI event traces

First observations using nonblocking collectives in MVAPICH

A fluid-structure-interaction tool by coupling of existing codes

Non-negative matrix factorization on low-power architectures: a comparative study

Entire motifs search of secondary structures in proteins: a parallelization study

Algorithms for large-scale whole genome association analysis

Scalability and accuracy improvements of consistency-based multiple sequence alignment tools

Enabling MPI interoperability through flexible communication endpoints

Using MPI in high-performance computing services

The impact of hybrid-core processors on MPI message rate

Efficient and truly passive MPI-3 RMA using InfiniBand atomics

Energy estimation for MPI broadcasting algorithms in large scale HPC systems

Runtime MPI collective checking with tree-based overlay networks

A hierarchical parallel storage system based on distributed memory for large scale systems

Advancing application process affinity experimentation: open MPI's LAMA-based affinity interface

Triangulating molecular surfaces on multiple GPUs

Parallel algorithm for simulating the spatial transmission of influenza in EpiGraph

A dynamic pipeline for RNA sequencing on multicore processors

A data decomposition middleware tool with a generic built-in work-flow

MPI datatype processing using runtime compilation

DRASync: distributed region-based memory allocation and synchronization

Understanding the formation of wait states in applications with one-sided communication

Towards the availability of Java bindings in open MPI

A GPU approach for accelerating 3D deformable registration (DARTEL) on brain biomedical images

Efficient parallel construction of suffix trees for genomes larger than main memory

Parallel efficient aligner of pyrosequencing reads

Job scheduling for optimizing data locality in Hadoop clusters

McMPI: a managed-code MPI library in pure C#

On the performance of concurrent transfers in collective algorithms

Parallel implementation of a X-ray tomography reconstruction algorithm based on MPI and CUDA

P-Biblio-MetReS, a parallel data mining tool for the reconstruction of molecular networks

Seamless coarse grained parallelism integration in intensive bioinformatics workflows

Methodology for MPI applications autotuning

A communication library between multiple sets of MPI processes for a MPMD model

Dynamic memory usage analysis of MPI libraries using DMATP-MPI

Optimization of MPI persistent communication

Content Provider	ACM Digital Library
Author	Ishikawa, Yutaka Hatanaka, Masayuki Hori, Atsushi
Abstract	This paper proposes a novel optimization technique for MPI persistent communication, that utilizes multiple RDMA engines to carry out low latency communication. Because the interconnects used in modern supercomputers have multiple RDMA engines, the multiple communication requests specified by a persistent communication invocation can be scheduled onto the RDMA engines in an optimal way and thus result in better communication performance. Such a scheduling algorithm is not only a packing problem, but also avoids interconnect resource contentions as much as possible. The scheduling algorithm proposed in this paper balances load of RDMA engines and mitigates network link contentions in case of neighbor communication patterns such like in stencil computation. The proposed scheduling algorithm is implemented in Open MPI of K computer using RDMA functions provided as Fujitsu MPI extensions. A typical 2D stencil computation of a climate simulation code is used as a benchmark program. The experimental result shows that a factor of two speedup of communication time is achieved.
Starting Page	79
Ending Page	84
Page Count	6
File Format	PDF
ISBN	9781450319034
DOI	10.1145/2488551.2488566
Language	English
Publisher	Association for Computing Machinery (ACM)
Publisher Date	2013-09-15
Publisher Place	New York
Access Restriction	Subscribed
Subject Keyword	Rdma Persistent communication Mpi
Content Type	Text
Resource Type	Article

Central Library (ISO-9001:2015 Certified)
Indian Institute of Technology Kharagpur
Kharagpur, West Bengal, India | PIN - 721302

See location in the Map
03222 282435
Mail: support@ndl.gov.in

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in