NDLI: Design and Implementation of Portable and Efficient Non-blocking Collective Communication

Content Provider	IEEE Xplore Digital Library
Author	Nomura, A. Ishikawa, Y. Maruyama, N. Matsuoka, S.
Copyright Year	2012
Abstract	Non-blocking communications are widely used in parallel applications for hiding communication overheads through overlapped computation and communication. While most of the existing implementations provide a non-blocking version of point-to-point communications, there is no portable and efficient implementation of non-blocking collectives, partly because application execution contexts need to be interrupted by dependent communications. This paper presents a portable and efficient user-level implementation technique of non-blocking communications. It allows users to design non-blocking collectives by declaring their operations and dependencies using provided APIs without being concerned with complicated management of their progression. While user-level implementations can be less efficient than kernel-level ones due to the cost of OS context switches, we solve this problem by employing the Marcel user level light-weight thread library when invoking communication operations. More specifically, each communication operation is mapped to one Marcel thread and scheduled to be executed when each operation's dependencies are satisfied by certain events. All executable operations and main user thread are executed simultaneously without any explicit invocations. Performance evaluations with micro benchmarks demonstrate the effectiveness of our proposed technique. Compared to existing OS-thread based method, it reduces CPU load to less than 10% while achieving similar level of communication latencies. We also discuss and compare the descriptive power of internal expressions for non-blocking communications.
Starting Page	1
Ending Page	8
File Size	310582
Page Count	8
File Format	PDF
ISBN	9781467313957
DOI	10.1109/CCGrid.2012.96
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2012-05-13
Publisher Place	Canada
Access Restriction	Subscribed
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Message systems Libraries Context Kernel Instruction sets Algorithm design and analysis Timing
Content Type	Text
Resource Type	Article

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Design and Implementation of Portable and Efficient Non-blocking Collective Communication

A Novel Functional Partitioning Approach to Design High-Performance MPI-3 Non-blocking Alltoallv Collective on Multi-core Systems

Enhanced Non-Blocking Buffer: A High Performance Non-Blocking Message Communication Mechanism

Designing an Offloaded Nonblocking MPI_Allgather Collective Using CORE-Direct

MPIActor - A Multicore-Architecture Adaptive and Thread-Based MPI Program Accelerator

Implementation and performance analysis of non-blocking collective operations for MPI

A Highly Efficient Implementation of I/O Functions on GPU

Implementation and performance analysis of non-blocking collective operations for MPI

Tervel: A unification of descriptor-based techniques for non-blocking programming

Design and Implementation of Portable and Efficient Non-blocking Collective Communication

Similar Documents

Design and Implementation of Portable and Efficient Non-blocking Collective Communication

A Novel Functional Partitioning Approach to Design High-Performance MPI-3 Non-blocking Alltoallv Collective on Multi-core Systems

Enhanced Non-Blocking Buffer: A High Performance Non-Blocking Message Communication Mechanism

Designing an Offloaded Nonblocking MPI_Allgather Collective Using CORE-Direct

MPIActor - A Multicore-Architecture Adaptive and Thread-Based MPI Program Accelerator

Implementation and performance analysis of non-blocking collective operations for MPI

A Highly Efficient Implementation of I/O Functions on GPU

Implementation and performance analysis of non-blocking collective operations for MPI

Tervel: A unification of descriptor-based techniques for non-blocking programming

Design and Implementation of Portable and Efficient Non-blocking Collective Communication