NDLI: Large-scale distributed sorting for GPU-based heterogeneous supercomputers

Content Provider	IEEE Xplore Digital Library
Author	Shamoto, H. Shirahata, K. Drozd, A. Sato, H. Matsuoka, S.
Copyright Year	2014
Description	Author affiliation: Tokyo Inst. of Technol., Tokyo, Japan (Shamoto, H.; Shirahata, K.; Drozd, A.; Sato, H.; Matsuoka, S.)
Abstract	Splitter-based parallel sorting algorithms are known to be highly efficient for distributed sorting due to their low communication complexity. Although using GPU accelerators could help to reduce the computation cost in general, their effectiveness in distributed sorting algorithms on large-scale heterogeneous GPU-based systems remains unclear. We investigate applicability of using GPU devices to the splitter-based algorithms and extend HykSort, an existing splitter-based algorithm by offloading costly computation phases to GPUs. We also handle GPU memory overflows by introducing an iterative approach which sorts multiple chunks and merges them into one array. We evaluate the performance of our implementation with local sort acceleration on the TSUBAME2.5 supercomputer that comprises over 4000 NVIDIA K20x GPUs. Performance evaluation of weak scaling shows that we achieve 389 times speedup with 0.25TB/s throughput when sorting 4TB 64bit integer on 1024 nodes compared to running on 1 node; on the other hand, for CPU vs. GPU comparison, our implementation achieves only 1.40 times speedup using 1024 nodes. Detailed analysis however reveals that the limitation is almost entirely due to the bottleneck in CPU-GPU host-to-device bandwidth. With orders of magnitude improvements planned for next generation GPUs, the performance boost will be tremendous in accordance with other successful GPU accelerations.
Starting Page	510
Ending Page	518
File Size	740564
Page Count	9
File Format	PDF
ISBN	9781479956661
DOI	10.1109/BigData.2014.7004268
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2014-10-27
Publisher Place	USA
Access Restriction	Subscribed
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Performance evaluation Algorithm design and analysis Histograms Big Data Applications Graphics processing units Data transfer Arrays Distributed Systems Hybrid Programming GPGPU Sorting
Content Type	Text
Resource Type	Article

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Out-of-core GPU memory management for MapReduce-based large-scale graph processing

A Scalable Implementation of a MapReduce-based Graph Processing Algorithm for Large-Scale Heterogeneous Supercomputers

Internal sorting algorithm for large-scale data based on GPU-assisted

GraphReduce: Large-Scale Graph Analytics on Accelerator-Based HPC Systems

Hybrid Map Task Scheduling for GPU-Based Heterogeneous Clusters

Optimized GPU Sorting Algorithms on Special Input Distributions

Synchronization and Ordering Semantics in Hybrid MPI+GPU Programming

JolokiaC++: Optimizing Irregular Accesses for GPGPU

Data Transfer Matters for GPU Computing

Large-scale distributed sorting for GPU-based heterogeneous supercomputers

Similar Documents

Out-of-core GPU memory management for MapReduce-based large-scale graph processing

A Scalable Implementation of a MapReduce-based Graph Processing Algorithm for Large-Scale Heterogeneous Supercomputers

Internal sorting algorithm for large-scale data based on GPU-assisted

GraphReduce: Large-Scale Graph Analytics on Accelerator-Based HPC Systems

Hybrid Map Task Scheduling for GPU-Based Heterogeneous Clusters

Optimized GPU Sorting Algorithms on Special Input Distributions

Synchronization and Ordering Semantics in Hybrid MPI+GPU Programming

JolokiaC++: Optimizing Irregular Accesses for GPGPU

Data Transfer Matters for GPU Computing

Large-scale distributed sorting for GPU-based heterogeneous supercomputers