NDLI: Productive Programming of GPU Clusters with OmpSs

Content Provider	IEEE Xplore Digital Library
Author	Bueno, J. Planas, J. Duran, A. Badia, R.M. Martorell, X. Ayguade, E. Labarta, J.
Copyright Year	2012
Abstract	Clusters of GPUs are emerging as a new computational scenario. Programming them requires the use of hybrid models that increase the complexity of the applications, reducing the productivity of programmers. We present the implementation of OmpSs for clusters of GPUs, which supports asynchrony and heterogeneity for task parallelism. It is based on annotating a serial application with directives that are translated by the compiler. With it, the same program that runs sequentially in a node with a single GPU can run in parallel in multiple GPUs either local (single node) or remote (cluster of GPUs). Besides performing a task-based parallelization, the runtime system moves the data as needed between the different nodes and GPUs minimizing the impact of communication by using affinity scheduling, caching, and by overlapping communication with the computational task. We show several applications programmed with OmpSs and their performance with multiple GPUs in a local node and in remote nodes. The results show good tradeoff between performance and effort from the programmer.
Starting Page	557
Ending Page	568
File Size	697687
Page Count	12
File Format	PDF
ISBN	9781467309752
ISSN	15302075
DOI	10.1109/IPDPS.2012.58
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2012-05-21
Publisher Place	China
Access Restriction	Subscribed
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Graphics processing unit Runtime Computer architecture Kernel Programming Message systems Coherence OpenMP Cluster programming GPGPU computing accelerators
Content Type	Text
Resource Type	Article

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

An OpenMP Compiler for Hybrid CPU/GPU Computing Architecture

Mapping of BLASTP Algorithm onto GPU Clusters

Enabling Mixed OpenMP/MPI Programming on Hybrid CPU/GPU Computing Architecture

2D-FMFI SAR application on HPC architectures with OmpSs parallel programming model

accULL: An User-directed Approach to Heterogeneous Programming

CPU+GPU Programming of Stencil Computations for Resource-Efficient Use of GPU Clusters

A package for OpenCL based heterogeneous computing on clusters with many GPU devices

GMH: A Message Passing Toolkit for GPU Clusters

OpenCL: Make Ubiquitous Supercomputing Possible

Productive Programming of GPU Clusters with OmpSs

Similar Documents

An OpenMP Compiler for Hybrid CPU/GPU Computing Architecture

Mapping of BLASTP Algorithm onto GPU Clusters

Enabling Mixed OpenMP/MPI Programming on Hybrid CPU/GPU Computing Architecture

2D-FMFI SAR application on HPC architectures with OmpSs parallel programming model

accULL: An User-directed Approach to Heterogeneous Programming

CPU+GPU Programming of Stencil Computations for Resource-Efficient Use of GPU Clusters

A package for OpenCL based heterogeneous computing on clusters with many GPU devices

GMH: A Message Passing Toolkit for GPU Clusters

OpenCL: Make Ubiquitous Supercomputing Possible

Productive Programming of GPU Clusters with OmpSs