NDLI: Kernel Specialization for Improved Adaptability and Performance on Graphics Processing Units (GPUs)

Content Provider	IEEE Xplore Digital Library
Author	Moore, N. Leeser, M. Smith King, L.
Copyright Year	2013
Description	Author affiliation: Dept. of Math. & Comput. Sci., Coll. of the Holy Cross, Worcester, MA, USA (Smith King, L.) \|\| Dept. of Electr. & Comput. Eng., Northeastern Univ., Boston, MA, USA (Leeser, M.) \|\| MathWorks, Natick, MA, USA (Moore, N.)
Abstract	Graphics processing units (GPUs) offer significant speedups over CPUs for certain classes of applications. However, programming for GPUs is challenging. There are many parameters that affect performance and their values may change depending on both problem instance and GPU hardware specifics. In addition, most GPU kernels are compiled once; performance optimizations are applied at application compile time. As a result, many GPU libraries and programs have limited adaptability to variations among problem instances and hardware configurations. These factors limit code reuse and the applicability of GPU computing to a wider variety of problems. This paper introduces GPGPU kernel specialization, a technique used to describe highly adaptable kernels that exhibit high performance across a wide range of programmer variables as well as different generations of GPUs. We also introduce our GPU Prototyping Framework (GPU-PF) for dynamic runtime generation of customized GPU kernels incorporating both problem and implementation-specific parameters. GPU-PF fully separates the GPU and CPU code so the GPU code can be compiled during program execution once all the parameters are known. This work explores the implementation and parameterization of two real world applications targeting two generations of NVIDIA CUDA-enabled GPUs using kernel specialization and GPU-PF: large template matching and cone-beam image reconstruction via backprojection. Starting with high performance GPU kernels that compare favorably to multi-threaded reference implementations, kernel specialization is shown to increase adaptability while providing performance improvements including improved run time and reduction in resource usage. Kernel specialization offers productivity benefits, improved library code, and a means to increase the parameterizability of GPGPU implementations.
Sponsorship	IEEE Comput. Soc.
Starting Page	1037
Ending Page	1048
File Size	320094
Page Count	12
File Format	PDF
ISBN	9781467360661
ISSN	15302075
DOI	10.1109/IPDPS.2013.31
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2013-05-20
Publisher Place	USA
Access Restriction	Subscribed
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Kernel Graphics processing units Runtime Hardware Registers Optimization Libraries template matching GPU compilation performance
Content Type	Text
Resource Type	Article

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Online Performance Projection for Clusters with Heterogeneous GPUs

Optimizing strassen matrix multiply on GPUs

OpenCL Kernel Fusion for GPU, Xeon Phi and CPU

Double precision stencil computations on Kepler GPUs

Adaptable Two-Dimension Sliding Windows on NVIDIA GPUs with Runtime Compilation

Enabling preemptive multiprogramming on GPUs

Fast Implementation of General Matrix-Vector Multiplication (GEMV) on Kepler GPUs

KernelGen -- The Design and Implementation of a Next Generation Compiler Platform for Accelerating Numerical Models on GPUs

High performance multi-dimensional (2D/3D) FFT-Shift implementation on Graphics Processing Units (GPUs)

Kernel Specialization for Improved Adaptability and Performance on Graphics Processing Units (GPUs)

Similar Documents

Online Performance Projection for Clusters with Heterogeneous GPUs

Optimizing strassen matrix multiply on GPUs

OpenCL Kernel Fusion for GPU, Xeon Phi and CPU

Double precision stencil computations on Kepler GPUs

Adaptable Two-Dimension Sliding Windows on NVIDIA GPUs with Runtime Compilation

Enabling preemptive multiprogramming on GPUs

Fast Implementation of General Matrix-Vector Multiplication (GEMV) on Kepler GPUs

KernelGen -- The Design and Implementation of a Next Generation Compiler Platform for Accelerating Numerical Models on GPUs

High performance multi-dimensional (2D/3D) FFT-Shift implementation on Graphics Processing Units (GPUs)

Kernel Specialization for Improved Adaptability and Performance on Graphics Processing Units (GPUs)