NDLI: Fine-grained resource sharing for concurrent GPGPU kernels

Please wait, while we are loading the content...

Parallel programming for the web

A case for parallelizing web pages

For extreme parallelism, your OS is Sooooo last-millennium

Operating systems should manage accelerators

Parallel closures: a new twist on an old idea

"Simultaneous" Considered harmful: modular parallelism (deprecating "locks", "semaphores", serializability, and other sequential thinking)

Disciplined concurrent programming using tasks with effects

HydraVM: extracting parallelism from legacy sequential code using STM

Parallelization by simulated tunneling

Fine-grained resource sharing for concurrent GPGPU kernels

Do we need a crystal ball for task migration?

A template library to integrate thread scheduling and locality management for NUMA multiprocessors

Retrofitted parallelism considered grossly sub-optimal

Parakeet: a just-in-time parallel accelerator for python

Concurrency attacks

CONCURRIT: testing concurrent programs with programmable state-space exploration

Understanding the interleaving-space overlap across inputs and software versions

Fine-grained resource sharing for concurrent GPGPU kernels

Content Provider	ACM Digital Library
Author	Gregg, Chris Hazelwood, Kim Dorn, Jonathan Skadron, Kevin
Abstract	General purpose GPU (GPGPU) programming frameworks such as OpenCL and CUDA allow running individual computation kernels sequentially on a device. However, in some cases it is possible to utilize device resources more efficiently by running kernels concurrently. This raises questions about load balancing and resource allocation that have not previously warranted investigation. For example, what kernel characteristics impact the optimal partitioning of resources among concurrently executing kernels? Current frameworks do not provide the ability to easily run kernels concurrently withne-grained and dynamic control over resource partitioning. We present KernelMerge, a kernel scheduler that runs two OpenCL kernels concurrently on one device. KernelMerge furnishes a number of settings that can be used to survey concurrent or single kernel configurations, and to investigate how kernels interact and influence each other, or themselves. KernelMerge provides a concurrent kernel scheduler compatible with the OpenCL API. We present an argument on the benefits of running kernels concurrently. We demonstrate how to use KernelMerge to increase throughput for two kernels that efficiently use device resources when run concurrently, and we establish that some kernels show worse performance when running concurrently. We also outline a method for using KernelMerge to investigate how concurrent kernels influence each other, with the goal of predicting runtimes for concurrent execution from individual kernel runtimes. Finally, we suggest GPU architectural changes that would improve such concurrent schedulers in the future.
Starting Page	10
Ending Page	10
Page Count	1
Language	English
Publisher	Association for Computing Machinery (ACM)
Publisher Date	2012-06-07
Access Restriction	Subscribed
Content Type	Text
Resource Type	Article

Central Library (ISO-9001:2015 Certified)
Indian Institute of Technology Kharagpur
Kharagpur, West Bengal, India | PIN - 721302

See location in the Map
03222 282435
Mail: support@ndl.gov.in

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in