NDLI: VirtCL: a framework for OpenCL device abstraction and management

Content Provider	ACM Digital Library
Author	Chao, Yen-Ting Wu, Hen-Jung You, Yi-Ping Tsai, Yeh-Ning
Abstract	The interest in using multiple graphics processing units (GPUs) to accelerate applications has increased in recent years. However, the existing heterogeneous programming models (e.g., OpenCL) abstract details of GPU devices at the per-device level and require programmers to explicitly schedule their kernel tasks on a system equipped with multiple GPU devices. Unfortunately, multiple applications running on a multi-GPU system may compete for some of the GPU devices while leaving other GPU devices unused. Moreover, the distributed memory model defined in OpenCL, where each device has its own memory space, increases the complexity of managing the memory among multiple GPU devices. In this article we propose a framework (called VirtCL) that reduces the programming burden by acting as a layer between the programmer and the native OpenCL run-time system for abstracting multiple devices into a single virtual device and for scheduling computations and communications among the multiple devices. VirtCL comprises two main components: (1) a front-end library, which exposes primary OpenCL APIs and the virtual device, and (2) a back-end run-time system (called CLDaemon) for scheduling and dispatching kernel tasks based on a history-based scheduler. The front-end library forwards computation requests to the back-end CLDaemon, which then schedules and dispatches the requests. We also propose a history-based scheduler that is able to schedule kernel tasks in a contention- and communication-aware manner. Experiments demonstrated that the VirtCL framework introduced a small overhead (mean of 6%) but outperformed the native OpenCL run-time system for most benchmarks in the Rodinia benchmark suite, which was due to the abstraction layer eliminating the time-consuming initialization of OpenCL contexts. We also evaluated different scheduling policies in VirtCL with a real-world application (clsurf) and various synthetic workload traces. The results indicated that the VirtCL framework provides scalability for multiple kernel tasks running on multi-GPU systems.
Starting Page	161
Ending Page	172
Page Count	12
File Format	PDF
ISSN	03621340 15581160
DOI	10.1145/2858788.2688505
Journal	ACM SIGPLAN Notices (SIGP)
Volume Number	50
Issue Number	8
Language	English
Publisher	Association for Computing Machinery (ACM)
Publisher Date	1983-05-01
Publisher Place	New York
Access Restriction	One Nation One Subscription (ONOS)
Subject Keyword	Device abstraction Multitasking Opencl
Content Type	Text
Resource Type	Article
Subject	Computer Graphics and Computer-Aided Design Software

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

VirtCL: a framework for OpenCL device abstraction and management

Virtcl: a framework for opencl device abstraction and management (2016).

Achieving a single compute device image in OpenCL for multiple GPUs

Dynamic Resource Management for Efficient Utilization of Multitasking GPUs (SIGP, Vol. 52, Issue. 4)

Algorithms for translating Ada multitasking

Actra-a multitasking/multiprocessing smalltalk

Predicate abstraction for software verification

Algorithms for translating Ada multitasking ( SIGPLAN '80 )

Lazy abstraction

VirtCL: a framework for OpenCL device abstraction and management

Similar Documents

VirtCL: a framework for OpenCL device abstraction and management

Virtcl: a framework for opencl device abstraction and management (2016).

Achieving a single compute device image in OpenCL for multiple GPUs

Dynamic Resource Management for Efficient Utilization of Multitasking GPUs (SIGP, Vol. 52, Issue. 4)

Algorithms for translating Ada multitasking

Actra-a multitasking/multiprocessing smalltalk

Predicate abstraction for software verification

Algorithms for translating Ada multitasking ( SIGPLAN '80 )

Lazy abstraction

VirtCL: a framework for OpenCL device abstraction and management