NDLI: Dynamic load balancing on GPU clusters for large-scale K-Means clustering

Content Provider	IEEE Xplore Digital Library
Author	Kijsipongse, E. U-ruekolan, S.
Copyright Year	2012
Description	Author affiliation: Large-Scale Simulation Research Laboratory, National Electronics and Computer Technology Center (NECTEC), 112 Thailand Science Park, Pahon Yothin Rd., Klong 1, Klong Luang, Pathumthani 12120 Thailand (Kijsipongse, E.; U-ruekolan, S.)
Abstract	K-Means is the clustering algorithm which is widely used in many areas such as information retrieval, computer vision and pattern recognition. With the recent advance in General Purpose Graphics Processing Unit (GPGPU), we can use a modern GPU which is capable to do computation up to Tflops to calculate K-Means clustering on average problems. However, due to the exponential growth of data, the K-Means clustering on a single GPU will not be adequate for large datasets in the near future. In this paper, we present the design and implementation of an efficient large-scale parallel K-Means on GPU clusters. We utilize the massive parallelism in GPUs to speed up the most time consuming part of K-Means clustering in each node. We employ the dynamic load balancing to distribute workload equally on different GPUs installed in the clusters so as to improve the performance of the parallel K-Means at the inter-node level. We also take advantage from software distributed shared memory to simplify the communication and collaboration among nodes. The result of the evaluation shows the performance improvement of the parallel K-Means by maintaining load balance on GPU clusters.
Starting Page	346
Ending Page	350
File Size	856233
Page Count	5
File Format	PDF
ISBN	9781467319201
e-ISBN	9781467319218
DOI	10.1109/JCSSE.2012.6261977
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2012-05-30
Publisher Place	Thailand
Access Restriction	Subscribed
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Performance evaluation Clustering algorithms Load management Arrays Kernel Graphics processing unit Message systems
Content Type	Text
Resource Type	Article

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Mapping of BLASTP Algorithm onto GPU Clusters

PLB-HeC: A Profile-Based Load-Balancing Algorithm for Heterogeneous CPU-GPU Clusters

Towards the Dynamic Load Balancing on Heterogeneous Multi-GPU Systems.

The GPU Enhanced Parallel Computing for Large Scale Data Clustering

Dynamic load balancing on heterogeneous multicore/multiGPU systems

A Load Distribution Algorithm Based on Profiling for Heterogeneous GPU Clusters

Exploring Fine-Grained Task-Based Execution on Multi-GPU Systems

K-means image segmentation on massively parallel GPU architecture

Implementation of Parallel 1-D FFT on GPU Clusters

Dynamic load balancing on GPU clusters for large-scale K-Means clustering

Similar Documents

Mapping of BLASTP Algorithm onto GPU Clusters

PLB-HeC: A Profile-Based Load-Balancing Algorithm for Heterogeneous CPU-GPU Clusters

Towards the Dynamic Load Balancing on Heterogeneous Multi-GPU Systems.

The GPU Enhanced Parallel Computing for Large Scale Data Clustering

Dynamic load balancing on heterogeneous multicore/multiGPU systems

A Load Distribution Algorithm Based on Profiling for Heterogeneous GPU Clusters

Exploring Fine-Grained Task-Based Execution on Multi-GPU Systems

K-means image segmentation on massively parallel GPU architecture

Implementation of Parallel 1-D FFT on GPU Clusters

Dynamic load balancing on GPU clusters for large-scale K-Means clustering