NDLI: GPU-enabled back-propagation artificial neural network for digit recognition in parallel

Content Provider	Springer Nature Link
Author	Brito, Ricardo Fong, Simon Cho, Kyungeun Song, Wei Wong, Raymond Mohammed, Sabah Fiaidhi, Jinan
Copyright Year	2016
Abstract	In this paper, we show that the GPU (graphics processing unit) can be used not only for processing graphics, but also for high speed computing. We provide a comparison between the times taken on the CPU and GPU to perform the training and testing of a back-propagation artificial neural network. We implemented two neural networks for recognizing handwritten digits; one consists of serial code executed on the CPU, while the other is a GPU-based version of the same system which executes in parallel. As an experiment for performance evaluation, a system for neural network training on the GPU is developed to reduce training time. The programming environment that the system is based on is CUDA which stands for compute unified device architecture, which allows a programmer to write code that will run on an NVIDIA GPU card. Our results over an experiment of digital image recognition using neural network confirm the speed-up advantages by tapping on the resources of GPU. Our proposed model has an advantage of simplicity, while it shows on par performance with the state-of-the-arts algorithms.
Starting Page	3868
Ending Page	3886
Page Count	19
File Format	PDF
ISSN	09208542
Journal	The Journal of Supercomputing
Volume Number	72
Issue Number	10
e-ISSN	15730484
Language	English
Publisher	Springer US
Publisher Date	2016-02-10
Publisher Place	New York
Access Restriction	One Nation One Subscription (ONOS)
Subject Keyword	Artificial neural networks Parallel execution NVIDIA CUDA Programming Languages, Compilers, Interpreters Processor Architectures Computer Science
Content Type	Text
Resource Type	Article
Subject	Theoretical Computer Science Information Systems Hardware and Architecture Software

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Towards implementation of residual-feedback GMDH neural network on parallel GPU memory guided by a regression curve

Accelerating 2D orthogonal matching pursuit algorithm on GPU

Design and evaluation of multi-GPU enabled Multiple Symbol Detection algorithm

An efficient parallel collaborative filtering algorithm on multi-GPU platform

Performance modeling and optimization of sparse matrix-vector multiplication on NVIDIA CUDA platform

A comparative study of GPU programming models and architectures using neural networks

Dual-execution mode processor architecture

Parallel medical image reconstruction: from graphics processing units (GPU) to Grids

Tuning remote GPU virtualization for InfiniBand networks

GPU-enabled back-propagation artificial neural network for digit recognition in parallel

Similar Documents

Towards implementation of residual-feedback GMDH neural network on parallel GPU memory guided by a regression curve

Accelerating 2D orthogonal matching pursuit algorithm on GPU

Design and evaluation of multi-GPU enabled Multiple Symbol Detection algorithm

An efficient parallel collaborative filtering algorithm on multi-GPU platform

Performance modeling and optimization of sparse matrix-vector multiplication on NVIDIA CUDA platform

A comparative study of GPU programming models and architectures using neural networks

Dual-execution mode processor architecture

Parallel medical image reconstruction: from graphics processing units (GPU) to Grids

Tuning remote GPU virtualization for InfiniBand networks

GPU-enabled back-propagation artificial neural network for digit recognition in parallel