NDLI: Parallel implementation of artificial neural network training

Content Provider	IEEE Xplore Digital Library
Author	Scanzio, S. Cumani, S. Gemello, R. Mana, F. Laface, P.
Copyright Year	2010
Description	Author affiliation: Politecnico di Torino, Corso Duca degli Abruzzi 24, 10129, Italy (Scanzio, S.; Cumani, S.; Laface, P.) \|\| Loquendo S.pA., Via Olivetti 6, Torino 10148, Italy (Gemello, R.; Mana, F.)
Abstract	In this paper we describe the implementation of a complete ANN training procedure for speech recognition using the block mode back-propagation learning algorithm. We exploit the high performance SIMD architecture of GPU using CUDA and its C-like language interface. We also compare the speed-up obtained implementing the training procedure only taking advantage of the multi-thread capabilities of multi-core processors. Our approach has been tested by training acoustic models for large vocabulary speech recognition tasks, showing a 6 times reduction of the time required to train real-world large size networks with respect to an already optimized implementation using the Intel MKL libraries.
Starting Page	4902
Ending Page	4905
File Size	148917
Page Count	4
File Format	PDF
ISBN	9781424442959
ISSN	15206149
DOI	10.1109/ICASSP.2010.5495108
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2010-03-14
Publisher Place	USA
Access Restriction	Subscribed
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Artificial neural networks Hidden Markov models Speech recognition Feedforward systems Vocabulary State estimation Matrix converters Multicore processing Acoustic testing Libraries Fast Training Artificial Neural Network Focused Attention Back-Propagation GPU CUDA
Content Type	Text
Resource Type	Article

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Size matters: an empirical study of neural network training for large vocabulary continuous speech recognition

A neural network for 500 vocabulary word spotting using acoustic sub-word units

Context-Dependent Pre-Trained Deep Neural Networks for Large-Vocabulary Speech Recognition

Accelerating the Training of HTK on GPU with CUDA

Parallel Training of a Back-Propagation Neural Network Using CUDA

Neuron sparseness versus connection sparseness in deep neural network for large vocabulary speech recognition

Parallel implementation of neural networks training on graphic processing unit

Hidden Markov model/neural network training techniques for connected alphadigit speech recognition

RASR/NN: The RWTH neural network toolkit for speech recognition

Parallel implementation of artificial neural network training

Similar Documents

Size matters: an empirical study of neural network training for large vocabulary continuous speech recognition

A neural network for 500 vocabulary word spotting using acoustic sub-word units

Context-Dependent Pre-Trained Deep Neural Networks for Large-Vocabulary Speech Recognition

Accelerating the Training of HTK on GPU with CUDA

Parallel Training of a Back-Propagation Neural Network Using CUDA

Neuron sparseness versus connection sparseness in deep neural network for large vocabulary speech recognition

Parallel implementation of neural networks training on graphic processing unit

Hidden Markov model/neural network training techniques for connected alphadigit speech recognition

RASR/NN: The RWTH neural network toolkit for speech recognition

Parallel implementation of artificial neural network training