NDLI: Improved training of cellular SRN using Unscented Kalman Filtering for ADP

Content Provider	IEEE Xplore Digital Library
Author	Vidyaratne, L. Alam, M. Anderson, J.K. Iftekharuddin, K.M.
Copyright Year	2014
Description	Author affiliation: Vision Lab. at Dept. of Electr. & Comput. Eng., Old Dominion Univ., Norfolk, VA, USA (Vidyaratne, L.; Alam, M.; Iftekharuddin, K.M.) \|\| Dept. of Electr. & Comput. Eng., Univ. of Memphis, Memphis, TN, USA (Anderson, J.K.)
Abstract	Cellular Simultaneous Recurrent Network (CSRN) is a unique type of recurrent networks that is designed to solve complex optimization problems. This network has already shown to successfully solve many challenging problems such as 2D maze navigation, image registration and affine transformation, game of go, and power system voltage profile prediction. One of the main challenges of using a complex network structure as CSRN is to efficiently train the network. Many representative training algorithms such as Back-propagation Through Time (BPTT), Extended Kalman Filtering (EKF) and Particle Swarm Optimization (PSO) have been used to train CSRN. Our prior works with CSRN suggest that for large number of network inputs, which is very common for large scale maze and image data, computational complexity of computing Jacobian in EKF training becomes prohibitive. In this paper, we propose Unscented Kalman Filter (UKF) for the training of CSRN to avoid computing Jacobian. We show that CSRN trained with UKF can solve the 2D maze traversal problem with better convergence rate than that of EKF. We also report preliminary results on binary image affine transformation wherein CSRN trained with UKF offers comparable performance to that of EKF. A comparison has been obtained between CSRN with GMLP core versus an Elman core trained with UKF for Affine transform results. Finally, we show that for more complex applications such as large scale image processing, UKF is much faster than EKF in training CSRN.
Starting Page	993
Ending Page	1000
File Size	3150083
Page Count	8
File Format	PDF
ISSN	21614407
e-ISBN	9781479914845
DOI	10.1109/IJCNN.2014.6889843
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2014-07-06
Publisher Place	China
Access Restriction	Subscribed
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Training Kalman filters Neural networks Jacobian matrices Function approximation Equations Mathematical model
Content Type	Text
Resource Type	Article

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in