NDLI: Solving the local minimum and flat-spot problem by modifying wrong outputs for feed-forward neural networks

Content Provider	IEEE Xplore Digital Library
Author	Chi-Chung Cheung Lui, A.K. Xu, S.S.
Copyright Year	2013
Description	Author affiliation: Dept. of Electron. & Inf. Eng., Hong Kong Polytech. Univ., Hong Kong, China (Chi-Chung Cheung) \|\| Sch. of Sci. & Technol., Open Univ. of Hong Kong, Hong Kong, China (Lui, A.K.; Xu, S.S.)
Abstract	Backpropagation (BP) algorithm, which is very popular in supervised learning, is extensively applied in training feed-forward neural networks. Many modifications have been proposed to speed up the convergence process of the standard BP algorithm. However, they seldom focus on improving the global convergence capability. This paper proposes a new algorithm called Wrong Output Modification (WOM) to improve the global convergence capability of a fast learning algorithm. When a learning process is trapped by a local minimum or a flat-spot area, this algorithm looks for some outputs that go to other extremes when compared with their target outputs, and then it modifies such outputs systemically so that they can get close to their target outputs and hence some weights of neurons are changed accordingly. It is hoped that these changes make the learning process escape from such local minima or flat-spot areas and then converge. The performance investigation shows that the proposed algorithm can be applied into different fast learning algorithms, and their global convergence capabilities are improved significantly compared with their original algorithms. Moreover, some statistical data obtained from this algorithm can be used to identify the difficulty of a learning problem.
Starting Page	1
Ending Page	7
File Size	339212
Page Count	7
File Format	PDF
ISSN	21614407
e-ISBN	9781467361293
DOI	10.1109/IJCNN.2013.6706913
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	2013-08-04
Publisher Place	USA
Access Restriction	Subscribed
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Convergence Breast cancer Equations Standards Backpropagation Training Educational institutions
Content Type	Text
Resource Type	Article

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Further enhancements in WOM algorithm to solve the local minimum and flat-spot problem in feed-forward neural networks

Improving the Quickprop algorithm

Mammogram Analysis Using Feed-Forward Back Propagation and Cascade-Forward Back Propagation Artificial Neural Network

A new fast learning algorithm with promising global convergence capability for feed-forward neural networks

A hardware training device for forward feed hidden neural networks

Voltage stability monitoring based on Feed Forward and Layer Recurrent Neural Networks

Hybrid algorithm for training feed-forward neural networks using PSO-information gain with back propagation algorithm

Unsupervised, smooth training of feed-forward neural networks for mismatch compensation

Stochastic weight update in the backpropagation algorithm on feed-forward neural networks

Solving the local minimum and flat-spot problem by modifying wrong outputs for feed-forward neural networks

Similar Documents

Further enhancements in WOM algorithm to solve the local minimum and flat-spot problem in feed-forward neural networks

Improving the Quickprop algorithm

Mammogram Analysis Using Feed-Forward Back Propagation and Cascade-Forward Back Propagation Artificial Neural Network

A new fast learning algorithm with promising global convergence capability for feed-forward neural networks

A hardware training device for forward feed hidden neural networks

Voltage stability monitoring based on Feed Forward and Layer Recurrent Neural Networks

Hybrid algorithm for training feed-forward neural networks using PSO-information gain with back propagation algorithm

Unsupervised, smooth training of feed-forward neural networks for mismatch compensation

Stochastic weight update in the backpropagation algorithm on feed-forward neural networks

Solving the local minimum and flat-spot problem by modifying wrong outputs for feed-forward neural networks