NDLI: Emulation of Spline Networks Through Approximation of Polynomials and Step Function of Neural Networks with Cosine Modulated Symmetric Exponential Function

Content Provider	Springer Nature Link
Author	Lee, Sang Wha Song, Hae Sang
Copyright Year	2014
Abstract	This study proves that the neural network, using the cosine modulated symmetric exponential function which is a non-monotonic function, can emulate the spline networks by approximating the polynomials and step functions. This means that the network with cosine modulated symmetric exponential function is equivalent to the spline networks. It is also equivalent to the neural network, which uses sigmoidal, hyperbolic tangent, and Gaussian activation function, as proved by DasGupta and Schnitger. In the multi-network structure, the cosine modulated symmetric exponential function has the capability to make more local hills than any other functions. In the neural network that uses this function, it has the capability to quickly localize the input space pattern, even though it makes a fewer number of layers. On the other hand, the monotonic function needs a greater number of layers to make these local hills. Therefore, in the training for the pattern classification of the neural network, we need a greater number of units and epochs. This is connected to the training speed of the neural network for the pattern classification, which also indicates the capabilities of the network. For the capacity test of the pattern classification in the cosine modulated symmetric exponential function, we have used the Cascade-Correlation neural network. Cascade-Correlation is a supervised learning algorithm that automatically determines the size and topology of the network. The Cascade-Correlation adds new hidden units one by one and creates a multi-layer structure in which each unit is in a hidden layer. In this experiment, the two benchmark problems have been used: one is the iris plant classification problem; the other is the tic-tac-toe endgame problem. The results are compared with those obtained with other activation functions. In this experiment, the evaluation items, such as the number of epochs, produced hidden units, listing of the run time, and the average crossings per second of ten trials on the training set of the problem, have been compared. For instance, In the experiment of the iris plants classification problem, the CosExp function has recorded about 53 % of the average epochs number when compared to the sigmoid function, and for the number of the hidden units, it is approximately 54 %. In the tic-tac-toe problem experiment, the average number of epochs and hidden units produced during the process has been reduced approximately by one thirds more with the CosExp function than with other activation functions. Accordingly, learning has been improved three times faster. The results of the experiments show that performance can be improved very significantly by using the cosine modulated symmetric exponential function as the activation function in neural networks with a predetermined set of parameters.
Starting Page	2579
Ending Page	2594
Page Count	16
File Format	PDF
ISSN	09296212
Journal	Wireless Personal Communications
Volume Number	79
Issue Number	4
e-ISSN	1572834X
Language	English
Publisher	Springer US
Publisher Date	2014-02-27
Publisher Place	Boston
Access Restriction	One Nation One Subscription (ONOS)
Subject Keyword	Cascade-Correlation algorithm Activation function Polynomial and step function Iris plant classification problem Tic-tac-toe endgame problem Communications Engineering, Networks Signal, Image and Speech Processing Computer Communication Networks
Content Type	Text
Resource Type	Article
Subject	Electrical and Electronic Engineering Computer Science Applications

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Generalized Exponential Euler Polynomials and Exponential Splines

Explicit Properties of q-Cosine and q-Sine Euler Polynomials Containing Symmetric Structures

Quantum Tic-Tac-Toe: A Genuine Probabilistic Approach

Playing Tic-Tac-Toe Using Genetic Neural Network with Double Transfer Functions

Telephone Tic-Tac-Toe

Play Tic-Tac-Toe Ambidextrously

Optimized Custom Precision Function Evaluation for Embedded Processors

Block-symmetric polynomials correlate with parity better than symmetric

Flexible Strategy Use in Soar’s Tic-Tac-Toe

Emulation of Spline Networks Through Approximation of Polynomials and Step Function of Neural Networks with Cosine Modulated Symmetric Exponential Function

Similar Documents

Generalized Exponential Euler Polynomials and Exponential Splines

Explicit Properties of q-Cosine and q-Sine Euler Polynomials Containing Symmetric Structures

Quantum Tic-Tac-Toe: A Genuine Probabilistic Approach

Playing Tic-Tac-Toe Using Genetic Neural Network with Double Transfer Functions

Telephone Tic-Tac-Toe

Play Tic-Tac-Toe Ambidextrously

Optimized Custom Precision Function Evaluation for Embedded Processors

Block-symmetric polynomials correlate with parity better than symmetric

Flexible Strategy Use in Soar’s Tic-Tac-Toe

Emulation of Spline Networks Through Approximation of Polynomials and Step Function of Neural Networks with Cosine Modulated Symmetric Exponential Function