NDLI: Optimal linear combinations of neural networks: an overview

Content Provider	IEEE Xplore Digital Library
Author	Hashem, S. Schmeiser, B. Yih, Y.
Copyright Year	1994
Description	Author affiliation: Sch. of Ind. Eng., Purdue Univ., West Lafayette, IN, USA (Hashem, S.; Schmeiser, B.; Yih, Y.)
Abstract	Neural networks based modeling often involves trying multiple networks with different architectures and/or training parameters in order to achieve acceptable model accuracy. Typically, one of the trained NNs is chosen as best, while the rest are discarded. Hashem and Schmeiser (1992) propose using optimal linear combinations of a number of trained neural networks instead of using a single best network. In this paper, we discuss and extend the idea of optimal linear combinations of neural networks. Optimal linear combinations are constructed by forming weighted sums of the corresponding outputs of the networks. The combination-weights are selected to minimize the mean squared error with respect to the distribution of random inputs. Combining the trained networks may help integrate the knowledge acquired by the component networks and thus improve model accuracy. We investigate some issues concerning the estimation of the optimal combination-weights and the role of the optimal linear combination in improving model accuracy for both well-trained and poorly trained component networks. Experimental results based on simulated data are included. For our examples, the model accuracy resulting from using estimated optimal linear combinations is better than that of the best trained network and that of the simple averaging of the outputs of the component networks.
Starting Page	1507
Ending Page	1512
File Size	531199
Page Count	6
File Format	PDF
ISBN	078031901X
DOI	10.1109/ICNN.1994.374511
Language	English
Publisher	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Publisher Date	1994-06-28
Publisher Place	USA
Access Restriction	Subscribed
Rights Holder	Institute of Electrical and Electronics Engineers, Inc. (IEEE)
Subject Keyword	Neural networks Statistics Voting Industrial engineering Intelligent networks Industrial training Ear Psychology Function approximation Context modeling
Content Type	Text
Resource Type	Article

Sl.	Authority	Responsibilities	Communication Details
1	Ministry of Education (GoI), Department of Higher Education	Sanctioning Authority	https://www.education.gov.in/ict-initiatives
2	Indian Institute of Technology Kharagpur	Host Institute of the Project: The host institute of the project is responsible for providing infrastructure support and hosting the project	https://www.iitkgp.ac.in
3	National Digital Library of India Office, Indian Institute of Technology Kharagpur	The administrative and infrastructural headquarters of the project	Dr. B. Sutradhar bsutra@ndl.gov.in
4	Project PI / Joint PI	Principal Investigator and Joint Principal Investigators of the project	Dr. B. Sutradhar bsutra@ndl.gov.in Prof. Saswat Chakrabarti will be added soon
5	Website/Portal (Helpdesk)	Queries regarding NDLI and its services	support@ndl.gov.in
6	Contents and Copyright Issues	Queries related to content curation and copyright issues	content@ndl.gov.in
7	National Digital Library of India Club (NDLI Club)	Queries related to NDLI Club formation, support, user awareness program, seminar/symposium, collaboration, social media, promotion, and outreach	clubsupport@ndl.gov.in
8	Digital Preservation Centre (DPC)	Assistance with digitizing and archiving copyright-free printed books	dpc@ndl.gov.in
9	IDR Setup or Support	Queries related to establishment and support of Institutional Digital Repository (IDR) and IDR workshops	idr@ndl.gov.in

Choice of the radial basis function approximation in neural networks used for fuzzy system implementation

Improving model accuracy using optimal linear combinations of trained neural networks

Locating the centers in an RBF network

Algorithms for optimal linear combinations of neural networks

Linear feedforward neural network classifiers and reduced-rank approximation

An adjustable model for linear to nonlinear regression

The BP neural networks with data clustering enhancement-an emerging optimization tool

Optimal sizing of feedforward neural networks: Case studies

Synthesis of intelligent antenna array using radial basis function networks

Optimal linear combinations of neural networks: an overview

Similar Documents

Choice of the radial basis function approximation in neural networks used for fuzzy system implementation

Improving model accuracy using optimal linear combinations of trained neural networks

Locating the centers in an RBF network

Algorithms for optimal linear combinations of neural networks

Linear feedforward neural network classifiers and reduced-rank approximation

An adjustable model for linear to nonlinear regression

The BP neural networks with data clustering enhancement-an emerging optimization tool

Optimal sizing of feedforward neural networks: Case studies

Synthesis of intelligent antenna array using radial basis function networks

Optimal linear combinations of neural networks: an overview