Constructing Low-Order Discriminant Neural Networks Using Statistical Feature Selection

Content Provider	Semantic Scholar
Author	Henderson, Eric Kord Martinez, Tony R.
Copyright Year	2007
Abstract	CONSTRUCTING LOW-ORDER DISCRIMINANT NEURAL NETWORKS USING STATISTICAL FEATURE SELECTION The selection of relevant inputs, and determining an appropriate network topology, are two critical issues faced when applying neural networks to classification problems. This paper presents an algorithm called Pair Attribute Learning (PAL) for addressing both input selection, and the determination of network topology. The PAL algorithm uses a preprocessing stage to search for features derived from pairs of training instances. A statistical rank is used to select a good set of features, and these features are then used to drive the construction of a single hidden layer neural network. Only inputs relevant within the context of a feature are used in constructing the network. This results in a sparsely connected hidden layer, and lower-order discriminants. Results on nine learning problems demonstrate that PAL constructed networks are 70% less complex on average than networks built using other constructive techniques, without a significant loss of predictive accuracy. In addition, the PAL algorithm does not use iterative construction, or suffer from bias mismatch. Because it addresses both input selection and network topology, it provides an end-to-end solution for applying neural networks to classification problems.
Starting Page	27
Ending Page	56
Page Count	30
File Format	PDF HTM / HTML
DOI	10.1515/JISYS.2007.16.1.27
Volume Number	16
Alternate Webpage(s)	http://axon.cs.byu.edu/papers/henderson.jis2005.pdf
Alternate Webpage(s)	http://axon.cs.byu.edu/papers/henderson.jis2005
Alternate Webpage(s)	https://doi.org/10.1515/JISYS.2007.16.1.27
Language	English
Access Restriction	Open
Content Type	Text
Resource Type	Article