PhD Thesis on nnet ensembles

[renner@ecst.csuchico.edu]

Dear Connectionists, 

The following dissertation is now available on-line from

	http://www.ecst.csuchico.edu/~renner

		or directly from
   
	http://www.ecst.csuchico.edu/~renner/Diss/

   Improving Generalization of Constructive
   Neural Networks Using Ensembles

	   by

       R.S. Renner


ABSTRACT

  Ensemble networks have been receiving considerable attention 
within the last few years.  Most existing models are created
with linear networks.  Ensembles of linear networks have
demonstrated improved performance over individual networks,
but linear models have limited capacity problems.  Ensembles
of more complex well-trained networks offer a promising 
alternative.  Unfortunately, the computational expense
involved in training large numbers of well-trained networks 
may be prohibitive.
  An ensemble of non-linear feed-forward neural networks
generated by a constructive algorithm is presented.  The 
ensemble method presented exhibits better generalization
than linear ensembles, and shows promise toward a reduction in
time-complexity over well-trained ensembles.  The problems
addressed in this research are: generalization of non-linear
data, time-complexity, structural dilemmas, model creation,
and model combination.  The Neural Network Ensemble Simulator
(NNES) is also introduced as a simulation tool for managing
ensemble experiments.  NNES provides routines for ensemble
creation, selection, combination, and analysis.

Keywords: ensembles, constructive neural networks,
          generalization, Cascade-Correlation,
	  Surrogate Bayes Combination Method (SBCM),
	  Neural Network Ensemble Simulator (NNES).

NOTE: Files in directory are pdf format.  Please 
      notify me via email if you are unable to 
      read this format. 

Table of Contents is available in 'preface.pdf'


 __ __ __ __ __ __ __ __ __ __ __ __ __
/ // // // // // // // // // // // // /
\ \\ \\ \\ \\ \\ \\ \\ \\ \\ \\ \\ \\ \
 R.S. Renner, Ph.D.
 Assistant Professor, College of ECT
 California State Univeristy - Chico
 Department of Computer Science
 Chico, CA   95929-0410 
 (530)898-5419  fax: 5995
 www.ecst.csuchico.edu/~renner
 renner at ecst.csuchico.edu 
/ // // // // // // // // // // // // /
\ \\ \\ \\ \\ \\ \\ \\ \\ \\ \\ \\ \\ \