Survey Paper on Constructive Neural Networks

[Dit-Yan Yeung]

Paper (81596 bytes in gziped PS):
  ftp://ftp.cs.ust.hk/pub/techreport/95/tr95-43.ps.gz

*******************************************************************************

                   Constructive Feedforward Neural Networks
                      for Regression Problems: A Survey

                         Tin-Yau Kwok & Dit-Yan Yeung

                        Department of Computer Science
                Hong Kong University of Science and Technology
                           Clear Water Bay, Kowloon
                                  Hong Kong
                          {jamesk,dyyeung}@cs.ust.hk

                        Technical Report HKUST-CS95-43

                                September 1995


                                   ABSTRACT

In this paper, we review the procedures for constructing feedforward neural
networks in regression problems.  While standard back-propagation performs
gradient descent only in the weight space of a network with fixed topology,
constructive procedures start with a small network and then grow additional
hidden units and weights until a satisfactory solution is found.  The
constructive procedures are categorized according to the resultant network
architecture and the learning algorithm for the network weights.

*******************************************************************************