Introduction to RBF networks plus Matlab package

Mark Orr mjo at cns.ed.ac.uk
Wed Apr 10 09:12:20 EDT 1996


Announcing the availability of the following resources on the
World Wide Web at URL http://www.cns.ed.ac.uk/people/mark.html.



                Introduction to RBF Networks
                ----------------------------

    A 67 page introduction to linear feed-forward neural
    networks for supervised learning, such as radial basis
    function networks, where there is a single hidden layer
    and the only parameters that change during learning are
    the weights from the hidden units to the outputs.

    But more importantly it covers "nearly linear" networks:
    networks which, though nonlinear (because learning affects
    more than just the hidden-to-output weights) can still be
    analysed with simple mathematics (linear algebra) and which
    don't need compute intensive gradient descent methods to learn.
    This applies to RBF networks with local ridge regression or
    which use regularised forward selection to build the hidden
    layer. These techniques, in conjunction with leave-one-out or
    generalised cross-validation, are covered in detail.

    Available in PostScript or hyper-text.



                     Matlab Routines for
                     -------------------
            Subset Selection and Ridge Regression
            -------------------------------------
                  in Linear Neural Networks
                  -------------------------

    A package of Matlab routines implementing regularised or
    unregularised forward subset selection and global or local
    ridge regression in linear networks such as radial basis
    function networks. Comes with a 45 page user manual with
    plenty of examples.

    Available as a compressed unix tape archive (.tar file).



The author would like to acknowledge support from the UK Joint
Councils Initiative in Human Computer Interaction and Cognitive
Science under grant G9213375, "Designing Systems of Coupled Networks".

Mark Orr
mark at cns.ed.ac.uk


More information about the Connectionists mailing list