Paper available in Neuroprose
Kurt Hornik
hornik at ci.tuwien.ac.at
Mon Jul 18 09:10:00 EDT 1994
FTP-host: archive.cis.ohio-state.edu
FTP-file: pub/neuroprose/baldi.linear.ps.Z
*** DO NOT FORWARD TO OTHER GROUPS ***
The file baldi.linear.ps.Z is now available for copying from the
Neuroprose repository:
A survey of learning in linear neural networks (24 pages)
Pierre Baldi (Caltech) && Kurt Hornik (TU Wien, Austria)
ABSTRACT:
Networks of linear units are the simplest kind of networks, where
the basic questions related to learning, generalization, and
self-organisation can sometimes be answered analytically. We survey
most of the known results on linear networks, including: (1)
back-propagation learning and the structure of the error function
landscape; (2) the temporal evolution of generalization; (3)
unsupervised learning algorithms and their properties. The
connections to classical statistical ideas, such as principal
component analysis (PCA), are emphasized as well as several simple
but challenging open questions. A few new results are also
spread across the paper, including an analysis of the effect of
noise on back-propagation networks and a unified view of all
unsupervised algorithms.
-Kurt Hornik (Kurt.Hornik at ci.tuwien.ac.at)
More information about the Connectionists
mailing list