Preprint available
LIN2%YKTVMZ.BITNET@CUNYVM.CUNY.EDU
LIN2%YKTVMZ.BITNET at CUNYVM.CUNY.EDU
Mon Oct 23 17:11:01 EDT 1989
********* FOR CONNECTIONISTS ONLY - PLEASE DO NOT FORWARD ***********
**************** TO OTHER BBOARDS/ELECTRONIC MEDIA *******************
The following preprint is available. If you would like a copy,
please send a note to
lin2 @ ibm.com
CONTAINING *ONLY* THE INFORMATION ON THE FOLLOWING FOUR LINES (to
allow semi-automated handling of your request):
*IJ*
Your Name
Your Address (each line not
beyond column 33)
Designing a Sensory Processing System:
What Can Be Learned from
Principal Components Analysis?
Ralph Linsker
IBM Research, T. J. Watson Research Center,
Yorktown Heights, NY 10598
Principal components analysis (PCA) is a useful tool for
understanding some feature-analyzing properties of cells
found in at least the first few stages of a sensory process-
ing pathway. However, the relationships between the results
obtained using PCA, and those obtained using a Hebbian model
or an information-theoretic optimization principle, are not
as direct or clear-cut as sometimes thought.
These points are illustrated for the formation of center-
surround and orientation-selective cells. For a model
"cell" having spatially localized connections, the relevant
PCA eigenfunction problem is shown to be separable in polar
coordinates. As a result, the principal components have a
radially sectored (or "pie-slice") geometric form, and (in
the absence of additional degeneracies) do *not* resemble
classic Hubel-Wiesel "simple" cells, except for the (odd-
symmetry) eigenmodes that have exactly two sectors of oppo-
site sign. However, for suitable input covariance
functions, one can construct model "cells" of simple-cell
type -- which are in general not PCA eigenfunctions -- as
particular linear combinations of the first few leading
principal components.
A connection between PCA and a criterion for the minimiza-
tion of a geometrically-weighted mean squared reconstruction
error is also derived.
This paper covers in greater detail one of the topics to be
discussed in an invited talk at the IJCNN Winter 1990 Meet-
ing (Washington, DC, Jan. 1990). It will be published in
the conference proceedings. The paper itself contains no
abstract; the above is a brief summary prepared for this
preprint availability notice.
More information about the Connectionists
mailing list