Preprint available

LIN2%YKTVMZ.BITNET@CUNYVM.CUNY.EDU LIN2%YKTVMZ.BITNET at CUNYVM.CUNY.EDU
Mon Oct 23 17:11:01 EDT 1989


*********  FOR CONNECTIONISTS ONLY - PLEASE DO NOT FORWARD  ***********
****************  TO OTHER BBOARDS/ELECTRONIC MEDIA *******************

The following preprint is available.  If you would like a copy,
please send a note to

                  lin2 @ ibm.com

CONTAINING *ONLY* THE INFORMATION ON THE FOLLOWING FOUR LINES (to
allow semi-automated handling of your request):

*IJ*
Your Name
Your Address (each line not
 beyond column 33)



                     Designing a Sensory Processing System:
                            What Can Be Learned from
                         Principal Components Analysis?


                                 Ralph Linsker


                  IBM Research, T. J. Watson Research Center,
                           Yorktown Heights, NY 10598


          Principal  components analysis  (PCA) is  a useful  tool for
          understanding  some  feature-analyzing properties  of  cells
          found in at least the first few stages of a sensory process-
          ing pathway.  However, the relationships between the results
          obtained using PCA, and those obtained using a Hebbian model
          or an information-theoretic  optimization principle, are not
          as direct or clear-cut as sometimes thought.

          These points  are illustrated  for the formation  of center-
          surround  and  orientation-selective  cells.   For  a  model
          "cell" having spatially  localized connections, the relevant
          PCA eigenfunction problem is shown  to be separable in polar
          coordinates.  As  a result, the principal  components have a
          radially sectored  (or "pie-slice") geometric form,  and (in
          the absence  of additional  degeneracies) do  *not* resemble
          classic Hubel-Wiesel  "simple" cells,  except for  the (odd-
          symmetry) eigenmodes that have  exactly two sectors of oppo-
          site   sign.   However,   for   suitable  input   covariance
          functions, one  can construct  model "cells"  of simple-cell
          type --  which are in  general not PCA eigenfunctions  -- as
          particular  linear combinations  of  the  first few  leading
          principal components.

          A connection between  PCA and a criterion  for the minimiza-
          tion of a geometrically-weighted mean squared reconstruction
          error is also derived.

          This paper covers in greater detail  one of the topics to be
          discussed in an invited talk  at the IJCNN Winter 1990 Meet-
          ing (Washington,  DC, Jan. 1990).   It will be  published in
          the conference  proceedings.  The  paper itself  contains no
          abstract; the  above is  a brief  summary prepared  for this
          preprint availability notice.



More information about the Connectionists mailing list