Squaring the activation function

MUMME%IDCSVAX.BITNET@CUNYVM.CUNY.EDU MUMME%IDCSVAX.BITNET at CUNYVM.CUNY.EDU
Fri Sep 22 06:47:00 EDT 1989


******  CONNECTIONISTS ONLY  DO NOT FORWARD *******
I have heard rumors that some people get faster learning in a Back-prop
network by passing the SQUARE of each unit's activation to the
following layer.  If anyone has tried this and/or can refer me to articles
regarding this method and theories thereof, please let me know.  I will
circulate the results of this inquiry to interested contributors.

Thanks!
Dean Mumme
*****  CONNECTIONISTS ONLY  DO NOT FORWARD ******

Dean C. Mumme                         bitnet:  mumme at idcsvax
Dept. of Computer Science
University of Idaho
Moscow, ID 83843


More information about the Connectionists mailing list