Squaring the activation function
MUMME%IDCSVAX.BITNET@CUNYVM.CUNY.EDU
MUMME%IDCSVAX.BITNET at CUNYVM.CUNY.EDU
Fri Sep 22 06:47:00 EDT 1989
****** CONNECTIONISTS ONLY DO NOT FORWARD *******
I have heard rumors that some people get faster learning in a Back-prop
network by passing the SQUARE of each unit's activation to the
following layer. If anyone has tried this and/or can refer me to articles
regarding this method and theories thereof, please let me know. I will
circulate the results of this inquiry to interested contributors.
Thanks!
Dean Mumme
***** CONNECTIONISTS ONLY DO NOT FORWARD ******
Dean C. Mumme bitnet: mumme at idcsvax
Dept. of Computer Science
University of Idaho
Moscow, ID 83843
More information about the Connectionists
mailing list