preprint (fwd)

[Benny Lautrup]

The preprint announced below has not yet arrived in archive.cis.ohio-state.edu
It may be retrieved through anonymous ftp from connect.nbi.dk (129.142.100.17)
in the neuroprose directory. 

> 
> The following preprint is now available:
> 
> FTP-host: archive.cis.ohio-state.edu
> FTP-file: pub/neuroprose/hertz.nonlin.ps.Z
> 
> Authors:  J. Hertz, A. Krogh, B. Lautrup and T. Lehmann
> 
> Title: Non-Linear Back-propagation: Doing Back-Propagation without
>        Derivatives of the Activation Function.
> 
> Size:  13 pages
> 
> Abstract:
> 
> The conventional linear back-propagation algorithm is replaced by a  non-linear
> version, which avoids the necessity  for  calculating  the  derivative  of  the
> activation function. This may be exploited in hardware realizations  of  neural
> processors. In this paper we derive the non-linear back-propagation  algorithms
> in the framework of  recurrent  back-propagation  and  present  some  numerical
> simulations of feed-forward networks on the NetTalk problem.  A  discussion  of
> implementation in analog VLSI electronics concludes the paper.
> 


--
Benny Lautrup, professor
Computational Neural Network Center (CONNECT)
Niels Bohr Institute
Blegdamsvej 17
2100 Copenhagen
Denmark

Telephone: +45-3532-5200
Direct:    +45-3532-5358
Fax:       +45-3142-1016
e-mail:    lautrup at connect.nbi.dk