Pre-Print Available in Neuroprose Archive

[Barry Flower]

Connectionists.

The following preprint is available in the neuroprose archive, and
will appear in the NIPS*92 Proceedings.

       "Summed Weight Neuron Perturbation:
        An O(N) Improvement over Weight Perturbation."

        Barry Flower and Marwan Jabri

	SEDAL
	Department of Electrical Engineering
	University of Sydney
	NSW 2006 Australia


		ABSTRACT
		~~~~~~~~
The algorithm presented performs gradient descent on the weight space
of an Artificial Neural Network (ANN), using a finite difference to
approximate the gradient. The method is novel in that it achieves a com-
putational complexity similar to that of Node Perturbation, O(N**3), but
does not require access to the activity of hidden or internal neurons.
This is possible due to a stochastic relation between perturbations at the
weights and the neurons of an ANN. The algorithm is also similar to
Weight Perturbation in that it is optimal in terms of hardware require-
ments when used for the training of VLSI implementations of ANNs.



A sample session for retrieving the preprint follows:


sedal::.mboxd-86} ftp cheops.cis.ohio-state.edu
Connected to archive.cis.ohio-state.edu.
220 archive FTP server (Version 6.14 Thu Apr 23 14:41:38 EDT 1992) ready.
Name (cheops.cis.ohio-state.edu:barryf): anonymous
331 Guest login ok, send e-mail address as password.
Password:
230 Guest login ok, access restrictions apply.
ftp> binary
200 Type set to I.
ftp> cd pub/neuroprose
250-Please read the file README
250-  it was last modified on Mon Feb 17 15:51:43 1992 - 316 days ago
250-Please read the file README~
250-  it was last modified on Wed Feb  6 16:41:29 1991 - 692 days ago
250 CWD command successful.
ftp> get flower.swnp.ps.Z
200 PORT command successful.
150 Opening BINARY mode data connection for flower.swnp.ps.Z (43113 bytes).
226 Transfer complete.
local: flower.swnp.ps.Z remote: flower.swnp.ps.Z
43113 bytes received in 16 seconds (2.7 Kbytes/s)
ftp> quit
221 Goodbye.

Uncompress and finally print the postscript file.

sedal::.mboxd-87} uncompress flower.swnp.ps.Z
sedal::.mboxd-88} lpr flower.swnp.ps

Cheers,
-------------------------------------------------------------------
Barry Flower                              Email: barryf at sedal.oz.au
SEDAL, Electrical Engineering,              Tel: (+61-2) 692-3297
Sydney University, NSW 2006, Australia      Fax: (+61-2) 660-1228