batch-mode parallel implementations

Gary Cottrell gary at cs.UCSD.EDU
Wed Oct 16 13:05:51 EDT 1991


I tried implementing Elman's simple recurrent nets on an
Intel Hypercube using data parallelism (a copy of the net
at each node, each getting a part of the training set).

I found is was as fast as a bat out of h**l, but as many times
faster as it was, it was also as many times SLOWER at converging,
leading to a net gain of 0!

g.

PS I did not try conjugate gradient, or back propping more steps
in time, which probably would have helped convergence lots.


More information about the Connectionists mailing list