Training XOR with BP

[teache tsaih]

  People who are surprised by the emperical observation of above might be
interested in the paper "The Saddle Stationary point In the Back
Propagation Networks", in IJCNN'92 Beijing, II, page 886-892.  There
I had shown mathematically that the "local minimum" phenomenon in
the vicinity of the origin point is due to the nature of the degenerate
saddle stationary point.  That is, the origin point in the XOR probelm
is a degenerate saddle stationary point.

Ray Tsaih

tsaih at mis.nccu.edu.tw