I happen to know it doesn't work for a more complicated encoder problem: Image compression. When Paul Munro & I were first doing image compression back in 86, the error would go down and then back up! Rumelhart said: "there's a bug in your code" and indeed there was: we left out the derivative on the hidden units. -g.