Response

[David L. Elliott]

Henrik-

Thanks for your comment; you wrote:
"Any interesting squashing function can be stored in a table of negligible size
(eg 256) with very high accuracy if linear (or higher) interpolation is used."

I think you are right *if the domain of the map
is compact* a priori. Otherwise the approximation must eventually become
constant for large x, and this has bad consequences for backpropagation
algorithms. For some other training methods, perhaps not.

David