About sequential learning (or interference)

[Christopher G. Atkeson]

Memory-Based Learning is one approach to avoiding interference,
and is in part descended from nearest neighbor neural networks, or at
least neural networks with local representations.

Some of our references that will point you to other work as well:

Atkeson, C.G. (1992) "Memory-Based Approaches To Approximating
Continuous Functions." In: Casdagli, M., & Eubank, S. (eds.),
"Nonlinear Modeling and Forecasting" Addison Wesley, Redwood City, CA.

Atkeson, C.G. ``Using Local Models to Control Movement'',
Proceedings, Neural Information Processing Systems,
Dec 1989, Denver, Colorado.
In: Neural Information Processing Systems 2.
Morgan Kaufmann, 1990.

Schaal, S., & Atkeson, C.G. (1994).
"Robot Juggling: An Implementation of Memory-Based Learning."
IEEE Control Systems Magazine, vol. 15, no. 1, pp. 57-71.

Chris Atkeson
Stefan Schaal