combining estimators w/ non-constant weighting

John Hampshire hamps at stevens.speech.cs.cmu.edu
Mon Jun 26 09:48:41 EDT 1995


In a response to Sylvia Gil David Wolpert writes:

====
	The oldest work in the neural network community on
non-constant combining of estimators, and by far the most thoroughly
researched, is stacking...
====

Perhaps the second claim is accurate, but the first claim (oldest
in neural nets) is not.
Robbie Jacobs, Mike Jordan, and Steve Nowlan have a long series
of papers on the topic of combining estimators (maybe that's not what
they called it, but that's certainly what it is);  their works date
back to well before 92.  Likewise, I wrote a NIPS paper (90 or 91...
not worth reading) and an IEEE PAMI article (92... probably worth
reading) with Alex Waibel on this topic.  Since David's not aware of
these earlier and contemporary works, his second ''most thoroughly
researched'' claim would appear doubtful as well.

-John


More information about the Connectionists mailing list