Paper on Generalized Bias/Variance Decomposition
Gareth James
gareth at stat.stanford.edu
Wed Feb 19 17:25:57 EST 1997
The following paper is available in postscript format at
http://stat.stanford.edu/~gareth under my papers section.
Generalizations of the Bias/Variance Decomposition for Prediction
Error
Gareth James and Trevor Hastie (Stanford University)
The bias and variance of a real valued random variable, using squared
error loss, are well understood. However because of recent developments
in classification techniques it has become desirable to extend these
concepts to general random variables and loss functions. The 0-1
(misclassification) loss function with categorical random variables has
been of particular interest.
We explore the concepts of variance and bias and develop a decomposition
of the prediction error into functions of the systematic and variable
parts of our predictor.
After providing some examples we conclude with a discussion of the
various definitions that have been proposed.
More information about the Connectionists
mailing list