Error decomposition and model complexity.

[Huaiyu Zhu]

The following paper has been submitted to Neural Computation:

http://www.santafe.edu/~zhuh/draft/edmc.ps.gz 

		Error Decomposition and Model Complexity

			     Huaiyu Zhu

  Bayesian information geometry provides a general error decomposition
  theorem for arbitrary statistical models and a family of information
  deviations that include Kullback-Leibler information as a special case.
  When applied to Gaussian measures it takes the classical Hilbert space
  (Sobolev space) theories for estimation (regression, filtering,
  approximation, smoothing) as a special case.  When the statistical and
  computational models are properly distinguished, the dilemmas of
  over-fitting and ``curse of dimensionality'' disappears, and the optimal
  model order disregarding computing cost is always infinity.


Cited papers that have not appeared in print can be obtained through the
web page below.

-- 
Huaiyu Zhu                      Tel: 1 505 984 8800 ext 305       
Santa Fe Institute              Fax: 1 505 982 0565
1399 Hyde Park Road             mailto:zhuh at santafe.edu          
Santa Fe, NM 87501              http://www.santafe.edu/~zhuh/  
USA                             ftp://ftp.santafe.edu/pub/zhuh/