model selection software for support vector machines
Chih-Jen Lin
cjlin at csie.ntu.edu.tw
Thu Nov 16 20:22:45 EST 2000
Dear Colleagues:
We announce the release of the software looms, a
leave-one-out model selection software for
support vector machines (SVM).
Automatic model selection is an important
issue to make support vector machines
(SVM) practically useful.
Most existing approaches use the leave-one-out (loo)
related estimators which are considered computationally
expensive. looms uses some numerical tricks which
lead to efficient calculation of loo rates of different models.
Given a range of parameters, looms automatically returns the
parameter and model with the best loo rate. For example,
% looms heart_scale
Optimal parameter: c=16.000000, gamma=0.016000, rate= 83.704%
where c is the penalty parameter (or say the upper
bound of the SVM dual formulation) and
gamma is the parameter of the RBF kernel:
exp(gamma*|x_i - x_j|^2). Currently we
support only the RBF kernel.
The current release (Version 1.0, by Jen-Hao Lee and Chih-Jen Lin)
is available from
http://www.csie.ntu.edu.tw/~cjlin/looms
Details of looms are in the following paper:
J.-H. Lee and C.-J. Lin,
Automatic model selection for support vector machines
http://www.csie.ntu.edu.tw/~cjlin/papers/modelselect.ps.gz
Any comments are very welcome.
Sincerely,
Chih-Jen Lin
Department of Computer Science and
Information Engineering
National Taiwan University
Taipei, Taiwan
cjlin at csie.ntu.edu.tw
More information about the Connectionists
mailing list