TR on connection pruning available
Lutz Prechelt
prechelt at ira.uka.de
Mon Mar 27 08:51:39 EST 1995
FTP-host: ftp.icsi.berkeley.edu
FTP-file: /pub/techreports/1995/tr-95-009.ps.Z
URL: ftp://ftp.icsi.berkeley.edu/pub/techreports/1995/tr-95-009.ps.Z
The technical report
"Adaptive Parameter Pruning in Neural Networks"
is now available for anonymous ftp
from ftp.icsi.berkeley.edu in directory /pub/techreports/1995/
as file tr-95-009.ps.Z (92 kB, 14 pages).
Here is the bibtex entry and abstract:
@TechReport{Prechelt95e,
author = "Lutz Prechelt",
title = "Adaptive Parameter Pruning in Neural Networks",
institution = "International Computer Science Institute",
year = 1995,
number = "95-009",
address = "Berkeley, CA",
month = mar,
Class = "nn, learning, experiment, algorithm",
URL = "ftp://ftp.icsi.berkeley.edu/pub/techreports/1995/tr-95-009.ps.Z},
abstract = "Neural network pruning methods on the level of individual
network parameters (e.g. connection weights) can improve
generalization. An open problem in the pruning methods
known today (OBD, OBS, autoprune, epsiprune) is the selection of the
number of parameters to be removed in each pruning step (pruning
strength). This paper presents a pruning method \Def{lprune} that
automatically adapts the pruning strength to the evolution of weights
and loss of generalization
during training. The method requires no algorithm parameter adjustment by
the user. The results of extensive experimentation indicate that lprune
is often superior to autoprune (which is superior to OBD) on diagnosis
tasks unless severe pruning early in the training process is required.
Results of statistical significance tests comparing autoprune to the
new method lprune as well as to backpropagation with early stopping
are given for 14 different problems."
}
The ICSI internet connection is sometimes extremely slow and fails
often. If you have problems getting the document, just try again at
a different time.
Sorry, no hardcopies available from me.
Lutz
Lutz Prechelt (http://wwwipd.ira.uka.de/~prechelt/) | Whenever you
Institut fuer Programmstrukturen und Datenorganisation | complicate things,
Universitaet Karlsruhe; 76128 Karlsruhe; Germany | they get
(Voice: +49/721/608-4068, FAX: +49/721/694092) | less simple.
More information about the Connectionists
mailing list