NIPS*95 Workshop on Transfer in Inductive Systems
Rich Caruana
caruana+ at cs.cmu.edu
Tue Nov 21 14:20:09 EST 1995
Post-NIPS*95 Workshop, December 1-2, 1995, Vail, Colorado
TITLE: "Learning to Learn: Knowledge Consolidation
and Transfer in Inductive Systems"
ORGANIZERS: Rich Caruana (co-chair), Danny Silver (co-chair),
Jon Baxter, Tom Mitchell, Lori Pratt, Sebastian Thrun
INVITED TALKS BY: Leo Breiman (Berkeley)
Tom Mitchell (CMU)
Tomaso Poggio (MIT)
Noel Sharkey (Sheffield)
Jude Shavlik (Wisconsin)
WEB PAGE: http://www.cs.cmu.edu/afs/cs/usr/caruana/pub/transfer.html
DESCRIPTION:
Because the power of tabula rasa learning is limited, interest is
increasing in methods that capitalize on previously acquired domain
knowledge. Examples of these methods include:
o using symbolic domain theories to bias connectionist networks
o using extra outputs on a connectionist network to bias the hidden
layer representation towards more predictive features
o using unsupervised learning on a large corpus of unlabelled data
to learn features useful for subsequent supervised learning on a
smaller labelled corpus
o using models previously learned for other problems as a bias when
learning new, but related, problems
There are many approaches: hints, knowledge-based artificial neural
nets (KBANN), explanation-based neural nets (EBNN), multitask learning
(MTL), knowledge consolidation, ... What they all have in common is
the attempt to transfer knowledge from other sources to benefit the
current inductive task.
The goal of this workshop is to provide an opportunity for researchers
and practitioners to discuss problems and progress in knowledge
transfer in learning. We hope to identify research directions, debate
theories and approaches, discover unifying principles, and begin to
start answering questions like:
o when will transfer help -- or hinder?
o what should be transferred and how?
o what are the benefits of transfer?
o in what domains is transfer most useful?
o is there evidence for transfer in nature?
More information about the Connectionists
mailing list