update of recurrent nets bibliography
thanasis kehagias
ST401843%BROWNVM.BITNET at VMA.CC.CMU.EDU
Mon Dec 11 01:07:12 EST 1989
dear list manager:
a while ago i passed you a connectionist bibliography of recuurent
nets and you deposited it in your ftp directories. i am now sending you
the updated version of the bibliography and a message to the list
members. if this is fine with you, replace the bibliography and post the
following message (adding the appropriate instructions for ftp-ing):
(i hope this is not too much work for you - if it is, let me know and i will
find other ways to distribute this .....)
--------------------text of message to list members -------------
a while ago i had posted a preliminary version of a bibliography of
recurrent nets. here is a more definitive version of it. it is expanded
from its old form (now has somewhat over 100 items). it is not strictly
recurrent nets. a better way to describe it is:
how-to-capture-temporal-relationships-bibliography. some of the
selections are static nets, but most are dynamic. i explain some more
the distinction in a short blurb that comes with the bibliography. the
blurb is in tex format (latex-able) and the bibliography is a
bib-texable bibliographic database. so people who like this kind of
thing can produce a pretty TeX document. if you do not want to mess with
it, just ftp the files- they are usable as ascii files without any
texxing. the files are in the connectionists/cmu directory and here is
how to access them :
**************************************************************************
----------(here you should add the ftp instructions) -----------
**************************************************************************
as i say in the tex document, this is a very informal bibliographic
search. some information is missing and the bibliography is certainly
incomplete. at this point i am not inclined to work much more on it,
except if someone feels he has work that should be in it, i would
certainly put it in. at this point i have already sent two messages to
the members of the list, so i suppose if somebody has something has
already contacted me.
so here it is, enjoy.
thanasis
-------------------end of message text ------------------------------------
-------------------beginning of tex document -------------------------------
\documentstyle{article}
\title{{\bf A Short Bibliography of Connectionist Systems \\
for Temporal Behavior}}
\author{Athanasios Kehagias \\
Division of Applied Mathematics \\
Brown University \\
Providence, RI 02912}
\date{December 12, 1989}
\begin{document}
\normalsize
\bibliography{recmes2}
\bibliographystyle{alpha}
\maketitle
%
This is a bibliography of work in Connectionism (and related fields)
that tries to capture temporal relationships. It is not intended as
a complete bibliography. I include work I came across after
a reasonable but not exhaustive search and the connection
to the problem of representing temporal relationships is seen
from my personal perspective. So, if you think something is
omitted, misrepresented etc., send me your suggestions.
A large part of the current work in connectionism is concerned
with the design of {\bf static} networks - meaning that
the output of the network at time $t+1$ is more or less
not influenced by the output at time $t$.
Nevertheless, such static architectures have been used to capture
temporal relationships. For example consider the work in predicting
chaotic time series:
\cite{kn:Moo88a}
\cite{kn:Lap87a}
\cite{kn:Far88a} .
Another case of implicitly {\bf dynamical} networks are Hopfield
type networks and Boltzmann machines. In both cases
we have networks where the state of a neuron at time $t+1$ depends on
the input from other neuron states at time $t$ . However, even though
such networks do have dynamic behavior, the goal is that they settle
down at a steady state useful for storing patterns. So in
the long run we are more interested in static behavior. There is an
extensive amount of work on Hopfield networks. Hopfield's seminal
papers are: \cite{kn:Hop82a}, \cite{kn:Hop84a}, \cite{kn:Hop85a}.
Similarly there is a lot of work on Boltzmann machines; here is
a small sample: \cite{kn:Ack85a}, \cite{kn:Pet87a}, \cite{kn:Pet88a},
\cite{kn:Pet89a}, \cite{kn:Pet89b}, \cite{kn:Sus88a}.
Moving on to certain application oriented work where
temporal behavior is important, we see a mixed approach,
sometimes using static network solutions, sometimes using
dynamic network solutions.
For instance in control/robotics, following a trajectory in state-space
is an essentially dynamic problem. Certain connectionist
approaches are: \cite{kn:Bar89a}, \cite{kn:Bar89b}, \cite{kn:Jor88a},
\cite{kn:Pea89a}, \cite{kn:Eck89a}.
Similarly, in speech recognition time is of great importance. Some
researchers
have used a static approach (e.g. the time-delay neural network,
\cite{kn:Wai89a} , or Boltzmann machines
\cite{kn:Pra86a}
). But there is also a lot
of work where dynamic (recurrent) neural networks are used:
\cite{kn:Bou88a}, \cite{kn:Bou89a}, \cite{kn:Elm88a},
\cite{kn:Gra89a}, \cite{kn:Koh89a}, \cite{kn:Kuh90a},
\cite{kn:Rob88a}, \cite{kn:Rob89a}, \cite{kn:Wat87a},
\cite{kn:Wat87b}.
Another area of practical problems being attacked by recurrent
neural architectures is tasks related to formal or natural language,
e.g.
\cite{kn:Cot85a},\cite{kn:San89a},\cite{kn:Cha87a},
\cite{kn:Fan85a}, \cite{kn:Han87a}, \cite{kn:Mik89a},
\cite{kn:Mii88a}, \cite{kn:Cle90a}, \cite{kn:Ser88a},
\cite{kn:All89a}, \cite{kn:All89b}, \cite{kn:All88a}, \cite{kn:Rie88a},
\cite{kn:Sej86a}, \cite{kn:StJ85a}, \cite{kn:Whe89a}.
Finally, the bulk of the references in this bibliography refer
to more or less theoretical treatments of the problem of dynamical
(recurrent) neural networks.
I cite first a very small sample of Grossberg's work:
\cite{kn:Gro86a}, \cite{kn:Gro86b}. This ART-type work by
Grossberg , Carpenter and collaborators is very interesting
and there is a very voluminous literature; references to
more of this type work are contained in the books listed above.
I now cite a large number of references which relate to
neural networks mostly as dynamical systems in $R^n$ (as opposed
to dynamical systems taking Boolean values) :
\cite{kn:Alm87a}, \cite{kn:Alm88a}, \cite{kn:Alm89a},
\cite{kn:Alm89b}, \cite{kn:Alm90a}, \cite{kn:Bab87a},
\cite{kn:Bar85a}, \cite{kn:Bar81a}, \cite{kn:Bel88a},
\cite{kn:Deh87a}, \cite{kn:Elm88b}, \cite{kn:Elm89b},
\cite{kn:Gal88a}, \cite{kn:Gol86a}, \cite{kn:Gol88a},
\cite{kn:Gut88a}, \cite{kn:Guy82a}, \cite{kn:Kur86a},
\cite{kn:Mar89a}, \cite{kn:Moz89a}, \cite{kn:Now88a},
\cite{kn:Ott89a}, \cite{kn:Pin87a}, \cite{kn:Pin88a},
\cite{kn:Pol87a}, \cite{kn:Pol88a}, \cite{kn:Ren90a},
\cite{kn:Ren90b}, \cite{kn:Roh87a}, \cite{kn:Roh90a},
\cite{kn:Ried88a}, \cite{kn:Sch88a}, \cite{kn:Sch89a},
\cite{kn:Sim88a}, \cite{kn:Som88a}, \cite{kn:Sto},
\cite{kn:Sun}, \cite{kn:Sut88a}, \cite{kn:Wil88a}.
Finally here are some refernces to work that considers
dynamical neural networks as dynamical systems with
a Boolean state vector (or in other words sequential machines):
\cite{kn:Ale89a}, \cite{kn:Ama71a}, \cite{kn:Ama72a},
\cite{kn:Ama83a}, \cite{kn:Cai70a}, \cite{kn:Cai75a},
\cite{kn:Cai76a}, \cite{kn:Cai86a}, \cite{kn:Cai89a},
\cite{kn:Jor86a}, \cite{kn:Mar89b}, \cite{kn:Mar87a},
\cite{kn:Mcc43a}, \cite{kn:Par89a}, \cite{kn:Sch},
\cite{kn:Raj}, \cite{kn:Tsu89a}, \cite{kn:Cot89a},
\cite{kn:All89c}, \cite{kn:All89d}, \cite{kn:Sun89a},
\cite{kn:Sun89b}, \cite{kn:Roz69a},
\cite{kn:Par88a}.
This is a rather fine and arbitrary classification , but work
which is often characterized as research in cellular automata
is relevant to neural netorks issues. Here are some samples:
\cite{kn:Ale73a}, \cite{kn:Kau69a}, \cite{kn:Fog82a},
\cite{kn:Fog83a}, \cite{kn:Fog85a}, \cite{kn:Slo67a}.
This is the material I was able to collect; there is a whole
lot more, sometimes refrred to in the references of
the above works. Any suggestions for improvement are welcome.
\end{document}
---------------------end of tex document --------------------------
---------------------beginning of bibliographic database-----------
@BOOK{KN:GRO86A,
author ="S. Grossberg",
title ="The Adaptive brain:I Learning, reinforcement,
motivation and rhythm",
YEAR ="1986",
PUBLISHER="?"
}
@book{kn:Gro86b,
author ="S. Grossberg",
title ="The Adaptive brain:II Vision, Speech, Language
and Motor Control",
YEAR ="1986",
PUBLISHER="?"
}
@ARTICLE{kn:Hop85a,
AUTHOR= "J.J.Hopfield and D.W.Tank",
TITLE= "Neural Computation of Decisions in Optimization Problems",
JOURNAL= "Biol. Cyb.",
YEAR= "1985",
VOLUME= "52"
}
@ARTICLE{kn:Hop82a,
AUTHOR= "J.J. Hopfield",
TITLE= "Neural Nets and Physical Systems with Emergent
Collective Computational Properties",
JOURNAL= "Proc. Nat'l Acad. Sci. USA",
YEAR= "1982",
VOLUME= "?"
}
@ARTICLE{kn:Hop84a,
AUTHOR= "J.J. Hopfield",
TITLE= "Neurons with Graded Response have Collective
Computational Properties like those of Two-State Neurons",
JOURNAL= "Proc. Nat'l Acad. Sci. USA",
YEAR= "1984",
VOLUME= "81"
}
@ARTICLE{kn:Ack85a,
AUTHOR= "D.H. Ackley and others",
TITLE= "A Learning Algorithm for Boltzmann Machines",
JOURNAL= "Cognitive Science",
YEAR= "1985",
VOLUME= "9"
}
@ARTICLE{kn:Pet87a,
AUTHOR= "C. Peterson and J.R. Anderson",
TITLE= "A Mean Field Theory Learning Algorithm for Neural Nets",
JOURNAL= "Complex Systems",
YEAR= "1987",
VOLUME= "1"
}
@ARTICLE{kn:Pet89a,
AUTHOR= "C. Peterson and E. Hartman",
TITLE= "Explorations of the Mean Field Theory Learning Algorithm",
JOURNAL= "Neural Networks",
YEAR= "1989",
VOLUME= "?"
}
@ARTICLE{KN:Pet88a,
AUTHOR= "C. Peterson and J.R. Anderson",
TITLE= "Neural Networks and NP-complete Optimization Problems;
A Performance Study on the Graph Bisection Problem",
JOURNAL= "Complex Systems",
YEAR= "1988",
VOLUME= "2"
}
@ARTICLE{kn:Pet89b,
AUTHOR= "C. Peterson and B. Soderberg",
TITLE= "A New Method for Mapping Optimization Problems
onto Neural Networks",
JOURNAL= "Int. J. of Neural Systems",
YEAR= "1989",
VOLUME= "1"
}
@techreport{kn:Sus88a,
author ="H.J. Sussman",
title ="On the Convergence of Learning Algorithms
for Boltzmann Machines",
number ="sycon-88-03",
institution ="Rutgers Center for Systems and Control",
year ="1988"
}
@techreport{kn:Bar89a,
AUTHOR= "A.G. Barto and R.S. Sutton",
TITLE= "Learning and Sequential
Decision Making",
INSTITUTION= "COINS Dept., Amherst Un. ",
YEAR= "1989",
Number= "TR 89-95"
}
@ARTICLE{kn:Jor88a,
AUTHOR= "M.I. Jordan",
TITLE= "Supervised Learning and Systems with Excess
Degrees of Freedom",
INSTITUTION= "COINS Dept., Amherst Un. ",
YEAR= "1988",
number= "TR 88-27"
}
@ARTICLE{kn:Bar89b,
AUTHOR= "A.G. Barto",
TITLE= "Connectionist Learning for Control:An Overview",
INSTITUTION= "COINS Dept., Amherst Un. ",
YEAR= "1989",
number= "TR 89-89"
}
@inproceedings{kn:Pea89a,
AUTHOR= "B.A. Pearlmutter",
TITLE= "Learning State Space Trajectories in Recurrent Neural Nets",
booktitle= "IJCNN",
YEAR= "1989",
organization= "IEEE"
}
@article{kn:Eck89a,
author ="R. Eckmiller",
title ="Generation of Movement Trajectories in
Primates and Robots",
journal ="Neural Computing Architectures, I. Aleksander ed.",
year ="MIT , 1989"
}
@inproceedings{kn:Moo88a,
title ="Learning with
Localized Receptor Fields",
booktitle ="Connectionist Models Summer School
",
author ="J. Moody and C. Darken",
year ="1988",
volume ="?",
organization ="Carnegie Mellon University"
}
@techreport{kn:Lap87a,
author ="A. Lapedes and R. Farber",
title ="Nonlinear Signal Processing using Neural Networks:
Prediction and System Modelling",
number ="LA UR 87-?",
institution ="Los Alamos National Lab",
year ="1987"
}
@techreport{kn:Far88a,
author ="J.D. Farmer and J.J. Sidorowich",
title ="Exploiting Chaos to Predict the Future
and Reduce Noise",
number ="LA UR 88-901",
institution ="Los Alamos National Lab",
year ="1988"
}
@inproceedings{kn:And88a,
author ="S. Anderson",
title ="Dynamic System Categorization with Recurrent Networks",
booktitle ="Connectionist Models Summer School",
year ="1988"
}
@ARTICLE{kn:Bou88a,
AUTHOR= "H. Bourlard and C.J. Wellekens",
TITLE= "Links between Markov Models and Multilayer Perceptrons",
organization="Phillips Research Lab",
YEAR= "1988",
techreport= "M 263"
}
@inproceedings{kn:Bou89a,
AUTHOR= "H. Bourlard and C.J. Wellekens",
TITLE= "Speech Dynamics and Recurrent Neural Nets",
booktitle= "ICASSP",
organization="IEEE",
YEAR= "1989",
VOLUME= "?"
}
@article{kn:Elm88a,
author ="J. L. Elman and D. Zipser",
title ="Learning the Hidden Structure of Speech",
journal ="Journal of the Acoustical
Society of America",
year ="1988",
volume ="83"
}
@inproceedings{kn:Gra89a,
AUTHOR= "K.A. Grajski and others ",
TITLE= "A Preliminary Note on Training Static and Recurrent
Neural Nets for Word-level Speech Recognition",
booktitle= "IJCNN",
YEAR= "1989",
VOLUME= "?"
}
@incollection{kn:Koh89a,
author ="T. Kohonen",
editor ="I. Aleksander",
title ="Speech Recognition based on Topology Preserving Maps",
booktitle ="Neural Computing Architectures",
year ="1989",
publisher ="MIT"
}
@article{kn:Kuh90a,
title ="Connected Recognition
with a Recurrent Network",
author ="G. Kuhn",
journal ="Speech Communication",
year ="1990",
volume ="9",
number ="2",
pages ="?",
}
@inproceedings{kn:Pin88a,
author= "F. Pineda",
title = "Generalization of Backpropagation to Recurrent and
Higher Order Neural Networks",
booktitle= "Neural Information Processing Systems",
editor= "D. Anderson",
year = "1988"
}
@article{kn:Pra86a,
title ="Boltzmann Machines
for Speech Recognition",
author ="R. Prager and others",
journal ="Computer , Speech and Language",
year ="1986",
volume ="1",
number ="?",
pages ="1-20",
}
@phdthesis{kn:Rob89a,
author = "Anthony J. Robinson",
title ="Dynamic Error Propagation Networks",
school ="Cambridge University Engineering Department",
address ="Cambridge, England",
year ="1989"
}
@techreport{kn:Rob88a,
author ="Anthony J. Robinson",
title ="A Dynamic Connectionist Model for Phoneme Recognition",
organization="Cambridge University Engineering Department",
address ="Cambridge, England",
year ="1988"
}
@inproceedings{kn:Wat87a,
key = "Watrous" ,
author = "Watrous, R.L. and Shastri, L." ,
title = "Learning Phonetic Features Using
Connectionist Networks: An
Experiment in Speech Recognition" ,
booktitle= "Int. Conf. on Neural Networks" ,
organization= "IEEE",
month = "June" ,
year = "1987"
}
@inproceedings{kn:Wat87b,
author = "R.L. Watrous and others" ,
title = "Learned Phonetic Discrimination
Using Connectionist Networks" ,
booktitle= "European Conference on Speech Technology" ,
month = "September" ,
address = "Edinburgh" ,
year = "1987" ,
pages = "377-380"
}
@phdthesis{kn:Wat88a,
key = "Watrous" ,
author = "Watrous, R." ,
title = "Speech Recognition Using Connectionist Networks" ,
school = "University of Pennsylvania" ,
month = "October" ,
year = "1988"
}
@article{kn:Wai89a,
title = "Phoneme Recognition Using Time-Delay Neural Networks" ,
author = "A. Waibel and others
" ,
year = "1989" ,
journal = "IEEE, Trans.
Acoustics, Speech and Signal Processing",
month = "March"
}
@INCOLLECTION{KN:Ale89a,
author ="I. Aleksander",
editor ="I. Aleksander",
title ="The Logic of Connectionist Systems",
booktitle ="Neural Computing Architectures",
year ="1989",
publisher ="MIT"
}
@ARTICLE{KN:Ale73a,
title ="Cycle Activity in Nature:
Causes of Stability",
author ="I. Aleksander and P. Atlas",
journal ="Int. J. of Neuroscience",
year ="1973",
volume ="6",
number ="?",
pages ="45-50",
}
@INPROCEEDINGS{KN:ALL89C,
AUTHOR ="Allen, R.B. and Kauffman, S.M.",
year ="1989",
title ="Developing agent models with a neural
reinforcement technique",
ORGANIZATION="IEE",
booktitle= "Conf. on Artificial Neural Networks"
}
@INPROCEEDINGS{KN:ALL89D,
AUTHOR ="Allen, R.B.",
year ="1989",
title ="Sequence Generation with Connectionist
State Machines",
booktitle= "IJCNN"
}
@article{kn:Ama71a,
title ="Characteristics of Randomly Connected Threshold
Elements and Network Systems",
author ="S.I. Amari",
journal ="Proc. of the IEEE",
year ="1971",
volume ="39",
number ="?",
pages ="33-47",
}
@article{kn:Ama72a,
title ="Learning Patterns and Pattern Sequences by
Self-Organizing Nets of Threshold Elements",
author ="S.I. Amari",
journal ="IEEE Trans. on Computers",
year ="1972",
volume ="21",
number ="?",
pages ="1197-1206"
}
@article{kn:Ama83a,
title ="Field Theory of Self-Organizing Neural Nets",
author ="S.I. Amari",
journal ="IEEE Trans. on Systems , Man and Cybernetics",
year ="1983",
volume ="?",
number ="?",
pages ="741-748",
}
@incollection{kn:Cai89a,
author ="E. R. Caianello",
editor ="I. Aleksander",
title ="A Theory of Neural Networks",
booktitle ="Neural Computing Architectures",
year ="1989",
publisher ="MIT"
}
@article{kn:Cai75a,
title ="Synthesis of Boolean Nets and
Time-Behavior of a General Mathematical Neuron",
author ="E. Caianello and E. Grimson",
journal ="Biol. Cyb.",
year ="1975",
volume ="18",
number ="?",
pages ="111-117",
}
@article{kn:Cai86a,
title ="Linearization and Synthesis of Cellular Automata.
The Additive Case",
author ="E. Caianello and M. Marinaro",
journal ="Physica Scripta",
year ="1986",
volume ="34",
number ="?",
pages ="444",
}
@article{kn:Cai76a,
title ="Methods of Analysis of
Neural Nets",
author ="E. Caianello and E. Grimson",
journal ="Biol. Cyb.",
year ="1976",
volume ="21",
number ="?",
pages ="1-6",
}
@article{kn:Cai70a,
title ="Reverberations and Control of Neural Networks",
author ="E. Caianello",
journal ="Kybernetik",
year ="1970",
volume ="7",
number ="5",
pages ="191",
}
@article{kn:Fog82a,
title ="Specific Roles of the Different Boolean
Mappings in Random Networks",
author ="F. Fogelman-Soulie and others",
journal ="Bull. of Math. Biol.",
year ="1982",
volume ="44",
number ="5",
pages ="715-730",
}
@article{kn:Fog85a,
title ="Frustration and Stability in
Random Boolean Networks",
author ="F. Fogelman-Soulie",
journal ="Discrete Applied Math.",
year ="?",
volume ="?",
number ="?",
pages ="?",
}
@article{kn:Fog83a,
title ="Transient Length in Sequential Iterations
of Threshold Functions ",
author ="F. Fogelman-Soulie and Others",
journal ="Discrete Applied Math.",
year ="1983",
volume ="6",
number ="?",
pages ="95-98",
}
@article{kn:Kau69a,
title ="Metabolic Stability and Epigenesis in Randomly
Constructed Genetic Nets",
author ="S.A. Kauffman",
journal ="J. Theoret. Biology",
year ="1969",
volume ="22",
number ="?",
pages ="437-467",
}
@incollection{kn:Mar89a,
author ="D. Martland",
editor ="I. Aleksander",
title ="Dynamic Behavior of Boolean Networks",
booktitle="Neural Computing Architectures",
year ="1989",
publisher="MIT"
}
@inproceedings{kn:Mar87a,
title ="Behavior of Autonomous (Synchronous)
Boolean Networks",
booktitle ="1st Int. Conf. on Neural Networks
",
author ="D. Martland",
year ="1987",
volume ="II",
organization ="IEEE"
}
@article{kn:Mcc43a,
title ="A Logical Calculus of the Ideas Immanent
in Nervous Activity ",
author ="W.S. McCulloch and W. Pitts ",
journal ="Bull. Math. Biophysics",
year ="1943",
volume ="5",
pages ="115-143",
}
@ARTICLE{kn:Par89a,
AUTHOR= "I. Parberry",
TITLE= "Relating Boltzmann Machines to Conventional
Models of Computation",
JOURNAL= "Neural Networks",
YEAR= "1989",
VOLUME= "2"
}
@ARTICLE{kn:Roz69a,
AUTHOR= "L.I. Rozonoer",
TITLE= "Random Logical Nets, I-III (in Russian)",
JOURNAL= "Avtomatika i Telemekhanika",
YEAR= "1969",
VOLUME= "5"
}
@INPROCEEDINGS{KN:Sun89a,
AUTHOR ="R. Sun",
year ="1989",
title ="A Discrete Neural Network Model for
Conceptual Representation and Reasoning",
booktitle= "11th Ann. Cog. Sci. Soc. Conf."
}
@TECHREPORT{KN:SUN89b,
AUTHOR ="R. Sun",
TITLE ="The Discrete Neuronal Model and the
Probabilistic Discrete Neuronal Model",
NUMBER ="?",
INSTITUTION ="Computer Sc. Dept., Brandeis Un.",
year ="1989"
}
@ARTICLE{kn:Sch,
AUTHOR ="R.E. Schneider",
TITLE ="The Neuron as a Sequential Mahine",
JOURNAL ="?",
YEAR ="?",
VOLUME ="?"
}
@ARTICLE{kn:Raj,
AUTHOR= "V. Rajlich",
TITLE= "Dynamics of certain Discrete Systems and Self
Reproduction of Patterns",
JOURNAL= "?",
YEAR= "?",
VOLUME= "?"
}
@inproceedings{kn:Tsu89a,
author ="Tsung, Fu-Sheng and Cottrell, G.",
title ="A sequential adder using recurrent neural
networks",
year ="1989",
booktitle ="IJCNN",
}
@inproceedings{kn:Cot89a,
author ="Cottrell, G. and Tsung, Fu-Sheng",
title ="Learning simple arithmetic procedures",
booktitle ="11th Annual Conf. of Cog. Sci.
Soc.",
year ="1989"
}
@INCOLLECTION{KN:ALL89A ,
author ="Allen, R.B. and Riecken, M.E.",
year ="1989",
title ="Reference in connectionist language users",
booktitle ="Connectionism in Perspective",
editor ="R. Pfeifer and others",
publisher ="Elsevier",
pages ="301-308"
}
@phdthesis{kn:Rie88a,
author ="Riecken, M.E.",
year ="1988",
title ="Neural networks in natural language processing
and distributed artificial intelligence",
school ="University of New Mexico"
}
@inproceedings{kn:All89b,
author ="Allen, R.B.",
year ="1989",
title ="Developing agent models with a neural
reinforcement technique",
organization="IEEE",
booktitle= "Systems Man and Cybernetics Conference",
}
@inproceedings{kn:All88a,
author ="Allen, R.B.",
year ="1988",
title ="Sequential connectionist networks for answering
simple questions about a microworld",
booktitle ="10th Ann. Cog. Sci. Soc. Conf.",
pages ="489-495"
}
@inproceedings{kn:Cot85a,
title ="Connectionist Parsing",
author ="G.W. Cottrell",
BOOKTITLE ="7th Ann. Conf. of Cog. Sci. Soc. ",
year ="1985"
}
@incollection{kn:San89a,
author ="E. {Santos Jr.}",
title ="A Massively Parallel Self-Tuning Context-free Parser",
booktitle ="Adv. in Neural Information Processing Systems",
year ="1989",
publisher ="Morgan Kauffman"
}
@inproceedings{kn:Cha87a,
title ="A Connectionist Context-free Parser which is not Context-
Free but then it is not really Connectionist either",
author ="E. Charniak and E. Santos",
BOOKTITLE ="9th Annual Conference of Cog. Sci. Soc. ",
year ="1987"
}
@techreport{kn:Fan85a,
author ="M. Fanty",
title ="Context-Free Parsing in Connectionist
Networks",
number ="TR 174",
institution ="Un. of Rochester, Computer Sc. Dept.",
year ="1985"
}
@inproceedings{kn:Han87a,
title ="PARSNIP:A connectionist Network that learns Natural
Language from Exposure to Natural Language Sentences",
author ="S. Hanson and J. Kegl",
BOOKTITLE ="9th Annual Conference of Cog. Sci. Soc.",
year ="1987"
}
@techreport{kn:Mik89a,
author ="R. Miikkulainen and M.G. Dyer",
title ="A Modular Neural Network Architecture for Sequential
Paraphrasing of Script-Based Stories",
NUMBER ="TR UCLA-AI-89-02",
INSTITUTION ="Un. of California at Los Angeles" ,
year ="1989"
}
@inproceedings{kn:Mii88a,
author ="R. Miikkulainen and M.G. Dyer",
title ="Encoding Input/Output Representations in
Connectionist Cognitive Systems",
booktitle ="Connectionist Models Summer School",
year ="1988"
}
@article{kn:Cle90a,
author ="A. Cleeremans and others",
year ="1990",
title ="Finite state
automata and simple recurrent networks",
journal ="Neural Computation",
volume ="1"
}
@techreport{kn:Ser88a,
AUTHOR ="D. Servan-Schreiber and others",
year ="1988",
title ="Encoding
sequential structure in simple recurrent networks",
number ="CMU-CS-88-183",
institution ="School of Computer Science, Carnegie Mellon Un.",
}
@techreport{kn:Sej86a,
author ="T.J. Sejnowski and C. Rosenberg",
title ="NETtalk:A Parallel Network that Learns to Read
Aloud",
number ="JHU EECS 86-01",
institution ="John Hopkins University",
year ="1986"
}
@techreport{kn:StJ85a,
author ="M. StJohn and J.L. McLelland",
title ="Learning and Applying Contextual Constraints in Sentence
Comprehension",
number ="?",
institution ="Dept. of Psychology, Carnegie Mellon Un.",
year ="1985"
}
@techreport{kn:Whe89a,
author = "D.W. Wheeler and D.S. Touretzky",
title = "A Connectionist Implementation of Cognitive Phonology",
year = "1989" ,
institution = "CS Dept., Carnegie Mellon University",
number = "CMU-CS-89-144"
}
@inproceedings{kn:Alm87a,
title ="A Learning Rule for Asynchronous Perceptrons
with Feedback in a Combinatorial Environment",
author ="L.B. Almeida",
booktitle ="1st Int. Conf. on Neural Networks, S. Diego ",
organization ="IEEE",
year ="1987",
}
@incollection{kn:Alm89a,
title ="Backpropagation in Nonfeedforward Networks",
author ="L.B. Almeida",
booktitle ="Neural Computing Architectures",
editor ="I. Aleksander",
publisher ="MIT Press",
year ="1989",
}
@incollection{kn:Alm88a,
title ="Backpropagation in Perceptrons with Feedback",
author ="L.B. Almeida",
booktitle ="Neural Computers",
editor ="R. Eckmiller and C.v.d. Malsburg",
publisher ="Springer",
year ="1988",
}
@incollection{kn:Alm89b,
title ="Recurrent Backpropagation and Hopfield Networks",
author ="L.B. Almeida and J.P. Neto",
booktitle ="Neuro Computing, Algorithms Architectures
and Applications",
editor ="F. Fogelman-Soulie ",
PUBLISHER ="Springer",
chapter ="?",
year ="1989",
}
@incollection{kn:Alm90a,
title ="Backpropagation in Feedforward
and Recurrent Networks",
author ="L.B. Almeida",
booktitle ="?",
editor ="B. Shriver",
chapter ="submitted to",
publisher ="IEEE Press",
year ="1990",
}
@article{kn:Bab87a,
title ="Dynamics of Simple Electronic
Neural Networks",
author ="K.L. Babcock and R.M. Westervelt",
journal ="Physica",
year ="1987",
volume ="28D",
number ="?",
pages ="305",
}
@article{kn:Bar85a,
author ="A.G. Barto and P. Anandan",
title ="Pattern Recognizing Stochastic Learning Automata",
journal ="IEEE Trans. on Systems , Man and Cybernetics",
volume ="SMC 15",
Number ="3",
year ="June 1985"
}
@article{kn:Bar81a,
author ="A.G. Barto and others",
title ="Associative Search Network:Reinforcement
Learning Associative Memory",
journal ="Biol. Cyb. 40",
year ="1981"
}
@inproceedings{kn:Bel88a,
author ="T. Bell",
title ="Sequential Processing using Attractor Transitions",
booktitle ="Connectionist Models Summer School",
year ="1988"
}
@article{kn:Deh87a,
title ="Neural Networks that learn
Temporal Sequences by Selection ",
pages ="2727",
author ="S. Dehaene and others",
year ="1987 ",
volume ="84",
journal ="Proc. of Nat'l Acad. Sci. USA"
}
@inproceedings{kn:Elm89b,
author ="J. L. Elman",
title ="Representation and structure in connectionist models",
BOOKTITLE ="11th Ann. Conf. Cog. Sci. Soc.",
year ="1989"
}
@TECHREPORT{KN:ELM88B,
author ="J. L. Elman",
title ="Finding structure in time",
institution="Center for Research in Language,
University of California at San Diego",
number ="CRL TR 8801",
year ="1988"
}
@inproceedings{kn:Gal88a,
author =" Gallant, S. I. and King, D. J",
title ="Experiments with Sequential Associative
Memories",
booktitle ="10th Ann. Conf. of Cog. Sci. Soc.",
year ="1988",
page ="40-47",
}
@ARTICLE{kn:Gol86a,
AUTHOR= "R.M. Golden",
TITLE= "The Brain-State-in-a-Box Neural Model is a
Gradient Descent Algorithm",
JOURNAL= "Journal of Mathematical Psychology",
YEAR= "1986",
VOLUME= "30" ,
NUMBER= "1"
}
@ARTICLE{kn:Gol88a,
AUTHOR= "R.M. Golden",
TITLE= "A Unified Framework for Connectionist Systems",
JOURNAL= "Biol. Cyb.",
YEAR= "1988",
VOLUME= "59"
}
@article{kn:Gut88a,
title ="Processing of Temporal Sequences
in Neural Networks",
author ="H. Gutfreund and M. Mezard",
journal ="Phys. Rev. Let.",
year ="1988",
volume ="61",
number ="?",
pages ="235",
}
@article{kn:Guy82a,
title ="Storage and Retrieval of Complex
sequences in Neural Networks",
author ="I. Guyon and others",
journal ="Phys. Rev. A",
year ="1982",
volume ="38",
number ="?",
pages ="6365",
}
@inproceedings{kn:Jor86a,
title ="Attractor Dynamics and Parallelism in a Connectionist
Sequential Machine",
author ="M.I. Jordan",
BOOKTITLE ="8th Ann. Conf. of Cog. Sci. Soc." ,
year ="1986"
}
@article{kn:Kur86a,
title ="Chaos in
Neural Systems",
author ="K.E. Kurten and J.W. Clark",
journal ="Phys. Lett.",
year ="1986",
volume ="114A",
number ="?",
pages ="413",
}
@incollection{kn:Mar89b,
title ="Dynamics of Analog Neural
Networks with Time Delay",
booktitle ="Advances in Neural
Information Processing Systems I",
author ="C.M. Marcus and R.M. Westervelt",
editor ="D. Touretzky",
publisher ="Morgan Kauffman",
year ="1989",
}
@ARTICLE{kn:Moz89a,
AUTHOR ="M. C. Mozer",
TITLE ="A Focused Back Propagation Algorithm for Temporal Pattern
Recognition",
JOURNAL ="Complex Systems",
YEAR ="1989 or 1990 (accepted for publication)",
VOLUME ="??"
}
@ARTICLE{KN:Now88a,
AUTHOR ="S.J. Nowlan",
TITLE ="Gain Variation in Recurrent Error Propagation Networks",
JOURNAL ="Complex Systems",
YEAR ="1988",
VOLUME= "2"
}
@incollection{kn:Ott89a,
title ="Fixed Point Analysis
for Recurrent Neural Networks",
booktitle ="Advances in Neural
Information Processing Systems I",
author ="M.B. Ottaway",
editor ="D. Touretzky",
publisher ="Morgan Kauffman",
year ="1989",
}
@inproceedings{kn:Par88a,
author = "K. Park",
title = "Sequential Learning:
Observations on the Internal Code Generation Problem",
booktitle= "Connectionist Models Summer School",
year = "1988"
}
@ARTICLE{kn:Pin87a,
AUTHOR= "F.J. Pineda",
TITLE= "Generalization of Back Propagation to Recurrent
Neural Nets",
JOURNAL= "Physical Review Letters" ,
YEAR= "1987",
VOLUME= "59"
}
@ARTICLE{kn:Pin88b,
AUTHOR= "F.J. Pineda",
TITLE= "Dynamics and Architecture for Neural Computation",
JOURNAL= "Journal of Complexity",
YEAR= "1988",
VOLUME= "4" ,
pages= "216"
}
@inproceedings{kn:Pol87a,
title ="Cascaded Back
Propagation on Dynamic Connectionist Networks",
author ="J. B. Pollack",
booktitle ="9th Ann. Conf. of the Cog. Sci. Soc. ",
year ="1987" ,
page ="391-404",
}
@inproceedings{kn:Pol88a,
title ="Recursive Auto-Associative Memory:
Devising Compositional Distributed
Representations",
author ="J. B. Pollack",
booktitle ="10th Ann.
Conf. of the Cog. Sci. Soc. ",
year ="1988",
page ="33-39"
}
@inproceedings{kn:Ren90a,
title ="Chaos in Neural Networks
",
booktitle ="EURASIP
",
author ="S. Renals",
year ="1990",
volume ="?",
organization ="?"
}
@inproceedings{kn:Roh90a,
title ="The Moving Targets Training
Algorithm",
booktitle ="EURASIP
",
author ="R. Rohwer",
year ="1990",
volume ="?",
organization ="?"
}
@inproceedings{kn:Roh87a,
title ="Training Time-Dependence in
Neural Networks",
booktitle ="1st Int. Conf. on Neural
Networks",
author ="R. Rohwer",
year ="1987",
volume ="?",
organization ="IEEE"
}
@article{kn:Ren90b,
title ="A Study of
Network Dynamics",
author ="S. Renals and R. Rohwer",
journal ="J. Stat. Phys.",
year ="1990",
volume ="In Press",
number ="?",
pages ="?",
}
@ARTICLE{KN:RIED88A,
title ="Temporal Sequences and
Chaos in Neural Networks",
author ="Riedel and others",
journal ="Phys. Rev. A",
year ="1988",
volume ="36",
number ="?",
pages ="1428",
}
@inproceedings{kn:Sch89a,
title ="Networks Adjusting Networks",
author ="J. Schmidhuber",
booktitle ="Distributed Adaptive Neural Infornmation Processing",
year ="1989",
}
@inproceedings{kn:Sch88a,
title ="The Neural Bucket Brigade",
author ="J. Schmidhuber",
booktitle ="International Conference on Connectionism in
Perspective",
year ="1988",
}
@article{kn:Sim88a,
author ="P.Y. Simard and others",
title ="Analysis of Recurrent Back-Propagation",
journal ="Proc. of the Connectionist Models Summer Schools",
year ="1988"
}
@techreport{kn:Slo67a,
author ="N.J. Sloane",
title ="Lengths of Cycle Times
in Random Neural Networks",
number ="10",
institution ="Cornell Un., Cognitive Systems Research Program",
year ="1967"
}
@ARTICLE{KN:SOM88A,
title ="Chaos in Random Neural
Networks",
author ="Sompolinsky and others",
journal ="Phys. Rev. Lett.",
year ="1988",
volume ="61",
number ="?",
pages ="259",
}
@ARTICLE{KN:STO,
AUTHOR= "W.S. Stornetta",
TITLE= "A Dynamical Approach to Temporal Pattern Processing",
JOURNAL= "?",
YEAR= "?",
VOLUME= "?"
}
@ARTICLE{kn:Sun,
AUTHOR= "G.Z. Sun",
TITLE= "A Recurrent Network that learns Context Free Grammars",
JOURNAL= "?",
YEAR= "?",
VOLUME= "?"
}
@article{kn:Sut88a,
title ="Learning to Predict by
the Methods of Temporal Difference",
author ="R.S. Sutton",
journal ="Machine Learning",
year ="1988",
volume ="3",
number ="?",
pages ="9-44",
}
@techreport{kn:Wil88a,
author ="R.J. Williams and D. Zipser",
title ="A Learning Algorithm for Continually
Running Fully Connected Recurrent Neural Networks",
number ="ICS-8805",
institution ="Un. of California at San Diego",
year ="1988"
}
------------end of bibliographic database and of message -------
More information about the Connectionists
mailing list