Announcement of paper on learning syntactic categories.

Steve Finch steve at cogsci.edinburgh.ac.uk
Fri Nov 8 13:34:00 EST 1991


I have submitted a copy of a paper Nick Chater and I have written, to
the neuroprose archive. It details a hybrid system comprising a
statistically motivated network and a symbolic clustering mechanism
which together automatically classify words into a syntactic hierachy
by imposing a similarity metric over the contexts in which they are
observed to have occured in USENET newsgroup articles. The resulting
categories are very linguistically intuitive.

The abstract follows:

Symbolic and neural network architectures differ with respect to the
representations they naturally handle.  Typically, symbolic systems
use trees, DAGs, lists and so on, whereas networks typically use high
dimensional vector spaces.  Network learning methods may therefore
appear to be inappropriate in domains, such as natural language, which
are naturally modelled using symbolic methods. One reaction is to
argue that network methods are able to {\it implicitly} capture this
symbolic structure, thus obviating the need for explicit symbolic
representation.  However, we argue that the {\it explicit}
representation of symbolic structure is an important goal, and can be
learned using a hybrid approach, in which statistical structure
extracted by a network is transformed into a symbolic representation.
We apply this approach at several levels of linguistic structure,
using as input unlabelled orthographic, phonological and word-level
strings. We derive linguistically interesting categories such as
`noun', `verb', `preposition', and so on from unlabeled text.

To get it by anonymous ftp type

ftp archive.cis.ohio-state.edu

when asked for login name type anonymous; when asked for password type
neuron. 

Then type

cd pub/neuroprose
binary
get finch.hybrid.ps.Z
quit

Then uncompress it and lpr it.

------------------------------------------------------------------------------
Steven Finch   Phone: +44 31 650 4435           | University of Edinburgh


More information about the Connectionists mailing list