<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
</head>
<body style="word-wrap: break-word; -webkit-nbsp-mode: space; line-break: after-white-space;" class="">
<div class="" style="margin: 0px; font-stretch: normal; line-height: normal; font-family: "Helvetica Neue";">
<div class="" style="margin: 0px; font-stretch: normal; line-height: normal;"><b class="">Location</b>: Cardiff, UK</div>
<div class="" style="margin: 0px; font-stretch: normal; line-height: normal;"><b class="">Deadline for applications</b>: 11th May 2021</div>
<div class="" style="margin: 0px; font-stretch: normal; line-height: normal;"><b class="">Start date</b>: 1st August</div>
<div class="" style="margin: 0px; font-stretch: normal; line-height: normal;"><b class="">Duration</b>: 36 months</div>
<div class="" style="margin: 0px; font-stretch: normal; line-height: normal;"><b class="">Keywords</b>: Lexical semantics, commonsense reasoning, learning & reasoning</div>
</div>
<div class="" style="margin: 0px; font-stretch: normal; line-height: normal; font-family: "Helvetica Neue";">
<br class="">
</div>
<div class="" style="margin: 0px; font-stretch: normal; line-height: normal; font-family: "Helvetica Neue";">
<b class="">Details about the post</b></div>
<div class="" style="margin: 0px; font-stretch: normal; line-height: normal; font-family: "Helvetica Neue";">
We are looking for a postdoctoral research associate to work on the EPSRC funded project “Encyclopedic Lexical Representations for Natural Language Processing (ELEXIR)”. The aim of this project is to learn vector space embeddings that capture fine-grained knowledge
about concepts. Different from existing approaches, these representations will explicitly represent the properties of, and relationships between concepts. Vectors in the proposed framework will thus intuitively play the role of facts, about which we can reason
in a principled way. More details about this post can be found at:</div>
<div class="" style="margin: 0px; font-stretch: normal; line-height: normal; font-family: "Helvetica Neue";">
<br class="">
</div>
<div class="" style="margin: 0px; font-stretch: normal; line-height: normal; font-family: "Helvetica Neue";">
<a href="https://krb-sjobs.brassring.com/TGnewUI/Search/home/HomeWithPreLoad?partnerid=30011&siteid=5460&PageType=JobDetails&jobid=1807387#jobDetails=1807387_5460" class="">https://krb-sjobs.brassring.com/TGnewUI/Search/home/HomeWithPreLoad?partnerid=30011&siteid=5460&PageType=JobDetails&jobid=1807387#jobDetails=1807387_5460</a></div>
<div class="" style="margin: 0px; font-stretch: normal; line-height: normal; font-family: "Helvetica Neue";">
<br class="">
</div>
<div class="" style="margin: 0px; font-stretch: normal; line-height: normal; font-family: "Helvetica Neue";">
<b class="">Background about the ELEXIR project</b></div>
<div class="" style="margin: 0px; font-stretch: normal; line-height: normal; font-family: "Helvetica Neue";">
The field of Natural Language Processing (NLP) has made unprecedented progress over the last decade, but the extent to which NLP systems “understand” language is still remarkably limited. A key underlying problem is the need for a vast amount of world knowledge.
In this project, we focus on conceptual knowledge, and more in particular on: </div>
<p class="" style="margin: 0px; font-stretch: normal; line-height: normal; font-family: "Helvetica Neue";">
</p>
<div class="" style="margin: 0px; font-stretch: normal; line-height: normal; font-family: "Helvetica Neue";">
(i) capturing what properties are associated with a given concept (e.g. lions are dangerous, boats can float); </div>
<div class="" style="margin: 0px; font-stretch: normal; line-height: normal; font-family: "Helvetica Neue";">
(ii) characterising how different concepts are related (e.g. brooms are used for cleaning, bees produce honey).</div>
<p class="" style="margin: 0px; font-stretch: normal; line-height: normal; font-family: "Helvetica Neue";">
</p>
<div class="" style="margin: 0px; font-stretch: normal; line-height: normal; font-family: "Helvetica Neue";">
Our proposed approach relies on the fact that Wikipedia contains a wealth of such knowledge. Unfortunately, however, important properties and relationships are often not explicitly mentioned in text, especially if they follow straightforwardly from other information
for a human reader (e.g. if X is an animal that can fly then X probably has wings). Apart from learning to extract knowledge expressed in text, we thus also have to learn how to reason about conceptual knowledge.</div>
<p class="" style="margin: 0px; font-stretch: normal; line-height: normal; font-family: "Helvetica Neue";">
</p>
<div class="" style="margin: 0px; font-stretch: normal; line-height: normal; font-family: "Helvetica Neue";">
A central question is how conceptual knowledge should be represented and incorporated in language model architectures. Current NLP systems heavily rely on vector representations in which each concept is represented by a single vector. This approach has important
theoretical limitations in terms of what knowledge can be captured, and it only allows for shallow forms of reasoning. In contrast, in symbolic AI, conceptual knowledge is typically represented using facts and rules. This enables powerful forms of reasoning,
but symbolic representations are harder to learn and to use in neural networks.</div>
<p class="" style="margin: 0px; font-stretch: normal; line-height: normal; font-family: "Helvetica Neue";">
</p>
<div class="" style="margin: 0px; font-stretch: normal; line-height: normal; font-family: "Helvetica Neue";">
The solution we propose relies on a novel hybrid representation framework, which combines the main advantages of vector representations with those of symbolic methods. In particular, we will explicitly represent properties and relationships, as in symbolic
frameworks, but these properties and relations will be encoded as vectors. Each concept will thus be associated with several property vectors, while pairs of related concepts will be associated with one or more relation vectors. Our vectors will thus intuitively
play the same role that facts play in symbolic frameworks, with associated neural network models then playing the role of rules.</div>
</body>
</html>