<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=Windows-1252">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<!--[if !mso]><style>v\:* {behavior:url(#default#VML);}
o\:* {behavior:url(#default#VML);}
w\:* {behavior:url(#default#VML);}
.shape {behavior:url(#default#VML);}
</style><![endif]--><style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Consolas;
panose-1:2 11 6 9 2 2 4 3 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0cm;
font-size:11.0pt;
font-family:"Calibri",sans-serif;
color:windowtext;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:#0563C1;
text-decoration:underline;}
pre
{mso-style-priority:99;
mso-style-link:"HTML Preformatted Char";
margin:0cm;
font-size:10.0pt;
font-family:"Courier New";
color:black;}
span.HTMLPreformattedChar
{mso-style-name:"HTML Preformatted Char";
mso-style-priority:99;
mso-style-link:"HTML Preformatted";
font-family:Consolas;}
span.EmailStyle22
{mso-style-type:personal-reply;
font-family:"Calibri",sans-serif;
color:windowtext;}
span.author
{mso-style-name:author;}
span.pubyear
{mso-style-name:pubyear;}
span.chaptertitle
{mso-style-name:chaptertitle;}
span.editor
{mso-style-name:editor;}
span.booktitle
{mso-style-name:booktitle;}
span.pagefirst
{mso-style-name:pagefirst;}
span.pagelast
{mso-style-name:pagelast;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
/* Page Definitions */
@page
{mso-endnote-separator:url("cid:header.htm\@01D81C30.25299640") es;
mso-endnote-continuation-separator:url("cid:header.htm\@01D81C30.25299640") ecs;}
@page WordSection1
{size:612.0pt 792.0pt;
margin:72.0pt 72.0pt 72.0pt 72.0pt;
mso-footer:url("cid:header.htm\@01D81C30.25299640") f1;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="2050" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="2" />
</o:shapelayout></xml><![endif]-->
</head>
<body bgcolor="#ECCA99" lang="EN-CA" link="#0563C1" vlink="#954F72" style="word-wrap:break-word">
<div class="WordSection1">
<p class="MsoNormal">Dear Stephen, Pau and Others .. The Connectionists list was created for the very exchange of ideas that we now see happening.
<o:p></o:p></p>
<p class="MsoNormal">It is wonderful that working professionals and those in the middle of academic research and applied work are using the list, but the vetting of new scientific ideas and subsequent discourse is what this forum has been about over 30 years.
<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">The current debate, and in some cases re-debate, of the symbolist versus connectionist positions harkens back to discussions in the 1980s and 90s. Of course, we now understand a lot more about the biological mechanisms of learning and
have new theory concerning computational learning. Many of the emails reflect on this. The exchange is wonderful for the silverbacks to review and most certainly for the new researchers to share, discuss and add their own fresh ideas.
<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">This debate has rekindled some of my own thoughts from the past plus a few more recent perspectives. The representation of semantics and their composition into thought can be modeled by:<o:p></o:p></p>
<p class="MsoNormal">(1) the symbolist perspective: symbolic representation and syntactic compositionality; and
<o:p></o:p></p>
<p class="MsoNormal">(2) the connectionist perspective: vectorial representation and composition through superposition.
<o:p></o:p></p>
<p class="MsoNormal">It can be argued that both can explain the systematicity of human thought and thinking, however … symbols and syntactic compositionality is much simpler for human communication. And this has likely been to our detriment in terms of understanding
the function of our nervous systems. It makes sense to me that early AI started with this choice of representation and compositionality, because it is how we exchange information between each other. But it is unlikely this is how our nervous systems function.<o:p></o:p></p>
<p class="MsoNormal">Many simple reptiles and mammals can perform complex tasks without having to manipulate symbols. Although more complex to understand, it is likely that vectorial representation and composition is the basis of how our brains work, and that
symbolic representation and syntactic compositionality developed as a method of sharing concepts and meaning between each other.
<o:p></o:p></p>
<p class="MsoNormal">The evolutionary step that allowed us to explain to a young person (using symbols) how to identify a dangerous insect or animal (using our senses and neural vectors) provided a huge advantage to humans and so it was inherited and expanded
upon over many generations. Eventually, it also provided something else … the ability to organize and “think” about the things we sensed in the world, at least at a coarse level, using symbols and syntactic relations.
<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">My suspicions are that the duality of learning to sense and respond to the world affectively (using vectors) while also learning to explain those senses and actions (using symbols) creates a multiple task learning problem that takes longer
to develop but results in significant benefits - the basis for an agent that can reason and plan over the things it senses and can affect. So currently I am in the camp that believes that our bodies manipulate sense and action vectors and not symbols. However,
we have developed the ability to map “manifolds” of sensory and action vectorial space onto symbols (also represented as vectors within our nervous system) that can be used for communications to others, or conscious reasoning about aspects of the world.
<o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal">Please see the following recent article by Jeff Mitchell and Mirella Lapata that dives much deep into aspects of this at
<a href="https://onlinelibrary.wiley.com/doi/10.1111/j.1551-6709.2010.01106.x">https://onlinelibrary.wiley.com/doi/10.1111/j.1551-6709.2010.01106.x</a>
<o:p></o:p></p>
<p class="MsoNormal">Interestingly, they sight Dedre Gentner’s article of 1989 which originally stimulated my thinking on this in the 1990s<o:p></o:p></p>
<p class="MsoNormal"><span class="author"><span style="color:#1C1D1E;background:#EFEFF0">Gentner, D.</span></span><span style="color:#1C1D1E;background:#EFEFF0"> (<span class="pubyear">1989</span>). <span class="chaptertitle">The mechanisms of analogical learning</span>.
In <span class="editor">S. Vosniadou</span> & <span class="editor">A. Ortony</span> (Eds.), </span><span class="booktitle"><i><span style="color:#1C1D1E;background:#EFEFF0">Similarity and analogical reasoning</span></i></span><span class="booktitle"><span style="color:#1C1D1E;background:#EFEFF0"> (pp. </span></span><span class="pagefirst"><span style="color:#1C1D1E;background:#EFEFF0">199</span></span><span style="color:#1C1D1E;background:#EFEFF0">–<span class="pagelast">241</span>).
Cambridge, England: Cambridge University Press.</span><o:p></o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<div>
<div>
<p class="MsoNormal"><span lang="EN-US" style="color:black">==========================</span><span style="color:black"><o:p></o:p></span></p>
<p class="MsoNormal"><b><span lang="EN-US" style="color:red">Daniel L. Silver </span></b><span style="color:black"><o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="color:black">Professor, Jodrey School of Computer Science</span><span style="color:black"><o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="color:black">Director, Acadia Institute for Data Analytics</span><span style="color:black"><o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="color:black">Acadia University,</span><span style="color:black"><o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="color:black">Office 314, Carnegie Hall, </span><span style="color:black"><o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="color:black">Wolfville, Nova Scotia Canada B4P 2R6</span><span style="color:black"><o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="color:black"> </span><span style="color:black"><o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="color:black">t. (902) 585-1413 </span><span style="color:black"><o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="color:black">f. (902) 585-1067 </span><span style="color:black"><o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="color:black"> </span><span style="color:black"><o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="color:red"><a href="http://www2.acadiau.ca/index.php"><span style="color:red;text-decoration:none">acadiau.ca</span></a></span><span style="color:black"><o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="color:black"><a href="https://www.facebook.com/acadiauniversity" title="https://www.facebook.com/acadiauniversity"><span style="color:black;text-decoration:none">Facebook</span></a> <a href="https://twitter.com/acadiau" title="https://twitter.com/acadiau"><span style="color:black;text-decoration:none">Twitter</span></a> <a href="https://www.youtube.com/user/AcadiaWebmaster"><span style="color:black;text-decoration:none">YouTube</span></a> <a href="https://www.linkedin.com/company/acadia-university?trk=biz-companies-cym"><span style="color:black;text-decoration:none">LinkedIn</span></a> <a href="https://www.flickr.com/photos/acadiauniversity/albums" title="https://www.flickr.com/photos/acadiauniversity/albums"><span style="color:black;text-decoration:none">Flickr</span></a></span><span style="color:black"><o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-US" style="color:black"><img border="0" width="271" height="56" style="width:2.8229in;height:.5833in" id="Picture_x0020_1" src="file:////Users/dannysilver/Library/Containers/com.microsoft.Outlook/Data/Library/Caches/Signatures/signature_1482282077" alt="id:image001.png@01D366AF.7F868A70"></span><span style="color:black"><o:p></o:p></span></p>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
</div>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<p class="MsoNormal"><o:p> </o:p></p>
<div style="border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0cm 0cm 0cm">
<p class="MsoNormal" style="margin-bottom:12.0pt"><b><span style="font-size:12.0pt;color:black">From:
</span></b><span style="font-size:12.0pt;color:black">Connectionists <connectionists-bounces@mailman.srv.cs.cmu.edu> on behalf of Stephen José Hanson <jose@rubic.rutgers.edu><br>
<b>Date: </b>Monday, February 7, 2022 at 10:14 AM<br>
<b>To: </b>pau <pau@ini.uzh.ch>, connectionists@mailman.srv.cs.cmu.edu <connectionists@mailman.srv.cs.cmu.edu><br>
<b>Subject: </b>Re: Connectionists: Please stop having conversations on this mailing list<o:p></o:p></span></p>
</div>
<table class="MsoNormalTable" border="0" cellpadding="0" style="background:#FDF5A7">
<tbody>
<tr>
<td style="padding:.75pt .75pt .75pt .75pt">
<p class="MsoNormal"><strong><span style="font-family:"Calibri",sans-serif;color:black">CAUTION:
</span></strong><span style="color:black">This email comes from outside Acadia. Verify the sender and use caution with any requests, links or attachments.<o:p></o:p></span></p>
</td>
</tr>
</tbody>
</table>
<div>
<p><span style="font-size:13.5pt">Pau,</span><o:p></o:p></p>
<p><span style="font-size:13.5pt">actually this was exactly what Connectionists was created for: civil, thoughtful discussion about Neural Computation.</span><o:p></o:p></p>
<p><span style="font-size:13.5pt">It is very lightly moderated and provides a forum for discussion, promotion and potential collaborations.</span><o:p></o:p></p>
<p><span style="font-size:13.5pt">This discussion has been a bit redundant here and there, but for the most part reconstructing much of the arguments from the 1980s in the background of the DL revolution.</span><o:p></o:p></p>
<p><span style="font-size:13.5pt">Explainable AI, Neuro-Symbolic models and causal structure have been constant concerns of thoughtful folks using, building Neural network systems for 40 years.</span><o:p></o:p></p>
<p><span style="font-size:13.5pt">The threads have gone in predictable ways, but have interesting voices and real issues behind them. Some of this is dialetical (my friend Gary Marcus who is a master at this) and some of it hyperbolic. But all have made
excellent and interesting points.</span><o:p></o:p></p>
<p><span style="font-size:13.5pt">Best Regards,</span><o:p></o:p></p>
<p><span style="font-size:13.5pt">Steve</span><o:p></o:p></p>
<div>
<p class="MsoNormal"><span style="color:black">On 2/5/22 11:29 AM, pau wrote:<o:p></o:p></span></p>
</div>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<pre>Dear connectionists,<o:p></o:p></pre>
<pre><o:p> </o:p></pre>
<pre>To the best of my understanding, the aim of this mailing list is to meet<o:p></o:p></pre>
<pre>the needs of working professionals. I understand by this sharing<o:p></o:p></pre>
<pre>information about events, publications, developments, etc. that can be<o:p></o:p></pre>
<pre>useful for someone who works in this field.<o:p></o:p></pre>
<pre>If someone wants to argue, discuss, praise or assign blame, agree or<o:p></o:p></pre>
<pre>disagree, please do so in private correspondence or in non-work-specific<o:p></o:p></pre>
<pre>social media channels.<o:p></o:p></pre>
<pre><o:p> </o:p></pre>
<pre>Best,<o:p></o:p></pre>
<pre>P.<o:p></o:p></pre>
</blockquote>
<div>
<p class="MsoNormal"><span style="color:black">-- <br>
<img border="0" width="402" height="98" style="width:4.1875in;height:1.0208in" id="_x0000_i1025" src="cid:part1.AC909AA8.0241CDFF@rubic.rutgers.edu"><o:p></o:p></span></p>
</div>
</div>
</div>
</body>
</html>