<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
<style type="text/css" style="display:none;"> P {margin-top:0;margin-bottom:0;} </style>
</head>
<body dir="ltr">
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0); background-color: rgb(255, 255, 255);" class="elementToProof">
The thing that I'm most interested in is how the human works. I believe it is possible to build an equivalent machine but we have not yet achieved that, mainly because we still have a ways to go in neuroscience. If what we've built so far turns out to resemble
the human mind in structure, it is by accident.<br>
</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0); background-color: rgb(255, 255, 255);" class="elementToProof">
<br>
</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0); background-color: rgb(255, 255, 255);" class="elementToProof">
One approach to AI is as a testbed for theories about how the human mind works. Few people share this view with me. Certainly in the present, driven by the funding sources, there is much more focus on applications. Will it sell more ads? Recognize more faces
(or cats)? Etc.</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0); background-color: rgb(255, 255, 255);" class="elementToProof">
<br>
</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0); background-color: rgb(255, 255, 255);" class="elementToProof">
The human mind is not the highest or only measure of "intelligence". There are certainly non-human or superhuman capabilities that we can give artificial agents. And someday when we do fully understand the human mind, we will be able to exceed it by applying
a few tweaks to the model.</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0); background-color: rgb(255, 255, 255);" class="elementToProof">
<br>
</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0); background-color: rgb(255, 255, 255);" class="elementToProof">
The human mind is, well, a mind-boggling mystery. A real scientific understanding would revolutionize philosophy, religion, and perhaps even how we live our lives and treat each other.</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0); background-color: rgb(255, 255, 255);" class="elementToProof">
<br>
</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0); background-color: rgb(255, 255, 255);" class="elementToProof">
It is fascinating that something so cut and dried as a mathematical model, fed by an enormous amount of data, can force us to question basic notions about ourselves. This thing we call thinking, is it unique to us? Is it even real? Can something non-human (animal
or artifact) have an internal mental life?</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0); background-color: rgb(255, 255, 255);" class="elementToProof">
<br>
</div>
<div style="font-family: Calibri, Arial, Helvetica, sans-serif; font-size: 12pt; color: rgb(0, 0, 0); background-color: rgb(255, 255, 255);" class="elementToProof">
I suspect one thing that makes the scientific understanding of human mind difficult is the prior assumptions and cognitive biases we bring to the task. For example, that language (symbolic processing) is the core of intelligence. Or that everything is a hierarchy.
Or that humans have some secret sauce distinct from other animals and machines. <br>
</div>
<br>
<hr tabindex="-1" style="display:inline-block; width:98%">
<div id="divRplyFwdMsg" dir="ltr"><font style="font-size:11pt" face="Calibri, sans-serif" color="#000000"><b>From:</b> Connectionists <connectionists-bounces@mailman.srv.cs.cmu.edu> on behalf of Ingo Bojak <i.bojak@reading.ac.uk><br>
<b>Sent:</b> Monday, March 20, 2023 8:04 AM<br>
<b>To:</b> connectionists@mailman.srv.cs.cmu.edu <connectionists@mailman.srv.cs.cmu.edu><br>
<b>Subject:</b> [EXTERNAL] Re: Connectionists: Can LLMs think?</font>
<div> </div>
</div>
<div style="word-wrap:break-word" lang="EN-GB">
<table style="border:0; display:table; width:100%; table-layout:fixed; border-collapse:seperate; float:none" width="100%" cellspacing="0" cellpadding="0" border="0" align="left">
<tbody style="display:block">
<tr>
<td cellpadding="7px 2px 7px 2px" style="padding:7px 2px 7px 2px; background-color:#A6A6A6" width="1px" valign="middle" bgcolor="#A6A6A6">
</td>
<td cellpadding="7px 5px 7px 15px" color="#212121" style="width:100%; background-color:#EAEAEA; padding:7px 5px 7px 15px; font-family:wf_segoe-ui_normal,Segoe UI,Segoe WP,Tahoma,Arial,sans-serif; font-size:12px; font-weight:normal; color:#212121; text-align:left; word-wrap:break-word" width="100%" valign="middle" bgcolor="#EAEAEA">
<div>You don't often get email from i.bojak@reading.ac.uk. <a href="https://aka.ms/LearnAboutSenderIdentification" data-auth="NotApplicable">
Learn why this is important</a></div>
</td>
<td cellpadding="7px 5px 7px 5px" color="#212121" style="width:75px; background-color:#EAEAEA; padding:7px 5px 7px 5px; font-family:wf_segoe-ui_normal,Segoe UI,Segoe WP,Tahoma,Arial,sans-serif; font-size:12px; font-weight:normal; color:#212121; text-align:left; word-wrap:break-word" width="75px" valign="middle" bgcolor="#EAEAEA" align="left">
</td>
</tr>
</tbody>
</table>
<div>
<div class="x_WordSection1">
<p class="x_MsoNormal" style="margin: 0cm; font-size: 12pt; font-family: "Times New Roman", serif;">
<span style="font-size:11.0pt; font-family:"Calibri",sans-serif">Hi all,</span></p>
<p class="x_MsoNormal" style="margin: 0cm; font-size: 12pt; font-family: "Times New Roman", serif;">
<span style="font-size:11.0pt; font-family:"Calibri",sans-serif"> </span></p>
<p class="x_MsoNormal" style="margin: 0cm; font-size: 12pt; font-family: "Times New Roman", serif;">
<span style="font-size:11.0pt; font-family:"Calibri",sans-serif">I think an important point here is that one should not play a simplistic “subtraction game” concerning human intelligence.</span></p>
<p class="x_MsoNormal" style="margin: 0cm; font-size: 12pt; font-family: "Times New Roman", serif;">
<span style="font-size:11.0pt; font-family:"Calibri",sans-serif"> </span></p>
<p class="x_MsoNormal" style="margin: 0cm; font-size: 12pt; font-family: "Times New Roman", serif;">
<span style="font-size:11.0pt; font-family:"Calibri",sans-serif">To give an analogy: Animals eat. Humans eat. Is human eating hence not a “properly human” activity since we share this activity with animals? No. There is no equivalent to say “fine dining” in
the animal kingdom. Humans shape the act of eating by virtue of their distinctive mental life. Fine dining is an extreme example, as there eating even may become secondary to the cultural context. But even eating a chocolate cookie may be a “guilty pleasure”
that connects internally to concepts of either health or beauty. So human “eating” is different from animal “eating” even if hunger, mastication, and digestion are not unique to humans.</span></p>
<p class="x_MsoNormal" style="margin: 0cm; font-size: 12pt; font-family: "Times New Roman", serif;">
<span style="font-size:11.0pt; font-family:"Calibri",sans-serif"> </span></p>
<p class="x_MsoNormal" style="margin: 0cm; font-size: 12pt; font-family: "Times New Roman", serif;">
<span style="font-size:11.0pt; font-family:"Calibri",sans-serif">As AIs start to copy more and more human performances, likewise one cannot remove various human activities like “writing as essay” as not “properly human”. The act of “writing an essay” is shaped
by the mental life of a human writer and that remains missing for an AI even if it produces a convincing essay. We know this because we have constructed the AI.</span></p>
<p class="x_MsoNormal" style="margin: 0cm; font-size: 12pt; font-family: "Times New Roman", serif;">
<span style="font-size:11.0pt; font-family:"Calibri",sans-serif"> </span></p>
<p class="x_MsoNormal" style="margin: 0cm; font-size: 12pt; font-family: "Times New Roman", serif;">
<span style="font-size:11.0pt; font-family:"Calibri",sans-serif">What all this rather shows is that it is not easy at all, and even may be impossible, to find human activities that can act as unequivocal external signs of an “inner mental life like ours”.</span></p>
<p class="x_MsoNormal" style="margin: 0cm; font-size: 12pt; font-family: "Times New Roman", serif;">
<span style="font-size:11.0pt; font-family:"Calibri",sans-serif"> </span></p>
<p class="x_MsoNormal" style="margin: 0cm; font-size: 12pt; font-family: "Times New Roman", serif;">
<span style="font-size:11.0pt; font-family:"Calibri",sans-serif">But even if AIs eventually can copy all observable human activity convincingly - a big “if” - it does not follow that they are the same as humans. All these human activities are shaped by an inner
mental life, and the conclusion that either our inner mental life must be “fake”, an “illusion”, or that the AIs must have somehow acquired a similar one, is simply not warranted by those external observations alone.
</span></p>
<p class="x_MsoNormal" style="margin: 0cm; font-size: 12pt; font-family: "Times New Roman", serif;">
<span style="font-size:11.0pt; font-family:"Calibri",sans-serif"> </span></p>
<p class="x_MsoNormal" style="margin: 0cm; font-size: 12pt; font-family: "Times New Roman", serif;">
<span style="font-size:11.0pt; font-family:"Calibri",sans-serif">Furthermore, it is hardly original to point out that ultimately the experience of our inner mental life is the only truly reliable information we possess (Descartes, but long before him St Augustine
of Hippo, and long after him the Wachowskis).</span></p>
<p class="x_MsoNormal" style="margin: 0cm; font-size: 12pt; font-family: "Times New Roman", serif;">
<span style="font-size:11.0pt; font-family:"Calibri",sans-serif"> </span></p>
<p class="x_MsoNormal" style="margin: 0cm; font-size: 12pt; font-family: "Times New Roman", serif;">
<span style="font-size:11.0pt; font-family:"Calibri",sans-serif">The Turing test does not provide a touchstone for sapience / human-ness. It is rather a measure of our own ability to detect this status, i.e., it is just a version of CAPTCHA we like to play.
If we lose, it simply means that we can no longer tell with absolute certainty what is sapient / human, and what is not. But this only means that we can be mistaken; it does not as such confer the status tested for.</span></p>
<p class="x_MsoNormal" style="margin: 0cm; font-size: 12pt; font-family: "Times New Roman", serif;">
<span style="font-size:11.0pt; font-family:"Calibri",sans-serif"> </span></p>
<p class="x_MsoNormal" style="margin: 0cm; font-size: 12pt; font-family: "Times New Roman", serif;">
<span style="font-size:11.0pt; font-family:"Calibri",sans-serif">It is interesting that the very fact that we know what goes into AIs that we have constructed means that the Turing test cannot confer “presumed sapient / human” status. We simply know better...
Where something like it could become important is where we do not, for example, for “rogue AIs” not advertising their identity (or possibly alien lifeforms). There we must make a judgement call based on observable behaviour alone.</span></p>
<p class="x_MsoNormal" style="margin: 0cm; font-size: 12pt; font-family: "Times New Roman", serif;">
<span style="font-size:11.0pt; font-family:"Calibri",sans-serif"> </span></p>
<p class="x_MsoNormal" style="margin: 0cm; font-size: 12pt; font-family: "Times New Roman", serif;">
<span style="font-size:11.0pt; font-family:"Calibri",sans-serif">Finally, there never was a good reason to believe that humans have evolved to have sophisticated detection mechanisms for what is human. They never needed to. Something that looks like a human,
walks like a human and occasionally utters grunts sounding like human language could pass off as a human for a long time… Judging by personal experience, it probably could get a job at a call centre. The Turing test always has been a somewhat academic exercise.</span></p>
<p class="x_MsoNormal" style="margin: 0cm; font-size: 12pt; font-family: "Times New Roman", serif;">
<span style="font-size:11.0pt; font-family:"Calibri",sans-serif"> </span></p>
<p class="x_MsoNormal" style="margin: 0cm; font-size: 12pt; font-family: "Times New Roman", serif;">
<span style="font-size:11.0pt; font-family:"Calibri",sans-serif">Best,</span></p>
<p class="x_MsoNormal" style="margin: 0cm; font-size: 12pt; font-family: "Times New Roman", serif;">
<span style="font-size:11.0pt; font-family:"Calibri",sans-serif">Ingo</span></p>
<p class="x_MsoNormal" style="margin: 0cm; font-size: 12pt; font-family: "Times New Roman", serif;">
<span style="font-size:11.0pt; font-family:"Calibri",sans-serif"> </span></p>
<div>
<div style="border:none; border-top:solid #E1E1E1 1.0pt; padding:3.0pt 0cm 0cm 0cm">
<p class="x_MsoNormal" style="margin: 0cm; font-size: 12pt; font-family: "Times New Roman", serif;">
<b><span style="font-size:11.0pt; font-family:"Calibri",sans-serif" lang="EN-US">From:</span></b><span style="font-size:11.0pt; font-family:"Calibri",sans-serif" lang="EN-US"> Connectionists <connectionists-bounces@mailman.srv.cs.cmu.edu>
<b>On Behalf Of </b>Thomas Nowotny<br>
<b>Sent:</b> 20 March 2023 09:48<br>
<b>To:</b> Gary Marcus <gary.marcus@nyu.edu>; Paul Cisek <paul.cisek@umontreal.ca><br>
<b>Cc:</b> connectionists@mailman.srv.cs.cmu.edu<br>
<b>Subject:</b> Re: Connectionists: Can LLMs think?</span></p>
</div>
</div>
<p class="x_MsoNormal" style="margin: 0cm; font-size: 12pt; font-family: "Times New Roman", serif;">
</p>
<p class="x_MsoNormal" style="margin: 0cm; font-size: 12pt; font-family: "Times New Roman", serif;">
<span style="font-size:11.0pt; font-family:"Calibri",sans-serif">Hi Paul and Gary,</span></p>
<p class="x_MsoNormal" style="margin: 0cm; font-size: 12pt; font-family: "Times New Roman", serif;">
<span style="font-size:11.0pt; font-family:"Calibri",sans-serif">I think I am firmly in your camp & well summarised. However, there is this nagging doubt about how much of the human intelligence we attribute to each other and ourselves are the same “</span><span style="font-size:11.0pt; font-family:"Calibri",sans-serif">little
strings and hidden compartments” and “how we just redirected the audience’s attention” that undoubtedly underlie LLMs abilities.</span></p>
<p class="x_MsoNormal" style="margin: 0cm; font-size: 12pt; font-family: "Times New Roman", serif;">
<span style="font-size:11.0pt; font-family:"Calibri",sans-serif">Best,</span></p>
<p class="x_MsoNormal" style="margin: 0cm; font-size: 12pt; font-family: "Times New Roman", serif;">
<span style="font-size:11.0pt; font-family:"Calibri",sans-serif">Thomas Nowotny</span><span style="font-size:11.0pt; font-family:"Calibri",sans-serif"></span></p>
<p class="x_MsoNormal" style="margin: 0cm; font-size: 12pt; font-family: "Times New Roman", serif;">
<span style="font-size:11.0pt; font-family:"Calibri",sans-serif"> </span></p>
<div>
<div style="border:none; border-top:solid #E1E1E1 1.0pt; padding:3.0pt 0cm 0cm 0cm">
<p class="x_MsoNormal" style="margin: 0cm; font-size: 12pt; font-family: "Times New Roman", serif;">
<b><span style="font-size:11.0pt; font-family:"Calibri",sans-serif" lang="EN-US">From:</span></b><span style="font-size:11.0pt; font-family:"Calibri",sans-serif" lang="EN-US"> Connectionists <<a href="mailto:connectionists-bounces@mailman.srv.cs.cmu.edu" data-auth="NotApplicable">connectionists-bounces@mailman.srv.cs.cmu.edu</a>>
<b>On Behalf Of </b>Gary Marcus<br>
<b>Sent:</b> 20 March 2023 08:01<br>
<b>To:</b> Paul Cisek <<a href="mailto:paul.cisek@umontreal.ca" data-auth="NotApplicable">paul.cisek@umontreal.ca</a>><br>
<b>Cc:</b> <a href="mailto:connectionists@mailman.srv.cs.cmu.edu" data-auth="NotApplicable">
connectionists@mailman.srv.cs.cmu.edu</a><br>
<b>Subject:</b> Re: Connectionists: Can LLMs think?</span></p>
</div>
</div>
<p class="x_MsoNormal" style="margin: 0cm; font-size: 12pt; font-family: "Times New Roman", serif;">
</p>
<div>
<p class="x_MsoNormal" style="margin: 0cm; font-size: 12pt; font-family: "Times New Roman", serif;">
bravo!<span style="font-size:11.0pt"></span></p>
</div>
<div>
<p class="x_MsoNormal" style="margin: 0cm; font-size: 12pt; font-family: "Times New Roman", serif;margin-bottom:12.0pt">
</p>
<blockquote style="margin-top:5.0pt; margin-bottom:5.0pt">
<p class="x_MsoNormal" style="margin: 0cm; font-size: 12pt; font-family: "Times New Roman", serif;margin-bottom:12.0pt">
On Mar 20, 2023, at 07:55, Paul Cisek <<a href="mailto:paul.cisek@umontreal.ca" data-auth="NotApplicable">paul.cisek@umontreal.ca</a>> wrote:</p>
</blockquote>
</div>
<blockquote style="margin-top:5.0pt; margin-bottom:5.0pt">
<div>
<p class="x_MsoNormal" style="margin: 0cm; font-size: 12pt; font-family: "Times New Roman", serif;">
<span style="font-family:"Tahoma",sans-serif"></span> <span style="font-size:11.0pt; font-family:"Calibri",sans-serif">
</span></p>
<p class="x_MsoNormal" style="margin: 0cm; font-size: 12pt; font-family: "Times New Roman", serif;">
I must say that I’m somewhat dismayed when I read these kinds of discussions, here or elsewhere. Sure, it’s understandable that many people are fooled into thinking that LLMs are intelligent, just like many people were fooled by Eliza and Eugene Goostman. Humans
are predisposed into ascribing intention and purpose to events in the world, which helped them construct complex societies by (often correctly) interpreting the actions of other people around them. But this same predisposition also led them to believe that
the volcano was angry when it erupted because they did something to offend the gods. Given how susceptible humans are to this false ascription of agency, it is not surprising that they get fooled when something acts in a complex way.</p>
<p class="x_MsoNormal" style="margin: 0cm; font-size: 12pt; font-family: "Times New Roman", serif;">
</p>
<p class="x_MsoNormal" style="margin: 0cm; font-size: 12pt; font-family: "Times New Roman", serif;">
But (most of) the people on this list know what’s under the hood! We know that LLMs are very good at pattern matching and completion, we know about the universal approximation theorem, we know that there is a lot of structure in the pattern of human-written
text, and we know that humans are predisposed to ascribe meaning and intention even where there are none. We should therefore not be surprised that LLMs can produce text patterns that generalize well within-distribution but not so well out-of-distribution,
and that when the former happens, people may be fooled into thinking they are speaking with a thinking being. Again, they were fooled by Eliza, and Eugene Goostman, and the Heider-Simmel illusion (ascribing emotion to animated triangles and circles)… and the
rumblings of volcanos. But we know how LLMs and volcanos do what they do, and can explain their behavior without any additional assumptions (of thinking, or sentience, or whatever). So why add them?</p>
<p class="x_MsoNormal" style="margin: 0cm; font-size: 12pt; font-family: "Times New Roman", serif;">
</p>
<p class="x_MsoNormal" style="margin: 0cm; font-size: 12pt; font-family: "Times New Roman", serif;">
In a sense, we are like a bunch of professional magicians, who know where all of the little strings and hidden compartments are, and who know how we just redirected the audience’s attention to slip the card into our pocket… but then we are standing around backstage
wondering: “Maybe there really is magic?”</p>
<p class="x_MsoNormal" style="margin: 0cm; font-size: 12pt; font-family: "Times New Roman", serif;">
</p>
<p class="x_MsoNormal" style="margin: 0cm; font-size: 12pt; font-family: "Times New Roman", serif;">
I think it’s not that machines have passed the Turing Test, but rather that we failed it.</p>
<p class="x_MsoNormal" style="margin: 0cm; font-size: 12pt; font-family: "Times New Roman", serif;">
</p>
<p class="x_MsoNormal" style="margin: 0cm; font-size: 12pt; font-family: "Times New Roman", serif;">
Paul Cisek</p>
<p class="x_MsoNormal" style="margin: 0cm; font-size: 12pt; font-family: "Times New Roman", serif;">
<span style="font-size:11.0pt; font-family:"Calibri",sans-serif" lang="EN-CA"> </span></p>
<p class="x_MsoNormal" style="margin: 0cm; font-size: 12pt; font-family: "Times New Roman", serif;">
<span style="font-size:11.0pt; font-family:"Calibri",sans-serif" lang="EN-CA"> </span></p>
<div>
<div style="border:none; border-top:solid #E1E1E1 1.0pt; padding:3.0pt 0cm 0cm 0cm">
<p class="x_MsoNormal" style="margin: 0cm; font-size: 12pt; font-family: "Times New Roman", serif;">
<b><span style="font-size:11.0pt; font-family:"Calibri",sans-serif">From:</span></b><span style="font-size:11.0pt; font-family:"Calibri",sans-serif"> Rothganger, Fredrick <<a href="mailto:frothga@sandia.gov" data-auth="NotApplicable">frothga@sandia.gov</a>>
<br>
<b>Sent:</b> Thursday, March 16, 2023 11:39 AM<br>
<b>To:</b> <a href="mailto:connectionists@mailman.srv.cs.cmu.edu" data-auth="NotApplicable">
connectionists@mailman.srv.cs.cmu.edu</a><br>
<b>Subject:</b> Connectionists: Can LLMs think?</span></p>
</div>
</div>
<p class="x_MsoNormal" style="margin: 0cm; font-size: 12pt; font-family: "Times New Roman", serif;">
</p>
<div>
<p class="x_MsoNormal" style="margin: 0cm; font-size: 12pt; font-family: "Times New Roman", serif;background:white">
<span style="font-family:"Calibri",sans-serif; color:black">Noting the examples that have come up on this list over the last week, it's interesting that it takes some of the most brilliant AI researchers in the world to devise questions that break LLMs. Chatbots
have always been able to fool some people some of the time, ever since ELIZA. But we now have systems that can fool a lot of people a lot of the time, and even the occasional expert who loses their perspective and comes to believe the system is sentient. LLMs
have either already passed the classic Turning test, or are about to in the next generation.</span></p>
</div>
<div>
<p class="x_MsoNormal" style="margin: 0cm; font-size: 12pt; font-family: "Times New Roman", serif;background:white">
<span style="font-family:"Calibri",sans-serif; color:black"> </span></p>
</div>
<div>
<p class="x_MsoNormal" style="margin: 0cm; font-size: 12pt; font-family: "Times New Roman", serif;background:white">
<span style="font-family:"Calibri",sans-serif; color:black">What does that mean exactly? Turing's expectation was that "the use of words and general educated opinion will have altered so much that one will be able to speak of machines thinking without expecting
to be contradicted". The ongoing discussion here is an indication that we are approaching that threshold. For the average person, we've probably already passed it.</span></p>
</div>
<p class="x_MsoNormal" style="margin: 0cm; font-size: 12pt; font-family: "Times New Roman", serif;">
</p>
</div>
</blockquote>
</div>
</div>
</div>
</body>
</html>