<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=utf-8">
</head>
<body>
<div style="font-family: inherit; font-size: inherit; color: rgb(0, 0, 0); background-color: transparent;">
</div>
<div>Not sure i agree </div>
<div>But let me read the paper </div>
<div><br>
</div>
<div>Thanks </div>
<div>Stephen </div>
<hr style="display:inline-block;width:98%" tabindex="-1">
<div id="divRplyFwdMsg" dir="ltr"><font face="Calibri, sans-serif" style="font-size:11pt" color="#000000"><b>From:</b> Asim Roy <ASIM.ROY@asu.edu><br>
<b>Sent:</b> Wednesday, June 5, 2024 6:49 PM<br>
<b>To:</b> Stephen José Hanson <jose@rubic.rutgers.edu>; Gary Marcus <gary.marcus@nyu.edu><br>
<b>Cc:</b> connectionists@mailman.srv.cs.cmu.edu <connectionists@mailman.srv.cs.cmu.edu><br>
<b>Subject:</b> RE: Connectionists: short Op-ed to address AI problems</font>
<div> </div>
</div>
<style>
<!--
@font-face
{font-family:Helvetica}
@font-face
{font-family:"Cambria Math"}
@font-face
{font-family:Calibri}
@font-face
{font-family:Aptos}
@font-face
{font-family:Consolas}
@font-face
{font-family:Tahoma}
p.x_MsoNormal, li.x_MsoNormal, div.x_MsoNormal
{margin:0in;
font-size:12.0pt;
font-family:"Aptos",sans-serif;
color:black}
a:link, span.x_MsoHyperlink
{color:blue;
text-decoration:underline}
pre
{margin:0in;
font-size:10.0pt;
font-family:"Courier New";
color:black}
span.x_HTMLPreformattedChar
{font-family:"Consolas",serif;
color:black}
span.x_EmailStyle21
{font-family:"Aptos",sans-serif;
color:windowtext}
.x_MsoChpDefault
{font-size:10.0pt}
@page WordSection1
{margin:1.0in 1.0in 1.0in 1.0in}
div.x_WordSection1
{}
-->
</style>
<div lang="EN-US" link="blue" vlink="purple" style="background-color:#EDEAC4; word-wrap:break-word">
<div class="x_WordSection1">
<p class="x_MsoNormal"><span style="font-size:11.0pt; color:windowtext">Dear Stephen,</span></p>
<p class="x_MsoNormal"><span style="font-size:11.0pt; color:windowtext"> </span></p>
<p class="x_MsoNormal"><span style="font-size:11.0pt; color:windowtext">We are doing neurosymbolic with image processing – the symbolic stuff on top of a DL model. It also brings in the explanation side. The results are astounding. We get better performance
than a pure DL model. And exploring applications with defense agencies. They are impressed with the results we have so far. So, neurosymbolic is definitely the way forward.
</span></p>
<p class="x_MsoNormal"><span style="font-size:11.0pt; color:windowtext"> </span></p>
<p class="x_MsoNormal"><span style="font-size:11.0pt; color:windowtext">Best,</span></p>
<p class="x_MsoNormal"><span style="font-size:11.0pt; color:windowtext">Asim Roy</span></p>
<p class="x_MsoNormal"><span style="font-size:11.0pt; color:windowtext">Professor, Information Systems</span></p>
<p class="x_MsoNormal"><span style="font-size:11.0pt; color:windowtext">Arizona State University</span></p>
<p class="x_MsoNormal"><a href="https://search.asu.edu/profile/9973" originalsrc="https://search.asu.edu/profile/9973" shash="d+zKG+Dr5BWbdr9T4iKV+LBiy92SaY963YH7ugQCtCq1G3XIRvWdpzoXBBdNeMZq3NAg7fwXCuTLqPaC/m8Mq2YphkaJDp5Bo/+UUWOnGEKkw1IvIfyvH2lb6eMwD7H9WwmNkBSCSIK5ghlahD2alchK3xbO3cVpBiXP+EFqnpA=">Asim
Roy | ASU Search</a></p>
<p class="x_MsoNormal"><a href="https://lifeboat.com/ex/bios.asim.roy" originalsrc="https://lifeboat.com/ex/bios.asim.roy" shash="McRvTuoU4iZV71WDI2RqHSiBZ2/AjxXJ3hMChxCttXSzdcH3gU40CXtfSO/aTZF96+Dl+l3LKwd1V+wXbQeDlVXsen873DWFSQBqOrm8Fz7W45C9isiAqNmnwYRtreiu4YJQnu+6hVg6YGzt3RVBwHZ6FxqX1YyCaFicsg5AeIM=">Lifeboat
Foundation Bios: Professor Asim Roy</a><span style="font-size:11.0pt; color:windowtext"></span></p>
<p class="x_MsoNormal"><span style="font-size:11.0pt; color:windowtext"> </span></p>
<div>
<div style="border:none; border-top:solid #E1E1E1 1.0pt; padding:3.0pt 0in 0in 0in">
<p class="x_MsoNormal"><b><span style="font-size:11.0pt; font-family:"Calibri",sans-serif; color:windowtext">From:</span></b><span style="font-size:11.0pt; font-family:"Calibri",sans-serif; color:windowtext"> Connectionists <connectionists-bounces@mailman.srv.cs.cmu.edu>
<b>On Behalf Of </b>Stephen José Hanson<br>
<b>Sent:</b> Wednesday, June 5, 2024 6:06 AM<br>
<b>To:</b> Gary Marcus <gary.marcus@nyu.edu><br>
<b>Cc:</b> connectionists@mailman.srv.cs.cmu.edu<br>
<b>Subject:</b> Re: Connectionists: short Op-ed to address AI problems</span></p>
</div>
</div>
<p class="x_MsoNormal"> </p>
<p>Dear Flabbergasted:</p>
<p>Thankyou, I endeavor to provide short but useful commentary that could be considered a "work of art". Graci!</p>
<p>Now either my memory is failing since 2017(not impossible), or you are smoothing over a time series of claims that are actually like a seesaw.</p>
<p>I think if we just rewind some of the connectionist comments; it would be clear, in fact, for example, you had a long series of comments with Geoff that seemed to indicate you were being misreprented as well. Your complaints have always be around the fact
that DL-AI has false alarms (and to be fair other problems) And sometimes pretty odd-ones. LLMs human and non-human errors are even more interesting. The fact that they seem to grow circuits in the attention-heads is gobsmacking! I thought then and think
now you are complaining about peas under a very thick mattress (oh-oh, metaphors now- I may have opened pandora's box.)</p>
<p>But I will go look at the budding NeuroSymbolic paper you mentioned, but I have my doubts that the statistical bias is equivalent with the architectually simplistic LLMs. Nonetheless, I have not read it.</p>
<p>I will also make a coarse timeline of your comments since 2017, but anyone out there that would like to help, greatly appreciated!</p>
<p>Best,</p>
<p>Stephen</p>
<div>
<p class="x_MsoNormal">On 6/5/24 8:41 AM, Gary Marcus wrote:</p>
</div>
<blockquote style="margin-top:5.0pt; margin-bottom:5.0pt">
<div>
<p class="x_MsoNormal">Wow, Stephen, you have outdone yourself. This note is a startling mixture of rude, condescending, inaccurate, and uninformed. A work of art! </p>
</div>
<div>
<p class="x_MsoNormal"> </p>
</div>
<div>
<p class="x_MsoNormal">To correct four misunderstandings:</p>
</div>
<div>
<p class="x_MsoNormal">1. Yes, my essay was written before LLMs were popular (though around the time Transformers were proposed as it happens). It was however
<i>precisely</i> “ a moonshot idea, that doesn't involve leaving the blackbox in the hands of corporate types who value profits over knowledge.” Please read what I wrote. It’s one page, linked below, and you obviously couldn’t be bothered,. (Parenthetically,
I was one of the first people to warn that OpenAI was likely to be problematic, and have done so repeatedly at my Substack.)</p>
</div>
<div>
<p class="x_MsoNormal">2. My argument throughout (back to 2012, in the New Yorker, 2018 in my Deep Learning: A Critical Appraisal, etc) has been that deep learning has some role but cannot solve all things, and that it would be not reliable on its own. In 2019
onwards I emphasized many of the social problems that arise from relying on such unreliable architectures. I have never wavered from any of that. (Again, please read my work before so grossly distorting it.) Unreliable systems that are blind to truth and values
can cause harm (bias), be exploited (to create disinformation), etc. There is absolutely no contradiction there, as I have explained numerous times in my writings.</p>
</div>
<div>
<p class="x_MsoNormal">3. It’s truly rude to dismiss an entire field as “flotsam and jetsam”, and you obviously aren’t following the neurosymbolic literature, e.g., you must have missed DeepMind’s neurosymbolic AlphaGeometry paper, in Nature, with its state
of the art results, beating pure neural nets.</p>
</div>
<div>
<p class="x_MsoNormal">4. Again, nothing has changed about my view; your last remark is gratuitous and based on a misunderstanding.</p>
</div>
<div>
<p class="x_MsoNormal"> </p>
</div>
<div>
<p class="x_MsoNormal">Truly flabbergasted,</p>
</div>
<div>
<p class="x_MsoNormal">Gary</p>
</div>
<div>
<p class="x_MsoNormal"><br>
<br>
</p>
<blockquote style="margin-top:5.0pt; margin-bottom:5.0pt">
<p class="x_MsoNormal" style="margin-bottom:12.0pt">On Jun 5, 2024, at 05:18, Stephen José Hanson
<a href="mailto:jose@rubic.rutgers.edu"><jose@rubic.rutgers.edu></a> wrote:</p>
</blockquote>
</div>
<blockquote style="margin-top:5.0pt; margin-bottom:5.0pt">
<div>
<p class="x_MsoNormal"><span style="font-family:"Tahoma",sans-serif"></span> </p>
<p>Gary, this was before the LLM discovery. Pierre is proposing a moonshot idea, that doesn't involve leaving the blackbox in the hands of corporate types who value profits over knowledge. OPENAI seems to be flailing and having serious safety and security
issues. It certainly could be recipe for diaster.</p>
<p>Frankly your views have been all over the place. DL doesn't work, DL could work but should be merged with the useless flotsam and jetsam from GOFAI over the last 50 years, and now they are too dangerous because they work but they are unreliable, like most
humans.</p>
<p>Its hard to know what views of yours to take seriously as they seem change so rapidly.
</p>
<p>Cheers</p>
<p>Stephen</p>
<div>
<p class="x_MsoNormal">On 6/4/24 9:53 AM, Gary Marcus wrote:</p>
</div>
<blockquote style="margin-top:5.0pt; margin-bottom:5.0pt">
<div>
<p class="x_MsoNormal">I would just point out that I first made this suggestion [CERN for AI] in the New York Times in 2017, and several others have since. There is some effort ongoing to try to make it happen, if you search you will see.</p>
</div>
<div>
<p class="x_MsoNormal"> </p>
</div>
<div>
<div>
<div>
<table class="x_MsoNormalTable" border="0" cellspacing="0" cellpadding="0" width="300" style="width:225.0pt; background:#E9E9EB; border-collapse:collapse">
<tbody>
<tr>
<td style="padding:0in 0in 0in 0in">
<div>
<p class="x_MsoNormal" align="center" style="text-align:center"><span style="font-family:"Helvetica",sans-serif"><30gray-facebookJumbo.jpg></span></p>
</div>
</td>
</tr>
<tr>
<td style="padding:0in 0in 0in 0in">
<table class="x_MsoNormalTable" border="0" cellspacing="0" cellpadding="0" width="300" style="width:225.0pt; background:#E9E9EB; background-color:rgba(233,233,235,1)">
<tbody>
<tr>
<td style="padding:6.0pt 0in 6.0pt 0in; background-color:rgba(233,233,235,1)">
<div style="margin-left:12.0pt; margin-right:12.0pt; max-width:100%; overflow:hidden">
<p class="x_MsoNormal"><span style="font-size:9.0pt; font-family:"Helvetica",sans-serif"><a href="https://urldefense.proofpoint.com/v2/url?u=https-3A__www.nytimes.com_2017_07_29_opinion_sunday_artificial-2Dintelligence-2Dis-2Dstuck-2Dheres-2Dhow-2Dto-2Dmove-2Dit-2Dforward.html-3Funlocked-5Farticle-5Fcode-3D1.xE0.mcIz.lT-5FK7BZdonGJ-26smid-3Dnytcore-2Dios-2Dshare-26referringSource-3DarticleShare-26u2g-3Di-26sgrp-3Dc-2Dcb&d=DwMGaQ&c=slrrB7dE8n7gBJbeO0g-IQ&r=wQR1NePCSj6dOGDD0r6B5Kn1fcNaTMg7tARe7TdEDqQ&m=fwBsbQ5xjEJFDg3c0iXuOBcr84mxEGxR0cEG4-hstVM8dJNyq3HVvpCACElUGWT2&s=TGZDkK1TsB_rNyjmal5jG1694upjB2JDhtj3UOe4Cws&e=" originalsrc="https://urldefense.proofpoint.com/v2/url?u=https-3A__www.nytimes.com_2017_07_29_opinion_sunday_artificial-2Dintelligence-2Dis-2Dstuck-2Dheres-2Dhow-2Dto-2Dmove-2Dit-2Dforward.html-3Funlocked-5Farticle-5Fcode-3D1.xE0.mcIz.lT-5FK7BZdonGJ-26smid-3Dnytcore-2Dios-2Dshare-26referringSource-3DarticleShare-26u2g-3Di-26sgrp-3Dc-2Dcb&d=DwMGaQ&c=slrrB7dE8n7gBJbeO0g-IQ&r=wQR1NePCSj6dOGDD0r6B5Kn1fcNaTMg7tARe7TdEDqQ&m=fwBsbQ5xjEJFDg3c0iXuOBcr84mxEGxR0cEG4-hstVM8dJNyq3HVvpCACElUGWT2&s=TGZDkK1TsB_rNyjmal5jG1694upjB2JDhtj3UOe4Cws&e=" shash="CX8KYpjoxZOXagWjt4yg/voLlvCgB1jksh/AduZkIVrTfiGfHLMq0/9jLvSHMClP5140+WybU7H8MkEFSHKn+2zrCvhSnSdr2Y14B/b/8AHQFykbFmHsznbEokXO91tr4Fusu7eTGZAp03rgvraVq1AQKp0JM0deIwCojTxbqhU="><span style="color:black; text-decoration:none">Opinion
| Artificial Intelligence Is Stuck. Here’s How to Move It Forward. (Gift Article)</span></a></span></p>
<p class="x_MsoNormal"><span style="font-size:8.5pt; font-family:"Helvetica",sans-serif"><a href="https://urldefense.proofpoint.com/v2/url?u=https-3A__www.nytimes.com_2017_07_29_opinion_sunday_artificial-2Dintelligence-2Dis-2Dstuck-2Dheres-2Dhow-2Dto-2Dmove-2Dit-2Dforward.html-3Funlocked-5Farticle-5Fcode-3D1.xE0.mcIz.lT-5FK7BZdonGJ-26smid-3Dnytcore-2Dios-2Dshare-26referringSource-3DarticleShare-26u2g-3Di-26sgrp-3Dc-2Dcb&d=DwMGaQ&c=slrrB7dE8n7gBJbeO0g-IQ&r=wQR1NePCSj6dOGDD0r6B5Kn1fcNaTMg7tARe7TdEDqQ&m=fwBsbQ5xjEJFDg3c0iXuOBcr84mxEGxR0cEG4-hstVM8dJNyq3HVvpCACElUGWT2&s=TGZDkK1TsB_rNyjmal5jG1694upjB2JDhtj3UOe4Cws&e=" originalsrc="https://urldefense.proofpoint.com/v2/url?u=https-3A__www.nytimes.com_2017_07_29_opinion_sunday_artificial-2Dintelligence-2Dis-2Dstuck-2Dheres-2Dhow-2Dto-2Dmove-2Dit-2Dforward.html-3Funlocked-5Farticle-5Fcode-3D1.xE0.mcIz.lT-5FK7BZdonGJ-26smid-3Dnytcore-2Dios-2Dshare-26referringSource-3DarticleShare-26u2g-3Di-26sgrp-3Dc-2Dcb&d=DwMGaQ&c=slrrB7dE8n7gBJbeO0g-IQ&r=wQR1NePCSj6dOGDD0r6B5Kn1fcNaTMg7tARe7TdEDqQ&m=fwBsbQ5xjEJFDg3c0iXuOBcr84mxEGxR0cEG4-hstVM8dJNyq3HVvpCACElUGWT2&s=TGZDkK1TsB_rNyjmal5jG1694upjB2JDhtj3UOe4Cws&e=" shash="g6Vt47OOi1zrj9xoNod5unm4EPnEEJlsaZxdtAQDv+CVVqW1wG78FSB9uZFbwM4mRbjN/71A8uyBSzhHjKOlG/EKTAl5Y0DRkQTwcGgoz80u5uYnPcud4bjF/3ltp+QaCQFpx2jMyn5uXsax1bdKEoiDcJIg478q0AlCjJw3Shk="><span style="color:#A2A2A9; text-decoration:none">nytimes.com</span></a></span></p>
</div>
</td>
</tr>
</tbody>
</table>
</td>
</tr>
</tbody>
</table>
</div>
</div>
<p class="x_MsoNormal"> </p>
</div>
<div>
<p class="x_MsoNormal"><br>
<br>
</p>
<blockquote style="margin-top:5.0pt; margin-bottom:5.0pt">
<p class="x_MsoNormal" style="margin-bottom:12.0pt">On Jun 3, 2024, at 22:58, Baldi,Pierre
<a href="mailto:pfbaldi@ics.uci.edu"><pfbaldi@ics.uci.edu></a> wrote:</p>
</blockquote>
</div>
<blockquote style="margin-top:5.0pt; margin-bottom:5.0pt">
<div>
<p class="x_MsoNormal" style="margin-bottom:12.0pt"><span style="font-family:"Tahoma",sans-serif"></span><br>
I would appreciate feedback from this group,especially dissenting feedback, on the attached Op-ed. You can send it to my personal email which you can find on my university web site if you prefer. The basic idea is simple:<br>
<br>
IF for scientific, security, or other societal reasons we want academics to develop and study the most advanced forms of AI, I can see only one solution: create a national or international effort around the largest data/computing center on Earth with a CERN-like
structure comprising permanent staff, and 1000s of affiliated academic laboratories. There are many obstacles, but none is completely insurmountable if we wanted to.<br>
<br>
Thank you.<br>
<br>
Pierre<br>
<br>
<br>
<br>
<br>
</p>
<div>
<p class="x_MsoNormal"><AI-CERN-Baldi2024FF.pdf></p>
</div>
</div>
</blockquote>
</blockquote>
<pre>-- </pre>
<pre>Stephen José Hanson</pre>
<pre>Professor of Psychology</pre>
<pre>Director of RUBIC</pre>
<pre>Member of Exc Comm RUCCS</pre>
</div>
</blockquote>
</blockquote>
<pre>-- </pre>
<pre>Stephen José Hanson</pre>
<pre>Professor of Psychology</pre>
<pre>Director of RUBIC</pre>
<pre>Member of Exc Comm RUCCS</pre>
</div>
</div>
</body>
</html>