<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40"><head><meta http-equiv=Content-Type content="text/html; charset=utf-8"><meta name=Generator content="Microsoft Word 15 (filtered medium)"><style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Tahoma;
panose-1:2 11 6 4 3 5 4 4 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman",serif;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
p.msonormal0, li.msonormal0, div.msonormal0
{mso-style-name:msonormal;
mso-margin-top-alt:auto;
margin-right:0in;
mso-margin-bottom-alt:auto;
margin-left:0in;
font-size:12.0pt;
font-family:"Times New Roman",serif;}
span.EmailStyle18
{mso-style-type:personal-reply;
font-family:"Calibri",sans-serif;
color:#1F497D;}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]--></head><body lang=EN-US link=blue vlink=purple><div class=WordSection1><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D'>Geoff, I have done the equivalent of switching sides over here. Long ago, I was recruited by Ray Kurzweil and Peter Diamandis to head academics for Singularity University and considered Elon Musk a friend of sorts. Now you see me teaming up with Gary to challenge Elon and the futurists who proclaim that AGI is almost here. <o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D'><o:p> </o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D'>It isn’t that I don’t believe that these models will evolve and do some things which seem amazing, it is because I have realized that Gary and others are right: “these systems aren’t stable or trustworthy; a crumbling house follows from a rotten foundation”. With all the hype that is being generated by people like Andreessen and Musk, the investments are going into wasteful things like crypto/NFTs and the imaginary Web3. We are being distracted from the problems that flawed AI data models have created with privacy and security — and inequity. <o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D'><o:p> </o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D'>In this piece I wrote for India’s Hindustan Times, for example, I talked for the first time about Tesla’s dangerous FSD: <a href="https://www.hindustantimes.com/opinion/why-india-is-better-off-without-musk-and-tesla-101654787059810.html">https://www.hindustantimes.com/opinion/why-india-is-better-off-without-musk-and-tesla-101654787059810.html</a>. By making unrealistic claims about the imminence of AGI, Elon is very skillfully changing the subject. The fact is that not only are the Tesla’s sensors inadequate, so are its AI models. The car will never have a safe FSD. And if Elon’s robots are as flawed as his car’s AI systems are, they will be killing their owners the moment they get shouted at. <o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D'><o:p> </o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D'>I have no doubt that in this decade, you will never trust an AI to look after your children or grandchildren. I would be surprised if anyone really believes that at least in the next two decades, computers will have any form of sentience or the stuff we saw in science fiction. <o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D'><o:p> </o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D'>Regards,<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D'><o:p> </o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D'>Vivek Wadhwa<o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri",sans-serif;color:black'>Former Distinguished Fellow at Harvard Law School, Carnegie Mellon School of Engineering, and Emory University; Fellow at Stanford Law and UC-Berkeley; adjunct professor at Duke University and Carnegie Mellon University; and VP of Academics at Singularity University</span><span style='font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D'><o:p></o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri",sans-serif;color:black'>Website: </span><span style='font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D'><a href="https://urldefense.com/v3/__http:/www.wadhwa.com/__;!!KzIVK9q-m3Ij!NoBI3uD3LNL_042u3EMr9kcFuF-cxu7yguX8fuZhj89uf2vTfFcpEPEuWu5ior3dQwk9yJjjvEIGWtt7yII$" target="_blank">www.wadhwa.com</a></span><span style='font-size:11.0pt;font-family:"Calibri",sans-serif;color:black'>, Twitter: </span><span style='font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D'><a href="https://urldefense.com/v3/__http:/twitter.com/wadhwa__;!!KzIVK9q-m3Ij!NoBI3uD3LNL_042u3EMr9kcFuF-cxu7yguX8fuZhj89uf2vTfFcpEPEuWu5ior3dQwk9yJjjvEIGhcr07JY$" target="_blank">@wadhwa</a><o:p></o:p></span></p><p class=MsoNormal style='margin-bottom:12.0pt;background:white'><span style='font-size:11.0pt;font-family:"Calibri",sans-serif;color:black'>Author: <a href="https://urldefense.com/v3/__http:/www.amazon.com/The-Immigrant-Exodus-Entrepreneurial-ebook/dp/B0098P9HKC/__;!!KzIVK9q-m3Ij!NoBI3uD3LNL_042u3EMr9kcFuF-cxu7yguX8fuZhj89uf2vTfFcpEPEuWu5ior3dQwk9yJjjvEIGawghaE4$" target="_blank"><i>The Immigrant Exodus</i></a>, <a href="https://urldefense.com/v3/__http:/www.amazon.com/gp/product/B00LFVJT6E__;!!KzIVK9q-m3Ij!NoBI3uD3LNL_042u3EMr9kcFuF-cxu7yguX8fuZhj89uf2vTfFcpEPEuWu5ior3dQwk9yJjjvEIGAIwNNPc$" target="_blank"><i>Innovating Women</i></a>, <a href="https://urldefense.com/v3/__https:/www.amazon.com/Your-Happiness-Was-Hacked-Brain/dp/1523095849__;!!KzIVK9q-m3Ij!NoBI3uD3LNL_042u3EMr9kcFuF-cxu7yguX8fuZhj89uf2vTfFcpEPEuWu5ior3dQwk9yJjjvEIGxG6UR7o$" target="_blank"><i>Your Happiness Was Hacked</i></a>, <a href="https://urldefense.com/v3/__https:/www.amazon.com/gp/product/1626569711__;!!KzIVK9q-m3Ij!NoBI3uD3LNL_042u3EMr9kcFuF-cxu7yguX8fuZhj89uf2vTfFcpEPEuWu5ior3dQwk9yJjjvEIGeiWOflg$" target="_blank"><i>The Driver in the Driverless Car</i></a> and <a href="https://urldefense.com/v3/__https:/www.amazon.com/Incremental-Exponential-Companies-Rethink-Innovation/dp/1523089563__;!!KzIVK9q-m3Ij!NoBI3uD3LNL_042u3EMr9kcFuF-cxu7yguX8fuZhj89uf2vTfFcpEPEuWu5ior3dQwk9yJjjvEIGPQB5Eyw$"><i><span style='color:#0563C1'>From Incremental to Exponential: How Large Companies Can See the Future and Rethink Innovation</span></i></a></span><span style='font-size:11.0pt;font-family:"Calibri",sans-serif;color:#1F497D'><o:p></o:p></span></p><p class=MsoNormal><b><span style='font-size:11.0pt;font-family:"Calibri",sans-serif'>From:</span></b><span style='font-size:11.0pt;font-family:"Calibri",sans-serif'> Geoffrey Hinton <geoffrey.hinton@gmail.com> <br><b>Sent:</b> Thursday, June 9, 2022 11:50 AM<br><b>To:</b> Gary Marcus <gary.marcus@nyu.edu><br><b>Cc:</b> connectionists@mailman.srv.cs.cmu.edu; Vivek Wadhwa <vivek@wadhwa.com><br><b>Subject:</b> Re: Connectionists: Geoff Hinton, Elon Musk, and a bet at garymarcus.substack.com<o:p></o:p></span></p><p class=MsoNormal><o:p> </o:p></p><div><p class=MsoNormal>If you make a bet, you need to be very clear about what counts as success and you need to assume the person who has to pay out will quibble.<o:p></o:p></p><div><p class=MsoNormal>You cannot have a real bet that includes phrases like:<o:p></o:p></p></div><div><p class=MsoNormal><o:p> </o:p></p></div><div><p class=MsoNormal>"tell you accurately"<o:p></o:p></p></div><div><p class=MsoNormal>"reliably answer questions"<o:p></o:p></p></div><div><p class=MsoNormal>"competent cook"<o:p></o:p></p></div><div><p class=MsoNormal>"reliably construct"<o:p></o:p></p></div><div><p class=MsoNormal><o:p> </o:p></p></div><div><p class=MsoNormal>A bet needs to have such clear criteria for whether it has been achieved or not that even Gary Marcus could not quibble. <o:p></o:p></p></div><div><p class=MsoNormal><o:p> </o:p></p></div><div><p class=MsoNormal>Geoff<o:p></o:p></p></div><div><p class=MsoNormal><o:p> </o:p></p></div><div><p class=MsoNormal><o:p> </o:p></p></div></div><p class=MsoNormal><o:p> </o:p></p><div><div><p class=MsoNormal>On Thu, Jun 9, 2022 at 3:41 AM Gary Marcus <<a href="mailto:gary.marcus@nyu.edu">gary.marcus@nyu.edu</a>> wrote:<o:p></o:p></p></div><blockquote style='border:none;border-left:solid #CCCCCC 1.0pt;padding:0in 0in 0in 6.0pt;margin-left:4.8pt;margin-top:5.0pt;margin-right:0in;margin-bottom:5.0pt'><div><div><p class=MsoNormal><span style='font-family:"Tahoma",sans-serif'></span>Dear Connectionists, and especially Geoff Hinton,<o:p></o:p></p><div><div><div><p class=MsoNormal><o:p> </o:p></p></div><div><p class=MsoNormal>It has come to my attention that Geoff Hinton is looking for challenging targets. In a just-released episode of The Robot Brains podcast [<a href="https://www.youtube.com/watch?v=4Otcau-C_Yc" target="_blank">https://www.youtube.com/watch?v=4Otcau-C_Yc</a>], he said <o:p></o:p></p><div><p class=MsoNormal><o:p> </o:p></p></div><div><p class=MsoNormal><i>“If any of the people who say [deep learning] is hitting a wall would just write down a list of the things it’s not going to be able to do then five years later, we’d be able to show we’d done them.”</i><o:p></o:p></p></div><div><p class=MsoNormal><o:p> </o:p></p></div><div><p class=MsoNormal>Now, as it so happens, I (with the help of Ernie Davis) did just write down exactly such a list of things, last weekm and indeed offered Elon Musk a $100,000 bet along similar lines.<o:p></o:p></p></div><div><p class=MsoNormal><o:p> </o:p></p></div><div><p class=MsoNormal>Precise details are here, towards the end of the essay: <o:p></o:p></p></div><div><p class=MsoNormal><o:p> </o:p></p></div><div><p class=MsoNormal><a href="https://garymarcus.substack.com/p/dear-elon-musk-here-are-five-things?s=w" target="_blank">https://garymarcus.substack.com/p/dear-elon-musk-here-are-five-things</a><o:p></o:p></p></div><div><p class=MsoNormal><o:p> </o:p></p></div><div><p class=MsoNormal>Five are specific milestones, in video and text comprehension, cooking, math, etc; the sixth is the proviso that for an intelligence to be deemed “general” (which is what Musk was discussing in a remark that prompted my proposal), it would need to solve a majority of the problems. We can probably all agree that narrow AI for any single problem on its own might be less interesting.<o:p></o:p></p></div><div><p class=MsoNormal><o:p> </o:p></p></div><div><p class=MsoNormal>Although there is no word yet from Elon, Kevin Kelly offered to host the bet at LongNow.Org, and Metaculus.com has transformed the bet into 6 questions that the community can comment on. Vivek Wadhwa, cc’d, quickly offered to double the bet, and several others followed suit; the bet to Elon (should he choose to take it) currently stands at $500,000.<o:p></o:p></p></div><div><p class=MsoNormal><o:p> </o:p></p></div><div><p class=MsoNormal>If you’d like in on the bet, Geoff, please let me know. <o:p></o:p></p></div><div><p class=MsoNormal><o:p> </o:p></p></div><div><p class=MsoNormal>More generally, I’d love to hear what the connectionists community thinks of six criteria I laid out (as well as the arguments at the top of the essay, as to why AGI might not be as imminent as Musk seems to think).<o:p></o:p></p></div><div><p class=MsoNormal><o:p> </o:p></p></div><div><p class=MsoNormal>Cheers.<o:p></o:p></p></div><div><p class=MsoNormal>Gary Marcus<o:p></o:p></p></div></div></div></div></div></div></blockquote></div></div></body></html>