<html xmlns="http://www.w3.org/1999/xhtml" xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office"><head><!--[if gte mso 9]><xml><o:OfficeDocumentSettings><o:AllowPNG/><o:PixelsPerInch>96</o:PixelsPerInch></o:OfficeDocumentSettings></xml><![endif]--></head><body><div class="ydp46107252yahoo-style-wrap" style="font-family:Helvetica Neue, Helvetica, Arial, sans-serif;font-size:16px;"><div><div dir="ltr" data-setdir="false">Dear Axel,</div><div dir="ltr" data-setdir="false"> <span><span style="color: rgb(0, 0, 0); font-family: Helvetica Neue, Helvetica, Arial, sans-serif; font-size: 16px;">Yes, Poincare, Lorentz et al were influences (just as Mach was for GR) and even remarkable developments such as theories of relativity do not occur</span><i style="color: rgb(0, 0, 0); font-family: Helvetica Neue, Helvetica, Arial, sans-serif; font-size: 16px;"> in vacuo. </i></span> </div><div dir="ltr" data-setdir="false"><br></div><div dir="ltr" data-setdir="false">Einstein was awarded the Physics Nobel for his work on the photoelectric effect and his contributions to theoretical physics (<a href="https://www.nobelprize.org/prizes/physics/1921/einstein/facts/" rel="nofollow" target="_blank" class="enhancr_card_8675945578">The Nobel Prize in Physics 1921</a>)</div><div><br></div><div id="ydp5afb78adenhancr_card_8675945578" class="ydp5afb78adyahoo-link-enhancr-card ydp5afb78adymail-preserve-class ydp5afb78adymail-preserve-style" style="max-width:400px;font-family:YahooSans VF, YahooSans, OpenSans VF, OpenSans, Helvetica Neue, Segoe UI, Helvetica, Arial, sans-serif" data-url="https://www.nobelprize.org/prizes/physics/1921/einstein/facts/" data-type="YENHANCER" data-size="MEDIUM" contenteditable="false"><a href="https://www.nobelprize.org/prizes/physics/1921/einstein/facts/" style="text-decoration:none !important;color:#000 !important" class="ydp5afb78adyahoo-enhancr-cardlink" rel="nofollow" target="_blank"><table border="0" class="ydp5afb78adcard-wrapper ydp5afb78adyahoo-ignore-table" cellpadding="0" cellspacing="0" style="max-width:400px"><tbody><tr><td width="400"><table border="0" class="ydp5afb78adcard ydp5afb78adyahoo-ignore-table" cellpadding="0" cellspacing="0" width="100%" style="max-width:400px;border-width:1px;border-style:solid;border-color:rgb(224, 228, 233);border-radius:2px"><tbody><tr><td class="ydp5afb78adcard-primary-image-cell" background="https://s.yimg.com/lo/api/res/1.2/lpd2zk_92uxILd9LQUOVoA--~A/Zmk9ZmlsbDt3PTQwMDtoPTIwMDthcHBpZD1pZXh0cmFjdA--/https://www.nobelprize.org/images/einstein-12923-landscape-medium.jpg.cf.jpg" bgcolor="#000000" valign="top" height="175" style="background-color: rgb(0, 0, 0); background-repeat: no-repeat; background-size: cover; position: relative; border-radius: 2px 2px 0px 0px; min-height: 175px;"><!--[if gte mso 9]><v:rect fill="true" stroke="false" style="width:396px;height:175px;position:absolute;top:0;left:0;"><v:fill type="frame" color="#000000" src="https://s.yimg.com/lo/api/res/1.2/lpd2zk_92uxILd9LQUOVoA--~A/Zmk9ZmlsbDt3PTQwMDtoPTIwMDthcHBpZD1pZXh0cmFjdA--/https://www.nobelprize.org/images/einstein-12923-landscape-medium.jpg.cf.jpg"/></v:rect><![endif]--><table border="0" class="ydp5afb78adcard-overlay-container-table ydp5afb78adyahoo-ignore-table" cellpadding="0" cellspacing="0" style="width:100%"><tbody><tr><td class="ydp5afb78adcard-overlay-cell" background="https://s.yimg.com/cv/ae/nq/storm/assets/enhancrV21/1/enhancr_gradient-400x175.png" bgcolor="transparent" valign="top" style="background-color: transparent; border-radius: 2px 2px 0px 0px; min-height: 175px;"><!--[if gte mso 9]><v:rect fill="true" stroke="false" style="width:396px;height:175px;position:absolute;top:-18px;left:0;"><v:fill type="pattern" color="#000000" src="https://s.yimg.com/cv/ae/nq/storm/assets/enhancrV21/1/enhancr_gradient-400x175.png"/><v:textbox inset="0,0,20px,0"><![endif]--><table border="0" class="ydp5afb78adyahoo-ignore-table" height="175" style="width: 100%; min-height: 175px;"><tbody><tr><td class="ydp5afb78adcard-richInfo2" style="text-align:left;padding:15px 0 0 15px;vertical-align:top"></td><td class="ydp5afb78adcard-actions" style="text-align:right;padding:15px 15px 0 0;vertical-align:top"><div class="ydp5afb78adcard-share-container"></div></td></tr></tbody></table><!--[if gte mso 9]></v:textbox></v:rect><![endif]--></td></tr></tbody></table></td></tr><tr><td><table border="0" align="center" class="ydp5afb78adcard-info ydp5afb78adyahoo-ignore-table" cellpadding="0" cellspacing="0" style="background:#fff;position:relative;z-index:2;width:100%;max-width:400px;border-radius:0 0 2px 2px;border-top:1px solid rgb(224, 228, 233)"><tbody><tr><td style="background-color:#ffffff;padding:16px 0 16px 12px;vertical-align:top;border-radius:0 0 0 2px"></td><td style="vertical-align:middle;padding:12px 24px 16px 12px;width:99%;font-family:YahooSans VF, YahooSans, OpenSans VF, OpenSans, Helvetica Neue, Segoe UI, Helvetica, Arial, sans-serif;border-radius:0 0 2px 0"><h2 class="ydp5afb78adcard-title" style="font-size: 14px; line-height: 19px; margin: 0px 0px 6px; font-family: YahooSans VF, YahooSans, OpenSans VF, OpenSans, Helvetica Neue, Segoe UI, Helvetica, Arial, sans-serif; color: rgb(29, 34, 40); max-width: 314px;">The Nobel Prize in Physics 1921</h2><p class="ydp5afb78adcard-description" style="font-size: 12px; line-height: 16px; margin: 0px; color: rgb(151, 158, 168);">The Nobel Prize in Physics 1921 was awarded to Albert Einstein "for his services to Theoretical Physics, and esp...</p></td></tr></tbody></table></td></tr></tbody></table></td></tr></tbody></table></a></div><div>.</div><div dir="ltr" data-setdir="false">I believe the special and general theories were a tad controversial at the time and this is perhaps reflected in the *services to theoretical physics* bit but it is not a direct acknowledgment of said body of work. Odd considering how General Relativity gave more accurate estimates for the precession of the perihelion of Mercury and had some empirical support following Eddington's famous expedition ( a few years prior to the date of the award). </div><div dir="ltr" data-setdir="false"><br></div><div dir="ltr" data-setdir="false">Best, </div><div dir="ltr" data-setdir="false"><i><br></i></div><div dir="ltr" data-setdir="false"><br></div><div dir="ltr" data-setdir="false"><i><br></i></div><div dir="ltr" data-setdir="false"><i><br></i></div><div><br></div><div dir="ltr" data-setdir="false"><br></div><div class="ydp46107252signature">Anand Ramamoorthy<div><br></div></div></div>
<div><br></div><div><br></div>
</div><div id="ydp27ab5831yahoo_quoted_8632704385" class="ydp27ab5831yahoo_quoted">
<div style="font-family:'Helvetica Neue', Helvetica, Arial, sans-serif;font-size:13px;color:#26282a;">
<div>
On Wednesday 9 October 2024 at 10:37:00 BST, Axel Hutt <axel.hutt@inria.fr> wrote:
</div>
<div><br></div>
<div><br></div>
<div><div id="ydp27ab5831yiv4108349449"><div><div style="font-family:arial, helvetica, sans-serif;font-size:12pt;color:#000000;"><div>Dear all,</div><div><br clear="none"></div><div>essentially all research is based on the current knowledge and the work of </div><div>previous generations.<br clear="none"></div><div><br clear="none"></div><div>For instance, Albert Einstein knew the Lorentz equations and their meaning <br clear="none"></div><div>from the work of Hendrik Lorentz developed at the end of the 19th century.<br clear="none"></div><div>Henri Poincaré, Oliver Heaviside and many others have worked on them and </div><div>their meaning assuming a world of aether. Then, 1905 Einstein derived them </div><div>without assuming aether in his special relativity theory (surely motivated and </div><div>heavily influenced by these previous studies) and won the Nobel Prize for it in </div><div>1921. Even Einstein's own wife (also a physicist) contributed much in scientific </div><div>discussions with him.<br clear="none"></div><div><br clear="none"></div><div>Axel<br clear="none"></div><div><br clear="none"></div><div id="ydp27ab5831yiv4108349449yqt74985" class="ydp27ab5831yiv4108349449yqt5217376987"><div><span id="ydp27ab5831yiv4108349449zwchr">----- On 9 Oct, 2024, at 01:55, Brad Wyble <bwyble@gmail.com> wrote:<br clear="none"></span></div><div><blockquote style="border-left:2px solid #1010FF;margin-left:5px;padding-left:5px;color:#000;font-weight:normal;font-style:normal;text-decoration:none;font-family:Helvetica, Arial, sans-serif;font-size:12pt;"><div dir="ltr">We really can trace the current AI boom back to John Carmack who wrote Doom, which ushered in the era of GPU-hungry computing. Credit where it's due please. </div><br clear="none"><div class="ydp27ab5831yiv4108349449gmail_quote"><div dir="ltr" class="ydp27ab5831yiv4108349449gmail_attr">On Tue, Oct 8, 2024 at 4:10 PM Stephen José Hanson <<a shape="rect" href="mailto:jose@rubic.rutgers.edu" rel="nofollow" target="_blank">jose@rubic.rutgers.edu</a>> wrote:<br clear="none"></div><blockquote style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb( 204 , 204 , 204 );padding-left:1ex;" class="ydp27ab5831yiv4108349449gmail_quote"><u></u>
<div>
<p>Hi Steve,</p>
<p></p>
<p style="line-height:100%;margin-bottom:0in;">The problem every writer encounters is what can be concluded as resolved knowledge rather then new/novel knowledge. In the law this is of course “legal precedence”, so does the reference refer to a recent precedent,
or does the one for the 17<sup>th</sup> century hold precedence? In the present case, I agree that calculating gradients of functions using the chain rule was invented (Legendre -- Least squares) far before Rumelhart and Hinton applied it to error gradients
in acyclic/cyclic networks, and of course there were others as you say, in the 20<sup>th</sup> century that also applied error gradient to networks (Parker, Le cun et al). Schmidhuber says all that matters is the “math” not the applied context. However, I
seriously doubt that Legendre could have imagined using gradients of function error through succesive application in a acylic network would have produced a hierarchical kinship relationship (distinguishing between an italian and english family mother, fathers,
sons, aunts, grandparents etc.) in the hidden units of a network, simply by observing individuals with fixed feature relations. I think any reasonable person would maintain that this application is completely novel and could not be predicted in or out of
context from the “math” and certainly not from the 18<sup>th</sup> century. Hidden units were new in this context and their representational nature was novel, in this context. Scope of reference is also based on logical or causal proximity to the reference.
In this case, referencing Darwin or Newton in all biological or physics papers should be based on the outcome of the metaphorical test of whether the recent results tie back to original source in some direct line, for example, was Oswald’s grandfather responsible
for the death of President John F. Kennedy? Failing this test, suggests that the older reference may not have scope. But of course this can be subjective.</p>
<p style="line-height:100%;margin-bottom:0in;">Steve<br clear="none">
</p>
<p></p>
<div>On 10/8/24 2:38 PM, Grossberg, Stephen wrote:<br clear="none">
</div>
<blockquote>
<div>
<p class="ydp27ab5831yiv4108349449MsoNormal"><span style="font-size:16pt;font-family:'arial' , sans-serif;">Actually, Paul Werbos developed back propagation into its modern form, and worked out computational examples, for his 1974 Harvard PhD thesis.<u></u><u></u></span></p>
<p class="ydp27ab5831yiv4108349449MsoNormal"><span style="font-size:16pt;font-family:'arial' , sans-serif;"><u></u> <u></u></span></p>
<p class="ydp27ab5831yiv4108349449MsoNormal"><span style="font-size:16pt;font-family:'arial' , sans-serif;">Then David Parker rediscovered it in 1982, etc.<u></u><u></u></span></p>
<p class="ydp27ab5831yiv4108349449MsoNormal"><span style="font-size:16pt;font-family:'arial' , sans-serif;"><u></u> <u></u></span></p>
<p class="ydp27ab5831yiv4108349449MsoNormal"><span style="font-size:16pt;font-family:'arial' , sans-serif;">Schmidhuber provides an excellent and wide-ranging history of many contributors to Deep Learning and its antecedents:<u></u><u></u></span></p>
<p class="ydp27ab5831yiv4108349449MsoNormal"><span style="font-size:16pt;font-family:'arial' , sans-serif;"><u></u> <u></u></span></p>
<p class="ydp27ab5831yiv4108349449MsoNormal"><span style="font-size:16pt;font-family:'arial' , sans-serif;"><a shape="rect" href="https://www.sciencedirect.com/science/article/pii/S0893608014002135?casa_token=k47YCzFwcFEAAAAA:me_ZGF5brDqjRihq5kHyeQBzyUMYBypJ3neSinZ-cPn1pnyi69DGyM9eKSyLsdiRf759I77c7w" rel="nofollow" target="_blank">https://www.sciencedirect.com/science/article/pii/S0893608014002135?casa_token=k47YCzFwcFEAAAAA:me_ZGF5brDqjRihq5kHyeQBzyUMYBypJ3neSinZ-cPn1pnyi69DGyM9eKSyLsdiRf759I77c7w</a><u></u><u></u></span></p>
<p class="ydp27ab5831yiv4108349449MsoNormal"><span style="font-size:16pt;font-family:'arial' , sans-serif;"><u></u> <u></u></span></p>
<p class="ydp27ab5831yiv4108349449MsoNormal"><span style="font-size:16pt;font-family:'arial' , sans-serif;">This article has been cited over 23,000 times.<u></u><u></u></span></p>
<p class="ydp27ab5831yiv4108349449MsoNormal"><span style="font-size:16pt;font-family:'arial' , sans-serif;"><u></u> <u></u></span></p>
<div id="ydp27ab5831yiv4108349449m_-23520673755399983mail-editor-reference-message-container">
<div>
<div style="border-right:none;border-bottom:none;border-left:none;border-top:1pt solid rgb( 181 , 196 , 223 );padding:3pt 0in 0in;">
<p style="margin-bottom:12pt;" class="ydp27ab5831yiv4108349449MsoNormal"><b><span style="font-size:12pt;color:black;">From:
</span></b><span style="font-size:12pt;color:black;">Connectionists <a shape="rect" href="mailto:connectionists-bounces@mailman.srv.cs.cmu.edu" rel="nofollow" target="_blank">
<connectionists-bounces@mailman.srv.cs.cmu.edu></a> on behalf of Stephen José Hanson
<a shape="rect" href="mailto:jose@rubic.rutgers.edu" rel="nofollow" target="_blank"><jose@rubic.rutgers.edu></a><br clear="none">
<b>Date: </b>Tuesday, October 8, 2024 at 2:25 PM<br clear="none">
<b>To: </b>Jonathan D. Cohen <a shape="rect" href="mailto:jdc@princeton.edu" rel="nofollow" target="_blank">
<jdc@princeton.edu></a>, Connectionists <a shape="rect" href="mailto:connectionists@cs.cmu.edu" rel="nofollow" target="_blank">
<connectionists@cs.cmu.edu></a><br clear="none">
<b>Subject: </b>Re: Connectionists: 2024 Nobel Prize in Physics goes to Hopfield and Hinton<u></u><u></u></span></p>
</div>
<p>Yes, Jon good point here, and although there is a through line from Hopfield to Hinton and Sejnowski.. Ie boltzmann machines and onto DL and LLMs<u></u><u></u></p>
<p>Dave of course invented BP, Geoff would always say.. his contribution was to try and talk Dave out of it as it had so many computational problems and could be in no way considered biologically plausible.<u></u><u></u></p>
<p>Steve<u></u><u></u></p>
<div>
<p class="ydp27ab5831yiv4108349449MsoNormal"><span style="font-size:11pt;">On 10/8/24 8:47 AM, Jonathan D. Cohen wrote:<u></u><u></u></span></p>
</div>
<blockquote style="margin-top:5pt;margin-bottom:5pt;">
<pre>I’d like to add, in this context, a note in memoriam of David Rumelhart, who was an integral contributor to the work honored by today’s Nobel Prize.<u></u><u></u></pre>
<pre><u></u> <u></u></pre>
<pre>jdc<u></u><u></u></pre>
<pre><u></u> <u></u></pre>
</blockquote>
<pre>-- <u></u><u></u></pre>
<pre>Stephen José Hanson<u></u><u></u></pre>
<pre>Professor, Psychology Department<u></u><u></u></pre>
<pre>Director, RUBIC (Rutgers University Brain Imaging Center)<u></u><u></u></pre>
<pre>Member, Executive Committee, RUCCS<u></u><u></u></pre>
</div>
</div>
</div>
</blockquote>
<pre>--
Stephen José Hanson
Professor, Psychology Department
Director, RUBIC (Rutgers University Brain Imaging Center)
Member, Executive Committee, RUCCS</pre>
</div>
</blockquote></div><br clear="all"><br clear="none"><span class="ydp27ab5831yiv4108349449gmail_signature_prefix">-- </span><br clear="none"><div dir="ltr" class="ydp27ab5831yiv4108349449gmail_signature"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr">Brad Wyble (he/him)</div></div></div></div></div><br clear="none"></blockquote></div></div><div><br clear="none"></div><div>-- <br clear="none"></div><div>Axel Hutt<br clear="none">Directeur de Recherche<br clear="none">Equipe MIMESIS - INRIA Nancy Grand Est <br clear="none">Equipe MLMS - iCube Strasbourg<br clear="none">Bâtiment NextMed<br clear="none">2, rue Marie Hamm<br clear="none">67000 Strasbourg, France<br clear="none">https://mimesis.inria.fr/members/axel-hutt/<br clear="none"></div></div></div></div></div>
</div>
</div></body></html>