Connectionists: 2024 Nobel Prize in Physics goes to Hopfield and Hinton

[Grossberg, Stephen]

Actually, Paul Werbos developed back propagation into its modern form, and worked out computational examples, for his 1974 Harvard PhD thesis.

Then David Parker rediscovered it in 1982, etc.

Schmidhuber provides an excellent and wide-ranging history of many contributors to Deep Learning and its antecedents:

https://www.sciencedirect.com/science/article/pii/S0893608014002135?casa_token=k47YCzFwcFEAAAAA:me_ZGF5brDqjRihq5kHyeQBzyUMYBypJ3neSinZ-cPn1pnyi69DGyM9eKSyLsdiRf759I77c7w

This article has been cited over 23,000 times.

From: Connectionists <connectionists-bounces at mailman.srv.cs.cmu.edu> on behalf of Stephen José Hanson <jose at rubic.rutgers.edu>
Date: Tuesday, October 8, 2024 at 2:25 PM
To: Jonathan D. Cohen <jdc at princeton.edu>, Connectionists <connectionists at cs.cmu.edu>
Subject: Re: Connectionists: 2024 Nobel Prize in Physics goes to Hopfield and Hinton

Yes, Jon good point here, and  although there is a through line from Hopfield to Hinton and Sejnowski.. Ie boltzmann machines and onto DL and LLMs

Dave of course invented BP, Geoff would always say.. his contribution was to try and talk Dave out of it as it had so many computational problems and could be in no way considered biologically plausible.

Steve
On 10/8/24 8:47 AM, Jonathan D. Cohen wrote:

I’d like to add, in this context, a note in memoriam of David Rumelhart, who was an integral contributor to the work honored by today’s Nobel Prize.



jdc



--

Stephen José Hanson

Professor, Psychology Department

Director, RUBIC (Rutgers University Brain Imaging Center)

Member, Executive Committee, RUCCS
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mailman.srv.cs.cmu.edu/pipermail/connectionists/attachments/20241008/b406d681/attachment.html>