Connectionists: Statistics versus “Understanding” in Generative AI.

[Thomas Trappenberg]

Good point, but Dave's point stands as the models he is referring to did
not even comprehend that they made mistakes.

Cheers, Thomas

On Mon, Feb 19, 2024, 4:43 a.m. <wuxundong at gmail.com> wrote:

> That can be attributed to the models' underlying text encoding and
> processing mechanisms, specifically tokenization that removes the spelling
> information from those words. If you use GPT-4 instead, it can process it
> properly by resorting to external tools.
>
> On Mon, Feb 19, 2024 at 3:45 PM Dave Touretzky <dst at cs.cmu.edu> wrote:
>
>> My favorite way to show that LLMs don't know what they're talking about
>> is this simple prompt:
>>
>>    List all the US states whose names don't contain the letter "a".
>>
>> ChatGPT, Bing, and Gemini all make a mess of this, e.g., putting "Texas"
>> or "Alaska" on the list and leaving out states like "Wyoming" and
>> "Tennessee".  And you can have a lengthy conversation with them about
>> this, pointing out their errors one at a time, and they still can't
>> manage to get it right.  Gemini insisted that all 50 US states have an
>> "a" in their name.  It also claimed "New Jersey" has two a's.
>>
>> -- Dave Touretzky
>>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mailman.srv.cs.cmu.edu/pipermail/connectionists/attachments/20240219/5e812a54/attachment.html>