Connectionists: Statistics versus “Understanding” in Generative AI.

[wuxundong at gmail.com]

That can be attributed to the models' underlying text encoding and
processing mechanisms, specifically tokenization that removes the spelling
information from those words. If you use GPT-4 instead, it can process it
properly by resorting to external tools.

On Mon, Feb 19, 2024 at 3:45 PM Dave Touretzky <dst at cs.cmu.edu> wrote:

> My favorite way to show that LLMs don't know what they're talking about
> is this simple prompt:
>
>    List all the US states whose names don't contain the letter "a".
>
> ChatGPT, Bing, and Gemini all make a mess of this, e.g., putting "Texas"
> or "Alaska" on the list and leaving out states like "Wyoming" and
> "Tennessee".  And you can have a lengthy conversation with them about
> this, pointing out their errors one at a time, and they still can't
> manage to get it right.  Gemini insisted that all 50 US states have an
> "a" in their name.  It also claimed "New Jersey" has two a's.
>
> -- Dave Touretzky
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mailman.srv.cs.cmu.edu/pipermail/connectionists/attachments/20240219/d94729ae/attachment.html>