Connectionists: Statistics versus “Understanding” in Generative AI.

[Dave Touretzky]

My favorite way to show that LLMs don't know what they're talking about
is this simple prompt:

   List all the US states whose names don't contain the letter "a".

ChatGPT, Bing, and Gemini all make a mess of this, e.g., putting "Texas"
or "Alaska" on the list and leaving out states like "Wyoming" and
"Tennessee".  And you can have a lengthy conversation with them about
this, pointing out their errors one at a time, and they still can't
manage to get it right.  Gemini insisted that all 50 US states have an
"a" in their name.  It also claimed "New Jersey" has two a's.

-- Dave Touretzky