Connectionists: Statistics versus “Understanding” in Generative AI.
Dave Touretzky
dst at cs.cmu.edu
Sun Feb 18 21:29:52 EST 2024
My favorite way to show that LLMs don't know what they're talking about
is this simple prompt:
List all the US states whose names don't contain the letter "a".
ChatGPT, Bing, and Gemini all make a mess of this, e.g., putting "Texas"
or "Alaska" on the list and leaving out states like "Wyoming" and
"Tennessee". And you can have a lengthy conversation with them about
this, pointing out their errors one at a time, and they still can't
manage to get it right. Gemini insisted that all 50 US states have an
"a" in their name. It also claimed "New Jersey" has two a's.
-- Dave Touretzky
More information about the Connectionists
mailing list