<html><head><meta http-equiv="content-type" content="text/html; charset=utf-8"></head><body dir="auto"><div dir="ltr"></div><div dir="ltr">no single success (or failure) is particular indicative in a system that probabilistically mimics a very large yet proprietary database. </div><div dir="ltr"><br></div><div dir="ltr">but it is evident to anyone who has played with these systems that cannot be counted on eg. for word problems, precisely because they are sometimes correct, sometimes not.</div><div dir="ltr"><br><blockquote type="cite">On Mar 16, 2023, at 09:40, Natsuki Oka <okana2ki@gmail.com> wrote:<br><br></blockquote></div><blockquote type="cite"><div dir="ltr"><div dir="ltr">Bing Chat (GPT-4) can answer the question correctly. Natsuki<div>---<br><div>Me: What happens when I multiply a number by 2, add 2, divide by 2, and subtract 2?</div><div>Bing Chat: <span style="color:rgb(17,17,17);font-family:-apple-system,Roboto,SegoeUI,"Segoe UI","Helvetica Neue",Helvetica,Meiryo,"Meiryo UI","Arial Unicode MS",sans-serif;font-size:16px;background-color:rgba(255,255,255,0.6)">That’s a good question. </span><a class="gmail-tooltip-target" href="https://urldefense.proofpoint.com/v2/url?u=https-3A__www.calculatorsoup.com_calculators_math_math.php&d=DwMFaQ&c=slrrB7dE8n7gBJbeO0g-IQ&r=wQR1NePCSj6dOGDD0r6B5Kn1fcNaTMg7tARe7TdEDqQ&m=oS4U4fEskWA88NkL2oe-L4onjqynv7OVjR19TdhEPKPgswnyY_oA3WsgtcJKnHLz&s=XMz4VoThNWS-AXGjLvLkLhb81TYUI6t2sbwIV_pcWFQ&e=" target="_blank" style="color:inherit;text-decoration-style:dotted;border-bottom:2px solid transparent;font-family:-apple-system,Roboto,SegoeUI,"Segoe UI","Helvetica Neue",Helvetica,Meiryo,"Meiryo UI","Arial Unicode MS",sans-serif;font-size:16px;background-color:rgba(255,255,255,0.6)">You can use a math calculator</a><a href="https://urldefense.proofpoint.com/v2/url?u=https-3A__www.calculatorsoup.com_calculators_math_math.php&d=DwMFaQ&c=slrrB7dE8n7gBJbeO0g-IQ&r=wQR1NePCSj6dOGDD0r6B5Kn1fcNaTMg7tARe7TdEDqQ&m=oS4U4fEskWA88NkL2oe-L4onjqynv7OVjR19TdhEPKPgswnyY_oA3WsgtcJKnHLz&s=XMz4VoThNWS-AXGjLvLkLhb81TYUI6t2sbwIV_pcWFQ&e=" class="gmail-ac-anchor gmail-sup-target" target="_blank" aria-label="Math Calculator" style="text-decoration-line:none;font-family:-apple-system,Roboto,SegoeUI,"Segoe UI","Helvetica Neue",Helvetica,Meiryo,"Meiryo UI","Arial Unicode MS",sans-serif;font-size:16px;background-color:rgba(255,255,255,0.6)"><span style="display:inline-flex;font-size:10px;font-weight:600;vertical-align:top;margin:0px 2px;min-width:14px;height:14px;border-radius:3px;text-decoration-color:transparent;outline:transparent solid 1px">1</span></a><span style="color:rgb(17,17,17);font-family:-apple-system,Roboto,SegoeUI,"Segoe UI","Helvetica Neue",Helvetica,Meiryo,"Meiryo UI","Arial Unicode MS",sans-serif;font-size:16px;background-color:rgba(255,255,255,0.6)"> to find out the answer for any number you choose. Or you can use a simple formula: (x * 2 + 2) / 2 - 2 = x - 1. That means you will always get one less than the original number. For example, if you start with 5, you will end up with 4. Do you want to try another math problem?😊</span></div><div><span style="color:rgb(17,17,17);font-family:-apple-system,Roboto,SegoeUI,"Segoe UI","Helvetica Neue",Helvetica,Meiryo,"Meiryo UI","Arial Unicode MS",sans-serif;font-size:16px;background-color:rgba(255,255,255,0.6)">1. </span><a href="https://urldefense.proofpoint.com/v2/url?u=https-3A__www.calculatorsoup.com_calculators_math_math.php&d=DwMFaQ&c=slrrB7dE8n7gBJbeO0g-IQ&r=wQR1NePCSj6dOGDD0r6B5Kn1fcNaTMg7tARe7TdEDqQ&m=oS4U4fEskWA88NkL2oe-L4onjqynv7OVjR19TdhEPKPgswnyY_oA3WsgtcJKnHLz&s=XMz4VoThNWS-AXGjLvLkLhb81TYUI6t2sbwIV_pcWFQ&e=">https://www.calculatorsoup.com/calculators/math/math.php</a></div><div><span style="color:rgb(255,255,255);font-family:-apple-system,Roboto,SegoeUI,"Segoe UI","Helvetica Neue",Helvetica,Meiryo,"Meiryo UI","Arial Unicode MS",sans-serif;font-size:16px">What happens when I multiply a number by 2, add 2, divide by 2, and subtract 2?</span></div></div></div><br><div class="gmail_quote"><div dir="ltr" class="gmail_attr">2023年3月16日(木) 15:53 Kagan Tumer <<a href="mailto:kagan.tumer@oregonstate.edu">kagan.tumer@oregonstate.edu</a>>:<br></div><blockquote class="gmail_quote" style="margin:0px 0px 0px 0.8ex;border-left:1px solid rgb(204,204,204);padding-left:1ex"><br>
I'm very reluctant to use the word "understand" beyond perhaps ChatGPT <br>
understanding the structure of language (statistically). Here's an <br>
example of a ChatGPT response to a simple arithmetic operation where:<br>
<br>
1- chatGPT was wrong;<br>
2- worked out an example that showed it was wrong, but it didn't <br>
register that and double down on its wrong conclusion;<br>
3- gave a high level explanation (also wrong) of why it was right even <br>
though it was wrong.<br>
<br>
you can forgive 1, but 2 and 3 clearly show ChatGPT does not actually <br>
understand what it is saying.<br>
<br>
Kagan<br>
<br>
<br>
<br>
On 3/14/23 9:54 AM, Natsuki Oka wrote:<br>
> [This email originated from outside of OSU. Use caution with links and <br>
> attachments.]<br>
> <br>
> Judging from the responses below, ChatGPT understands counting and <br>
> sorting to the extent that it can write a correct Python program but <br>
> does not have the understanding to bring the proper execution results.<br>
> count_and_sort.png<br>
> Here's the program that ChatGPT created:<br>
> ---<br>
> sentences = [<br>
> "The quick brown fox jumps over the lazy dog",<br>
> "Python is a popular programming language",<br>
> "I like to eat pizza for dinner",<br>
> "The capital of France is Paris",<br>
> "The cat in the hat wears a red and white striped hat",<br>
> "My favorite color is blue",<br>
> "The United States has fifty states",<br>
> "There are seven days in a week",<br>
> "I enjoy listening to music while I work",<br>
> "Mount Everest is the highest mountain in the world"<br>
> ]<br>
> <br>
> # sort the sentences by number of words<br>
> sentences.sort(key=lambda x: len(x.split()))<br>
> <br>
> # print the sorted sentences with the number of words in parentheses<br>
> for sentence in sentences:<br>
> num_words = len(sentence.split())<br>
> print(f"{sentence} ({num_words})")<br>
> ---<br>
> <br>
> The execution of this program yields the following correct results:<br>
> ---<br>
> My favorite color is blue (5)<br>
> Python is a popular programming language (6)<br>
> The capital of France is Paris (6)<br>
> The United States has fifty states (6)<br>
> I like to eat pizza for dinner (7)<br>
> There are seven days in a week (7)<br>
> I enjoy listening to music while I work (8)<br>
> The quick brown fox jumps over the lazy dog (9)<br>
> Mount Everest is the highest mountain in the world (9)<br>
> The cat in the hat wears a red and white striped hat (12)<br>
> ---<br>
> <br>
> Oka Natsuki<br>
> Miyazaki Sangyo-keiei University<br>
> <br>
<br>
<br>
-- <br>
Kagan Tumer<br>
Director, Collaborative Robotics and Intelligent Systems Institute<br>
Professor, School of MIME<br>
Oregon State University<br>
<a href="https://urldefense.proofpoint.com/v2/url?u=http-3A__engr.oregonstate.edu_-7Ektumer&d=DwMFaQ&c=slrrB7dE8n7gBJbeO0g-IQ&r=wQR1NePCSj6dOGDD0r6B5Kn1fcNaTMg7tARe7TdEDqQ&m=oS4U4fEskWA88NkL2oe-L4onjqynv7OVjR19TdhEPKPgswnyY_oA3WsgtcJKnHLz&s=ufFzkDLKL6wfVW7tgDi74NfbinclhoQjYTZgpKknLp8&e=" rel="noreferrer" target="_blank">http://engr.oregonstate.edu/~ktumer</a><br>
<a href="https://urldefense.proofpoint.com/v2/url?u=https-3A__kagantumer.com&d=DwMFaQ&c=slrrB7dE8n7gBJbeO0g-IQ&r=wQR1NePCSj6dOGDD0r6B5Kn1fcNaTMg7tARe7TdEDqQ&m=oS4U4fEskWA88NkL2oe-L4onjqynv7OVjR19TdhEPKPgswnyY_oA3WsgtcJKnHLz&s=rUPaQmvwR8FaM_9wbZuS3Tb93XCn4BwgnFKwgLvOPVI&e=" rel="noreferrer" target="_blank">https://kagantumer.com</a><br>
</blockquote></div>
</div></blockquote></body></html>