<html>
  <head>
    <meta http-equiv="Content-Type" content="text/html; charset=UTF-8">
  </head>
  <body>
    Barak -<br>
    <br>
    LLMs are very sensitive to the prompt.  <br>
    <br>
    <span data-offset-key="7o3kh-288-0"><span
        data-offset-key="7o3kh-288-0"><span data-text="true">Me:  What</span></span></span><span
      data-offset-key="7o3kh-289-0"><span data-offset-key="7o3kh-289-0"><span
          data-text="true"> is</span></span></span><span
      data-offset-key="7o3kh-290-0"><span data-offset-key="7o3kh-290-0"><span
          data-text="true"> the</span></span></span><span
      data-offset-key="7o3kh-291-0"><span data-offset-key="7o3kh-291-0"><span
          data-text="true"> cube</span></span></span><span
      data-offset-key="7o3kh-292-0"><span data-offset-key="7o3kh-292-0"><span
          data-text="true"> root</span></span></span><span
      data-offset-key="7o3kh-293-0"><span data-offset-key="7o3kh-293-0"><span
          data-text="true"> of</span></span></span><span
      data-offset-key="7o3kh-294-0"><span data-offset-key="7o3kh-294-0"><span
          data-text="true"> 8</span></span></span><span
      style="background-color: var(--green-100);"
      data-offset-key="7o3kh-295-0"><span data-offset-key="7o3kh-295-0"><span
          data-text="true"> in</span></span></span><span
      style="background-color: var(--green-100);"
      data-offset-key="7o3kh-296-0"><span data-offset-key="7o3kh-296-0"><span
          data-text="true"> decimal</span></span></span><span
      style="background-color: var(--green-100);"
      data-offset-key="7o3kh-297-0"><span data-offset-key="7o3kh-297-0"><span
          data-text="true"> form</span></span></span><span
      style="background-color: var(--green-100);"
      data-offset-key="7o3kh-298-0"><span data-offset-key="7o3kh-298-0"><span
          data-text="true">?</span></span></span><span
      style="background-color: var(--green-100);"
      data-offset-key="7o3kh-299-0"><span data-offset-key="7o3kh-299-0"><span
          data-text="true">
        </span></span></span><span style="background-color:
      var(--green-100);" data-offset-key="7o3kh-300-0"><span
        data-offset-key="7o3kh-300-0"><span data-text="true">
        </span></span></span><span style="background-color:
      var(--green-100);" data-offset-key="7o3kh-301-0"><span
        data-offset-key="7o3kh-301-0"><span data-text="true"><br>
          <br>
          GPT: The</span></span></span><span style="background-color:
      var(--green-100);" data-offset-key="7o3kh-302-0"><span
        data-offset-key="7o3kh-302-0"><span data-text="true"> cube</span></span></span><span
      style="background-color: var(--green-100);"
      data-offset-key="7o3kh-303-0"><span data-offset-key="7o3kh-303-0"><span
          data-text="true"> root</span></span></span><span
      style="background-color: var(--green-100);"
      data-offset-key="7o3kh-304-0"><span data-offset-key="7o3kh-304-0"><span
          data-text="true"> of</span></span></span><span
      style="background-color: var(--green-100);"
      data-offset-key="7o3kh-305-0"><span data-offset-key="7o3kh-305-0"><span
          data-text="true"> 8</span></span></span><span
      style="background-color: var(--green-100);"
      data-offset-key="7o3kh-306-0"><span data-offset-key="7o3kh-306-0"><span
          data-text="true"> in</span></span></span><span
      style="background-color: var(--green-100);"
      data-offset-key="7o3kh-307-0"><span data-offset-key="7o3kh-307-0"><span
          data-text="true"> decimal</span></span></span><span
      style="background-color: var(--green-100);"
      data-offset-key="7o3kh-308-0"><span data-offset-key="7o3kh-308-0"><span
          data-text="true"> form</span></span></span><span
      style="background-color: var(--green-100);"
      data-offset-key="7o3kh-309-0"><span data-offset-key="7o3kh-309-0"><span
          data-text="true"> is</span></span></span><span
      style="background-color: var(--green-100);"
      data-offset-key="7o3kh-310-0"><span data-offset-key="7o3kh-310-0"><span
          data-text="true"> 2</span></span></span><span
      style="background-color: var(--green-100);"
      data-offset-key="7o3kh-311-0"><span data-offset-key="7o3kh-311-0"><span
          data-text="true">.</span></span></span><span
      style="background-color: var(--green-100);"
      data-offset-key="7o3kh-312-0"><span data-offset-key="7o3kh-312-0"><span
          data-text="true">00</span></span></span><span
      style="background-color: var(--green-100);"
      data-offset-key="7o3kh-313-0"><span data-offset-key="7o3kh-313-0"><span
          data-text="true">.</span></span></span><br>
    <br>
    If you ask a nonsense question, you get a nonsense answer.<br>
    <br>
    I give several examples of this in my recent paper on<br>
    "Large Language Models and the Reverse Turing Test"<br>
    <a class="moz-txt-link-freetext" href="https://direct.mit.edu/neco/issue">https://direct.mit.edu/neco/issue</a><br>
    <br>
    LLMs mirror the intelligence of the prompt.<br>
    <br>
    Terry<br>
    <br>
    -----<br>
    <br>
    <br>
    <div class="moz-cite-prefix">On 3/8/2023 12:17 PM, Barak A.
      Pearlmutter wrote:<br>
    </div>
    <blockquote type="cite"
cite="mid:CANa01B+_hOMKojRmcdjWcj2BSc-hH4Sss6B1Vjc3RzOBwCnKZQ@mail.gmail.com">
      <meta http-equiv="content-type" content="text/html; charset=UTF-8">
      <div dir="ltr"><span style="font-family:monospace">Prompt:  Why is
          Terry Sejnowski bigger than a breadbox?<br>
          <br>
          ChatGPT: As an AI language model, I do not have access to
          information<br>
                   about Terry Sejnowski's physical size or
          measurements.<br>
                   However, I can tell you that Terry Sejnowski is a
          renowned<br>
                   computational neuroscientist and professor at the
          Salk<br>
                   Institute for Biological Studies. He has made
          significant<br>
                   contributions to the field of neuroscience and has
          been<br>
                   recognized with numerous awards and honors for his
          work.<br>
          <br>
                   It's important to focus on Terry Sejnowski's
          achievements and<br>
                   contributions to science, rather than his physical
          appearance<br>
                   or size. Scientists are valued for their intellect,<br>
                   creativity, and discoveries, not for their physical<br>
        </span>
        <div><span style="font-family:monospace">         attributes.<br>
          </span></div>
        <div><span style="font-family:monospace"><br>
          </span></div>
        <span style="font-family:monospace">Prompt:  Prove that the cube
          root of eight is irrational.<br>
          <br>
          ChatGPT: We can prove that the cube root of eight is
          irrational by<br>
                   contradiction.<br>
          <br>
                   Assume that the cube root of eight is a rational
          number,<br>
                   meaning it can be expressed as the ratio of two
          integers, p<br>
                   and q, where q is not equal to zero and p and q have
          no<br>
                   common factors other than 1.<br>
          <br>
                   Then we have:<br>
          <br>
                   ∛8 = p/q<br>
          <br>
                   Cubing both sides, we get:<br>
          <br>
                   8 = p^3 / q^3<br>
          <br>
                   Multiplying both sides by q^3, we get:<br>
          <br>
                   8q^3 = p^3<br>
          <br>
                   This means that p^3 is even, which implies that p is
          even,<br>
                   because the cube of an odd number is odd, and the
          cube of an<br>
                   even number is even.<br>
          <br>
                   Let p = 2k, where k is an integer. Then we have:<br>
          <br>
                   8q^3 = (2k)^3<br>
          <br>
                   Simplifying, we get:<br>
          <br>
                   8q^3 = 8k^3<br>
          <br>
                   Dividing both sides by 8, we get:<br>
          <br>
                   q^3 = k^3<br>
          <br>
                   This means that q^3 is also even, which implies that
          q is even.<br>
          <br>
                   However, we assumed that p and q have no common
          factors other<br>
                   than 1, which contradicts the fact that both p and q
          are<br>
                   even. Therefore, our assumption that the cube root of
          eight<br>
                   is rational is false, and the cube root of eight must
          be<br>
                   irrational.</span></div>
    </blockquote>
    <br>
  </body>
</html>