<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40"><head><meta http-equiv=Content-Type content="text/html; charset=utf-8"><meta name=Generator content="Microsoft Word 15 (filtered medium)"><style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:"Barlow Light";}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0cm;
font-size:11.0pt;
font-family:"Calibri",sans-serif;}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
p.MsoListParagraph, li.MsoListParagraph, div.MsoListParagraph
{mso-style-priority:34;
margin-top:0cm;
margin-right:0cm;
margin-bottom:0cm;
margin-left:36.0pt;
font-size:11.0pt;
font-family:"Calibri",sans-serif;}
span.EmailStyle18
{mso-style-type:personal-reply;
font-family:"Calibri",sans-serif;
color:windowtext;}
.MsoChpDefault
{mso-style-type:export-only;
font-family:"Calibri",sans-serif;}
@page WordSection1
{size:612.0pt 792.0pt;
margin:72.0pt 90.0pt 72.0pt 90.0pt;}
div.WordSection1
{page:WordSection1;}
/* List Definitions */
@list l0
{mso-list-id:957952421;
mso-list-type:hybrid;
mso-list-template-ids:685263056 -545984070 67698713 67698715 67698703 67698713 67698715 67698703 67698713 67698715;}
@list l0:level1
{mso-level-number-format:roman-upper;
mso-level-tab-stop:none;
mso-level-number-position:left;
margin-left:54.0pt;
text-indent:-36.0pt;
mso-ansi-font-size:10.0pt;
font-family:"Barlow Light";
mso-bidi-font-family:Calibri;
mso-ansi-font-weight:bold;}
@list l0:level2
{mso-level-number-format:alpha-lower;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-18.0pt;}
@list l0:level3
{mso-level-number-format:roman-lower;
mso-level-tab-stop:none;
mso-level-number-position:right;
text-indent:-9.0pt;}
@list l0:level4
{mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-18.0pt;}
@list l0:level5
{mso-level-number-format:alpha-lower;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-18.0pt;}
@list l0:level6
{mso-level-number-format:roman-lower;
mso-level-tab-stop:none;
mso-level-number-position:right;
text-indent:-9.0pt;}
@list l0:level7
{mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-18.0pt;}
@list l0:level8
{mso-level-number-format:alpha-lower;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-18.0pt;}
@list l0:level9
{mso-level-number-format:roman-lower;
mso-level-tab-stop:none;
mso-level-number-position:right;
text-indent:-9.0pt;}
@list l1
{mso-list-id:1124810550;
mso-list-type:hybrid;
mso-list-template-ids:114585550 1458229508 67698713 67698715 67698703 67698713 67698715 67698703 67698713 67698715;}
@list l1:level1
{mso-level-number-format:roman-upper;
mso-level-tab-stop:none;
mso-level-number-position:left;
margin-left:54.0pt;
text-indent:-36.0pt;
mso-ansi-font-size:10.0pt;
font-family:"Barlow Light";
mso-bidi-font-family:Calibri;
mso-ansi-font-weight:bold;}
@list l1:level2
{mso-level-number-format:alpha-lower;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-18.0pt;}
@list l1:level3
{mso-level-number-format:roman-lower;
mso-level-tab-stop:none;
mso-level-number-position:right;
text-indent:-9.0pt;}
@list l1:level4
{mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-18.0pt;}
@list l1:level5
{mso-level-number-format:alpha-lower;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-18.0pt;}
@list l1:level6
{mso-level-number-format:roman-lower;
mso-level-tab-stop:none;
mso-level-number-position:right;
text-indent:-9.0pt;}
@list l1:level7
{mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-18.0pt;}
@list l1:level8
{mso-level-number-format:alpha-lower;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-18.0pt;}
@list l1:level9
{mso-level-number-format:roman-lower;
mso-level-tab-stop:none;
mso-level-number-position:right;
text-indent:-9.0pt;}
@list l2
{mso-list-id:1554734098;
mso-list-type:hybrid;
mso-list-template-ids:-14518814 67698711 67698713 67698715 67698703 67698713 67698715 67698703 67698713 67698715;}
@list l2:level1
{mso-level-number-format:alpha-lower;
mso-level-text:"%1\)";
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-18.0pt;}
@list l2:level2
{mso-level-number-format:alpha-lower;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-18.0pt;}
@list l2:level3
{mso-level-number-format:roman-lower;
mso-level-tab-stop:none;
mso-level-number-position:right;
text-indent:-9.0pt;}
@list l2:level4
{mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-18.0pt;}
@list l2:level5
{mso-level-number-format:alpha-lower;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-18.0pt;}
@list l2:level6
{mso-level-number-format:roman-lower;
mso-level-tab-stop:none;
mso-level-number-position:right;
text-indent:-9.0pt;}
@list l2:level7
{mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-18.0pt;}
@list l2:level8
{mso-level-number-format:alpha-lower;
mso-level-tab-stop:none;
mso-level-number-position:left;
text-indent:-18.0pt;}
@list l2:level9
{mso-level-number-format:roman-lower;
mso-level-tab-stop:none;
mso-level-number-position:right;
text-indent:-9.0pt;}
ol
{margin-bottom:0cm;}
ul
{margin-bottom:0cm;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]--></head><body lang=EN-US link=blue vlink=purple style='word-wrap:break-word'><div class=WordSection1><p class=MsoNormal>Dear AI Colleagues,<o:p></o:p></p><p class=MsoNormal><o:p> </o:p></p><p class=MsoNormal>in the International AI Doctoral Academy (<a href="https://www.i-aida.org/">AIDA</a>), we recently organized a series of events (lectures etc), towards clarifying LLM issues for the<o:p></o:p></p><p class=MsoNormal>Benefit of our PhD students and postdocs. I have also done some research myself (though not an LLM expert), as I wanted to add a section on LLMs in my recent book (Oct 2022)<o:p></o:p></p><p class=MsoNormal><b><span lang=EN-GB style='font-size:10.0pt;font-family:"Barlow Light"'>I.Pitas, “Artificial Intelligence Science and Society Part A: Introduction to AI Science and Information Technology“, Amazon/Createspece, </span></b><a href="https://www.amazon.com/dp/9609156460?ref_=pe_3052080_397514860"><b><span lang=EN-GB style='font-size:10.0pt;font-family:"Barlow Light"'>https://www.amazon.com/dp/9609156460?ref_=pe_3052080_397514860</span></b></a><o:p></o:p></p><p class=MsoNormal><o:p> </o:p></p><p class=MsoNormal>I attach some thoughts (parts of the above mentioned book section) on the issue of LLM memory and intelligence that may be of interest to you. Of course, critical comments are welcomed.<o:p></o:p></p><p class=MsoNormal><o:p> </o:p></p><p class=MsoNormal>As such discussions in Connectionists are very interesting, but fragmented by the nature of this medium, I propose that they continue in the form of a rather informal ‘LLM mellontology’ symposium <o:p></o:p></p><p class=MsoNormal>that can summarize the related findings. If there is an interest in co-organizing such a (e-?)symposium, let me know. <o:p></o:p></p><p class=MsoNormal><o:p> </o:p></p><p class=MsoNormal>AIDA has recently organized several very successful such symposia, the last one (2023) on <a href="https://icarus.csd.auth.gr/ai-mellontology-symposium-2023/">Computational Politics</a>.<o:p></o:p></p><p class=MsoNormal>Though I am really oversubscribed, if there is sufficient interest, I could consider co-organizing such an event in Greece, which is very beautiful in summer (2023). <o:p></o:p></p><p class=MsoNormal>Any other location proposal (or e-symposium organization) is welcomed.<o:p></o:p></p><p class=MsoNormal> <o:p></o:p></p><p class=MsoNormal>Best regards<o:p></o:p></p><p class=MsoNormal>Ioannis Pitas, AIDA Chair<o:p></o:p></p><p class=MsoNormal><o:p> </o:p></p><ol style='margin-top:0cm' start=1 type=a><li class=MsoListParagraph style='margin-left:0cm;line-height:15.0pt;mso-list:l2 level1 lfo3'><b><span style='font-size:10.0pt;font-family:"Barlow Light"'>LLMs and Memory</span></b><span style='font-size:10.0pt;font-family:"Barlow Light"'> (I still have some reservations on whether LLMs are really closed systems or have access to external knowledge sources).<o:p></o:p></span></li></ol><p class=MsoNormal style='line-height:15.0pt'><span style='font-size:10.0pt;font-family:"Barlow Light"'><o:p> </o:p></span></p><p class=MsoNormal style='line-height:15.0pt'><span style='font-size:10.0pt;font-family:"Barlow Light"'>LLMs have been around for a while. However, they did caption massive people’s attention and enjoyed huge popularity with the huge success of<i> ChatGPT </i>of OpenAI (2022). It showcased the production of smooth text, in response to user needs and prompts. It could also enter into ‘intelligent’ dialogs with even experienced users. Such text and replies could have the form of small essays containing rather accurate factual information (though it may hallucinate facts at times). Of course, a closed LLM system having billions of parameters should have a finite storage capacity. It has been designed to implicitly 'store' grammar and syntax knowledge, in the form of word correlations. However, it is quite puzzling how it can store rather well factual knowledge, as it can infinite (in theory). This storage capacity of LLMs should be studied more carefully. It can be proven that such a study could give us hints on how biological (including human) memory mechanisms function. Furthermore, the use of ‘closed LLM systems’ in conjunction with classical knowledge storage, query and retrieval mechanisms, e.g., in the form of knowledge graphs, can both expand their application domain and offer new superior ways to search content. Such questions become even more interesting, if we take into account that the 'knowledge' storage capacity of much simpler DNNs has not really been studied well in the literature.<o:p></o:p></span></p><p class=MsoNormal style='line-height:15.0pt'><span style='font-size:10.0pt;font-family:"Barlow Light"'><o:p> </o:p></span></p><ol style='margin-top:0cm' start=2 type=a><li class=MsoListParagraph style='margin-left:0cm;line-height:15.0pt;mso-list:l2 level1 lfo3'><b><span style='font-size:10.0pt;font-family:"Barlow Light"'>LLMs and reasoning/intelligence.<o:p></o:p></span></b></li></ol><p class=MsoNormal style='line-height:15.0pt'><span style='font-size:10.0pt;font-family:"Barlow Light"'><o:p> </o:p></span></p><p class=MsoNormal style='line-height:15.0pt'><span style='font-size:10.0pt;font-family:"Barlow Light"'>It is understood that LLMs were not designed to address logical inference/reasoning. However, they create the impression to the average user that they have such a capacity, possibly at a limited level. For example, ChatGPT can also solve mathematical problems and produce programming code. A big question is whether such inference mechanisms are just an illusion or a revolutionary approach in solving a core AI research issues: reconciling Symbolic AI with Machine Learning, while advancing the former. As language (text) include millions of inference examples, it could be revealed that LLMs have the capacity to learn to learn symbolic AI from examples. After all, human inference follows certain thought patterns that can be easily mimicked (predicted) by LLMs through massive training. For example, LLMs can be proven to be proficient in forms of Logic Programming, as they already do in other programming tasks. This prospect may create jitter to Mathematical Logic scientists, but it can be proven to be a viable way forward. Any LLM ‘inference by example’ capacity may also hint ways that humans use to learn to think. Even in the absence of formal education, humans learn from their mothers, relatives and peers how to think, based on countless discussions and arguments on every day topics. At the very end, the debate on whether LLMs are intelligent or not may just evolve around a non-issue. For great many people, it is enough that machines <i>appear</i> to be intelligent and possibly better at that than themselves. However, stronger research efforts are needed answer such fundamental questions on machine intelligence.<o:p></o:p></span></p><p class=MsoNormal><o:p> </o:p></p></div><div id="DAB4FAD8-2DD7-40BB-A1B8-4E2AA1F9FDF2"><br /><table style="border-top: 1px solid #D3D4DE;"><tr><td style="width: 55px; padding-top: 13px;"><a href="https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campaign=sig-email&utm_content=emailclient" target="_blank"><img src="https://s-install.avcdn.net/ipm/preview/icons/icon-envelope-tick-round-orange-animated-no-repeat-v1.gif" alt="" width="46" height="29" style="width: 46px; height: 29px;"/></a></td><td style="width: 470px; padding-top: 12px; color: #41424e; font-size: 13px; font-family: Arial, Helvetica, sans-serif; line-height: 18px;">Virus-free.<a href="https://www.avast.com/sig-email?utm_medium=email&utm_source=link&utm_campaign=sig-email&utm_content=emailclient" target="_blank" style="color: #4453ea;">www.avast.com</a></td></tr></table><a href="#DAB4FAD8-2DD7-40BB-A1B8-4E2AA1F9FDF2" width="1" height="1"> </a></div></body></html>