<div dir="ltr"><div class="gmail_quote gmail_quote_container"><div dir="ltr" class="gmail_attr"><br></div><div dir="ltr"><b><font size="4"><span style="color:rgb(33,33,33);font-family:Arial">CLEF 2025 Conference and Labs of the Evaluation Forum</span></font></b><div><b><font size="4"><span style="color:rgb(33,33,33);font-family:Arial">9-12 September<span> </span></span><span style="color:rgb(33,33,33);font-family:Arial">2025, Madrid, Spain</span></font></b><br style="color:rgb(33,33,33);font-family:Arial;font-size:14.6667px"><br style="color:rgb(33,33,33);font-family:Arial;font-size:14.6667px"><span style="color:rgb(33,33,33);font-family:Arial">CLEF 2025 is the 16th CLEF conference continuing the popular CLEF<span> </span></span><br style="color:rgb(33,33,33);font-family:Arial"><span style="color:rgb(33,33,33);font-family:Arial">campaigns which have run since 2000 contributing to the systematic<span> </span></span><br style="color:rgb(33,33,33);font-family:Arial"><span style="color:rgb(33,33,33);font-family:Arial">evaluation of information access systems, primarily through<span> </span></span><br style="color:rgb(33,33,33);font-family:Arial"><span style="color:rgb(33,33,33);font-family:Arial">experimentation on shared tasks.</span><br style="color:rgb(33,33,33);font-family:Arial"><br style="color:rgb(33,33,33);font-family:Arial"><span style="color:rgb(33,33,33);font-family:Arial">The CLEF Conference addresses all aspects of Information Access in any<span> </span></span><br style="color:rgb(33,33,33);font-family:Arial"><span style="color:rgb(33,33,33);font-family:Arial">modality and language. The CLEF conference consists of presentation of<span> </span></span><br style="color:rgb(33,33,33);font-family:Arial"><span style="color:rgb(33,33,33);font-family:Arial">research papers and a series of workshops presenting the results of<span> </span></span><br style="color:rgb(33,33,33);font-family:Arial"><span style="color:rgb(33,33,33);font-family:Arial">lab-based comparative evaluation benchmarks.</span><br style="color:rgb(33,33,33);font-family:Arial"><br style="color:rgb(33,33,33);font-family:Arial"><span style="color:rgb(33,33,33);font-family:Arial"><b>Good To Know</b></span><br style="color:rgb(33,33,33);font-family:Arial"><span style="color:rgb(33,33,33);font-family:Arial">-------------</span><br style="color:rgb(33,33,33);font-family:Arial"><span style="color:rgb(33,33,33);font-family:Arial">The CLEF 2025 Conference welcomes papers in the Information Access<span> </span></span><br style="color:rgb(33,33,33);font-family:Arial"><span style="color:rgb(33,33,33);font-family:Arial">domain that describe rigorous</span><br style="color:rgb(33,33,33);font-family:Arial"><span style="color:rgb(33,33,33);font-family:Arial">hypothesis testing regardless of whether the results are positive or<span> </span></span><br style="color:rgb(33,33,33);font-family:Arial"><span style="color:rgb(33,33,33);font-family:Arial">negative. Each submission is reviewed in two stages, see more details<span> </span></span><br style="color:rgb(33,33,33);font-family:Arial"><span style="color:rgb(33,33,33);font-family:Arial">here:<span> </span></span><a href="https://clef2025.clef-initiative.eu" title="https://clef2025.clef-initiative.eu" style="color:rgb(0,120,215);font-family:Arial" target="_blank">https://clef2025.clef-initiative.eu</a><br style="color:rgb(33,33,33);font-family:Arial"><br style="color:rgb(33,33,33);font-family:Arial"><span style="color:rgb(33,33,33);font-family:Arial"><b>Important Dates (AoE)</b></span><br style="color:rgb(33,33,33);font-family:Arial"><span style="color:rgb(33,33,33);font-family:Arial">-----------------------</span><br style="color:rgb(33,33,33);font-family:Arial"><span style="color:rgb(33,33,33);font-family:Arial">6 May 2025: Abstract submission of Long, Short, Best of 2024 Labs Papers</span><br style="color:rgb(33,33,33);font-family:Arial"><span style="color:rgb(33,33,33);font-family:Arial">13 May 2025: Full paper submission deadline (Long, Short, Best of 2024 Labs)</span><br style="color:rgb(33,33,33);font-family:Arial"><span style="color:rgb(33,33,33);font-family:Arial">10 June 2025: Notification of acceptance (Long, Short, Best of Labs)</span><br style="color:rgb(33,33,33);font-family:Arial"><span style="color:rgb(33,33,33);font-family:Arial">23 June 2025: Camera-ready version due</span><br style="color:rgb(33,33,33);font-family:Arial"><span style="color:rgb(33,33,33);font-family:Arial">9-12 September 2025: Conference</span><br style="color:rgb(33,33,33);font-family:Arial"><br style="color:rgb(33,33,33);font-family:Arial"><span style="color:rgb(33,33,33);font-family:Arial"><b>Format</b></span><br style="color:rgb(33,33,33);font-family:Arial"><span style="color:rgb(33,33,33);font-family:Arial">-------</span><br style="color:rgb(33,33,33);font-family:Arial"><span style="color:rgb(33,33,33);font-family:Arial">Authors are invited to electronically submit original papers, which have<span> </span></span><br style="color:rgb(33,33,33);font-family:Arial"><span style="color:rgb(33,33,33);font-family:Arial">not been published and are not under consideration elsewhere, using the<span> </span></span><br style="color:rgb(33,33,33);font-family:Arial"><span style="color:rgb(33,33,33);font-family:Arial">LNCS proceedings format.</span><br style="color:rgb(33,33,33);font-family:Arial"><br style="color:rgb(33,33,33);font-family:Arial"><span style="color:rgb(33,33,33);font-family:Arial">Two categories of papers will be accepted:</span><br style="color:rgb(33,33,33);font-family:Arial"><ul><li><span style="color:rgb(33,33,33);font-family:Arial">Long papers: 12 pages plus references</span></li><li>Short papers: 6 pages plus references</li></ul><br style="color:rgb(33,33,33);font-family:Arial"><span style="color:rgb(33,33,33);font-family:Arial"><b>Topics</b></span><br style="color:rgb(33,33,33);font-family:Arial"><span style="color:rgb(33,33,33);font-family:Arial">---------</span><br style="color:rgb(33,33,33);font-family:Arial"><span style="color:rgb(33,33,33);font-family:Arial">Relevant topics for the CLEF 2025 Conference include but are not limited to:</span><br style="color:rgb(33,33,33);font-family:Arial"><ul><li><span style="color:rgb(33,33,33);font-family:Arial">Information access in any language or modality: information retrieval,<span> </span></span>image retrieval, question answering, search interfaces and design,<span style="color:rgb(33,33,33);font-family:Arial"> </span>infrastructures, etc.</li><li><span style="color:rgb(33,33,33);font-family:Arial">Analytics for information retrieval: theoretical and practical results </span>in the analytics field that are specifically targeted for information<span style="color:rgb(33,33,33);font-family:Arial"> </span>access data analysis, data enrichment, etc.</li><li><span style="color:rgb(33,33,33);font-family:Arial">Reproducibility and replicability issues: analyses of past results/run<span> </span></span>deep analysis both statistically and fine grain based.</li><li><span style="color:rgb(33,33,33);font-family:Arial">Language diversity: work on low-resource languages.</span></li><li><span style="color:rgb(33,33,33);font-family:Arial">Models leveraging collaborative and social data and their evaluation.</span></li><li><span style="color:rgb(33,33,33);font-family:Arial">User studies either based on lab studies or crowdsourcing.</span></li><li><span style="color:rgb(33,33,33);font-family:Arial">Evaluation initiatives: conclusions, lessons learned, impact and<span> </span></span>projection of any evaluation initiative after completing their cycle.</li><li><span style="color:rgb(33,33,33);font-family:Arial">Evaluation: methodologies, metrics, statistical and analytical tools,<span> </span></span>component based, user groups and use cases, ground-truth creation,<span style="color:rgb(33,33,33);font-family:Arial"> </span>impact of multilingual/multicultural/multimodal differences, etc.</li><li><span style="color:rgb(33,33,33);font-family:Arial">Technology transfer: economic impact/sustainability of information<span> </span></span>access approaches, deployment and exploitation of systems, use cases, etc.</li><li><span style="color:rgb(33,33,33);font-family:Arial">Interactive and Conversational Information Retrieval evaluation: the<span> </span></span>interactive/conversational evaluation of information retrieval systems<span style="color:rgb(33,33,33);font-family:Arial"> </span>using user-centered methods, evaluation of novel search interfaces,<span style="color:rgb(33,33,33);font-family:Arial"> </span>novel interactive/conversational evaluation methods, simulation of<span style="color:rgb(33,33,33);font-family:Arial"> </span>interaction/conversation, etc.</li><li><span style="color:rgb(33,33,33);font-family:Arial">Specific application domains: information access and its evaluation in </span>application domains such as cultural heritage, digital libraries, social<span style="color:rgb(33,33,33);font-family:Arial"> </span>media, health information, legal documents, patents, news, books, and in<span style="color:rgb(33,33,33);font-family:Arial"> </span>the form of text, audio and/or image data.</li><li><span style="color:rgb(33,33,33);font-family:Arial">New data collection: presentation of new data collections with<span> </span></span>potential high impact on future research, specific collections from<span style="color:rgb(33,33,33);font-family:Arial"> </span>companies or labs, multilingual collections.</li></ul><br style="color:rgb(33,33,33);font-family:Arial"><span style="color:rgb(33,33,33);font-family:Arial">More details at<span> </span></span><a href="https://clef2025.clef-initiative.eu" title="https://clef2025.clef-initiative.eu" style="color:rgb(0,120,215);font-family:Arial" target="_blank">https://clef2025.clef-initiative.eu</a></div><div><br></div><div><span style="color:rgb(33,33,33);font-family:Arial;font-size:14.6667px">----------</span></div><div><p class="MsoNormal" style="margin:0cm;font-family:Aptos,sans-serif"><span lang="ES" style="font-family:Arial,sans-serif"> </span></p>

<p class="MsoNormal" style="margin:0cm 0cm 8pt;line-height:115%;font-family:Aptos,sans-serif"><b><span style="line-height:115%;font-family:"Arial Black",sans-serif;color:rgb(0,83,63)">Dr Alba García Seco de Herrera</span></b></p>

<p class="MsoNormal" style="margin:0cm 0cm 8pt;line-height:115%;font-family:Aptos,sans-serif"><b><i><span style="line-height:115%;font-family:Arial,sans-serif;color:black">Distinguished researcher</span></i></b></p>

<p class="MsoNormal" style="margin:0cm 0cm 8pt;line-height:115%;font-family:Aptos,sans-serif"><span style="line-height:115%;font-family:Arial,sans-serif;color:black">Escuela Técnica Superior de Ingeniería
Informática</span></p><span style="font-size:12pt;font-family:Aptos,sans-serif">
<br>
</span></div></div>
</div></div>