Connectionists: [Call for participation] 2025 WSDM Cup: LMSYS Multilingual Chatbot Arena

[Megha Khosla]

We are thrilled to launch the 2025 WSDM Cup: LMSYS Multilingual Chatbot Arena Prediction Contest, in collaboration with Kaggle and LMSYS.org.

This year's challenge focuses on creating multilingual auto-rater models using chatbot arena data. In order to provide a strong ability to ensure that these models are indeed reflective of human evaluations, we have worked in partnership with LMSYS.org <http://lmsys.org/>, which has become one of the leading resources for the field through their well known chatbot arena lmarena.ai <http://lmarena.ai/>. This arena has led the way in open-ended, community based evaluations of LLMs in blind side-by-side comparison, and provides the perfect resource for training and evaluating auto-rater models.

Hosted by Kaggle, with a prize fund of $50,000 USD, the competition begins Monday, November 18, 2024, and submissions close February 3, 2025. More details about deadlines can be found at https://www.wsdm-conference.org/2025/2025-wsdm-cup-lmsys-multilingual-chatbot-arena/ <https://eur03.safelinks.protection.outlook.com/?url=https%3A%2F%2Fwww.wsdm-conference.org%2F2025%2F2025-wsdm-cup-lmsys-multilingual-chatbot-arena%2F&data=05%7C02%7CM.Khosla%40tudelft.nl%7Cf0f6755be055406c6e1108dd07ff180a%7C096e524d692940308cd38ab42de0887b%7C0%7C0%7C638675514396238242%7CUnknown%7CTWFpbGZsb3d8eyJFbXB0eU1hcGkiOnRydWUsIlYiOiIwLjAuMDAwMCIsIlAiOiJXaW4zMiIsIkFOIjoiTWFpbCIsIldUIjoyfQ%3D%3D%7C0%7C%7C%7C&sdata=cMV%2BuS9bWvcPTPbo%2FpCVQ5riWnnHd04R%2BeCvAEJYp%2B4%3D&reserved=0>
Get Started

Visit the official competition page on Kaggle for all details:  https://www.kaggle.com/competitions/wsdm-cup-multilingual-chatbot-arena/overview

-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mailman.srv.cs.cmu.edu/pipermail/connectionists/attachments/20241119/8d3c4858/attachment.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: smime.p7s
Type: application/pkcs7-signature
Size: 1566 bytes
Desc: not available
URL: <http://mailman.srv.cs.cmu.edu/pipermail/connectionists/attachments/20241119/8d3c4858/attachment.p7s>