[CMU AI Seminar] March 1 at 12pm (Zoom) -- Douwe Kiela (Hugging Face) -- Dynabench: Rethinking Benchmarking in AI -- AI Seminar sponsored by Morgan Stanley

[Asher Trockman]

Dear all,

We look forward to seeing you *next Tuesday (3/1)* from *1**2:00-1:00 PM
(U.S. Eastern time)* for the next talk of our *CMU AI seminar*, sponsored
by Morgan Stanley <https://www.morganstanley.com/about-us/technology/>.

To learn more about the seminar series or see the future schedule, please
visit the seminar website <http://www.cs.cmu.edu/~aiseminar/>.

On 3/1, *Douwe Kiela *(Hugging Face) will be giving a talk titled
*"**Dynabench:
Rethinking Benchmarking in AI**"* to share his work on addressing problems
with the current benchmarking paradigm in AI.

*Title*: Dynabench: Rethinking Benchmarking in AI

*Talk Abstract*: The current benchmarking paradigm in AI has many issues:
benchmarks saturate quickly, are susceptible to overfitting, contain
exploitable annotator artifacts, have unclear or imperfect evaluation
metrics, and do not necessarily measure what we really care about. I will
talk about our work in trying to rethink the way we do benchmarking in AI,
specifically in natural language processing, focusing mostly on the
Dynabench platform (dynabench.org).

*Speaker Bio*: Douwe Kiela (@douwekiela, https://douwekiela.github.io/) is
the Head of Research at Hugging Face. Before, he was a Research Scientist
at Facebook AI Research. His current research interests lie in developing
better models for (grounded, multi-agent) language understanding and better
tools for evaluation and benchmarking.

*Zoom Link*:
https://cmu.zoom.us/j/99510233317?pwd=ZGx4aExNZ1FNaGY4SHI3Qlh0YjNWUT09

Thanks,
Asher Trockman
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mailman.srv.cs.cmu.edu/pipermail/ai-seminar-announce/attachments/20220225/da011fe4/attachment.html>