[CMU AI Seminar] March 1 at 12pm (Zoom) -- Douwe Kiela (Hugging Face) -- Dynabench: Rethinking Benchmarking in AI -- AI Seminar sponsored by Morgan Stanley

[Asher Trockman]

Hi all,

Just a reminder that the CMU AI Seminar <http://www.cs.cmu.edu/~aiseminar/> is
tomorrow *12pm-1pm*:
https://cmu.zoom.us/j/99510233317?pwd=ZGx4aExNZ1FNaGY4SHI3Qlh0YjNWUT09.

*Douwe Kiela (Hugging Face)* will be sharing his work on addressing
problems with the current benchmarking paradigm in AI.

Thanks,
Asher

On Fri, Feb 25, 2022 at 1:41 PM Asher Trockman <ashert at cs.cmu.edu> wrote:

> Dear all,
>
> We look forward to seeing you *next Tuesday (3/1)* from *1**2:00-1:00 PM
> (U.S. Eastern time)* for the next talk of our *CMU AI seminar*, sponsored
> by Morgan Stanley <https://www.morganstanley.com/about-us/technology/>.
>
> To learn more about the seminar series or see the future schedule, please
> visit the seminar website <http://www.cs.cmu.edu/~aiseminar/>.
>
> On 3/1, *Douwe Kiela *(Hugging Face) will be giving a talk titled *"**Dynabench:
> Rethinking Benchmarking in AI**"* to share his work on addressing
> problems with the current benchmarking paradigm in AI.
>
> *Title*: Dynabench: Rethinking Benchmarking in AI
>
> *Talk Abstract*: The current benchmarking paradigm in AI has many issues:
> benchmarks saturate quickly, are susceptible to overfitting, contain
> exploitable annotator artifacts, have unclear or imperfect evaluation
> metrics, and do not necessarily measure what we really care about. I will
> talk about our work in trying to rethink the way we do benchmarking in AI,
> specifically in natural language processing, focusing mostly on the
> Dynabench platform (dynabench.org).
>
> *Speaker Bio*: Douwe Kiela (@douwekiela, https://douwekiela.github.io/)
> is the Head of Research at Hugging Face. Before, he was a Research
> Scientist at Facebook AI Research. His current research interests lie in
> developing better models for (grounded, multi-agent) language understanding
> and better tools for evaluation and benchmarking.
>
> *Zoom Link*:
> https://cmu.zoom.us/j/99510233317?pwd=ZGx4aExNZ1FNaGY4SHI3Qlh0YjNWUT09
>
> Thanks,
> Asher Trockman
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mailman.srv.cs.cmu.edu/pipermail/ai-seminar-announce/attachments/20220228/b758cd11/attachment.html>