[CMU AI Seminar] March 1 at 12pm (Zoom) -- Douwe Kiela (Hugging Face) -- Dynabench: Rethinking Benchmarking in AI -- AI Seminar sponsored by Morgan Stanley

[Asher Trockman]

Hi all,

The seminar today by Douwe Kiela on the Dynabench platform is happening
right now!

In case you are interested:
https://cmu.zoom.us/j/99510233317?pwd=ZGx4aExNZ1FNaGY4SHI3Qlh0YjNWUT09

Thanks,
Asher

On Mon, Feb 28, 2022 at 4:27 PM Asher Trockman <ashert at cs.cmu.edu> wrote:

> Hi all,
>
> Just a reminder that the CMU AI Seminar
> <http://www.cs.cmu.edu/~aiseminar/> is tomorrow *12pm-1pm*:
> https://cmu.zoom.us/j/99510233317?pwd=ZGx4aExNZ1FNaGY4SHI3Qlh0YjNWUT09.
>
> *Douwe Kiela (Hugging Face)* will be sharing his work on addressing
> problems with the current benchmarking paradigm in AI.
>
> Thanks,
> Asher
>
> On Fri, Feb 25, 2022 at 1:41 PM Asher Trockman <ashert at cs.cmu.edu> wrote:
>
>> Dear all,
>>
>> We look forward to seeing you *next Tuesday (3/1)* from *1**2:00-1:00 PM
>> (U.S. Eastern time)* for the next talk of our *CMU AI seminar*,
>> sponsored by Morgan Stanley
>> <https://www.morganstanley.com/about-us/technology/>.
>>
>> To learn more about the seminar series or see the future schedule, please
>> visit the seminar website <http://www.cs.cmu.edu/~aiseminar/>.
>>
>> On 3/1, *Douwe Kiela *(Hugging Face) will be giving a talk titled *"**Dynabench:
>> Rethinking Benchmarking in AI**"* to share his work on addressing
>> problems with the current benchmarking paradigm in AI.
>>
>> *Title*: Dynabench: Rethinking Benchmarking in AI
>>
>> *Talk Abstract*: The current benchmarking paradigm in AI has many
>> issues: benchmarks saturate quickly, are susceptible to overfitting,
>> contain exploitable annotator artifacts, have unclear or imperfect
>> evaluation metrics, and do not necessarily measure what we really care
>> about. I will talk about our work in trying to rethink the way we do
>> benchmarking in AI, specifically in natural language processing, focusing
>> mostly on the Dynabench platform (dynabench.org).
>>
>> *Speaker Bio*: Douwe Kiela (@douwekiela, https://douwekiela.github.io/)
>> is the Head of Research at Hugging Face. Before, he was a Research
>> Scientist at Facebook AI Research. His current research interests lie in
>> developing better models for (grounded, multi-agent) language understanding
>> and better tools for evaluation and benchmarking.
>>
>> *Zoom Link*:
>> https://cmu.zoom.us/j/99510233317?pwd=ZGx4aExNZ1FNaGY4SHI3Qlh0YjNWUT09
>>
>> Thanks,
>> Asher Trockman
>>
>
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mailman.srv.cs.cmu.edu/pipermail/ai-seminar-announce/attachments/20220301/e8534eb3/attachment.html>