Ridiculously long streak of victories of the Auton Lab's AutoML tool continues

[Artur Dubrawski]

Dear Autonians,

You have heard many times from me about our DARPA D3M Team and in
particular Saswati Ray who is leading the automated machine learning effort
in it (which we have recently aptly named Auto^{n}ML), and their long
uninterrupted streak of wins in periodic DARPA-run evaluations.

I guess everyone in the program was bored with that, so they decided to
expose the competing systems to an external repository of challenges. So
they picked 651 predictive problems from the OpenML repository. Guess what,
our CMU team has done it again. See the attached screenshots from the
leaderboard provided by DARPA. What is of note this time around is that
Saswati's algorithm was able to yield better results than the best
solutions available so far on OpenML in more than 100 cases. All
contensting tools were given a budget of 30 minutes of compute time per
task to propose the best ML architecture to tackle a problem.

Way to go Saswati and the CMU Auton Lab DARPA D3M Team!

Cheers,
Artur

[image: image.png]
[image: image.png]
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://mailman.srv.cs.cmu.edu/pipermail/autonlab-users/attachments/20210430/855de649/attachment-0001.html>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image.png
Type: image/png
Size: 23720 bytes
Desc: not available
URL: <http://mailman.srv.cs.cmu.edu/pipermail/autonlab-users/attachments/20210430/855de649/attachment-0002.png>
-------------- next part --------------
A non-text attachment was scrubbed...
Name: image.png
Type: image/png
Size: 32457 bytes
Desc: not available
URL: <http://mailman.srv.cs.cmu.edu/pipermail/autonlab-users/attachments/20210430/855de649/attachment-0003.png>