From pnspence at andrew.cmu.edu Wed Jan 8 15:07:48 2020 From: pnspence at andrew.cmu.edu (Patricia N Spencer) Date: Wed, 8 Jan 2020 20:07:48 +0000 Subject: Auton Lab Weekly Brainstorming Meeting Message-ID: <1a764ed308184d81832110abe9a963b7@andrew.cmu.edu> -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: not available Type: text/calendar Size: 1509 bytes Desc: not available URL: From sarveshj at andrew.cmu.edu Sun Jan 12 20:13:39 2020 From: sarveshj at andrew.cmu.edu (Sarveshwaran Jayaraman) Date: Mon, 13 Jan 2020 01:13:39 +0000 Subject: TensorBoard vizualization error Message-ID: Hi, Has anyone using tensorboard for visualizing training on the compute cluster? I am getting the following error(ref:screenshot attached) Unable to connect Firefox can?t establish a connection to the server at localhost:6006. The site could be temporarily unavailable or too busy. Try again in a few moments. If you are unable to load any pages, check your computer?s network connection. If your computer or network is protected by a firewall or proxy, make sure that Firefox is permitted to access the Web. Thanks for your help! [1562005799537] Sarvesh Jayaraman Sr. Research Analyst, Auton Lab Carnegie Mellon University Mob: +1-240-893-4287 -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: OutlookEmoji-15620057995374690225d-20b8-4d53-890e-7a883f549b37.png Type: image/png Size: 5461 bytes Desc: OutlookEmoji-15620057995374690225d-20b8-4d53-890e-7a883f549b37.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: tensorboard_viz_error.png Type: image/png Size: 110558 bytes Desc: tensorboard_viz_error.png URL: From predragp at andrew.cmu.edu Sun Jan 12 21:55:44 2020 From: predragp at andrew.cmu.edu (Predrag Punosevac) Date: Sun, 12 Jan 2020 21:55:44 -0500 Subject: TensorBoard vizualization error In-Reply-To: References: Message-ID: <20200113025544.esLsubAr5%predragp@andrew.cmu.edu> Sarveshwaran Jayaraman wrote: > Hi, > > > Has anyone using tensorboard for visualizing training on the compute cluster? I am getting the following error(ref:screenshot attached) > Attachments are stripped from the emails sent to our mailing list. That is the standard practice and most mailing lists. The most common reason is that allowing attachments can theoretically allow harmful things like viruses to be sent. > > Unable to connect > > Firefox can?t establish a connection to the server at localhost:6006. > Firewalls are turned on by default on all Auton Lab machines but the computing nodes have very liberal policies allowing most egress traffic and limiting ingress traffic to ssh and one other UDP port needed for SNMP monitoring. However, local traffic should be OK unless more than one user are trying to listen on the same port. If you are trying port 6006 from a remote machine you are out of luck my friend. Best, Predrag > The site could be temporarily unavailable or too busy. Try again in a few moments. > If you are unable to load any pages, check your computer?s network connection. > If your computer or network is protected by a firewall or proxy, make sure that Firefox is permitted to access the Web. > > > > Thanks for your help! > > > > > [1562005799537] > > Sarvesh Jayaraman > Sr. Research Analyst, Auton Lab > Carnegie Mellon University > Mob: +1-240-893-4287 > > From awd at cs.cmu.edu Wed Jan 15 19:56:48 2020 From: awd at cs.cmu.edu (Artur Dubrawski) Date: Wed, 15 Jan 2020 19:56:48 -0500 Subject: ANOTHER UPDATE: [In case you have been contemplating developing or applying automated machine learning... In-Reply-To: References: Message-ID: As you might have noticed, we are hosting a large DARPA workshop and evaluation exercise this week (thank you Jarod for taking care of all the logistics and the rest of the Auton team for your support!) I know if starts sounding quite boring, but Saswati and her Team's automated machine learning tool is still leading the leaderboard of the D3M program, uncontested for several months now. This is quite special since all of the code is available to other performers so they should be able to catch up, and they are trying, but our tool seems to continue eluding its pursuers with a surprising consistency :) Again, congrats to everyone involved! Artur PS The top of the current leaderboard: [image: image.png] On Tue, Aug 27, 2019 at 4:33 PM Artur Dubrawski wrote: > ... look no further than Saswati Ray's office. <-- that's what I said > in June, and it holds!] > > However, Saswati's Task Force continues to excel at DARPA D3M evaluations. > Please see below the current leaderboard -- the competition was indeed > top-notch. > > Cheers and congrats to everyone who contributed and please continue your > outstanding work! > > Artur > > [image: image.png] > On Fri, Jun 14, 2019 at 8:41 AM Artur Dubrawski wrote: > >> ... look no further than Saswati Ray's office. >> >> She leads the Auton Lab task force that got CMU to the very top of the >> leader boards in the current DARPA D3M evaluations, leaving behind a number >> of lead university (all the usual suspects included) and industrial >> competitors. >> >> Congrats to everyone involved! >> >> Cheers, >> Artur >> > -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image.png Type: image/png Size: 79664 bytes Desc: not available URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image.png Type: image/png Size: 70105 bytes Desc: not available URL: From roni at cs.cmu.edu Wed Jan 15 22:09:02 2020 From: roni at cs.cmu.edu (Roni Rosenfeld) Date: Thu, 16 Jan 2020 03:09:02 +0000 Subject: ANOTHER UPDATE: [In case you have been contemplating developing or applying automated machine learning... In-Reply-To: References: Message-ID: <4601a1c056cc47baaa65aa1d5c50b391@cs.cmu.edu> Congratulations! Very impressive indeed! From: Artur Dubrawski Sent: Wednesday, January 15, 2020 7:57 PM To: users at autonlab.org Cc: Srinivasa G Narasimhan ; Martial H Hebert ; Byron G Spice ; Roni Rosenfeld ; Tom M Mitchell Subject: ANOTHER UPDATE: [In case you have been contemplating developing or applying automated machine learning... As you might have noticed, we are hosting a large DARPA workshop and evaluation exercise this week (thank you Jarod for taking care of all the logistics and the rest of the Auton team for your support!) I know if starts sounding quite boring, but Saswati and her Team's automated machine learning tool is still leading the leaderboard of the D3M program, uncontested for several months now. This is quite special since all of the code is available to other performers so they should be able to catch up, and they are trying, but our tool seems to continue eluding its pursuers with a surprising consistency :) Again, congrats to everyone involved! Artur PS The top of the current leaderboard: [image.png] On Tue, Aug 27, 2019 at 4:33 PM Artur Dubrawski > wrote: ... look no further than Saswati Ray's office. <-- that's what I said in June, and it holds!] However, Saswati's Task Force continues to excel at DARPA D3M evaluations. Please see below the current leaderboard -- the competition was indeed top-notch. Cheers and congrats to everyone who contributed and please continue your outstanding work! Artur [image.png] On Fri, Jun 14, 2019 at 8:41 AM Artur Dubrawski > wrote: ... look no further than Saswati Ray's office. She leads the Auton Lab task force that got CMU to the very top of the leader boards in the current DARPA D3M evaluations, leaving behind a number of lead university (all the usual suspects included) and industrial competitors. Congrats to everyone involved! Cheers, Artur -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image001.png Type: image/png Size: 60152 bytes Desc: image001.png URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image002.png Type: image/png Size: 95261 bytes Desc: image002.png URL: From ngisolfi at cs.cmu.edu Thu Jan 16 11:11:10 2020 From: ngisolfi at cs.cmu.edu (Nick Gisolfi) Date: Thu, 16 Jan 2020 11:11:10 -0500 Subject: [Lunch] Today @noon in Gates 8105 Message-ID: <7D00A05A-571A-41DB-B702-367B53761608@cs.cmu.edu> Hi Everyone, I hope everyone is feeling refreshed after winter break! Weekly Auton lab bring-your-own-lunches will continue this semester each Thursday in Gates 8105, which we have reserved from 12-1pm. Sorry for the late notice, but we will start today! A big thank you goes to Karen Widmaier for setting us up in the same spot each week this semester! As a reminder, this invite extends to anyone affiliated in any way with the lab. We rarely talk shop, so this gathering is just an opportunity to connect with your colleagues in an informal and relaxed setting. We hope to see everyone today and in the weeks to come! - Nick From ngisolfi at cs.cmu.edu Thu Jan 16 11:20:05 2020 From: ngisolfi at cs.cmu.edu (Nick Gisolfi) Date: Thu, 16 Jan 2020 11:20:05 -0500 Subject: [Lunch] Today @noon in Gates 8105 In-Reply-To: <7D00A05A-571A-41DB-B702-367B53761608@cs.cmu.edu> References: <7D00A05A-571A-41DB-B702-367B53761608@cs.cmu.edu> Message-ID: <422C0993-C9A5-43BA-BB77-B5657A5FAF27@cs.cmu.edu> 1) The room is Gates 8115 2) The recurring reservation starts *next week* and continues for the rest of the semester. 3) Let?s skip today to avoid confusion on where to meet. Sorry for the false alarm, I?ll send out a reminder next week when we start these meetings in earnest. > On Jan 16, 2020, at 11:11 AM, Nick Gisolfi wrote: > > Hi Everyone, > > I hope everyone is feeling refreshed after winter break! > > Weekly Auton lab bring-your-own-lunches will continue this semester each Thursday in Gates 8105, which we have reserved from 12-1pm. Sorry for the late notice, but we will start today! A big thank you goes to Karen Widmaier for setting us up in the same spot each week this semester! > > As a reminder, this invite extends to anyone affiliated in any way with the lab. We rarely talk shop, so this gathering is just an opportunity to connect with your colleagues in an informal and relaxed setting. > > We hope to see everyone today and in the weeks to come! > > - Nick From vjeansel at andrew.cmu.edu Tue Jan 21 18:33:35 2020 From: vjeansel at andrew.cmu.edu (Vincent Jeanselme) Date: Tue, 21 Jan 2020 18:33:35 -0500 Subject: Lov3 Message-ID: Hello all, Could you check your space usage on lov3, the scratch is close to be full Thank you, Vincent -- Vincent Jeanselme ----------------- Analyst Researcher Auton Lab - Robotics Institute Carnegie Mellon University From ngisolfi at cs.cmu.edu Thu Jan 23 09:47:51 2020 From: ngisolfi at cs.cmu.edu (Nick Gisolfi) Date: Thu, 23 Jan 2020 09:47:51 -0500 Subject: [Lunch] Today @ noon in GHC 8115 Message-ID: Hi Everyone, Auton Lab?s bring-your-own-lunch starts today at noon in GHC 8115. This is a recurring reservation for each Thursday this semester, so feel free to mark the time (12-1pm) and location (GHC 8115) in your calendar if you wish. As a reminder, this invite extends to anyone affiliated in any way with the lab. We rarely talk shop, so this gathering is just an opportunity to connect with your colleagues in an informal and relaxed setting. We hope to see you today! - Nick From laura at schnittgerbourne.ie Sat Jan 25 21:09:36 2020 From: laura at schnittgerbourne.ie (Accounts) Date: Sun, 26 Jan 2020 02:09:36 +0000 Subject: Payment Advice Note from 24.01.2020 Message-ID: To Supplier: Please find enclosed a remittance advice for payment date 24/01/2020. Should you have any queries in relation to the attachment, please do not hesitate to contact us. Sincerely, Accounts Team This e-mail and any attachments including voice attachments may contain confidential, personal, sensitive, proprietary or legally privileged information. Anyone who is not the intended recipient should not use or open the document. Any information or voice recording used within this document or e-mail should not be forwarded to any other legal person or organisation or posted on any social media platform as to do so would be in breach of privacy and data protection legislation. If you have erroneously received this email or document, please delete immediately and notify the sender. If you have received this e-mail or documentation where there is a precise reason to forward to a third party, all rules regarding privacy and data protection should be followed. You will be liable for a third party breach.The recipients acknowledge that Centric Health or associated companies are unable to exercise control to ensure or guarantee the integrity of/over the contents of the information contained in e-mail transmission and further acknowledge that any views expressed in this message are those of the individual sender and no binding nature of the message shall be implied or assumed unless the sender does so expressly with due authority of Centric Health.s. -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: image001.png Type: image/png Size: 8784 bytes Desc: image001.png URL: From predragp at andrew.cmu.edu Tue Jan 28 00:02:57 2020 From: predragp at andrew.cmu.edu (Predrag Punosevac) Date: Tue, 28 Jan 2020 00:02:57 -0500 Subject: GPU[15-19] Message-ID: <20200128050257.7jie3Em9a%predragp@andrew.cmu.edu> Dear Autonians, I just provisioned five new GPU computing nodes bought by Dr. Jeff Schneider before Christmas. Each server had 40 CPU threads, 192 GB of RAM and four RTX 2080 Ti cards. OS is installed on 256 GB SSD. For the first time our computing nodes are running Red Hat branch 8 (8.1 version to be precise soon to be upgraded to 8.2). That is the reason it took me so long to provision them as I wanted to make sure drivers and packages are available. Nvidia drivers seems to be in working condition according to my tests. I did install CUDA 10.2. I didn't install cuDNN libraries as I see only cuDNN RPMs avaiable for Red Hat branch 7. However, I do see cudnn-10.2-linux-x64-v7.6.5.32.tgz which I assume is a source code so you are welcome to try to compile this on your own. Note that you have to have NVidia devel account to access cuDNN libraries. You will find miniconda3 in its usual place. /opt. Note that RedHat 8.1 is build using gcc-8.3.1. System python is now 3.6 but I suggest you use the 3.7.4 from miniconda. Python 2.7 is no longer available. I am pushing right now MATLAB. Your scratch directories will be created tomorrow after I get some sleep. R is there as well as Git 2.18.2. Yes I did test network login both legacy as well autofs accounts. Note that /opt/rh for now is non-existing as SCL are still not available. Namely, default software is rather new so there is no need yet for newer versions. Please stay away from these machines if you are not willing to help debugging remaining issues. Best, Predrag From predragp at andrew.cmu.edu Tue Jan 28 13:01:33 2020 From: predragp at andrew.cmu.edu (Predrag Punosevac) Date: Tue, 28 Jan 2020 13:01:33 -0500 Subject: GPU[15-19] In-Reply-To: <20200128050257.7jie3Em9a%predragp@andrew.cmu.edu> References: <20200128050257.7jie3Em9a%predragp@andrew.cmu.edu> Message-ID: FYI scratch directories are created. Due to the fact that NVMe SSD used for OS is very small 256GB these scratch directories are miniscule. However servers do have a bunch of 3.5" drive bays and I can add some old drives or we could even buy new once as they are super cheap (12 TB is about $250). Also people should familiarize themselves with the differences https://www.simplylinuxfaq.com/p/major-differences-between-rhel-8-and-7.html If everything goes as planned no new instances of branch 7 will be deployed. Existing branch 7 instances will be gradually replaced with 8.XXX but that process might take a while (read more than a year as we have over physical machines running branch 7). Best, Predrag On Tue, Jan 28, 2020 at 12:02 AM Predrag Punosevac wrote: > > Dear Autonians, > > I just provisioned five new GPU computing nodes bought by Dr. Jeff > Schneider before Christmas. Each server had 40 CPU threads, 192 GB of > RAM and four RTX 2080 Ti cards. OS is installed on 256 GB SSD. > > For the first time our computing nodes are running Red Hat branch 8 (8.1 > version to be precise soon to be upgraded to 8.2). That is the reason it > took me so long to provision them as I wanted to make sure drivers and > packages are available. > > Nvidia drivers seems to be in working condition according to my tests. I > did install CUDA 10.2. I didn't install cuDNN libraries as I see only > cuDNN RPMs avaiable for Red Hat branch 7. However, I do see > cudnn-10.2-linux-x64-v7.6.5.32.tgz which I assume is a source code so > you are welcome to try to compile this on your own. Note that you have > to have NVidia devel account to access cuDNN libraries. > > You will find miniconda3 in its usual place. /opt. Note that RedHat 8.1 > is build using gcc-8.3.1. System python is now 3.6 but I suggest you use > the 3.7.4 from miniconda. Python 2.7 is no longer available. I am > pushing right now MATLAB. Your scratch directories will be created > tomorrow after I get some sleep. R is there as well as Git 2.18.2. Yes I > did test network login both legacy as well autofs accounts. Note that > /opt/rh for now is non-existing as SCL are still not available. Namely, > default software is rather new so there is no need yet for newer > versions. > > Please stay away from these machines if you are not willing to help > debugging remaining issues. > > Best, > Predrag > From ngisolfi at cs.cmu.edu Thu Jan 30 10:45:55 2020 From: ngisolfi at cs.cmu.edu (Nick Gisolfi) Date: Thu, 30 Jan 2020 10:45:55 -0500 Subject: [Lunch] Today @ noon in Gates 8115 Message-ID: <159189F8-3585-4A71-AA4B-3ABA37B0CE2D@cs.cmu.edu> Hi Everyone, Auton Lab?s bring-your-own-lunch is happening today at noon in GHC 8115. As a reminder, this invite extends to anyone affiliated in any way with the lab. Come chat with your colleagues and get to know each other better in an informal setting. We hope to see you today! - Nick From awd at cs.cmu.edu Thu Jan 30 11:33:56 2020 From: awd at cs.cmu.edu (Artur Dubrawski) Date: Thu, 30 Jan 2020 11:33:56 -0500 Subject: PITTSBURGH A.I. COMPANY NAMED SEMI-FINALIST FOR IBM WATSON AI XPRIZE Message-ID: Check this out: https://www.marinusanalytics.com/articles/2020/1/30/pittsburgh-ai-company-named-semi-finalist-for-ibm-watson-ai-xprize12 Congrats to Marinus and all the Autonians who helped build the Traffic Jam tool! -------------- next part -------------- An HTML attachment was scrubbed... URL: From choset at andrew.cmu.edu Thu Jan 30 11:40:21 2020 From: choset at andrew.cmu.edu (Howie Choset) Date: Thu, 30 Jan 2020 11:40:21 -0500 Subject: PITTSBURGH A.I. COMPANY NAMED SEMI-FINALIST FOR IBM WATSON AI XPRIZE In-Reply-To: References: Message-ID: <02be01d5d78b$f73f6290$e5be27b0$@andrew.cmu.edu> Cool. The Watson people win by selecting you to win. Congrats Howie Robotics Institute Co-Founder: Co-Director: 5000 Forbes Ave Medrobotics Biorobotics Lab Pittsburgh, PA 15213 Hebi Robotics Director: Undergrad Major http://choset.com Bito Robotics Editor: Science Robotics Office: 412-268-2495 ARM Institute Peggy: 412-268-7943 From: Artur Dubrawski Sent: Thursday, January 30, 2020 11:34 AM To: users at autonlab.org; hebert ; Srinivasa Narasimhan ; Ramayya Krishnan ; Roni Rosenfeld ; Byron Spice Subject: PITTSBURGH A.I. COMPANY NAMED SEMI-FINALIST FOR IBM WATSON AI XPRIZE Check this out: https://www.marinusanalytics.com/articles/2020/1/30/pittsburgh-ai-company-named-semi-finalist-for-ibm-watson-ai-xprize12 Congrats to Marinus and all the Autonians who helped build the Traffic Jam tool! -------------- next part -------------- An HTML attachment was scrubbed... URL: From bspice at cs.cmu.edu Fri Jan 31 09:33:48 2020 From: bspice at cs.cmu.edu (Byron G Spice) Date: Fri, 31 Jan 2020 14:33:48 +0000 Subject: PITTSBURGH A.I. COMPANY NAMED SEMI-FINALIST FOR IBM WATSON AI XPRIZE In-Reply-To: References: Message-ID: https://twitter.com/SCSatCMU/status/1223252825163075585 Byron Spice 412 268 9068 From: Artur Dubrawski Sent: Thursday, January 30, 2020 11:34 AM To: users at autonlab.org; Martial H Hebert ; Srinivasa G Narasimhan ; Ramayya Krishnan ; Roni Rosenfeld ; Byron G Spice Subject: PITTSBURGH A.I. COMPANY NAMED SEMI-FINALIST FOR IBM WATSON AI XPRIZE Check this out: https://www.marinusanalytics.com/articles/2020/1/30/pittsburgh-ai-company-named-semi-finalist-for-ibm-watson-ai-xprize12 Congrats to Marinus and all the Autonians who helped build the Traffic Jam tool! -------------- next part -------------- An HTML attachment was scrubbed... URL: