From boecking at andrew.cmu.edu Mon Nov 2 12:57:43 2020 From: boecking at andrew.cmu.edu (Benedikt Boecking) Date: Mon, 2 Nov 2020 11:57:43 -0600 Subject: gpu scratch directories Message-ID: Hi all, Some of our gpu scratch directories are 100% full, for example gpu3. Could you please take a minute remove any files on scratch directories that you don?t need to access anymore? Thanks! From predragp at andrew.cmu.edu Mon Nov 2 16:52:15 2020 From: predragp at andrew.cmu.edu (Predrag Punosevac) Date: Mon, 2 Nov 2020 16:52:15 -0500 Subject: Rack swap status update In-Reply-To: References: Message-ID: Dear Autonians, LOV6 is up and running. Xen1 (lop2) is in the rack but I can't ping it. I will attach the console as soon as I finish my weekly status update with Dr. Dubrawski. FYI LOV[10-13] are in the server rack and power up. I am not sure I will have time to provision them today. There is just too much work left from the server rack swap. Best, Predrag On Wed, Oct 28, 2020 at 8:10 PM Predrag Punosevac wrote: > Everything is up except lov6 and xen1 (which hosts lop2 shell gateway > among other VMs). Something is wrong with lov6 railings. I wasted 1h trying > to put that thing into the new rack but something is stuck. > > > I am out of fuel guys for today. This will have to be finished some other > day. > > Best, > Predrag > -------------- next part -------------- An HTML attachment was scrubbed... URL: From predragp at andrew.cmu.edu Mon Nov 2 19:38:06 2020 From: predragp at andrew.cmu.edu (Predrag Punosevac) Date: Mon, 2 Nov 2020 19:38:06 -0500 Subject: Rack swap status update In-Reply-To: References: Message-ID: xen1 is "fixed". I was able to bypass one of the dead HDDs tonight but it lop2 is up and running. That is the 3rd gateway machine. I will try to add one more but I am unsure if it is going to happen this week. Predrag On Mon, Nov 2, 2020 at 4:52 PM Predrag Punosevac wrote: > Dear Autonians, > > LOV6 is up and running. Xen1 (lop2) is in the rack but I can't ping it. I > will attach the console as soon as I finish my weekly status update with > Dr. Dubrawski. > > FYI LOV[10-13] are in the server rack and power up. I am not sure I will > have time to provision them today. There is just too much work left from > the server rack swap. > > Best, > Predrag > > On Wed, Oct 28, 2020 at 8:10 PM Predrag Punosevac > wrote: > >> Everything is up except lov6 and xen1 (which hosts lop2 shell gateway >> among other VMs). Something is wrong with lov6 railings. I wasted 1h trying >> to put that thing into the new rack but something is stuck. >> >> >> I am out of fuel guys for today. This will have to be finished some other >> day. >> >> Best, >> Predrag >> > -------------- next part -------------- An HTML attachment was scrubbed... URL: From predragp at andrew.cmu.edu Tue Nov 3 11:45:37 2020 From: predragp at andrew.cmu.edu (Predrag Punosevac) Date: Tue, 3 Nov 2020 11:45:37 -0500 Subject: gogs/git issues and VPN access to the Auton Lab Message-ID: Dear Autonians, I know that many of you were annoyed by the fact that in order to use our internal instance of Gogs you had to use X2Go for GUI access to one of the shell gateways first. https://gogs.io After a bit of consideration the following solution proposed by Gus Welter seems to be the easiest. Locate on your machine the following file or create a new one ~/.ssh/config use your favorite editor and create an entry as follows: Host gogs Hostname lop2.autonlab.org (you could do any other shell gateway) User $yourusername IdentityFile ~/.ssh/$your_private_key (could be left out if you insist on using LDAP password) Port 22 LocalForward 2222 git.int.autonlab.org:80 Then just ssh to gogs. Open the web browser on your own computer and type in the search bar http://localhost:2222 Magic will happen. I will update documentation shortly. After further consideration, evaluation of various VPN technologies: OpenSSH, IKEv2, OpenVPN, tinc, WireGuard, AnyConnect (CISCO proprietary version as well as open source *ocserv *clone) the following decision was made: We will continue to provide world wide access to the Auton Lab infrastructure via shell gateways OpenSSH for people who don't have the Auton Lab provided/supported desktops. However, I will add the additional 4th shell gateways. FYI (will be updated in the documenation as well) There is a minor difference between lop2.autonlab.org lop1.autonlab.org (I will replace dead gateway with the new one) and bash.autonlab.org lion.auton.cs.cmu.edu The first two shell gateways have no VPN overhead. The second two shell gateways are just the desktops which are connected via OpenVPN to the computing nodes. As a matter of fact any Auton Lab desktop is potentially shell gateway but the login is restricted only to the desktop owner. The desktops use OpenVPN to connect to the Auton Lab LAN zone. Unless your ISP is blocking UDP port 1194 (not uncommon) and you have a very complicated NAT (network address translation) set up at home there is no reason that a desktop which you take home will stop having VPN access to the lan zone. Upon the insistence of Robert Edman I agreed to create and distribute certificates/keys and configuration files to any Auton Lab member who would like to set up OpenVPN access from her/his home computer to our VPN gateway. However, I am not willing to give any support beyond that and furthermore I am not willing to answer any emails regarding your personal machines and home networks. Most Kind Regards, Predrag Punosevac -------------- next part -------------- An HTML attachment was scrubbed... URL: From predragp at andrew.cmu.edu Tue Nov 3 17:07:45 2020 From: predragp at andrew.cmu.edu (Predrag Punosevac) Date: Tue, 3 Nov 2020 17:07:45 -0500 Subject: gogs/git issues and VPN access to the Auton Lab In-Reply-To: References: Message-ID: This is just a quick follow up building upon Gus's solution. The ssh trick as described is not a 100% GUI access but it goes quote long to alleviate the need for GUI. To have CLI access to Git repository you will need the following small blurb in your ~/.ssh/config Host gogs HostName git.int.autonsys.com User git Port 2224 IdentityFile ~/.ssh/gogs ProxyCommand ssh springdale1 exec nc %h %p Note that the user is always git. That is not a mistake. Gogs automatically maps singe uid git to your ssh-keys (you need the GUI access to upload them) and in turn to your repos. That is what I personally use working from home. For example, instead of login into the shell gateway and then moving to one of your favorite computing nodes, you can do something like this with your ~/.ssh/config file Host foxconn HostName foxconn.int.autonlab.org Port 22 User predragp ProxyCommand ssh -W %h:%p predragp at lop2.autonlab.org I will conclude this email by saying that with the exception of MATLAB GUI or genuine web browsing you really don't need the X2Go client and GUI access to servers. In my experience, most members actually use Jupiter notebook, RStudio or just some programming language (I use Julia as many of you know) and need access only to Gogs web services. Does anybody need help to convert the following trick? https://fizzylogic.nl/2017/11/06/edit-jupyter-notebooks-over-ssh/ into the appropriate ~/.ssh/config entry? If people need help with RStudio or if you guys insist on me running RStudio-server that would be OK. That kind of suggestions followed with some nice little hacks are much more useful to all of us in my opinion than asking for some fundamental changes requiring complex technologies. If there is an interest I would be happy to give a ZOOM overview of the Lab capabilities or even to have regular or irregular Q&A sessions. Best, Predrag On Tue, Nov 3, 2020 at 11:45 AM Predrag Punosevac wrote: > Dear Autonians, > > I know that many of you were annoyed by the fact that in order to use our > internal instance of Gogs you had to use X2Go for GUI access to one of the > shell gateways first. > > https://gogs.io > > After a bit of consideration the following solution proposed by Gus Welter > seems to be the easiest. Locate on your machine the following file or > create a new one > > ~/.ssh/config > > use your favorite editor and create an entry as follows: > > Host gogs > Hostname lop2.autonlab.org (you could do any other shell gateway) > User $yourusername > IdentityFile ~/.ssh/$your_private_key (could be left out if you > insist on using LDAP password) > Port 22 > LocalForward 2222 git.int.autonlab.org:80 > > > Then just ssh to gogs. Open the web browser on your own computer and type > in the search bar > > http://localhost:2222 > > Magic will happen. I will update documentation shortly. > > > After further consideration, evaluation of various VPN technologies: > OpenSSH, IKEv2, OpenVPN, tinc, WireGuard, AnyConnect (CISCO proprietary > version as well as open source *ocserv *clone) the following > decision was made: > > We will continue to provide world wide access to the Auton Lab > infrastructure via shell gateways OpenSSH for people who don't have the > Auton Lab provided/supported desktops. However, I will add the additional > 4th shell gateways. FYI (will be updated in the documenation as well) There > is a minor difference between > > lop2.autonlab.org > lop1.autonlab.org (I will replace dead gateway with the new one) > > and > > bash.autonlab.org > lion.auton.cs.cmu.edu > > The first two shell gateways have no VPN overhead. The second two shell > gateways are just the desktops which are connected via OpenVPN to the > computing nodes. As a matter of fact any Auton Lab desktop is potentially > shell gateway but the login is restricted only to the desktop owner. The > desktops use OpenVPN to connect to the Auton Lab LAN zone. Unless your ISP > is blocking UDP port 1194 (not uncommon) and you have a very complicated > NAT (network address translation) set up at home there is no reason that a > desktop which you take home will stop having VPN access to the lan zone. > > Upon the insistence of Robert Edman I agreed to create and distribute > certificates/keys and configuration files to any Auton Lab member who would > like to set up OpenVPN access from her/his home computer to our VPN > gateway. However, I am not willing to give any support beyond that and > furthermore I am not willing to answer any emails regarding your personal > machines and home networks. > > > Most Kind Regards, > Predrag Punosevac > > > > > > > > > > > -------------- next part -------------- An HTML attachment was scrubbed... URL: From ngisolfi at cs.cmu.edu Thu Nov 5 09:17:13 2020 From: ngisolfi at cs.cmu.edu (Nick Gisolfi) Date: Thu, 5 Nov 2020 09:17:13 -0500 Subject: [Lunch] Today @noon over Zoom Message-ID: https://cmu.zoom.us/j/492870487 We hope to see you there! - Nick -------------- next part -------------- An HTML attachment was scrubbed... URL: From boecking at andrew.cmu.edu Tue Nov 10 22:01:47 2020 From: boecking at andrew.cmu.edu (Benedikt Boecking) Date: Tue, 10 Nov 2020 21:01:47 -0600 Subject: gpu19 scratch full Message-ID: <9802DD2E-3347-4755-91A9-090188938A51@andrew.cmu.edu> Hi everyone, The scratch directory on gpu19 is completely full. Please clean up your /home/scratch/username directory so that we can continue to use the machine to its full extent. Best, Ben From ngisolfi at cs.cmu.edu Thu Nov 12 10:06:16 2020 From: ngisolfi at cs.cmu.edu (Nick Gisolfi) Date: Thu, 12 Nov 2020 10:06:16 -0500 Subject: [Lunch] Today @noon over Zoom Message-ID: https://cmu.zoom.us/j/492870487 We hope to see you there! - Nick -------------- next part -------------- An HTML attachment was scrubbed... URL: From boecking at andrew.cmu.edu Tue Nov 17 11:54:43 2020 From: boecking at andrew.cmu.edu (Benedikt Boecking) Date: Tue, 17 Nov 2020 10:54:43 -0600 Subject: Fwd: 2020 Global Analytics Summit: Ethics in AI References: <96247A3A-DF28-4C65-BD0E-4C853EA237BE@mccombs.utexas.edu> Message-ID: Hi all, Auton Lab PhD alumni Maria De Arteaga, now Assistant Professor at UT Austin, is organizing an Ethics in AI Conference on November 19 and 20. Registration is free! See details below. Best, Ben > Begin forwarded message: > > From: Maria De-Arteaga > Subject: 2020 Global Analytics Summit: Ethics in AI > Date: November 17, 2020 at 10:46:23 AM CST > To: Benedikt Boecking > > Dear Colleagues, > > The McCombs School of Business, the Center for Analytics & Transformative Technologies (CATT), and the Good Systems Initiative at the University of Texas at Austin would like to invite you to the CATT 2020 Annual Conference, being held online on November 19 (afternoon Central Time) and 20 (morning Central Time). This year?s theme is ?Ethics in AI? and features compelling research and commentary from leading data science, machine learning, and policy experts representing academia, industry and non-profit organizations. > > The registration fee is completely waived for this year?s online conference and attendance will be FREE OF CHARGE. However, all attendees must register for conference access. > > To view program information and to register, please visit: > https://www.mccombs.utexas.edu/Centers/Center-for-Research-and-Analytics/Conference > > All registrants will receive a program booklet with a more detailed agenda, speaker biographies, and logistical information related to the conference (including login information). > > This year?s conference has been made possible with the generous support of the McCombs School of Business and the Good Systems Initiative?A UT Grand Challenge. > > > PROGRAM AGENDA (Timezone: Central Time) > > November 19, 2020 (afternoon session) > > 1:00pm?????? Introductory Remarks > > 1:10pm?????? Keynote:? Setting the Stage?the Grand Challenge of Ethical AI > ? Ece Kamar, PhD (Microsoft Research)? > > 2:00pm?????? Session I:? Bias in AI:? What are the Risks? > ? Moderator:? Huseyin Tanriverdi, PhD (UT Austin) > Speakers: > ? Sina Fazelpour, PhD (Carnegie Mellon Univ.) > ? Maria De-Arteaga, PhD (UT Austin) > ? Francesca Rossi, PhD (IBM Research) > > 3:30pm?????? Session II:? Ethics Aware Design of AI > ? Moderator:? Joydeep Biswas, PhD (Dept. of CS, UT Austin) > Speakers: > ? Ken Holstein, PhD (Carnegie Mellon Univ.) > ? Min Kyung Lee, PhD (UT Austin) > > 5:00pm?????? Panel:? Operationalizing Ethics in AI > ? Moderator:? Luis Sentis, PhD (The Human Centered Robotics Lab) > Speakers: > ? Luca Belli, PhD (Twitter) > ? Ashley Casovan (AI Global) > ? Andrew Zaldivar, PhD (Google AI) > ? Alice Xiang, JD (Partnership on AI) > > November 20, 2020 (morning session) > > 8:15am?????? Presentation > ? Jim Guszcza, PhD (Stanford) > > 9:00am?????? Session III:? AI Accountability > ? Moderator: Connie Rosati, PhD, JD (UT Austin) > Speakers: > ? Aaron Horowitz (ACLU) > ? Deborah Hellman, JD (University of Virginia School of Law) > ? Aaron Rieke, JD (Upturn) > > 10:30am???? Session IV:? Technology Determinism and Unethical Technologies > ? Moderator: Sherri Greenberg, PhD (UT Austin) > Speakers: > ? Anna Lauren Hoffman, PhD (University of Washington) > ? Junfeng Jiao, PhD (UT Austin) > > 12:00pm???? Panel:? AI for Better and More Ethical Practices > ? Moderator, Tej Anand, Ed.D > Panelists: > ? Adewole Adamson, MD, MPP (Dell Medical School) > ? Elisa Celis, PhD (Yale University) > ? Michael Shepherd, (Dell Technologies) > ? Michael Chui, PhD (McKinsey & Co.) > > 1:00pm?????? Formal Conference Concludes/Breakout Sessions/Networking Time > > Maria De-Arteaga, PhD (she/her/ella) > Assistant Professor > Information, Risk, and Operations Management Department > McCombs School of Business > The University of Texas at Austin > -------------- next part -------------- An HTML attachment was scrubbed... URL: From ngisolfi at cs.cmu.edu Thu Nov 19 09:27:16 2020 From: ngisolfi at cs.cmu.edu (Nick Gisolfi) Date: Thu, 19 Nov 2020 09:27:16 -0500 Subject: [Lunch] NEW LINK Today @noon over Zoom Message-ID: <5456AA9A-EF7A-4CE9-92D2-11E039A48DC6@cs.cmu.edu> Hi Everyone, I have a little bit of overlapping conflict for today?s lab lunch, so I used the opportunity to generate a new, recurring link for our lab lunch meetings. We?ll use this link for the foreseeable future. https://cmu.zoom.us/j/96391712304?pwd=WGhzSy9kWnNpc3haZjd5bmVXV291QT09 We hope to see you there! - Nick -------------- next part -------------- An HTML attachment was scrubbed... URL: From awd at cs.cmu.edu Thu Nov 19 13:31:26 2020 From: awd at cs.cmu.edu (Artur Dubrawski) Date: Thu, 19 Nov 2020 13:31:26 -0500 Subject: Ben and the Astronauts Message-ID: Below you can see our own Ben Boecking moderating FIVE astronauts in a very exciting seminar focusing on AI-driven predictive (and not so predictive) maintenance of spacecraft. So, whoever thinks that the Auton Lab is not the coolest place in the world must be nuts! :D Cheers, Artur [image: Ben and Astronauts.PNG] -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: Ben and Astronauts.PNG Type: image/png Size: 3557498 bytes Desc: not available URL: From awd at cs.cmu.edu Fri Nov 20 04:58:00 2020 From: awd at cs.cmu.edu (Artur Dubrawski) Date: Fri, 20 Nov 2020 04:58:00 -0500 Subject: Fwd: [ML-news] AI Incident Database In-Reply-To: References: Message-ID: Can be of interest to a few of us. Artur ---------- Forwarded message --------- From: Sean McGregor Date: Fri, Nov 20, 2020 at 12:53 AM Subject: [ML-news] AI Incident Database To: Hello All, I am pleased to announce the opening of the AI Incident Database. The AI Incident Database captures instances of real world harms brought by AI so that we can collectively learn to avoid or mitigate those harms. If you know of any AI incidents that are not covered by the database, please submit them to the database. If you are stewarding an AI project, please consider examining the potential harms and put in place measures (e.g., education) to avoid a repeat. More information: https://www.partnershiponai.org/aiincidentdatabase/ Best, Sean -- Sean McGregor PhD, Machine Learning Website: seanbmcgregor.com Twitter: seanmcgregor -- You received this message because you are subscribed to the Google Groups "Machine Learning News" group. To unsubscribe from this group and stop receiving emails from it, send an email to ml-news+unsubscribe at googlegroups.com. To view this discussion on the web visit https://groups.google.com/d/msgid/ml-news/CAEHZfjUR1Lr2bx9K1q9WVULTuvfHCruQULr0hvs-BGyjzCVbFQ%40mail.gmail.com . -------------- next part -------------- An HTML attachment was scrubbed... URL: From predragp at andrew.cmu.edu Fri Nov 20 18:05:40 2020 From: predragp at andrew.cmu.edu (Predrag Punosevac) Date: Fri, 20 Nov 2020 18:05:40 -0500 Subject: Gateways Down? In-Reply-To: References: Message-ID: I just upgraded 7 network servers. The gateways were not reachable for less than 15 min. Please try again. Predrag On Fri, Nov 20, 2020 at 6:01 PM Naji Shajarisales wrote: > Hi Predrag, > > I am trying to connect to gateways and none of lop1, lop2, or bash work. > Lion gets to authentication but does not accept my password. > > Is there something wrong? > > Thank you! > Best, > Naji > -------------- next part -------------- An HTML attachment was scrubbed... URL: From awd at cs.cmu.edu Wed Nov 25 11:40:20 2020 From: awd at cs.cmu.edu (Artur Dubrawski) Date: Wed, 25 Nov 2020 11:40:20 -0500 Subject: [Emergency Lunch] Today @noon over Zoom In-Reply-To: <5456AA9A-EF7A-4CE9-92D2-11E039A48DC6@cs.cmu.edu> References: <5456AA9A-EF7A-4CE9-92D2-11E039A48DC6@cs.cmu.edu> Message-ID: Team, Given that tomorrow is Thanksgiving, we would have our weekly lunch meeting today. If you are available feel free to join: https://cmu.zoom.us/j/96391712304?pwd=WGhzSy9kWnNpc3haZjd5bmVXV291QT09 Cheers, Artur (for Nick) -------------- next part -------------- An HTML attachment was scrubbed... URL: