From predragp at andrew.cmu.edu Thu Jan 4 16:03:31 2018 From: predragp at andrew.cmu.edu (Predrag Punosevac) Date: Thu, 04 Jan 2018 16:03:31 -0500 Subject: Fwd: Brief Power Shutdowns Monday and Friday of Next Week Message-ID: <20180104210331.CcHXv5Aw8%predragp@andrew.cmu.edu> Dear Autonians, First of all I would like to wish all of you Happy New Year. Please see the message below. Due to the fact that we no longer use UPS for our desktops this power outrage are going to affect all Auton Lab members who have offices in the Newell Simon Hall. I will be shutting down all auton lab maintained desktop machines the day before around 9:30 PM and turning them on the following day. Best, Predrag -------- Original Message -------- Subject: Brief Power Shutdowns Monday and Friday of Next Week From: Jim Skees Date: Thu, 4 Jan 2018 12:26:53 -0500 To: undisclosed-recipients:; Folks, ???? The SCS spaces affected by these brief power outages will be Newell Simon and Smith Halls.? The outages should last no more than five minutes, so the small UPS units most SCS people have in their offices and labs should carry them through without disruption. However, if you are not using a UPS or have equipment that is otherwise sensitive to power disruptions, you should power that equipment down no later than Sunday night, Jan. 7th, and Thursday night, Jan. 11th. ??? ??? ??? ??? ??? --Jim -------- Forwarded Message -------- Subject: FMS -- Brief Power Shutdown 1/8 & 1/12 Date: Thu, 4 Jan 2018 17:15:21 +0000 From: FMS Announce To: fms-shutdown at lists.andrew.cmu.edu , 'fms-fmsb at lists.andrew.cmu.edu' , 'fms-newelsimon at lists.andrew.cmu.edu' , fms-hamburg at lists.andrew.cmu.edu , 'fms-smith at lists.andrew.cmu.edu' *Division of Operations* *Facilities Management and Campus Services* ** *TO: Shutdown Group; FMSB; Newell Simon; Hamburg, Smith* *FROM: Service Response Center* *DATE: ?January 4, 2018* *SUBJECT: Brief Power Shutdown 1/8 & 1/12* There will be a momentary loss of power, about 5 minutes long, to the buildings listed below sometime between 6:00AM and 7:00AM on Monday, 1/8, in order to make the power connects to the FMS switchgear for the Tepper Quad project: -The FMS Building -Newell Simon Hall -Hamburg Hall -Smith Hall There will be an additional momentary loss of power on Friday, 1/12, between 6:00AM and 7:00AM. Please contact Lenny Libbon with any questions or concerns at x8-6148 or email LL1R at andrew.cmu.edu . From predragp at andrew.cmu.edu Fri Jan 5 17:46:15 2018 From: predragp at andrew.cmu.edu (Predrag Punosevac) Date: Fri, 05 Jan 2018 17:46:15 -0500 Subject: Meltdown and Spectre chip flaws Message-ID: <20180105224615.D2qKjK4ik%predragp@andrew.cmu.edu> Dear Autonians, Several of you have e-mailed me regarding Meltdown and Spectre vulnerabilities. Instead of individual replays I will try to give you an idea where the things are standing right now. These chip flaws more or less affect all Intel product since 1995. At this point kernel hackers are scrambling to find "software patches" but the only real remedy is replacing all affected chips with safe chips: sparc, mips, arm, possibly AMD (not clear if AMD made i386-64 are affected). As some of you know we use OpenBSD on our perimeter firewalls which has KARL https://marc.info/?l=openbsd-tech&m=149732026405941 as well as the first widely used OS to provide ASLR (introducted 15 years ago) https://en.wikipedia.org/wiki/Address_space_layout_randomization However it doesn't currenly have KASLR. That seriously limits our exposure to the meltdown and Meltdown and Spectre but we are not 100% safe. Anyway any "software patch" that you will soon see from Linux, OS X, and Windows kernel hackers will introduce at least 5% pefromance penalty for system calls non-intensive programs and close to 30% overhead for anything file system/network related including things lake databases https://marc.info/?l=dragonfly-users&m=151517909713575&w=2 I have on my desk Ubiquiti Edgerouter Lite ERLITE-3 https://www.amazon.com/Ubiquiti-Edgerouter-ERLITE-3-Desktop-Router/dp/B00HXT8EKE/ref=sr_1_1?s=electronics&ie=UTF8&qid=1515191230&sr=1-1&keywords=Ubiquiti+Edgerouter+Lite+ERLITE-3 which is MIPS based and unaffected by the Intel bugs. I am monitoring situation and will not hesitate do deploy MIPS based network solutions. For those of you who have one of ARMv7 devices at hand those seems to be also unaffected by meltdown. https://www.openbsd.org/armv7.html Finally we can definitelly recycle some old Sun hardware (sparc which is also bigendian) the last of which I retired about 2 years ago. The last seems to be the approach that Russian military and space forces are taking by exclusively deploying home grown Elbrus sparc based computers pionired by Armenian super computer architect Boris Babaian. https://en.wikipedia.org/wiki/MCST Best, Predrag From awd at cs.cmu.edu Sun Jan 7 13:53:26 2018 From: awd at cs.cmu.edu (Artur Dubrawski) Date: Sun, 7 Jan 2018 13:53:26 -0500 Subject: Fwd: AI4ALL in CMU, 06/30-07/21 -- Call For Participation In-Reply-To: <5b85d989812929c710ed225eba05eb14.squirrel@webmail.andrew.cmu.edu> References: <5b85d989812929c710ed225eba05eb14.squirrel@webmail.andrew.cmu.edu> Message-ID: fyi, if you'd like to help by advising these students on their projects feel free to sign up. I find this initiative to have a great potential! Artur -------- Forwarded Message -------- Subject: AI4ALL in CMU, 06/30-07/21 -- Call For Participation Date: Sat, 6 Jan 2018 12:12:39 -0500 From: kfragki2 at andrew.cmu.edu To: scs-faculty at cs.cmu.edu Dear all, CMU is starting this summer a reach out summer residency program, AI4ALL,?with the aim of familiarizing women from under-represented backgrounds (ethnic minorities, rural areas, low-SES) with the field of Artificial Intelligence, its goals, its practices, and its successes so far. There will be around twenty participants within the age of 16 to 17 years old. The summer program is taking place June 30th ? July 21?in the CMU campus. It would be great if you would be willing to give *a short lecture* (*45 mins*+questions) 9am-9.45am to the young audience about your vision and/or lab activities on any of those dates. Kindly add your name, list of dates you may be available and a title for your talk here: https://docs.google.com/spreadsheets/d/1pTxo91sKaYiA8bN5-FrLgm_WE4HP28CfPpX2wIaPbZM/edit?usp=sharing Keep in mind that you can adjust your available dates and title anytime. Talks can also be given by two faculty jointly. This is a great reach out opportunity that you can write about in your /broader impacts/?part of your NSF grant proposals. We further need daily lectures (*10am-11.15am*) from faculty or excellent TAs. Topics and slides will be provided, but you can adapt them as you wish. If you would be happy to give such lecture,? please add your name again in the appropriate place in the doc: https://docs.google.com/spreadsheets/d/1pTxo91sKaYiA8bN5-FrLgm_WE4HP28CfPpX2wIaPbZM/edit?usp=sharing ?, or forward this email to people that you think they would be interested. We also need TAs to guide the young participants on their daily homework/projects. If you believe that any of your students or TAs would be interested, please kindly forward them this email, and encourage them to sign up: https://docs.google.com/spreadsheets/d/1pTxo91sKaYiA8bN5-FrLgm_WE4HP28CfPpX2wIaPbZM/edit?usp=sharing Thank you in advance for your help on giving an opportunity to young individuals to experience the joy that we daily feel about working on such an aspiring field, which, due to their backgrounds,? they would not have the chance otherwise. Happy 2018, Katerina Fragkiadaki -------------- next part -------------- An HTML attachment was scrubbed... URL: From predragp at andrew.cmu.edu Mon Jan 8 10:52:50 2018 From: predragp at andrew.cmu.edu (Predrag Punosevac) Date: Mon, 08 Jan 2018 10:52:50 -0500 Subject: bash is down Message-ID: <20180108155250.MT1Has02B%predragp@andrew.cmu.edu> Dear Autonians, Bash is down due to the scheduled power outrage. Please use lop1.autonlab.org for access to lab infrastructure until I power up bash. Best, Predrag From predragp at andrew.cmu.edu Mon Jan 8 11:44:45 2018 From: predragp at andrew.cmu.edu (Predrag Punosevac) Date: Mon, 08 Jan 2018 11:44:45 -0500 Subject: bash is down In-Reply-To: <20180108155250.MT1Has02B%predragp@andrew.cmu.edu> References: <20180108155250.MT1Has02B%predragp@andrew.cmu.edu> Message-ID: <20180108164445.zN3u5kO2w%predragp@andrew.cmu.edu> Predrag Punosevac wrote: > Dear Autonians, > > Bash is down due to the scheduled power outrage. Please use > lop1.autonlab.org for access to lab infrastructure until I power up > bash. > > Best, > Predrag bash.autonlab.org is up and running normaly now. Predrag From predragp at andrew.cmu.edu Tue Jan 9 19:02:40 2018 From: predragp at andrew.cmu.edu (Predrag Punosevac) Date: Tue, 09 Jan 2018 19:02:40 -0500 Subject: 2 new CPU nodes added Message-ID: <20180110000240.21DeZg1iN%predragp@andrew.cmu.edu> Dear Autonians, I just added two new CPU nodes lov1.int.autonlab.org lov2.int.autonlab.org to Auton Lab cluster. They each have two new Xeon Gold 6152 with 22 cores (44 threads per CPU) and 768 GB of RAM. You can already log and use them. There are few rough edges that I need to fix tonight (I need to add scratch directories and MATLAB) but other than that they should be usable. Cheers, Predrag P.S. We should be getting another CPU node with identical hardware specs by the end of the week. I am also planning to repurpose Athena by the end of next week for general CPU computing. From awd at cs.cmu.edu Tue Jan 9 19:35:16 2018 From: awd at cs.cmu.edu (Artur Dubrawski) Date: Tue, 9 Jan 2018 19:35:16 -0500 Subject: 2 new CPU nodes added In-Reply-To: <20180110000240.21DeZg1iN%predragp@andrew.cmu.edu> References: <20180110000240.21DeZg1iN%predragp@andrew.cmu.edu> Message-ID: <2edc9ecd-e66b-6d93-dccf-73685898ebb2@cs.cmu.edu> Thank you Predrag. Team: The Lab has never had as much computing power as we have now, in both CPU and GPU resources. It is not clear how soon we would be able to further expand our computing capacity at similar scales. So, please let us use what we have wisely, responsibly, and with consideration of needs of other colleagues. In a separate message Predrag will refresh our memories on how to track activity, best choose where to submit our jobs, and how to clean up and avoid clogging the systems. Cheers, Artur On 1/9/2018 7:02 PM, Predrag Punosevac wrote: > Dear Autonians, > > I just added two new CPU nodes > > lov1.int.autonlab.org > lov2.int.autonlab.org > > to Auton Lab cluster. They each have two new Xeon Gold 6152 with 22 > cores (44 threads per CPU) and 768 GB of RAM. You can already log and > use them. There are few rough edges that I need to fix tonight (I need > to add scratch directories and MATLAB) but other than that they should > be usable. > > Cheers, > Predrag > > P.S. We should be getting another CPU node with identical hardware specs > by the end of the week. I am also planning to repurpose Athena by the > end of next week for general CPU computing. From ngisolfi at cs.cmu.edu Thu Jan 11 16:02:27 2018 From: ngisolfi at cs.cmu.edu (Nick Gisolfi) Date: Thu, 11 Jan 2018 16:02:27 -0500 Subject: [hackauton] Change the Dates: April 6-8 Message-ID: Hi Everyone, In order to put our strongest foot forward, the hackauton is instead being planned for April 6-8th. This gives us time to organize a big event. Please keep this in mind when making plans during that weekend. Hopefully we will have everyone participating. - Nick -------------- next part -------------- An HTML attachment was scrubbed... URL: From ngisolfi at cs.cmu.edu Thu Jan 11 17:30:08 2018 From: ngisolfi at cs.cmu.edu (Nick Gisolfi) Date: Thu, 11 Jan 2018 17:30:08 -0500 Subject: Website Upgrade Message-ID: Hi Everyone, autonlab.org is scheduled for an update which will include more comprehensive info about past and present projects and people at the lab. Here are links to two surveys everyone should complete. If you complete these surveys before the upgrade, we will enter in all the information for you. 1) People (Fill out one for your personal page on the site) https://goo.gl/forms/zfg53lAGpza9Ivsy2 2) Research Projects (Fill out as many times as you would like for your past/present projects) https://goo.gl/forms/50ZMizwtZ74ypDSc2 One of the short term goals of the website upgrade is to attract donations for the hackauton. Please complete these surveys so we can have a strong online presence. If you have any questions or if you think something is missing from the survey (especially the research projects form), please contact me directly. - Nick #hackauton @ auton.slack.com -------------- next part -------------- An HTML attachment was scrubbed... URL: From predragp at andrew.cmu.edu Sat Jan 13 15:22:14 2018 From: predragp at andrew.cmu.edu (Predrag Punosevac) Date: Sat, 13 Jan 2018 15:22:14 -0500 Subject: lov5 in production Message-ID: <20180113202214.u2FMKdVpk%predragp@andrew.cmu.edu> Dear Autonians, We have received yesterday afternoon the last of the three large CPU computing nodes we ordered over the Christmas break. lov5.int.autonlab.org is in production and ready to be used all 768 GB of RAM and 88 threads. Best, Predrag From predragp at andrew.cmu.edu Mon Jan 22 20:02:00 2018 From: predragp at andrew.cmu.edu (Predrag Punosevac) Date: Mon, 22 Jan 2018 20:02:00 -0500 Subject: GPU8 and GPU9 Message-ID: <20180123010200.EfONewBRE%predragp@andrew.cmu.edu> Dear Autonians, I really hate to do this but the person whose grant money paid for GPU8 and GPU9 machines has notified me about the paper deadline which is coming in 3 weeks. I am kindly asking everyone to stay away from those two machines so that the rightful owner can complete the work. I will turn off LDAP loggin on those 2 machines about this time tomorrow. Best, Predrag From predragp at andrew.cmu.edu Tue Jan 23 12:43:34 2018 From: predragp at andrew.cmu.edu (Predrag Punosevac) Date: Tue, 23 Jan 2018 12:43:34 -0500 Subject: Fwd: need to lock out a gpu machine Message-ID: <20180123174334.W-Mm80emm%predragp@andrew.cmu.edu> Dear Autonians, Effective immediately GPU7 will be re-purposed for a special project. I will give you an hour to wind up your jobs before switching off LDAP. We expect GPU7 to be back to our computing pool within few weeks possibly month until the dedicated hardware is acquired. I am sorry for the short notice and for the disruption but we have no choice but to do this. Best, Predrag From awd at cs.cmu.edu Wed Jan 24 11:13:37 2018 From: awd at cs.cmu.edu (Artur Dubrawski) Date: Wed, 24 Jan 2018 11:13:37 -0500 Subject: Fwd: Auton Lab at Winchester Thurston In-Reply-To: References: Message-ID: This is what is called an effective outreach! Great stuff Karen, Maria and Ben. Artur -------- Forwarded Message -------- Subject: Auton Lab at Winchester Thurston Date: Wed, 24 Jan 2018 11:09:00 -0500 From: Maria De Arteaga To: Artur Dubrawski CC: Karen Chen , Ben Boecking 3rd consecutive year of the Auton Lab (Karen, Ben and I) talking to the Stats students at WT School about 'Data Science for Social Good'. Today we learned one of the girls who was on the audience three years ago is now studying ML & Econ :) -------------- next part -------------- An HTML attachment was scrubbed... URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: IMG_20180124_095554024.jpg Type: image/jpeg Size: 3518840 bytes Desc: not available URL: -------------- next part -------------- A non-text attachment was scrubbed... Name: IMG_20180124_095250815.jpg Type: image/jpeg Size: 3020920 bytes Desc: not available URL: From awd at cs.cmu.edu Wed Jan 24 16:02:20 2018 From: awd at cs.cmu.edu (Artur Dubrawski) Date: Wed, 24 Jan 2018 16:02:20 -0500 Subject: caselets - invitation (and request) to contribute In-Reply-To: References: Message-ID: Team, Karen has been researching how to bridge an important gap in data science training curricula. Everyone who tried to teach (or learn) data science will probably agree that lectures and hands-on homework do not fully prepare students to be successful data scientists in the real-world right after graduation. Some of that stems from the lack of self-confidence due to little to none practical experience. Karen hypothesizes that this could be partially remedied via self-assessment, if the students were exposed to real-world challenges in small doses, chunk-by-chunk, and practice how to resolve them in an exercise. She has designed a little experiment (and won a rather humble amount of funding for running it) and she will use the ongoing course on Applied Data Science as a platform to give it a try. For the sake of comprehensiveness of problem coverage and to ensure that this attempt is in fact meaningful, she is seeking our help with producing "caselets" - a little interactive assignments - to help populate her engine. See below for more info and please reach out to Karen if you could (and I truly hope you would) help. Cheers, Artur ======================================= We are building a repository of caselets (caselet = lightweighted case study) to help the beginner data scientists to build up data science problem solving skills using authentic problems and data sources. The caselets will be deployed in an online learning environment where timely feedback and explanation will be provided when users work through the problems. This is part of the CMU Simon Initiative funded project on ?Accelerated Apprenticeship? with the goal to teach data science problem solving skills at scale. You're invited to contribute to the repository given your experience in solving tough real world problems and/or the mentoring students or interns in our lab. Here are the steps to get started: 1. Pick a domain and dataset. You may refer to a list here, but feel free to use your own data sources; https://tinyurl.com/ybdowtn3 2. Pick a subset of skills you want to target. This list gives you some idea to start with. It will be helpful to reflect on the tricky problems you?ve encountered yourself in your project or those observed when mentoring students; https://tinyurl.com/y888mxru 3. Author caselet. A caselet a) problem context; b) data description (in the form of tabular summary or plots) ; c) a list of questions (5-7)? multiple choices questions with correct answers and explanations provided; a sample caselet write up can be found here.https://tinyurl.com/y7y8bnnu We are aiming to have the first batch of caselets ready to be used by Artur?s students right after spring break. So we need to have drafts ready by Feb 16th and followed by internal review. Please send Karen an email (karenchen at cmu.edu )? if you?re interested in being part of it. Thanks in advance! Karen (Lujie) Chen Ph.D. Candidate in Information Systems, Heinz College PIER Fellow (Program of Interdisciplinary Educational Research) Member of Auton Lab, Robotics Institute Newell-Simon Hall 3124 Carnegie Mellon University Pittsburgh, PA 15213 -------------- next part -------------- An HTML attachment was scrubbed... URL: From predragp at andrew.cmu.edu Tue Jan 30 12:04:49 2018 From: predragp at andrew.cmu.edu (Predrag Punosevac) Date: Tue, 30 Jan 2018 12:04:49 -0500 Subject: GPU8 and GPU9 Message-ID: <20180130170449.sKCzKmy5C%predragp@andrew.cmu.edu> Dear Autonians, This is gentle remainder that you should stay away from GPU8 and GPU9 machines for the next 2 weeks until the rightful owner of the machines finishes his jobs. I just killed and logged out two unauthorized users. I would prefer not to use heavy handed approach. I will send a notification when the rest of the lab can use those machines again. Best, Predrag