From predragp at andrew.cmu.edu Thu May 7 09:14:03 2015 From: predragp at andrew.cmu.edu (predragp at andrew.cmu.edu) Date: Thu, 7 May 2015 09:14:03 -0400 Subject: cvs/svn server is down Message-ID: > Predrag, > > It seems svnhub.int.autonlab.org is down. LEAN has trouble to access the server. > > Thanks, > Jarod > I am checking it right now. Apparently it crashed over the night around 3:00 AM. Predrag From predragp at andrew.cmu.edu Thu May 7 10:00:53 2015 From: predragp at andrew.cmu.edu (predragp at andrew.cmu.edu) Date: Thu, 7 May 2015 10:00:53 -0400 Subject: cvs/svn server fixed! Message-ID: Server is fixed now and appears to be fully functional. BTW failing hardware is the cause. Predrag From predragp at andrew.cmu.edu Thu May 7 10:48:25 2015 From: predragp at andrew.cmu.edu (predragp at andrew.cmu.edu) Date: Thu, 7 May 2015 10:48:25 -0400 Subject: compute-0-0 is now part of GridFTP Message-ID: <51829ce021904e9f69e5b2bad5c4fcd2.squirrel@webmail.andrew.cmu.edu> Dear Autonians, We are plugging compute-0-0 into GridFTP network to do a very large data transfer. Please refrain from using this computing node until we finish the job. I am thinking of disconnecting it from LDAP and umounting home directories after people whom I CC finish their jobs. I am planning to put new very large computing node foxconn into production early next week to offset the loss of resources. Thank you for your cooperation in this matter. Predrag From predragp at andrew.cmu.edu Fri May 15 19:23:24 2015 From: predragp at andrew.cmu.edu (predragp at andrew.cmu.edu) Date: Fri, 15 May 2015 19:23:24 -0400 Subject: compute-0-0 back in business Message-ID: <1ceb308d950bf7f6e266d3d23e5f5228.squirrel@webmail.andrew.cmu.edu> Dear Autonian, After a week as a part of GridFTP, compute-0-0 returns to its regular duties in the LAN zone. I used the fact that nobody was on the machine to update MATLAB to R2015a and change NFS block size mount options to 64k which should give us better speed. Cheers, Predrag From predragp at andrew.cmu.edu Wed May 27 10:42:41 2015 From: predragp at andrew.cmu.edu (predragp at andrew.cmu.edu) Date: Wed, 27 May 2015 10:42:41 -0400 Subject: New computing node Message-ID: Dear Autonians, About a month ago I built very powerful computing node for Foxconn project (foxconn.int.autonlab.org). I just got permission from Dr. Dubrawski and Dr. Schneider to make it available to all members of Auton Lab with the understanding that priority when it comes to use of this server will be given to members of Foxconn team. You can access this computing node with your regular LDAP credentials just like any other machine in the lab. Hardware specs: 2xIntel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz 8 core each (16 hyper-threads) RAM 384 GB of the latest and fastest storage space 6 TB effective (most of it will be used by foxconn but you scratch directories are there too) NFS is mounted with new and improved options (I am allowing script execution directly from NFS). Still be realistic about the speed which is in real terms 80-90 MB/s due to 1 Gigabit network limitation. Theoretical speed of NFS on this network is about 120 MB/s. To give you an idea how fast/slow this is I will remind you that new SSD drives including the one I use to install OS on this server have speed of over 600 MB/s. RAID 6 with XFS peeks around 350 MB/s. That means that using local file system to do data science is at least 4 time faster than using NFS. Finally some great software news for this server. It runs Red Hat 7.1 which is compiled with gcc-4.8.3. Feels much faster than 6.6. I installed latest MATLAB R2015a, R, python-2.7.5 is now default system Python. Usual suspects are there too: Pandas, scikit-learn, numpy, scipy, ipython, blas, atlas, boost, gsl, and the whole slue of other software you are accustomed to. Enjoy, Predrag From kandasamy at cmu.edu Wed May 27 10:55:40 2015 From: kandasamy at cmu.edu (Kirthevasan Kandasamy) Date: Wed, 27 May 2015 10:55:40 -0400 Subject: New computing node In-Reply-To: References: Message-ID: This is awesome predrag. many thanks ! On Wed, May 27, 2015 at 10:42 AM, wrote: > Dear Autonians, > > About a month ago I built very powerful computing node for Foxconn project > (foxconn.int.autonlab.org). I just got permission from Dr. Dubrawski and > Dr. Schneider to make it available to all members of Auton Lab with the > understanding that priority when it comes to use of this server will be > given to members of Foxconn team. You can access this computing node with > your regular LDAP credentials just like any other machine in the lab. > > Hardware specs: > > 2xIntel(R) Xeon(R) CPU E5-2650 v2 @ 2.60GHz 8 core each (16 hyper-threads) > > RAM 384 GB of the latest and fastest > > storage space 6 TB effective (most of it will be used by foxconn but you > scratch directories are there too) > > NFS is mounted with new and improved options (I am allowing script > execution directly from NFS). Still be realistic about the speed which is > in real terms 80-90 MB/s due to 1 Gigabit network limitation. Theoretical > speed of NFS on this network is about 120 MB/s. To give you an idea how > fast/slow this is I will remind you that new SSD drives including the one > I use to install OS on this server have speed of over 600 MB/s. RAID 6 > with XFS peeks around 350 MB/s. That means that using local file system to > do data science is at least 4 time faster than using NFS. > > > Finally some great software news for this server. It runs Red Hat 7.1 > which is compiled with gcc-4.8.3. Feels much faster than 6.6. I installed > latest MATLAB R2015a, R, python-2.7.5 is now default system Python. Usual > suspects are there too: Pandas, scikit-learn, numpy, scipy, ipython, blas, > atlas, boost, gsl, and the whole slue of other software you are accustomed > to. > > > Enjoy, > Predrag > > > -------------- next part -------------- An HTML attachment was scrubbed... URL: From awd at cs.cmu.edu Thu May 28 10:01:56 2015 From: awd at cs.cmu.edu (Artur Dubrawski) Date: Thu, 28 May 2015 10:01:56 -0400 Subject: Jeff's send-off: 7pm tomorrow Message-ID: <55671FD4.40308@cs.cmu.edu> Dear Autonians, As we all know Jeff will be taking a leave of absence, actually very soon. Let us sent him off properly by having beer and snacks at 7pm tomorrow (which happens to be Jeff's last day on campus before he goes on his leave). Place: Mario's on Walnut Street in Shadyside. We will book some space upstairs on the deck. See you all there and please bring significant others! Artur From mdeartea at andrew.cmu.edu Thu May 28 10:35:59 2015 From: mdeartea at andrew.cmu.edu (Maria De Arteaga Gonzalez) Date: Thu, 28 May 2015 14:35:59 +0000 Subject: RV: Bloomberg data sci call for papers In-Reply-To: References: Message-ID: <37C824D99A19574DBF99B218045E3C4A138388@PGH-MSGMB-03.andrew.ad.cmu.edu> Hi all, Some of you might find this interesting. Best, Maria Mar?a De Arteaga PhD Student in Machine Learning and Public Policy Carnegie Mellon University ________________________________ De: heinz-phd-students-bounces+mdeartea=andrew.cmu.edu at lists.andrew.cmu.edu [heinz-phd-students-bounces+mdeartea=andrew.cmu.edu at lists.andrew.cmu.edu] en nombre de jacqueline mauro [jacqueline.amauro at gmail.com] Enviado: jueves, 28 de mayo de 2015 16:18 Para: heinz-phd-students at lists.andrew.cmu.edu Asunto: Bloomberg data sci call for papers Hi all, a friend of mine at Bloomberg sent me this call for papers, and thought it might be interesting to some of us. Looks like there's some money in it. I'm working on a project w Bloomberg at work. Do you think anyone in your CMU network would be relevant to this? This is a broad call for data science / analysis papers (could be works in progress papers) relating to four social good areas: education, environment, health and gov innovation. I feel like this might be relevant to your stats and public policy peers? Would appreciate any leads. I am currently in the process of putting together a proposal for incentivizing (possibly mini grant awards) people to submit innovative papers. http://www.bloomberglabs.com/data-science/content/uploads/sites/6/2015/05/DGX-CallforPapers.pdf -------------- next part -------------- An HTML attachment was scrubbed... URL: