From kirthevasankandasamy at gmail.com Mon Apr 3 12:12:40 2017 From: kirthevasankandasamy at gmail.com (Kirthevasan Kandasamy) Date: Mon, 3 Apr 2017 12:12:40 -0400 Subject: Fwd: Thesis Proposal - 4/6/17 - Kirthevasan Kandasamy - Tuning Hyper-parameters without Grad Students: Scaling up Bandit Optimisation In-Reply-To: <3efac583-d00e-d878-515b-249d202ee6b1@cs.cmu.edu> References: <3efac583-d00e-d878-515b-249d202ee6b1@cs.cmu.edu> Message-ID: Hi all, I'll be proposing this Thursday at noon. Feel free to drop by. -kirthevasan Sent from my phone. Please excuse brevity. ---------- Forwarded message ---------- From: "Diane Stidle" Date: Mar 27, 2017 14:17 Subject: Thesis Proposal - 4/6/17 - Kirthevasan Kandasamy - Tuning Hyper-parameters without Grad Students: Scaling up Bandit Optimisation To: "ml-seminar at cs.cmu.edu" , "zoubin at eng.cam.ac.uk" Cc: *Thesis Proposal* Date: 4/6/17 Time 12:00pm Place: 6121 GHC Speaker: Kirthevasan Kandasamy Title: Tuning Hyper-parameters without Grad Students: Scaling up Bandit Optimisation Abstract: In many scientific and engineering applications, we are tasked with optimising a black-box function which is expensive to evaluate due to computational or economic reasons. In *bandit optimisation*, we sequentially evaluate a noisy function with the goal of identifying its optimum in as few evaluations as possible. Some applications include tuning the hyper-parameters of machine learning algorithms, on-line advertising, optimal policy selection in robotics and maximum likelihood inference in simulation based scientific models. Today, these problems face new challenges due to increasingly expensive evaluations and the need to perform these tasks in high dimensional spaces. At the same time, there are new opportunities that have not been exploited before. We may have the flexibility to approximate the expensive function by investing less resources per evaluation. We can also carry out several evaluations simultaneously, say via parallel computing or by concurrently conducting multiple experiments in the real world. In this thesis, we aim to tackle these and several other challenges to meet emerging demands in large scale bandit applications. We develop methods with theoretical underpinnings and which also enjoy good empirical performance. Thesis Committee: Barnab?s P?czos (Co-Chair) Jeff Schneider (Co-Chair) Aarti Singh Zoubin Ghahramani (University of Cambridge) Link to draft document: cs.cmu.edu/~kkandasa/docs/proposal.pdf -- Diane Stidle Graduate Programs Manager Machine Learning Department Carnegie Mellon Universitydiane at cs.cmu.edu412-268-1299 <(412)%20268-1299> -------------- next part -------------- An HTML attachment was scrubbed... URL: From kandasamy at cmu.edu Wed Apr 5 20:05:15 2017 From: kandasamy at cmu.edu (Kirthevasan Kandasamy) Date: Wed, 5 Apr 2017 20:05:15 -0400 Subject: Fwd: ROOM CHANGE - Thesis Proposal - 4/6/17 - Kirthevasan Kandasamy - Tuning Hyper-parameters without Grad Students: Scaling up Bandit Optimisation In-Reply-To: <54f7717b-feaf-cb38-218e-3e5cf8d66eed@cs.cmu.edu> References: <54f7717b-feaf-cb38-218e-3e5cf8d66eed@cs.cmu.edu> Message-ID: Hi all, We changed rooms for the proposal. It is happening tomorrow at noon at GHC 6115. samy ---------- Forwarded message ---------- From: Diane Stidle Date: Tue, Apr 4, 2017 at 2:03 PM Subject: ROOM CHANGE - Thesis Proposal - 4/6/17 - Kirthevasan Kandasamy - Tuning Hyper-parameters without Grad Students: Scaling up Bandit Optimisation To: "ml-seminar at cs.cmu.edu" , "zoubin at eng.cam.ac.uk" *Thesis Proposal* Date: 4/6/17 Time 12:00pm Place: *6115 GHC (Note: Room Change)* Speaker: Kirthevasan Kandasamy Title: Tuning Hyper-parameters without Grad Students: Scaling up Bandit Optimisation Abstract: In many scientific and engineering applications, we are tasked with optimising a black-box function which is expensive to evaluate due to computational or economic reasons. In *bandit optimisation*, we sequentially evaluate a noisy function with the goal of identifying its optimum in as few evaluations as possible. Some applications include tuning the hyper-parameters of machine learning algorithms, on-line advertising, optimal policy selection in robotics and maximum likelihood inference in simulation based scientific models. Today, these problems face new challenges due to increasingly expensive evaluations and the need to perform these tasks in high dimensional spaces. At the same time, there are new opportunities that have not been exploited before. We may have the flexibility to approximate the expensive function by investing less resources per evaluation. We can also carry out several evaluations simultaneously, say via parallel computing or by concurrently conducting multiple experiments in the real world. In this thesis, we aim to tackle these and several other challenges to meet emerging demands in large scale bandit applications. We develop methods with theoretical underpinnings and which also enjoy good empirical performance. Thesis Committee: Barnab?s P?czos (Co-Chair) Jeff Schneider (Co-Chair) Aarti Singh Zoubin Ghahramani (University of Cambridge) Link to draft document: cs.cmu.edu/~kkandasa/docs/proposal.pdf -- Diane Stidle Graduate Programs Manager Machine Learning Department Carnegie Mellon Universitydiane at cs.cmu.edu412-268-1299 <(412)%20268-1299> -------------- next part -------------- An HTML attachment was scrubbed... URL: From predragp at cs.cmu.edu Wed Apr 12 15:54:44 2017 From: predragp at cs.cmu.edu (Predrag Punosevac) Date: Wed, 12 Apr 2017 15:54:44 -0400 Subject: ipython2 broken on all servers In-Reply-To: References: Message-ID: <20170412195444.N4akPjdVn%predragp@cs.cmu.edu> Benedikt Boecking wrote: > Ok, I take that back. It does not work for me, but ipython2 worked for Sibi. However, none of us can start new ipython/jupyter notebooks for some reason. Trying to figure out what might be causing it. > You are not the first one reporting. I do run yum-cron without kernel updates so it could be that. I will look into it. Predrag > > > > On Apr 12, 2017, at 3:47 PM, Benedikt Boecking wrote: > > > > Predrag, > > > > Were any updates pushed to the servers midway today? ipython2 does not work anymore (tested on ari, lov3 and lov4 and also had chirag and Sibi test it independently) > > > > - Ben > > > > > > > From predragp at cs.cmu.edu Wed Apr 12 16:41:12 2017 From: predragp at cs.cmu.edu (Predrag Punosevac) Date: Wed, 12 Apr 2017 16:41:12 -0400 Subject: ipython2 broken on all servers In-Reply-To: <20170412195444.N4akPjdVn%predragp@cs.cmu.edu> References: <20170412195444.N4akPjdVn%predragp@cs.cmu.edu> Message-ID: <20170412204112.Bc-5pggJp%predragp@cs.cmu.edu> Predrag Punosevac wrote: > Benedikt Boecking wrote: > > > Ok, I take that back. It does not work for me, but ipython2 worked for Sibi. However, none of us can start new ipython/jupyter notebooks for some reason. Trying to figure out what might be causing it. > > > I upgraded ipython on all computing nodes. ipython starts for me with the root account but it will not start with my regular user network account. That indicates that there is some kind NFS issuep. Somebody must be heavily writing/reading from the file server or stale NFS file handles. I would wait a bit to see if the problem resolves by itself. Obvius "easy" solution would be to clear things by rebooting file server and computing nodes. Predrag > You are not the first one reporting. I do run yum-cron without kernel > updates so it could be that. I will look into it. > > Predrag > > > > > > > > On Apr 12, 2017, at 3:47 PM, Benedikt Boecking wrote: > > > > > > Predrag, > > > > > > Were any updates pushed to the servers midway today? ipython2 does not work anymore (tested on ari, lov3 and lov4 and also had chirag and Sibi test it independently) > > > > > > - Ben > > > > > > > > > > > From predragp at cs.cmu.edu Mon Apr 17 19:01:25 2017 From: predragp at cs.cmu.edu (Predrag Punosevac) Date: Mon, 17 Apr 2017 19:01:25 -0400 Subject: LOP1 Message-ID: <20170417230125.zMS6b4eV4%predragp@cs.cmu.edu> Is back on line after I upgraded 5 servers from OpenBSD 6.0 to 6.1. Please report anything unusual. Predrag From sheath at andrew.cmu.edu Fri Apr 21 11:08:48 2017 From: sheath at andrew.cmu.edu (Simon Heath) Date: Fri, 21 Apr 2017 11:08:48 -0400 Subject: bash and lop1 down Message-ID: Dear all, It appears that bash.autonlab.org and lop1.autonlab.org are inaccessible. We're working on it and should have an update within an hour. Simon+Predrag -- Simon Heath, Research Programmer and Analyst Robotics Institute - Auton Lab Carnegie Mellon University sheath at andrew.cmu.edu -------------- next part -------------- An HTML attachment was scrubbed... URL: From sheath at andrew.cmu.edu Fri Apr 21 11:17:27 2017 From: sheath at andrew.cmu.edu (Simon Heath) Date: Fri, 21 Apr 2017 11:17:27 -0400 Subject: bash.autonlab.org and lop1.autonlab.org are back up Message-ID: You should be able to access both systems again. Please let me know immediately if you have problems with either of them. Thanks, Simon -- Simon Heath, Research Programmer and Analyst Robotics Institute - Auton Lab Carnegie Mellon University sheath at andrew.cmu.edu -------------- next part -------------- An HTML attachment was scrubbed... URL: From predragp at cs.cmu.edu Sat Apr 22 06:55:27 2017 From: predragp at cs.cmu.edu (Predrag Punosevac) Date: Sat, 22 Apr 2017 06:55:27 -0400 Subject: bash.autonlab.org and lop1.autonlab.org are back up In-Reply-To: References: Message-ID: <20170422105527.Gu3h7B27V%predragp@cs.cmu.edu> Michael Andrews wrote: > Hi Simon, > > FYI, it seems to be down again: > > ssh: connect to host lop1.autonlab.org port 22: Connection refused > > Regards, > Michael As I expected ldapd daemon died again. I am working with OpenBSD developers to see why is this happening after the upgrade to 6.1. I am setting the cron job to regularly restart the daemon. As soon as I get back to Pittsburgh I will consider downgrading one of LDAP servers to 6.0 which was rock stable. Predrag > > > On Fri, Apr 21, 2017 at 5:17 PM, Simon Heath wrote: > > > You should be able to access both systems again. Please let me know > > immediately if you have problems with either of them. > > > > Thanks, > > Simon > > > > -- > > Simon Heath, Research Programmer and Analyst > > Robotics Institute - Auton Lab > > Carnegie Mellon University > > sheath at andrew.cmu.edu > > From predragp at cs.cmu.edu Tue Apr 25 12:24:06 2017 From: predragp at cs.cmu.edu (Predrag Punosevac) Date: Tue, 25 Apr 2017 12:24:06 -0400 Subject: nvidia-smi not working on gpu1 In-Reply-To: References: Message-ID: <20170425162406.IMAoHtVF1%predragp@cs.cmu.edu> Sibi Venkatesan wrote: > Hi Predrag, > > nvidia-smi does not work on gpu1 -- Nick and I have both checked. It gives > me this issue: > > Failed to initialize NVML: Driver/library version mismatch > > Have others reported this issue? Sibi, Simon did reboot the machine which have cleared the error. My initial hunch was that the driver is too old. We were using older driver on GPU1 due to the fact that newer 8.xxx driver released after September of last year were braking MATLAB 2016b. The MATLAB 2017a has being released three weeks ago. I am planning to start upgrading MATLAB in the least descriptive way, firstly GPU[2-4] which had to use newer NVIDIA driver due to the compatibility issue with Titan X cards and on which MATLAB currently is broken with for GPU work. I will then upgrade NVIDIA driver to the latest following by TensorFlow and Caffe. Best, Predrag > -- > > - Sibi From predragp at cs.cmu.edu Tue Apr 25 12:36:45 2017 From: predragp at cs.cmu.edu (Predrag Punosevac) Date: Tue, 25 Apr 2017 12:36:45 -0400 Subject: Toner replaced Message-ID: <20170425163645.6FrUKHugb%predragp@cs.cmu.edu> If your printer preference is lbro.auton.cs.cmu.edu (the Brother printer located in the dungeon) I would like to let you know that I just put a new toner, courtesy of Dr. Dubrawski who is out for $100. Best, Predrag From sheath at andrew.cmu.edu Wed Apr 26 10:44:27 2017 From: sheath at andrew.cmu.edu (Simon Heath) Date: Wed, 26 Apr 2017 10:44:27 -0400 Subject: Auton Lab Code and Coffee, next Thursday at 12:30 pm Message-ID: Hi all, I want to try something new, which I call Code and Coffee. The goal is basically to be the equivalent of the brainstorming sessions, but oriented less around what research we're doing and more around what research tools we're using/developing/wish we had. I want to do them at least monthly, maybe weekly if we can manage it, just to get a lot of people together in the same room to talk about programming. The first session will be next Thursday at 12:30 PM, in NSH 3001. Feel free to bring lunches, and if people want we can pass a hat around and get a couple pots of actually good coffee. I will be kicking off by talking about Collective Mind Data Server, a web service for time-series data analysis being built by Jarod, Saswati, Anthony and myself. Simon -- Simon Heath, Research Programmer and Analyst Robotics Institute - Auton Lab Carnegie Mellon University sheath at andrew.cmu.edu -------------- next part -------------- An HTML attachment was scrubbed... URL: From db78349 at gmail.com Wed Apr 26 11:15:27 2017 From: db78349 at gmail.com (David Bayani) Date: Wed, 26 Apr 2017 11:15:27 -0400 Subject: Auton Lab Code and Coffee, next Thursday at 12:30 pm In-Reply-To: References: Message-ID: Great idea! I approve! On Wed, Apr 26, 2017 at 10:44 AM, Simon Heath wrote: > Hi all, > > I want to try something new, which I call Code and Coffee. The goal is > basically to be the equivalent of the brainstorming sessions, but oriented > less around what research we're doing and more around what research tools > we're using/developing/wish we had. I want to do them at least monthly, > maybe weekly if we can manage it, just to get a lot of people together in > the same room to talk about programming. > > The first session will be next Thursday at 12:30 PM, in NSH 3001. Feel > free to bring lunches, and if people want we can pass a hat around and get > a couple pots of actually good coffee. I will be kicking off by talking > about Collective Mind Data Server, a web service for time-series data > analysis being built by Jarod, Saswati, Anthony and myself. > > Simon > > -- > Simon Heath, Research Programmer and Analyst > Robotics Institute - Auton Lab > Carnegie Mellon University > sheath at andrew.cmu.edu > -------------- next part -------------- An HTML attachment was scrubbed... URL: From awd at cs.cmu.edu Wed Apr 26 22:24:12 2017 From: awd at cs.cmu.edu (Artur Dubrawski) Date: Wed, 26 Apr 2017 22:24:12 -0400 Subject: Auton Lab in the media Message-ID: <74200d0f-bb31-21ef-6e38-621472924297@cs.cmu.edu> Heroic work of Emily et al at Marinus, and many Autonians in support, have not gone unnoticed: "This collaboration, along with trend analysis of activity from Carnegie-Mellon University, led to 44 human trafficking targets generated, two national trafficking networks being identified, and eight target packages turned over to law enforcement within a 72-hour period. Law enforcement in Houston have already made arrests and freed victims based on information gathered during the Super Bowl." ...it is just an excerpt. Check these out for more info: http://www.dailyinterlake.com/article/20170426/ARTICLE/170429883 http://www.focusonthefamily.com/socialissues/citizen-magazine/changing-the-game/changing-the-game There is also a new piece about "big data" in food safety to appear in the newest edition of Food Technology journal (www.ift.org) which reflects some of our past and current work on helping make our food safer for consumption. Congrats to everyone involved! Artur From sheath at andrew.cmu.edu Thu Apr 27 11:48:27 2017 From: sheath at andrew.cmu.edu (Simon Heath) Date: Thu, 27 Apr 2017 11:48:27 -0400 Subject: DNS issues Message-ID: Dear all, Several people are experiencing intermittent DNS issues. We are looking into it and will follow up when we figure out what's going on. Simon -- Simon Heath, Research Programmer and Analyst Robotics Institute - Auton Lab Carnegie Mellon University sheath at andrew.cmu.edu -------------- next part -------------- An HTML attachment was scrubbed... URL: From sheath at andrew.cmu.edu Fri Apr 28 11:47:24 2017 From: sheath at andrew.cmu.edu (Simon Heath) Date: Fri, 28 Apr 2017 11:47:24 -0400 Subject: Auton Lab Code and Coffee, next Thursday at 12:30 pm In-Reply-To: References: Message-ID: Jeishi had a great idea, which is to actually make a wiki page about this. So I made one here: https://www.autonlab.org/private/intranet/code_and_coffee Feel free to edit it and add stuff. Simon On Wed, Apr 26, 2017 at 11:15 AM, David Bayani wrote: > Great idea! I approve! > > On Wed, Apr 26, 2017 at 10:44 AM, Simon Heath > wrote: > >> Hi all, >> >> I want to try something new, which I call Code and Coffee. The goal is >> basically to be the equivalent of the brainstorming sessions, but oriented >> less around what research we're doing and more around what research tools >> we're using/developing/wish we had. I want to do them at least monthly, >> maybe weekly if we can manage it, just to get a lot of people together in >> the same room to talk about programming. >> >> The first session will be next Thursday at 12:30 PM, in NSH 3001. Feel >> free to bring lunches, and if people want we can pass a hat around and get >> a couple pots of actually good coffee. I will be kicking off by talking >> about Collective Mind Data Server, a web service for time-series data >> analysis being built by Jarod, Saswati, Anthony and myself. >> >> Simon >> >> -- >> Simon Heath, Research Programmer and Analyst >> Robotics Institute - Auton Lab >> Carnegie Mellon University >> sheath at andrew.cmu.edu >> > > -- Simon Heath, Research Programmer and Analyst Robotics Institute - Auton Lab Carnegie Mellon University sheath at andrew.cmu.edu -------------- next part -------------- An HTML attachment was scrubbed... URL: From db78349 at gmail.com Fri Apr 28 11:49:39 2017 From: db78349 at gmail.com (David Bayani) Date: Fri, 28 Apr 2017 11:49:39 -0400 Subject: Auton Lab Code and Coffee, next Thursday at 12:30 pm In-Reply-To: References: Message-ID: Great! On Fri, Apr 28, 2017 at 11:47 AM, Simon Heath wrote: > Jeishi had a great idea, which is to actually make a wiki page about > this. So I made one here: https://www.autonlab.org/ > private/intranet/code_and_coffee > > Feel free to edit it and add stuff. > > Simon > > On Wed, Apr 26, 2017 at 11:15 AM, David Bayani wrote: > >> Great idea! I approve! >> >> On Wed, Apr 26, 2017 at 10:44 AM, Simon Heath >> wrote: >> >>> Hi all, >>> >>> I want to try something new, which I call Code and Coffee. The goal is >>> basically to be the equivalent of the brainstorming sessions, but oriented >>> less around what research we're doing and more around what research tools >>> we're using/developing/wish we had. I want to do them at least monthly, >>> maybe weekly if we can manage it, just to get a lot of people together in >>> the same room to talk about programming. >>> >>> The first session will be next Thursday at 12:30 PM, in NSH 3001. Feel >>> free to bring lunches, and if people want we can pass a hat around and get >>> a couple pots of actually good coffee. I will be kicking off by talking >>> about Collective Mind Data Server, a web service for time-series data >>> analysis being built by Jarod, Saswati, Anthony and myself. >>> >>> Simon >>> >>> -- >>> Simon Heath, Research Programmer and Analyst >>> Robotics Institute - Auton Lab >>> Carnegie Mellon University >>> sheath at andrew.cmu.edu >>> >> >> > > > -- > Simon Heath, Research Programmer and Analyst > Robotics Institute - Auton Lab > Carnegie Mellon University > sheath at andrew.cmu.edu > -------------- next part -------------- An HTML attachment was scrubbed... URL: From predragp at cs.cmu.edu Fri Apr 28 11:51:19 2017 From: predragp at cs.cmu.edu (Predrag Punosevac) Date: Fri, 28 Apr 2017 11:51:19 -0400 Subject: DNS issues demystified In-Reply-To: <4836d14887d70e9afdd94c2c7798b61f@imap.srv.cs.cmu.edu> References: <4836d14887d70e9afdd94c2c7798b61f@imap.srv.cs.cmu.edu> Message-ID: <20170428155119.ZsBT5_u2s%predragp@cs.cmu.edu> Dear Autonians, I got to the bottom of DNS/OpenVPN issue. As I suspected the CMU network guys have being upgrading backplane on the switches. The CMU switches are now passing packets at the speeds of 20 Gigabit/s. Best, Predrag Predrag Punosevac wrote: > On 2017-04-27 11:48, Simon Heath wrote: > > Dear all, > > > > Several people are experiencing intermittent DNS issues. We are > > looking into it and will follow up when we figure out what's going on. > > > > Simon > > > > DNS issue on desktops seems to be resolved at this point.I restarted > OpenVPN > server which also serves as the DNS resolver for desktops. It is not > clear > to me (even after going through log files) what caused the problem > (OpenVPN > connection between desktops and the main firewall/OpenVPN server being a > prime suspect). > People who were trying to access computing nodes from the > lop1.autonlab.org > never experienced any problems which is another pointer to OpenVPN > server. > > I did physically inspect the server and made sure that cables OK. I was > unable > to locate Matt Nickelson (CS CMU network guy) which is kind a bad sign > as > he had lots issues yesterday with his switches. I am continue to monitor > the situation > and I am ready to act. > > Best, > Predrag > > > -- > > > > Simon Heath, Research Programmer and Analyst > > Robotics Institute - Auton Lab > > Carnegie Mellon University > > sheath at andrew.cmu.edu