From mailer at doodle.com Mon Oct 5 15:13:37 2009 From: mailer at doodle.com (Karen Widmaier via Doodle) Date: Mon, 5 Oct 2009 21:13:37 +0200 (CEST) Subject: [Research] AutonLab weekly meetings Message-ID: <16922323.239407.1254770017674.JavaMail.doodle@worker1> If you have already responded, Thank You. If not, please take a moment to access the poll and mark your availability. So far, it looks as if most people are available on Wednesdays at noon. Follow this link to participate in it: http://www.doodle.com/rgvkwswp2afwnsyc ---- Advertisement -------------------------------- Are you a regular Doodle user? Use Doodle ads-free and with your personal design Order now: http://www.doodle.com/r/PremiumDoodleEN -------------------------------- Advertisement ---- From awd at cs.cmu.edu Mon Oct 5 16:39:35 2009 From: awd at cs.cmu.edu (Artur Dubrawski) Date: Mon, 05 Oct 2009 16:39:35 -0400 Subject: [Research] AutonLab weekly meetings In-Reply-To: <16922323.239407.1254770017674.JavaMail.doodle@worker1> References: <16922323.239407.1254770017674.JavaMail.doodle@worker1> Message-ID: <4ACA5987.5000500@cs.cmu.edu> Thanks Karen. All: We are planning to meet for up to 1.5 hours starting at the times shown in the survey (please translate 3am to 3pm :) Artur Karen Widmaier via Doodle wrote: > If you have already responded, Thank You. > > If not, please take a moment to access the poll and mark your availability. So far, it looks as if most people are available on Wednesdays at noon. > > Follow this link to participate in it: > http://www.doodle.com/rgvkwswp2afwnsyc > > > ---- Advertisement -------------------------------- > > Are you a regular Doodle user? > Use Doodle ads-free and with your personal design > Order now: http://www.doodle.com/r/PremiumDoodleEN > > -------------------------------- Advertisement ---- > > _______________________________________________ > Research mailing list > Research at autonlab.org > https://www.autonlab.org/mailman/listinfo/research > > From awd at cs.cmu.edu Mon Oct 5 16:54:47 2009 From: awd at cs.cmu.edu (Artur Dubrawski) Date: Mon, 05 Oct 2009 16:54:47 -0400 Subject: [Research] Lab meeting this Wednesday 10/7 12noon in GHC 8102 Message-ID: <4ACA5D17.3090608@cs.cmu.edu> Dear Autonians, The first 2009/10 Lab meeting will take place this Wednesday, Oct 7, at 12noon in GHC 8102 (it is in that ugly new building next door :) We will first go around with the updates on the good things that have happened since our last meeting in the spring. Then we will be entertained by a veteran member of the Auton Lab, Mr. Sajid Siddiqi, who will discuss the use of his STACS algorithm for learning classifiers of sound that are useful for analysis and interpretation of unstructured audio scenes in cool real world applications. The intellectual feast will be complemented with food. See you all there Artur From awd at cs.cmu.edu Mon Oct 5 18:53:21 2009 From: awd at cs.cmu.edu (Artur Dubrawski) Date: Mon, 05 Oct 2009 18:53:21 -0400 Subject: [Research] Lab meeting this Wednesday 10/7 12noon in GHC 8102 In-Reply-To: <4ACA5D17.3090608@cs.cmu.edu> References: <4ACA5D17.3090608@cs.cmu.edu> Message-ID: <4ACA78E1.5050007@cs.cmu.edu> BTW, Sajid submits the following title and abstract of his presentation: AUTOMATIC STATE DISCOVERY FOR UNSTRUCTURED AUDIO SCENE ANALYSIS We present a novel classification scheme for unstructured audio scene analysis. Our scheme is based on our recently introduced machine learning algorithm called Simultaneous Temporal And Contextual Splitting (STACS) that discovers the appropriate number of states and efficiently learns accurate Hidden Markov Model (HMM) parameters for the given data. STACS-based algorithms train HMMs upto an order of magnitude faster than Baum-Welch, avoid the overfitting problem commonly encountered in learning large state complex HMMs using Expectation Maximization (EM) methods such as Baum-Welch, and achieve superior classification results on a very diverse dataset with minimal pre-processing. Furthermore, our scheme has proven to be highly effective for building real-world applications and has been integrated into a commercial surveillance system as an event detection component. This is joint work with Julian Ramos, Artur Dubrawski and Geoff Gordon of CMU and Abhishek Sharma of MobileFusion, Inc. Artur Dubrawski wrote: > Dear Autonians, > > The first 2009/10 Lab meeting will take place this Wednesday, Oct 7, > at 12noon in GHC 8102 (it is in that ugly new building next door :) > > We will first go around with the updates on the good things that have happened > since our last meeting in the spring. Then we will be entertained by > a veteran member of the Auton Lab, Mr. Sajid Siddiqi, who will discuss the > use of his STACS algorithm for learning classifiers of sound that are useful > for analysis and interpretation of unstructured audio scenes in cool real > world applications. > > The intellectual feast will be complemented with food. > > See you all there > Artur > > > _______________________________________________ > Research mailing list > Research at autonlab.org > https://www.autonlab.org/mailman/listinfo/research > > From siddiqi at cs.cmu.edu Mon Oct 12 14:12:16 2009 From: siddiqi at cs.cmu.edu (Sajid Siddiqi) Date: Mon, 12 Oct 2009 14:12:16 -0400 (EDT) Subject: [Research] Thesis practice talk today @ 6:30pm Message-ID: <1537.128.2.182.68.1255371136.squirrel@webmail.cs.cmu.edu> Hi all, Just a reminder that my first thesis practice talk is today at 6:30pm in GHC 8102, in case you'd like to come. Your input will be helpful. There will be pizza. Thanks! Sajid ---------------------------------------------- Hi all, I'm going to hold two practice talks for my thesis defense. One is on Monday 6:30pm in Gates-Hillman 8102, the other on Wednesday at currently 10:30am in NSH 3001. It would be great if you could come and help me practice and improve the talk! I'll order pizza or something. Please let me know if you can make it to either one. Thanks! Sajid From siddiqi at cs.cmu.edu Fri Oct 9 16:03:29 2009 From: siddiqi at cs.cmu.edu (Sajid Siddiqi) Date: Fri, 9 Oct 2009 16:03:29 -0400 (EDT) Subject: [Research] Practice talks for thesis defense next week In-Reply-To: <1777.128.2.182.68.1255116344.squirrel@webmail.cs.cmu.edu> References: <1777.128.2.182.68.1255116344.squirrel@webmail.cs.cmu.edu> Message-ID: <1901.128.2.182.68.1255118609.squirrel@webmail.cs.cmu.edu> Sorry, the second talk is on Wednesday 10/14 at 10:30am. Sajid On Fri, October 9, 2009 3:25 pm, Sajid Siddiqi wrote: > Hi all, > > > I'm going to hold two practice talks for my thesis defense. One is on > Monday 6:30pm in Gates-Hillman 8102, the other at (currently) 10:30am in > NSH 3001. It would be great if you could come and help me practice and > improve the talk! I'll order pizza or something. Please let me know if you > can make it to either one. > > Thanks! > Sajid > > From siddiqi at cs.cmu.edu Fri Oct 9 15:25:44 2009 From: siddiqi at cs.cmu.edu (Sajid Siddiqi) Date: Fri, 9 Oct 2009 15:25:44 -0400 (EDT) Subject: [Research] Practice talks for thesis defense next week Message-ID: <1777.128.2.182.68.1255116344.squirrel@webmail.cs.cmu.edu> Hi all, I'm going to hold two practice talks for my thesis defense. One is on Monday 6:30pm in Gates-Hillman 8102, the other at (currently) 10:30am in NSH 3001. It would be great if you could come and help me practice and improve the talk! I'll order pizza or something. Please let me know if you can make it to either one. Thanks! Sajid From siddiqi at cs.cmu.edu Tue Oct 13 23:04:33 2009 From: siddiqi at cs.cmu.edu (Sajid Siddiqi) Date: Tue, 13 Oct 2009 23:04:33 -0400 (EDT) Subject: [Research] Thesis practice Wednesday at 10:30 am in NSH 3001 Message-ID: <4012.76.125.232.60.1255489473.squirrel@webmail.cs.cmu.edu> Hi all, Just a reminder that my final thesis practice talk is tomorrow (Wednesday) at 10:30am in NSH 3001 (next to the Roboceptionist), in case you'd like to come. Your input will be very helpful! There will be donuts from Dunkin. Thanks, Sajid From mjbaysek at cs.cmu.edu Thu Oct 22 08:33:59 2009 From: mjbaysek at cs.cmu.edu (Michael J. Baysek) Date: Thu, 22 Oct 2009 08:33:59 -0400 Subject: [Research] Reminder Compute Machine Downtime Message-ID: <4AE05137.4090407@cs.cmu.edu> Hi Lab, This is a reminder that the compute machines will be down tomorrow Friday for a software upgrade. I am budgeting the entire day for the process, though it is quite likely many machines will be back online by around noontime. If you are planning jobs for after the downtime, please email me with your memory and CPU requirements and I can notify you as soon as a machine is online that matches your criteria. Mike From mjbaysek at cs.cmu.edu Fri Oct 23 15:33:00 2009 From: mjbaysek at cs.cmu.edu (Michael J. Baysek) Date: Fri, 23 Oct 2009 15:33:00 -0400 Subject: [Research] Lab Machine Upgrades Message-ID: <4AE204EC.8020000@cs.cmu.edu> Hi Lab, This a brief email because I am still working on this, but the lab machines are, for the most part back online. There are some software packages missing, notably VNC, MATLAB and JAVA. I will be adding these shortly. For VNC users, for now, use screen. If you don't know how, login to https://www.autonlab.org/auton_intranet and search for screen. There are three very helpful documents with varying levels of detail. Also, the following T-Cube Web Interfaces are down (but next to be restored): LOP6 (Sri Lanka) and LOS1 (Public Demo). USAF and USDA interfaces are UP. I will keep you informed of changes, and let you all know when I am done. LOQ2 and LOR1 will remain down over the weekend. LOQ1 and LOR2 however, have been unavailable, but are now UP, so it's kind of a wash. LINA and LIRA are not yet upgraded. These upgrades will happen early next week. The only people using them are Saswati, myself, and USDA T-Cube Web Interface users, but I thought it worth mentioning. Mike -- -- Michael J. Baysek, Systems Analyst Carnegie Mellon University - Auton Lab www.cmu.edu - www.autonlab.org 412-268-8939 From mjbaysek at cs.cmu.edu Fri Oct 23 17:04:46 2009 From: mjbaysek at cs.cmu.edu (Michael J. Baysek) Date: Fri, 23 Oct 2009 17:04:46 -0400 Subject: [Research] [auton-users] Lab Machine Upgrades In-Reply-To: <4AE204EC.8020000@cs.cmu.edu> References: <4AE204EC.8020000@cs.cmu.edu> Message-ID: <4AE21A6E.4040302@cs.cmu.edu> There is a new version of GCC on this install, so it will be very smart for you to clean all your object and binary files out of your h/ by running make zapsibs before recompiling, or even better, deleting all the ~/h/*Linux*gcc* directories. If you have any compilation problems, let me know. -- Michael J. Baysek, Systems Analyst Carnegie Mellon University - Auton Lab www.cmu.edu - www.autonlab.org 412-268-8939 Michael J. Baysek wrote, On 10/23/2009 03:33 PM: > Hi Lab, > > > This a brief email because I am still working on this, but the lab > machines are, for the most part back online. > > > There are some software packages missing, notably VNC, MATLAB and > JAVA. I will be adding these shortly. For VNC users, for now, use > screen. If you don't know how, login to > https://www.autonlab.org/auton_intranet and search for screen. There > are three very helpful documents with varying levels of detail. > > Also, the following T-Cube Web Interfaces are down (but next to be > restored): LOP6 (Sri Lanka) and LOS1 (Public Demo). USAF and USDA > interfaces are UP. > > > I will keep you informed of changes, and let you all know when I am done. > > > LOQ2 and LOR1 will remain down over the weekend. LOQ1 and LOR2 > however, have been unavailable, but are now UP, so it's kind of a wash. > > > LINA and LIRA are not yet upgraded. These upgrades will happen early > next week. The only people using them are Saswati, myself, and USDA > T-Cube Web Interface users, but I thought it worth mentioning. > > > Mike > From mjbaysek at cs.cmu.edu Fri Oct 23 23:59:30 2009 From: mjbaysek at cs.cmu.edu (Michael J. Baysek) Date: Fri, 23 Oct 2009 23:59:30 -0400 Subject: [Research] gmake-magic update required Message-ID: <4AE27BA2.5040703@cs.cmu.edu> Hi Lab, Two people have had problems building code which links to system includes on the new system. The fix has been committed to gmake-magic. You should update your ~/h/gmake-magic asap if you want to avoid this problem. As a side note: there have been a lot of fixes in the core code recently. You should all consider running cvs up on the whole of your ~/h directory by: cd ~/h cvs up As soon as you can. You should be in the habit of doing this at least monthly. We are soon releasing a system which will let you know about core code changes automatically, but for now, just keep updating your ~/h at sane intervals. Best, Mike From psarkar at cs.cmu.edu Sun Oct 25 12:03:57 2009 From: psarkar at cs.cmu.edu (Purnamrita Sarkar) Date: Sun, 25 Oct 2009 12:03:57 -0400 Subject: [Research] "Too many open files" error Message-ID: <4AE476ED.7050807@cs.cmu.edu> Hi all, I am running some code which needs to quickly open lots of files to load the data in them. These are in the fast fds format. I use the ds_load() function. The problem is that even if all open file pointers are closed using fclose, I see an error "too many open files". I google-d for this particular error, and apparently this is OS specific, since every OS has an upper bound on number of open files (ulimit -n gives 1024 for our OS). What I am not understanding is, I _am_ closing all files the moment they are used, so no two files should be open together. Any ideas? Thanks! Purna From psarkar at cs.cmu.edu Sun Oct 25 13:22:51 2009 From: psarkar at cs.cmu.edu (Purnamrita Sarkar) Date: Sun, 25 Oct 2009 13:22:51 -0400 Subject: [Research] "Too many open files" error In-Reply-To: References: <4AE476ED.7050807@cs.cmu.edu> Message-ID: <4AE4896B.4080009@cs.cmu.edu> Hi all, Thanks very much for all the ideas. It has been fixed! Purna From mjbaysek at cs.cmu.edu Sun Oct 25 13:23:05 2009 From: mjbaysek at cs.cmu.edu (Michael J. Baysek) Date: Sun, 25 Oct 2009 13:23:05 -0400 Subject: [Research] "Too many open files" error In-Reply-To: <4AE476ED.7050807@cs.cmu.edu> References: <4AE476ED.7050807@cs.cmu.edu> Message-ID: <4AE48979.2050907@cs.cmu.edu> It looks like there were bugs introduced into dsut.c back in July that caused this problem. The bug was triggered if you were loading lots and lots of datsets within your program. Anyway, we figured it out. Purna is committing the fix. Everyone should update your dset directory. -Mike On 10/25/09 12:03 PM, Purnamrita Sarkar wrote: > Hi all, > > I am running some code which needs to quickly open lots of files to load > the data in them. These are in the fast fds format. I use the ds_load() > function. The problem is that even if all open file pointers are closed > using fclose, I see an error "too many open files". > > I google-d for this particular error, and apparently this is OS > specific, since every OS has an upper bound on number of open files > (ulimit -n gives 1024 for our OS). What I am not understanding is, I > _am_ closing all files the moment they are used, so no two files should > be open together. > > Any ideas? > Thanks! > Purna > _______________________________________________ > Research mailing list > Research at autonlab.org > https://www.autonlab.org/mailman/listinfo/research > > From siddiqi at cs.cmu.edu Wed Oct 28 13:39:52 2009 From: siddiqi at cs.cmu.edu (Sajid Siddiqi) Date: Wed, 28 Oct 2009 13:39:52 -0400 (EDT) Subject: [Research] C/Matlab code for learning ARMA models? Message-ID: <1286.128.2.192.35.1256751592.squirrel@webmail.cs.cmu.edu> Hi, Does anyone know of easily available code for learning multivariate AutoRegressive-Moving Average (ARMA) models from data, in Matlab or C? Is it present in our code repository? Thanks, Sajid From awd at cs.cmu.edu Fri Oct 30 10:42:45 2009 From: awd at cs.cmu.edu (Artur Dubrawski) Date: Fri, 30 Oct 2009 10:42:45 -0400 Subject: [Research] Auton Lab meeting next week Message-ID: <4AEAFB65.1000502@cs.cmu.edu> Dear Autonians, Now with the fall foliage past its peak, everyone in Pittsburgh can see more structural detail of trees growing around. It feels appropriate and timely for computer scientists to relate to this phenomenon. Fundamental questions, such as why the "real" trees have roots in the bottom and leaves up on top, entirely opposite to how they are in computers, as well as other crucial and relevant issues, will be addressed by the leading Auton Lab tree grower Dr. Daria Sorokina. When: Wednesday November 4th at noon Where: NSH 1507 Food: yes Abstract: see below See you all there! Artur ---- TreeExtra package: prediction and descriptive analysis with ensembles of trees. In this talk I am going to describe a C++ package I have been developing over the past two years. TreeExtra contains a number of general data mining tools relevant for a large range of problems. - Additive Groves A powerful ensemble of trees, significantly outperforms other ensembles on regression and is highly competitive on classification problems. TreeExtra implementation provides several modes of training, automatic parameter choice and parallelization tools. - Bagged trees with fast feature evaluation. Bagged trees is a fast and simple ensemble, in our implementation it is equipped with built-in feature importance ranking. - Backward elimination feature selection Thorough feature selection, leaves only a small set of truly important non-redundant features. - Interaction detection Detects which features are involved in complex effects and need to be studied together - Effect plots (or partial dependence plots) Visualization of an effect of a single variable in a given model - Interaction plots Visualization of a joint effect of two variables in a model along with the joint distribution of those variables From sbrudene at andrew.cmu.edu Sun Oct 25 13:21:32 2009 From: sbrudene at andrew.cmu.edu (Steven Brudenell) Date: Sun, 25 Oct 2009 13:21:32 -0400 Subject: [Research] "Too many open files" error Message-ID: <4AE476ED.7050807@cs.cmu.edu> Purna, one thing you can do to help debug this kind of error is to look in the /proc filesystem. /proc//fd/ contains symlinks to every file a process has open. so if you run you program in a gdb, and put a breakpoint at the point of receiving this error, then do ls -l /proc//fd, you can see which files your program has open. this may clue you in to why you have so many open files. Purnamrita Sarkar wrote: >Hi all, > >I am running some code which needs to quickly open lots of files to load >the data in them. These are in the fast fds format. I use the ds_load() >function. The problem is that even if all open file pointers are closed >using fclose, I see an error "too many open files". > >I google-d for this particular error, and apparently this is OS >specific, since every OS has an upper bound on number of open files >(ulimit -n gives 1024 for our OS). What I am not understanding is, I >_am_ closing all files the moment they are used, so no two files should >be open together. > >Any ideas? >Thanks! >Purna >_______________________________________________ >Research mailing list >Research at autonlab.org >https://www.autonlab.org/mailman/listinfo/research >