From komarek.paul at gmail.com Mon Jun 1 15:44:41 2009 From: komarek.paul at gmail.com (Paul Komarek) Date: Mon, 1 Jun 2009 12:44:41 -0700 Subject: [Research] Using the .fds file format In-Reply-To: <4A21B9AB.6010705@cs.cmu.edu> References: <4A21B9AB.6010705@cs.cmu.edu> Message-ID: <459f38470906011244r296a3745i73550d6e24d3f924@mail.gmail.com> By "junk", do you mean the funny-looking stuff after the header? That stuff (probably) isn't junk. It is the compressed file format that puts the "fast" in fds. 64 bit should not be a problem with fds code, nor should endianness if I recall correctly. Intel and Alpha machines had different word size and endianness, but we were (I believe) using fds on both a long time ago. I'm not sure if the fds file from one worked on the other, but I think it at least worked to save and load fds on a 32 or 64 bit little or big endian machine. Paul On Sat, May 30, 2009 at 3:56 PM, Purnamrita Sarkar wrote: > Hi all, > > I am having some problems with saving a datset in fds (fast datset) > format and loading it again. Right now the fds file (attached) has some > junk in it. Could this be because I am running my code on a 64-bit machine? > > This is a snippet of code where I save it, > ----------------- > ds = ds_load_assuming_attr_types_and_number(filename,"x1/s x2/s x3/r x4/s"); > > ds_save(filename_fds,ds); > ----------------- > > I would really appreciate any ideas/help :) > > thanks! > Purna > > AUTONFastFileFormat Version 1 > x1 x2 x3 x4 > symbolic ?x1 values: alison_white amarjit_s._bahl colm_malone david_p._currier dikran_s._meliksetian ioane_toke irwin_boutboul jean-luc_lepesant jean-pierre_prost jean-yves_girard_0002 john_f._hague kevin_m._kassab moon_j._kim paul_manesco pub-157366 pub-158694 pub-180141 pub-383049 pub-453358 pub-518819 pub-535113 pub-667253 pub-737106 richard_treumann sebastien_fibra > symbolic ?x2 values: alice_e._koniges alison_white amarjit_s._bahl bin_jia colm_malone david_p._currier dikran_s._meliksetian george_a._mihaila ioane_toke irwin_boutboul jean-luc_lepesant jean-pierre_prost jean-yves_girard_0002 john_f._hague kevin_m._kassab moon_j._kim nianjun_zhou nicholas_k._allsopp paul_manesco pub-157366 pub-158694 pub-180141 pub-187842 pub-220172 pub-270914 pub-272278 pub-322300 pub-383049 pub-452781 pub-453358 pub-470228 pub-470229 pub-518819 pub-535113 pub-627239 pub-667166 pub-667253 pub-737106 pub-760894 pub-802762 pub-834229 pub-834231 pub-848316 pub-852748 pub-855698 richard_hedges richard_treumann sebastien_fibra > real ?x3 > symbolic ?x4 values: abdulaziz_s._almazyad ahmed_ghouse amarjit_s._bahl arthur_lent dimitri_reading-picopoulos g._g._zhang luigi_brochard simon_j._cox terry_jones themis_palpanas yarsun_hsu ye_wu > rows = 80 > pivec fast size 80 max_value 24 > X1'C!!!1)%#B!1)%#B!9+%#B!A1)UR!E1)%#"Y;MF+"]?PHT")D2)]"-H3J5_5J5[=_8LV;N_ at NV; > N_H"Q*__ > end pivec fast > pivec fast NULL > pivec fast size 80 max_value 47 > X13373"YF>:6"1+'#_"IGC?;_1#ORO_IB2.2_1/#WR"52/2O"!%VM1_9YWO%!-!QA]!H9YWO!$>9! > N!H951)!)ZQMI!1W2&]_ > end pivec fast > pivec fast NULL > pvector fast size 80 > !!!!`!!!!!`!!!!A`!!!!A`!!!!A`!J$0=^!J$0=^!J$0=^!J$0=^!J$0=^!J$0=^!J$0=^!J$0= > ^!J$0=^!J$0=^!J$0=^!J$0=^!J$0=^!J$0=^!J$0=^!J$0=^!J$0=^!!!!A`!!!!!`!!!!!`!!! > !A`!KYYY^!KYYY^!KYYY^!KYYY^!KYYY^!KYYY^!KYYY^!KYYY^!KYYY^!!!!!`!!!!!`!!!!A`! > !!!A`!!!!A`!!!!A`!@KKK_!@KKK_!@KKK_!.T-4_!.T-4_!.T-4_!.T-4_!.T-4_!!!!!`!!!!! > `!!!!!`!!!!!`!.T-4_!.T-4_!.T-4_!.T-4_!.T-4_!!!!A_!!!!A_!!!!A_!!!!A_!@KKK_!@K > KK_!@KKK_!.[CO^!.[CO^!.[CO^!.[CO^!.[CO^!.[CO^!.[CO^!.[CO^!.[CO^!.[CO^!.[CO^! > !!!A`!!!!!`!!!!!`!!!!A`! > end pvector fast > pivec fast NULL > pivec fast size 80 max_value 11 > X1)C)C!F%C!!!C!!!1!S-G)C!C)C)K!I)Y*C!SCC)C!J1C)#_C)C)#"C)C)C! > end pivec fast > pivec fast NULL > > _______________________________________________ > Research mailing list > Research at autonlab.org > https://www.autonlab.org/mailman/listinfo/research > > From sabhnani at cs.cmu.edu Mon Jun 1 15:49:32 2009 From: sabhnani at cs.cmu.edu (Robin Sabhnani) Date: Mon, 1 Jun 2009 15:49:32 -0400 (EDT) Subject: [Research] Using the .fds file format In-Reply-To: <459f38470906011244r296a3745i73550d6e24d3f924@mail.gmail.com> References: <4A21B9AB.6010705@cs.cmu.edu> <459f38470906011244r296a3745i73550d6e24d3f924@mail.gmail.com> Message-ID: <44587.128.2.181.158.1243885772.squirrel@webmail.cs.cmu.edu> on the first glance the file looks good to me. i am working on 64-bit machine and never faced any such problems. i think you have one of the special characters in the attribute values that our fds system does not like. stop by my office and we can have a look at your file. if i am not around any research programmer must be able to help you debug it. robin On Mon, June 1, 2009 3:44 pm, Paul Komarek wrote: > By "junk", do you mean the funny-looking stuff after the header? That > stuff (probably) isn't junk. It is the compressed file format that puts > the "fast" in fds. > > 64 bit should not be a problem with fds code, nor should endianness if > I recall correctly. Intel and Alpha machines had different word size > and endianness, but we were (I believe) using fds on both a long time ago. > I'm not sure if the fds file from one worked on the other, but I > think it at least worked to save and load fds on a 32 or 64 bit little or > big endian machine. > > Paul > > > On Sat, May 30, 2009 at 3:56 PM, Purnamrita Sarkar > wrote: > >> Hi all, >> >> >> I am having some problems with saving a datset in fds (fast datset) >> format and loading it again. Right now the fds file (attached) has some >> junk in it. Could this be because I am running my code on a 64-bit >> machine? >> >> This is a snippet of code where I save it, >> ----------------- >> ds = ds_load_assuming_attr_types_and_number(filename,"x1/s x2/s x3/r >> x4/s"); >> >> ds_save(filename_fds,ds); ----------------- >> >> >> I would really appreciate any ideas/help :) >> >> >> thanks! Purna >> >> >> AUTONFastFileFormat Version 1 >> x1 x2 x3 x4 symbolic ?x1 values: alison_white amarjit_s._bahl colm_malone >> david_p._currier dikran_s._meliksetian ioane_toke irwin_boutboul >> jean-luc_lepesant jean-pierre_prost jean-yves_girard_0002 john_f._hague >> kevin_m._kassab moon_j._kim paul_manesco pub-157366 pub-158694 >> pub-180141 pub-383049 pub-453358 pub-518819 pub-535113 pub-667253 >> pub-737106 richard_treumann sebastien_fibra symbolic ?x2 values: >> alice_e._koniges alison_white amarjit_s._bahl bin_jia colm_malone >> david_p._currier dikran_s._meliksetian george_a._mihaila ioane_toke >> irwin_boutboul jean-luc_lepesant jean-pierre_prost >> jean-yves_girard_0002 john_f._hague kevin_m._kassab moon_j._kim >> nianjun_zhou nicholas_k._allsopp paul_manesco pub-157366 pub-158694 >> pub-180141 pub-187842 pub-220172 pub-270914 pub-272278 pub-322300 >> pub-383049 pub-452781 pub-453358 pub-470228 pub-470229 pub-518819 >> pub-535113 pub-627239 pub-667166 pub-667253 pub-737106 pub-760894 >> pub-802762 pub-834229 pub-834231 pub-848316 pub-852748 pub-855698 >> richard_hedges richard_treumann sebastien_fibra real ?x3 symbolic ?x4 >> values: abdulaziz_s._almazyad ahmed_ghouse amarjit_s._bahl arthur_lent >> dimitri_reading-picopoulos g._g._zhang luigi_brochard simon_j._cox >> terry_jones themis_palpanas yarsun_hsu ye_wu rows = 80 pivec fast size 80 >> max_value 24 >> X1'C!!!1)%#B!1)%#B!9+%#B!A1)UR!E1)%#"Y;MF+"]?PHT")D2)]"-H3J5_5J5[=_8LV; >> N_ at NV; >> N_H"Q*__ >> end pivec fast pivec fast NULL pivec fast size 80 max_value 47 >> X13373"YF>:6"1+'#_"IGC?;_1#ORO_IB2.2_1/#WR"52/2O"!%VM1_9YWO%!-!QA]!H9YW >> O!$>9! >> N!H951)!)ZQMI!1W2&]_ >> end pivec fast pivec fast NULL pvector fast size 80 >> !!!!`!!!!!`!!!!A`!!!!A`!!!!A`!J$0=^!J$0=^!J$0=^!J$0=^!J$0=^!J$0=^!J$0=^ >> !J$0= >> ^!J$0=^!J$0=^!J$0=^!J$0=^!J$0=^!J$0=^!J$0=^!J$0=^!J$0=^!!!!A`!!!!!`!!!!! >> `!!! >> !A`!KYYY^!KYYY^!KYYY^!KYYY^!KYYY^!KYYY^!KYYY^!KYYY^!KYYY^!!!!!`!!!!!`!!! >> !A`! >> !!!A`!!!!A`!!!!A`!@KKK_!@KKK_!@KKK_!.T-4_!.T-4_!.T-4_!.T-4_!.T-4_!!!!!`! >> !!!! >> `!!!!!`!!!!!`!.T-4_!.T-4_!.T-4_!.T-4_!.T-4_!!!!A_!!!!A_!!!!A_!!!!A_!@KKK >> _!@K >> KK_!@KKK_!.[CO^!.[CO^!.[CO^!.[CO^!.[CO^!.[CO^!.[CO^!.[CO^!.[CO^!.[CO^!.[ >> CO^! >> !!!A`!!!!!`!!!!!`!!!!A`! >> end pvector fast pivec fast NULL pivec fast size 80 max_value 11 >> X1)C)C!F%C!!!C!!!1!S-G)C!C)C)K!I)Y*C!SCC)C!J1C)#_C)C)#"C)C)C! >> end pivec fast pivec fast NULL >> >> _______________________________________________ >> Research mailing list >> Research at autonlab.org >> https://www.autonlab.org/mailman/listinfo/research >> >> >> > _______________________________________________ > Research mailing list > Research at autonlab.org > https://www.autonlab.org/mailman/listinfo/research > > > -- Robin Sabhnani Machine Learning PhD student From mjbaysek at cs.cmu.edu Mon Jun 1 16:23:42 2009 From: mjbaysek at cs.cmu.edu (Michael J. Baysek) Date: Mon, 01 Jun 2009 16:23:42 -0400 Subject: [Research] Using the .fds file format In-Reply-To: <44587.128.2.181.158.1243885772.squirrel@webmail.cs.cmu.edu> References: <4A21B9AB.6010705@cs.cmu.edu> <459f38470906011244r296a3745i73550d6e24d3f924@mail.gmail.com> <44587.128.2.181.158.1243885772.squirrel@webmail.cs.cmu.edu> Message-ID: <4A2438CE.2070702@cs.cmu.edu> Purna, I thought we got this problem resolved with mk_ds_load_assuming, no? -- Michael J. Baysek, Systems Analyst Carnegie Mellon University - Auton Lab www.cmu.edu - www.autonlab.org 412-268-8939 Robin Sabhnani wrote, On 06/01/2009 03:49 PM: > on the first glance the file looks good to me. i am working on 64-bit > machine and never faced any such problems. i think you have one of the > special characters in the attribute values that our fds system does not > like. stop by my office and we can have a look at your file. if i am not > around any research programmer must be able to help you debug it. > > robin > > > On Mon, June 1, 2009 3:44 pm, Paul Komarek wrote: > >> By "junk", do you mean the funny-looking stuff after the header? That >> stuff (probably) isn't junk. It is the compressed file format that puts >> the "fast" in fds. >> >> 64 bit should not be a problem with fds code, nor should endianness if >> I recall correctly. Intel and Alpha machines had different word size >> and endianness, but we were (I believe) using fds on both a long time ago. >> I'm not sure if the fds file from one worked on the other, but I >> think it at least worked to save and load fds on a 32 or 64 bit little or >> big endian machine. >> >> Paul >> >> >> On Sat, May 30, 2009 at 3:56 PM, Purnamrita Sarkar >> wrote: >> >> >>> Hi all, >>> >>> >>> I am having some problems with saving a datset in fds (fast datset) >>> format and loading it again. Right now the fds file (attached) has some >>> junk in it. Could this be because I am running my code on a 64-bit >>> machine? >>> >>> This is a snippet of code where I save it, >>> ----------------- >>> ds = ds_load_assuming_attr_types_and_number(filename,"x1/s x2/s x3/r >>> x4/s"); >>> >>> ds_save(filename_fds,ds); ----------------- >>> >>> >>> I would really appreciate any ideas/help :) >>> >>> >>> thanks! Purna >>> >>> >>> AUTONFastFileFormat Version 1 >>> x1 x2 x3 x4 symbolic x1 values: alison_white amarjit_s._bahl colm_malone >>> david_p._currier dikran_s._meliksetian ioane_toke irwin_boutboul >>> jean-luc_lepesant jean-pierre_prost jean-yves_girard_0002 john_f._hague >>> kevin_m._kassab moon_j._kim paul_manesco pub-157366 pub-158694 >>> pub-180141 pub-383049 pub-453358 pub-518819 pub-535113 pub-667253 >>> pub-737106 richard_treumann sebastien_fibra symbolic x2 values: >>> alice_e._koniges alison_white amarjit_s._bahl bin_jia colm_malone >>> david_p._currier dikran_s._meliksetian george_a._mihaila ioane_toke >>> irwin_boutboul jean-luc_lepesant jean-pierre_prost >>> jean-yves_girard_0002 john_f._hague kevin_m._kassab moon_j._kim >>> nianjun_zhou nicholas_k._allsopp paul_manesco pub-157366 pub-158694 >>> pub-180141 pub-187842 pub-220172 pub-270914 pub-272278 pub-322300 >>> pub-383049 pub-452781 pub-453358 pub-470228 pub-470229 pub-518819 >>> pub-535113 pub-627239 pub-667166 pub-667253 pub-737106 pub-760894 >>> pub-802762 pub-834229 pub-834231 pub-848316 pub-852748 pub-855698 >>> richard_hedges richard_treumann sebastien_fibra real x3 symbolic x4 >>> values: abdulaziz_s._almazyad ahmed_ghouse amarjit_s._bahl arthur_lent >>> dimitri_reading-picopoulos g._g._zhang luigi_brochard simon_j._cox >>> terry_jones themis_palpanas yarsun_hsu ye_wu rows = 80 pivec fast size 80 >>> max_value 24 >>> X1'C!!!1)%#B!1)%#B!9+%#B!A1)UR!E1)%#"Y;MF+"]?PHT")D2)]"-H3J5_5J5[=_8LV; >>> N_ at NV; >>> N_H"Q*__ >>> end pivec fast pivec fast NULL pivec fast size 80 max_value 47 >>> X13373"YF>:6"1+'#_"IGC?;_1#ORO_IB2.2_1/#WR"52/2O"!%VM1_9YWO%!-!QA]!H9YW >>> O!$>9! >>> N!H951)!)ZQMI!1W2&]_ >>> end pivec fast pivec fast NULL pvector fast size 80 >>> !!!!`!!!!!`!!!!A`!!!!A`!!!!A`!J$0=^!J$0=^!J$0=^!J$0=^!J$0=^!J$0=^!J$0=^ >>> !J$0= >>> ^!J$0=^!J$0=^!J$0=^!J$0=^!J$0=^!J$0=^!J$0=^!J$0=^!J$0=^!!!!A`!!!!!`!!!!! >>> `!!! >>> !A`!KYYY^!KYYY^!KYYY^!KYYY^!KYYY^!KYYY^!KYYY^!KYYY^!KYYY^!!!!!`!!!!!`!!! >>> !A`! >>> !!!A`!!!!A`!!!!A`!@KKK_!@KKK_!@KKK_!.T-4_!.T-4_!.T-4_!.T-4_!.T-4_!!!!!`! >>> !!!! >>> `!!!!!`!!!!!`!.T-4_!.T-4_!.T-4_!.T-4_!.T-4_!!!!A_!!!!A_!!!!A_!!!!A_!@KKK >>> _!@K >>> KK_!@KKK_!.[CO^!.[CO^!.[CO^!.[CO^!.[CO^!.[CO^!.[CO^!.[CO^!.[CO^!.[CO^!.[ >>> CO^! >>> !!!A`!!!!!`!!!!!`!!!!A`! >>> end pvector fast pivec fast NULL pivec fast size 80 max_value 11 >>> X1)C)C!F%C!!!C!!!1!S-G)C!C)C)K!I)Y*C!SCC)C!J1C)#_C)C)#"C)C)C! >>> end pivec fast pivec fast NULL >>> >>> _______________________________________________ >>> Research mailing list >>> Research at autonlab.org >>> https://www.autonlab.org/mailman/listinfo/research >>> >>> >>> >>> >> _______________________________________________ >> Research mailing list >> Research at autonlab.org >> https://www.autonlab.org/mailman/listinfo/research >> >> >> >> > > > From awd at cs.cmu.edu Thu Jun 18 08:05:16 2009 From: awd at cs.cmu.edu (Artur Dubrawski) Date: Thu, 18 Jun 2009 08:05:16 -0400 Subject: [Research] no power in NSH today Message-ID: <4A3A2D7C.3030206@cs.cmu.edu> Dear Autonians, Those of us whose offices are in Newell-Simon Hall will have to work from home today. The power is down due to flooding due to the storm last night. See you on Friday. Artur