[Research] "Too many open files" error

Michael J. Baysek mjbaysek at cs.cmu.edu
Sun Oct 25 13:23:05 EDT 2009


It looks like there were bugs introduced into dsut.c back in July that 
caused this problem.  The bug was triggered if you were loading lots and 
lots of datsets within your program.

Anyway, we figured it out.  Purna is committing the fix.  Everyone 
should update your dset directory.

-Mike

On 10/25/09 12:03 PM, Purnamrita Sarkar wrote:
> Hi all,
>
> I am running some code which needs to quickly open lots of files to load
> the data in them. These are in the fast fds format. I use the ds_load()
> function. The problem is that even if all open file pointers are closed
> using fclose, I see an error "too many open files".
>
> I google-d for this particular error, and apparently this is OS
> specific, since every OS has an upper bound on number of open files
> (ulimit -n gives 1024 for our OS). What I am not understanding is, I
> _am_ closing all files the moment they are used, so no two files should
> be open together.
>
> Any ideas?
> Thanks!
> Purna
> _______________________________________________
> Research mailing list
> Research at autonlab.org
> https://www.autonlab.org/mailman/listinfo/research
>
>    



More information about the Autonlab-research mailing list