[Research] "Too many open files" error

[Purnamrita Sarkar]

Hi all,

I am running some code which needs to quickly open lots of files to load
the data in them. These are in the fast fds format. I use the ds_load()
function. The problem is that even if all open file pointers are closed
using fclose, I see an error "too many open files".

I google-d for this particular error, and apparently this is OS
specific, since every OS has an upper bound on number of open files
(ulimit -n gives 1024 for our OS). What I am not understanding is, I
_am_ closing all files the moment they are used, so no two files should
be open together.

Any ideas?
Thanks!
Purna