Lisandro Dalcin wrote: > On 5 May 2010 14:08, Dag Sverre Seljebotn <[email protected]> wrote: >> Also, going offtopic for the benefit of anyone who might struggle with >> the fcntl module: >> >> flock is bad. lockf is good. At least in the context of programming on a >> cluster. (Yes, there are two of them, and I wasted some hours before I >> discovered that.) >> > > So MPI_File_xxx API's are not useful for your?
Well, if I can avoid writing at that low level I do so (and I haven't had the need yet). I prefer working with a self-annotating file format of some sort, either HDF5 or FITS. HDF5 does support MPI-IO, but the available Python wrappers doesn't follow through currently... Luckily my applications are not anywhere close to be filesystem IO bound. Locking with lockf then opening the file using h5py or PyTables is convenient for some isolated purposes (but the occasions IO is needed must be few, or else the processes will just sit and wait for locks...). -- Dag Sverre _______________________________________________ Cython-dev mailing list [email protected] http://codespeak.net/mailman/listinfo/cython-dev
