Hi all, the HDF5 documentation states that H5Dopen may be called independently if the target object is not modified. What exactly is the definition of a modification in that case? Does writing to the data set count or is it only resizing/attribute setting/...
Our application has to write in parallel to on the order order of 1 million independent data sets in a single file. We currently do it by creating the file up-front and closing it again. Each rank then opens only the data sets he wants to write to and does its thing. Note that at this point only the actual data values change - everything else is already in the file. At least this is what we would like to do - currently we have to call H5Dopen for all datasets on each rank to get it to work correctly. Interestingly enough it also appears to work if each rank opens exactly the same number of data sets. Can H5Dopen() work in this way? If not: can you advise us on the fastest way of writing 1 million separate data sets in parallel on many cores? All the best and thanks! Lion _______________________________________________ Hdf-forum is for HDF software users discussion. [email protected] http://lists.hdfgroup.org/mailman/listinfo/hdf-forum_lists.hdfgroup.org Twitter: https://twitter.com/hdf5
