The dataset creation has to be called on all ranks, not the actual writing of the array data. So all ranks should call H5Dcreate() for all the datasets, but then each rank can write to its corresponding dataset.
Alternatively, you can have 1 rank create the entire file serially, then close the file, then all other ranks open and write the raw data in parallel. Thanks, Mohamad From: Hdf-forum <[email protected]> on behalf of jaber javanshir <[email protected]> Reply-To: hdf-forum <[email protected]> Date: Tuesday, August 30, 2016 at 4:21 PM To: hdf-forum <[email protected]> Subject: [Hdf-forum] Parallel I/O with HDF5 Hi All, Hopa all is well. I am trying to use hdf5 parallel feature for extreme scale computing. I would like each processor write out a dseparate dataset. This question is actually mentioned on the HDF5 website. Due to the collective call every processor has to call the same data set. https://www.hdfgroup.org/HDF5/faq/parallel.html How do you write to a single file in parallel in which different processes write to separate datasets?Please advise on this matter. The answer is not satisfying for the extreme scale computing where hundreds of thousand cores are involved. Is there and better way of overcoming this issue? Your advise on this issue is greatly appreciated Thanks Dr J
_______________________________________________ Hdf-forum is for HDF software users discussion. [email protected] http://lists.hdfgroup.org/mailman/listinfo/hdf-forum_lists.hdfgroup.org Twitter: https://twitter.com/hdf5
