Hi, AFAIK, the issue is that if you create a new dataset in the file, all ranks have to know about it (I think it seems obvious why). I don't think there is a file format that can solve this issue. The best idea is still to use different files if you are not writing in the same dataset!
Cheers, Matthieu 2016-08-30 22:21 GMT+01:00 jaber javanshir <[email protected]>: > Hi All, > > Hopa all is well. > > I am trying to use hdf5 parallel feature for extreme scale computing. > I would like each processor write out a dseparate dataset. > This question is actually mentioned on the HDF5 website. > Due to the collective call every processor has to call the same data set. > > https://www.hdfgroup.org/HDF5/faq/parallel.html How do you write to a > single file in parallel in which different processes write to separate > datasets?Please advise on this matter. > > The answer is not satisfying for the extreme scale computing where > hundreds of thousand cores are involved. > > Is there and better way of overcoming this issue? > > Your advise on this issue is greatly appreciated > > Thanks > > Dr J > > _______________________________________________ > Hdf-forum is for HDF software users discussion. > [email protected] > http://lists.hdfgroup.org/mailman/listinfo/hdf-forum_lists.hdfgroup.org > Twitter: https://twitter.com/hdf5 > -- Information System Engineer, Ph.D. Blog: http://blog.audio-tk.com/ LinkedIn: http://www.linkedin.com/in/matthieubrucher
_______________________________________________ Hdf-forum is for HDF software users discussion. [email protected] http://lists.hdfgroup.org/mailman/listinfo/hdf-forum_lists.hdfgroup.org Twitter: https://twitter.com/hdf5
