Jason Newton <[email protected]> wrote: > For the 2nd/third issue, take a look at the packet table api for some > reduction on the overhead of extending to a table, boeing made it to > address some data acquisition rates they needed. It is fairly similar but > is in another library in the distribution and not quite a first/2nd class > citizen although it needs to get there IMO along with more guarantees about > atomicity. It builds on the private table api backing H5TB but optimizes > for data acquisition use case (packet io).
I just tried packet table, and it was also terribly slow. As for batching writes, my hope was to use H5TB as the in-memory representation. If I have to create a data structure to store the table before I give it to H5TB, I will just use that data structure instead. Thanks, Walter Landry _______________________________________________ Hdf-forum is for HDF software users discussion. [email protected] http://mail.lists.hdfgroup.org/mailman/listinfo/hdf-forum_lists.hdfgroup.org Twitter: https://twitter.com/hdf5
