Hi Petr, I know I've said this before and I'm not sure how first-class this is in C# (you probably will have to drop to the c-api) but packet tables do this. They keep the table api backend open so you can keep appending but otherwise are just another table (existing tools will treat it as a normal HDF5 table dataset).
-Jason On Mon, Aug 10, 2015 at 12:09 PM, Petr KLAPKA <[email protected]> wrote: > Hello all, > > Now that I'm able to write types of pretty much unlimited complexity into > the HDF5 files, the next step is writing additional elements of data to > existing datasets. > > I'll go diving through the manuals again, but if anyone has a "quick start > guide" link for how to create a dataset and append to (stream to) it > throughout the life of the application, I'd be most grateful. > > My next goal is to add elements to the "myMajorCycles" dataset that is > pictured below with just a single element. I need to accomplish this in a > way where the dataset is kept open and can accept new data as it comes in, > but it must not remain completely in memory because the final dataset on > disk will be ~2GB. > > D:\Programs\HDF5Utils>h5dump c:\temp\myfirstfile.h5 > HDF5 "c:\temp\myfirstfile.h5" { > GROUP "/" { > DATASET "myMajorCycles" { > DATATYPE H5T_COMPOUND { > H5T_STD_U32LE "UniqueID"; > H5T_STD_U32LE "MsgCount"; > H5T_ARRAY { [5] H5T_COMPOUND { > H5T_STD_U32LE "MsgID"; > H5T_STD_U64LE "MsgHWTimestamp"; > H5T_STD_U32LE "MsgLengthBytes"; > H5T_ARRAY { [8] H5T_STD_U8LE } "MsgBody"; > } } "Messages"; > } > DATASPACE SIMPLE { ( 1 ) / ( 1 ) } > DATA { > (0): { > 23, > 5, > [ { > 10, > 18446744073709551615, > 8, > [ 0, 1, 2, 3, 4, 5, 6, 7 ] > }, > { > 11, > 18446744073709551615, > 8, > [ 10, 11, 12, 13, 14, 15, 16, 17 ] > }, > { > 12, > 18446744073709551615, > 8, > [ 20, 21, 22, 23, 24, 25, 26, 27 ] > }, > { > 13, > 18446744073709551615, > 8, > [ 30, 31, 32, 33, 34, 35, 36, 37 ] > }, > { > 14, > 18446744073709551615, > 8, > [ 40, 41, 42, 43, 44, 45, 46, 47 ] > } ] > } > } > } > } > } > > Many thanks! > > > Best regards, > > Petr Klapka > System Tools Engineer > *Valeo* Radar Systems > 46 River Rd > Hudson, NH 03051 > Mobile: (603) 921-4440 > Office: (603) 578-8045 > *"Festina lente."* > > > *This e-mail message is intended only for the use of the intended > recipient(s). > The information contained therein may be confidential or privileged, > and its disclosure or reproduction is strictly prohibited. > If you are not the intended recipient, please return it immediately to its > sender > at the above address and destroy it. * > > > _______________________________________________ > Hdf-forum is for HDF software users discussion. > [email protected] > http://lists.hdfgroup.org/mailman/listinfo/hdf-forum_lists.hdfgroup.org > Twitter: https://twitter.com/hdf5 >
_______________________________________________ Hdf-forum is for HDF software users discussion. [email protected] http://lists.hdfgroup.org/mailman/listinfo/hdf-forum_lists.hdfgroup.org Twitter: https://twitter.com/hdf5
