Hello,

I am planning to store potentially tens of thousands of 2-D datasets along with 
their relevant attributes to an HDF5 file. Each dataset will have the same 
number of rows but different number of columns. I am rather new to HDF so I 
thought I'd ask about any potential pitfalls before diving into coding. Are 
there any memory or performance issues I should be concerned about due to the 
large number of datasets being dealt with? And what about the file size? 
Currently, the data is stored in native Fortran sequential binary file format. 
The file sizes range from tens of GBytes to over 100 GBytes depending on the 
application they are generated from. Should I expect a file size that is much 
larger than its Fortran binary counterpart or about the same size?

Any information would be greatly appreciated.

Thanks,
Jon


**************************************************
Emin C. Dogrul, Ph.D., P.E.
Water Resources Engineer
Hydrologic Models Development Unit

California Department of Water Resources Bay-Delta Office
1416 9th Street, Rm 252A
Sacramento, CA 95814

Phone: (916) 654 7018
Fax: (916) 653 6077
e-mail: can.dog...@water.ca.gov<mailto:can.dog...@water.ca.gov>
**************************************************

_______________________________________________
Hdf-forum is for HDF software users discussion.
Hdf-forum@lists.hdfgroup.org
http://lists.hdfgroup.org/mailman/listinfo/hdf-forum_lists.hdfgroup.org
Twitter: https://twitter.com/hdf5

Reply via email to