Hello, I am planning to store potentially tens of thousands of 2-D datasets along with their relevant attributes to an HDF5 file. Each dataset will have the same number of rows but different number of columns. I am rather new to HDF so I thought I'd ask about any potential pitfalls before diving into coding. Are there any memory or performance issues I should be concerned about due to the large number of datasets being dealt with? And what about the file size? Currently, the data is stored in native Fortran sequential binary file format. The file sizes range from tens of GBytes to over 100 GBytes depending on the application they are generated from. Should I expect a file size that is much larger than its Fortran binary counterpart or about the same size?
Any information would be greatly appreciated. Thanks, Jon ************************************************** Emin C. Dogrul, Ph.D., P.E. Water Resources Engineer Hydrologic Models Development Unit California Department of Water Resources Bay-Delta Office 1416 9th Street, Rm 252A Sacramento, CA 95814 Phone: (916) 654 7018 Fax: (916) 653 6077 e-mail: can.dog...@water.ca.gov<mailto:can.dog...@water.ca.gov> **************************************************
_______________________________________________ Hdf-forum is for HDF software users discussion. Hdf-forum@lists.hdfgroup.org http://lists.hdfgroup.org/mailman/listinfo/hdf-forum_lists.hdfgroup.org Twitter: https://twitter.com/hdf5