Hello
I store sparse data using chunked dataset, and zeros values are only
virtually stored, as non existent data. And in case of reading, these
are not read. However, avoiding to read these data may take some time to
hdf5, i suggest you to select only nonzeros data through an explicit
hyperslabs.
Mathieu
On 06/24/2012 04:28 PM, Corelli.Eileen wrote:
I want to store a 5D sparse dataset; only the nonzero values.
Chunking appears to save the whole matrix; I don't want this.
I came upon H5's Vdata interface but don't see how this helps.
Anyone have an example of storing/retrieving highly-dimensional sparse
data?
------------------------------------------------------------------------
The information contained in this email message is intended only for
the use of the individual(s) to whom it is addressed and may contain
information that is privileged and sensitive. If you are not the
intended recipient, or otherwise have received this communication in
error, please notify the sender immediately by email at the above
referenced address and note that any further dissemination,
distribution or copying of this communication is strictly prohibited.
The U.S. Export Control Laws regulate the export and re-export of
technology originating in the United States. This includes the
electronic transmission of information and software to foreign
countries and to certain foreign nationals. Recipient agrees to abide
by these laws and their regulations -- including the U.S. Department
of Commerce Export Administration Regulations and the U.S. Department
of State International Traffic in Arms Regulations -- and not to
transfer, by electronic transmission or otherwise, any content derived
from this email to either a foreign national or a foreign destination
in violation of such laws.
_______________________________________________
Hdf-forum is for HDF software users discussion.
Hdf-forum@hdfgroup.org
http://mail.hdfgroup.org/mailman/listinfo/hdf-forum_hdfgroup.org
_______________________________________________
Hdf-forum is for HDF software users discussion.
Hdf-forum@hdfgroup.org
http://mail.hdfgroup.org/mailman/listinfo/hdf-forum_hdfgroup.org