Blosc <http://www.blosc.org> is a compression library that claims to be
faster than standard zlib. There is also a Blosc filter for HDF5 <
https://github.com/Blosc/hdf5-blosc>. The Julia language <
http://julialang.org> uses HDF5 as the "default" way to store binary data
on disk <https://github.com/JuliaLang/JLD.jl>.

It so happens that JLD uses Blosc by default; if you install JLD, then HDF5
and Blosc will both be installed automatically.

This also means that the respective HDF5 files are not readable by vanilla
HDF5 implementations, since these do not know about the Blosc filter.

Are you aware of Blosc? What are your thoughts about it -- is it worthwhile
to use it to improve compression speed? Is it feasible to include Blosc
with HDF5 by default, or to suggest to install Blosc in HDF5's install
instructions, or to include a Blosc decompressor in HDF5?

-erik

-- 
Erik Schnetter <[email protected]>
http://www.perimeterinstitute.ca/personal/eschnetter/
_______________________________________________
Hdf-forum is for HDF software users discussion.
[email protected]
http://lists.hdfgroup.org/mailman/listinfo/hdf-forum_lists.hdfgroup.org
Twitter: https://twitter.com/hdf5

Reply via email to