On 06/12/13 11:58, Dr. Volker Jaenisch wrote:
A year ago I wrote a prototype of an import plugin framework for HDF5-Files in
VEUSZ.
https://github.com/volkerjaenisch/veusz/tree/modular_import
I utilized the pytables framework for the plugin.
The code may be not operable for every purpose since it depends on a certain
structure of HDF5 files tailored for one of my customers,
but this can be changed easily.
This code was unfinished, untested and therfore never made its way upstream.
I would like to contribute to a project to integrate HDF5 into veusz.
Not only import but also output of HDF5 is of importance. The VEUSZ data format
is not capable of dealing with
large datasets. With the HDF5 plugin my customer was able to visualize terabyte
large HDF5 datasets, but was not capable to save them since
the veusz data format is nether binary nor packed.
Thanks Volker. I'm having a look again at your code and see whether I
can move it to the latest Veusz version and play with it. I might change
the way the modular plugins are arranged - at the moment the "commands"
which load data from documents are still not stored within the modular
framework. I think it would be nice to store everything together, except
for the ui files which may need to be stored with the others due to the
new module layout.
I didn't really understand your point about storing in HDF5 before. I
see you would like some sort of vsz hdf5 saved file. I can see that
might work. However, I can't see a nice way of storing the document tree
in HDF5 file, unless it's encoded in XML. I'll read up a bit more about
HDF5.
Jeremy
_______________________________________________
Veusz-discuss mailing list
[email protected]
https://mail.gna.org/listinfo/veusz-discuss
