Re: [Pytables-users] Clear chunks from CArray

2013-08-06 Thread Giovanni Luca Ciampaglia
hi Anthony and Antonio, thanks for the explanations. I was hoping I could do it programmatically, but if it is an inherent limitation of HDF5 there is little I can do. Compression plus a sensible chunk size should help though. Best, Giovanni On 08/06/2013 04:11 AM, pytables-users-requ...@lis

Re: [Pytables-users] Clear chunks from CArray

2013-08-06 Thread Anthony Scopatz
Hi Antonio, Now that you mention it I think that you are right that there is no way to remove a chunk from an existing data set. If you think about this it makes a lot of sense since you would have to alter the B-tree in strange and unfortunate way. So HDF5 doesn't even try. However, you can fa

Re: [Pytables-users] Clear chunks from CArray

2013-08-05 Thread Antonio Valentino
Hi Anthony, hi Giovanni, Il giorno 06/ago/2013, alle ore 00:45, Anthony Scopatz ha scritto: > > On Mon, Aug 5, 2013 at 3:14 PM, Giovanni Luca Ciampaglia > wrote: > Hi Anthony, > > what do you mean precisely? I tried > > del ca[:,:] > > but CArray does not support __delitem__. Looking in t

Re: [Pytables-users] Clear chunks from CArray

2013-08-05 Thread Anthony Scopatz
On Mon, Aug 5, 2013 at 3:14 PM, Giovanni Luca Ciampaglia < glciamp...@gmail.com> wrote: > Hi Anthony, > > what do you mean precisely? I tried > > del ca[:,:] > > but CArray does not support __delitem__. Looking in the documentation I > could > only find a method called remove_rows, but it's in Tab

Re: [Pytables-users] Clear chunks from CArray

2013-08-05 Thread Giovanni Luca Ciampaglia
Hi Anthony, what do you mean precisely? I tried del ca[:,:] but CArray does not support __delitem__. Looking in the documentation I could only find a method called remove_rows, but it's in Table, not CArray. Maybe I am missing something? Thank, Giovanni On Mon 05 Aug 2013 03:43:42 PM EDT,

Re: [Pytables-users] Clear chunks from CArray

2013-08-05 Thread Anthony Scopatz
Hello Giovanni, I think you may need to del that slice and then possibly repack. Hope this helps. Be Well Anthony On Mon, Aug 5, 2013 at 2:09 PM, Giovanni Luca Ciampaglia < glciamp...@gmail.com> wrote: > Hello all, > > is there a way to clear out a chunk from a CArray? I noticed that setting

[Pytables-users] Clear chunks from CArray

2013-08-05 Thread Giovanni Luca Ciampaglia
Hello all, is there a way to clear out a chunk from a CArray? I noticed that setting the data to zero actually takes disk space, i.e. *** from tables import open_file, BoolAtom h5f = open_file('test.h5', 'w') ca = h5f.create_carray(h5f.root, 'carray', BoolAtom(), shape=(1000,1000), chunkshape=