Re: [Pytables-users] Basic question

2009-05-22 Thread Dav Clark
On May 21, 2009, at 5:54 PM, David Warde-Farley wrote: > On 21-May-09, at 8:21 PM, Dav Clark wrote: > >> for i in range(1): >> f.createArray('/', 'array%d' % i, >> np.random.random(np.random.random_integers(10))) > > I may be wrong but I don't think the basic Array type has any > support

Re: [Pytables-users] Basic question

2009-05-22 Thread David Warde-Farley
On 21-May-09, at 8:21 PM, Dav Clark wrote: > for i in range(1): >f.createArray('/', 'array%d' % i, > np.random.random(np.random.random_integers(10))) Hey Dav, I may be wrong but I don't think the basic Array type has any support whatsoever for compression. You'd want to go with CArra

Re: [Pytables-users] Basic question

2009-05-22 Thread Francesc Alted
A Friday 22 May 2009 05:10:52 Dav Clark escrigué: > You need to be a little careful reading the attrs off... PyTables also > keeps some stuff in there (which I'm guessing you don't want!). The > user attribute names are in attrs._v_attrnamesuser if your program > doesn't know what to expect ahead

Re: [Pytables-users] Basic question

2009-05-21 Thread Dav Clark
All arrays have metadata. You can set it like so (f is a pytables file): annotated = f.createArray('/', 'annotated', [1,2,3]) annotated.attrs.name = 'Spam' annotated.attrs.really = True annotated.attrs.frac = 0.123 Again, not as fast / indexed as a table, but if you're loading it all into m

Re: [Pytables-users] Basic question

2009-05-21 Thread Dav Clark
I feel like this is the same (only?) message I always send to people on the list... Have you considered simply storing each item as a separate atomic array? Then you don't need to mess with any of this VLArray stuff, or tables at all. I know it's called PyTables, but you can actually get

Re: [Pytables-users] Basic question

2009-05-21 Thread Robert Ferrell
Okay, I'm completely confused. I've gone through the docs and there are many examples, but I can't find anything as simple as I want. Maybe I'm not using the right tool? In it's simplest form, I have a large number of (name, np array) tuples. (I happen to store them in a dict, and the np

Re: [Pytables-users] Basic question

2009-05-21 Thread Robert Ferrell
On May 19, 2009, at 2:42 AM, Francesc Alted wrote: > A Tuesday 19 May 2009 05:03:48 escriguéreu: >> On May 18, 2009, at 3:06 AM, Francesc Alted wrote: >>> A Monday 18 May 2009 10:31:47 Francesc Alted escrigué: A Sunday 17 May 2009 15:31:00 Robert Ferrell escrigué: > I have an elementary

Re: [Pytables-users] Basic question

2009-05-19 Thread Francesc Alted
A Tuesday 19 May 2009 05:03:48 escriguéreu: > On May 18, 2009, at 3:06 AM, Francesc Alted wrote: > > A Monday 18 May 2009 10:31:47 Francesc Alted escrigué: > >> A Sunday 17 May 2009 15:31:00 Robert Ferrell escrigué: > >>> I have an elementary question. > >>> > >>> I have a dictionary with about 10,

Re: [Pytables-users] Basic question

2009-05-18 Thread Francesc Alted
A Monday 18 May 2009 10:31:47 Francesc Alted escrigué: > A Sunday 17 May 2009 15:31:00 Robert Ferrell escrigué: > > I have an elementary question. > > > > I have a dictionary with about 10,000 keys. The keys are (shortish) > > strings. Each value is a time series of structured arrays (record > >

Re: [Pytables-users] Basic question

2009-05-18 Thread Francesc Alted
A Sunday 17 May 2009 15:31:00 Robert Ferrell escrigué: > I have an elementary question. > > I have a dictionary with about 10,000 keys. The keys are (shortish) > strings. Each value is a time series of structured arrays (record > arrays) with 5 fields. Each value totals about 100,000 bytes, so t

[Pytables-users] Basic question

2009-05-17 Thread Robert Ferrell
I have an elementary question. I have a dictionary with about 10,000 keys. The keys are (shortish) strings. Each value is a time series of structured arrays (record arrays) with 5 fields. Each value totals about 100,000 bytes, so the total data size isn't huge, about 1GB. What would be a