Re: [Pytables-users] Very slow access to EArrays

2008-06-17 Thread Francesc Alted
A Wednesday 18 June 2008, Glenn escrigué: > Thank you for the help, what you say makes sense. In this > application, I need to access the data both by rows and by columns in > different loops. What is the best way to optimize this? Ideally I'd > want to specify a different chunkshape for each loop,

Re: [Pytables-users] Very slow access to EArrays

2008-06-17 Thread Glenn
Thank you for the help, what you say makes sense. In this application, I need to access the data both by rows and by columns in different loops. What is the best way to optimize this? Ideally I'd want to specify a different chunkshape for each loop, but I guess that would require storing two copie

Re: [Pytables-users] Very slow access to EArrays

2008-06-17 Thread Francesc Alted
A Tuesday 17 June 2008, Glenn escrigué: > Francesc Alted pytables.com> writes: > > A Monday 16 June 2008, Glenn escrigué: > > > Hello, > > > I am storing 40 rows to an EArray as follows: > > > if grp.__contains__('normI'): > > > fh.removeNode(grp,'normI') > > > fh.createEArray(grp,'normI',Fl

Re: [Pytables-users] Very slow access to EArrays

2008-06-17 Thread Glenn
Francesc Alted pytables.com> writes: > > A Monday 16 June 2008, Glenn escrigué: > > Hello, > > I am storing 40 rows to an EArray as follows: > > if grp.__contains__('normI'): > > fh.removeNode(grp,'normI') > > fh.createEArray(grp,'normI',Float32Atom(), (0,512), > > expectedrows=80) > >

Re: [Pytables-users] Very slow access to EArrays

2008-06-17 Thread Francesc Alted
A Monday 16 June 2008, Glenn escrigué: > Hello, > I am storing 40 rows to an EArray as follows: > if grp.__contains__('normI'): > fh.removeNode(grp,'normI') > fh.createEArray(grp,'normI',Float32Atom(), (0,512), > expectedrows=80) > > ... populate 40 rows of normI array ... > > When I