Re: [Pytables-users] Histogramming 1000x too slow

2012-11-17 Thread Francesc Alted
On 11/16/12 6:02 PM, Jon Wilson wrote: > Hi all, > I am trying to find the best way to make histograms from large data > sets. Up to now, I've been just loading entire columns into in-memory > numpy arrays and making histograms from those. However, I'm currently > working on a handful of datasets

Re: [Pytables-users] Histogramming 1000x too slow

2012-11-17 Thread David Wilson
I've been using (and recommend) Pandas http://pandas.pydata.org/ along with this book: http://www.google.com/url?sa=t&rct=j&q=&esrc=s&source=web&cd=1&ved=0CDIQFjAA&url=http%3A%2F%2Fshop.oreilly.com%2Fproduct%2F0636920023784.do&ei=GfSnUJSbGqm5ywH7poCwDA&usg=AFQjCNEJuio5DbubgyNQR4Tp9iM1RClZHA Good

Re: [Pytables-users] Histogramming 1000x too slow

2012-11-17 Thread Anthony Scopatz
On Fri, Nov 16, 2012 at 7:33 PM, Jon Wilson wrote: > Hi Anthony, > I don't think that either of these help me here (unless I've misunderstood > something). I need to fill the histogram with every row in the table, so > querying doesn't gain me anything. (especially since the query just returns >