Re: [Pytables-users] Improving the query efficiency

2012-03-16 Thread sreeaurovindh viswanathan
Hi Anthony, Thanks for the response.But I have some difficulty in throwing everything to a single table and require your help for the same. Please consider the following : The table is in the following structure. 1) adSuggester table: trId long click int queryId long 2)query table

Re: [Pytables-users] Improving the query efficiency

2012-03-16 Thread Anthony Scopatz
Hello Sree, Sorry for the slow response. On Thu, Mar 15, 2012 at 10:56 PM, sreeaurovindh viswanathan < sreeaurovi...@gmail.com> wrote: > Hi, > > I have created five tables in a Hdf5 file.I have created index during the > creation of the file.I have about 140 million records in my postgresql > da

Re: [Pytables-users] Advice for new user

2012-03-16 Thread Alvaro Tejero Cantero
Thank you for these e-mails with so many useful tips! This is definitely a start. I will report what I find! Cheers, -รก. On Fri, Mar 16, 2012 at 15:00, Francesc Alted wrote: > On Mar 16, 2012, at 1:55 AM, Alvaro Tejero Cantero wrote: > >> Thanks Francesc, we're getting there :). >> >> Some mo

Re: [Pytables-users] Advice for new user

2012-03-16 Thread Anthony Scopatz
Hi Alvaro, I just want to second what Francesc is saying. You do have to get used to the fact that you can't do *everything* that numpy can do inside of PyTables. However, you can do the important stuff which lets you pull out only the data that you are interested in. In fact, PyTables lets you

Re: [Pytables-users] Advice for new user

2012-03-16 Thread Francesc Alted
On Mar 16, 2012, at 1:55 AM, Alvaro Tejero Cantero wrote: > Thanks Francesc, we're getting there :). > > Some more precise questions below. > >> Here it is how you can do that in PyTables: >> >> my_condition = '(col1>0.5) && (col2<24) && (col3 == "novel")' >> mycol4_values = [ r['col4'] for r i