Re: [GENERAL] Asking advice on speeding up a big table

2006-04-16 Thread felix-accts-pgsql
On Sat, Apr 15, 2006 at 10:31:26AM -0400, Francisco Reyes wrote: [EMAIL PROTECTED] writes: Usage is to match data from the key and val tables to fetch the data value from the sid table. What is the relation between key and val tables? Will key.id and val.id be equal? This benchmark

Re: [GENERAL] Asking advice on speeding up a big table

2006-04-15 Thread Francisco Reyes
[EMAIL PROTECTED] writes: Usage is to match data from the key and val tables to fetch the data value from the sid table. What is the relation between key and val tables? Will key.id and val.id be equal? I have never quite/fully understand the outputs of analyze, but I wonder why you have:

Re: [GENERAL] Asking advice on speeding up a big table

2006-04-15 Thread Francisco Reyes
[EMAIL PROTECTED] writes: I have made some minor changes and speeded things up to around 15-20 lookups/sec, good enough, but not exciting :-) hmm let me understand this. You went from 1 query 3 to 4 seconds to 45 to 60 queries in the same amount of time... 45 to 60 times faster.. and that

Re: [GENERAL] Asking advice on speeding up a big table

2006-04-11 Thread hubert depesz lubaczewski
On 4/10/06, [EMAIL PROTECTED] [EMAIL PROTECTED] wrote: It is, but it is only 32 msec because thequery has already run andcached the useful bits.And since I have random values, as soon as Ilook up some new values, they are cached and no longer new. according to my experiene i would vote for too

Re: [GENERAL] Asking advice on speeding up a big table

2006-04-11 Thread felix
On Tue, Apr 11, 2006 at 09:52:40AM +0200, hubert depesz lubaczewski wrote: On 4/10/06, [EMAIL PROTECTED] [EMAIL PROTECTED] wrote: What I was hoping for was some general insight from the EXPLAIN ANALYZE, that maybe extra or different indices would help, or if there is some better method for

Re: [GENERAL] Asking advice on speeding up a big table

2006-04-11 Thread Alban Hertroys
[EMAIL PROTECTED] wrote: On Tue, Apr 11, 2006 at 09:52:40AM +0200, hubert depesz lubaczewski wrote: On 4/10/06, [EMAIL PROTECTED] [EMAIL PROTECTED] wrote: What I was hoping for was some general insight from the EXPLAIN ANALYZE, that maybe extra or different indices would help, or if there

[GENERAL] Asking advice on speeding up a big table

2006-04-10 Thread felix
I have a simple benchmark which runs too slow on a 100M row table, and I am not sure what my next step is to make it faster. It's a simple setup, part of a larger system. There are three data tables, each with a BIGINT id and a data column of dofferent types. There is a fourth table with BIGINT

Re: [GENERAL] Asking advice on speeding up a big table

2006-04-10 Thread Tom Lane
[EMAIL PROTECTED] writes: I have a simple benchmark which runs too slow on a 100M row table, and I am not sure what my next step is to make it faster. The EXPLAIN ANALYZE you showed ran in 32 msec, which ought to be fast enough for anyone on that size table. You need to show us data on the

Re: [GENERAL] Asking advice on speeding up a big table

2006-04-10 Thread felix
On Mon, Apr 10, 2006 at 02:51:30AM -0400, Tom Lane wrote: [EMAIL PROTECTED] writes: I have a simple benchmark which runs too slow on a 100M row table, and I am not sure what my next step is to make it faster. The EXPLAIN ANALYZE you showed ran in 32 msec, which ought to be fast enough for