Re: [GENERAL] Load testing across 2 machines

2006-04-10 Thread Richard Huxton

Gavin Hamill wrote:

On Sun, 09 Apr 2006 17:00:14 +0100
Simon Riggs <[EMAIL PROTECTED]> wrote:


Sniff the live log for SELECT statements (plus their live durations),


Wow, how wonderfully low-tech - hence it's right up my street :) Yay,
some tail + psql fun coming up!


Be careful though - concurrency issues mean queries might not be 
returning the same results, so not taking the same time anyway. Should 
work nicely for load-testing though.


--
  Richard Huxton
  Archonet Ltd

---(end of broadcast)---
TIP 9: In versions below 8.0, the planner will ignore your desire to
  choose an index scan if your joining column's datatypes do not
  match


Re: [GENERAL] Load testing across 2 machines

2006-04-09 Thread Gavin Hamill
On Sun, 09 Apr 2006 17:00:14 +0100
Simon Riggs <[EMAIL PROTECTED]> wrote:

> On Sat, 2006-04-08 at 15:10 +0100, Gavin Hamill wrote:
> 
> > SELECTS go to *both* live and test, but only the answers from live
> > are sent back to clients - the answers from test are discarded... 
> 
> Put log_min_duration_statement = 0 so all SELECTs go to the log.
> 
> Sniff the live log for SELECT statements (plus their live durations),
> then route those same statements to the dev box and get a timing from
> there also. That way you'll be able to do this without any C coding,
> plus you'll have both the live and test elapsed times as a comparison.

Ah, having eaten and had my brain finally switch on, I've realised that
there's an unfortunate flaw in the plan; only a single process will be
executing the SELECT-log which pretty much defeats the purpose of the
experiment to simulate identical load patterns on both machines.

I might be wrong, but if I just end up grepping for 'SELECT' then
feeding the results into psql, then only a single connection will be
made to the test server, and all queries will be processed serially on
a single CPU, no?

Cheers,
Gavin.

---(end of broadcast)---
TIP 5: don't forget to increase your free space map settings


Re: [GENERAL] Load testing across 2 machines

2006-04-09 Thread Joshua D. Drake

Gavin Hamill wrote:

On Sun, 09 Apr 2006 17:00:14 +0100
Simon Riggs <[EMAIL PROTECTED]> wrote:


Sniff the live log for SELECT statements (plus their live durations),


Wow, how wonderfully low-tech - hence it's right up my street :) Yay,
some tail + psql fun coming up!


You can even tell it to only show you queries that taken longer the (n) 
where (n) is milliseconds.


Joshua D. Drake



Cheers,
Gavin.

---(end of broadcast)---
TIP 5: don't forget to increase your free space map settings




--

=== The PostgreSQL Company: Command Prompt, Inc. ===
  Sales/Support: +1.503.667.4564 || 24x7/Emergency: +1.800.492.2240
  Providing the most comprehensive  PostgreSQL solutions since 1997
 http://www.commandprompt.com/



---(end of broadcast)---
TIP 9: In versions below 8.0, the planner will ignore your desire to
  choose an index scan if your joining column's datatypes do not
  match


Re: [GENERAL] Load testing across 2 machines

2006-04-09 Thread Gavin Hamill
On Sun, 09 Apr 2006 17:00:14 +0100
Simon Riggs <[EMAIL PROTECTED]> wrote:

> Sniff the live log for SELECT statements (plus their live durations),

Wow, how wonderfully low-tech - hence it's right up my street :) Yay,
some tail + psql fun coming up!

Cheers,
Gavin.

---(end of broadcast)---
TIP 5: don't forget to increase your free space map settings


Re: [GENERAL] Load testing across 2 machines

2006-04-09 Thread Simon Riggs
On Sat, 2006-04-08 at 15:10 +0100, Gavin Hamill wrote:

> SELECTS go to *both* live and test, but only the answers from live are
> sent back to clients - the answers from test are discarded... 

Put log_min_duration_statement = 0 so all SELECTs go to the log.

Sniff the live log for SELECT statements (plus their live durations),
then route those same statements to the dev box and get a timing from
there also. That way you'll be able to do this without any C coding,
plus you'll have both the live and test elapsed times as a comparison.

Best Regards, Simon Riggs


---(end of broadcast)---
TIP 1: if posting/reading through Usenet, please send an appropriate
   subscribe-nomail command to [EMAIL PROTECTED] so that your
   message can get through to the mailing list cleanly