Re: [GENERAL] [OT] Slony Triggers pulling down performance?

2008-01-27 Thread Ow Mun Heng

On Fri, 2008-01-18 at 14:57 -0500, Chris Browne wrote:
 [EMAIL PROTECTED] (Ow Mun Heng) writes:
  Just wondering if my 'Perceived' feeling that since implementing slony
  for master/slave replication of select tables, my master database
  performance is getting slower.
 
  I'm constantly seeing a very high amount of IO wait. ~40-80 according to
  vmstat 1
 
  and according to atop. (hdb/hdc = raid1 mirror)
  DSK | hdb | busy 83% | read1052 | write 50 | avio7 
  ms |
  DSK | hdc | busy 81% | read1248 | write 49 | avio6 
  ms |
 
 The triggers generate some extra I/O, as they go off and write tuples
 into sl_log_1/sl_log_2, so there's certainly a cost, there.
 
 When you pull data from sl_log_1/sl_log_2, that will have a cost, too.
 
 Replication does not come at zero cost...


I've been battling with this issus for the past week and that prompted a
few changes in the manner I pull the data and in the location where i
store the data. I ended up implementing partitioning on the 2 main
largest (problematic) tables and put it intp weekly rotation and moved
the broke the 3 disk raid1(1 spare) spare disk and used that as the
slony-I sl_log_1/sl_log_2 tablespace. 

Now, everything is back to normal. (until I break it again!!) IO Wait is
hovering between 0-40%

---(end of broadcast)---
TIP 4: Have you searched our list archives?

   http://archives.postgresql.org/


Re: [GENERAL] [OT] Slony Triggers pulling down performance?

2008-01-18 Thread Andrew Sullivan
On Fri, Jan 18, 2008 at 03:14:41PM +0800, Ow Mun Heng wrote:
 Just wondering if my 'Perceived' feeling that since implementing slony
 for master/slave replication of select tables, my master database
 performance is getting slower.

It imposes a performance penalty, yes.

A


---(end of broadcast)---
TIP 1: if posting/reading through Usenet, please send an appropriate
   subscribe-nomail command to [EMAIL PROTECTED] so that your
   message can get through to the mailing list cleanly


Re: [GENERAL] [OT] Slony Triggers pulling down performance?

2008-01-18 Thread Chris Browne
[EMAIL PROTECTED] (Ow Mun Heng) writes:
 Just wondering if my 'Perceived' feeling that since implementing slony
 for master/slave replication of select tables, my master database
 performance is getting slower.

 I'm constantly seeing a very high amount of IO wait. ~40-80 according to
 vmstat 1

 and according to atop. (hdb/hdc = raid1 mirror)
 DSK | hdb | busy 83% | read1052 | write 50 | avio7 ms 
 |
 DSK | hdc | busy 81% | read1248 | write 49 | avio6 ms 
 |

The triggers generate some extra I/O, as they go off and write tuples
into sl_log_1/sl_log_2, so there's certainly a cost, there.

When you pull data from sl_log_1/sl_log_2, that will have a cost, too.

Replication does not come at zero cost...
-- 
(format nil [EMAIL PROTECTED] cbbrowne linuxdatabases.info)
http://www3.sympatico.ca/cbbrowne/finances.html
Power tends  to corrupt and absolute power  corrupts absolutely.  
-- First Baron Acton, 1834 - 1902

---(end of broadcast)---
TIP 1: if posting/reading through Usenet, please send an appropriate
   subscribe-nomail command to [EMAIL PROTECTED] so that your
   message can get through to the mailing list cleanly


[GENERAL] [OT] Slony Triggers pulling down performance?

2008-01-17 Thread Ow Mun Heng
Just wondering if my 'Perceived' feeling that since implementing slony
for master/slave replication of select tables, my master database
performance is getting slower.

I'm constantly seeing a very high amount of IO wait. ~40-80 according to
vmstat 1

and according to atop. (hdb/hdc = raid1 mirror)
DSK | hdb | busy 83% | read1052 | write 50 | avio7 ms |
DSK | hdc | busy 81% | read1248 | write 49 | avio6 ms |


---(end of broadcast)---
TIP 5: don't forget to increase your free space map settings