On Friday 22 June 2007 04:46:56 pm Christopher Browne wrote:

> That'll take place routinely on all nodes; slony
> needs to switch between sl_log_1 and sl_log_2 periodically,
> and does so on every node. 

I was wondering about that.  I was mostly suspicious because it copies 
like mad until about 15-17G, and then slows to a crawl before erupting 
with those errors and aborting the sync.  The logswitch was just where 
it kept dying, so I kept it as a possible candidate.

> There's something odd about the problem with logswitch_finish();
> can you check your logs to see if the DBMS saw a Signal 11 or
> such at 19:08:44?  

I didn't see any Sig-11, but postgres *did* whine about the client 
unexpectedly closing the connection.  But considering the slony client 
was just as confused about the connection drop, that's what made me 
think of the Savvis firewall getting pissy.

> If you have multiple tables, you could set up a replication set per
> table, and subscribe one table at a time.  In practice, you probably
> have five tables that are bigger than all the others put together;

That's exactly the case.  Not counting indexes, I have 1 5GB table with 
44M rows, a 4GB table with 50M rows, and a 2.5G table with 10M rows.  
If I put those in their own sets, the rest would have no problem being 
in the remainder.

But I wonder about something - does slony turn off indexes to facilitate 
the data copy, and then reenable them so they're all created after the 
copy is done?  If that's the case, that could be my problem.  17G is 
about the size of all the tables with no indexes, fully vacuumed.  If 
slony is waiting around forever for the indexes to finish generating 
before committing and declaring the initial copy successful, that could 
account for my idle time.

I'm still going to assume it's just Savvis and their finicky firewall.  
I've got our sysadmin operating under that assumption, and hope if 
multiple sets don't work, we can get them to, at least temporarily, 
turn off whatever is killing my slons.

Thanks for the help!

-- 

Shaun Thomas
Database Administrator

Leapfrog Online 
807 Greenwood Street 
Evanston, IL 60201 
Tel. 847-440-8253
Fax. 847-570-5750
www.leapfrogonline.com
_______________________________________________
Slony1-general mailing list
[email protected]
http://lists.slony.info/mailman/listinfo/slony1-general

Reply via email to