Re: [HACKERS] Replication on the backend

2005-12-10 Thread Markus Schiltknecht
Hello, On Fri, 2005-12-09 at 08:47 -0500, Christopher Browne wrote: > We *know* (particularly those of us that have had involvement in > actually implementing replication systems used in production > environments) that "user space" implementations of replication can > function satisfactorily. We'

Re: [HACKERS] Replication on the backend

2005-12-09 Thread Christopher Browne
> Are you sure that no way to implement a generic aproach on the > backend? What does specification say? What specification are you talking about? > Does Oracle 10g have a core implementation of replication (cluster)? Since replication is sold as a separate product from Oracle 10g, obviously not

Re: [HACKERS] Replication on the backend

2005-12-08 Thread Jan Wieck
On 12/8/2005 1:28 PM, Gustavo Tonini wrote: Are you sure that no way to implement a generic aproach on the backend? What You mean "generic" as in a replication system that can do asynchronous master-slave, asynchronous multimaster with conflict resolution based on timestamps, system priority

Re: [HACKERS] Replication on the backend

2005-12-08 Thread Andrew Dunstan
What is the point of these questions? If you have a concrete, practical proposal to make, please do so. Otherwise, you have already got the answer from the people who are actually working on replication and understand it far beyond abstract considerations. If you think there is a good reason

Re: [HACKERS] Replication on the backend

2005-12-08 Thread Gustavo Tonini
Are you sure that no way to implement a generic aproach on the backend? What does specification say? Does Oracle 10g have a core implementation of replication (cluster)? Gustavo. 2005/12/7, Andrew Sullivan <[EMAIL PROTECTED]>: On Tue, Dec 06, 2005 at 12:35:43AM -0500, Jan Wieck wrote:> We do not p

Re: [HACKERS] Replication on the backend

2005-12-07 Thread Andrew Sullivan
On Tue, Dec 06, 2005 at 12:35:43AM -0500, Jan Wieck wrote: > We do not plan to implement replication inside the backend. Replication > needs are so diverse that pluggable replication support makes a lot more > sense. To me it even makes more sense than keeping transaction support > outside of th

Re: [HACKERS] Replication on the backend

2005-12-07 Thread Luke Lonergan
Andrew, > And if postgres could actually use an infiniband fabric for > clustering a single database instance across Opteron servers, that > would be very impressive... That's what we do with Bizgres MPP. We've implemented an interconnect to do the data shuffling underneath the optimizer/exe

Re: [HACKERS] Replication on the backend

2005-12-07 Thread J. Andrew Rogers
On Dec 6, 2005, at 11:42 PM, Markus Schiltknecht wrote: Does anybody have latency / roundtrip measurements for current hardware? I'm interested in: 1Gb Ethernet, 10 Gb Ethernet, InfiniBand, probably even p2p usb2 or firewire links? In another secret life, I k

Re: [HACKERS] Replication on the backend

2005-12-07 Thread J. Andrew Rogers
On Dec 6, 2005, at 9:09 PM, Gregory Maxwell wrote: Eh, why would light limited delay be any slower than a disk on FC the same distance away? :) In any case, performance of PG on iscsi is just fine. You can't blame the network... Doing multimaster replication is hard because the locking primitiv

Re: [HACKERS] Replication on the backend

2005-12-07 Thread Markus Schiltknecht
On Wed, 2005-12-07 at 01:04 -0800, J. Andrew Rogers wrote: > Opteron boards get pretty damn close to Big Iron SMP fabric > performance in a cheap package. Given how many companies have > announced plans to produce Opteron server boards with Infiniband > fabrics directly integrated into Hyper

Re: [HACKERS] Replication on the backend

2005-12-06 Thread Markus Schiltknecht
On Tue, 2005-12-06 at 23:19 -0500, Jan Wieck wrote: > It's not so much the bandwidth but more the roundtrips that limit your > maximum transaction throughput. I completely agree that the latency is counting, not the bandwith. Does anybody have latency / roundtrip measurements for current hardwa

Re: [HACKERS] Replication on the backend

2005-12-06 Thread Gregory Maxwell
On 12/6/05, Jan Wieck <[EMAIL PROTECTED]> wrote: > > IMO this is not true. You can get affordable 10GBit network adapters, so > > you can have plenty of bandwith in a db server pool (if they are located in > > the same area). Even 1GBit Ethernet greatly helps here, and would make it > > possible

Re: [HACKERS] Replication on the backend

2005-12-06 Thread Jan Wieck
To: pgsql-hackers@postgresql.org Subject: Re: [HACKERS] Replication on the backend [EMAIL PROTECTED] (Gustavo Tonini) writes: But, wouldn't the performance be better? And wouldn't asynchronous messages be better processed? Why do you think performance would be materially affected

Re: [HACKERS] Replication on the backend

2005-12-06 Thread Aly S.P Dharshi
I would classify it as a clustered database system (Oracle 10g that is). Clustered meaning more than one node in the cluster. ALy. On Tue, 6 Dec 2005, Michael Meskes wrote: >> Postgres-R, pgcluster, Slony-II. Some more advanced, some less. But >> certainly nothing I would send into the

Re: [HACKERS] Replication on the backend

2005-12-06 Thread Gustavo Tonini
I don't see anything in the TODO list. I'm very interesting in work that. If is possible... Gustavo.

Re: [HACKERS] Replication on the backend

2005-12-06 Thread Rick Gigger
- Asynchronous master to multi-slave. We have a few of those with Mommoth-Replicator and Slony-I being the top players. Slony-I does need some cleanup and/or reimplementation after we have a general pluggable replication API in place. Is this API actually have people working on it

Re: [HACKERS] Replication on the backend

2005-12-06 Thread Rick Gigger
Just like MySql! On Dec 5, 2005, at 10:35 PM, Jan Wieck wrote: On 12/5/2005 8:18 PM, Gustavo Tonini wrote: replication (master/slave, multi-master, etc) implemented inside postgres...I would like to know what has been make in this area. We do not plan to implement replication inside the bac

Re: [HACKERS] Replication on the backend

2005-12-06 Thread Michael Meskes
> Postgres-R, pgcluster, Slony-II. Some more advanced, some less. But > certainly nothing I would send into the ring against Oracle-Grid. Assuming that you mean Oracle Real Application Cluster (the Grid is more, right?) I wonder if this technology technically still counts as replication

Re: [HACKERS] Replication on the backend

2005-12-06 Thread Mario Weilguni
Chris Browne Sent: Tuesday, December 06, 2005 4:43 PM To: pgsql-hackers@postgresql.org Subject: Re: [HACKERS] Replication on the backend [EMAIL PROTECTED] (Gustavo Tonini) writes: > But,  wouldn't the performance be better? And wouldn't asynchronous > messages be better processed?

Re: [HACKERS] Replication on the backend

2005-12-06 Thread Chris Browne
[EMAIL PROTECTED] (Gustavo Tonini) writes: > But,  wouldn't the performance be better? And wouldn't asynchronous > messages be better processed? Why do you think performance would be materially affected by this? The MAJOR performance bottleneck is normally the slow network connection between serv

Re: [HACKERS] Replication on the backend

2005-12-06 Thread Markus Schiltknecht
Hello Jan, On Tue, 2005-12-06 at 10:10 -0500, Jan Wieck wrote: > We need a general API. It should be possible to define on a per-database > level which shared replication module to load on connect. The init > function of that replication module then installs all the required > callbacks at stra

Re: [HACKERS] Replication on the backend

2005-12-06 Thread Jan Wieck
On 12/6/2005 8:10 AM, Markus Schiltknecht wrote: On Tue, 2005-12-06 at 10:03 -0200, Gustavo Tonini wrote: But, wouldn't the performance be better? And wouldn't asynchronous messages be better processed? At least for synchronous multi-master replication, the performance bottelneck is going to

Re: [HACKERS] Replication on the backend

2005-12-06 Thread Markus Schiltknecht
On Tue, 2005-12-06 at 10:03 -0200, Gustavo Tonini wrote: > But, wouldn't the performance be better? And wouldn't asynchronous > messages be better processed? At least for synchronous multi-master replication, the performance bottelneck is going to be the interconnect between the nodes - integrati

Re: [HACKERS] Replication on the backend

2005-12-06 Thread Gustavo Tonini
But,  wouldn't the performance be better? And wouldn't asynchronous messages be better processed? Thanks for replies, Gustavo.2005/12/6, Jan Wieck <[EMAIL PROTECTED]>: On 12/5/2005 8:18 PM, Gustavo Tonini wrote:> replication (master/slave, multi-master, etc) implemented inside> postgres...I would

Re: [HACKERS] Replication on the backend

2005-12-05 Thread Jan Wieck
On 12/5/2005 8:18 PM, Gustavo Tonini wrote: replication (master/slave, multi-master, etc) implemented inside postgres...I would like to know what has been make in this area. We do not plan to implement replication inside the backend. Replication needs are so diverse that pluggable replication

Re: [HACKERS] Replication on the backend

2005-12-05 Thread Christopher Kings-Lynne
replication (master/slave, multi-master, etc) implemented inside postgres...I would like to know what has been make in this area. It's not in the backend, check out things like Slony (www.slony.info) and various other commercial solutions. Chris ---(end of broadcast)

Re: [HACKERS] Replication on the backend

2005-12-05 Thread Joshua D. Drake
Gustavo Tonini wrote: replication (master/slave, multi-master, etc) implemented inside postgres...I would like to know what has been make in this area. http://www.commandprompt.com/ - Master/Slave Joshua D. Drake Gustavo. P.S. Sorry for my bad English. 2005/12/5, Chris Browne <[EMAIL PROT

Re: [HACKERS] Replication on the backend

2005-12-05 Thread Gustavo Tonini
replication (master/slave, multi-master, etc) implemented inside postgres...I would like to know what has been make in this area. Gustavo. P.S. Sorry for my bad English.2005/12/5, Chris Browne <[EMAIL PROTECTED]>: [EMAIL PROTECTED] (Gustavo Tonini) writes:> What about replication or data distribu

Re: [HACKERS] Replication on the backend

2005-12-05 Thread Chris Browne
[EMAIL PROTECTED] (Gustavo Tonini) writes: > What about replication or data distribution inside the backend. This > is a valid issue? I'm not sure what your question is... -- (reverse (concatenate 'string "gro.gultn" "@" "enworbbc")) http://www.ntlug.org/~cbbrowne/x.html "Love is like a snowmobi

[HACKERS] Replication on the backend

2005-12-05 Thread Gustavo Tonini
What about replication or data distribution inside the backend. This is a valid issue? Thanks, Gustavo.