Re: [ADMIN] Replication monitoring questions
On Jan 17, 2013, at 11:20 AM, Scott Whitney wrote: > What I want to know is whether there's a situation in which my standby is > running, the receiver process is running, but "something" is wrong. I compare pg_controldata output from the two clusters periodically.
[ADMIN] Replication monitoring questions
I've got replication setup (streaming replication) between two 9.2.2 clusters. Everything went just fine on that, and it's working as expected. Now, obviously, I'll know if my primary goes down. I just monitor him as usual. How do I tell whether the standby has gone out of sync for whatever reason? Obviously, I can monitor this: ps -elf | grep "wal receiver" but is there a situation in which the wal receiver is running, but the replication is not working, or there are errors? I know about the replay/receive xlog locations, but those can be off due to lag, of course. What I want to know is whether there's a situation in which my standby is running, the receiver process is running, but "something" is wrong. Sorry this isn't more definite. I'm not quite sure what I'm looking for. Thanks, Scott
[ADMIN] replication question - connections on slave
Hi I have a replicated slave copy of my database. Our 6 year old - non modular web app does not have the connection selector for our PHP scripts, so PHP opens SQL queries to the default (last connection) made by the scripts. So if i open a connection to the slave somewhere, it would become the latest connection and would break write-queries that defaults to it. I was wondering if there is a downfall to opening the slave connection first then master, so master would be default. But if there is no read queries on that page i specially direct to slave, the slave connection would be opened for nothing and simply close after script executes. Is this a horrible practice in terms of performance? thanks
Re: [ADMIN] replication recovery/startup question
On 06/25/2012 11:40 AM, Rob Cowell wrote: Why would the output from ‘ls’ show older filenames (013D...xx) as newer in date than the “013F...xx” filenames? Does Postgres re-cycle old log filenames ? It recycles old log files. If you turn on log_checkpoints, you can see how many and how often. It will list a count of recycled WAL files at each checkpoint, along with how many of the old ones were just deleted instead. The weird pattern in the timestamps you're seeing is a state in the middle of doing that, and yes they look quite weird sometimes. The files are noteed as reusable, get re-initialized to hold new data (they're not overwritten completely with zeros like new WAL files are), and renamed to a new segment number. And each of those steps has a corresponding flush to disk step which makes sure the filesystem metadata is updated. Some of the middle states there are unusual. Does the output from ‘ps’ mean the master/slave are in sync, or is the slave really still playing catchup (based on the names of the logfiles in pg_xlog) ? Your example was in sync, with the file names just being odd due to the implementation of WAL file recycling. You might also check pg_stat_replication to get an easier view of things, rather than relying on ps. ps is correct, it's just harder to check. -- Greg Smith 2ndQuadrant USg...@2ndquadrant.com Baltimore, MD PostgreSQL Training, Services, and 24x7 Support www.2ndQuadrant.com -- Sent via pgsql-admin mailing list (pgsql-admin@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-admin
[ADMIN] replication recovery/startup question
Hi, I started replicating my Postgres9.1.3 server on Friday, and it seems to be working well. The master server database is quite large (somewhere in the order of 85GB) so the rsync to copy the base_backup took a while to complete. However, looking at the log files and 'ps' I'm wondering if the replication has caught up or is still catching up. Master : postgres 3964 3926 0 Jun21 ?00:00:32 postgres: archiver process last was 0001003D0055 postgres 15080 3926 0 Jun22 ?00:02:39 postgres: wal sender process dbrepl xxx.xxx.xxx.xxx(46496) streaming 3D/560752D0 Slave : postgres 5048 5040 0 Jun22 ?00:11:37 postgres: startup process recovering 0001003D0056 postgres 6714 5040 0 Jun22 ?00:06:24 postgres: wal receiver process streaming 3D/560752D0 The log files in ~data/pg_xlog show : ls -lart -rw--- 1 postgres postgres 16777216 Jun 25 13:36 0001003F004C -rw--- 1 postgres postgres 16777216 Jun 25 13:36 0001003F004D -rw--- 1 postgres postgres 16777216 Jun 25 13:37 0001003F0050 -rw--- 1 postgres postgres 16777216 Jun 25 13:46 0001003F0052 -rw--- 1 postgres postgres 16777216 Jun 25 14:24 0001003F0053 -rw--- 1 postgres postgres 16777216 Jun 25 14:50 0001003F0054 -rw--- 1 postgres postgres 16777216 Jun 25 14:59 0001003F0055 -rw--- 1 postgres postgres 16777216 Jun 25 15:03 0001003F0056 -rw--- 1 postgres postgres 16777216 Jun 25 15:06 0001003F0057 -rw--- 1 postgres postgres 16777216 Jun 25 15:10 0001003F0058 drwx-- 4 postgres postgres69632 Jun 25 15:24 . -rw--- 1 postgres postgres 16777216 Jun 25 15:29 0001003D0055 -rw--- 1 postgres postgres 16777216 Jun 25 15:30 0001003D0056 Why would the output from 'ls' show older filenames (013D...xx) as newer in date than the "013F...xx" filenames? Does Postgres re-cycle old log filenames ? Does the output from 'ps' mean the master/slave are in sync, or is the slave really still playing catchup (based on the names of the logfiles in pg_xlog) ? Cheers, Rob.
Re: [ADMIN] replication failure with GIN index
Simon Riggs writes: > On Fri, Apr 6, 2012 at 2:56 AM, Rural Hunter wrote: >> 2012-04-06 02:37:27 CST [@] PANIC: GIN metapage disappeared Known bug, see http://git.postgresql.org/gitweb/?p=postgresql.git;a=commitdiff;h=57b100fe0fb1d0d5803789d3113b89fa18a34fad >> 2012-04-06 02:37:27 CST [@] CONTEXT: xlog redo Update metapage, node: >> 37547844/16405/83896882 blkno: 4294967295 > The blkno is all wrong, so it looks like a clear bug to me. [ looks into that... ] The funny blkno is attributable to this overly-cute code: case XLOG_GIN_UPDATE_META_PAGE: appendStringInfo(buf, "Update metapage, "); desc_node(buf, ((ginxlogUpdateMeta *) rec)->node, ((ginxlogUpdateMeta *) rec)->metadata.tail); break; and we also have case XLOG_GIN_DELETE_LISTPAGE: appendStringInfo(buf, "Delete list pages (%d), ", ((ginxlogDeleteListPages *) rec)->ndeleted); desc_node(buf, ((ginxlogDeleteListPages *) rec)->node, ((ginxlogDeleteListPages *) rec)->metadata.head); break; While there could be some point in printing the list head or tail pointer, it's just confusing to print it with a label of "blkno". I think we should just print the metapage block number here and be done with it. regards, tom lane -- Sent via pgsql-admin mailing list (pgsql-admin@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-admin
Re: [ADMIN] replication failure with GIN index
On Fri, Apr 6, 2012 at 2:56 AM, Rural Hunter wrote: > I'm trying to set up a standby server. Both the primary and standby servers > are on latest version 9.1.3 on ubunt server 10.10. So far I tried to init > the setup 2 times but both failed after the replication running for some > time. what can I do to fix this? The log on the standby is shown below: > > 2012-04-06 02:31:01 CST [@] LOG: restored log file > "00020E3C00F1" from archive > 2012-04-06 02:35:35 CST [@] LOG: restored log file > "00020E3C00F2" from archive > 2012-04-06 02:36:19 CST [@] LOG: restored log file > "00020E3C00F3" from archive > 2012-04-06 02:36:48 CST [@] LOG: restored log file > "00020E3C00F4" from archive > 2012-04-06 02:37:24 CST [@] LOG: restored log file > "00020E3C00F5" from archive > 2012-04-06 02:37:27 CST [@] PANIC: GIN metapage disappeared > 2012-04-06 02:37:27 CST [@] CONTEXT: xlog redo Update metapage, node: > 37547844/16405/83896882 blkno: 4294967295 > 2012-04-06 02:37:28 CST [@] LOG: startup process (PID 24912) was terminated > by signal 6: Aborted > 2012-04-06 02:37:28 CST [@] LOG: terminating any other active server > processes The blkno is all wrong, so it looks like a clear bug to me. Blkno has been set to -1. -- Simon Riggs http://www.2ndQuadrant.com/ PostgreSQL Development, 24x7 Support, Training & Services -- Sent via pgsql-admin mailing list (pgsql-admin@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-admin
[ADMIN] replication failure with GIN index
I'm trying to set up a standby server. Both the primary and standby servers are on latest version 9.1.3 on ubunt server 10.10. So far I tried to init the setup 2 times but both failed after the replication running for some time. what can I do to fix this? The log on the standby is shown below: 2012-04-06 02:31:01 CST [@] LOG: restored log file "00020E3C00F1" from archive 2012-04-06 02:35:35 CST [@] LOG: restored log file "00020E3C00F2" from archive 2012-04-06 02:36:19 CST [@] LOG: restored log file "00020E3C00F3" from archive 2012-04-06 02:36:48 CST [@] LOG: restored log file "00020E3C00F4" from archive 2012-04-06 02:37:24 CST [@] LOG: restored log file "00020E3C00F5" from archive 2012-04-06 02:37:27 CST [@] PANIC: GIN metapage disappeared 2012-04-06 02:37:27 CST [@] CONTEXT: xlog redo Update metapage, node: 37547844/16405/83896882 blkno: 4294967295 2012-04-06 02:37:28 CST [@] LOG: startup process (PID 24912) was terminated by signal 6: Aborted 2012-04-06 02:37:28 CST [@] LOG: terminating any other active server processes -- Sent via pgsql-admin mailing list (pgsql-admin@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-admin
Re: [ADMIN] replication from Oracle to PostgreSQL?
On 12/08/2011 10:40 PM, CS DBA wrote: There are lots of ETL tools available, and there's always the roll-your-own queue-based trigger replication system option. Of course, both options would probably cost more than buying EDB's already built and tested version... interesting idea, any specific ETL tools you could recommend? The main open source ones I hear about are Talend (http://uk.talend.com/index.php) and Pentaho (http://www.pentaho.com/). These are the only two I hear of people on this list using, but that doesn't mean others don't see use too. Others found in a quick search include CloverETL (http://www.cloveretl.com/) and Aptar (http://apatar.com/). I'm sure there are tons more, but who knows what they're like. -- Craig Ringer -- Sent via pgsql-admin mailing list (pgsql-admin@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-admin
Re: [ADMIN] replication from Oracle to PostgreSQL?
On 08/11/2011 08:09 PM, Craig Ringer wrote: On 11/08/2011 10:57 PM, CS DBA wrote: On Thu, 2011-08-11 at 08:41 -0600, CS DBA wrote: Anyone know of tools / options that will allow Oracle to PostgreSQL replication? or at least a real time feed or dblink? EnterpriseDB's Postgres Plus Advanced Server has a realtime replication solution bundled. Regards, That was the first thing I tried to push 'em towards... they shut it down cause it's not free (which is weird since they're not considering a real TCO, but they are the customer). Using Oracle ... and objecting to "not free"? That's why we're here - to help 'em migrate from Oracle to PostgreSQL, it seems some systems will need a longer Oracle life due to other constraints *boggle* agreed There are lots of ETL tools available, and there's always the roll-your-own queue-based trigger replication system option. Of course, both options would probably cost more than buying EDB's already built and tested version... interesting idea, any specific ETL tools you could recommend? -- Craig Ringer -- - Kevin Kempter - Constent State A PostgreSQL Professional Services Company www.consistentstate.com - -- Sent via pgsql-admin mailing list (pgsql-admin@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-admin
Re: [ADMIN] replication from Oracle to PostgreSQL?
On 11/08/2011 10:57 PM, CS DBA wrote: On Thu, 2011-08-11 at 08:41 -0600, CS DBA wrote: Anyone know of tools / options that will allow Oracle to PostgreSQL replication? or at least a real time feed or dblink? EnterpriseDB's Postgres Plus Advanced Server has a realtime replication solution bundled. Regards, That was the first thing I tried to push 'em towards... they shut it down cause it's not free (which is weird since they're not considering a real TCO, but they are the customer). Using Oracle ... and objecting to "not free"? *boggle* There are lots of ETL tools available, and there's always the roll-your-own queue-based trigger replication system option. Of course, both options would probably cost more than buying EDB's already built and tested version... -- Craig Ringer -- Sent via pgsql-admin mailing list (pgsql-admin@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-admin
Re: [ADMIN] replication from Oracle to PostgreSQL?
On 08/11/2011 03:58 PM, Joshua D. Drake wrote: I would imagine it would be pretty simple to fork the triggers that do replication in Londiste or Slony (as long as everything else was PostgreSQL) to be able to replicate from Oracle to PostgreSQL. That's the approach taken by some of our in-house tools. "simple" wouldn't be the right word to describe the process that went into building them though. You have to get the basics working, then worry about non-deterministic statements (random, timestamps, etc.), sequencing, all of the stuff any statement based replication can be faced with--except now there's the quirks of two databases to worry about. One of the reasons Slony and Londiste statement extraction works as well as it does is because new functions were added to PostgreSQL 8.3 for them, to make it easier to get the sort of snapshot information needed to grab consistent copies of data. That problem comes back again when the origin database isn't a PostgreSQL one too. There are a couple of ways to solve this problem, but all of them are complicated enough that they're only sitting in commercial/consultant projects right now (in addition to ones mentioned here already, I'm sure Continuent has some applicable stuff too). I think Kevin's customer may be in for a surprise at how much it will cost to duplicate this feature set from scratch--I'd be surprised to see that total come in under what licensing an already built package would sell for. Companies who aren't willing to throw some money toward buying/customizing at least some PostgreSQL software, if it allows escaping from Oracle licensing, should reconsider their strategy. Not everything you'll want to make a conversion easy is going to be free. -- Greg Smith 2ndQuadrant USg...@2ndquadrant.com Baltimore, MD PostgreSQL Training, Services, and 24x7 Support www.2ndQuadrant.us -- Sent via pgsql-admin mailing list (pgsql-admin@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-admin
Re: [ADMIN] replication from Oracle to PostgreSQL?
On 08/11/2011 07:57 AM, CS DBA wrote: On Thu, 2011-08-11 at 08:41 -0600, CS DBA wrote: Anyone know of tools / options that will allow Oracle to PostgreSQL replication? or at least a real time feed or dblink? EnterpriseDB's Postgres Plus Advanced Server has a realtime replication solution bundled. Regards, That was the first thing I tried to push 'em towards... they shut it down cause it's not free (which is weird since they're not considering a real TCO, but they are the customer). I would aimagine it would be pretty simple to fork the triggers that do replication in Londiste or Slony (as long as everything else was PostgreSQL) to be able to replicate from Oracle to PostgreSQL. JD -- Command Prompt, Inc. - http://www.commandprompt.com/ PostgreSQL Support, Training, Professional Services and Development The PostgreSQL Conference - http://www.postgresqlconference.org/ @cmdpromptinc - @postgresconf - 509-416-6579 -- Sent via pgsql-admin mailing list (pgsql-admin@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-admin
Re: [ADMIN] replication from Oracle to PostgreSQL?
On 08/11/2011 08:41 AM, CS DBA wrote: Hi All; Anyone know of tools / options that will allow Oracle to PostgreSQL replication? or at least a real time feed or dblink? Thanks in advance... SymmetricDS is capable of doing replication one DB to another, but I've never used it so cannot speak from experience. Mark -- Sent via pgsql-admin mailing list (pgsql-admin@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-admin
Re: [ADMIN] replication from Oracle to PostgreSQL?
On Thu, Aug 11, 2011 at 3:41 PM, CS DBA wrote: > Anyone know of tools / options that will allow Oracle to PostgreSQL > replication? or at least a real time feed or dblink? 2ndQuadrant has various in-house tools for fast migration from Oracle to PostgreSQL, but those aren't designed for long term co-existence, just for minimising the window of downtime at cutover. It's not been weaponised, so its not available for free download. -- Simon Riggs http://www.2ndQuadrant.com/ PostgreSQL Development, 24x7 Support, Training & Services -- Sent via pgsql-admin mailing list (pgsql-admin@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-admin
Re: [ADMIN] replication from Oracle to PostgreSQL?
On 08/11/2011 08:41 AM, CS DBA wrote: > Hi All; > > Anyone know of tools / options that will allow Oracle to PostgreSQL > replication? or at least a real time feed or dblink? > > > Thanks in advance... > I believe EnterpriseDB Advanced Server does it (http://www.enterprisedb.com/) -- Chris Ernst Data Operations Engineer Zvelo, Inc. -- Sent via pgsql-admin mailing list (pgsql-admin@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-admin
Re: [ADMIN] replication from Oracle to PostgreSQL?
On Thu, 2011-08-11 at 08:41 -0600, CS DBA wrote: Anyone know of tools / options that will allow Oracle to PostgreSQL replication? or at least a real time feed or dblink? EnterpriseDB's Postgres Plus Advanced Server has a realtime replication solution bundled. Regards, That was the first thing I tried to push 'em towards... they shut it down cause it's not free (which is weird since they're not considering a real TCO, but they are the customer). -- - Kevin Kempter - Constent State A PostgreSQL Professional Services Company www.consistentstate.com - -- Sent via pgsql-admin mailing list (pgsql-admin@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-admin
Re: [ADMIN] replication from Oracle to PostgreSQL?
On Thu, 2011-08-11 at 08:41 -0600, CS DBA wrote: > > Anyone know of tools / options that will allow Oracle to PostgreSQL > replication? or at least a real time feed or dblink? EnterpriseDB's Postgres Plus Advanced Server has a realtime replication solution bundled. Regards, -- Devrim GÜNDÜZ Principal Systems Engineer @ EnterpriseDB: http://www.enterprisedb.com PostgreSQL Danışmanı/Consultant, Red Hat Certified Engineer Community: devrim~PostgreSQL.org, devrim.gunduz~linux.org.tr http://www.gunduz.org Twitter: http://twitter.com/devrimgunduz signature.asc Description: This is a digitally signed message part
[ADMIN] replication from Oracle to PostgreSQL?
Hi All; Anyone know of tools / options that will allow Oracle to PostgreSQL replication? or at least a real time feed or dblink? Thanks in advance... -- - Kevin Kempter - Constent State A PostgreSQL Professional Services Company www.consistentstate.com - -- Sent via pgsql-admin mailing list (pgsql-admin@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-admin
Re: [ADMIN] replication of whole database from one machine to another
amjad usman wrote: > now i want to copy the same data on the other machine for testing > some queries. > > can anybody tell me how i can do this? You have many options. You can review them in the documentation here: http://www.postgresql.org/docs/9.0/interactive/backup.html > secondly, my PostgreSQL server sometimes does not start even if i > have not changed any configuration file. > whats the problem with this? You haven't given enough detail to allow anyone to figure that out. Please read this page and post with more information: http://wiki.postgresql.org/wiki/Guide_to_reporting_problems -Kevin -- Sent via pgsql-admin mailing list (pgsql-admin@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-admin
[ADMIN] replication of whole database from one machine to another
Hello everybody, I am new to PostgreSQL. i am using version 9. I have installed it on two machines. I have put data about 450 digital documents in one machine. now i want to copy the same data on the other machine for testing some queries. can anybody tell me how i can do this? secondly, my PostgreSQL server sometimes does not start even if i have not changed any configuration file. whats the problem with this? Pliz help me sorting out these problems... Thanx in advance. Best regards: Amjeeki
Re: [ADMIN] Replication by schema
On Wed, Feb 16, 2011 at 1:33 PM, Scott Marlowe wrote: > On Wed, Feb 16, 2011 at 12:45 PM, Armin Resch wrote: >> Hi there, >> >> what options do exist to replicate from a master by schema? >> >> What I'm really after is this scenario: >> >> Say, I have 100 databases out in the field. All of them have the same schema >> and are autonomous masters. Now, at a central location, I want to replicate >> from all masters to a central slave (which would have the combined data >> footprint from all masters). Now, if schema-based replication was possible, >> I would configure the slave to replicate the first master's schema 'A' to >> the central slave's schema 'Master01', the second master's schema 'A' to the >> central slave's schema 'Master02', etc. >> >> Making sense? Is there appetite by anyone else for something like that? >> Would there be insurmountable architectural hurdles to make this a built-in >> replication option? > > Slony can already do all of this. OK, it can't change schemas, but if you named them something unique in both places it will work. -- Sent via pgsql-admin mailing list (pgsql-admin@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-admin
Re: [ADMIN] Replication by schema
On Wed, Feb 16, 2011 at 12:45 PM, Armin Resch wrote: > Hi there, > > what options do exist to replicate from a master by schema? > > What I'm really after is this scenario: > > Say, I have 100 databases out in the field. All of them have the same schema > and are autonomous masters. Now, at a central location, I want to replicate > from all masters to a central slave (which would have the combined data > footprint from all masters). Now, if schema-based replication was possible, > I would configure the slave to replicate the first master's schema 'A' to > the central slave's schema 'Master01', the second master's schema 'A' to the > central slave's schema 'Master02', etc. > > Making sense? Is there appetite by anyone else for something like that? > Would there be insurmountable architectural hurdles to make this a built-in > replication option? Slony can already do all of this. -- Sent via pgsql-admin mailing list (pgsql-admin@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-admin
[ADMIN] Replication by schema
Hi there, what options do exist to replicate from a master by schema? What I'm really after is this scenario: Say, I have 100 databases out in the field. All of them have the same schema and are autonomous masters. Now, at a central location, I want to replicate from all masters to a central slave (which would have the combined data footprint from all masters). Now, if schema-based replication was possible, I would configure the slave to replicate the first master's schema 'A' to the central slave's schema 'Master01', the second master's schema 'A' to the central slave's schema 'Master02', etc. Making sense? Is there appetite by anyone else for something like that? Would there be insurmountable architectural hurdles to make this a built-in replication option? Rgds, -ar
Re: [ADMIN] Replication to less secure slave server
On Jan 25, 2011, at 7:04 AM, alys brett wrote: > I am planning a system that will be hosted within a secure network with very > limited access. All access to the database will be from within this network. > I need to have a copy of the database available on a much less secure server, > which will allow access for web applications. This copy of the database is > considered sacrificial. > > The replication methods I have read about are focussed on creating standby > servers to take over if the primary becomes unavailable. For this, there is > obviously a requirement that the slave be able to connect to the database on > the master. This is not allowed by our security set-up (that's the whole > reason for having the replica database). > > I need to somehow push the changes from the master out to the slave. The > database is not very complex or large (two main tables with < 100,000 rows) > and new rows will be added only every few minutes. A minute or so lag on the > copy database is acceptable. I have similar requirements, so I have the master initiate an SSH reverse tunnel to the replica, where pg connects to the local port that is the remote end of that tunnel. -- Scott Ribe scott_r...@elevated-dev.com http://www.elevated-dev.com/ (303) 722-0567 voice -- Sent via pgsql-admin mailing list (pgsql-admin@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-admin
[ADMIN] Replication to less secure slave server
I am planning a system that will be hosted within a secure network with very limited access. All access to the database will be from within this network. I need to have a copy of the database available on a much less secure server, which will allow access for web applications. This copy of the database is considered sacrificial. The replication methods I have read about are focussed on creating standby servers to take over if the primary becomes unavailable. For this, there is obviously a requirement that the slave be able to connect to the database on the master. This is not allowed by our security set-up (that's the whole reason for having the replica database). I need to somehow push the changes from the master out to the slave. The database is not very complex or large (two main tables with < 100,000 rows) and new rows will be added only every few minutes. A minute or so lag on the copy database is acceptable. I think Slony-1 using shipping of log files may be an option: http://www.slony.info/documentation/1.2/logshipping.html Could I do this without using a separate replication tool? Is there any way that I could use the replication methods in PostgreSQL 9 without allowing the slave to connect to the master? I know that log shipping is still possible with earlier versions of Postgres, but I think the slave is then in a permanent state of recovery and cannot accept read-only connections. Thanks in advance for any suggestions, Alys
Re: [ADMIN] replication solution
Simon Riggs ha scritto: On Tue, 2010-08-24 at 15:46 +0200, Silvio Brandani wrote: Hi all, we are looking for a solution to create a replicated database to be used as reporting database with same data of production ( we can accept a lag of some minutes). we already have the Point In Time Recovery but we need a solution where the standby is always open in readonly , but the data is replicated continuosly from primary. The Slony solution could be a possibility but the production database is 80 Gb of data with around 1 transaction each hour. DO you have some suggestion for our implementaiont if exists?? PostgreSQL 9.0 is production ready now and supports Hot Standby, which is exactly what you want. We are testing postgres 9.0.1 hot-standby feautures in a dev environment. Thanks a lot Silvio Brandani --- Utilizziamo i dati personali che la riguardano esclusivamente per nostre finalit� amministrative e contabili, anche quando li comunichiamo a terzi. Informazioni dettagliate, anche in ordine al Suo diritto di accesso e agli altri Suoi diritti, sono riportate alla pagina http://www.savinodelbene.com/privacy.html Se avete ricevuto questo messaggio per errore Vi preghiamo di ritornarlo al mittente eliminandolo assieme agli eventuali allegati, ai sensi art. 616 codice penale http://www.savinodelbene.com/privacy/codice_penale_616.html L'Azienda non si assume alcuna responsabilit� giuridica qualora pervengano da questo indirizzo messaggi estranei all'attivit� lavorativa o contrari a norme. -- -- Sent via pgsql-admin mailing list (pgsql-admin@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-admin
Re: [ADMIN] replication solution
I've heard that rubyrep (http://www.rubyrep.org) is a good tool for replication too. I think it has gained popularity because of its ease of use. On a similar note I am eager to try postgreSQl 9.0 bulit in hot standby solution.I can't really wait till Postgersql rolls out replicated solution which can also be used for a failover. Dinesh On 10/13/2010 1:06 PM, Simon Riggs wrote: On Tue, 2010-08-24 at 15:46 +0200, Silvio Brandani wrote: Hi all, we are looking for a solution to create a replicated database to be used as reporting database with same data of production ( we can accept a lag of some minutes). we already have the Point In Time Recovery but we need a solution where the standby is always open in readonly , but the data is replicated continuosly from primary. The Slony solution could be a possibility but the production database is 80 Gb of data with around 1 transaction each hour. DO you have some suggestion for our implementaiont if exists?? PostgreSQL 9.0 is production ready now and supports Hot Standby, which is exactly what you want. -- Sent via pgsql-admin mailing list (pgsql-admin@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-admin
Re: [ADMIN] replication solution
On Tue, 2010-08-24 at 15:46 +0200, Silvio Brandani wrote: > Hi all, > > we are looking for a solution to create a replicated database to be used > as reporting database with same data of production ( we can accept a lag > of some minutes). > > we already have the Point In Time Recovery but we need a solution where > the standby is always open in readonly , but the data is replicated > continuosly from primary. > > The Slony solution could be a possibility but the production database is > 80 Gb of data with around 1 transaction each hour. > > DO you have some suggestion for our implementaiont if exists?? PostgreSQL 9.0 is production ready now and supports Hot Standby, which is exactly what you want. -- Simon Riggs www.2ndQuadrant.com PostgreSQL Development, 24x7 Support, Training and Services -- Sent via pgsql-admin mailing list (pgsql-admin@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-admin
Re: [ADMIN] replication solution
On Tue, Aug 24, 2010 at 10:38 AM, Joshua D. Drake wrote: > On Tue, 2010-08-24 at 15:46 +0200, Silvio Brandani wrote: >> The Slony solution could be a possibility but the production database is >> 80 Gb of data with around 1 transaction each hour. > Slony (or Londiste) can handle that without issue, at all. Bucardo, too. All three work on similar principles. rls -- :wq -- Sent via pgsql-admin mailing list (pgsql-admin@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-admin
Re: [ADMIN] replication solution
On Tue, 2010-08-24 at 15:46 +0200, Silvio Brandani wrote: > Hi all, > > we are looking for a solution to create a replicated database to be used > as reporting database with same data of production ( we can accept a lag > of some minutes). > > we already have the Point In Time Recovery but we need a solution where > the standby is always open in readonly , but the data is replicated > continuosly from primary. > > The Slony solution could be a possibility but the production database is > 80 Gb of data with around 1 transaction each hour. Slony (or Londiste) can handle that without issue, at all. Joshua D. Drake -- PostgreSQL.org Major Contributor Command Prompt, Inc: http://www.commandprompt.com/ - 509.416.6579 Consulting, Training, Support, Custom Development, Engineering http://twitter.com/cmdpromptinc | http://identi.ca/commandprompt -- Sent via pgsql-admin mailing list (pgsql-admin@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-admin
Re: [ADMIN] replication solution
Hi, 24.Ağu.2010 tarihinde 16:46 saatinde, Silvio Brandani t> şunları yazdı: The Slony solution could be a possibility but the production database is 80 Gb of data with around 1 transaction each hour. We do at least 15x more transactions with Slony, w/o any issues. Slony should be good for you. -- Devrim GÜNDÜZ PostgreSQL DBA @ Akinon/Markafoni, Red Hat Certified Engineer devrim~gunduz.org, devrim~PostgreSQL.org, devrim.gunduz~linux.org.tr http://www.gunduz.org Twitter: http://twitter.com/devrimgunduz -- Sent via pgsql-admin mailing list (pgsql-admin@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-admin
Re: [ADMIN] replication solution
Silvio Brandani wrote: > we already have the Point In Time Recovery but we need a solution > where the standby is always open in readonly , but the data is > replicated continuosly from primary. What's your time frame? The Hot Standby and Streaming Replication features in PostgreSQL 9.0 will do exactly that. 9.0 is currently in beta testing and expected to be released next month. These new features are based on PITR techniques, but SR allows the WAL data to flow across a connection in near real-time, and HS allows the standby to be used for read-only queries. -Kevin -- Sent via pgsql-admin mailing list (pgsql-admin@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-admin
[ADMIN] replication solution
Hi all, we are looking for a solution to create a replicated database to be used as reporting database with same data of production ( we can accept a lag of some minutes). we already have the Point In Time Recovery but we need a solution where the standby is always open in readonly , but the data is replicated continuosly from primary. The Slony solution could be a possibility but the production database is 80 Gb of data with around 1 transaction each hour. DO you have some suggestion for our implementaiont if exists?? thanks a lot Silvio --- Utilizziamo i dati personali che la riguardano esclusivamente per nostre finalità amministrative e contabili, anche quando li comunichiamo a terzi. Informazioni dettagliate, anche in ordine al Suo diritto di accesso e agli altri Suoi diritti, sono riportate alla pagina http://www.savinodelbene.com/news/privacy.html Se avete ricevuto questo messaggio per errore Vi preghiamo di ritornarlo al mittente eliminandolo assieme agli eventuali allegati, ai sensi art. 616 codice penale http://www.savinodelbene.com/codice_penale_616.html L'Azienda non si assume alcuna responsabilità giuridica qualora pervengano da questo indirizzo messaggi estranei all'attività lavorativa o contrari a norme. -- -- Sent via pgsql-admin mailing list (pgsql-admin@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-admin
Re: [ADMIN] replication recommendation
-BEGIN PGP SIGNED MESSAGE- Hash: RIPEMD160 > We are running PG 8.4.4 on Suse 9 and would like to set up a > master/slave configuration but have the following requirements: > - we want to be able to freeze the slave and only force it to update 'on > demand' > - we have data in other schemas in the slave database that we would like to > preserve > > The master and slave will exist on different servers if that helps. > The master DB is roughly 40 GB in size. I realize we could do a dump on > master and restore to slave, but it seems like there might be a more elegant > and efficient solution. This could be accomplished with Bucardo (http://bucardo.org). Setup a sync, make sure "ping" is off (so it does not automatically update the slave on master activity), and then you can manually "kick" the sync whenever you want to update the slave. (Apologies for all the Bucardo terminology) Some possible drawbacks: * Bucardo can only replicate tables incrementally that have a primary key or a unique index. If the table has neither, it can only copy the entire table each time. * If you go a long time between slave updates, the table that holds queued changes on the master will get quite large, and the update will, naturally, take longer. Both are not too much of a concern, but if you have tables that change nearly all of their data between updates, you may want to switch to a different method and copy the entire table instead. - -- Greg Sabino Mullane g...@turnstep.com End Point Corporation http://www.endpoint.com/ PGP Key: 0x14964AC8 201007191737 http://biglumber.com/x/web?pk=2529DF6AB8F79407E94445B4BC9B906714964AC8 -BEGIN PGP SIGNATURE- iEYEAREDAAYFAkxExdYACgkQvJuQZxSWSshTMgCgmNBMil740wtFMtAut083GKET dv8AoOqhtNLy5orQGOJK4eZrWJzbJxG9 =iUBd -END PGP SIGNATURE- -- Sent via pgsql-admin mailing list (pgsql-admin@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-admin
[ADMIN] replication recommendation
We are running PG 8.4.4 on Suse 9 and would like to set up a master/slave configuration but have the following requirements: - we want to be able to freeze the slave and only force it to update 'on demand' - we have data in other schemas in the slave database that we would like to preserve The master and slave will exist on different servers if that helps. The master DB is roughly 40 GB in size. I realize we could do a dump on master and restore to slave, but it seems like there might be a more elegant and efficient solution. Does anyone have any recommendations about the best replication solution given these requirements? Thanks in advance Information in this e-mail may be confidential. It is intended only for the addressee(s) identified above. If you are not the addressee(s), or an employee or agent of the addressee(s), please note that any dissemination, distribution, or copying of this communication is strictly prohibited. If you have received this e-mail in error, please notify the sender of the error. -- Sent via pgsql-admin mailing list (pgsql-admin@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-admin
[ADMIN] Replication on windows - PgAdmin
Hi,
I am struck with a problm could anyone help me out here plz..
I have a problem while replicating my database in same machine via PgAdmin
on Windows, When I try to initiate a new Slony cluster in the PgAdmin
interface, the status-bar says "Slony-I creation scripts not available; only
joining possible" .. where OK remains greyed out..thtz it ..
As i have followed the below steps , Plz do chk whatz wrong below:
- I 've started with Installation of PostgreSQL 8.4 and run Application
Stack Builder to add Replication : Slony-I support.
- Start pgAdmin
III,File ->
Options, setup the Slony-I Path C:\Program Files\PostgreSQL\8.4\share , But
the problem still persists with same error("Slony-I creation scripts not
available; only joining possible").
- set the eventlog
pgsql\lib>regsvr32 slevent.dll
---register the service
- pgsql\bin>slon -regservice Slony-I
- pgsql\bin>slon -addengine Slony-I C:\Program Files\PostgreSQL\8.4\
master.conf
pgsql\bin>slon -addengine Slony-I C:\Program Files\PostgreSQL\8.4\
slave.conf
later tried replacing the slony installation directory
- pgsql\bin>slon -addengine Slony-I C:\Program
Files\PostgreSQL\8.4\slony\master.conf
pgsql\bin>slon -addengine Slony-I C:\Program Files\PostgreSQL\8.4\slony\
slave.conf
pgsql\bin>slon -listengines Slony-I--when i execute this i get
0 engine(s) registered for service 'Slony-I'
any solution for this ? plz do help me..As i am also trying to sortout
using sysinternals procmon to trouble shoot it.
Thanks and Regards,
Reshma
Re: [ADMIN] Replication solution
As much of a pain as slony can be to setup and get working on a large data set, it is pretty solid and reliable for us too. Our DB is about 100G or so. On Sun, Nov 29, 2009 at 9:09 PM, Mark Guadalupe wrote: > We are currently using Slony for our client's database that has million of > rows on some tables and 12GB of raw data. > So far so good, we set it up as a service and using a watchdog script to > monitor and notify us in case the service fails. > > On Fri, Nov 27, 2009 at 12:19 AM, Dimitri Fontaine > wrote: >> >> "Joshua D. Drake" writes: >> > http://pgfoundry.org/projects/skytools/ >> >> See also: http://wiki.postgresql.org/wiki/Londiste_Tutorial >> >> Regards, >> -- >> dim >> >> -- >> Sent via pgsql-admin mailing list (pgsql-admin@postgresql.org) >> To make changes to your subscription: >> http://www.postgresql.org/mailpref/pgsql-admin > > > > -- > > > "Every memorable act in the history of the world is a triumph of enthusiasm. > Nothing great was ever achieved without it because it gives any challenge or > any occupation, no matter how frightening or difficult, a new meaning. > Without enthusiasm you are doomed to a life of mediocrity but with it you > can accomplish miracles." > > Og Mandino 1923-1996, Speaker and Author > > > -- When fascism comes to America, it will be intolerance sold as diversity. -- Sent via pgsql-admin mailing list (pgsql-admin@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-admin
Re: [ADMIN] Replication solution
We are currently using Slony for our client's database that has million of rows on some tables and 12GB of raw data. So far so good, we set it up as a service and using a watchdog script to monitor and notify us in case the service fails. On Fri, Nov 27, 2009 at 12:19 AM, Dimitri Fontaine wrote: > "Joshua D. Drake" writes: > > http://pgfoundry.org/projects/skytools/ > > See also: http://wiki.postgresql.org/wiki/Londiste_Tutorial > > Regards, > -- > dim > > -- > Sent via pgsql-admin mailing list (pgsql-admin@postgresql.org) > To make changes to your subscription: > http://www.postgresql.org/mailpref/pgsql-admin > -- "Every memorable act in the history of the world is a triumph of enthusiasm. Nothing great was ever achieved without it because it gives any challenge or any occupation, no matter how frightening or difficult, a new meaning. Without enthusiasm you are doomed to a life of mediocrity but with it you can accomplish miracles." Og Mandino 1923-1996, Speaker and Author
Re: [ADMIN] Replication solution
"Joshua D. Drake" writes: > http://pgfoundry.org/projects/skytools/ See also: http://wiki.postgresql.org/wiki/Londiste_Tutorial Regards, -- dim -- Sent via pgsql-admin mailing list (pgsql-admin@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-admin
Re: [ADMIN] Replication solution
Thanks for the information. From: Julio Leyva [mailto:jcle...@hotmail.com] Sent: Thursday, November 19, 2009 10:53 AM To: kevin.gritt...@wicourts.gov; Palaniappan Thiyagarajan; pgsql-admin@postgresql.org Subject: RE: [ADMIN] Replication solution check this http://symmetricds.codehaus.org/ I just began playing with that one > Date: Thu, 19 Nov 2009 12:39:04 -0600 > From: kevin.gritt...@wicourts.gov > To: pthiyagara...@cashedge.com; pgsql-admin@postgresql.org > Subject: Re: [ADMIN] Replication solution > > Palaniappan Thiyagarajan wrote: > > > I am looking for Postgres replication solution for 8.3.x DB. > > > > Any open source software available for replication? > > > > Anybody has good step by step doc for warm standby setup? > > > > Any other suggestion to achieve replication is appreciated. > > You might want to start with these pages: > > http://wiki.postgresql.org/wiki/Replication%2C_Clustering%2C_and_Connection_Pooling > > http://www.postgresql.org/docs/8.3/interactive/warm-standby.html > > -Kevin > > -- > Sent via pgsql-admin mailing list (pgsql-admin@postgresql.org) > To make changes to your subscription: > http://www.postgresql.org/mailpref/pgsql-admin
Re: [ADMIN] Replication solution
On Thu, 2009-11-19 at 18:25 +, Palaniappan Thiyagarajan wrote: > > I am looking for Postgres replication solution for 8.3.x DB. > > Any open source software available for replication? http://wiki.postgresql.org/wiki/Replication%2C_Clustering% 2C_and_Connection_Pooling > Anybody has good step by step doc for warm standby setup? https://projects.commandprompt.com/public/pitrtools This BSD-licensed software includes a nice document for setting up a warm standby. -- Devrim GÜNDÜZ, RHCE Command Prompt - http://www.CommandPrompt.com devrim~gunduz.org, devrim~PostgreSQL.org, devrim.gunduz~linux.org.tr http://www.gunduz.org Twitter: http://twitter.com/devrimgunduz signature.asc Description: This is a digitally signed message part
Re: [ADMIN] Replication solution
On Thu, 2009-11-19 at 18:53 +, Julio Leyva wrote: > check this > http://symmetricds.codehaus.org/ > > I just began playing with that one > > > > Date: Thu, 19 Nov 2009 12:39:04 -0600 > > From: kevin.gritt...@wicourts.gov > > To: pthiyagara...@cashedge.com; pgsql-admin@postgresql.org > > Subject: Re: [ADMIN] Replication solution > > > > Palaniappan Thiyagarajan wrote: > > > > > I am looking for Postgres replication solution for 8.3.x DB. https://projects.commandprompt.com/public/replicator http://www.slony.info http://www.bucardo.org http://pgfoundry.org/projects/skytools/ > > > > > Any open source software available for replication? > > > > > > Anybody has good step by step doc for warm standby setup? > > > > > > Any other suggestion to achieve replication is appreciated. > > > > You might want to start with these pages: > > > > http://wiki.postgresql.org/wiki/Replication%2C_Clustering% > 2C_and_Connection_Pooling > > > > http://www.postgresql.org/docs/8.3/interactive/warm-standby.html > > > > -Kevin > > > > -- > > Sent via pgsql-admin mailing list (pgsql-admin@postgresql.org) > > To make changes to your subscription: > > http://www.postgresql.org/mailpref/pgsql-admin -- PostgreSQL.org Major Contributor Command Prompt, Inc: http://www.commandprompt.com/ - 503.667.4564 Consulting, Training, Support, Custom Development, Engineering If the world pushes look it in the eye and GRR. Then push back harder. - Salamander -- Sent via pgsql-admin mailing list (pgsql-admin@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-admin
Re: [ADMIN] Replication solution
check this http://symmetricds.codehaus.org/ I just began playing with that one > Date: Thu, 19 Nov 2009 12:39:04 -0600 > From: kevin.gritt...@wicourts.gov > To: pthiyagara...@cashedge.com; pgsql-admin@postgresql.org > Subject: Re: [ADMIN] Replication solution > > Palaniappan Thiyagarajan wrote: > > > I am looking for Postgres replication solution for 8.3.x DB. > > > > Any open source software available for replication? > > > > Anybody has good step by step doc for warm standby setup? > > > > Any other suggestion to achieve replication is appreciated. > > You might want to start with these pages: > > http://wiki.postgresql.org/wiki/Replication%2C_Clustering%2C_and_Connection_Pooling > > http://www.postgresql.org/docs/8.3/interactive/warm-standby.html > > -Kevin > > -- > Sent via pgsql-admin mailing list (pgsql-admin@postgresql.org) > To make changes to your subscription: > http://www.postgresql.org/mailpref/pgsql-admin
Re: [ADMIN] Replication solution
Palaniappan Thiyagarajan wrote: > I am looking for Postgres replication solution for 8.3.x DB. > > Any open source software available for replication? > > Anybody has good step by step doc for warm standby setup? > > Any other suggestion to achieve replication is appreciated. You might want to start with these pages: http://wiki.postgresql.org/wiki/Replication%2C_Clustering%2C_and_Connection_Pooling http://www.postgresql.org/docs/8.3/interactive/warm-standby.html -Kevin -- Sent via pgsql-admin mailing list (pgsql-admin@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-admin
[ADMIN] Replication solution
Friends, I am looking for Postgres replication solution for 8.3.x DB. Any open source software available for replication? Anybody has good step by step doc for warm standby setup? Any other suggestion to achieve replication is appreciated. Thanks Palani -- Sent via pgsql-admin mailing list (pgsql-admin@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-admin
Re: [ADMIN] Replication for R/W offline use
-BEGIN PGP SIGNED MESSAGE- Hash: RIPEMD160 > First of all, I need Windows clients for offline use -- maybe cygwin will do. Perhaps. Keep in mind the Bucardo daemon(s) can live anywhere, doesn't have to be on the Windows boxes themselves. > Second, I don't exactly know what is the effect of disabling triggers > and rules: will it affect transactions running in parallel (a real > problem), or will triggers be disabled for that transaction only > (sounds like trouble)? No, it will not affect anything outside of that transaction, and thus cause no trouble. - -- Greg Sabino Mullane g...@turnstep.com End Point Corporation PGP Key: 0x14964AC8 200908131627 http://biglumber.com/x/web?pk=2529DF6AB8F79407E94445B4BC9B906714964AC8 -BEGIN PGP SIGNATURE- iEYEAREDAAYFAkqEd1QACgkQvJuQZxSWSshQwQCg4MhCPyzx0zmNFN3uCY6C/YRB 6OcAoNss20HkPudynjm1jt/TNS+NSour =O0hG -END PGP SIGNATURE- -- Sent via pgsql-admin mailing list (pgsql-admin@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-admin
Re: [ADMIN] Replication for R/W offline use
Hello Greg, Thanks, that sounds really reasonable. I'll have to get really familiar with it, though. First of all, I need Windows clients for offline use -- maybe cygwin will do. Second, I don't exactly know what is the effect of disabling triggers and rules: will it affect transactions running in parallel (a real problem), or will triggers be disabled for that transaction only (sounds like trouble)? On Fri, Jul 31, 2009 at 8:00 PM, Greg Sabino Mullane wrote: > > -BEGIN PGP SIGNED MESSAGE- > Hash: RIPEMD160 > > >> - Way of handling conflicting records >> e.g. client A goes offline, client B modifies master, client A >> modifies locally, and when goes online again cannot commit the >> changes. > > One possible solution you should look at is Bucardo, which > does master-master replication. One of the tricky parts you > might want to reconsider though is: > >> The difference is that I do not know when will the client go offline, >> even client does not know (e.g. ISP goes down) and, of course, there >> may be a lot of connections while client is offline. > > This says to me that you should simply make all writes go to the > local box, and have Bucardo keep trying to keep things in sync. > If it can connect, great. If not, it dies and tries again later. > > http://bucardo.org/ > > - -- > Greg Sabino Mullane g...@turnstep.com > End Point Corporation > PGP Key: 0x14964AC8 200907311359 > http://biglumber.com/x/web?pk=2529DF6AB8F79407E94445B4BC9B906714964AC8 > -BEGIN PGP SIGNATURE- > > iEYEAREDAAYFAkpzMSsACgkQvJuQZxSWSsgpoQCgrNa9PFxtVvKcljTguCCvmN6E > HnkAn3OzYFCJZeR7vvhC9Hr/+DVs9tir > =+Tr0 > -END PGP SIGNATURE- > > > > -- > Sent via pgsql-admin mailing list (pgsql-admin@postgresql.org) > To make changes to your subscription: > http://www.postgresql.org/mailpref/pgsql-admin > -- G. -- Sent via pgsql-admin mailing list (pgsql-admin@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-admin
Re: [ADMIN] Replication for R/W offline use
-BEGIN PGP SIGNED MESSAGE- Hash: RIPEMD160 > - Way of handling conflicting records > e.g. client A goes offline, client B modifies master, client A > modifies locally, and when goes online again cannot commit the > changes. One possible solution you should look at is Bucardo, which does master-master replication. One of the tricky parts you might want to reconsider though is: > The difference is that I do not know when will the client go offline, > even client does not know (e.g. ISP goes down) and, of course, there > may be a lot of connections while client is offline. This says to me that you should simply make all writes go to the local box, and have Bucardo keep trying to keep things in sync. If it can connect, great. If not, it dies and tries again later. http://bucardo.org/ - -- Greg Sabino Mullane g...@turnstep.com End Point Corporation PGP Key: 0x14964AC8 200907311359 http://biglumber.com/x/web?pk=2529DF6AB8F79407E94445B4BC9B906714964AC8 -BEGIN PGP SIGNATURE- iEYEAREDAAYFAkpzMSsACgkQvJuQZxSWSsgpoQCgrNa9PFxtVvKcljTguCCvmN6E HnkAn3OzYFCJZeR7vvhC9Hr/+DVs9tir =+Tr0 -END PGP SIGNATURE- -- Sent via pgsql-admin mailing list (pgsql-admin@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-admin
[ADMIN] Replication for R/W offline use
Dear Gurus, I need some solution for a transaction-based system that may have offline clients. Something like CVS in version management, but SQL-based. I need this because we have a team of 6 people, concurrently updating shared XML files and such. When I leave the corporate network I can keep updating corporate data, along with my colleagues. When I join the corporate network again the data will then be published to a common place. I thought about PostgreSQL for several reasons. First of all, concurrent writes while online will not cause confusion. What I need: - If client is online the data should be stored in master DB with data integrity - if client is offline the data should be stored locally - If data is stored locally and client goes online data should be synced to master. - Way of handling conflicting records e.g. client A goes offline, client B modifies master, client A modifies locally, and when goes online again cannot commit the changes. i.e. I need to insert/update (maybe not delete) records even at times when I cannot access the DB (of course, will be committed later). What I DON'T need: - No need for performance (no massive data) - No need for automatic sync (client-initiated sync is sufficient; automatic is a bonus though) - No need to be generic, just some tables should be monitored. Even if I have to write triggers for each table it's OK. - Don't even need master, if it can be solved without master. Crudely speaking I can imagine it something like: - when client goes offline a "snapshot" is present locally, just like at the beginning of a transaction - when client goes online all the changes are "committed" to the master db, just like at end of transaction. The difference is that I do not know when will the client go offline, even client does not know (e.g. ISP goes down) and, of course, there may be a lot of connections while client is offline. Inserting is piece of cake but updates give me a headache. Is there some addon, contrib, whatever for PostgreSQL that can be used for such purpose? Is there some guide how to implement such a system? (my first guess is helper tables, similar in redo logs, but only for specific changes in the database) -- G. -- Sent via pgsql-admin mailing list (pgsql-admin@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-admin
Re: [ADMIN] Replication with SQL Server 2k
2009/6/11 Hans Roman : > Hi guys, I wanna make replication between a MSQLServer 2k (master) to a > PostgreSQL 8.3.7 (slave in a Centos box), Could you tell me what options i > have? Any expierences? > > Regards. > > -- > Hans Roman > > sure, you have Sequoia to do that, but ... beware! this tool is Java and is a little 'heavy', but i think it could be useful. [1] http://www.continuent.com/community -- Emanuel Calvo Franco ArPUG [www.arpug.com.ar] / AOSUG Member www.emanuelcalvofranco.com.ar -- Sent via pgsql-admin mailing list (pgsql-admin@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-admin
[ADMIN] Replication with SQL Server 2k
Hi guys, I wanna make replication between a MSQLServer 2k (master) to a PostgreSQL 8.3.7 (slave in a Centos box), Could you tell me what options i have? Any expierences? Regards. -- Hans Roman
Re: [ADMIN] Replication for migration
On Thu, May 14, 2009 at 7:59 AM, Kenneth Marshall wrote: > On Thu, May 14, 2009 at 10:57:26AM -0300, Martin Spinassi wrote: >> Hi list! >> >> I've to do a migration of postgresql from version 8.2 to 8.3 in one >> server. The problem I see here is, to avoid data loss (people still >> using the web site that uses postgres), I'll need to stop postgres 8.2, >> make a pg_dumpall, and then restore that information in 8.3. >> Taking some considerations, like database size, server, etc. I estimate >> that it will be at least 30 minutes of downtime, and that's pretty much >> time. >> >> I've thinking in the possibility of doing some kind of master/slave with >> both versions (I must change the default port in one of them, as >> everything must happen on a single machine), and find some useful links >> like: >> >> http://wiki.postgresql.org/wiki/Replication%2C_Clustering% >> 2C_and_Connection_Pooling >> http://momjian.us/main/writings/pgsql/replication.pdf >> >> >> I'd love to read some experiences or advices, since I haven't done it >> before. Also if you have some link o document that you think I must >> read, it'll be welcomed. >> >> >> Thanks to all. >> >> >> Mart??n >> > > I used Slony replication to upgrade a database from 8.2 -> 8.3 and > it worked quite well. You will need an outage to change the master > to the 8.3 database and re-point your apps, but if scripted, that > is minimal. Where I work we use slony as our standard replication platform, and we used it to migrate from 8.1 to 8.3. Went smooth as silk. We had about 30 seconds of downtime on a Saturday night, our slowest time. -- Sent via pgsql-admin mailing list (pgsql-admin@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-admin
Re: [ADMIN] Replication for migration
Hi, Martin Spinassi writes: > On Thu, 2009-05-14 at 08:59 -0500, Kenneth Marshall wrote: >> I used Slony replication to upgrade a database from 8.2 -> 8.3 and >> it worked quite well. You will need an outage to change the master >> to the 8.3 database and re-point your apps, but if scripted, that >> is minimal. > > I've seen that slony documentation is huge! I'll give it a shot in > testing environment. The skytools project's documentation is an easy read ;) http://wiki.postgresql.org/wiki/Londiste_Tutorial Londiste in its current stable version (2.1.9) doesn't support failover, but as long as you're migrating away from 8.2 I suppose you don't need to be able to switch back. The procedure would then be: - setup londiste and replicate data - enter site maintenance mode (no more writes on the database) - wait for the londiste logs to show there's nothing to replicate (while waiting, maybe setup the site to point to 8.3) - open up the site again, on 8.3 - shut down the londiste daemons and the 8.2 pg server The waiting for emptying queues shouldn't be very long, expect 3s to 30s, but be sure to test it before switching for real, of course. Regards, -- dim -- Sent via pgsql-admin mailing list (pgsql-admin@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-admin
Re: [ADMIN] Replication for migration
On Thu, 2009-05-14 at 08:59 -0500, Kenneth Marshall wrote: > On Thu, May 14, 2009 at 10:57:26AM -0300, Martin Spinassi wrote: > > Hi list! > > [snip] > > > > I'd love to read some experiences or advices, since I haven't done it > > before. Also if you have some link o document that you think I must > > read, it'll be welcomed. > > > > > > Thanks to all. > > > > > > Mart??n > > > > I used Slony replication to upgrade a database from 8.2 -> 8.3 and > it worked quite well. You will need an outage to change the master > to the 8.3 database and re-point your apps, but if scripted, that > is minimal. > > Cheers, > Ken Thanks for the advice Ken. I've seen that slony documentation is huge! I'll give it a shot in testing environment. Cheers Martin -- Sent via pgsql-admin mailing list (pgsql-admin@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-admin
Re: [ADMIN] Replication for migration
On Thu, May 14, 2009 at 10:57:26AM -0300, Martin Spinassi wrote: > Hi list! > > I've to do a migration of postgresql from version 8.2 to 8.3 in one > server. The problem I see here is, to avoid data loss (people still > using the web site that uses postgres), I'll need to stop postgres 8.2, > make a pg_dumpall, and then restore that information in 8.3. > Taking some considerations, like database size, server, etc. I estimate > that it will be at least 30 minutes of downtime, and that's pretty much > time. > > I've thinking in the possibility of doing some kind of master/slave with > both versions (I must change the default port in one of them, as > everything must happen on a single machine), and find some useful links > like: > > http://wiki.postgresql.org/wiki/Replication%2C_Clustering% > 2C_and_Connection_Pooling > http://momjian.us/main/writings/pgsql/replication.pdf > > > I'd love to read some experiences or advices, since I haven't done it > before. Also if you have some link o document that you think I must > read, it'll be welcomed. > > > Thanks to all. > > > Mart??n > I used Slony replication to upgrade a database from 8.2 -> 8.3 and it worked quite well. You will need an outage to change the master to the 8.3 database and re-point your apps, but if scripted, that is minimal. Cheers, Ken -- Sent via pgsql-admin mailing list (pgsql-admin@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-admin
[ADMIN] Replication for migration
Hi list! I've to do a migration of postgresql from version 8.2 to 8.3 in one server. The problem I see here is, to avoid data loss (people still using the web site that uses postgres), I'll need to stop postgres 8.2, make a pg_dumpall, and then restore that information in 8.3. Taking some considerations, like database size, server, etc. I estimate that it will be at least 30 minutes of downtime, and that's pretty much time. I've thinking in the possibility of doing some kind of master/slave with both versions (I must change the default port in one of them, as everything must happen on a single machine), and find some useful links like: http://wiki.postgresql.org/wiki/Replication%2C_Clustering% 2C_and_Connection_Pooling http://momjian.us/main/writings/pgsql/replication.pdf I'd love to read some experiences or advices, since I haven't done it before. Also if you have some link o document that you think I must read, it'll be welcomed. Thanks to all. Martín -- Sent via pgsql-admin mailing list (pgsql-admin@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-admin
Re: [ADMIN] replication with table add/removes..
How can I make them constantly create restore points? Once I create recover.conf it creates recover.done but what about those new queries that comes after that? Do I have to re-create recover.conf? Or how do I achive constant logging to slaves? This issue is not clear in the documentation http://www.postgresql.org/docs/8.3/interactive/continuous-archiving.html - Original Message From: Chris Browne <[EMAIL PROTECTED]> To: pgsql-admin@postgresql.org Sent: Wednesday, October 8, 2008 7:47:45 PM Subject: Re: [ADMIN] replication with table add/removes.. [EMAIL PROTECTED] (Martin Badie) writes: > Hi, I have a system that have constant table adds/removes are > present. I want to make a replication between master and slaves but > not sure which one is the best solution for that kind of a > situation. Since I am new to replication stuff on postgresql I am > truly lost but I know that Slony is not an answer for replications > where table add/remove are present. Best Regards. The only way that is at all supportable right now in that regard is to use PITR: http://www.postgresql.org/docs/8.3/interactive/continuous-archiving.html That does NOT allow you to query the backup nodes; in order to do so, you must activate them, which amounts to failing over to the backup node. If your system doesn't have a stable schema, that seems like a problem... -- select 'cbbrowne' || '@' || 'linuxfinances.info'; http://linuxdatabases.info/info/wp.html Objects & Markets "Object-oriented programming is about the modular separation of what from how. Market-oriented, or agoric, programming additionally allows the modular separation of why." -- Mark Miller -- Sent via pgsql-admin mailing list (pgsql-admin@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-admin
Re: [ADMIN] replication with table add/removes..
On Wed, Oct 8, 2008 at 9:10 AM, Martin Badie <[EMAIL PROTECTED]> wrote: > Hi, > > I have a system that have constant table adds/removes are present. I want to > make a replication between master and slaves but not sure which one is the > best solution for that kind of a situation. Since I am new to replication > stuff on postgresql I am truly lost but I know that Slony is not an answer > for replications where table add/remove are present. I think that pgpool might work for this. There are probably some other "front end" type replication systems that would work too. -- Sent via pgsql-admin mailing list (pgsql-admin@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-admin
Re: [ADMIN] replication with table add/removes..
[EMAIL PROTECTED] (Martin Badie) writes: > Hi, I have a system that have constant table adds/removes are > present. I want to make a replication between master and slaves but > not sure which one is the best solution for that kind of a > situation. Since I am new to replication stuff on postgresql I am > truly lost but I know that Slony is not an answer for replications > where table add/remove are present. Best Regards. The only way that is at all supportable right now in that regard is to use PITR: http://www.postgresql.org/docs/8.3/interactive/continuous-archiving.html That does NOT allow you to query the backup nodes; in order to do so, you must activate them, which amounts to failing over to the backup node. If your system doesn't have a stable schema, that seems like a problem... -- select 'cbbrowne' || '@' || 'linuxfinances.info'; http://linuxdatabases.info/info/wp.html Objects & Markets "Object-oriented programming is about the modular separation of what from how. Market-oriented, or agoric, programming additionally allows the modular separation of why." -- Mark Miller -- Sent via pgsql-admin mailing list (pgsql-admin@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-admin
[ADMIN] replication with table add/removes..
Hi, I have a system that have constant table adds/removes are present. I want to make a replication between master and slaves but not sure which one is the best solution for that kind of a situation. Since I am new to replication stuff on postgresql I am truly lost but I know that Slony is not an answer for replications where table add/remove are present. Best Regards.
Re: [ADMIN] Replication, HA ...?
> I have a webserver with postgresql. I would have a backup from this > database. It should also be possible to query this backup solution. > So I think slony would be a good choice. Am I right? Slony will replicate the data from selected tables for you, and the replicated database will be available for queries. So it will work for you unless you face performance limits, or have some problem with asynchronous updates, or find Slony setup to be too difficult. -- Sent via pgsql-admin mailing list (pgsql-admin@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-admin
Re: [ADMIN] Replication, HA ...?
YOu can also check out PgPool II http://pgpool.projects.postgresql.org/ you can get parallel querying and stand by solutions using pgpool II. it also offers HA & LB solutions. > Date: Mon, 16 Jun 2008 10:55:23 +0200> From: [EMAIL PROTECTED]> To: [EMAIL > PROTECTED]> CC: pgsql-admin@postgresql.org> Subject: Re: [ADMIN] Replication, > HA ...?> > Check out cybercluster at http://www.postgresql.at/> It's free, > however the support can cost a bit. But the software itself is free,> and > it's built on postgresql8.2.> > On Mon, 16 Jun 2008 09:46:57 +0200> Andreas > Kraftl <[EMAIL PROTECTED]> wrote:> > > Hello, > > > > I have a webserver with > postgresql. I would have a backup from this> > database. It should also be > possible to query this backup solution.> > So I think slony would be a good > choice. Am I right?> > > > Thanks for answers> > Andreas> > > -- > > Üdvölettel,> > Czuczy Gergely> Harmless Digital Bt> mailto: [EMAIL > PROTECTED]> Tel: +36-30-9702963 _ Timely update on all current affairs, sports, events and all thats in News here on MSN videos. http://video.msn.com/?mkt=en-in
Re: [ADMIN] Replication, HA ...?
Check out cybercluster at http://www.postgresql.at/ It's free, however the support can cost a bit. But the software itself is free, and it's built on postgresql8.2. On Mon, 16 Jun 2008 09:46:57 +0200 Andreas Kraftl <[EMAIL PROTECTED]> wrote: > Hello, > > I have a webserver with postgresql. I would have a backup from this > database. It should also be possible to query this backup solution. > So I think slony would be a good choice. Am I right? > > Thanks for answers > Andreas -- Üdvölettel, Czuczy Gergely Harmless Digital Bt mailto: [EMAIL PROTECTED] Tel: +36-30-9702963 signature.asc Description: PGP signature
[ADMIN] Replication, HA ...?
Hello, I have a webserver with postgresql. I would have a backup from this database. It should also be possible to query this backup solution. So I think slony would be a good choice. Am I right? Thanks for answers Andreas -- Kraftl EDV - Dienstleistungen Schulungen, Linux, Linuxlösungen, Webprogrammierung Autofabrikstraße 16/6, 1230 Wien, Österreich http://www.kraftl.at/ -- Sent via pgsql-admin mailing list (pgsql-admin@postgresql.org) To make changes to your subscription: http://www.postgresql.org/mailpref/pgsql-admin
Re: [ADMIN] Replication advice Many-to-one Slony
Hello Walfred, yes you can use slony, we use slony for huge data replication. One solution of them is the backup of many masters to one slave. It is in real time - and we're quite happy with the newest version of slony. Don't forget to not only add tables to your replication but to also add sequences additionally, because you may backup the tables and content of them but when trying to use your backup you could have a big nightmare when you cannot find the state of your sequences - so your data is not lost but not instantly usable. When you think of using a hot-copy system so that you just can switch from the master when it brakes to your slave system I would suggest you to think about the load that could go to the backup-slave which should now be used as master, in this case we calculate 1/3 of master-load to one slave, but that depends on the application and the load of your databases. Switching to Slave and back to master when it's again ready (also with automatic replication back to the master) works great in slony. If you have any further questions or need any help on setting up the slony scripts just contact me directly. Regards, Aldor Walfred Tedeschi wrote: > Hi all, > > We intend to establish a central back-up for our system. It can be though as > many machines (masters) linked to one Slave. The communication may be one > directional (master -> slave) and would appreciate to have it almost in > realtime. > The data flux on the system is not very high in terms of transactions and > volume of data. And the primary keys are planned in a way that there is no > overlap over the masters (every master has its own range of PK) without > overlapping. We were thinking about slony1. > > Since we are not sure about the decision, we would appreciate very much if you > could advise us what to use and where to start. > > Thank you very much, > > Fred > > > -- > Open WebMail Project (http://openwebmail.org) > > > ---(end of broadcast)--- > TIP 1: if posting/reading through Usenet, please send an appropriate >subscribe-nomail command to [EMAIL PROTECTED] so that your >message can get through to the mailing list cleanly > ---(end of broadcast)--- TIP 9: In versions below 8.0, the planner will ignore your desire to choose an index scan if your joining column's datatypes do not match
[ADMIN] Replication advice Many-to-one Slony
Hi all, We intend to establish a central back-up for our system. It can be though as many machines (masters) linked to one Slave. The communication may be one directional (master -> slave) and would appreciate to have it almost in realtime. The data flux on the system is not very high in terms of transactions and volume of data. And the primary keys are planned in a way that there is no overlap over the masters (every master has its own range of PK) without overlapping. We were thinking about slony1. Since we are not sure about the decision, we would appreciate very much if you could advise us what to use and where to start. Thank you very much, Fred -- Open WebMail Project (http://openwebmail.org) ---(end of broadcast)--- TIP 1: if posting/reading through Usenet, please send an appropriate subscribe-nomail command to [EMAIL PROTECTED] so that your message can get through to the mailing list cleanly
Re: [ADMIN] replication between linxu postgresql and Windows postgresql
Mary Anderson wrote: Hi all, I am new to postgresql and have been called upon to set up a database to be used by two groups. One group (mine) is strictly a UNIX shop. The other group (theirs) is strictly a Windows shop. What is the best way to go. First, does postgresql have replication and can i get it with the open source database? Yes. There Is some replication systems for PostgreSQL, the most popular is "Slony". You're from USA, so You don't have to worry about encodings and collate problems, when the are different in Windows server and UNIX/Linux. When You use specific encodings I think the best way is to use UTF8 in both servers - Windows and UNIX/Linux (if it is possible). If You want to make Your own specific replication, You can use dblink module and some triggers. It sounds very complicate, but it is not. Sometimes the applications are working in very specific way, so classical replication is not very usable (not in PostgreSQL only). Second, would replication work between a Linux postgresql and a Windows postgresql? I think - It's no problem. What if I run postgresql on VMWare in the Windows shop? Will replication work? Like above. What about dumping the Linux database and restoring it on the Windows database. Will that work? Yes. When You are using different encodings in these databases, the best way is to use dumps as SQL script restoring with psql program. Opinions on any of this are welcome! Mary Anderson ---(end of broadcast)--- TIP 7: You can help support the PostgreSQL project by donating at http://www.postgresql.org/about/donate ---(end of broadcast)--- TIP 5: don't forget to increase your free space map settings
Re: [ADMIN] replication between linxu postgresql and Windows postgresql
I didnt meant for the version, what i meant was all on latest.
--
Shoaib Mir
EnterpriseDB (www.enterprisedb.com)
On 6/25/07, Chris Browne <[EMAIL PROTECTED]> wrote:
[EMAIL PROTECTED] ("Shoaib Mir") writes:
> Slony can handle this all.
No it can't. It will not work with versions of PostgreSQL earlier
than 7.3.3, because it requires namespace functionality that did not
stabilize until that point.
--
(reverse (concatenate 'string "moc.enworbbc" "@" "enworbbc"))
http://www3.sympatico.ca/cbbrowne/lsf.html
Rules of the Evil Overlord #147. "I will classify my lieutenants in
three categories: untrusted, trusted, and completely trusted.
Promotion to the third category can only be awarded posthumously."
Re: [ADMIN] replication between linxu postgresql and Windows postgresql
On Mon, Jun 25, 2007 at 02:42:04PM -0400, Chris Browne wrote: > No it can't. It will not work with versions of PostgreSQL earlier > than 7.3.3, because it requires namespace functionality that did not > stabilize until that point. But if you're running on <7.3.3, you really, really need to upgrade anyway. And you could upgrade to the latest 7.3 and get the Slony functionality. A -- Andrew Sullivan | [EMAIL PROTECTED] The whole tendency of modern prose is away from concreteness. --George Orwell ---(end of broadcast)--- TIP 5: don't forget to increase your free space map settings
Re: [ADMIN] replication between linxu postgresql and Windows postgresql
[EMAIL PROTECTED] ("Shoaib Mir") writes:
> Slony can handle this all.
No it can't. It will not work with versions of PostgreSQL earlier
than 7.3.3, because it requires namespace functionality that did not
stabilize until that point.
--
(reverse (concatenate 'string "moc.enworbbc" "@" "enworbbc"))
http://www3.sympatico.ca/cbbrowne/lsf.html
Rules of the Evil Overlord #147. "I will classify my lieutenants in
three categories: untrusted, trusted, and completely trusted.
Promotion to the third category can only be awarded posthumously."
Re: [ADMIN] replication between linxu postgresql and Windows postgresql
Slony can handle this all. If you do not want to use Slony, you can write your own triggers using dblink module to get the data across. -- Shoaib Mir EnterpriseDB (www.enterprisedb.com) On 6/25/07, Mary Anderson <[EMAIL PROTECTED]> wrote: Hi all, I am new to postgresql and have been called upon to set up a database to be used by two groups. One group (mine) is strictly a UNIX shop. The other group (theirs) is strictly a Windows shop. What is the best way to go. First, does postgresql have replication and can i get it with the open source database? Second, would replication work between a Linux postgresql and a Windows postgresql? What if I run postgresql on VMWare in the Windows shop? Will replication work? What about dumping the Linux database and restoring it on the Windows database. Will that work? Opinions on any of this are welcome! Mary Anderson ---(end of broadcast)--- TIP 7: You can help support the PostgreSQL project by donating at http://www.postgresql.org/about/donate
[ADMIN] replication between linxu postgresql and Windows postgresql
Hi all, I am new to postgresql and have been called upon to set up a database to be used by two groups. One group (mine) is strictly a UNIX shop. The other group (theirs) is strictly a Windows shop. What is the best way to go. First, does postgresql have replication and can i get it with the open source database? Second, would replication work between a Linux postgresql and a Windows postgresql? What if I run postgresql on VMWare in the Windows shop? Will replication work? What about dumping the Linux database and restoring it on the Windows database. Will that work? Opinions on any of this are welcome! Mary Anderson ---(end of broadcast)--- TIP 7: You can help support the PostgreSQL project by donating at http://www.postgresql.org/about/donate
Re: [ADMIN] Replication Multi Master Asyncronous
On Tue, 2007-04-24 at 00:35 -0700, Muhammad Isnaini wrote: > Hi.. > I success develop a Replication Multi Master Async through PHP. > Just few step to make replication with php, but I want to make this > replication can embedded into PostgreSQL. > > This step by step . > Make every record unique in every > Every table that create must added by 1 Field ( ex : clusterid ). > Every primary key must changed to add clusterid. > Every update ( insert and update ) must corelation with clusterid. > Make Update / Insert to Log > Send Log to another member cluster. > Every member cluster Execute Log that receive. > Send message that to Sender. > Delete log. > > That's model that I want to make code . How are you planning on handling collision detection and resolution? -- Brad Nicholson 416-673-4106 Database Administrator, Afilias Canada Corp. ---(end of broadcast)--- TIP 7: You can help support the PostgreSQL project by donating at http://www.postgresql.org/about/donate
[ADMIN] Replication Multi Master Asyncronous
Hi.. I success develop a Replication Multi Master Async through PHP. Just few step to make replication with php, but I want to make this replication can embedded into PostgreSQL. This step by step . Make every record unique in every Every table that create must added by 1 Field ( ex : clusterid ). Every primary key must changed to add clusterid. Every update ( insert and update ) must corelation with clusterid. Make Update / Insert to Log Send Log to another member cluster. Every member cluster Execute Log that receive. Send message that to Sender. Delete log. That's model that I want to make code . thanks for advice. - Ahhh...imagining that irresistible "new car" smell? Check outnew cars at Yahoo! Autos.
Re: [ADMIN] Replication
Hi, [ please keep CCing to the list (reply all), as this certainly isn't a personal discussion and could help others. ] anorganic anorganic wrote: my opinion: partitioning is vertical and horizontal, dived table into two or more parts. > replicated only part of some object,here table = replicated two columns ins't partitioning, because table is same ;) and have one part = self table ;) The main point is, you divide data *somehow* into partitions and grant write rights to only *one* server for each partition, thus allowing you to use a simpler master-slave replication. i want have s1 and s2 tableA col1 col2 col3 tableA is on s1 and s2 same design s1 change only col1, s2 change only col3 is possible set replication on s1 only for col1 of tableA is possible set replication on s2 only for col3 of tableA this is not partitioning i think How else would you call it? In what way is it different from what's commonly known as vertical partitioning? Couldn't you do what you want with the help of ordinary vertical partitioning and using a VIEW viewA with all the columns col1, col2, col3? ok, sync is not saying something about when is transaction log send... Uhm.. yes it does. It has to be sent before commit confirmation is sent to the client (Postgres-R does some optimization here, but basically the above statement still holds true). It is the async approach, which doesn't say anything about when changes are sent to other servers. sync said: i coimmit transaction when all slaves send me commit :) asynch: i make change i commit this change and i send it to my slave. and i want do it fast as possible ;) No matter *how* fast you do that, conflicts can arise if you don't prevent them somehow. The requirement to send changes as fast as possible in async replication rings my alarm bell, because it sounds like your application cannot cope with conflicts and wants to prevent them by minimizing the propagation delays. That's prone to race conditions and probably won't work. However, if you partition your data vertically and do per-table master-slave replication, you of course don't have to worry about conflicts, as there is only exactly one master. Regards Markus ---(end of broadcast)--- TIP 6: explain analyze is your friend
Re: [ADMIN] Replication
Hi, [ please keep CCing to the list (reply all), as this certainly isn't a personal discussion and could help others. ] anorganic anorganic wrote: Hello, "I don't quite follow what you mean here. I assume you mean rows, not columns. Then probably you mean something like what we call data partitioning, where each server is a master for a certain subset of the data." I think granurality, some system allow replicate only all db, all table, some allow to choose only 4 colums from one table 2 from another and replicated only these parts of db. I can add example. it's not partitioning. Uhm.. I'd still call it partitioning. Although, I'm not exactly sure why you want to replicate only a partial row. I suspect you will have to split into two tables and have one table replicated while not replicating the other. "Interesting... where exactly is it to short for you? What else would you expect?" ok may be i'm false but i think this all is not common features of postgre and it's necessary use system as slony. i want know what i must use, how i can make and detail description of these solution. What's happen when connection crash, when server shutdown etc. Right, but as we only have external solutions, I think it makes sense to have them document how exactly they work and behave. "Hm. If that really is a problem, think again about sync vs. async. In async replication, there is a delay by definition. But again, I'm not sure what Slony can do to minimize that delay." yeah may be i am on bad adress but may be somebody here will say me here i used this program fort his solution. Or this problem have no solution on postgre. I fear replication is such a wide field with that many options, you probably can't get away with a general approach. I especially think so because I consider your wishes to be quite exotic for two reasons: * realtime, as fast as possible, but certainly not sync (You are aware that async, no matter how fast, can lead to conflicts, aren't you?) * replicating only parts of a row Async, sync i dont need sync, but i need send change fast as possible. i don't want sync. But when i change col on s1 i wnat send change right now, no waiting for another 5 changes. It must be quite realtime we have low traffic between servers there is not necessary make some optimilaztion as sending in packages. I'd be surprised if Slony couldn't be configured to send changes immediately (i.e. not waiting for more transactions before sending a package). But again, the Slony guys may know better. Regards Markus ---(end of broadcast)--- TIP 3: Have you checked our extensive FAQ? http://www.postgresql.org/docs/faq
Re: [ADMIN] Replication
Hi, anorganic anorganic wrote: >> did you check the manual about 'High Availability and Load >> Balancing"? >> http://www.postgresql.org/docs/8.2/static/high-availability.html > yes but this was really short i think. Interesting... where exactly is it to short for you? What else would you expect? I need that: s1 and s2 must be multimaster replication asyn. but make replication in real time. Changes are immediately send to second server. Slony can probably be used for such a setup, although it's primarily designed for single master, async replication. OR: s1 is master s2 slave, s1 change some columns on s2, and s2 is master s1 slave and s2 change another columns in one time. I don't quite follow what you mean here. I assume you mean rows, not columns. Then probably you mean something like what we call data partitioning, where each server is a master for a certain subset of the data. I read about slony but, it looks that's make changes not immediatly but in packages = not send one transaction but wait and send package. This could be a problem. Hm. If that really is a problem, think again about sync vs. async. In async replication, there is a delay by definition. But again, I'm not sure what Slony can do to minimize that delay. I hope slony online system is right for me. And these question about slony i have more than one i think it could be rigth way. Somebody who run it could be great person for me :). Probably ask on the slony mailing list. I'm not exactly a slony expert either. Regards Markus ---(end of broadcast)--- TIP 5: don't forget to increase your free space map settings
Re: [ADMIN] Replication
Hi, did you check the manual about 'High Availability and Load Balancing"? http://www.postgresql.org/docs/8.2/static/high-availability.html Regards Markus ---(end of broadcast)--- TIP 5: don't forget to increase your free space map settings
Re: [ADMIN] Replication
Did you try Slony with PostgreSQL? -- Shoaib Mir EnterpriseDB (www.enterprisedb.com) On 1/4/07, anorganic anorganic <[EMAIL PROTECTED]> wrote: Hello, i need make with postgre something as this: i have two servers S1 and S2, connection is quit good, but sometimes once or twice per month there is short disconnection, longer discoonection 2x per year (1-2+ hours) on both are running updates i need have same data in time, but i never update same collumns on S1 an S2, S1 change another atributes than S2 = there are no conflicts, on MS SQL i use transactional replication and i like find somethin same for postgre. Can u please send me some info where can i found what i need, which postgre tool is right way for me.. Thnx a lot.
[ADMIN] Replication
Hello, i need make with postgre something as this: i have two servers S1 and S2, connection is quit good, but sometimes once or twice per month there is short disconnection, longer discoonection 2x per year (1-2+ hours) on both are running updates i need have same data in time, but i never update same collumns on S1 an S2, S1 change another atributes than S2 = there are no conflicts, on MS SQL i use transactional replication and i like find somethin same for postgre. Can u please send me some info where can i found what i need, which postgre tool is right way for me.. Thnx a lot.
Re: [ADMIN] replication?
Why not just have a primary key with 2 columns, one of which is a serial and the other is a "siteid" or "installid" that is different for each server? TomDB wrote: would there be any default available field (like the OID of the records) that would be unique in the two versions of the datbase? there isn't "by accident" something like a unique UID like an MD5 or something... ? cause if there is no replication available, I'd consider this (together with PHP) a) replacing the serial fields by generated UID's (md5 of ID + a string that depends on the install) or b) start the autoincrement field at a high number in the second install (since I can estimate that there will never by > 10 000 records) + store all queries that were performed & run them in the network-master afterwards. I'd like to create a setup where there are exactly 2 masters which need to be synchronized against each other. The two masters should have read+write access, but don't have a permanent connection to each other. One will be on a LAN-server, the other instance will be installed on a Windows-client-laptop which can be taken along the road. When coming back to the office, we need to sync the changed data. is there any tool that will allow me to do so ? If you got *really* clever you could maybe pull it off with Slony, but in general, no, this isn't possible.
Re: [ADMIN] replication?
would there be any default available field (like the OID of the records) that would be unique in the two versions of the datbase? there isn't "by accident" something like a unique UID like an MD5 or something... ? cause if there is no replication available, I'd consider this (together with PHP) a) replacing the serial fields by generated UID's (md5 of ID + a string that depends on the install) or b) start the autoincrement field at a high number in the second install (since I can estimate that there will never by > 10 000 records) + store all queries that were performed & run them in the network-master afterwards. >> >> I'd like to create a setup where there are exactly 2 masters which >> need to be synchronized against each other. The two masters should >> have read+write access, but don't have a permanent connection to each >> other. One will be on a LAN-server, the other instance will be >> installed on a Windows-client-laptop which can be taken along the >> road. When coming back to the office, we need to sync the changed >> data. >> >> is there any tool that will allow me to do so ? > If you got *really* clever you could maybe pull it off with Slony, but > in general, no, this isn't possible. -- Best regards, TomDBmailto:[EMAIL PROTECTED] ---(end of broadcast)--- TIP 4: Have you searched our list archives? http://archives.postgresql.org
Re: [ADMIN] replication?
hmm - I was hoping to have it in a database supported by PHP, preferably freely available. MySQL would be OK too, but I didn't find it there either. Strange, cause to my knowledge 'even' MS Access offers it - I used it before in the Access 97 version. And Access it not what I'd call a decent database. > [Offline multi master replication] >> If you got *really* clever you could maybe pull it off with Slony, but >> in general, no, this isn't possible. > If this is an option, FrontBase offers support for that. You might > contact them directly. > http://www.frontbase.com ---(end of broadcast)--- TIP 2: Don't 'kill -9' the postmaster
Re: [ADMIN] replication?
On Mon, Nov 13, 2006 at 10:21:40PM +0100, TomDB wrote: > > I'd like to create a setup where there are exactly 2 masters which > need to be synchronized against each other. The two masters should > have read+write access, but don't have a permanent connection to each > other. One will be on a LAN-server, the other instance will be > installed on a Windows-client-laptop which can be taken along the > road. When coming back to the office, we need to sync the changed > data. > > is there any tool that will allow me to do so ? If you got *really* clever you could maybe pull it off with Slony, but in general, no, this isn't possible. -- Jim Nasby[EMAIL PROTECTED] EnterpriseDB http://enterprisedb.com 512.569.9461 (cell) ---(end of broadcast)--- TIP 7: You can help support the PostgreSQL project by donating at http://www.postgresql.org/about/donate
[ADMIN] replication?
I'd like to create a setup where there are exactly 2 masters which need to be synchronized against each other. The two masters should have read+write access, but don't have a permanent connection to each other. One will be on a LAN-server, the other instance will be installed on a Windows-client-laptop which can be taken along the road. When coming back to the office, we need to sync the changed data. is there any tool that will allow me to do so ? ---(end of broadcast)--- TIP 1: if posting/reading through Usenet, please send an appropriate subscribe-nomail command to [EMAIL PROTECTED] so that your message can get through to the mailing list cleanly
[ADMIN] replication loop
Hi, I am using Pgcluster 1.3 and Postgres 8. Can you tell me meaning of this messages from pgreplicate in verbose mode: 1. DEBUG:replicate_loop():replicate_loop selected 2. DEBUG:replicate_loop(): PGRread_packet failed query[(null)] cmdSys[] Thanx for your time. -- Anton P. Linevich ---(end of broadcast)--- TIP 3: Have you checked our extensive FAQ? http://www.postgresql.org/docs/faq
Re: [ADMIN] Replication solutions high volume db
> > I think I've narrowed it down to Slony and Mammoth. > Any pro's or con's on one vs the other? Slony is more complicated to setup. Slony requires triggers and cron. Slony is asynchronous Slony is Open Source If Slony breaks you can call Command Prompt It used to be that Slony was timed replication. I do not know if that is still the case. Mammoth is about as easy as it can be to setup. Mammoth does not require triggers or cron Mammoth is asynchronous Mammoth costs $$$ Mammoth is set to be optionally synchronous in June. Mammoth replicates on a per comitted transaction basis. Mammoth Replicator is PostgreSQL with integrated replication. If Mammoth breaks you can call Command Prompt ;) > > Some area where our environement might stretch a solution. > Some records can be large. Limitied to one table but they can be 40K+ > of chraracters in a column. As long as that is not the primary key, there wouldn't be a problem. The length of the primary key can not be greater than 8k with Mammoth. > > High volume of inserts coming during nightly load (millions of rows). > These loads are coming in commited blocks of 100. No problem. > > That cannot slow down the replication. > Our call center agents needs access to them asap. > > Any locking issues on the master during the replication process? Neither Mammoth or Slony require any exclusive locks to replicate the data. Sincerely, Joshua D. Drake > Anything else I should be concerned about or things I need to consider? > Personal experiences you have had running either. > > tia > David > > ---(end of broadcast)--- > TIP 7: don't forget to increase your free space map settings -- Command Prompt, Inc., Your PostgreSQL solutions company. 503-667-4564 Custom programming, 24x7 support, managed services, and hosting Open Source Authors: plPHP, pgManage, Co-Authors: plPerlNG Reliable replication, Mammoth Replicator - http://www.commandprompt.com/ ---(end of broadcast)--- TIP 5: Have you checked our extensive FAQ? http://www.postgresql.org/docs/faq ---(end of broadcast)--- TIP 1: if posting/reading through Usenet, please send an appropriate subscribe-nomail command to [EMAIL PROTECTED] so that your message can get through to the mailing list cleanly
Re: [ADMIN] Replication solutions high volume db
> > Generally speaking I'd expect Mammoth to handle high loads a little > better since it's a log shipper and not trigger based. So, if slony > proves too slow for this situation, then I'd recommend asking the folks > at Command Prompt for a demo of their system to see if it can. http://www.commandprompt.com/download Sincerely, Joshua D. Drake > > ---(end of broadcast)--- > TIP 4: Don't 'kill -9' the postmaster -- Command Prompt, Inc., Your PostgreSQL solutions company. 503-667-4564 Custom programming, 24x7 support, managed services, and hosting Open Source Authors: plPHP, pgManage, Co-Authors: plPerlNG Reliable replication, Mammoth Replicator - http://www.commandprompt.com/ ---(end of broadcast)--- TIP 2: you can get off all lists at once with the unregister command (send "unregister YourEmailAddressHere" to [EMAIL PROTECTED]) ---(end of broadcast)--- TIP 1: if posting/reading through Usenet, please send an appropriate subscribe-nomail command to [EMAIL PROTECTED] so that your message can get through to the mailing list cleanly
[ADMIN] Replication SOlutions for PostgreSQL Master to Slave
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 We have installed a product called Quasar for accounting needs at our company, which is back ended by PostgreSQL. It is a requirement that the database is replicated, real time, to a secondary machine and PostgreSQL database, in case of failure of the first. Currently i have Slony working, but am not satisfied with how it accomplishes replication, or it's interface, and am curious what others are using to accomplish replication? Thanks in advance, k. - -- Kirby Ubben Systems Engineer McMurray Hatchery [EMAIL PROTECTED] -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.1 (MingW32) Comment: Using GnuPG with Thunderbird - http://enigmail.mozdev.org iD8DBQFDWRSfthkzRAQDSgERAnyrAJ9xGZMeQpiA6/pW9Uxf90l4M+PU3ACfZGCx vYhQYGqio5ppiYIZuGmgH8g= =Q6JV -END PGP SIGNATURE- ---(end of broadcast)--- TIP 1: if posting/reading through Usenet, please send an appropriate subscribe-nomail command to [EMAIL PROTECTED] so that your message can get through to the mailing list cleanly
Re: [ADMIN] Replication Solutions for PostgreSQL Master to Slave
-BEGIN PGP SIGNED MESSAGE-
Hash: SHA1
Chris Browne wrote:
>[EMAIL PROTECTED] ("Joshua D. Drake") writes:
>
>>>You are looking for synchronous replication as opposed to async?
>>>
Currently i have Slony working, but am not satisfied with how it
accomplishes replication, or it's interface, and am curious what
others are using to accomplish replication?
>>
>>There is also Mammoth Replicator:
>>
>>http://www.commandprompt.com/products/mammothreplicator
>>
>>It is a commercial product (I work for CMD) but it is widely used
>>in the corporate environment and you may find it a little easier
>>to manage.
>
>
>A vital difference is that Slony-I extracts replication information
>(e.g. - determines what it needs to replicate) via triggers on the
>tables, whereas Mammoth Replicator takes the (quite common in the
>industry) approach of reading update information out of the
>transaction logs.
>
>There are a number of differences between the approaches, but in the
>conversations with people at OSCON, it seemed surprisingly common for
>the similarities to make it seem that when Slony-I was inadequate,
>Mammoth Replicator would be too.
>
>Of course, this particular discussion hasn't extracted enough
>information about the dissatisfaction to evaluate much of anything...
This is all true. The issues with slony are, as you guessed correctly,
are based around the triggers, and relatively cumbersome
administration overhead for a high number of tables, and dynamic table
creation.
The application will indeed come to a more stable database scheme in
the future, but as it is right now, if each table added needs to have
triggers in place to include it in replication, i have alot of work to
deal with.
It is very possible pgcluster may be a better solution, and i am
currently setting it up on a test machine.
I am also limited in what solutions i can use based on platform. for
whatever reasons, i need to be able to use the replication solution on
two intel SuSE 9.0 Professional machines. I was told Mammoth wasn't
available for this version of SuSE. (by the install script. ;p)
Any and all advice is appreciated.
- --
Kirby Ubben
Systems Engineer
McMurray Hatchery
[EMAIL PROTECTED]
1 515 832 1235 ext 201
-BEGIN PGP SIGNATURE-
Version: GnuPG v1.4.1 (MingW32)
Comment: Using GnuPG with Thunderbird - http://enigmail.mozdev.org
iD8DBQFDWWl3thkzRAQDSgERAi+8AJ4hcoI1ytDzzFx5YmcQylbDZsLBqwCeKxr1
43fQvYdxXMyh7MT6nWp+pxg=
=JQad
-END PGP SIGNATURE-
---(end of broadcast)---
TIP 2: Don't 'kill -9' the postmaster
Re: [ADMIN] Replication Solutions for PostgreSQL Master to Slave
[EMAIL PROTECTED] ("Joshua D. Drake") writes:
>> You are looking for synchronous replication as opposed to async?
>>
>> >Currently i have Slony working, but am not satisfied with how it
>> >accomplishes replication, or it's interface, and am curious what
>> >others are using to accomplish replication?
>
> There is also Mammoth Replicator:
>
> http://www.commandprompt.com/products/mammothreplicator
>
> It is a commercial product (I work for CMD) but it is widely used
> in the corporate environment and you may find it a little easier
> to manage.
A vital difference is that Slony-I extracts replication information
(e.g. - determines what it needs to replicate) via triggers on the
tables, whereas Mammoth Replicator takes the (quite common in the
industry) approach of reading update information out of the
transaction logs.
There are a number of differences between the approaches, but in the
conversations with people at OSCON, it seemed surprisingly common for
the similarities to make it seem that when Slony-I was inadequate,
Mammoth Replicator would be too.
Of course, this particular discussion hasn't extracted enough
information about the dissatisfaction to evaluate much of anything...
--
output = ("cbbrowne" "@" "cbbrowne.com")
http://cbbrowne.com/info/spiritual.html
There was a young lady of Crewe
Whose limericks stopped at line two.
---(end of broadcast)---
TIP 4: Have you searched our list archives?
http://archives.postgresql.org
Re: [ADMIN] Replication Solutions for PostgreSQL Master to Slave
> You are looking for synchronous replication as opposed to async? > > >Currently i have Slony working, but am not satisfied with how it > >accomplishes replication, or it's interface, and am curious what > >others are using to accomplish replication? There is also Mammoth Replicator: http://www.commandprompt.com/products/mammothreplicator It is a commercial product (I work for CMD) but it is widely used in the corporate environment and you may find it a little easier to manage. Sincerely, Joshua D. Drake -- The PostgreSQL Company - Command Prompt, Inc. 1.503.667.4564 PostgreSQL Replication, Consulting, Custom Development, 24x7 support Managed Services, Shared and Dedicated Hosting Co-Authors: plPHP, plPerlNG - http://www.commandprompt.com/ ---(end of broadcast)--- TIP 5: don't forget to increase your free space map settings
Re: [ADMIN] Replication Solutions for PostgreSQL Master to Slave
Kirby Ubben wrote: -BEGIN PGP SIGNED MESSAGE- Hash: SHA1 We have installed a product called Quasar for accounting needs at our company, which is back ended by PostgreSQL. It is a requirement that the database is replicated, real time, to a secondary machine and PostgreSQL database, in case of failure of the first. You are looking for synchronous replication as opposed to async? Currently i have Slony working, but am not satisfied with how it accomplishes replication, or it's interface, and am curious what others are using to accomplish replication? Well, the two main projects that people are using are: Slony-I (Async, master/slave) PgPool (sync, load balancing possibilities) Best Wishes, Chris Travers Metatron Technology COnsulting begin:vcard fn:Chris Travers n:Travers;Chris email;internet:[EMAIL PROTECTED] x-mozilla-html:FALSE version:2.1 end:vcard ---(end of broadcast)--- TIP 4: Have you searched our list archives? http://archives.postgresql.org
Re: [ADMIN] Replication Solutions for PostgreSQL Master to Slave
On Fri, Oct 21, 2005 at 11:28:36AM -0500, Kirby Ubben wrote: > Currently i have Slony working, but am not satisfied with how it > accomplishes replication, or it's interface, and am curious what > others are using to accomplish replication? What do you find unsatisfactory (or, for that matter, dissatisfactory) about Slony? I expect the developers would like to know. A -- Andrew Sullivan | [EMAIL PROTECTED] A certain description of men are for getting out of debt, yet are against all taxes for raising money to pay it off. --Alexander Hamilton ---(end of broadcast)--- TIP 9: In versions below 8.0, the planner will ignore your desire to choose an index scan if your joining column's datatypes do not match
Re: [ADMIN] Replication Solutions for PostgreSQL Master to Slave
Unfortunately, the only syncronous replication I know of is http://pgfoundry.org/projects/pgcluster/, which is statement-based. That means it's got some substantial drawbacks... On Fri, Oct 21, 2005 at 11:28:36AM -0500, Kirby Ubben wrote: > -BEGIN PGP SIGNED MESSAGE- > Hash: SHA1 > > > We have installed a product called Quasar for accounting needs at our > company, which is back ended by PostgreSQL. It is a requirement that > the database is replicated, real time, to a secondary machine and > PostgreSQL database, in case of failure of the first. > > Currently i have Slony working, but am not satisfied with how it > accomplishes replication, or it's interface, and am curious what > others are using to accomplish replication? > > Thanks in advance, > > k. > > - -- > Kirby Ubben > Systems Engineer > McMurray Hatchery > [EMAIL PROTECTED] > > 1 515 832 1235 ext 201 > -BEGIN PGP SIGNATURE- > Version: GnuPG v1.4.1 (MingW32) > Comment: Using GnuPG with Thunderbird - http://enigmail.mozdev.org > > iD8DBQFDWRc0thkzRAQDSgERAhSrAJ9Ax5nwDMlOUiRw8jcczmU7PJo8LgCeMf3a > gIFKb7oH7+4zuAEZyQYowh0= > =CIAC > -END PGP SIGNATURE- > > > ---(end of broadcast)--- > TIP 4: Have you searched our list archives? > >http://archives.postgresql.org > -- Jim C. Nasby, Sr. Engineering Consultant [EMAIL PROTECTED] Pervasive Software http://pervasive.comwork: 512-231-6117 vcard: http://jim.nasby.net/pervasive.vcf cell: 512-569-9461 ---(end of broadcast)--- TIP 2: Don't 'kill -9' the postmaster
[ADMIN] Replication Solutions for PostgreSQL Master to Slave
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 We have installed a product called Quasar for accounting needs at our company, which is back ended by PostgreSQL. It is a requirement that the database is replicated, real time, to a secondary machine and PostgreSQL database, in case of failure of the first. Currently i have Slony working, but am not satisfied with how it accomplishes replication, or it's interface, and am curious what others are using to accomplish replication? Thanks in advance, k. - -- Kirby Ubben Systems Engineer McMurray Hatchery [EMAIL PROTECTED] 1 515 832 1235 ext 201 -BEGIN PGP SIGNATURE- Version: GnuPG v1.4.1 (MingW32) Comment: Using GnuPG with Thunderbird - http://enigmail.mozdev.org iD8DBQFDWRc0thkzRAQDSgERAhSrAJ9Ax5nwDMlOUiRw8jcczmU7PJo8LgCeMf3a gIFKb7oH7+4zuAEZyQYowh0= =CIAC -END PGP SIGNATURE- ---(end of broadcast)--- TIP 4: Have you searched our list archives? http://archives.postgresql.org
Re: [ADMIN] Replication
>Are there any non-statement level solution? Something that appends to the WAL >> on the slave server? For this kind of solution I'm also looking for a while - but in the meantime you can also take a look at "slony" - it can do really many things. Don't give up at the beginning, after you've understood how it works you will like it ;-) Craig Servin wrote: > Are there any non-statement level solution? Something that appends to the > WAL > on the slave server? > > > > On Tuesday 20 September 2005 12:28 pm, Jim C. Nasby wrote: > >>There's also pgcluster, but keep in mind that these are all >>statement-level replication solutions which have some rather big >>gotchas. >> >>On Mon, Sep 19, 2005 at 03:24:31PM -0500, Scott Marlowe wrote: >> >>>On Mon, 2005-09-19 at 02:02, the vespadict wrote: >>> Hi , I want high Availability but I don't need load balance. I need sync replication if is posible using two way. >>> >>>If you need sync, then pgpool may be a good choice, or client side >>>replication like C-JDBC or something like that. >>> >>>pgpool doesn't HAVE to do load balancing, it can do simple two way sync >>>replication if that's what you need. >>> >>>---(end of broadcast)--- >>>TIP 1: if posting/reading through Usenet, please send an appropriate >>> subscribe-nomail command to [EMAIL PROTECTED] so that your >>> message can get through to the mailing list cleanly > > > ---(end of broadcast)--- > TIP 4: Have you searched our list archives? > >http://archives.postgresql.org > ---(end of broadcast)--- TIP 4: Have you searched our list archives? http://archives.postgresql.org
Re: [ADMIN] Replication
Are there any non-statement level solution? Something that appends to the WAL on the slave server? On Tuesday 20 September 2005 12:28 pm, Jim C. Nasby wrote: > There's also pgcluster, but keep in mind that these are all > statement-level replication solutions which have some rather big > gotchas. > > On Mon, Sep 19, 2005 at 03:24:31PM -0500, Scott Marlowe wrote: > > On Mon, 2005-09-19 at 02:02, the vespadict wrote: > > > Hi , > > > > > > I want high Availability but I don't need load balance. I need sync > > > replication if is posible using two way. > > > > If you need sync, then pgpool may be a good choice, or client side > > replication like C-JDBC or something like that. > > > > pgpool doesn't HAVE to do load balancing, it can do simple two way sync > > replication if that's what you need. > > > > ---(end of broadcast)--- > > TIP 1: if posting/reading through Usenet, please send an appropriate > >subscribe-nomail command to [EMAIL PROTECTED] so that your > >message can get through to the mailing list cleanly ---(end of broadcast)--- TIP 4: Have you searched our list archives? http://archives.postgresql.org
Re: [ADMIN] Replication
There's also pgcluster, but keep in mind that these are all statement-level replication solutions which have some rather big gotchas. On Mon, Sep 19, 2005 at 03:24:31PM -0500, Scott Marlowe wrote: > On Mon, 2005-09-19 at 02:02, the vespadict wrote: > > Hi , > > > > I want high Availability but I don't need load balance. I need sync > > replication if is posible using two way. > > If you need sync, then pgpool may be a good choice, or client side > replication like C-JDBC or something like that. > > pgpool doesn't HAVE to do load balancing, it can do simple two way sync > replication if that's what you need. > > ---(end of broadcast)--- > TIP 1: if posting/reading through Usenet, please send an appropriate >subscribe-nomail command to [EMAIL PROTECTED] so that your >message can get through to the mailing list cleanly > -- Jim C. Nasby, Sr. Engineering Consultant [EMAIL PROTECTED] Pervasive Software http://pervasive.comwork: 512-231-6117 vcard: http://jim.nasby.net/pervasive.vcf cell: 512-569-9461 ---(end of broadcast)--- TIP 6: explain analyze is your friend
