Re: [GENERAL] Backups over slave instead master?

2014-05-29 Thread hubert depesz lubaczewski
OmniPITR (https://github.com/omniti-labs/omnipitr) has working backups off slave. Working as in - we were using in it production since 8.3 at least. depesz On Thu, May 29, 2014 at 8:02 PM, Andres Freund wrote: > Hi, > > On 2014-05-16 12:49:25 +0530, chiru r wrote: > > Yes, It is possible to ex

Re: [GENERAL] Backups over slave instead master?

2014-05-29 Thread Andres Freund
Hi, On 2014-05-16 12:49:25 +0530, chiru r wrote: > Yes, It is possible to execute backups on the slave server instead of > master. > > Below are the steps we run for one of our past customer every day to > refresh his Dev/test environments using slave backups. > > *On Slave:* > > 1. Pause the r

Re: [GENERAL] Backups over slave instead master?

2014-05-16 Thread chiru r
Hi , Yes, It is possible to execute backups on the slave server instead of master. Below are the steps we run for one of our past customer every day to refresh his Dev/test environments using slave backups. *On Slave:* 1. Pause the replication postgres=# select pg_xlog_replay_pause(); pg_xlo

Re: [GENERAL] Backups over slave instead master?

2014-05-15 Thread bricklen
On Thu, May 15, 2014 at 1:55 PM, Bruce Momjian wrote: > On Thu, May 1, 2014 at 12:39:44PM -0700, bricklen wrote: > > Or alternatively, if "backup" = pg_dump, then backups can taken from the > slave > > too. Have a look at pg_xlog_replay_pause() + pg_dump + > pg_xlog_replay_resume(). > > http://w

Re: [GENERAL] Backups over slave instead master?

2014-05-15 Thread Bruce Momjian
On Thu, May 1, 2014 at 12:39:44PM -0700, bricklen wrote: > > On Thu, May 1, 2014 at 8:54 AM, Shaun Thomas wrote: > > On 05/01/2014 10:31 AM, Edson Richter wrote: > > > I'm wondering if would be possible to execute these backups in the > slave > server instead, so I

Re: [GENERAL] Backups over slave instead master?

2014-05-02 Thread Shaun Thomas
On 05/02/2014 09:46 AM, Edson Richter wrote: Yes, backup = pg_dump. Can I use it on slave even on 9.2.7? Yes. The reason I suggested 9.3 was assuming you were using pg_basebackup, rsync, or a similar tool to backup the database binaries. You should be fine with pg_dump. -- Shaun Thomas Opt

Re: [GENERAL] Backups over slave instead master?

2014-05-02 Thread Edson Richter
Em 01/05/2014 16:39, bricklen escreveu: On Thu, May 1, 2014 at 8:54 AM, Shaun Thomas > wrote: On 05/01/2014 10:31 AM, Edson Richter wrote: I'm wondering if would be possible to execute these backups in the slave server instead, so I

Re: [GENERAL] Backups over slave instead master?

2014-05-01 Thread bricklen
On Thu, May 1, 2014 at 8:54 AM, Shaun Thomas wrote: > On 05/01/2014 10:31 AM, Edson Richter wrote: > > I'm wondering if would be possible to execute these backups in the slave >> server instead, so I can avoid the overhead of backups on master system? >> > > If you're on PostgreSQL 9.3, you can b

Re: [GENERAL] Backups over slave instead master?

2014-05-01 Thread Shaun Thomas
On 05/01/2014 10:31 AM, Edson Richter wrote: I'm wondering if would be possible to execute these backups in the slave server instead, so I can avoid the overhead of backups on master system? If you're on PostgreSQL 9.3, you can backup the slave server safely. If not, you'll need to run this c

[GENERAL] Backups over slave instead master?

2014-05-01 Thread Edson Richter
I've a basic setup with async replication between two distant, geographically separated servers over vpn. Replication happens every 0.5 seconds or so, and is incredible reliable. Today, I've been using backup on master server every twelve hours. I'm wondering if would be possible to execute these

Re: [GENERAL] Backups using Solaris ZFS Snapshots

2012-04-24 Thread Michael Nolan
On Tue, Apr 24, 2012 at 4:08 PM, Yunong J Xiao wrote: > I am currently backing up my postgres instances using ZFS snapshots > instead of the sanctioned pg_dump utility mainly because I am running on > Solaris and it offers a copy-on-write file system. Anecdotally this has > been working fine for

[GENERAL] Backups using Solaris ZFS Snapshots

2012-04-24 Thread Yunong J Xiao
I am currently backing up my postgres instances using ZFS snapshots instead of the sanctioned pg_dump utility mainly because I am running on Solaris and it offers a copy-on-write file system. Anecdotally this has been working fine for me. Are there any issues I should be aware of since I'm not usin

Re: [GENERAL] Backups

2012-03-15 Thread Bret Stern
Perhaps a RAM DISK could be considered in the equation On Thu, 2012-03-15 at 16:30 +0100, Albe Laurenz wrote: > Richard Harley wrote: > > Very simple question - does pg_dump/dumpall hit the server in terms > of database performance? We > > currently do nightly backups and I want to move to ho

Re: [GENERAL] Backups

2012-03-15 Thread Albe Laurenz
Richard Harley wrote: > Very simple question - does pg_dump/dumpall hit the server in terms of database performance? We > currently do nightly backups and I want to move to hourly backups but not at the expense of hogging > all the resources for 5 mins. > > Pg_dumpall is currently producing a 1GB

Re: [GENERAL] Backups

2012-03-15 Thread Scott Marlowe
On Thu, Mar 15, 2012 at 6:15 AM, Richard Harley wrote: > Hello all > > Very simple question -  does pg_dump/dumpall hit the server in terms of > database performance? We currently do nightly backups and I want to move to > hourly backups but not at the expense of hogging all the resources for 5 >

Re: [GENERAL] Backups

2012-03-15 Thread Bèrto ëd Sèra
Hi yes, if you get like ~2.5 when running it in peak hour it should definitely be harmless. Bèrto On 15 March 2012 12:37, Richard Harley wrote: > ** > Thanks for a quick reply. The server has 6 cores, 6GB ram and top gets to > 2.3-2.5 load average when running the dumpall. So I assume we are n

Re: [GENERAL] Backups

2012-03-15 Thread Richard Harley
Thanks for a quick reply. The server has 6 cores, 6GB ram and top gets to 2.3-2.5 load average when running the dumpall. So I assume we are nowhere near this causing performance issues for users? Thanks Rich On 15/03/12 12:21, Bèrto ëd Sèra wrote: Hi Richard, it's no easy answer. If your s

Re: [GENERAL] Backups

2012-03-15 Thread Bèrto ëd Sèra
Hi Richard, it's no easy answer. If your server has plenty of free resources there won't be trouble, but I do have customers who cannot even imagine of launching a dump in normal traffic hours. How loaded is your box, currently? Cheerio Bèrto On 15 March 2012 12:15, Richard Harley wrote: > **

[GENERAL] Backups

2012-03-15 Thread Richard Harley
Hello all Very simple question - does pg_dump/dumpall hit the server in terms of database performance? We currently do nightly backups and I want to move to hourly backups but not at the expense of hogging all the resources for 5 mins. Pg_dumpall is currently producing a 1GB file - that's t

Re: [GENERAL] Backups and binary mode

2011-08-29 Thread pasman pasmański
> Simple benchmark show that COPY BINARY is 8 times faster > than COPY CSV on my desktop. > > I retry benchmark, and differences are small. pasman -- Sent via pgsql-general mailing list (pgsql-general@postgresql.org) To make changes to your subscription: http://www.postgresql.org/

[GENERAL] Backups and binary mode

2011-08-29 Thread pasman pasmański
Hi. Is this possible to force pg_dump to make backups using COPY ... BINARY ? Simple benchmark show that COPY BINARY is 8 times faster than COPY CSV on my desktop. Postgresql 8.4.8 , WinXp sp3 pasman -- Sent via pgsql-general mailing list (pgsql-general@postgresql.org) To make ch

Re: [GENERAL] Backups with continuous archiving

2011-03-23 Thread Vibhor Kumar
On Mar 22, 2011, at 5:20 AM, runner wrote: > A) CREATING FILESSYSTEM SNAPSHOTS - We're snapping the data, wal and archive > directories. We only plan on using the data snap and that's just so we can > perform the backup faster. Will the wal and archive snapshots be useful for > anything?

[GENERAL] Backups with continuous archiving

2011-03-21 Thread runner
Using Postgres 9.0.3 on Solaris 10 (Sparc). I have a few questions concerning hot backups with continuous archiving. We have read and think we understand the Postgres documentation on backup and restore located here: http://www.postgresql.org/docs/9.0/static/continuous-archiving.html We

Re: [GENERAL] Backups / replication

2010-06-18 Thread Greg Smith
Adrian von Bidder wrote: I don't know the rpm builds you're using; the Debian packages allow configuring two instances on two different ports AFAIK. Possibly the rpm installation do, too. Even if not: hacking up a 2nd start script which runs postgres against a different data directory / conf

Re: [GENERAL] Backups / replication

2010-06-15 Thread Adrian von Bidder
[continuous backup] On Tuesday 15 June 2010 21.42:52 Oliver Kohll - Mailing Lists wrote: > 1) Continuously ship the WAL records to somewhere on the test server > unknown to Postgres but run the test machine as a normal database > completely separately. If a backup is needed, delete the test databa

Re: [GENERAL] Backups / replication

2010-06-15 Thread Alan Hodgson
On Tuesday, June 15, 2010, "Oliver Kohll - Mailing Lists" wrote: > Are either of those two likely? Any other suggestions? Another question > is will the replication coming in v9.0 change things and would it be > worth holding off until then? In particular Command Prompt's PITR tools > look useful

[GENERAL] Backups / replication

2010-06-15 Thread Oliver Kohll - Mailing Lists
Hello, I'm interested in using WAL shipping / replication for backup purposes but have no interest in failover. Currently my situation is: I have two servers, live and backup, which are in different cities. The backup server is also a test/development machine. Backups of my most important data

Re: [GENERAL] Backups

2009-11-16 Thread Jasen Betts
On 2009-11-08, Bret wrote: > > I need to back up a production database every night > on FreeBSD 7.2, running Postgresql 8.3. > > Any good backup tips I should be aware of. I backup using pgdump and move the dumps offsite using rsync --compress overwriting a copy of yesterdays backup in this

Re: [GENERAL] Backups

2009-11-08 Thread Uwe Schroeder
Personally I prefer multiple stages of backups off-site. So for my production webserver database, I have slony replicating the database to a different location. In addition I run full dumps every 12 hours which in turn I replicate using rdist to a remote system. That way, whatever happens, the m

[GENERAL] Backups

2009-11-08 Thread Bret
I need to back up a production database every night on FreeBSD 7.2, running Postgresql 8.3. Any good backup tips I should be aware of. Typically, I make a backup based on the current day, and rotate the seven days in the backup file name (eg; sat_backup, sun_backup etc). Thanks for all the cha

Re: [GENERAL] backups

2004-07-01 Thread vinny
On Wed, 30 Jun 2004 22:32:26 -0500, [EMAIL PROTECTED] (Bruno Wolff III) wrote: >On Wed, Jun 30, 2004 at 18:23:08 -0500, > [EMAIL PROTECTED] wrote: >> >> What do other sites with mondo databases do? > >There have been comments from people using storage systems that they >can freeze the storage sy

Re: [GENERAL] backups

2004-07-01 Thread Christopher Petrilli
On Wed, 30 Jun 2004 18:23:08 -0500, [EMAIL PROTECTED] <[EMAIL PROTECTED]> wrote: > > What do other sites with mondo databases do? > Let me offer the ideas of what I've used in some high-end environments before. First, we've always used a mirror configuration in most situations, simply for reliabil

Re: [GENERAL] backups

2004-06-30 Thread Dennis Gearon
Bruno Wolff III wrote: On Wed, Jun 30, 2004 at 18:23:08 -0500, [EMAIL PROTECTED] wrote: What do other sites with mondo databases do? There have been comments from people using storage systems that they can freeze the storage system and get a consistant snap shot of the file system. This can be u

Re: [GENERAL] backups

2004-06-30 Thread Bruno Wolff III
On Wed, Jun 30, 2004 at 20:35:04 -0700, Dennis Gearon <[EMAIL PROTECTED]> wrote: > > > Just shutting it down doesn't work? If you can shut the database down then that works fine. Some people can't do that and can't afford the long recovery time either. ---(end of broadca

Re: [GENERAL] backups

2004-06-30 Thread Bruno Wolff III
On Wed, Jun 30, 2004 at 18:23:08 -0500, [EMAIL PROTECTED] wrote: > > What do other sites with mondo databases do? There have been comments from people using storage systems that they can freeze the storage system and get a consistant snap shot of the file system. This can be used to do a restor