Re: [GENERAL] How to increace nightly backup speed

2006-11-30 Thread Martijn van Oosterhout
On Wed, Nov 29, 2006 at 11:21:41PM +0100, Bernhard Weisshuhn wrote: > LZO is pretty much rock solid. It is used in OpenVPN and supposedly was > used for the communication with NASAs Mars Rovers Spirit and > Opportunity, if that counts as trusted. It's also GPL, which makes it a hard sell. Have a

Re: [GENERAL] How to increace nightly backup speed

2006-11-29 Thread Bernhard Weisshuhn
Chris Browne schrieb: > There are other options out there that could conceivably change the > price of compression, such as: > > http://www.lzop.org/ > http://www.quicklz.com/ > > Of course, those are not as well known compression systems, and so are > not as well trusted. Maybe worth looking i

Re: [GENERAL] How to increace nightly backup speed

2006-11-29 Thread Chris Browne
[EMAIL PROTECTED] (Vivek Khera) writes: > On Nov 28, 2006, at 11:11 AM, Andrus wrote: > >> 1. My database size seems to be appox 1 GB and download speed is >> approx 600 >> kb/s. Your solution requires 4.5 hours download time >> since 1 GB of data must be downloaded. > > If you're running pg_dump

Re: [GENERAL] How to increace nightly backup speed

2006-11-28 Thread Vivek Khera
On Nov 28, 2006, at 11:11 AM, Andrus wrote: 1. My database size seems to be appox 1 GB and download speed is approx 600 kb/s. Your solution requires 4.5 hours download time since 1 GB of data must be downloaded. If you're running pg_dump on a remote host, you're transferring the data ove

Re: [GENERAL] How to increace nightly backup speed

2006-11-28 Thread Martijn van Oosterhout
On Tue, Nov 28, 2006 at 03:29:44PM +0200, Andrus wrote: > > If you've got excess CPU capacity at night, I wonder if -Z1 or -Z2 > > would speed the backup since it reduces the amount of data written > > to disk. > > Where to find study which pg_dump compares backup speed and backup size by > using

Re: [GENERAL] How to increace nightly backup speed

2006-11-28 Thread Andrus
> $ ssh 81.50.12.18 "pg_dump -Z0 -Fc -ibv -U myuser mydb" | gzip -9 Alexander, 1. My database size seems to be appox 1 GB and download speed is approx 600 kb/s. Your solution requires 4.5 hours download time since 1 GB of data must be downloaded. 2. I have only 5432 port open to public interne

Re: [GENERAL] How to increace nightly backup speed

2006-11-28 Thread Michael Nolan
On 11/28/06, Andrus <[EMAIL PROTECTED]> wrote: My goal is to create ERP system which creates backups without any attendance. I don'nt know how to automate this 100% and havent found any such sample. Depending on what you plan to do with the backups (like create a fallover server), I don't kno

Re: [GENERAL] How to increace nightly backup speed

2006-11-28 Thread Andrus
> If you've got excess CPU capacity at night, I wonder if -Z1 or -Z2 > would speed the backup since it reduces the amount of data written > to disk. Where to find study which pg_dump compares backup speed and backup size by using various -Z options ? I'm wondering by -Z9 increases backup speed.

Re: [GENERAL] How to increace nightly backup speed

2006-11-28 Thread Andrus
> You might try using online backups. By following the steps in this > document: > > http://www.postgresql.org/docs/8.1/static/backup-online.html > > you can back up the data at the speed of your filesystem. There's no way > to make it faster than that. PITR config is complicated. A lot of manual

Re: [GENERAL] How to increace nightly backup speed

2006-11-27 Thread Ron Johnson
-BEGIN PGP SIGNED MESSAGE- Hash: SHA1 On 11/27/06 19:26, Glen Parker wrote: > Jeff Davis wrote: >> On Mon, 2006-11-27 at 19:13 +0200, Andrus wrote: >>> I need to create nightly backups to separate computer over internet >>> from 8.1 server >>> >>> I tried to run pg_dump to make backup usin

Re: [GENERAL] How to increace nightly backup speed

2006-11-27 Thread Glen Parker
Jeff Davis wrote: On Mon, 2006-11-27 at 19:13 +0200, Andrus wrote: I need to create nightly backups to separate computer over internet from 8.1 server I tried to run pg_dump to make backup using command "..\pg_dump\pg_dump.exe" -i -Z9 -b -v -f "C:\061127 mybackup.backup" -F c -h 81.50.12.18 -

Re: [GENERAL] How to increace nightly backup speed

2006-11-27 Thread Joshua D. Drake
> > > > You might try using online backups. By following the steps in this > document: > > http://www.postgresql.org/docs/8.1/static/backup-online.html > > you can back up the data at the speed of your filesystem. There's no way > to make it faster than that. Note however that you will want to

Re: [GENERAL] How to increace nightly backup speed

2006-11-27 Thread Jeff Davis
On Mon, 2006-11-27 at 19:13 +0200, Andrus wrote: > I need to create nightly backups to separate computer over internet from 8.1 > server > > I tried to run pg_dump to make backup using command > > "..\pg_dump\pg_dump.exe" -i -Z9 -b -v -f "C:\061127 mybackup.backup" -F c -h > 81.50.12.18 -U myuse

Re: [GENERAL] How to increace nightly backup speed

2006-11-27 Thread Alexander Staubo
On Nov 27, 2006, at 18:13 , Andrus wrote: I need to create nightly backups to separate computer over internet from 8.1 server I tried to run pg_dump to make backup using command "..\pg_dump\pg_dump.exe" -i -Z9 -b -v -f "C:\061127 mybackup.backup" -F c -h 81.50.12.18 -U myuser -p 5431 mydb

[GENERAL] How to increace nightly backup speed

2006-11-27 Thread Andrus
I need to create nightly backups to separate computer over internet from 8.1 server I tried to run pg_dump to make backup using command "..\pg_dump\pg_dump.exe" -i -Z9 -b -v -f "C:\061127 mybackup.backup" -F c -h 81.50.12.18 -U myuser -p 5431 mydb but this takes 4.5 hours to complete. How to i