Re: [GENERAL] incremental dumps

2013-08-11 Thread Michael Nolan
On 8/10/13, haman...@t-online.de wrote: > currently the source uses some 20 GB in a database partition and about 700 > GB > in a general data partition. For the database, a diff -e grows to about 10% > of the size > of a full dump in a week > The remote site is a raid box at a hosting center, wit

Re: [GENERAL] incremental dumps

2013-08-09 Thread hamann . w
>> On 8/1/13, haman...@t-online.de wrote: >> > Hi, >> > I want to store copies of our data on a remote machine as a security >> > measure. >> >> >> > Wolfgang >> >> 2 questions: >> >> 1. How secure is the remote site? >> 2. How much data are we talking about? >> -- >> Mike Nolan Hi Mike, c

Re: [GENERAL] incremental dumps

2013-08-09 Thread Michael Nolan
On 8/1/13, haman...@t-online.de wrote: > Hi, > I want to store copies of our data on a remote machine as a security > measure. > Wolfgang 2 questions: 1. How secure is the remote site? 2. How much data are we talking about? -- Mike Nolan -- Sent via pgsql-general mailing list (pgsql-gener

Re: [GENERAL] incremental dumps

2013-08-09 Thread Jeff Janes
On Thu, Aug 1, 2013 at 1:59 AM, wrote: > Hi, > I want to store copies of our data on a remote machine as a security measure. Can you describe what your security concerns are? Are you worried about long-lasting malicious tampering with the data that you need to be able to recover from? Simple l

Re: [GENERAL] incremental dumps

2013-08-05 Thread hamann . w
Luca Ferrari wrote: On Fri, Aug 2, 2013 at 6:55 PM, wrote: > thanks for the hint - this is probably one of the things to do. > I have something else in mind, but at present I just suspect that this might > happen: > when I modify data and select _without an ordering_, I am pretty sure to get

Re: [GENERAL] incremental dumps

2013-08-05 Thread Luca Ferrari
On Fri, Aug 2, 2013 at 6:55 PM, wrote: > thanks for the hint - this is probably one of the things to do. > I have something else in mind, but at present I just suspect that this might > happen: > when I modify data and select _without an ordering_, I am pretty sure to get > the data > in a dif

Re: [GENERAL] incremental dumps

2013-08-02 Thread hamann . w
>> On 08/01/2013 02:59 AM, haman...@t-online.de wrote: >> > >> > However, the diff files seem to be considerably larger than one would >> > expect. >> > One obvious part of the problem is the fact that diff shows old and new >> > text, >> >> You could try using >> diff --suppress-common-line

Re: [GENERAL] incremental dumps

2013-08-02 Thread Martin Collins
On 08/01/2013 02:59 AM, haman...@t-online.de wrote: > > However, the diff files seem to be considerably larger than one would expect. > One obvious part of the problem is the fact that diff shows old and new text, You could try using diff --suppress-common-lines -ed which in my experience create

Re: [GENERAL] incremental dumps

2013-08-01 Thread Bèrto ëd Sèra
> suppose wal archiving or PITR would be better +1, never re-invent the wheel, unless you really need to. Bèrto On 1 August 2013 14:14, Luca Ferrari wrote: > On Thu, Aug 1, 2013 at 10:59 AM, wrote: > > > However, the diff files seem to be considerably larger than one would > expect. > > One

Re: [GENERAL] incremental dumps

2013-08-01 Thread Luca Ferrari
On Thu, Aug 1, 2013 at 10:59 AM, wrote: > However, the diff files seem to be considerably larger than one would expect. > One obvious part of the problem is the fact that diff shows old and new text, > so e.g. changing the amount of stock for a product with a 1kB description > would generate at

[GENERAL] incremental dumps

2013-08-01 Thread hamann . w
Hi, I want to store copies of our data on a remote machine as a security measure. My first attempt was a full dump (which takes too long to upload) followed by diffs between the pgdump files. This provides readable / searchable versioned data (I could alway apply the diffs on the remote machine and