Re: Is there any way to restore/create hardlinks lost in incremental backups?

2020-12-13 Thread Dan Stromberg via rsync
On Sun, Dec 13, 2020 at 11:59 AM Wayne Davison via rsync < rsync@lists.samba.org> wrote: > I should also mention that there are totally valid reasons why the dir > might be huge on day4. For instance, if someone changed the mode on the > files from 664 to 644 then the files cannot be hard-linked t

Re: Is there any way to restore/create hardlinks lost in incremental backups?

2020-12-13 Thread Wayne Davison via rsync
I should also mention that there are totally valid reasons why the dir might be huge on day4. For instance, if someone changed the mode on the files from 664 to 644 then the files cannot be hard-linked together even if the file's data is unchanged. The same goes for differences in preserved xattrs,

Re: Is there any way to restore/create hardlinks lost in incremental backups?

2020-12-13 Thread Wayne Davison via rsync
You could rsync the current day4 dir to a day4.new dir, and list all the prior days as --link-dest options. Make sure that you're using the same xatt/acl options as your official backup command (the options may or may not be present) so that you are preserving the same level of info as the backup.

Re: Is there any way to restore/create hardlinks lost in incremental backups?

2020-12-11 Thread Chris Green via rsync
/ . Hmm, in C but in French) > The program jdupes will do it for you as well. The disadvantage (for me) of jdupes is that, given 40 or so incremental backups (which is what I had when I saw the problem) each with many tens of thousands of files in them it will take a *very* long time to do its

Re: Is there any way to restore/create hardlinks lost in incremental backups?

2020-12-11 Thread Guillaume Outters via rsync
On 2020-12-11 12:53, Chris Green wrote : […] wrote a trivial[ish] script that copied all the backups to a new destination sequentially (using --link-dest) and then removed the original tree, having checked the new backups were OK of course. With the same cause as yours, I once worked out exact

Re: Is there any way to restore/create hardlinks lost in incremental backups?

2020-12-11 Thread Chris Green via rsync
Paul Slootman via rsync wrote: > On Thu 10 Dec 2020, Chris Green via rsync wrote: > > > > Occasionally, because I've moved things around or because I've done > > something else that breaks things, the hard links aren't created as > > they should be and I get a very space consuming backup incremen

Re: Is there any way to restore/create hardlinks lost in incremental backups?

2020-12-11 Thread Paul Slootman via rsync
On Thu 10 Dec 2020, Chris Green via rsync wrote: > > Occasionally, because I've moved things around or because I've done > something else that breaks things, the hard links aren't created as > they should be and I get a very space consuming backup increment. > > Is there any easy way that one can

Re: Is there any way to restore/create hardlinks lost in incremental backups?

2020-12-10 Thread Dan Stromberg via rsync
Hi. Is it possible that, if day4 is consuming too much space, that day3 was an incomplete backup? The rsync wrapper I wrote goes to a little trouble to make sure that incomplete backups aren't allowed. It's called Backup.rsync, and can be found at: https://stromberg.dnsalias.org/~strombrg/Backup

Is there any way to restore/create hardlinks lost in incremental backups?

2020-12-10 Thread Chris Green via rsync
I run a simple self written incremental backup system using rsync's --link-dest option. Occasionally, because I've moved things around or because I've done something else that breaks things, the hard links aren't created as they should be and I get a very space consuming backup increment. Is ther

issues with batch mode for incremental backups

2010-04-13 Thread Andrew Pimlott
Hi! I use rsync batch mode for incremental backups. That is, I create an on-line backup with rsync, and use the --write-batch flag to additionally generate my delta, which I send off-site. To restore, I download a full backup and apply the deltas with --read-batch. This is quite a lovely setup

Re: Help creating incremental backups using --backup-dir.

2009-04-16 Thread Eric Bravick
David, I haven't found any other file systems that directly support HFS meta data... however, you mentioned in your post trying the "mount a NAS based sparse file" approach but that it was unreliable. Honestly, I'd fix whatever on your network is making this unreliable - I use this method

Re: Help creating incremental backups using --backup-dir.

2009-04-15 Thread henri
Hi David, I am also interested to know if anyone has found a file system which will store Mac OS X meta data. In the mean time, I would suggest that you back up to another Mac OS X machine with a pull backup strategy. On 10/04/2009, at 11:05 AM, David Miller wrote: Ok, I figured out th

Re: Help creating incremental backups using --backup-dir.

2009-04-14 Thread henri
://www.lucidsystems.org/tools/lsync When using rsync to perform incremental backups with with hard links enabled, I have found that pulling backups is very robust. In addition, LBackup and LSync (expert system under construction) will also provide you with various options with regards backup reports. Hopefully

Re: Help creating incremental backups using --backup-dir.

2009-04-09 Thread David Miller
Ok, I figured out the problem. I had to put in the full path for the -- backup-dir option. However, I have ran into another problem that makes doing this just about useless. If I rsync to an HFS+ volume it works correctly. If I rsync to a Samba share it gives me errors and puts files it th

Help creating incremental backups using --backup-dir.

2009-04-09 Thread David Miller
Normally I would use the --link-dest option to do this but I can't since I'm rsyncing from a Mac to a Samba share on a Linux box and hard links don't work. What I want to do is create a 10 day rotating incremental backup. I used the first script example on the rsync examples page as a templ

Incremental backups too large

2008-03-05 Thread Robert DuToit
Hi All, Continued good results with rsync 3.0 but I have been noticing that incremental no-change backups of my Home folder (15Gb, 50,000+- files) have been using up on average about 500+-MB of disk space. Thinking back a ways to rsync3.0pre7, or earlier, each incremental took up very li

Re: Incremental backups

2006-06-01 Thread Wayne Davison
On Thu, Jun 01, 2006 at 01:43:01PM +0200, Esteban Dugueperoux wrote: > As I want back up on DAT tapes I would like to have a full backup and > after some incremental backup with differences (modified or added files) > from latest backup (full or incremental backup) and not backup of olds > modif

Incremental backups

2006-06-01 Thread Esteban Dugueperoux
Hi, I want define a incremental backup policy with Rsync. But Rsync can only back up olds releases of modified files. As I want back up on DAT tapes I would like to have a full backup and after some incremental backup with differences (modified or added files) from latest backup (full or incre

Re: restoring incremental backups

2005-06-15 Thread Keith Lofstrom
On Tue, Jun 14, 2005 at 04:11:07PM +0200, Erik Romijn wrote: > Unfortunatly rsnapshot does not do what I need. > The backups should be pushed by the fileserver to the backup server. > This does not appear to be possible with rsnapshot, as far as I can find > it only supports 'pulling' backups from

Re: restoring incremental backups

2005-06-14 Thread Erik Romijn
On Mon, 2005-06-13 at 18:15 +0200, Martin Schröder wrote: > On 2005-06-12 13:39:46 +0200, Erik Romijn wrote: > > A bit complicated, but my problem is this: I want to restore the system > > as it was on friday. > > Use rsnapshot Unfortunatly rsnapshot does not do what I need. The backups should b

Re: restoring incremental backups

2005-06-13 Thread Martin Schröder
On 2005-06-12 13:39:46 +0200, Erik Romijn wrote: > A bit complicated, but my problem is this: I want to restore the system > as it was on friday. Use rsnapshot Best Martin -- http://www.tm.oneiros.de -- To unsubscribe or change options: https://lists.samba.org/mailman/l

Re: restoring incremental backups

2005-06-12 Thread Raphael Jaffey
hard links and restoration is quite straightforward. Quoting Erik Romijn <[EMAIL PROTECTED]>: > Hi, > > I'm using rsync to make incremental backups, which appears to work fine. > I use a script quite similar to the first one on > http://rsync.samba.org/examples.html (i

restoring incremental backups

2005-06-12 Thread Erik Romijn
Hi, I'm using rsync to make incremental backups, which appears to work fine. I use a script quite similar to the first one on http://rsync.samba.org/examples.html (incremental 7 day to remote host). However, I can't seem to find a nice way to restore a backup other than the curr

Re: Incremental Backups

2005-02-19 Thread Joost van den Broek
On Thursday 17 February 2005 02:24, [EMAIL PROTECTED] wrote: > I read the following hint at: > http://www.mikerubel.org/computers/rsync_snapshots/#Incremental > > mv backup.0 backup.1 > rsync -a --delete --link-dest=../backup.1 source_directory/ backup.0/ > > > I simply want to maintain a dated ba

Re: Incremental Backups

2005-02-17 Thread Wayne Davison
On Thu, Feb 17, 2005 at 12:20:57PM -0600, Chris McKeever wrote: > so the chain goes > > hardlink a mirror directory to a new folder > rsync live data to a mirror directory > deleted files between the mirror/live data are then persistant in the > hardlinked daily directories Doing this can tweak t

Re: Incremental Backups

2005-02-17 Thread Hans-Juergen Beie
at 17.02.2005 2:24 [EMAIL PROTECTED] wrote: I read the following hint at: http://www.mikerubel.org/computers/rsync_snapshots/#Incremental mv backup.0 backup.1 rsync -a --delete --link-dest=../backup.1 source_directory/ backup.0/ I simply want to maintain a dated backup of a server so that I could

Re: Incremental Backups

2005-02-17 Thread Chris McKeever
On Thu, 17 Feb 2005 10:02:07 -0800, Wayne Davison <[EMAIL PROTECTED]> wrote: > On Wed, Feb 16, 2005 at 08:24:54PM -0500, [EMAIL PROTECTED] wrote: > > It seems that this method would not use terribly much space in terms of > > duplicating files, however I am not sure of the --delete portion > > In

Re: Incremental Backups

2005-02-17 Thread Wayne Davison
On Wed, Feb 16, 2005 at 08:24:54PM -0500, [EMAIL PROTECTED] wrote: > It seems that this method would not use terribly much space in terms of > duplicating files, however I am not sure of the --delete portion In your command sequence, you are (properly) moving the existing hierarchy of files out o

Re: Incremental Backups

2005-02-17 Thread Chris McKeever
ucture > > for each day for the last seven days, then one weekly snapshot for each > > week in the month and then each month I would like to have as well. here is a script from LINUX HACKS - it will create a local mirror (in this case different HD) of the live file system, and at the s

Re: Incremental Backups

2005-02-17 Thread Paul Slootman
On Wed 16 Feb 2005, [EMAIL PROTECTED] wrote: > > I simply want to maintain a dated backup of a server so that I could > always go back to a certain date. I would like to keep this structure > for each day for the last seven days, then one weekly snapshot for each > week in the month and then e

Incremental Backups

2005-02-16 Thread lists
I read the following hint at: http://www.mikerubel.org/computers/rsync_snapshots/#Incremental mv backup.0 backup.1 rsync -a --delete --link-dest=../backup.1 source_directory/ backup.0/ I simply want to maintain a dated backup of a server so that I could always go back to a certain date. I would

RE: Incremental backups and batch mode.

2002-03-30 Thread Diego Liziero
>You're using the wrong tool -- you want a binary diff program instead. >Run that on your files, then rsync/tar/cp/whatever the diffs. Not exactly, I need the rsync algorithm to check the new version of the file against the checksums of that file calculated when the previous backup was made, and

RE: Incremental backups and batch mode.

2002-03-30 Thread Diego Liziero
>Ah... now I see. Unfortunately, this one's over my head. Can anyone else >help here? Can rsync deal explicitly with parts of files? The rsync program can deal with delta files, but just in the batch mode, unfortunately it is not exactly what I need. The rsync algorithm instead is exaclty wha

Re: Incremental backups and batch mode.

2002-03-30 Thread Adrian Ho
On Thu, Mar 28, 2002 at 09:06:59PM +, Diego Liziero wrote: > So at every backup the whole 2Gbyte file is saved. That's exactly what rsync's supposed to do, AIUI. I would be /very/ upset if it didn't make perfect copies. 8-) > So I would like to use the rsync algorithm to calculate the diff

RE: Incremental backups and batch mode.

2002-03-28 Thread Mike Rubel
Diego wrote: > Right, wonderful, but let's consider a big database file, let's say > a 2Gbyte file, that is slightly changed every day of about a 10% ... > So at every backup the whole 2Gbyte file is saved. ... > So I would like to use the rsync algorithm to calculate the differences > (delta fi

RE: Incremental backups and batch mode.

2002-03-28 Thread Diego Liziero
Thanks, now I know how rsync backup option works. But I haven't been so clear about what I would like to do. >> I would like to have a first snapshot (level 0) that is a complete copy, >> and then other incremental backups that are just delta files >> (just the diffe

RE: Incremental backups and batch mode.

2002-03-28 Thread Mike Rubel
> Something similar: > I would like to have a first snapshot (level 0) that is a complete copy, > and then other incremental backups that are just delta files > (just the differences from the level 0 snapshot). The "normal" utilities for this job would be dump and tar

Incremental backups and batch mode.

2002-03-28 Thread Diego Liziero
I'm trying to use the rsync algorithm for incremental backups. After a quick look at rsync I saw the batch mode operations, and I thought that maybe I can modify them for incremental backups. What is needed is to add an option to save the checksums of all the files of the level 0 backup

RE: Using rsync for incremental backups and the logfile dilemma

2001-02-21 Thread Yazz D. Atlas
Just saw this thread in the list and thought I'd point out a little bash script I wrote for laptop users that want to do backups in the office or on the road using rsync and ssh. Using the latest version of rsync. http://support.osdn.com/yazz/guppy-01-beta/INSTALL http://support.osdn.com/yazz/gup

Re: Using rsync for incremental backups and the logfile dilemma

2001-02-21 Thread Hans E. Kristiansen
I have a related question to this problem. We are doing backups from PC clients to a Linux server using rsync, and I would like change the full backup to incremental backups. However, the problem is that I may have used the wrong options , --destination-dir rather than -compare-dest option

Re: Using rsync for incremental backups and the logfile dilemma

2001-02-21 Thread Dave Dykstra
On Thu, Feb 22, 2001 at 01:00:49AM +0800, Hans E. Kristiansen wrote: > I have a related question to this problem. > > We are doing backups from PC clients to a Linux server using rsync, and I > would like change the full backup to incremental backups. > > However, the problem

RE: Using rsync for incremental backups and the logfile dilemma

2001-02-15 Thread David Bolen
Paul Wouters [[EMAIL PROTECTED]] writes: > Yes, imagine your nice logfiles being reduced to 0 bytes because > someone removed them on the server. My backups will vanish as soon > as rsynch is done (assuming --delete). I'm not using --delete on the > incremental, but want to use it on the week-old

RE: Using rsync for incremental backups and the logfile dilemma

2001-02-15 Thread Paul Wouters
On Thu, 15 Feb 2001, David Bolen wrote: > Is there a reason that you can't just use a single backup location > based on a weekly cycle even if you're backing them up daily? (E.g., > rather than $DATE for the output directory on your daily runs, compute > a target directory based on week rather t

RE: Using rsync for incremental backups and the logfile dilemma

2001-02-15 Thread David Bolen
Paul Wouters [[EMAIL PROTECTED]] writes: > Now, I do realise this is still fairly efficient on our network, and > that's not my problem. My problem is more the diskspace all these > logfiles take up. Now I can't believe I'm the first one to have this > problem, and unless everyone else switched t

Using rsync for incremental backups and the logfile dilemma

2001-02-15 Thread Paul Wouters
Hi, We're doing offsite backups using rsync, more or less the cookbook example using: rsync --numeric-ids --compress --rsh=/usr/bin/ssh --recursive --archive \ --relative --sparse --one-file-system \ --compare-dest=/vol/backup/$HOSTNAME/current $HOSTNAME:$DIRECTORY \ /vol/back