Re: Help creating incremental backups using --backup-dir.

2009-04-09 Thread David Miller


Ok, I figured out the problem. I had to put in the full path for the -- 
backup-dir option. However, I have ran into another problem that makes  
doing this just about useless. If I rsync to an HFS+ volume it works  
correctly. If I rsync to a Samba share it gives me errors and puts  
files it thinks have been modified at the time of sync into the -- 
backup-dir directory. It is going through and deleting all the ._  
files. The errors I'm seeing are as such.


rsync: get_xattr_names: llistxattr(Documents/web server diagram/ 
web.graffle/._image2.jpg,1024) failed: Operation not permitted (1)

deleting Documents/web server diagram/web.graffle/._image2.jpg

I have checked the Samba server and the files are being set with the  
correct owner, group, permissions.


Are there any filesystems under linux that allow the proper  storage  
of the Mac metadata? I have tried XFS, ext3 and ext4 with no luck. I  
even tried creating a sparse disk image and mounting that from a Samba  
share but it is too unreliable. If there is a connection loss  while  
data is writing to the image it corrupts the image more often than not.


David.
On Apr 9, 2009, at 11:11 AM, David Miller wrote:

Normally I would use the --link-dest option to do this but I can't  
since I'm rsyncing from a Mac to a Samba share on a Linux box and  
hard links don't work. What I want to do is create a 10 day rotating  
incremental backup. I used the first script example on the rsync  
examples page as a template. The only thing I changed was the  
destination to be a local directory and paths for the other  
variables. when I run the script nothing gets copied into the  
directories named by the day of the week. Each day when the script  
runs the directory with the name of the current week day is created  
but everything just goes into current. and stays there. Can someone  
post an example that does work for what I'm trying to do? Below is  
the script I'm using.



#---
# directory to backup
BDIR=$HOME/Documents

BACKUPDIR=`date +%A`
OPTS= -aX --force --progress --ignore-errors --delete --backup -- 
backup-dir=/$BACKUPDIR


# the following line clears the last weeks incremental directory
[ -d $HOME/emptydir ] || mkdir $HOME/emptydir
/usr/local/bin/rsync3.0.5 --delete -a $HOME/emptydir/ /Volumes/SAMBA/ 
$BACKUPDIR/

rmdir $HOME/emptydir

# now the actual transfer
/usr/local/bin/rsync3.0.5 $OPTS $BDIR /Users/Shared/current
#---

Thanks.
David.
--
Please use reply-all for most replies to avoid omitting the mailing  
list.

To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


--
Please use reply-all for most replies to avoid omitting the mailing list.
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


Re: Rsync to Mac

2008-05-28 Thread David Miller
It is the same on all *NIX platforms. Create an rsyncd.conf file in / 
etc and define the settings and modules you want. Here is an example.


#rsyncd.conf=
secrets file = /etc/rsyncd.secrets
read only = no
list = yes
uid = root
gid = wheel
timeout = 300
strict modes = false

[backup1]
auth users = backup
path = /Volumes/left/rsync

[backup2]
auth users = backup
path = /Volumes/right/rsync
#rsyncd.conf=

You can launch the rsync in daemon mode like so

/path/to/rsync --daemon 

Good luck.

David.
On May 28, 2008, at 2:28 AM, Brad Farrell wrote:


Hi All

I am trying to setup my Mac to be an Rsync server for my office  
PCs.  I can’t seem to find information on how to setup the Mac as  
the server part.  Any ideas?


Brad

No virus found in this outgoing message.
Checked by AVG.
Version: 7.5.524 / Virus Database: 269.24.1/1468 - Release Date:  
5/26/2008 3:23 PM


--
Please use reply-all for most replies to avoid omitting the mailing  
list.

To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


--
Please use reply-all for most replies to avoid omitting the mailing list.
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


Re: Howto: Mac OS X to Windows VM

2008-04-11 Thread David Miller


On Apr 9, 2008, at 3:12 PM, Rama D. Chavali wrote:


Hi,

I have a mac pro and a windows Vm which I want to keep sync.  I  
tired using other Sync programs but they do not seems to be  
working.  I tend to leave applications running which create their  
own temp files in its own specific folder, which caused the other  
sync programs to crash.  I tired SyncToy by MS and Unison.  I am  
looking for a bi-directional sync program that runs in the  
background and syncs any changes caused to the folder.  I heard that  
rsync can slove this problem for me, but I am not sure how.  Can any  
one be of hlep to me?


- Rama



Why not have a common share point to save your work to? If you are  
using VMware or Parallels you can share your Macs home folder with  
windows through the the VM software. We have lots of users who do  
this. It makes backups easy. I only rsync their Mac home folders and  
exclude their VMware image.


David.


--
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


rsync3 universal binary for Mac OS X?

2008-03-06 Thread David Miller
Did anyone ever get rsync3 to compile as a universal binary and work  
correctly on both tiger and leopard on ppc and intel?


David.
--
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


Re: preserving Mac OS X metadata in rsync backups and restores

2008-01-18 Thread David Miller


On Jan 18, 2008, at 8:14 AM, Moritz Heckscher wrote:


Hello all,

I'm new to the list, but have done quite a bit of researching before  
regarding the support of Mac OS X specific features (resource forks,  
extended attributes, ACLs, file creation  modification date).


By reading the archives, I get the impression that the current  
version of rsync 3.0.0pre8 is quite far in this respect. At least it  
sounds so, and I thank the developers very much for this! I like  
your approach much more than the (very buggy) one originally pursued  
by Apple (store metadata in separate ._ file).




Be careful and test, test, test. I tried using pre8 to sync two local  
Xserve RAID's(about 2TB of data) and I'm seeing these errors.


rsync: writefd_unbuffered failed to write 4 bytes [sender]: Broken  
pipe (32)

[receiver] internal abbrev error!
rsync error: error in rsync protocol data stream (code 12) at  
xattrs.c(565) [receiver=3.0.0pre8]
rsync: connection unexpectedly closed (175959 bytes received so far)  
[sender]
rsync error: error in rsync protocol data stream (code 12) at  
io.c(600) [sender=3.0.0pre8]


I have another Xserve RAID(about 1.3TB) and I don't get those errors  
when syncing with pre8. I'm trying to pin down what files/folders are  
causing the problem now.



I plan to do the following:

* Run a Linux server (Ubuntu, I guess, on a ext3 partition) with two  
separate internal ATA hard disks formatted in XFS and configured in  
software RAID to store the actual backup data. (As I understand, I  
should use XFS rather than ext3 because XFS supports extended  
attributes large enough to hold also larger converted Mac resource  
forks.)


* Back up from different Mac OS X clients (cuurently all on 10.4,  
but I might upgrade them to 10.5 later) to the server using rsync  
over ssh. This should hopefully preserve (most of) the Mac-specifif  
metadata on the server. (Actually I plan to use rsnapshot, but I  
believe if I have rsync installed in the newest version and possibly  
tell rsnaphot to use the appropriate rsync options, things will be  
the same.)


Now my question is the following:

1) What would I have to do to ensure the metadata is also restored  
correctly? I assume I will have to use rsync for restoring also, and  
if I just copy over data (using, e.g, scp or over an AFP or CIFS or  
NFS network mount), I will lose this metadata. Is this correct?




Why not use rsync3 for both backup and restore. Either use ssh (rsync - 
azXA --delete /path/to/source server:/path/to/target) or setup an  
rsync daemon server. This way you let rsync handle the metadata.




Another problem I'm thinking about is that rsnapshot should be run  
on the server to pull the backups over the network. One cannot run  
it on the clients and push the data to the server over the network  
-- which is what I'd prefer because I plan to not leave the server  
on all day but rather have it woken up by the (laptop) clients when  
needed who'll take care of the scheduling of the backups (using  
anachron or launchd etc.) One could, however, run rsnapshot on the  
clients to backup onto a locally attached storage device.




You don't need rsnapshot. Use the --link-dist option to create  
incremental backups.



This leads me to the second question:

2) If I mount the server as a network drive on the clients using  
AFP, SMB/CIFS, NFS, ..., and then backup to this 'locally attached'  
drive with rsync (using rsnapshot), will I lose the metadata because  
of the transfer via the SMB/... layer?


Thanks a lot for a great program!
-Moritz

--
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html



David Miller.
--
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html