Modifications to NOT recursively make_backup

2007-04-03 Thread Mike Bombich
Hi: Suppose I have the following files on my target volume: /Applications/[45,000 sub files and directories] /Developer/[120,000 sub files and directories] ... (another 8 or so directories with lots of files and sub directories) /usr/ [75,000 sub files and directories] For a total of ap

Re: preserving Mac OS X metadata in rsync backups and restores

2008-01-20 Thread Mike Bombich
With rsync 3 pre8 and Mac OS 10.5.1: bash-3.2# patch -p1 bash-3.2# ~/rsync-3.0.0pre8/rsync -aHAX --fileflags /Volumes/Source/ / Volumes/Target/ bash-3.2# bbouncer verify -d /Volumes/Source /Volumes/Target Verifying:basic-permissions ... ok Verifying: timestamps ... Sub-test:

Re: OS X xattr troubles (was Re: --exclude patterns)

2008-01-31 Thread Mike Bombich
On Jan 30, 2008, at 11:03 PM, Anthony Morton wrote: I have a similar problem. I'm trying to specify a custom per- directory filter using --filter='dir-merge .rsync-filter-m' but because the whole thing is double-quoted the filter rule arrives in single quotes. I can't simply leav

Re: creation date and OSX [performance]

2008-02-01 Thread Mike Bombich
Looking at this patch from a performance perspective, it appears that getattrlist is called twice for every file: 23:57:24.341 lstat 00-basic- permissions/owned-by- root

Re: creation date and OSX [performance]

2008-02-03 Thread Mike Bombich
I think the issue is that the flags patch and the crtimes patch are often trying to patch the same lines. For example, line 65-ish in compat.c: flags.diff: /* These index values are for the file-list's extra-attribute array. */ - int uid_ndx, gid_ndx, acls_ndx, xattrs_ndx, unsort_ndx; +

Re: creation date and OSX [performance]

2008-02-03 Thread Mike Bombich
fi Mike Sorry for my continued ignorance with this- am just trying to get crtimes and flags patches to work together in rsync 3... Thanks, Rob D On Feb 3, 2008, at 2:31 PM, Mike Bombich wrote: I think the issue is that the flags patch and the crtimes patch are often tryin

Re: universal binary and crtimes

2008-02-20 Thread Mike Bombich
Off the cuff, without looking at the code, I'd guess there is an Endian issue at play. Mike On Feb 20, 2008, at 11:34 PM, Robert DuToit wrote: Hi All, I promise I won't bug you anymore about this but I did find that the compiled universal binary on rsync3.0.pre10 does preserve creatio

Several changes missing from [HEAD] fileflags.diff

2008-03-04 Thread Mike Bombich
Looking at http://rsync.samba.org/ftp/rsync/patches/fileflags.diff -- It looks like the changes from fileflags-fixes.diff patch were applied to the patch from http://rsync.samba.org/ftp/rsync/rsync-patches-3.0.0.tar.gz , but this entire chunk of the that original diff file was lost: diff -

[PATCH] xattrs not set on locked files that already exist on target

2008-04-14 Thread Mike Bombich
Working with rsync 3.0.2, it appears that rsync isn't unlocking files before setting the file attributes when those files already exist. This generates error messages on subsequent such as: rsync: rsync_xal_set: lsetxattr("locked_file","test_xattr") failed: Operation not permitted (1) rsyn

Re: Number of files transferred

2008-04-15 Thread Mike Bombich
For stats, rsync uses the word "file" inconsistently. When reporting the total "Number of files", it indicates a total number of filesystem objects which consists of regular files, directories, symlinks, specials, and devices. When reporting number of "files" transferred, it refers only t

Re: supporting HFS+ attributes and forks on a Linux rsync server?

2008-06-23 Thread Mike Bombich
Will --fake-super handle this? --fake-super When this option is enabled, rsync simulates super- user activities by saving/restoring the privileged attributes via spe- cial extended attributes that are attached to each file (as needed). This includes the f

Re: Non-clean Rsync 3.0.3 exit on OSX

2008-07-02 Thread Mike Bombich
I'd guess you're running into endian issues. Does the same error occur when you compile a version specifically for the i386 architecture (e.g. on the Intel machine)? Mike On Jul 2, 2008, at 4:40 PM, Paul Ortman wrote: -BEGIN PGP SIGNED MESSAGE- Hash: SHA1 I've compiled rsync 3.0.

Re: (not quite) reproducible segfaults in 3.0.3

2008-09-23 Thread Mike Bombich
I think I isolated that exact same crash just last night. Here's my symbolized crash report: Process: rsync [17295] Path:/usr/local/bin/rsync Identifier: rsync Version: ??? (???) Code Type: PPC (Native) Parent Process: rsync [17294] Date/Time: 200

crtimes discrepancy on PPC

2008-09-29 Thread Mike Bombich
On a PPC machine running Mac OS X, I noticed that creation time is not preserved for files that are transferred (i.e. versus files that are not transferred, or files that have only attribute changes). I discovered two things that work together to cause this: 1) cmp_time (util.c) doesn't ch

Re: Problem Escaping Spaces in File Name

2009-01-05 Thread Mike Bombich
Take a look at the "--protect-args" argument as well, this is probably a more elegant solution. -s, --protect-args This option sends all filenames and some options to the remote rsync without allowing the remote shell to interpret them. This means that spa

Re: Macintosh rsync: Inconsistent Behaviour: Hints Appreciated

2009-02-11 Thread Mike Bombich
You're using the version of rsync that is built-in to Mac OS X. Don't do that. It's a fairly old version (though it is maintained by Apple), and it doesn't handle extended attribute modifications (or lack thereof), thus it transfers them every time. When you have many files with resource

Re: installing rsync-3-0-5 on a Mac

2009-02-25 Thread Mike Bombich
On Feb 25, 2009, at 12:00 PM, Rob Rye wrote: The following note never went through yesterday for some reason: You probably know all of this already, but for those not familiar with the mysteries of the Unix side of the Mac OS X, allow me to comment here: Assuming /usr/local/bin is i

Odd issue with locked directories and Mac OS X

2009-03-10 Thread Mike Bombich
Some of my users have reported problems with rsync puking on locked folders. The errors typically look like this: rsync -aNHAXx --fileflags --force-change --no-inc-recursive / /Volumes/ Backup rsync: mkstemp "/Volumes/SCSI Backup/Users/Ken/Library/Caches/ Metadata/Safari/Bookmarks/..DS_Sto

rsyserr is occasionally dropping receiver messages

2009-03-10 Thread Mike Bombich
Typically rsync exits and reports an error such as: rsync: writefd_unbuffered failed to write 4 bytes [sender]: Broken pipe (32) rsync: write failed on "/Volumes/Backup/big_file.dmg": No space left on device (28) rsync: connection unexpectedly closed (67174 bytes received so far) [sender] r

Re: rsync 3.0.6 ACLs under MacOS 10.4

2009-05-18 Thread Mike Bombich
Are the users specified in the ACE present in the directory service on the remote machine? If not, you'll see errors like this. ACLs are set using the username, not uid, so matching user accounts must be present on the remote machine Mike On May 14, 2009, at 7:02 PM, gigagigosu wrote:

Re: unpack_smb_acl unknown error

2009-08-31 Thread Mike Bombich
That error occurs when rsync tries to set an ACE specifying a user that does not exist. Here's what happens: 1) Read ACE on source file --> on Mac OS X, the user or group of the ACE is stored using the user or group's UUID 2) Convert UUID to uid/gid using mbr_uuid_to_id, also store which typ

Re: unpack_smb_acl unknown error, + rsync maintainability

2009-09-01 Thread Mike Bombich
at 16:59 -0500, Mike Bombich wrote: Regardless, rsync shouldn't be converting uuid to uid/gid for Mac OS X, it's unnecessary. This is really a question of whether Mac users expect users/groups to be preserved by uid/gid or by uuid. Are you saying it makes more sense to preserve

Re: unpack_smb_acl unknown error, + rsync maintainability

2009-09-02 Thread Mike Bombich
0046), but those are defined universally on Mac OS X, so these wouldn't (shouldn't) introduce conflicts. Mike On Sep 2, 2009, at 10:31 AM, Matt McCutchen wrote: On Tue, 2009-09-01 at 09:09 -0500, Mike Bombich wrote: Rsync shouldn't be converting UUID to uid/gid *for

Re: OS X 10.6 (Snow Leopard) HFS+ File Compression

2009-10-28 Thread Mike Bombich
HFS compression can be preserved as long as the relevant xattr(s) and flags on those files are preserved.  A compressed file has the compressed data in a hidden xattr (com.apple.decmpfs if < 4Kb, com.apple.ResourceFork if more), and has the UF_COMPRESSED flag set (decimal 40).  When rsync encounter

Re: OS X 10.6 (Snow Leopard) HFS+ File Compression

2009-11-03 Thread Mike Bombich
in the next month or so. Mike On Nov 1, 2009, at 7:57 PM, Tony wrote: Mike, thanks for the patch. Will this patch be maintained in rsync- patches-3.0.6.tar.gz ? On Oct 28, 2009, at 1:20 AM, Mike Bombich wrote: HFS compression can be preserved as long as the relevant xattr(s) and flags on

Getting EEXIST out of make_bak_dir()

2010-03-08 Thread Mike Bombich
I have users running rsync 3.0.6 on Mac OS 10.5 and 10.6 with the following arguments (for example): rsync -aNHAXx --fileflags --force-change --no-inc-recursive --delete-during --filter="P _Archive*" --filter="P /*" --backup --backup-dir="_Archive_2010_March_07_22-27-43" / /Volumes/Backup I ca

Re: Getting EEXIST out of make_bak_dir()

2010-03-10 Thread Mike Bombich
On Mar 9, 2010, at 10:09 AM, Wayne Davison wrote: > On Mon, Mar 08, 2010 at 10:02:26AM -0600, Mike Bombich wrote: >> rsync: make_bak_dir mkdir >> "/Volumes/Backup/_Archive_2010_March_07_22-27-43/Users/jsmith/Library/Mail/Mailboxes/ >>Orchestra" failed: Fil

Re: OSX and HFS+ filesystem compression

2010-05-18 Thread Mike Bombich
Hi Rob: I posted a patch several months ago (October 28, to be specific) that offers HFS+ compression support for rsync. It's OS-specific, so I don't expect the rsync team to maintain the patch, but I'll be keeping it as up to date as I can. Right now it's built and tested against rsy

Re: OSX and HFS+ filesystem compression

2010-05-19 Thread Mike Bombich
Hi Robert: My apologies, that "if (fnamecmp)" should be commented out as you discovered.  Did you read the updated man page to see the new arguments available for supporting HFS+ compression?  It isn't on by default, you need to use --protect-decmpfs, for example, to preserve those xattrs.I crafted

Re: rsync and hfs+ compressed files damaged

2010-06-25 Thread Mike Bombich
Can you share the steps required to reproduce this? I've seen two reports of this but have not been able to reproduce it myself, and the users that reported it also could not reproduce it. Mike On Jun 25, 2010, at 5:16 AM, Robert DuToit wrote: > Hi All, > > I have been using rysnc 3.0.6 with

Re: Optimising the Rsync algorithm for speed by reverting to MD4 hashing

2010-08-04 Thread Mike Bombich
I agree! I was planning to implement an alternative specifically for my own use to improve performance, though it would be nice to at least have an option to use something cheaper using the standard distro. Especially when you can expect high performance from storage, the performance hit is ve

rsync: pack_smb_acl: sys_acl_init(): Cannot allocate memory

2010-08-20 Thread Mike Bombich
Before I call this a bug, I figured I'd ask -- what's the "+ 3" for in calc_sacl_entries? static int calc_sacl_entries(const rsync_acl *racl) { /* A System ACL always gets user/group/other permission entries. */ return racl->names.count #ifdef ACLS_NEED_MASK + 4; #e

Re: osx remote backup wrong permissions

2010-10-30 Thread Mike Bombich
On Oct 30, 2010, at 9:02 AM, Robert DuToit wrote: > Hi All, > > I'm trying a remote backup for the first time. It is between two laptops, I > installed rsync 3.0.7 on both compiled > > patch -p1 > patch -p1 > patch -p1 > patch -p1 f > patch -p1 > ./configure > > make > > this all wo

Re: MacOS and Extended Attributes

2010-12-28 Thread Mike Bombich
Hi Dave: I put together some instructions for compiling rsync with a few Mac OS X-specific patches here: http://www.bombich.com/rsync.html Hopefully that gets you going. Mike On Dec 28, 2010, at 1:49 PM, David Emery wrote: > I'm just starting with rsync(). I grabbed the 3.0.7 source

Re: rsync not reporting diskfull error

2011-02-06 Thread Mike Bombich
Begin forwarded message: > From: Mike Bombich > Date: March 10, 2009 11:17:36 PM CDT > To: rsync@lists.samba.org > Subject: rsyserr is occasionally dropping receiver messages > > Typically rsync exits and reports an error such as: > > rsync: writefd_unbuffered failed

Re: Backing up resource forks

2011-03-11 Thread Mike Bombich
and download/compile version 3.0.7. Very stable, > I've been downloading/compiling my own rsync from here for several years and > have not encountered any problems. > > If you're interested and would like the download/compile steps, let me know. > Mike Bombich (CCC, Appl

HFS+ compression support [was Re: Backing up resource forks]

2011-03-16 Thread Mike Bombich
Hi Wayne: Thanks for taking a look at that patch. A few comments inline below... On Mar 14, 2011, at 12:42 AM, Wayne Davison wrote: > On Fri, Mar 11, 2011 at 8:05 AM, Mike Bombich wrote: > FWIW, I updated http://www.bombich.com/rsync.html just recently with a minor > bug fix

Re: Getting errors with 3.0.8

2011-04-05 Thread Mike Bombich
Drop the -A argument, iDisk doesn't supports ACLs. iDisk volumes are mounted over WebDAV, so ACLs, hard links, symlinks, and ownership are not supported. Try this instead: /usr/local/bin/rsync -rtp -NXx --fileflags --force-change --progress /Users/davidallie/Documents/ /Volumes/david.allie/Doc

Failed assertion in finish_hard_link

2011-08-11 Thread Mike Bombich
I'm seeing this assertion failure: hlink.c:610: failed assertion `node != NULL && node->data != NULL' In this block of code: if (inc_recurse) { int gnum = F_HL_GNUM(file); struct ht_int32_node *node = hashtable_find(prior_hlinks, gnum, 0); --> assert(node != NULL && node->dat