Re: Delete files specified in --from-files-file that don't exist on the sender side

2009-03-06 Thread Matt McCutchen
On Sat, 2009-02-28 at 09:36 -0800, Wayne Davison wrote: I added an option to the latest development version that supports this: --delete-missing-args. Nice work! I feared the implementation would be much messier. Two issues you may wish to correct (or I might do it and post the patch): 1.

Re: uid/gid settings in rsyncd.conf not respected?

2009-03-05 Thread Matt McCutchen
On Thu, 2009-03-05 at 10:31 -0800, Harry Mangalam wrote: Also, it might be useful to note in the rsyncd.conf.5 that if you use Wayne's supplementary group approach, it will require multiple rsync connections. So it will fail if your 'max connections' is set to a number less than the

Re: Sync files not folders non recursively

2009-03-04 Thread Matt McCutchen
On Wed, 2009-03-04 at 15:13 +0100, Ehlers, Kolja wrote: What I am trying to do is to simply sync files with a special suffix to a destination folder. So I dont want to transfer recursively but I want to delete files from the destination which are not in the source anymore. Closest I have

Re: uid/gid settings in rsyncd.conf not respected?

2009-03-04 Thread Matt McCutchen
On Wed, 2009-03-04 at 17:01 -0800, Harry Mangalam wrote: In your patch that you graciously provided me to provide supplementary groups capability, you didn't say how it was supposed to be specified. I thought it was working the first time I used it, but I was mistaken. I forgot to add the

Re: Conflicting timestamps in rsyncd.log

2009-03-01 Thread Matt McCutchen
On Sun, 2009-03-01 at 17:21 -0800, Bill Landry wrote: I just setup my first rsyncd server and all is working well as far as file syncing goes. However, I am a bit baffled by the fact that some of the log entries in the rsyncd.log file are entered in local time and other are entered in GMT.

Re: Treat files that were modified locally and remote

2009-03-01 Thread Matt McCutchen
On Sat, 2009-02-28 at 13:31 +0100, Kurt wrote: Hi - is there a clever way to identify files that have been change on the local _and_ the remote location? Without such a check it may happen, that changes are lost without even noticing. One way to identify such files would be to do a

Re: installing rsync-3-0-5 on a Mac

2009-02-23 Thread Matt McCutchen
On Mon, 2009-02-23 at 20:21 +0100, Kurt wrote: is rsync --version reporting the wrong version number, or am I to stupid to properly install rsync-3-0-5 on a Mac? Here is what I did: download and extract rsync-3-0-5 (btw: why is there an extra patches folder?) in Terminal I ran:

Re: uid/gid settings in rsyncd.conf not respected?

2009-02-17 Thread Matt McCutchen
for calling initgroups(3) to parse /etc/group and take on the corresponding supplementary groups. -- Matt From 2928216e47de707d3fb8277278c366752701b1f2 Mon Sep 17 00:00:00 2001 From: Matt McCutchen m...@mattmccutchen.net Date: Sat, 14 Feb 2009 20:49:56 -0500 Subject: [PATCH] Add supplementary groups

Re: --link-dest=server::location/folder

2009-02-14 Thread Matt McCutchen
On Fri, 2009-02-13 at 04:24 -0700, lewis butler wrote: Hate to bug you again, but I went ahead and installed 3.0.5 and looked at --help and didn't see anything about incremental recursion. Incremental recursion is not mentioned in the --help output, but there's some information about it in

Re: uid/gid settings in rsyncd.conf not respected?

2009-02-14 Thread Matt McCutchen
in wip/supplementary-groups of my repository) adds a daemon parameter to take on the supplementary groups. Please test this and tell us whether it works for you. -- Matt From 1175c760bc7408a28b831e18db5d2e4fae78c0fa Mon Sep 17 00:00:00 2001 From: Matt McCutchen m...@mattmccutchen.net Date: Sat, 14

Re: rsync not preserving permissions

2009-02-11 Thread Matt McCutchen
On Wed, 2009-02-11 at 19:05 +, Andy Smith wrote: I am running the following command, it is pulling the files across from a read-only configured rsync server via ssh. The command runs as root and I use the -p option to preserve permissions but files with non-root owners are being

Re: Rsync from Windows to Linux

2009-02-08 Thread Matt McCutchen
On Mon, 2009-02-09 at 07:57 +1100, Tyson Dina Patricia Ackland wrote: I have installed rsync on my Windows and Linux PCs. I would like to use it to copy a folder from Windows to Linux on a regular basis as part of my backup regime. It works but always prompts me for a password. Is there

Re: Local transform on files before sending?

2009-02-08 Thread Matt McCutchen
On Sun, 2009-02-08 at 20:28 -0600, Michael Gardner wrote: Is it possible to have rsync do a transform on each file before sending it? This would be useful for things like individually compressed or encrypted backups, or in my case, syncing lossy copies of my FLAC music to an mp3 player or

Re: rsync oldest files first

2009-02-07 Thread Matt McCutchen
On Sat, 2009-02-07 at 17:01 -0800, nate wrote: The problem is really two fold- there seems to be some sort of issue/bug? with rsync where under certain circumstances it will rename one of it's temporary dot files to the real file name even though it hasn't been successfully copied, You're

Re: --chmod for destination only

2009-02-06 Thread Matt McCutchen
On Fri, 2009-02-06 at 09:32 -0500, Matthew Monaco wrote: Is it possible to set the permissions on the destination side? As I understand it, --chmod just pretends certain permissions are coming from the sending side. If you use --chmod with -p, you'll end up setting the destination

Re: --chmod for destination only

2009-02-06 Thread Matt McCutchen
Matthew, please remember to CC rsync@lists.samba.org . On Fri, 2009-02-06 at 22:33 -0500, Matthew Monaco wrote: Matt McCutchen wrote: With --chmod and -p, the receiver will locally copy any --link-dest files that have the right data but the wrong permissions. This will give you

Re: rsync differences between Fedora/Ubuntu?

2009-02-03 Thread Matt McCutchen
On Wed, 2009-02-04 at 12:29 +1300, Carl Turney wrote: (I'm only one step above a user, so would appreciate any technical answers thoroughly explained. But if you're in a real rush, I could just forward your reply to a local wizard for translation.) With the script below, I use rsync to

Re: rsync compression (-z) and timestamp

2009-02-03 Thread Matt McCutchen
On Tue, 2009-02-03 at 14:46 +0100, David de Lama wrote: The first command is transferring the file and the second is not, because the file has already been transferred. That's why the first command is taking longer. What did you expect to see? -- Matt Thanks for your patience,

Re: strange behaviour on file with ':' in its name

2009-02-01 Thread Matt McCutchen
On Sun, 2009-02-01 at 13:33 +0100, Louis-David Mitterrand wrote: Using 3.0.5 I can't send a file with ':' in its name in the current directory without prefixing it with ./ delos% touch file:ext delos% rsync -avP file:ext sylla:/home/ldm The source and destination cannot both be remote.

Re: rsync with --copy-devices patch and device-target with --write-batch doesnt work

2009-01-30 Thread Matt McCutchen
On Fri, 2009-01-30 at 13:12 +0100, freisei wrote: i?ve found the problem. ./rsync -v --copy-devices --progress --write-batch=/mnt/sdc1/snapshotvergleich/diff1 /mnt/sdc1/snapshotvergleich/xp8main3-mnt-backup-base.img /dev/vg0/xp8main3-mnt-backup-1 creates a diff1-file which has nearly the

Re: Strange behaviour with rsync and mounted truecrypt volume

2009-01-30 Thread Matt McCutchen
On Sat, 2009-01-31 at 02:18 +0100, Oliver wrote: when i mount a truecrpyt volume with truecrypt 5.1a and synchronize data locally with rsync (version 2.6.9 protocol version 29) like this way: $ truecrypt myvolume.tc $ rsync -av /home/oliver/myfolder /media/truecrypt The myfolder is

Re: Improving loadparm design to fix bug in configuration reloading

2009-01-30 Thread Matt McCutchen
On Fri, 2009-01-16 at 22:36 -0500, Matt McCutchen wrote: On Fri, 2009-01-16 at 19:23 -0800, Wayne Davison wrote: On Wed, Jan 14, 2009 at 02:25:33AM -0500, Matt McCutchen wrote: I think I'll take the opportunity to improve the design a bit by actually adding a section structure

[PATCH] Combine Globals and Locals into a single Variables structure that parallels Defaults, shortening some code. Improve comments and make other minor cleanups.

2009-01-30 Thread Matt McCutchen
--- This is the first refactoring I mentioned. I decided not to inline global_vars because I find it helpful to see the global parameters in their own structure. loadparm.c | 157 ++- 1 files changed, 80 insertions(+), 77 deletions(-)

Re: rsync with --copy-devices patch and device-target with --write-batch doesnt work

2009-01-30 Thread Matt McCutchen
On Fri, 2009-01-30 at 17:06 +0100, freisei wrote: Matt McCutchen schrieb: On Fri, 2009-01-30 at 13:12 +0100, freisei wrote: Is it possible to tell rsync to treat a device-target lika a file? Not currently. That's a separate feature from --copy-devices; it would be called --keep-devices

Re: rsync compression (-z) and timestamp

2009-01-29 Thread Matt McCutchen
On Thu, 2009-01-29 at 09:43 +0100, David de Lama wrote: YES, the same results! The copy command takes nearly twice as long as the -c command!:( I can't explain it!!! With the copy command I get following result: receiving incremental file list

Re: Exclude some source files from being deleted when --remove-source-files is used

2009-01-28 Thread Matt McCutchen
On Wed, 2009-01-28 at 01:58 -0800, Martin Scharrer wrote: I'm using rsync to transfer some files from host A to B and using --remove-source-files to remove them from A after the transfer. Now however I have one file 'md5sum' which should be transfered but not removed. I tried the protect

Re: Is -R --link-dest really hard to use, or is it me?

2009-01-28 Thread Matt McCutchen
On Mon, 2009-01-26 at 03:48 -0500, foner-rs...@media.mit.edu wrote: but eventually I'm going to want to migrate this ext3 to ext4, and the problem will recur at that point. Incidentally, are you sure about that? I thought one could just mount an ext3 filesystem as type ext4 and it would be

Re: rsync with --copy-devices patch and device-target with --write-batch doesnt work

2009-01-28 Thread Matt McCutchen
Freisei, please CC rsync@lists.samba.org so that others can help you and your messages are archived for others' future benefit. On Sun, 2009-01-25 at 12:08 +0100, Freisei wrote: Matt McCutchen schrieb: In the meantime, you can strace rsync to see how the write(2) call is failing. How can i

Re: rsync compression (-z) and timestamp

2009-01-27 Thread Matt McCutchen
On Tue, 2009-01-27 at 14:49 +0100, Paul Slootman wrote: Unfortunately this also happens when the transfer is local and -z happens to be passed as an option; the result is that the transfer is slowed down significantly without any benefit at all. Rsync should perhaps give a warning about the

Re: rsync compression (-z) and timestamp

2009-01-27 Thread Matt McCutchen
On Tue, 2009-01-27 at 15:17 +0100, David de Lama wrote: I don't see the amount of data rsync do compress. Use the %b log escape (see the rsyncd.conf(5) man page) to see the amount of data actually sent over the wire to transfer each file. Example: $ rsync -r -z --out-format='%10b %10l %n'

Re: [patch] Replace illegal characters in filenames for FAT (switch)

2009-01-27 Thread Matt McCutchen
Jonas, please CC rsync@lists.samba.org so that others can help you and your messages are archived for others' future benefit. On Sun, 2009-01-25 at 20:00 +0100, Jonas Häggqvist wrote: Matt McCutchen wrote: On Sat, 2009-01-24 at 23:59 +0100, Jonas Häggqvist wrote: This patch adds a switch

Re: Include/Exclude problems

2009-01-25 Thread Matt McCutchen
On Sun, 2009-01-25 at 10:29 -0500, Mag Gam wrote: I am trying to rsync a very large filesystem which is about 3TB, but naturally I want to exclude a lot of things. However, I am really struggling with excluding directories. SRC=/dasd/december/2008 #Notice there is no trailing slash

Re: [patch] Replace illegal characters in filenames for FAT (switch)

2009-01-25 Thread Matt McCutchen
On Sat, 2009-01-24 at 23:59 +0100, Jonas Häggqvist wrote: This patch adds a switch --fat-filenames which replaces all characters that aren't legal on FAT filesystems with an underscore. This is the first time I touch the rsync code, so I may not be going about it the right way, but it seems to

Re: rsync with --copy-devices patch and device-target with --write-batch doesnt work

2009-01-24 Thread Matt McCutchen
On Sat, 2009-01-24 at 11:32 +0100, Freisei wrote: I want to use rsync to create differential backups of my lvm-snapshots. fullbackup-filename: /mnt/sdc1/snapshotvergleich/rootbackup1.img current snapshot: /dev/vg0/rootbackup note: compiled-in --copy-devices-patch

Re: Is -R --link-dest really hard to use, or is it me?

2009-01-24 Thread Matt McCutchen
I regret the slow response. I was interested in your problem, but I knew it would take me a while to respond thoughtfully, so I put the message aside and didn't get back to it until now. I hope this is still useful. On Sun, 2009-01-11 at 23:24 -0500, foner-rs...@media.mit.edu wrote: I've got a

Re: Chance of equal checksum and changing blocks

2009-01-23 Thread Matt McCutchen
David, please CC rsync@lists.samba.org in your replies so that others can help you and your messages are archived for others' future benefit. On Fri, 2009-01-23 at 09:02 +0100, David de Lama wrote: - Finally I want two know if it is possible to change an amount of blocks manually? e.g. I

Re: Soft link trouble with rsync on SGI

2009-01-23 Thread Matt McCutchen
On Fri, 2009-01-23 at 09:57 -0700, Jones, Matthew L (N-Scitor) wrote: I have 2 machines and I run 2 rsync commands from one of them to keep them in synch. First I rsync to the remote box and have it send the local side all new stuff (rsync –auvz) and then I rsync from the local box and send

Re: Chance of equal checksum and changing blocks

2009-01-22 Thread Matt McCutchen
On Thu, 2009-01-22 at 10:43 +0100, David de Lama wrote: - First, am I right that the chance of getting the same 32-bit rolling checksum is 1/2^16 and to get the same 128-bit MD5 Hash is 1/2^127? You might know something I don't, but I would expect the collision probability to be 1/2^32 for 32

Should posters be required to join the list? (was: Bad habits)

2009-01-21 Thread Matt McCutchen
On Thu, 2008-03-20 at 11:52 -0400, Matt McCutchen wrote: Why are non members even allowed to post to the list? Why shouldn't they be? In my view, subscription to the list just indicates a personal preference to receive all the mail because one wishes to either help others or stay informed

Re: webdav timeout

2009-01-21 Thread Matt McCutchen
Helge, please CC rsync@lists.samba.org in your replies so your messages are archived for others' future benefit. On Wed, 2009-01-21 at 19:48 +0100, Kraak Helge wrote: Thanks for your reply Matt! I now tested two different commands with two different versions of rsync. Once I used the

Re: How to setup and configure rsync with backupPC

2009-01-21 Thread Matt McCutchen
On Wed, 2009-01-21 at 19:37 -0800, Molin MEN wrote: Could you please explain me how do backupPC and rsync work together? I am a new user to debian linux and i would like to setup backupPC and rsync to backup all user data in my network. Could you tell me how to do that? This isn't really an

Re: Not able to read the content of the file.

2009-01-19 Thread Matt McCutchen
On Mon, 2009-01-19 at 16:22 +0530, Ushank Khanna, Noida wrote: I want to read the list of files from txt file. I am using – files-from=myFile.txt command but I am getting the error. Please tell me how to read the list of files from other file. I am using this below Rsync command:- rsync

Re: --compare-dest; I'm missing the boat

2009-01-17 Thread Matt McCutchen
On Sat, 2009-01-17 at 11:08 -0600, Harry Putnam wrote: I keep a checked out module from cvs at /usr/local/common/base, that contains the checked in versions of files in /cvsb Periodically I run rsync -blah /cvsb/ /usr/local/common/base Over writing the old cvs copies with new stuff. Then

Re: --compare-dest; I'm missing the boat

2009-01-17 Thread Matt McCutchen
On Sat, 2009-01-17 at 14:57 -0600, Harry Putnam wrote: Matt McCutchen m...@mattmccutchen.net writes: You know, there are two-way synchronization tools such as unison ( http://www.cis.upenn.edu/~bcpierce/unison/ ) that are designed for this situation and would make your job much easier. I

Re: --compare-dest; I'm missing the boat

2009-01-16 Thread Matt McCutchen
On Fri, 2009-01-16 at 18:04 -0800, Wayne Davison wrote: On Thu, Jan 15, 2009 at 06:11:36PM -0600, Harry Putnam wrote: In other words the full directory structure minus any plain files. Right, that's what compare-dest does. It only copies changed files, omitting all files that haven't

Commit messages

2009-01-16 Thread Matt McCutchen
Wayne, I noticed you have shortened the commit messages of many of the rsync patches I have submitted. Why? Unlike comments in the source, commit messages don't go bad over time, and the extra information may help those trying to decipher the source in the future. -- Matt -- Please use

Re: Improving loadparm design to fix bug in configuration reloading

2009-01-16 Thread Matt McCutchen
On Fri, 2009-01-16 at 19:23 -0800, Wayne Davison wrote: On Wed, Jan 14, 2009 at 02:25:33AM -0500, Matt McCutchen wrote: I think I'll take the opportunity to improve the design a bit by actually adding a section structure representing the global values of section parameters to the global

Re: Problem syncing large dataset

2009-01-15 Thread Matt McCutchen
On Thu, 2009-01-15 at 17:33 +0100, Maarten Thibaut wrote: When using rsync-3.0.2 through 3.0.5, I get this error on a large dataset syncing from machine-a to machine-b: $ /bin/rsync -aHSz /local/. machine-b:/local/. invalid len passed to map_ptr: -1737287498 rsync error: error in file IO

Re: --compare-dest; I'm missing the boat

2009-01-15 Thread Matt McCutchen
On Thu, 2009-01-15 at 16:54 -0600, Harry Putnam wrote: I tried this test. (d1 has single files and 2 subdir with files) cp -a d1 d1a mkdir d2 rsync -avv --compare-dest=./d1a d1/ d2/ d1a is carbon copy of d1 but still every last file in d1 is copied to d2. Two paragraphs later

Re: slow rsync connection establish

2009-01-13 Thread Matt McCutchen
On Tue, 2009-01-13 at 16:20 -0800, tanshul22 wrote: I am running the rsync server on a windows xp machine on my local network. It is taking about 10-15 secs for me to get a connection with the rsync server. Once the connection is established, i am getting transfer speeds of 5-6MBps which is

Improving loadparm design to fix bug in configuration reloading

2009-01-13 Thread Matt McCutchen
While I was working on the avoid-reverse-lookup patches, I found a flaw in the daemon's behavior of reloading the configuration on each connection. If I remove a module parameter (in my case, hosts allow) from the global section, the removal does not take effect. This is because loadparm.c does

Re: webdav timeout

2009-01-12 Thread Matt McCutchen
On Sat, 2009-01-10 at 18:16 +0100, Kraak Helge wrote: I tried to sync two files (50 MB and 100 MB) with my webdav folder using rsync 3.0.5 with Mac OS X (10.4.11) Terminal and X11. With the Terminal application the sync always failed with both files. With X11 I once was successful

Re: (Synchronization among clients with history)

2009-01-12 Thread Matt McCutchen
On Sat, 2009-01-10 at 15:01 -0600, Jeff Allen wrote: I'm looking to build a rough implementation of a multi-client rdiff-backup system; in order to do this I'm using rsync before rdiff-backup. (We'll say there's a server, Client A, and Client B. Files should be synced between A and B but

Re: rsync to fat32 on different platforms

2009-01-12 Thread Matt McCutchen
On Mon, 2009-01-12 at 09:58 +0100, Andreas Nef wrote: Only one additional remark so far: The problem seems to be connected to Windows XP (tested SP 3 so far). On Vista the same task with the same hard drive runs smoothly, while going back to an XP machine shows the same slow behaviour

Re: Rsync error 'unexpected tag 93' when --log-file= parameter is present and run from crontab

2009-01-12 Thread Matt McCutchen
I have some general remarks about the problem; I hope Wayne will have more specific ideas on how to debug it. On Sun, 2009-01-11 at 13:33 +0100, Ernst J. Oud wrote: rsync -vrpth --stats --progress --log-file=/nslu2/rsync.log --log-file-format=%t %i %n%L --include-from=/nslu2/rsync-files

Re: how to connect to rsyncd via forwarded ssh port?

2009-01-12 Thread Matt McCutchen
On Sat, 2009-01-10 at 22:32 +0100, Matthias Meyer wrote: I've running a rsyncd and ssh port forwarding (-R 12345:localhost:873 bac...@server) on a client because the client should not reachable but over ssh. The rsyncd should acessible because I can backup and restore files with backuppc

Re: Rsync crash

2009-01-12 Thread Matt McCutchen
On Mon, 2009-01-12 at 13:29 +0100, Maxence DUNNEWIND wrote: Anyway, after it has been working well for some time (between 2 and 24hours), the rsync daemon crashes. I wouldn't call an infinite loop a crash, but whatever. It is still running but seems to retry something infinitly. The rsync

Re: Delete only run

2009-01-08 Thread Matt McCutchen
On Thu, 2009-01-08 at 09:42 +0100, Fabian Cenedese wrote: I have a backup on a NAS that is quite full. So when I try to backup changed stuff it may run out of space, but only because rsync may try to write a new file before deleting the old one. That not only means changed files in the same

Re: rsync to fat32 on different platforms

2009-01-08 Thread Matt McCutchen
On Thu, 2009-01-08 at 11:38 +0100, Andreas Nef wrote: I have a dozen of external usb disks which should be kept in sync with a central rsync server. As I can't predict which OS they will be used with they are formatted with fat32. If I use them with either Linux (ubuntu) or OS X rsync

Re: how to backup/restore of windows file attributes

2008-12-30 Thread Matt McCutchen
On Tue, 2008-12-30 at 22:40 +0100, Matthias Meyer wrote: I use rsync for backing up windows. After a restore of Desktop.ini I recognize that the hidden attribut and the system attribut will not been restored. I know, this are no unix attributes. But is there a way to backup and restore the

Re: Rsync windows acls

2008-12-29 Thread Matt McCutchen
On Mon, 2008-12-29 at 09:54 -0700, Michael Chletsos wrote: Has rsync integrated windows acls into it yet? No, and the main version probably never will as rsync targets primarily unix-like systems. Windows ACL support would be fair game for a maintained patch that could be included in packagings

Re: restart rsync process via shell script

2008-12-29 Thread Matt McCutchen
On Mon, 2008-12-29 at 08:13 -0800, Noah wrote: I am trying to figure out the most accurate way to assess if an rsync process is running and is established to the remote rsync server and is transferring data. I am writing a bourne shell script to restart rsync if the connection to the

Re: 答复: [Pilot]Recover to a different folder failed! Any way out of the problem?

2008-12-28 Thread Matt McCutchen
[This may be too late to be useful, but I'll answer anyway for future reference.] On Fri, 2008-12-19 at 14:55 +0800, Daniel wrote: I have backup local data every 7 days. Recently, I found that some of local files are infected with virus. Can I use some operation to restore back to 7 days ago?

Re: open solaris --one-file-system ignored, source path also ignored

2008-12-27 Thread Matt McCutchen
On Sat, 2008-12-27 at 10:58 +1100, Jesse Reynolds wrote: I am attempting to backup a remote OpenSolaris zone to a local Mac OS X Server 10.5.machine. Both are running rsync 2.9.6. There's no rsync 2.9.6. I guess you mean 2.6.9? The Solaris box has a filesystem mounted from NFS at /shared

Re: 24, file has vanished

2008-12-27 Thread Matt McCutchen
On Fri, 2008-12-19 at 14:38 +0100, Xavi Aranda wrote: The file have gif extension and isn't a temporary file or deleted file file has vanished: /home/usuaris/connexiotebusuaris/G/GUAPI/gonzalo1/ANIMALES/C?pia de ani-bug.gif The name of the file contain accent, is fot that reason i've

Re: Rsync compression still broken

2008-12-26 Thread Matt McCutchen
On Fri, 2008-12-26 at 14:07 -0800, Les Barstow wrote: I've surfed through the archives and notice that no-one's resolved the compression issue, nor has anyone reported it for a while. I am sad to report that the issue still appears to exist in 3.0.4. Conditions seem similar to other

Re: Windows 2003 Cygwin Netapp remote filesystem

2008-12-26 Thread Matt McCutchen
On Fri, 2008-12-26 at 14:13 -0700, Michael Chletsos wrote: Ok so I have figured out the problem with my rsync daemon is the fact that rsync interprets // as / and therefore is not seeing this as a unc path, but rather a absolute path. This should be fixed in rsync 3.0.5pre2 as well as the

Re: logging mechanism in rsync

2008-12-23 Thread Matt McCutchen
On Tue, 2008-12-23 at 12:20 +0530, Jignesh Shah wrote: Thanks for the info. Basically I want to display all the files which has not transfer because the file has not changed. Can I use --info=skip for this? That would be: - For files that did not need a transfer because they passed

Re: rsync --link-dest option with the destination directory containing old files.

2008-12-23 Thread Matt McCutchen
[Cross-posting this thread from rsync to rsnapshot-discuss because it bears directly on rsnapshot's mode of operation.] On Tue, 2008-12-23 at 10:00 -0600, Dave Dykstra wrote: Rob gave the example of rsync -a --link-dest=../backup.1 source/ backup.0/ where backup.0 already had files in it.

Re: file count limit in rsync V3.0.4

2008-12-23 Thread Matt McCutchen
On Tue, 2008-12-23 at 20:21 +0530, Jignesh Shah wrote: Is there any limit in total files to be transfered in rsync V3.0.4? There's no hard-coded limit, but memory is still a constraint... The rsync V3.0.4 has synching interleaved with file system walk and thus it uses much less memory so

Re: Windows 2003 Cygwin Netapp remote filesystem

2008-12-23 Thread Matt McCutchen
On Tue, 2008-12-23 at 12:39 -0700, Michael Chletsos wrote: Amongst various problems I am having, I am trying to run an rsync daemon on a windows 2003 server with cygwin installed. It works fine, except that I can't seem to get the daemon to chdir to any file that is remotely mounted from my

Re: Windows 2003 Cygwin Netapp remote filesystem

2008-12-23 Thread Matt McCutchen
On Tue, 2008-12-23 at 12:55 -0700, Michael Chletsos wrote: On Tue, Dec 23, 2008 at 12:50 PM, Matt McCutchen m...@mattmccutchen.net wrote: On Tue, 2008-12-23 at 12:39 -0700, Michael Chletsos wrote: Amongst various problems I am having, I am trying to run an rsync daemon on a windows 2003

Re: rsync --link-dest option with the destination directory containing old files.

2008-12-23 Thread Matt McCutchen
On Tue, 2008-12-23 at 15:07 -0600, Dave Dykstra wrote: On Tue, Dec 23, 2008 at 01:52:21PM -0500, Matt McCutchen wrote: I too find the current semantics of basis dirs illogical and would support an option for better semantics (though I think we should avoid changing defaults some users may

Re: Windows 2003 Cygwin Netapp remote filesystem

2008-12-23 Thread Matt McCutchen
Michael, please CC rsync@lists.samba.org so that others can help you and your messages are archived for others' future benefit. On Tue, 2008-12-23 at 14:02 -0700, Michael Chletsos wrote: thanks, I have perms, since I can read and write to the dir. Is the daemon running as the same user who you

Re: logging mechanism in rsync

2008-12-23 Thread Matt McCutchen
On Wed, 2008-12-24 at 09:37 +0530, Jignesh Shah wrote: Could you please tell me why I am getting below errors in rsync 3.0.4? I have rsync 3.0.4 both side. use...@system123:/userid rsync -avz --debug=exclude --info=skip --info=name2 tmp/* sys2.nyc:/userid/tmp/ rsync: --debug=exclude: unknown

Re: file count limit in rsync V3.0.4

2008-12-23 Thread Matt McCutchen
On Wed, 2008-12-24 at 09:23 +0530, Jignesh Shah wrote: Thanks. I have noticed the performance degradation issue in rsync V2 when file count reaches some limit. but I think it wont be there in rsync V3(Assume that directory counts are not much smaller than file counts). Correct? Rsync 3 builds

Tridge's rsync talk: great survey of issues

2008-12-23 Thread Matt McCutchen
I found this transcript of an rsync talk by Andrew Tridgell in 2000: http://olstrans.sourceforge.net/release/OLS2000-rsync/OLS2000-rsync.html Are people aware of this? I found it to be a helpful survey of a number of issues related to rsync that are still important today; to give one example,

Re: Odd behavior in an exclude-file

2008-12-22 Thread Matt McCutchen
On Fri, 2008-12-19 at 10:01 -0600, Roy F. Cabaniss wrote: rsync -avl --stats --progress --timeout=300 --exclude-from /home/foo/bin/exclude.txt /home /mnt/sdc2 Since there are, as with any backups, files I don't want to bother backing up I created an exclude file and stored it in my bin.

Re: [Pilot]Recover to a different folder failed! Any way out of the problem?

2008-12-18 Thread Matt McCutchen
On Fri, 2008-12-19 at 11:46 +0800, Daniel wrote: I backup data in test_laptop folder in my laptop to the server. And I use another PC to get data back from server, and the folder is named with test_pc. But rsync is going to create a folder test_laptop in test_pc. I just wanna everything in

Re: sorting files by size

2008-12-18 Thread Matt McCutchen
On Tue, 2008-12-16 at 10:13 -0500, Sebastien Roy wrote: In this context, an option --sort-by-size would be very helpful to get the maximum number of files transfered before an interruption. size could be the actual file size, or the ammount of bytes that rsync intend to transfer. For now, I

Re: file system parsing question

2008-12-17 Thread Matt McCutchen
On Mon, 2008-12-15 at 10:21 +0530, Jignesh Shah wrote: Could any one tell me rsync start sending the changed file while parsing/walking file system or it starts sending one by one after complete file system walk completed. Regular file transfers are interleaved with filesystem scanning in

Re: Rsync via two ssh tunnels possible (standard method mentioned k times not possible?)

2008-12-17 Thread Matt McCutchen
On Mon, 2008-12-15 at 12:11 +0100, Roman Fiedler wrote: Roman Fiedler wrote: Matt McCutchen wrote: On Fri, 2008-12-12 at 12:56 +0100, Roman Fiedler wrote: The goal is to sync two directories using rsync without running the rsync daemon on one of the two hosts... The additional args

Re: Rsync via two ssh tunnels possible (standard method mentioned k times not possible?)

2008-12-17 Thread Matt McCutchen
On Mon, 2008-12-15 at 10:54 +0100, Roman Fiedler wrote: Matt McCutchen wrote: On Fri, 2008-12-12 at 12:56 +0100, Roman Fiedler wrote: The goal is to sync two directories using rsync without running the rsync daemon on one of the two hosts... I suggest you just replace your nc command

Re: Rsync and recursion protection with .svn folders

2008-12-17 Thread Matt McCutchen
On Wed, 2008-12-17 at 09:02 -0800, Richard Lee wrote: src(local copy) -- dst(svn working copy) I want to sync changes over from src to dst, leaving the [.svn] folders intact on the dst, as long as the folder containg the [.svn] folder still exists in the source. i.e. If a folder is deleted

Re: Transfer mode

2008-12-16 Thread Matt McCutchen
On Tue, 2008-12-16 at 16:57 +0530, Jignesh Shah wrote: Hello Friends, Could any one please tell me what is transfer mode and what are the transfer modes available in rsync? I'm not sure what you mean by transfer mode; I don't know of a concept by that specific name in the concept of rsync.

Re: logging mechanism in rsync

2008-12-16 Thread Matt McCutchen
On Tue, 2008-12-16 at 16:56 +0530, Jignesh Shah wrote: Does rsync V3 has the feature for logging the files which have not been transferred? Out of what set do you want to see the files not transferred? - For files hidden by exclude rules, pass -vv (or --debug=exclude if your rsync is new

Re: Syncing file with reference to another one

2008-12-16 Thread Matt McCutchen
On Tue, 2008-12-16 at 01:28 +0200, Hai Zaar wrote: I have the following situation: file2 on remote host and file1 on localhost. file1 and file2 are mostly the same. Simply running rsync remotehost:file2 file2 will actually transfer the entire file. But I would like to use the factt that I

Re: rsync architecture

2008-12-16 Thread Matt McCutchen
On Mon, 2008-12-15 at 10:14 +0530, Jignesh Shah wrote: I am trying to see the rsync source code. I could see that there are main three processes: I realize that Server or Client becomes Sender or Receiver based on arguments provided. 1. What is the roll of deamon process. How it different

Re: Rsync via two ssh tunnels possible (standard method mentioned k times not possible?)

2008-12-12 Thread Matt McCutchen
On Fri, 2008-12-12 at 12:56 +0100, Roman Fiedler wrote: The goal is to sync two directories using rsync without running the rsync daemon on one of the two hosts. The standard shell sync does not work because of the network topology: Ssh connect to SRC-Host ^ Base host (with ssh

Re: Idle option in rsync

2008-12-12 Thread Matt McCutchen
On Mon, 2008-12-08 at 14:00 +0300, Alexey Vlasov wrote: Is there an option in rsync that would lower loading of the disk, namely loading on a file write/delete? For example, in my case it would be great if after a file writing rsync would sleep for N seconds. My options: rsync -v -a -u

Re: rsync 2.6.5

2008-12-12 Thread Matt McCutchen
On Mon, 2008-12-08 at 16:56 +0530, Deepak K Sharma1 wrote: Currently we are using rsync 2.0 in our system to take backup. But it gives an error when it comes to our one of the folder which has very huge data(50 GB). We got to know that rsync 2.0 is not capable of transfering

Re: What the meaning of the error codes?

2008-12-12 Thread Matt McCutchen
On Thu, 2008-12-11 at 23:19 +0100, Matthias Meyer wrote: Where I can find a list of the error codes and their meanings? Especially I have troubles because of: pre-xfer exec returned failure (32256) in Win XP SP3 pre-xfer exec returned failure (65280) in Vista Those codes are coming from your

Re: Feature I'd love to see: --move-dest

2008-12-12 Thread Matt McCutchen
On Mon, 2008-12-08 at 17:23 -0500, Josh Hanson wrote: Looking over rsync's --compare-dest, --copy-dest, and --link-dest options, there's one thing I really wish I could do, and I've been looking for a few years now for a program that could do it: Instead of copying or hard-linking from the

Re: how to debug the rsync function start_client

2008-12-12 Thread Matt McCutchen
On Fri, 2008-12-05 at 12:04 +0800, shuang quan wen wrote: I am a student in computer science, several weeks ago, i learn the rsync algorithm and i am very interested in it. I use the gdb to debug the rsync,but when i enter the function start_client , I use bt to find the function stacks,but i

Re: Parallel rsync

2008-12-10 Thread Matt McCutchen
On Wed, 2008-12-10 at 12:10 -0800, Jim Searle wrote: Has there ever been a discussion about parallelizing rsync? We do some large file transfers across our wan which get done much faster if we run multiple rsync's at the same time. I wrote a perl script that traverses the directories and

RE: Run rsync through intermediary server with SSH

2008-12-10 Thread Matt McCutchen
On Tue, 2008-12-09 at 12:29 -0800, Jimmie Fulton wrote: Before rewriting my scripts to implement with port forwarding, I decided to try ssh's '-t' (force pseudo-tty allocation) option. This seemed to do the trick for me. I bet the use of a pseudo-tty allows the rsync command to be sent a

Re: What does module option do?

2008-12-08 Thread Matt McCutchen
On Mon, 2008-12-08 at 17:26 +0530, Jignesh Shah wrote: Could anyone please tell me what module option do in below rsync call and which case it is mandatory? rsync -av host::module /dest A module is used when accessing an rsync daemon. See the CONNECTING TO AN RSYNC DAEMON section of the

Re: rsync Failure

2008-12-05 Thread Matt McCutchen
On Fri, 2008-12-05 at 11:42 -0500, Shawn Geraghty wrote: Upgrading will be done, but not really an option at this point, unless of course, that is the fix. I'm a limited resource and other stuff is backing up. I understand, but if the strace does indicate that you're hitting a hang bug

Re: rsync Failure

2008-12-04 Thread Matt McCutchen
On Thu, 2008-12-04 at 16:50 -0500, Shawn Geraghty wrote: I'm having an issue with rsync in that it recently (11/29/2008) started to crash during a daily cron job backup. Below is some info on how rsync is being used to backup our servers. Version: 2.6.9 Please try the latest

Re: how to get details of rsync source code?

2008-12-03 Thread Matt McCutchen
On Wed, 2008-12-03 at 17:49 +0530, Jignesh Shah wrote: I am new to rsync. I learnt the rsync algorithm and functionalities. It seems great. I want to dive into source code of rsync now. Could anyone suggest how should I proceed to understand the code. Is there any documentation about source

<    1   2   3   4   5   6   7   8   9   10   >