rsync and symlinks
Hi, I have one question regarding handling of symlinks in rsync. If I have /source directory in which I have 100s of sub directories of directories and each one has symlink to some directories out side the /source directory hierarchy. Does rsync follows all those symlinks and syncs the data if I specifies below rsync command? rsync -avz /source/ remote.ky:/source/ source | | - source1 -- /projects/win | - source2 -- /projects/unix | - source3 -- /scripts/win | Does rsync command syncs /project contents as well? What if I have some symlinks inside /projects? Thanks, Jignesh -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: rsync and symlinks
Thanks Carlos. ... rsync copy symlinks as symlinks What about the contents pointed by simlinks? Could you please also elaborate on Only if it's inside source. Thanks, Jignesh On Tue, Sep 1, 2009 at 8:25 PM, Carlos Carvalho car...@fisica.ufpr.brwrote: Jignesh Shah (jignesh.shah1...@gmail.com) wrote on 1 September 2009 11:30: Hi, I have one question regarding handling of symlinks in rsync. If I have /source directory in which I have 100s of sub directories of directories and each one has symlink to some directories out side the /source directory hierarchy. Does rsync follows all those symlinks and syncs the data if I specifies below rsync command? rsync -avz /source/ remote.ky:/source/ The -a option in this command will make rsync copy symlinks as symlinks, to faithfully reproduce source on remote.ky. source | | - source1 -- /projects/win | - source2 -- /projects/unix | - source3 -- /scripts/win | Does rsync command syncs /project contents as well? Only if it's inside source. -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.htmlhttp://www.catb.org/%7Eesr/faqs/smart-questions.html -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
snapshot support in rsync
Hi, I have been using rsync-3.0.6 to sync my huge file system and it works awesome. I have been getting really annoying lots of errors about file has vanished. We thought on getting rid of this and realized that having snapshot support in rsync would make things much easier. Could you please let me know if there is any way to get rid of this error message in rsync-3.0.6? If not then is there any plan of getting rid of it in future? Thanks a ton, Jignesh -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
rsync-3.0.6 IO Time out
Hi, We have been facing strange(for me) behavior while synching a file system. Error while syncing /projects/list/: io timeout after 43211 seconds -- exiting Error while syncing /projects/list/: rsync error: timeout in data send/receive (code 30) at io.c(200) [sender=3.0.6] From rsync man page: --timeout=TIMEOUT This option allows you to set a maximum IO timeout in seconds. If no data is transferred for the specified time then rsync will exit. The default is 0, which means no timeout. Could anyone please tell me why IO timeout occures..in other words, why data could not be transferred in 12 hours? BTW, I have not set IOTIMEOUT from rsync but still it has been existing. Thanks, Jignesh -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: Need help of exclusion options in rsync-3.0.6
Thanks Matt, that was great information. I think I don't need to use exclude at all and just need to user H and P flags with --filter option. Also I will need to use --delete option to remove directories filtered H flag. The below command meets exactly my requirements: rsync -avz /foo/bar/ --delete --filter='P /baz' --filter='H /abc' --filter='P /old-baz' desthost:/foo/bar/ Am I missing anything or anything could be done better way? I hope that --include option would not get affected with these options. Thanks a tons, Jignesh On Mon, Jul 27, 2009 at 3:15 AM, Matt McCutchen m...@mattmccutchen.netwrote: On Sun, 2009-07-26 at 21:37 +0530, Jignesh Shah wrote: I have a situation where I want to delete some of my excluded patterns but still want to preserve some other. For example consider below source and destination directory hierarchy. SourceDest -- - /foo/bar/ /foo/bar/ | - baz | - baz | - xyz | - xyz | - abc | - abc | - old-baz I am below comand using --delete-excluded and as a result rsync deletes exluded directories baz and abc and also deletes old-baz. I want to preserve the old-baz and baz directories on destination side and want abc to gets deleted. Could you tell me how to tell rsync to do this? rsync -avz /foo/bar/ --delete-excluded --exclude=/baz --exclude=/abc desthost:/foo/bar/ Recall that an exclude filter is shorthand for a hide plus a protect if --delete-excluded is off, or just a hide if it is on.. Since you want some of your filters to protect destination files from deletion but not others, your best bet would be to drop the --delete-excluded and specify individual hide, protect, and plain exclude (hide+protect) filters. For more detail, carefully read the FILTER RULES section of the man page. Something like the following should do what you described: rsync -avz /foo/bar/ --exclude=/baz --filter='H /abc' \ --filter='P /old-baz' desthost:/foo/bar/ -- Matt -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: Need help of exclusion options in rsync-3.0.6
Yup, it is working. On Mon, Jul 27, 2009 at 7:42 PM, Carlos Carvalho car...@fisica.ufpr.brwrote: Matt McCutchen (m...@mattmccutchen.net) wrote on 26 July 2009 17:45: On Sun, 2009-07-26 at 21:37 +0530, Jignesh Shah wrote: I have a situation where I want to delete some of my excluded patterns but still want to preserve some other. For example consider below source and destination directory hierarchy. SourceDest -- - /foo/bar/ /foo/bar/ | - baz | - baz | - xyz | - xyz | - abc | - abc | - old-baz I am below comand using --delete-excluded and as a result rsync deletes exluded directories baz and abc and also deletes old-baz. I want to preserve the old-baz and baz directories on destination side and want abc to gets deleted. Could you tell me how to tell rsync to do this? rsync -avz /foo/bar/ --delete-excluded --exclude=/baz --exclude=/abc desthost:/foo/bar/ Recall that an exclude filter is shorthand for a hide plus a protect if --delete-excluded is off, or just a hide if it is on.. Since you want some of your filters to protect destination files from deletion but not others, your best bet would be to drop the --delete-excluded and specify individual hide, protect, and plain exclude (hide+protect) filters. For more detail, carefully read the FILTER RULES section of the man page. Something like the following should do what you described: rsync -avz /foo/bar/ --exclude=/baz --filter='H /abc' \ --filter='P /old-baz' desthost:/foo/bar/ Would just --filter='P /abc' (without the --filter='H...') also work? -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Need help of exclusion options in rsync-3.0.6
Hi, I have a situation where I want to delete some of my excluded patterns but still want to preserve some other. For example consider below source and destination directory hierarchy. SourceDest -- - /foo/bar/ /foo/bar/ | - baz | - baz | - xyz | - xyz | - abc | - abc | - old-baz I am below comand using --delete-excluded and as a result rsync deletes exluded directories baz and abc and also deletes old-baz. I want to preserve the old-baz and baz directories on destination side and want abc to gets deleted. Could you tell me how to tell rsync to do this? rsync -avz /foo/bar/ --delete-excluded --exclude=/baz --exclude=/abc desthost:/foo/bar/ Is there any option like --preserve-excluded available? Thanks, Jignesh -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Lots of file exists errors with rsync version 3.0.6
Hi, we have started getting file exists ~100s errors every day. I think we never got it with rsync 2.6.9. Is there anything changed in new version that has been generating these errors? Error while syncing /usr/local/theapp/: rsync: symlink /usr/local/theapp/2009.uv - ../thedt.uv failed: File exists (17) ... Error while syncing /usr/local/theapp/: rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1039) [sender=3.0.6] Am I missing anything? Thanks, Jignesh -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
difference between --no-implied-dir abd --keep-dirlinks ?
Hi, I have gone through the rsync documentation and also tested same both --no-implied-dir and --keep-dirlinks options. My question is what is the difference between these options in below scenario? I have /foo/bar is the symlink to /foo/baz at source and same directory structure with symlink is there at destination. When I sync the data from /foo/bar/* with --relative option specified, I am ending with losing symlink at destination. The rsync replaces symlink (/foo/bar - /foo/baz) with /foo/bar directory and synch data into it rather than synching it to /foo/baz/. When I read rsync documentation and used either of --keep-dirlinks or --no-implied-dir option, everything works as expected. Jignesh -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: could not make way for new symlink !!!
You are correct Carlos but it wasn't happening with rsync-2.6 and started happening with rsync-3.0.6. Do you have any idea on this? On Sat, Jun 6, 2009 at 12:12 AM, Carlos Carvalho car...@fisica.ufpr.brwrote: Jignesh Shah (jignesh.shah1...@gmail.com) wrote on 5 June 2009 18:16: Could any one please help me to get rid of below errors? ERROR: DoRsync(): rsync had errors or failed rsync return code: 23 could not make way for new symlink: bin could not make way for new symlink: etc could not make way for new symlink: include Are you using --delete? If not this may happen if in the source a directory is replaced by a symlink; in the destination rsync must then remove the directory to put the symlink in place but if it's not empty rsync can't because you didn't give --delete, explicitly or implied. If you don't want deletions but want the dir replaced you can use --force. -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
could not make way for new symlink !!!
Could any one please help me to get rid of below errors? ERROR: DoRsync(): rsync had errors or failed rsync return code: 23 could not make way for new symlink: bin could not make way for new symlink: etc could not make way for new symlink: include rsync error: some files/attrs were not transferred (see previous errors) (code 23) at main.c(1505) [generator=3.0.6] Jignesh. -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
rsync and snapshots
Hi, when file is unavailable (or vanished), is there any way to tell rsync to retrieve file from snapshot? Any other idea? Jignesh -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: rsync-3.0.6 prints file list generation time wrong ???
Big thanks Wayne, then could you tell me what the while loop in
flist.c::send_file_list does between calculation of file generation time
(given below)? The while loop generates the complete flist. Isn't it?
gettimeofday(start_tv, NULL);
.
.
while (1) {
Generates the file list
}
.
.
gettimeofday(end_tv, NULL);
stats.flist_buildtime = (int64)(end_tv.tv_sec - start_tv.tv_sec) *
1000
+ (end_tv.tv_usec - start_tv.tv_usec) / 1000;
if (stats.flist_buildtime == 0)
stats.flist_buildtime = 1;
Is there any way I can find out how much time rsync spends in complete file
list generation?
Jignesh.
On Sat, May 30, 2009 at 10:42 PM, Wayne Davison way...@samba.org wrote:
On Fri, May 29, 2009 at 06:29:22PM +0530, Jignesh Shah wrote:
Does that mean rsync traversed complete 1000k files in 0.671 seconds?
Rsync uses an incremental recursion scan by default, so when that is
active the time mentioned is just for the getting-started part of the
scan. I've been thinking aobut making the sender time each extra scan
that it does as the incremental scan progresses and add the times up,
but that is not what rsync currently does.
..wayne..
--
Please use reply-all for most replies to avoid omitting the mailing list.
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
rsync-3.0.6 prints file list generation time wrong ???
Hi, While researching on where rsync-3.0.6 spending more time when we have huge number of files in directory(~1000K files). I got below statistics: 2009/05/28 19:05:38 [9660] building file list . . . 2009/05/28 21:40:09 [9660] Number of files: 724591 2009/05/28 21:40:09 [9660] Number of files transferred: 5674 2009/05/28 21:40:09 [9660] Total file size: 63492447862 bytes 2009/05/28 21:40:09 [9660] Total transferred file size: 1472465959 bytes 2009/05/28 21:40:09 [9660] Literal data: 94119888 bytes 2009/05/28 21:40:09 [9660] Matched data: 1378346071 bytes 2009/05/28 21:40:09 [9660] File list size: 17239106 2009/05/28 21:40:09 [9660] File list generation time: 0.671 seconds 2009/05/28 21:40:09 [9660] File list transfer time: 0.000 seconds 2009/05/28 21:40:09 [9660] Total bytes sent: 115513595 2009/05/28 21:40:09 [9660] Total bytes received: 4873849 2009/05/28 21:40:09 [9660] sent 115513595 bytes received 4873849 bytes 12983.28 bytes/sec 2009/05/28 21:40:09 [9660] total size is 63492447862 speedup is 527.40 Total time for synching is around 2.5 hrs ( sent_bytes / XferRate ). Here I am surprised when I see file list generation time = 0.671 seconds !!! Does that mean rsync traversed complete 1000k files in 0.671 seconds? Jignesh. -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
some files vanished before they could be transferred
Hi, I am getting rsync warning: some files vanished before they could be transferred (code 24) at main.c(1039) [sender=3.0.6] now frequently but while using rsync version 2.6, I used to get it rarely. Any idea would be helpful on why rsync 3.0.6 is throwing this warning frequently. Jignesh. -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: some files vanished before they could be transferred
I wonder why rsync-3.0.6 don;t have --ignore-vanished-files option? Jignesh On Thu, May 28, 2009 at 12:39 PM, Jignesh Shah jignesh.shah1...@gmail.comwrote: Hi, I am getting rsync warning: some files vanished before they could be transferred (code 24) at main.c(1039) [sender=3.0.6] now frequently but while using rsync version 2.6, I used to get it rarely. Any idea would be helpful on why rsync 3.0.6 is throwing this warning frequently. Jignesh. -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: some files vanished before they could be transferred
Actually, rsync has never included --ignore-vanished-files option. I am also interested to have that option. BTW, you can get the patch for this option at https://bugzilla.samba.org/show_bug.cgi?id=3653#c11 Jignesh On Fri, May 29, 2009 at 3:08 AM, henri he...@stmargarets.school.nz wrote: I was not aware of this flag. But I am interested to know why it is not in 3.0.6 if this is the case. It seems like a good option to have available. On 28/05/2009, at 9:16 PM, Jignesh Shah wrote: I wonder why rsync-3.0.6 don;t have --ignore-vanished-files option? Jignesh On Thu, May 28, 2009 at 12:39 PM, Jignesh Shah jignesh.shah1...@gmail.com wrote: Hi, I am getting rsync warning: some files vanished before they could be transferred (code 24) at main.c(1039) [sender=3.0.6] now frequently but while using rsync version 2.6, I used to get it rarely. Any idea would be helpful on why rsync 3.0.6 is throwing this warning frequently. Jignesh. -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: incremental directory searche in rsync 3.0.6
Thanks Matt, does that means, in incremental recursion (to create the missin dirs), --implied-dirs/--no-implied-dirs has no importance? Jignesh. On Tue, May 19, 2009 at 11:24 AM, Matt McCutchen m...@mattmccutchen.netwrote: On Tue, 2009-05-19 at 10:58 +0530, Jignesh Shah wrote: I was in under impression that rsync 3.0.5/3.0.6 creates all the missing directories in the path but I think I am wrong. Could any one tell me is it possible to create all missing dirs in path at destination side if not exists. Currently, I have been getting below errors. rsync -avz /tmp/mytest/rsync-test/dir-test/parent-dir/ desthost:/tmp/mytest/rsync-test/dir-test/parent-dir/ sending incremental file list rsync: mkdir /tmp/mytest/rsync-test/dir-test/parent-dir/ failed: No such file or directory (2) rsync error: error in file IO (code 11) at main.c(576) [receiver=3.0.6] rsync: connection unexpectedly closed (9 bytes received so far) [sender] rsync error: error in rsync protocol data stream (code 12) at io.c(600) [sender=3.0.6] I want rsync to create /mytest/rsync-test/dir-test/parent-dir/ directory heirarchy at destination. I also tried with --relative and --no-implied-dirs/--implied-dirs but no luck. https://bugzilla.samba.org/show_bug.cgi?id=4621#c3 http://lists.samba.org/archive/rsync/2007-October/018993.html Rsync does not create parents of the specified destination directory. You can instead move to a higher destination directory and use --relative to place the files appropriately under it, and rsync will create intervening directories as necessary: rsync -avz --relative /tmp/mytest/rsync-test/dir-test/parent-dir/ desthost:/ The behavior here is the same regardless of incremental recursion. -- Matt -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: incremental directory searche in rsync 3.0.6
O... If I am not wrong then this behavior is same from older rsync2.6.0 to latest rsync3.0.6. Thanks. On Tue, May 19, 2009 at 12:33 PM, Matt McCutchen m...@mattmccutchen.netwrote: On Tue, 2009-05-19 at 12:19 +0530, Jignesh Shah wrote: Thanks Matt, does that means, in incremental recursion (to create the missin dirs), --implied-dirs/--no-implied-dirs has no importance? It is incremental recursion that has no importance. You'll get the same result with or without incremental recursion, though the steps may be done in a different order. The missing directories will be /created/ regardless of the --implied-dirs setting. The difference is that with --implied-dirs, their attributes will be copied from the corresponding source dirs according to your options (-tpog, etc.), while without --implied-dirs, rsync will not set their attributes. -- Matt On Tue, May 19, 2009 at 11:24 AM, Matt McCutchen m...@mattmccutchen.net wrote: On Tue, 2009-05-19 at 10:58 +0530, Jignesh Shah wrote: I was in under impression that rsync 3.0.5/3.0.6 creates all the missing directories in the path but I think I am wrong. Could any one tell me is it possible to create all missing dirs in path at destination side if not exists. Currently, I have been getting below errors. rsync -avz /tmp/mytest/rsync-test/dir-test/parent-dir/ desthost:/tmp/mytest/rsync-test/dir-test/parent-dir/ sending incremental file list rsync: mkdir /tmp/mytest/rsync-test/dir-test/parent-dir/ failed: No such file or directory (2) rsync error: error in file IO (code 11) at main.c(576) [receiver=3.0.6] rsync: connection unexpectedly closed (9 bytes received so far) [sender] rsync error: error in rsync protocol data stream (code 12) at io.c(600) [sender=3.0.6] I want rsync to create /mytest/rsync-test/dir-test/parent-dir/ directory heirarchy at destination. I also tried with --relative and --no-implied-dirs/--implied-dirs but no luck. https://bugzilla.samba.org/show_bug.cgi?id=4621#c3 http://lists.samba.org/archive/rsync/2007-October/018993.html Rsync does not create parents of the specified destination directory. You can instead move to a higher destination directory and use --relative to place the files appropriately under it, and rsync will create intervening directories as necessary: rsync -avz --relative /tmp/mytest/rsync-test/dir-test/parent-dir/ desthost:/ The behavior here is the same regardless of incremental recursion. -- Matt -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
ESTALE error while synching
Hi, I am wondering how rsync-3.0.6 react if it encounters ESTALE error while synching? If I remember correctly then the rsync-2.6.0 skipping that file/dir in case of ESTALE error. Jignesh. -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: ESTALE error while synching
Thanks Matt but I think that should not be a correct behavior. The rsync should retry the ESTALE files rather than giving errors immediately and deleting the files untimely. Jignesh. On Wed, May 20, 2009 at 8:32 AM, Matt McCutchen m...@mattmccutchen.netwrote: On Tue, 2009-05-19 at 15:49 +0530, Jignesh Shah wrote: Hi, I am wondering how rsync-3.0.6 react if it encounters ESTALE error while synching? If I remember correctly then the rsync-2.6.0 skipping that file/dir in case of ESTALE error. If rsync encounters any kind of error reading a source file, it will report the error (causing an eventual exit code of 23) and skip the actual update to the destination file, unless --inplace was specified, in which case the update has already been done. A second rsync run will clean up any mess resulting from untimely deletion of source files. -- Matt -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
incremental directory searche in rsync 3.0.6
Hi, I was in under impression that rsync 3.0.5/3.0.6 creates all the missing directories in the path but I think I am wrong. Could any one tell me is it possible to create all missing dirs in path at destination side if not exists. Currently, I have been getting below errors. rsync -avz /tmp/mytest/rsync-test/dir-test/parent-dir/ desthost:/tmp/mytest/rsync-test/dir-test/parent-dir/ sending incremental file list rsync: mkdir /tmp/mytest/rsync-test/dir-test/parent-dir/ failed: No such file or directory (2) rsync error: error in file IO (code 11) at main.c(576) [receiver=3.0.6] rsync: connection unexpectedly closed (9 bytes received so far) [sender] rsync error: error in rsync protocol data stream (code 12) at io.c(600) [sender=3.0.6] I want rsync to create /mytest/rsync-test/dir-test/parent-dir/ directory heirarchy at destination. I also tried with --relative and --no-implied-dirs/--implied-dirs but no luck. Jignesh -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Any idea on this rsync error?
Hi, we have been getting this errors frequently. ERROR: DoRsync(): rsync had errors or failed rsync return code: 12 unexpected tag -7 rsync error: error in rsync protocol data stream (code 12) at io.c(469) rsync: connection unexpectedly closed (7087269 bytes read so far) rsync error: error in rsync protocol data stream (code 12) at io.c(189) Any idea to avoid it? Thanks, Jignesh -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: Going to upgrad rsync V2.6.7 to V3.0.5
Big Thanks Wayne for your valuable information. -Jignesh On Sat, May 9, 2009 at 12:09 AM, Wayne Davison way...@samba.org wrote: On Thu, May 07, 2009 at 04:50:40PM +0530, Jignesh Shah wrote: I am wondering if we upgrade rsync 3.0.5 then will it cause any unexpected behaviour then rsync 2.6.7? Probably not, but not knowing how you rsync rsync, one can't say for sure. You can read through the various news files, looking for things that may affect you: http://rsync.samba.org/ftp/rsync/src/rsync-2.6.8-NEWS http://rsync.samba.org/ftp/rsync/src/rsync-2.6.9-NEWS http://rsync.samba.org/ftp/rsync/src/rsync-3.0.0-NEWS http://rsync.samba.org/ftp/rsync/src/rsync-3.0.1-NEWS http://rsync.samba.org/ftp/rsync/src/rsync-3.0.2-NEWS http://rsync.samba.org/ftp/rsync/src/rsync-3.0.3-NEWS http://rsync.samba.org/ftp/rsync/src/rsync-3.0.4-NEWS http://rsync.samba.org/ftp/rsync/src/rsync-3.0.5-NEWS http://rsync.samba.org/ftp/rsync/src/rsync-3.0.6-NEWS There is a NOTABLE CHANGES IN BEHAVIOR section in 2 of those files (3.0.0 and 3.0.1). If you run into any problems, you can always try a quick-fix of using either the --no-inc-recursive (--no-i-r) option (which turns off the new, fancy incremental recursion scanning), or the --protocol=29 option (which reverts back to the protocol that 2.6.7 used, which will also disable incremental recursion in addition to several other changes). Most folks are not having problems with the latest rsync, but there are always bugs lying around waiting for less-used use-cases to expose them. I certainly recommend the 3.0.x series over the 2.6.x series. Also I could see so many bug fixes after rsync 3.0.5 release. Do I have to patch all the bug fixes or its fine if I use only rsync 3.0.5? I'd suggest you go with the just-released 3.0.6, personally. :-) ..wayne.. -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: %h %a %u string in --log-file-format doesn't work
Ohhh,,..Thanks Wayne...Got it.. Thanks, Jignesh On Thu, May 7, 2009 at 8:40 PM, Wayne Davison way...@samba.org wrote: On Thu, May 07, 2009 at 04:42:28PM +0530, Jignesh Shah wrote: It does't include the host name, IP address and authenticated user name and instead it keep it as %h %a %u. Could any one tell me what is wrong here? You aren't doing a daemon copy, which is the only time those values are currently defined. I'm considering enhancing %a and %h to derive the IP from the environment when possible (like daemon-mode over remote-shell currently does). That would let someone do normal (non-daemon), ssh copies and still get an IP+hostname put into the log file. ..wayne.. -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: Needs suggestion in using --relative with /./ feature in rsync 3.0.5
Thats great !!! Thanks Wayne for you great reply. could you please also help me to remove my fear in upgrading rsync 3.0.5. We have been planning to upgrad rsync 3.0.5. I have some question on this so that we will not screwed up the file systems. We have been using rsync 2.6.7 since long and we didn't have any major problems. I am wondering if we upgrade rsync 3.0.5 then will it cause any unexpected behaviour then rsync 2.6.7? Can we directly upgrade it without any problems? It would be nice if someone suggest anything that we need to care to be safe side. Also I could see so many bug fixes after rsync 3.0.5 release. *Do I have to patch all the bug fixes or its fine if I use only rsync 3.0.5?* Thanks, Jignesh On Thu, May 7, 2009 at 8:43 PM, Wayne Davison way...@samba.org wrote: On Thu, May 07, 2009 at 04:59:34PM +0530, Jignesh Shah wrote: I just need to execute rsync --relative /foo/./bar/baz/. /tmp/. That's exactly right, though you probably don't need the tailing /. on the source arg (but it doesn't hurt anything). ..wayne.. -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
%h %a %u string in --log-file-format doesn't work
Hi, I have been using --log-file-format and --log-file options in following way in rsync-3.0.5 rsync -avz -ii --log-file-format='%h %a %m %u %i %f %l %o %b' --log-file='/tmp/myfile' /src /dest It does't include the host name, IP address and authenticated user name and instead it keep it as %h %a %u. Could any one tell me what is wrong here? Example output is given below: 2009/05/07 16:39:52 [14432] receiving file list 2009/05/07 16:39:52 [14432] created directory /dest/XXX 2009/05/07 16:39:52 [14438] %h %a %u cd+ . 4096 recv 0 2009/05/07 16:39:57 [14438] %h %a %u f+ Sparc 2340668 recv 1006245 2009/05/07 16:40:02 [14438] %h %a %u f+ linux 2064479 recv 914074 2009/05/07 16:40:06 [14438] %h %a %u f+ x86 3 2161072 recv 961741 2009/05/07 16:40:07 [14438] Number of files: 4 2009/05/07 16:40:07 [14438] Number of files transferred: 3 2009/05/07 16:40:07 [14438] Total file size: 6566219 bytes 2009/05/07 16:40:07 [14438] Total transferred file size: 6566219 bytes 2009/05/07 16:40:07 [14438] Literal data: 6566219 bytes 2009/05/07 16:40:07 [14438] Matched data: 0 bytes 2009/05/07 16:40:07 [14438] File list size: 109 2009/05/07 16:40:07 [14438] File list generation time: 0.001 seconds 2009/05/07 16:40:07 [14438] File list transfer time: 0.000 seconds 2009/05/07 16:40:07 [14438] Total bytes sent: 170 2009/05/07 16:40:07 [14438] Total bytes received: 2882195 2009/05/07 16:40:07 [14438] sent 170 bytes received 2882195 bytes 147813.59 bytes/sec 2009/05/07 16:40:07 [14438] total size is 6566219 speedup is 2.28 Thanks, Jignesh -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Going to upgrad rsync V2.6.7 to V3.0.5
Hi, We have been planning to upgrad rsync 3.0.5. I have some question on this so that we will not screwed up the file systems. We have been using rsync 2.6.7 since long and we didn't have any major problems. I am wondering if we upgrade rsync 3.0.5 then will it cause any unexpected behaviour then rsync 2.6.7? Can we directly upgrade it without any problems? It would be nice if someone suggest anything that we need to care to be safe side. Also I could see so many bug fixes after rsync 3.0.5 release. Do I have to patch all the bug fixes or its fine if I use only rsync 3.0.5? Thanks, Jignesh -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Needs suggestion in using --relative with /./ feature in rsync 3.0.5
Hi, I came across --relative option in rsync 3.0.5 and that looks awesome option through which we can avoid CD usage in base directory. Suppose I want to sync the file from /foo/bar/baz/* to /tmp/bar/baz/ then we have been using wrapper script that do cd /tmp before executing rsync --relative /bar/baz/. /tmp/ command. But I could see that we could avoid using our wrapper script by using /./ concept with --relative option. I just need to execute rsync --relative /foo/./bar/baz/. /tmp/. Please let me know if above changes would work fine without any problems. Is there anything that I might be missing? Any other suggestion would be really appreciated. Thanks, Jignesh -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Problem with --fil
Hi, I am using below command. rsync --verbose --log-file-format='%i %f %l %o %b' --log-file='/tmp/myfile' src/ dest/ Though it is good that all the sync information contents will be redirected to /tmp/myfile, it would be useful if rsync could print at least below final statistics on stdout. 2009/05/05 00:17:45 [26050] Number of files: 18 2009/05/05 00:17:45 [26050] Number of files transferred: 0 2009/05/05 00:17:45 [26050] Total file size: 9593706 bytes 2009/05/05 00:17:45 [26050] Total transferred file size: 0 bytes 2009/05/05 00:17:45 [26050] Literal data: 0 bytes 2009/05/05 00:17:45 [26050] Matched data: 0 bytes 2009/05/05 00:17:45 [26050] File list size: 417 2009/05/05 00:17:45 [26050] File list generation time: 0.001 seconds 2009/05/05 00:17:45 [26050] File list transfer time: 0.000 seconds 2009/05/05 00:17:45 [26050] Total bytes sent: 130 2009/05/05 00:17:45 [26050] Total bytes received: 464 2009/05/05 00:17:45 [26050] sent 130 bytes received 464 bytes 108.00 bytes/sec 2009/05/05 00:17:45 [26050] total size is 9593706 speedup is 16151.02 Could any one please let me know if it is possible to display these statistics on standard output. It would be fine if it also redirected or not to log-file. Thanks, Jignesh -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: Problem with --fil
Hey Matt, OK it is displaying the statistics with --states on stdout as well but I think format has been changed than rsync 2.6.7. Am I right? Thanks, Jignesh On Tue, May 5, 2009 at 12:59 AM, Jignesh Shah jignesh.shah1...@gmail.comwrote: Thanks for reply but I have been passing --states option. I have given the command for example. See below is my exact command. /usr/local/bin/rsync --verbose --bwlimit=6144 --relative --archive --blocking-io --stats --partial --force --timeout=43200 --delete --compress -ii --log-file-format='%i %f %l %o %b' --log-file='/tmp/myfile' --omit-dir-times /src /dest Do you see anything wrong in this command. Thanks, Jignesh On Tue, May 5, 2009 at 12:54 AM, Matt McCutchen m...@mattmccutchen.netwrote: On Tue, 2009-05-05 at 00:26 +0530, Jignesh Shah wrote: Hi, I am using below command. rsync --verbose --log-file-format='%i %f %l %o %b' --log-file='/tmp/myfile' src/ dest/ Though it is good that all the sync information contents will be redirected to /tmp/myfile, it would be useful if rsync could print at least below final statistics on stdout. 2009/05/05 00:17:45 [26050] Number of files: 18 [...] 2009/05/05 00:17:45 [26050] Total bytes received: 464 2009/05/05 00:17:45 [26050] sent 130 bytes received 464 bytes 108.00 bytes/sec 2009/05/05 00:17:45 [26050] total size is 9593706 speedup is 16151.02 Could any one please let me know if it is possible to display these statistics on standard output. It would be fine if it also redirected or not to log-file. Those lines are supposed to be controlled by the --stats option. When I ran your command (which does not have --stats), the stats didn't appear in my log file, so I'm not sure how they got into yours; you might check if you have two different rsyncs writing to the same log file. In any case, if you pass --stats, rsync should print the information to both stdout and the log file. -- Matt -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: Problem with --fil
I think I got it. The line in rsync 2.6.7 wrote 130 bytes read 464 bytes 108.00 bytes/sec is changed to 2009/05/05 00:17:45 [26050] sent 130 bytes received 464 bytes 108.00 bytes/sec in rsync 3.0.5. Please let me know if I am correct. Thanks, Paresh On Tue, May 5, 2009 at 1:02 AM, Jignesh Shah jignesh.shah1...@gmail.comwrote: Hey Matt, OK it is displaying the statistics with --states on stdout as well but I think format has been changed than rsync 2.6.7. Am I right? Thanks, Jignesh On Tue, May 5, 2009 at 12:59 AM, Jignesh Shah jignesh.shah1...@gmail.comwrote: Thanks for reply but I have been passing --states option. I have given the command for example. See below is my exact command. /usr/local/bin/rsync --verbose --bwlimit=6144 --relative --archive --blocking-io --stats --partial --force --timeout=43200 --delete --compress -ii --log-file-format='%i %f %l %o %b' --log-file='/tmp/myfile' --omit-dir-times /src /dest Do you see anything wrong in this command. Thanks, Jignesh On Tue, May 5, 2009 at 12:54 AM, Matt McCutchen m...@mattmccutchen.netwrote: On Tue, 2009-05-05 at 00:26 +0530, Jignesh Shah wrote: Hi, I am using below command. rsync --verbose --log-file-format='%i %f %l %o %b' --log-file='/tmp/myfile' src/ dest/ Though it is good that all the sync information contents will be redirected to /tmp/myfile, it would be useful if rsync could print at least below final statistics on stdout. 2009/05/05 00:17:45 [26050] Number of files: 18 [...] 2009/05/05 00:17:45 [26050] Total bytes received: 464 2009/05/05 00:17:45 [26050] sent 130 bytes received 464 bytes 108.00 bytes/sec 2009/05/05 00:17:45 [26050] total size is 9593706 speedup is 16151.02 Could any one please let me know if it is possible to display these statistics on standard output. It would be fine if it also redirected or not to log-file. Those lines are supposed to be controlled by the --stats option. When I ran your command (which does not have --stats), the stats didn't appear in my log file, so I'm not sure how they got into yours; you might check if you have two different rsyncs writing to the same log file. In any case, if you pass --stats, rsync should print the information to both stdout and the log file. -- Matt -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: Problem with --fil
Thanks Matt, that has solved my problem. Thanks, Jignesh On Tue, May 5, 2009 at 1:16 AM, Matt McCutchen m...@mattmccutchen.netwrote: On Tue, 2009-05-05 at 01:08 +0530, Jignesh Shah wrote: I think I got it. The line in rsync 2.6.7 wrote 130 bytes read 464 bytes 108.00 bytes/sec is changed to 2009/05/05 00:17:45 [26050] sent 130 bytes received 464 bytes 108.00 bytes/sec in rsync 3.0.5. Please let me know if I am correct. That particular change was made long before 2.6.7: http://gitweb.samba.org/?p=rsync.git;a=commit;h=4de2a1740983244221d66b22b983c36a174e3100 $ git name-rev 4de2a1740983244221d66b22b983c36a174e3100 4de2a1740983244221d66b22b983c36a174e3100 tags/v2.6.3pre1~59 The only thing I see different between rsync 2.6.7 and 3.0.5 is that 3.0.5 puts thousand separators in the numbers: sent 3,089 bytes received 285 bytes 6,748.00 bytes/sec total size is 2,138 speedup is 0.63 You can disable that with --no-human-readable . -- Matt -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
The --relative option on remote machine to source machine ???
Hi, I read below lines in rsync v3.0.5 for --relative option. if you used this command: rsync -av /foo/bar/baz.c remote:/tmp/ ... this would create a file named baz.c in /tmp/ on the remote machine. If instead you used rsync -avR /foo/bar/baz.c remote:/tmp/ then a file named /tmp/foo/bar/baz.c would be created on the remote machine, preserving its full path It is also possible to limit the amount of path information that is sent as implied directories for each path you specify. With a modern rsync on the sending side (beginning with 2.6.7), you can insert a dot and a slash into the source path, like this: rsync -avR /foo/./bar/baz.c remote:/tmp/ That would create /tmp/bar/baz.c on the remote machine. (note the line in blue) This says we can use relative option only from source to destination. Could any one tell me how could I use relative option from remote machine to source machine like below: rsync -avR remote:/foo/./bar/. /tmp/ I want to sync everything in /foo/bar/ on remote machine to /tmp/bar/ on source machine. Currently this command creates /tmp/foo/bar/ directory. Thanks, Jignesh -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: The --relative option on remote machine to source machine ???
Sorry guys, I was using rsync 2.6.7 in rsync -avR remote:/foo/./bar/. /tmp/ command. In rsync v3.0.5 it works as expected. Thanks, Jignesh On Sun, May 3, 2009 at 12:07 AM, Jignesh Shah jignesh.shah1...@gmail.comwrote: Hi, I read below lines in rsync v3.0.5 for --relative option. if you used this command: rsync -av /foo/bar/baz.c remote:/tmp/ ... this would create a file named baz.c in /tmp/ on the remote machine. If instead you used rsync -avR /foo/bar/baz.c remote:/tmp/ then a file named /tmp/foo/bar/baz.c would be created on the remote machine, preserving its full path It is also possible to limit the amount of path information that is sent as implied directories for each path you specify. With a modern rsync on the sending side (beginning with 2.6.7), you can insert a dot and a slash into the source path, like this: rsync -avR /foo/./bar/baz.c remote:/tmp/ That would create /tmp/bar/baz.c on the remote machine. (note the line in blue) This says we can use relative option only from source to destination. Could any one tell me how could I use relative option from remote machine to source machine like below: rsync -avR remote:/foo/./bar/. /tmp/ I want to sync everything in /foo/bar/ on remote machine to /tmp/bar/ on source machine. Currently this command creates /tmp/foo/bar/ directory. Thanks, Jignesh -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Overwrite the log-file in rsync3.0.5
Hi, Could any one please let me know if there is anyway to overwrite the log-file if it already exists. I want /tmp/mylogs/myfile file to be overwritten each time below command executes. rsync -av -ii file-format='MyLogs: %i %f %l %o %b' --log-file='/tmp/mylogs/myfile' Thanks, Jignesh -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Overwrite the rsync log-file in rsync3.0.5 ??
Hi, Could any one please let me know if there is anyway to overwrite the log-file if it already exists. I want /tmp/mylogs/myfile file to be overwritten each time below command executes. rsync -av -ii file-format='MyLogs: %i %f %l %o %b' --log-file='/tmp/mylogs/myfile' Thanks, Jignesh -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: itemized option (-ii) with --log-file and --log-file format
David, How could I use sed in rsync -av --stats -ii --log-file-format='CONTENTS: %i %f %l %o %b' --log-file='/tmp/rsync-test' src/ dest/ command. For that, i think I have to redirect output to stdout using --out-format an needs to read it. but I want to redirect the desire output directly to the file. Thanks. On Mon, Apr 6, 2009 at 12:24 PM, David Overton da...@overtons.id.au wrote: Pipe the output through sed? 2009/4/6 Jignesh Shah jignesh.shah1...@gmail.com: Thanks Wayne for reply. I want to use log-file support only so that i need not to read stdout and put output into the file. I have to use -ii so that it print all the statistic info about what files/dirs synched and what are not. Please refer below output: with -i only. --- 2009/04/06 10:38:41 [27475] building file list 2009/04/06 10:38:41 [27475] sent 88 bytes received 12 bytes 200.00 bytes/sec 2009/04/06 10:38:41 [27475] total size is 1003012 speedup is 10030.12 with -ii - 2009/03/31 15:15:17 [4537] building file list 2009/03/31 15:15:29 [4537] created directory Mydocs1 2009/03/31 15:15:29 [4537] CONTENTS: cd+ Mydocs/. 4096 send 0 2009/03/31 15:15:29 [4537] CONTENTS: f+ Mydocs/1.pl 394 send 437 2009/03/31 15:15:29 [4537] CONTENTS: f+ Mydocs/CHANGELOG.txt 2588 send 2631 . . I want the output of -ii but dont want cryptic output in it (e.g. cd+ , f+ etc). If we remove it then it will become similar output as 2.6.* version output. Is it possible? Thanks, Jignesh On Thu, Apr 2, 2009 at 8:14 PM, Wayne Davison way...@samba.org wrote: On Wed, Apr 01, 2009 at 10:50:13AM +0530, Jignesh Shah wrote: I noticed that the output format for this command is different from rsync V2.6.* . Is there any way I can make this output similar to rsync V2.6.*? What difference are you referring to? The use of send instead of recv for a local transfer? That is a more accurate representation of what rsync is doing, but you can change it by forcing rsync to pull files from localhost. See the support/lsh script for a way to pull from localhost w/o using a remote shell. If that's not the issue, please elaborate. ..wayne.. -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.htmlhttp://www.catb.org/%7Eesr/faqs/smart-questions.html -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: itemized option (-ii) with --log-file and --log-file format
If you just want to log transferred files, No, I also want to log files that are not transferred. Thanks, Jignesh On Tue, Apr 7, 2009 at 8:04 PM, Wayne Davison way...@samba.org wrote: On Mon, Apr 06, 2009 at 10:45:42AM +0530, Jignesh Shah wrote: I have to use -ii so that it print all the statistic info about what files/dirs synched and what are not. No, -ii will include unchanged files in the logs in addition to changed files, and thus a %i field (the one with the cryptic characters) is needed to distinguish the two. The -i option also tells rsync to log about files that have attribute changes (not just transferred files), and the %i field is necessary to be able to distinguish if a file just got tweaked or was transferred. If you just want to log transferred files, don't specify -i at all, and use your prior --log-file=FILE and --log-file-format=FORMAT options, but leave out the %i parameter in the latter. ..wayne.. -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: cryptic output with itemized option
Thanks Paul for reply but I want to user log-file support only so that i need not to read stdout and put output into the file. I have to use -ii so that it print all the statistic info about what files/dirs synched and what are not. Please refer below output: with -i only. --- 2009/04/06 10:38:41 [27475] building file list 2009/04/06 10:38:41 [27475] sent 88 bytes received 12 bytes 200.00 bytes/sec 2009/04/06 10:38:41 [27475] total size is 1003012 speedup is 10030.12 with -ii - 2009/03/31 15:15:17 [4537] building file list 2009/03/31 15:15:29 [4537] created directory Mydocs1 2009/03/31 15:15:29 [4537] CONTENTS: cd+ Mydocs/. 4096 send 0 2009/03/31 15:15:29 [4537] CONTENTS: f+ Mydocs/1.pl 394 send 437 2009/03/31 15:15:29 [4537] CONTENTS: f+ Mydocs/CHANGELOG.txt 2588 send 2631 . . I want the output of -ii but dont want cryptic output in it (e.g. cd+ , f+ etc). If we remove it then it will become similar output as 2.6.* version output. Is it possible? Thanks, Jignesh On Thu, Apr 2, 2009 at 2:49 PM, Paul Slootman paul+rs...@wurtel.netpaul%2brs...@wurtel.net wrote: On Thu 02 Apr 2009, Jignesh Shah wrote: Could any one please tell me if there is any way to remove 11 letters long cryptic output from -ii option. That cryptic output is the main point of --itemize-changes... And note that -ii is dedundant, -i is enough. I suspect you want to use --out-format=... instead of --itemize-changes. Paul -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.htmlhttp://www.catb.org/%7Eesr/faqs/smart-questions.html -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: itemized option (-ii) with --log-file and --log-file format
Thanks Wayne for reply. I want to use log-file support only so that i need not to read stdout and put output into the file. I have to use -ii so that it print all the statistic info about what files/dirs synched and what are not. Please refer below output: with -i only. --- 2009/04/06 10:38:41 [27475] building file list 2009/04/06 10:38:41 [27475] sent 88 bytes received 12 bytes 200.00 bytes/sec 2009/04/06 10:38:41 [27475] total size is 1003012 speedup is 10030.12 with -ii - 2009/03/31 15:15:17 [4537] building file list 2009/03/31 15:15:29 [4537] created directory Mydocs1 2009/03/31 15:15:29 [4537] CONTENTS: cd+ Mydocs/. 4096 send 0 2009/03/31 15:15:29 [4537] CONTENTS: f+ Mydocs/1.pl 394 send 437 2009/03/31 15:15:29 [4537] CONTENTS: f+ Mydocs/CHANGELOG.txt 2588 send 2631 . . I want the output of -ii but dont want cryptic output in it (e.g. cd+ , f+ etc). If we remove it then it will become similar output as 2.6.* version output. Is it possible? Thanks, Jignesh On Thu, Apr 2, 2009 at 8:14 PM, Wayne Davison way...@samba.org wrote: On Wed, Apr 01, 2009 at 10:50:13AM +0530, Jignesh Shah wrote: I noticed that the output format for this command is different from rsync V2.6.* . Is there any way I can make this output similar to rsync V2.6.*? What difference are you referring to? The use of send instead of recv for a local transfer? That is a more accurate representation of what rsync is doing, but you can change it by forcing rsync to pull files from localhost. See the support/lsh script for a way to pull from localhost w/o using a remote shell. If that's not the issue, please elaborate. ..wayne.. -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
cryptic output with itemized option
Hi, Could any one please tell me if there is any way to remove 11 letters long cryptic output from -ii option. I am using rsync 3.0.5 rsync -av -stats -ii --log-file-format='CONTENTS: %i %f %l %o %b' --log-file='/tmp/rsync-test' Mydocs/ Mydocs1/ The output of this command: 2009/03/31 15:15:17 [4537] building file list 2009/03/31 15:15:29 [4537] created directory Mydocs1 2009/03/31 15:15:29 [4537] CONTENTS: cd+ Mydocs/. 4096 send 0 2009/03/31 15:15:29 [4537] CONTENTS: f+ Mydocs/1.pl 394 send 437 2009/03/31 15:15:29 [4537] CONTENTS: f+ Mydocs/CHANGELOG.txt 2588 I want to remove cd+, f+ etc from whole output to make it compatible with rsync V2.6.7. Is it possible? Thanks, Jignesh -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
itemized option (-ii) with --log-file and --log-file format
Hi, I am using rsync3.0.5 both side. I have been using below rsync command to get the sync info. rsync -av --stats -ii --log-file-format='CONTENTS: %i %f %l %o %b' --log-file='/tmp/rsync-test' src/ dest/ I noticed that the output format for this command is different from rsync V2.6.* . Is there any way I can make this output similar to rsync V2.6.*? Thanks, Jignesh -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: how rsync calculate Tranfer rate ??
Hi, Still I couldnot understand below items: 1. Let me give more details on bytes written. The Total transferred file size: 6566219 bytes is perfectly fine but Total bytes written: 6567384 includes 1165 more bytes. How rsync could write more than the total file size? What the additional bytes includes? 2. How transfer rate is 170583.48 bytes/sec? Could someone please help me here. Thanks, Jignesh On Mon, Mar 2, 2009 at 1:36 PM, Jignesh Shah jignesh.shah1...@gmail.comwrote: Hi, I am not sure how rsync calculates below statistics and how transfer rate 170583.48 bytes/sec ? Where is the total transfer time information? How speedup is 1? How Total bytes written is 6567384? Could someone please give me brief information on this. Number of files: 4 Number of files transferred: 3 Total file size: 6566219 bytes Total transferred file size: 6566219 bytes Literal data: 6566219 bytes Matched data: 0 bytes File list size: 134 Total bytes written: 6567384 Total bytes read: 80 wrote 6567384 bytes read 80 bytes 170583.48 bytes/sec total size is 6566219 speedup is 1.00 Thanks, Jignesh -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: find out the meaning of rsync error code
Stuart, This problem is harassing us since long now. It occurs only when we run rsync in daemon mode and on remote sites. It works perfectly fine if source and destination are in same site. We have tried --blocking-io and also ran rsync manually but still no luck. We are not able to find what is the actual problem. Could you please help us here. Thanks, Jignesh On 1/20/09, Stuart Halliday stua...@ecs-tech.com wrote: Correct. -- Stuart Halliday I think there is no bulletproof solution for this. Right? Thanks, Jignesh On 1/20/09, Stuart Halliday stua...@ecs-tech.com wrote: When I get errors like that I do a manual rsync command via a terminal (or command prompt) shell which tries to list the contents of either side of the connection. This at least shows you if the connection and rsync is working. ie rsync -v metatex.org::minimals-temp/test/ or rsync /cygdrive/c/ -- Stuart Halliday -Original Message- From: Jignesh Shah jignesh.shah1...@gmail.com To: Stuart Halliday stua...@ecs-tech.com Date: Tue, 20 Jan 2009 16:18:25 +0530 Subject: Re: find out the meaning of rsync error code Thanks Sven and Stuart for reply. They both are running at the same version 2.6.0 but still it gives same error. It was working fine since months but just now it has started throwing below error. ERROR: DoRsync(): rsync had errors or failed rsync return code: 12 unexpected tag -7 rsync error: error in rsync protocol data stream (code 12) at io.c(469) rsync: connection unexpectedly closed (3941538 bytes read so far) rsync error: error in rsync protocol data stream (code 12) at io.c(189) On 1/20/09, Stuart Halliday stua...@ecs-tech.com wrote: See bottom of Man page @ http://www.samba.org/ftp/rsync/rsync.html EXIT Values 12 is: Error in rsync protocol data stream I suggest that this may be caused by you using two different versions of Rsync? Please check that the daemon and client are running the same version. -- Stuart Halliday -Original Message- From: Jignesh Shah jignesh.shah1...@gmail.com To: rsync@lists.samba.org Date: Tue, 20 Jan 2009 15:25:05 +0530 Subject: find out the meaning of rsync error code Hi, Could anyone please tell me how to get the meaning of rsync error codes. In rsync return code: 12 error, what 12 indicates? Thanks, Jignesh This email is the property of ECS Technology Ltd. This company is registered in Scotland with company number 212513. VAT registered GB 761 7456 12 http://www.ecs-tech.com/ -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: find out the meaning of rsync error code
I missed one point is that: It is also works between remote sites when we run rsync as a client-server normally.(i.e.non-daemon mode). Thanks. On 1/21/09, Jignesh Shah jignesh.shah1...@gmail.com wrote: Stuart, This problem is harassing us since long now. It occurs only when we run rsync in daemon mode and on remote sites. It works perfectly fine if source and destination are in same site. We have tried --blocking-io and also ran rsync manually but still no luck. We are not able to find what is the actual problem. Could you please help us here. Thanks, Jignesh On 1/20/09, Stuart Halliday stua...@ecs-tech.com wrote: Correct. -- Stuart Halliday I think there is no bulletproof solution for this. Right? Thanks, Jignesh On 1/20/09, Stuart Halliday stua...@ecs-tech.com wrote: When I get errors like that I do a manual rsync command via a terminal (or command prompt) shell which tries to list the contents of either side of the connection. This at least shows you if the connection and rsync is working. ie rsync -v metatex.org::minimals-temp/test/ or rsync /cygdrive/c/ -- Stuart Halliday -Original Message- From: Jignesh Shah jignesh.shah1...@gmail.com To: Stuart Halliday stua...@ecs-tech.com Date: Tue, 20 Jan 2009 16:18:25 +0530 Subject: Re: find out the meaning of rsync error code Thanks Sven and Stuart for reply. They both are running at the same version 2.6.0 but still it gives same error. It was working fine since months but just now it has started throwing below error. ERROR: DoRsync(): rsync had errors or failed rsync return code: 12 unexpected tag -7 rsync error: error in rsync protocol data stream (code 12) at io.c(469) rsync: connection unexpectedly closed (3941538 bytes read so far) rsync error: error in rsync protocol data stream (code 12) at io.c(189) On 1/20/09, Stuart Halliday stua...@ecs-tech.com wrote: See bottom of Man page @ http://www.samba.org/ftp/rsync/rsync.html EXIT Values 12 is: Error in rsync protocol data stream I suggest that this may be caused by you using two different versions of Rsync? Please check that the daemon and client are running the same version. -- Stuart Halliday -Original Message- From: Jignesh Shah jignesh.shah1...@gmail.com To: rsync@lists.samba.org Date: Tue, 20 Jan 2009 15:25:05 +0530 Subject: find out the meaning of rsync error code Hi, Could anyone please tell me how to get the meaning of rsync error codes. In rsync return code: 12 error, what 12 indicates? Thanks, Jignesh This email is the property of ECS Technology Ltd. This company is registered in Scotland with company number 212513. VAT registered GB 761 7456 12 http://www.ecs-tech.com/ -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
rsync invalid tag error
Hi, Please let me know what what could be the cause of below error: ERROR: DoRsync(): rsync had errors or failed rsync return code: 12 unexpected tag -7 rsync error: error in rsync protocol data stream (code 12) at io.c(469) rsync: connection unexpectedly closed (3941538 bytes read so far) rsync error: error in rsync protocol data stream (code 12) at io.c(189) Thanks, Jignesh -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
find out the meaning of rsync error code
Hi, Could anyone please tell me how to get the meaning of rsync error codes. In rsync return code: 12 error, what 12 indicates? Thanks, Jignesh -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
file count limit in rsync V3.0.4
Hi Friends, Is there any limit in total files to be transfered in rsync V3.0.4? The rsync V3.0.4 has synching interleaved with file system walk and thus it uses much less memory so ideally it should not have any limit of total number of files to be transfered. Am I right? Thanks, Jignesh -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: file count limit in rsync V3.0.4
Matt, Thanks. I have noticed the performance degradation issue in rsync V2 when file count reaches some limit. but I think it wont be there in rsync V3(Assume that directory counts are not much smaller than file counts). Correct? Thanks, Jignesh On Wed, Dec 24, 2008 at 12:31 AM, Matt McCutchen m...@mattmccutchen.netwrote: On Tue, 2008-12-23 at 20:21 +0530, Jignesh Shah wrote: Is there any limit in total files to be transfered in rsync V3.0.4? There's no hard-coded limit, but memory is still a constraint... The rsync V3.0.4 has synching interleaved with file system walk and thus it uses much less memory so ideally it should not have any limit of total number of files to be transfered. Am I right? No, it still holds a list of all directories (called dir_flist) in memory, so you may still hit a limit on the number of directories. See: http://lists.samba.org/archive/rsync/2007-August/018193.html -- Matt -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: logging mechanism in rsync
Matt, Could you please tell me why I am getting below errors in rsync 3.0.4? I have rsync 3.0.4 both side. use...@system123:/userid rsync --version rsync version 3.0.4 protocol version 30 Copyright (C) 1996-2008 by Andrew Tridgell, Wayne Davison, and others. Web site: http://rsync.samba.org/ Capabilities: 64-bit files, 64-bit inums, 32-bit timestamps, 64-bit long ints, socketpairs, hardlinks, symlinks, no IPv6, batchfiles, inplace, append, ACLs, no xattrs, iconv, no symtimes rsync comes with ABSOLUTELY NO WARRANTY. This is free software, and you are welcome to redistribute it under certain conditions. See the GNU General Public Licence for details. Errors: use...@system123:/userid rsync -avz --debug=exclude --info=skip --info=name2 tmp/* sys2.nyc:/userid/tmp/ rsync: --debug=exclude: unknown option rsync error: syntax or usage error (code 1) at main.c(1423) [client=3.0.4] use...@system123:/userid rsync -avz --info=skip --info=name2 tmp/* sys2.nyc:/userid/tmp/ rsync: --info=skip: unknown option rsync error: syntax or usage error (code 1) at main.c(1423) [client=3.0.4] use...@system123:/userid rsync -avz --info=name2 tmp/* sys2.nyc:/userid/tmp/ rsync: --info=name2: unknown option rsync error: syntax or usage error (code 1) at main.c(1423) [client=3.0.4] use...@system123:/userid rsync -avz -w tmp/* sys2.nyc:/userid/tmp/ rsync: -w: unknown option rsync error: syntax or usage error (code 1) at main.c(1423) [client=3.0.4] Thanks, Jignesh On Tue, Dec 23, 2008 at 10:00 PM, Matt McCutchen m...@mattmccutchen.netwrote: On Tue, 2008-12-23 at 12:20 +0530, Jignesh Shah wrote: Thanks for the info. Basically I want to display all the files which has not transfer because the file has not changed. Can I use --info=skip for this? That would be: - For files that did not need a transfer because they passed the quick check, pass -vv (--info=name2) and look for FILENAME is uptodate, or pass -ii and look for files whose itemize code is blank after the first two characters. -- Matt -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: logging mechanism in rsync
Thanks Matt. I thought V3.0.5 is the latest version. From where I can download 3.1.* ? Is it preview version? Thanks, Jignesh On Wed, Dec 24, 2008 at 9:43 AM, Matt McCutchen m...@mattmccutchen.netwrote: On Wed, 2008-12-24 at 09:37 +0530, Jignesh Shah wrote: Could you please tell me why I am getting below errors in rsync 3.0.4? I have rsync 3.0.4 both side. use...@system123:/userid rsync -avz --debug=exclude --info=skip --info=name2 tmp/* sys2.nyc:/userid/tmp/ rsync: --debug=exclude: unknown option rsync error: syntax or usage error (code 1) at main.c(1423) [client=3.0.4] [similar cases...] The --info=* and --debug=* options require a 3.1.* development version of rsync from the source repository. use...@system123:/userid rsync -avz -w tmp/* sys2.nyc:/userid/tmp/ rsync: -w: unknown option rsync error: syntax or usage error (code 1) at main.c(1423) [client=3.0.4] I think you misread my -vv (two occurrences of the letter v) as -w. -- Matt -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: logging mechanism in rsync
Matt, Thanks for the info. Basically I want to display all the files which has not transfer because the file has not changed. Can I use --info=skip for this? Thanks, Jignesh On Tue, Dec 16, 2008 at 8:18 PM, Matt McCutchen m...@mattmccutchen.netwrote: On Tue, 2008-12-16 at 16:56 +0530, Jignesh Shah wrote: Does rsync V3 has the feature for logging the files which have not been transferred? Out of what set do you want to see the files not transferred? - For files hidden by exclude rules, pass -vv (or --debug=exclude if your rsync is new enough to support it) and look for messages like: [sender] hiding directory alsomydir because of pattern /alsomydir - For files skipped because of --min-size, --max-size, --update, --ignore-existing, or --ignore-non-existing, pass -v (--info=skip) and look for the corresponding messages. - For files that did not need a transfer because they passed the quick check, pass -vv (--info=name2) and look for FILENAME is uptodate, or pass -ii and look for files whose itemize code is blank after the first two characters. - If rsync tries and fails to transfer a file, it will print an error message and exit immediately (for fatal errors) or with code 23 at the end of the run (for nonfatal ones). Unfortunately, the error message does not always name the affected file; see: http://lists.samba.org/archive/rsync/2008-January/019650.html If none of those were what you were asking, please be more specific. -- Matt -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: rsync architecture
Thanks a lot Matt. I understood everying now. :-) On Wed, Dec 17, 2008 at 4:55 AM, Matt McCutchen m...@mattmccutchen.netwrote: On Mon, 2008-12-15 at 10:14 +0530, Jignesh Shah wrote: I am trying to see the rsync source code. I could see that there are main three processes: I realize that Server or Client becomes Sender or Receiver based on arguments provided. 1. What is the roll of deamon process. How it different from server? Does it run always on remote machine? When I do rsync from client how remote deamon/server will get triggered? In the context of rsync, the server is simply the rsync process that is accessed on the user's behalf to handle one end of the transfer: the remote end if there is one, or otherwise (arbitrarily) the destination. A daemon is a server with some extra features controlled by a configuration file: it limits clients to accessing areas of the filesystem defined as modules, and it can optionally listen on a port for any number of client connections (which it handles individually). An rsync client can fork a server locally, invoke a plain server over remote shell, connect to a listening daemon, or invoke a single-use daemon over remote shell. In the last two cases, rsync carries out a daemon protocol before the main transfer protocol begins. (Now that I've taken the time to write a complete, concise explanation, maybe it will eventually find its way into my revised man page.) 2 .Where the arguments are being set. I cannot see any of arguments(like am_server, am_deamon etc) is being set anywhere. They are set from the --daemon and --server command-line arguments. git grep is your friend: rsync $ git grep -E -n 'am_(server|daemon) =' cleanup.c:110: am_server = 2; clientserver.c:773: am_server = 1; /* Don't let someone try to be tricky. */ options.c:79:int am_server = 0; options.c:100:int am_daemon = 0; options.c:1305: am_server = 1; options.c:1386: am_daemon = 1; pipe.c:135: am_server = 1; -- Matt -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
logging mechanism in rsync
Hi Friends, Does rsync V3 has the feature for logging the files which have not been transferred? Its already logs the file which have been transfered. Thanks, Jignesh -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Transfer mode
Hello Friends, Could any one please tell me what is transfer mode and what are the transfer modes available in rsync? Thanks, Jignesh -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
rsync architecture
Hi All,
I am trying to see the rsync source code. I could see that there are main
three processes: I realize that Server or Client becomes Sender or Receiver
based on arguments provided.
1. Daemon
start_daemon : clientserver.c
2. Server
if(sender) {
call recv_filter_list : exclude.c
call send_file_list : flist.c
call send_files : sender.c
} else {
call recv_filter_list : exlude.c
call recv_file_list : flist.c
call do_recv : main.c
call recv_files : receiver.c
call generate files : generator.c
}
3. Client
call do_cmd : main.c
call client_run : main.c
if(sender) {
call send_filter_list : exclude.c
call send_file_list : flist.c
call send_files : sender.c
} else {
call send_filter_list : exclude.c
call recv_file_list : flist.c
call do_recv : main.c
call recv_files : receiver.c call generate files :
generator.c
}
I have noticed that deamon process will start only if am_daemon argument
provided. My questions are
1. What is the roll of deamon process. How it different from server? Does it
run always on remote machine? When I do rsync from client how remote
deamon/server will get triggered?
2 .Where the arguments are being set. I cannot see any of arguments(like
am_server, am_deamon etc) is being set anywhere.
Please help me on this so that I can proceed.
Thanks,
Jignesh
--
Please use reply-all for most replies to avoid omitting the mailing list.
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
file system parsing question
Hi Friends, Could any one tell me rsync start sending the changed file while parsing/walking file system or it starts sending one by one after complete file system walk completed. Thanks, Jignesh -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
use rsync 3.0.4
Hello Friends, We are using rsync 2.6 and planning to switch to rsync 3.0.4 latest version. Could anyone tell me how would I get latest rsync version executable for unix different platform like sparc, i86 and linux? Also how would I know what are the changes made in rsync2.6 to rsync3.0.4? Thanks in advanced, Jignesh -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
File System walk in rsync
Hello Friends, Could any atleast one tell me how rsync walk the complete File System and when it start actual synching? Thanks, Jignesh On Thu, Dec 4, 2008 at 1:32 PM, Jignesh Shah [EMAIL PROTECTED]wrote: Hi Friends, I think lot of changes have been made from rsync 2.6.0 to V3. The one major change is rsync V3 will not walk complete file system first and then start the synching but it will parallely start synching as well along with file system walking. Could any one tell me which source files got affected with this change. I think it should be using more threads now. Thanks, Jignesh -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
What does module option do?
Hi, Could anyone please tell me what module option do in below rsync call and which case it is mandatory? rsync -av host::module /dest Thanks, Jignesh -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
changes in rsync V3
Hi Friends, I think lot of changes have been made from rsync 2.6.0 to V3. The one major change is rsync V3 will not walk complete file system first and then start the synching but it will parallely start synching as well along with file system walking. Could any one tell me which source files got affected with this change. I think it should be using more threads now. Thanks, Jignesh -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: rssync source code as a windows project
Thanks Sachar. but I am completely new in UNIX world. Could you tell me how ctags and cscope will help me and from where I can read those manuals? BTW, If I could not compile then its fine. I just want to migrate to specific function quickly and when i move my cursor on variable it should display what is this variable and where it defined.(For example I could see so many constans like ARENA_SIZE). If simply I should create project and add everything as project(folder) wise, do you think it will work? Thanks a lot, Jignesh On Thu, Dec 4, 2008 at 1:44 PM, Shachar Shemesh [EMAIL PROTECTED] wrote: Jignesh Shah wrote: Thanks for reply. Could you tell what do you mean by RTFM ctags and cscope,?? RTFM - Read The Manual ctags and cscope - utilities whose manual I think you should read. Creating a new project I think it will have so many errors. We can do it only if we know the complete code. If anybody or you have done then please forward it to me. rsync is a POSIX application. It will not compile natively on Windows without a considerable porting effort. No such port exists. If you only want VC to trace the function flow, it should be able to do that without compiling the code (see my rant above). If you want the code to compile on VC, I suggest you do the porting. Shachar -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
how to get details of rsync source code?
Hi Friends, I am new to rsync. I learnt the rsync algorithm and functionalities. It seems great. I want to dive into source code of rsync now. Could anyone suggest how should I proceed to understand the code. Is there any documentation about source code available? Basically I want to find out the execution path of complete client and server program. currently I am not able to separate client and server programs itself. Thanks, Jack -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
rssync source code as a windows project
Hi Friends, I have started learning rsync source code but I am finding very difficult to go back and forth to find the execution flow. I could see that rsync code is written in UNIX and the compilation is difficult. Does anybody converted it into Windows Project so that we can open in using Visual Studio IDE and it will be very simple to search for some function and find the complete work flow. Thanks, Jignesh -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: rssync source code as a windows project
Thanks for reply. Could you tell what do you mean by RTFM ctags and cscope,?? Creating a new project I think it will have so many errors. We can do it only if we know the complete code. If anybody or you have done then please forward it to me. Thanks, Jignesh On Thu, Dec 4, 2008 at 1:12 PM, Shachar Shemesh [EMAIL PROTECTED] wrote: Jignesh Shah wrote: Hi Friends, I have started learning rsync source code but I am finding very difficult to go back and forth to find the execution flow. I could see that rsync code is written in UNIX and the compilation is difficult. Does anybody converted it into Windows Project so that we can open in using Visual Studio IDE and it will be very simple to search for some function and find the complete work flow. Thanks, Jignesh RTFM ctags and cscope, or just create a project and put the sources into it (not that I think the later will do you much good). rant Personally, I find VS's cross reference to have deteriorated considerably over the versions. VS6 had a cross reference that was tied to the compiler's symbol tables. This worked excellent, as no amount of preprocessor trickery would fool it. I much preferred it to ctags. Somewhere between version 6 and version 9, MS switched to Intellisense for cross referencing. My guess is that the VS6 version wouldn't cross reference a project unless it could compile it, and people (or at least MS's sales people) complained. As a result, the cross reference is much less accurate and error prone, and I no longer see any advantage for it over ctags and other tools available for Linux and Posix platforms. /rant Shachar -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
