Re: rsync vs. unison
Get Unison. Rsync needs to be run twice and isn't that great at mirror syncing. -- Stuart Halliday -Original Message- From: Noam Birnbaum <[EMAIL PROTECTED]> To: rsync@lists.samba.org Date: Sun, 30 Sep 2007 20:56:06 -0700 Subject: rsync vs. unison > Hey all, > > I'm looking into a two-way WAN mirror on two boxes running Mac OS X > 10.4. It seems that both rsync (with the -u option) and unison could > do this. Any suggestions on how to choose one over the other? > > Many thanks, > noam > > Noam Birnbaum > http://maccentricsolutions.com/ > 877.luv.macs x89 > > ð Apple Certified Technical Coordinator > ð Apple Certified Help Desk Specialist > > > This email is the property of ECS Technology Ltd. This company is registered in Scotland with company number 212513. VAT registered GB 761 7456 12 http://www.ecs-tech.com/ -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: why not a gui for rsync
At 00:04 01.10.2007 -0500, Robert wrote: > >> >> > Is there some works in the world trying to make a good gui for >> > rsync and to let all people using this very good method to make >> > a backup. >> > >> > If somebody is interesting to create this gui, let me know >> >> --Suresh > >Delta Copy: http://www.aboutmyip.com/AboutMyXApp/DeltaCopy.jsp > >It has a gui already. No need to reinvent the wheel. Delta Copy unfortunately only works in client/server mode. As I also need local mode this is no option (though it looks nice). So me too I still haven't found a simple, user-friendly GUI. bye Fabi -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
RE: why not a gui for rsync
There are times I use deltacopy locally. I have a couple clients backing up to removable hard disks with it. Just start the server service on the local machine. For the server's ip, type in 127.0.0.1 or localhost and you can backup locally with deltacopy. Deltacopy is the best gui for windows IMO. Plus, it supports e-mail notification which I utilize heavily. _ Stephen Zemlicka Integrated Computer Technologies PH. 608-558-5926 E-Mail [EMAIL PROTECTED] -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Fabian Cenedese Sent: Monday, October 01, 2007 4:17 AM To: rsync@lists.samba.org Subject: Re: why not a gui for rsync At 00:04 01.10.2007 -0500, Robert wrote: > >> >> > Is there some works in the world trying to make a good gui for >> > rsync and to let all people using this very good method to make >> > a backup. >> > >> > If somebody is interesting to create this gui, let me know >> >> --Suresh > >Delta Copy: http://www.aboutmyip.com/AboutMyXApp/DeltaCopy.jsp > >It has a gui already. No need to reinvent the wheel. Delta Copy unfortunately only works in client/server mode. As I also need local mode this is no option (though it looks nice). So me too I still haven't found a simple, user-friendly GUI. bye Fabi -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
cygwin rsync windows to windows ACL problem
I am having problems using rsync on cygwin to properly copy the ownership of files from windows to windows. I am running: rsync -avPA //src_addr/some/path /local/dst/path/ Based on: http://www.mail-archive.com/rsync@lists.samba.org/msg18920.html and: http://www.nabble.com/Re:-I-need-rsync-+-acl-support-for-windows--t2462647.html ENV: CYGWIN=ntsec tty I am running this on Windows Server 2003 R2 SP2 (a DC), the SRC is a Windows XP SP2 domain member. I have tried patching the cygwin rsync source to enable ACL support, and had this confirmed by rsync --version This didn't work so I got rsync-acl-2.6.9.tar.bz2 from: http://mattmccutchen.net/myrsync/ and configured with --enable-acl-support This still does not work. Is what I am trying to do not possible, or am I just doing something wrong? Thanks for any input. -- - havoc -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
RE: cygwin rsync windows to windows ACL problem
I have also noticed that permissions aren't always copied under windows. I've heard you can use robocopy to do it. I have not because it hasn't been critical to my operation but supposedly, you can use something like ROBOCOPY source destination /XO /XN /XC /E /COPY:ATSOU After the backup script. This should not copy any files and just copy the file permissions and attributes. Let me know if that helps. BTW, robocopy is part of the windows 2003 resource kit. _ Stephen Zemlicka Integrated Computer Technologies PH. 608-558-5926 E-Mail [EMAIL PROTECTED] -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of havoc Sent: Monday, October 01, 2007 9:59 AM To: rsync@lists.samba.org Subject: cygwin rsync windows to windows ACL problem I am having problems using rsync on cygwin to properly copy the ownership of files from windows to windows. I am running: rsync -avPA //src_addr/some/path /local/dst/path/ Based on: http://www.mail-archive.com/rsync@lists.samba.org/msg18920.html and: http://www.nabble.com/Re:-I-need-rsync-+-acl-support-for-windows--t2462647.h tml ENV: CYGWIN=ntsec tty I am running this on Windows Server 2003 R2 SP2 (a DC), the SRC is a Windows XP SP2 domain member. I have tried patching the cygwin rsync source to enable ACL support, and had this confirmed by rsync --version This didn't work so I got rsync-acl-2.6.9.tar.bz2 from: http://mattmccutchen.net/myrsync/ and configured with --enable-acl-support This still does not work. Is what I am trying to do not possible, or am I just doing something wrong? Thanks for any input. -- - havoc -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: cygwin rsync windows to windows ACL problem
Does robocopy handle partial transfers, and backups of changed deleted files? My reason for wanting rsync is to maintain a mirror, and accomplish incremental backups via --backup --backup-dir= with rsync. On Monday 01 October 2007, Stephen Zemlicka wrote: > I have also noticed that permissions aren't always copied under windows. > I've heard you can use robocopy to do it. I have not because it hasn't > been critical to my operation but supposedly, you can use something like > > ROBOCOPY source destination /XO /XN /XC /E /COPY:ATSOU > > After the backup script. This should not copy any files and just copy the > file permissions and attributes. Let me know if that helps. > > BTW, robocopy is part of the windows 2003 resource kit. > > _ > Stephen Zemlicka > Integrated Computer Technologies > PH. 608-558-5926 > E-Mail [EMAIL PROTECTED] > -Original Message- > From: [EMAIL PROTECTED] > [mailto:[EMAIL PROTECTED] On Behalf Of > havoc > Sent: Monday, October 01, 2007 9:59 AM > To: rsync@lists.samba.org > Subject: cygwin rsync windows to windows ACL problem > > I am having problems using rsync on cygwin to properly copy the > ownership of files from windows to windows. > I am running: rsync -avPA //src_addr/some/path /local/dst/path/ > > Based on: > http://www.mail-archive.com/rsync@lists.samba.org/msg18920.html > and: > http://www.nabble.com/Re:-I-need-rsync-+-acl-support-for-windows--t2462647. >h tml > > ENV: CYGWIN=ntsec tty > I am running this on Windows Server 2003 R2 SP2 (a DC), the SRC is > a Windows XP SP2 domain member. > I have tried patching the cygwin rsync source to enable ACL support, > and had this confirmed by rsync --version > This didn't work so I got rsync-acl-2.6.9.tar.bz2 from: > http://mattmccutchen.net/myrsync/ > and configured with --enable-acl-support > This still does not work. Is what I am trying to do not possible, > or am I just doing something wrong? > > Thanks for any input. > > -- > >- havoc -- - havoc -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
RE: cygwin rsync windows to windows ACL problem
Robocopy does copy only the new or changed files. However it does copy the whole files (similar to the -W switch in rsync). I use robocopy whenever I already have a secure connection (VPN) or when my backups don't include large (multi GB) database files. To see if robocopy will work by itself for you, add the -W switch and see if that's acceptable. It'll take a bit longer for changed files but will be just as fast for new files. _ Stephen Zemlicka Integrated Computer Technologies PH. 608-558-5926 E-Mail [EMAIL PROTECTED] -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of havoc Sent: Monday, October 01, 2007 10:50 AM To: rsync@lists.samba.org Subject: Re: cygwin rsync windows to windows ACL problem Does robocopy handle partial transfers, and backups of changed deleted files? My reason for wanting rsync is to maintain a mirror, and accomplish incremental backups via --backup --backup-dir= with rsync. On Monday 01 October 2007, Stephen Zemlicka wrote: > I have also noticed that permissions aren't always copied under windows. > I've heard you can use robocopy to do it. I have not because it hasn't > been critical to my operation but supposedly, you can use something like > > ROBOCOPY source destination /XO /XN /XC /E /COPY:ATSOU > > After the backup script. This should not copy any files and just copy the > file permissions and attributes. Let me know if that helps. > > BTW, robocopy is part of the windows 2003 resource kit. > > _ > Stephen Zemlicka > Integrated Computer Technologies > PH. 608-558-5926 > E-Mail [EMAIL PROTECTED] > -Original Message- > From: [EMAIL PROTECTED] > [mailto:[EMAIL PROTECTED] On Behalf Of > havoc > Sent: Monday, October 01, 2007 9:59 AM > To: rsync@lists.samba.org > Subject: cygwin rsync windows to windows ACL problem > > I am having problems using rsync on cygwin to properly copy the > ownership of files from windows to windows. > I am running: rsync -avPA //src_addr/some/path /local/dst/path/ > > Based on: > http://www.mail-archive.com/rsync@lists.samba.org/msg18920.html > and: > http://www.nabble.com/Re:-I-need-rsync-+-acl-support-for-windows--t2462647. >h tml > > ENV: CYGWIN=ntsec tty > I am running this on Windows Server 2003 R2 SP2 (a DC), the SRC is > a Windows XP SP2 domain member. > I have tried patching the cygwin rsync source to enable ACL support, > and had this confirmed by rsync --version > This didn't work so I got rsync-acl-2.6.9.tar.bz2 from: > http://mattmccutchen.net/myrsync/ > and configured with --enable-acl-support > This still does not work. Is what I am trying to do not possible, > or am I just doing something wrong? > > Thanks for any input. > > -- > >- havoc -- - havoc -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: cygwin rsync windows to windows ACL problem
Unfortunately I don't think it will work. We have two offices in the same corporate park connected by an unreliable radio backhaul, and several terabytes of data to sync daily, hence my desire to get rsync working :( PS: I will definitely check out robocopy for other uses, thank you :) On Monday 01 October 2007, Stephen Zemlicka wrote: > Robocopy does copy only the new or changed files. However it does copy the > whole files (similar to the -W switch in rsync). I use robocopy whenever I > already have a secure connection (VPN) or when my backups don't include > large (multi GB) database files. To see if robocopy will work by itself > for you, add the -W switch and see if that's acceptable. It'll take a bit > longer for changed files but will be just as fast for new files. > > _ > Stephen Zemlicka > Integrated Computer Technologies > PH. 608-558-5926 > E-Mail [EMAIL PROTECTED] > -Original Message- > From: [EMAIL PROTECTED] > [mailto:[EMAIL PROTECTED] On Behalf Of > havoc > Sent: Monday, October 01, 2007 10:50 AM > To: rsync@lists.samba.org > Subject: Re: cygwin rsync windows to windows ACL problem > > Does robocopy handle partial transfers, and backups of changed deleted > files? > My reason for wanting rsync is to maintain a mirror, and accomplish > incremental backups via --backup --backup-dir= with rsync. > > On Monday 01 October 2007, Stephen Zemlicka wrote: > > I have also noticed that permissions aren't always copied under windows. > > I've heard you can use robocopy to do it. I have not because it hasn't > > been critical to my operation but supposedly, you can use something like > > > > ROBOCOPY source destination /XO /XN /XC /E /COPY:ATSOU > > > > After the backup script. This should not copy any files and just copy > > the file permissions and attributes. Let me know if that helps. > > > > BTW, robocopy is part of the windows 2003 resource kit. > > > > _ > > Stephen Zemlicka > > Integrated Computer Technologies > > PH. 608-558-5926 > > E-Mail [EMAIL PROTECTED] > > -Original Message- > > From: [EMAIL PROTECTED] > > [mailto:[EMAIL PROTECTED] On Behalf > > Of > > > havoc > > Sent: Monday, October 01, 2007 9:59 AM > > To: rsync@lists.samba.org > > Subject: cygwin rsync windows to windows ACL problem > > > > I am having problems using rsync on cygwin to properly copy the > > ownership of files from windows to windows. > > I am running: rsync -avPA //src_addr/some/path /local/dst/path/ > > > > Based on: > > http://www.mail-archive.com/rsync@lists.samba.org/msg18920.html > > and: > > http://www.nabble.com/Re:-I-need-rsync-+-acl-support-for-windows--t2462647. > > >h tml > > > > ENV: CYGWIN=ntsec tty > > I am running this on Windows Server 2003 R2 SP2 (a DC), the SRC is > > a Windows XP SP2 domain member. > > I have tried patching the cygwin rsync source to enable ACL support, > > and had this confirmed by rsync --version > > This didn't work so I got rsync-acl-2.6.9.tar.bz2 from: > > http://mattmccutchen.net/myrsync/ > > and configured with --enable-acl-support > > This still does not work. Is what I am trying to do not possible, > > or am I just doing something wrong? > > > > Thanks for any input. > > > > -- > > > >- havoc > > -- > >- havoc -- - havoc -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: cygwin rsync windows to windows ACL problem
On 10/1/07, havoc <[EMAIL PROTECTED]> wrote: > I am having problems using rsync on cygwin to properly copy the > ownership of files from windows to windows. > I am running: rsync -avPA //src_addr/some/path /local/dst/path/ > > Based on: > http://www.mail-archive.com/rsync@lists.samba.org/msg18920.html > and: > http://www.nabble.com/Re:-I-need-rsync-+-acl-support-for-windows--t2462647.html > > ENV: CYGWIN=ntsec tty > I am running this on Windows Server 2003 R2 SP2 (a DC), the SRC is > a Windows XP SP2 domain member. > I have tried patching the cygwin rsync source to enable ACL support, > and had this confirmed by rsync --version > This didn't work so I got rsync-acl-2.6.9.tar.bz2 from: > http://mattmccutchen.net/myrsync/ > and configured with --enable-acl-support > This still does not work. What incorrect ownership did rsync set on the destination? That might give me a clue what the problem is. Is the receiving rsync running as an administrator so that it has the power to set ownership arbitrarily? (Once it is, you may have to pass --super to make sure it realizes that.) Do you have entries in your Cygwin /etc/passwd and /etc/group (see http://www.cygwin.com/cygwin-ug-net/ntsec.html ) on both sides for all the owners involved? Matt -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
RE: cygwin rsync windows to windows ACL problem
I have synced terabytes of data across DSL connections using robocopy with no problem. Robocopy is just as fast as rsync on whole files and I find it to be even faster on folders with large numbers of small files (though I hear the next release of rsync is supposed to speed that up). However, if you must use rsync, you can still use the robocopy that I specified earlier. Rsync would be responsible for all the file copying and robocopy would be responsible for only the attributes and permissions. Since rsync is a *nix utility, I doubt much effort will be put into compatibility with windows permissions. _ Stephen Zemlicka Integrated Computer Technologies PH. 608-558-5926 E-Mail [EMAIL PROTECTED] -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of havoc Sent: Monday, October 01, 2007 11:00 AM To: rsync@lists.samba.org Subject: Re: cygwin rsync windows to windows ACL problem Unfortunately I don't think it will work. We have two offices in the same corporate park connected by an unreliable radio backhaul, and several terabytes of data to sync daily, hence my desire to get rsync working :( PS: I will definitely check out robocopy for other uses, thank you :) On Monday 01 October 2007, Stephen Zemlicka wrote: > Robocopy does copy only the new or changed files. However it does copy the > whole files (similar to the -W switch in rsync). I use robocopy whenever I > already have a secure connection (VPN) or when my backups don't include > large (multi GB) database files. To see if robocopy will work by itself > for you, add the -W switch and see if that's acceptable. It'll take a bit > longer for changed files but will be just as fast for new files. > > _ > Stephen Zemlicka > Integrated Computer Technologies > PH. 608-558-5926 > E-Mail [EMAIL PROTECTED] > -Original Message- > From: [EMAIL PROTECTED] > [mailto:[EMAIL PROTECTED] On Behalf Of > havoc > Sent: Monday, October 01, 2007 10:50 AM > To: rsync@lists.samba.org > Subject: Re: cygwin rsync windows to windows ACL problem > > Does robocopy handle partial transfers, and backups of changed deleted > files? > My reason for wanting rsync is to maintain a mirror, and accomplish > incremental backups via --backup --backup-dir= with rsync. > > On Monday 01 October 2007, Stephen Zemlicka wrote: > > I have also noticed that permissions aren't always copied under windows. > > I've heard you can use robocopy to do it. I have not because it hasn't > > been critical to my operation but supposedly, you can use something like > > > > ROBOCOPY source destination /XO /XN /XC /E /COPY:ATSOU > > > > After the backup script. This should not copy any files and just copy > > the file permissions and attributes. Let me know if that helps. > > > > BTW, robocopy is part of the windows 2003 resource kit. > > > > _ > > Stephen Zemlicka > > Integrated Computer Technologies > > PH. 608-558-5926 > > E-Mail [EMAIL PROTECTED] > > -Original Message- > > From: [EMAIL PROTECTED] > > [mailto:[EMAIL PROTECTED] On Behalf > > Of > > > havoc > > Sent: Monday, October 01, 2007 9:59 AM > > To: rsync@lists.samba.org > > Subject: cygwin rsync windows to windows ACL problem > > > > I am having problems using rsync on cygwin to properly copy the > > ownership of files from windows to windows. > > I am running: rsync -avPA //src_addr/some/path /local/dst/path/ > > > > Based on: > > http://www.mail-archive.com/rsync@lists.samba.org/msg18920.html > > and: > > http://www.nabble.com/Re:-I-need-rsync-+-acl-support-for-windows--t2462647. > > >h tml > > > > ENV: CYGWIN=ntsec tty > > I am running this on Windows Server 2003 R2 SP2 (a DC), the SRC is > > a Windows XP SP2 domain member. > > I have tried patching the cygwin rsync source to enable ACL support, > > and had this confirmed by rsync --version > > This didn't work so I got rsync-acl-2.6.9.tar.bz2 from: > > http://mattmccutchen.net/myrsync/ > > and configured with --enable-acl-support > > This still does not work. Is what I am trying to do not possible, > > or am I just doing something wrong? > > > > Thanks for any input. > > > > -- > > > >- havoc > > -- > >- havoc -- - havoc -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: cygwin rsync windows to windows ACL problem
On Monday 01 October 2007, Matt McCutchen wrote: > On 10/1/07, havoc <[EMAIL PROTECTED]> wrote: > > I am having problems using rsync on cygwin to properly copy the > > ownership of files from windows to windows. > > I am running: rsync -avPA //src_addr/some/path /local/dst/path/ > > > > Based on: > > http://www.mail-archive.com/rsync@lists.samba.org/msg18920.html > > and: > > http://www.nabble.com/Re:-I-need-rsync-+-acl-support-for-windows--t246264 > >7.html > > > > ENV: CYGWIN=ntsec tty > > I am running this on Windows Server 2003 R2 SP2 (a DC), the SRC is > > a Windows XP SP2 domain member. > > I have tried patching the cygwin rsync source to enable ACL support, > > and had this confirmed by rsync --version > > This didn't work so I got rsync-acl-2.6.9.tar.bz2 from: > > http://mattmccutchen.net/myrsync/ > > and configured with --enable-acl-support > > This still does not work. > > What incorrect ownership did rsync set on the destination? That might > give me a clue what the problem is. > > Is the receiving rsync running as an administrator so that it has the > power to set ownership arbitrarily? (Once it is, you may have to pass > --super to make sure it realizes that.) Do you have entries in your > Cygwin /etc/passwd and /etc/group (see > http://www.cygwin.com/cygwin-ug-net/ntsec.html ) on both sides for all > the owners involved? > > Matt The SRC is via a default network share: //netbios.name/C$ The DST is a local directory. So there is only onw instance of rsync running (no "sending" end). The Owners/Groups on the SRC side are: Group: COMPUTER\Administrators User: DOMAIN\SpecificUser Group: SYSTEM The Owners/Groups on the DST side end up as: User: DOMAIN\Administrator Group: DOMAIN\Domain Users Group: Everyone Prior to using an ACL enabled rsync (and rsync without -A) they were: User: DOMAIN\Administrator Group: CREATOR GROUP Group: CREATOR OWNER Group: DOMAIN\Domain Users Group: Everyone I have read http://www.cygwin.com/cygwin-ug-net/ntsec.html (many times) and /etc/passwd and /etc/group look OK, they seem to have all the SIDs in them, including one for SpecificUser. I also just tried "rsync -avPA --super ..." with no luck. Could the problem be related to rsync only running on a single machine with no "remote" side? -- - havoc -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
RE: why not a gui for rsync
Regarding the recommendation: > Delta Copy: http://www.aboutmyip.com/AboutMyXApp/DeltaCopy.jsp > It has a gui already. No need to reinvent the wheel. I went over the FAQ and the documentation for Delta Copy. Delta Copy does not provide any means to continually monitor an on-going rsync process. The most they do is: | Question: What type of logging is available in DeltaCopy | | Answer: Besides the logging options available in Rsync, | DeltaCopy provides two additional logs: | | deltac.log - available on DeltaCopy client | DeltaService.log - available on DeltaCopy server | | deltac.log file contains information about the DeltaCopy | client. It logs a message when a profile is run and | notifications emails are sent to the user. | | DeltaService.log is available where DeltaCopy server is | installed and contains messages when service is started or | stopped. | | It is important to know that rsync supports additional logging | that can be configured by specifying additional parameters | either on DeltaCopy client or server. Please refer to rsync | documentation for more information about logging options | available for rsync. | | When rsync.exe is executed in the back-ground by DeltaCopy, it | generates status messages which are sent to standard output. | DeltaCopy captures these messages and sends them via email. Observe that Delta Copy relies on rsync itself to provide insight into the status of the on-going transaction. So the question remains: In regard to output, rsync has the following features: a) -v option with various levels of verbosity b) --stats c) --log-file=foo d) messages rsync prints to stdout e) messages rsync prints to stderr. Where can one find an explanation of the format, content and interpretation of the outputs (a-e)? Thanks, --Suresh -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: cygwin rsync windows to windows ACL problem
Intriguing, you're saying to use rsync to copy/sync the data, the use robocopy to only recursively set permissions? Robocopy can do this without transferring data? I haven't finished reading all about it yet, but have started with: http://en.wikipedia.org/wiki/Robocopy On Monday 01 October 2007, Stephen Zemlicka wrote: > I have synced terabytes of data across DSL connections using robocopy with > no problem. Robocopy is just as fast as rsync on whole files and I find it > to be even faster on folders with large numbers of small files (though I > hear the next release of rsync is supposed to speed that up). > > However, if you must use rsync, you can still use the robocopy that I > specified earlier. Rsync would be responsible for all the file copying and > robocopy would be responsible for only the attributes and permissions. > Since rsync is a *nix utility, I doubt much effort will be put into > compatibility with windows permissions. > > _ > Stephen Zemlicka > Integrated Computer Technologies > PH. 608-558-5926 > E-Mail [EMAIL PROTECTED] > > -Original Message- > From: [EMAIL PROTECTED] > [mailto:[EMAIL PROTECTED] On Behalf Of > havoc > Sent: Monday, October 01, 2007 11:00 AM > To: rsync@lists.samba.org > Subject: Re: cygwin rsync windows to windows ACL problem > > Unfortunately I don't think it will work. > We have two offices in the same corporate park connected by an unreliable > radio backhaul, and several terabytes of data to sync daily, hence my > desire > > to get rsync working :( > > PS: I will definitely check out robocopy for other uses, thank you :) > > On Monday 01 October 2007, Stephen Zemlicka wrote: > > Robocopy does copy only the new or changed files. However it does copy > > the > > > whole files (similar to the -W switch in rsync). I use robocopy whenever > > I > > > already have a secure connection (VPN) or when my backups don't include > > large (multi GB) database files. To see if robocopy will work by itself > > for you, add the -W switch and see if that's acceptable. It'll take a > > bit longer for changed files but will be just as fast for new files. > > > > _ > > Stephen Zemlicka > > Integrated Computer Technologies > > PH. 608-558-5926 > > E-Mail [EMAIL PROTECTED] > > -Original Message- > > From: [EMAIL PROTECTED] > > [mailto:[EMAIL PROTECTED] On Behalf > > Of > > > havoc > > Sent: Monday, October 01, 2007 10:50 AM > > To: rsync@lists.samba.org > > Subject: Re: cygwin rsync windows to windows ACL problem > > > > Does robocopy handle partial transfers, and backups of changed deleted > > files? > > My reason for wanting rsync is to maintain a mirror, and accomplish > > incremental backups via --backup --backup-dir= with rsync. > > > > On Monday 01 October 2007, Stephen Zemlicka wrote: > > > I have also noticed that permissions aren't always copied under > > > windows. I've heard you can use robocopy to do it. I have not because > > > it hasn't been critical to my operation but supposedly, you can use > > > something like > > > > > > ROBOCOPY source destination /XO /XN /XC /E /COPY:ATSOU > > > > > > After the backup script. This should not copy any files and just copy > > > the file permissions and attributes. Let me know if that helps. > > > > > > BTW, robocopy is part of the windows 2003 resource kit. > > > > > > _ > > > Stephen Zemlicka > > > Integrated Computer Technologies > > > PH. 608-558-5926 > > > E-Mail [EMAIL PROTECTED] > > > -Original Message- > > > From: [EMAIL PROTECTED] > > > [mailto:[EMAIL PROTECTED] On > > > Behalf > > > > Of > > > > > havoc > > > Sent: Monday, October 01, 2007 9:59 AM > > > To: rsync@lists.samba.org > > > Subject: cygwin rsync windows to windows ACL problem > > > > > > I am having problems using rsync on cygwin to properly copy the > > > ownership of files from windows to windows. > > > I am running: rsync -avPA //src_addr/some/path /local/dst/path/ > > > > > > Based on: > > > http://www.mail-archive.com/rsync@lists.samba.org/msg18920.html > > > and: > > http://www.nabble.com/Re:-I-need-rsync-+-acl-support-for-windows--t2462647. > > > >h tml > > > > > > ENV: CYGWIN=ntsec tty > > > I am running this on Windows Server 2003 R2 SP2 (a DC), the SRC is > > > a Windows XP SP2 domain member. > > > I have tried patching the cygwin rsync source to enable ACL support, > > > and had this confirmed by rsync --version > > > This didn't work so I got rsync-acl-2.6.9.tar.bz2 from: > > > http://mattmccutchen.net/myrsync/ > > > and configured with --enable-acl-support > > > This still does not work. Is what I am trying to do not possible, > > > or am I just doing something wrong? > > > > > > Thanks for any input. > > > > > > -- > > > > > >- havoc > > > > -- > > > >- havoc > > -- > >- havoc -- - havoc -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.or
RE: cygwin rsync windows to windows ACL problem
Yup, that's what I originally intended but I probably wasn't very clear. So basically you would add ROBOCOPY source destination /XO /XN /XC /E /COPY:ATSOU to run after the rsync finishes. How are you running rsync with no remote daemon running? Mapped drive? Why not run the remote daemon, I believe rsync can even initiate the remote daemon from the client side if you want. (hopefully my terminology is correct there) _ Stephen Zemlicka Integrated Computer Technologies PH. 608-558-5926 E-Mail [EMAIL PROTECTED] -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of havoc Sent: Monday, October 01, 2007 11:28 AM To: rsync@lists.samba.org Subject: Re: cygwin rsync windows to windows ACL problem Intriguing, you're saying to use rsync to copy/sync the data, the use robocopy to only recursively set permissions? Robocopy can do this without transferring data? I haven't finished reading all about it yet, but have started with: http://en.wikipedia.org/wiki/Robocopy On Monday 01 October 2007, Stephen Zemlicka wrote: > I have synced terabytes of data across DSL connections using robocopy with > no problem. Robocopy is just as fast as rsync on whole files and I find it > to be even faster on folders with large numbers of small files (though I > hear the next release of rsync is supposed to speed that up). > > However, if you must use rsync, you can still use the robocopy that I > specified earlier. Rsync would be responsible for all the file copying and > robocopy would be responsible for only the attributes and permissions. > Since rsync is a *nix utility, I doubt much effort will be put into > compatibility with windows permissions. > > _ > Stephen Zemlicka > Integrated Computer Technologies > PH. 608-558-5926 > E-Mail [EMAIL PROTECTED] > > -Original Message- > From: [EMAIL PROTECTED] > [mailto:[EMAIL PROTECTED] On Behalf Of > havoc > Sent: Monday, October 01, 2007 11:00 AM > To: rsync@lists.samba.org > Subject: Re: cygwin rsync windows to windows ACL problem > > Unfortunately I don't think it will work. > We have two offices in the same corporate park connected by an unreliable > radio backhaul, and several terabytes of data to sync daily, hence my > desire > > to get rsync working :( > > PS: I will definitely check out robocopy for other uses, thank you :) > > On Monday 01 October 2007, Stephen Zemlicka wrote: > > Robocopy does copy only the new or changed files. However it does copy > > the > > > whole files (similar to the -W switch in rsync). I use robocopy whenever > > I > > > already have a secure connection (VPN) or when my backups don't include > > large (multi GB) database files. To see if robocopy will work by itself > > for you, add the -W switch and see if that's acceptable. It'll take a > > bit longer for changed files but will be just as fast for new files. > > > > _ > > Stephen Zemlicka > > Integrated Computer Technologies > > PH. 608-558-5926 > > E-Mail [EMAIL PROTECTED] > > -Original Message- > > From: [EMAIL PROTECTED] > > [mailto:[EMAIL PROTECTED] On Behalf > > Of > > > havoc > > Sent: Monday, October 01, 2007 10:50 AM > > To: rsync@lists.samba.org > > Subject: Re: cygwin rsync windows to windows ACL problem > > > > Does robocopy handle partial transfers, and backups of changed deleted > > files? > > My reason for wanting rsync is to maintain a mirror, and accomplish > > incremental backups via --backup --backup-dir= with rsync. > > > > On Monday 01 October 2007, Stephen Zemlicka wrote: > > > I have also noticed that permissions aren't always copied under > > > windows. I've heard you can use robocopy to do it. I have not because > > > it hasn't been critical to my operation but supposedly, you can use > > > something like > > > > > > ROBOCOPY source destination /XO /XN /XC /E /COPY:ATSOU > > > > > > After the backup script. This should not copy any files and just copy > > > the file permissions and attributes. Let me know if that helps. > > > > > > BTW, robocopy is part of the windows 2003 resource kit. > > > > > > _ > > > Stephen Zemlicka > > > Integrated Computer Technologies > > > PH. 608-558-5926 > > > E-Mail [EMAIL PROTECTED] > > > -Original Message- > > > From: [EMAIL PROTECTED] > > > [mailto:[EMAIL PROTECTED] On > > > Behalf > > > > Of > > > > > havoc > > > Sent: Monday, October 01, 2007 9:59 AM > > > To: rsync@lists.samba.org > > > Subject: cygwin rsync windows to windows ACL problem > > > > > > I am having problems using rsync on cygwin to properly copy the > > > ownership of files from windows to windows. > > > I am running: rsync -avPA //src_addr/some/path /local/dst/path/ > > > > > > Based on: > > > http://www.mail-archive.com/rsync@lists.samba.org/msg18920.html > > > and: > > http://www.nabble.com/Re:-I-need-rsync-+-acl-support-for-windows--t2462647. > > > >h tml > > > > > > ENV: CYGWIN=ntsec
RE: why not a gui for rsync
What exactly are you looking for in monitoring it? The -v should give you a verbose output. If you want more details, I think you can specify multiple -v to give you a more verbose output. _ Stephen Zemlicka Integrated Computer Technologies PH. 608-558-5926 E-Mail [EMAIL PROTECTED] -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Suresh Govindachar Sent: Monday, October 01, 2007 11:26 AM To: rsync@lists.samba.org Subject: RE: why not a gui for rsync Regarding the recommendation: > Delta Copy: http://www.aboutmyip.com/AboutMyXApp/DeltaCopy.jsp > It has a gui already. No need to reinvent the wheel. I went over the FAQ and the documentation for Delta Copy. Delta Copy does not provide any means to continually monitor an on-going rsync process. The most they do is: | Question: What type of logging is available in DeltaCopy | | Answer: Besides the logging options available in Rsync, | DeltaCopy provides two additional logs: | | deltac.log - available on DeltaCopy client | DeltaService.log - available on DeltaCopy server | | deltac.log file contains information about the DeltaCopy | client. It logs a message when a profile is run and | notifications emails are sent to the user. | | DeltaService.log is available where DeltaCopy server is | installed and contains messages when service is started or | stopped. | | It is important to know that rsync supports additional logging | that can be configured by specifying additional parameters | either on DeltaCopy client or server. Please refer to rsync | documentation for more information about logging options | available for rsync. | | When rsync.exe is executed in the back-ground by DeltaCopy, it | generates status messages which are sent to standard output. | DeltaCopy captures these messages and sends them via email. Observe that Delta Copy relies on rsync itself to provide insight into the status of the on-going transaction. So the question remains: In regard to output, rsync has the following features: a) -v option with various levels of verbosity b) --stats c) --log-file=foo d) messages rsync prints to stdout e) messages rsync prints to stderr. Where can one find an explanation of the format, content and interpretation of the outputs (a-e)? Thanks, --Suresh -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: cygwin rsync windows to windows ACL problem
Yes, mapped drive, "kindof", it's a netbios default share, but essentially the same thing. I am trying to avoid any situation that requires special handling on the remote (client workstation) side, like additional software to install and maintain. On Monday 01 October 2007, Stephen Zemlicka wrote: > Yup, that's what I originally intended but I probably wasn't very clear. > So basically you would add > > ROBOCOPY source destination /XO /XN /XC /E /COPY:ATSOU > > to run after the rsync finishes. > > How are you running rsync with no remote daemon running? Mapped drive? > Why not run the remote daemon, I believe rsync can even initiate the remote > daemon from the client side if you want. (hopefully my terminology is > correct there) > > _ > Stephen Zemlicka > Integrated Computer Technologies > PH. 608-558-5926 > E-Mail [EMAIL PROTECTED] > > -Original Message- > From: [EMAIL PROTECTED] > [mailto:[EMAIL PROTECTED] On Behalf Of > havoc > Sent: Monday, October 01, 2007 11:28 AM > To: rsync@lists.samba.org > Subject: Re: cygwin rsync windows to windows ACL problem > > Intriguing, you're saying to use rsync to copy/sync the data, the use > robocopy > to only recursively set permissions? Robocopy can do this without > transferring data? > I haven't finished reading all about it yet, but have started with: > http://en.wikipedia.org/wiki/Robocopy > > On Monday 01 October 2007, Stephen Zemlicka wrote: > > I have synced terabytes of data across DSL connections using robocopy > > with no problem. Robocopy is just as fast as rsync on whole files and I > > find > > it > > > to be even faster on folders with large numbers of small files (though I > > hear the next release of rsync is supposed to speed that up). > > > > However, if you must use rsync, you can still use the robocopy that I > > specified earlier. Rsync would be responsible for all the file copying > > and > > > robocopy would be responsible for only the attributes and permissions. > > Since rsync is a *nix utility, I doubt much effort will be put into > > compatibility with windows permissions. > > > > _ > > Stephen Zemlicka > > Integrated Computer Technologies > > PH. 608-558-5926 > > E-Mail [EMAIL PROTECTED] > > > > -Original Message- > > From: [EMAIL PROTECTED] > > [mailto:[EMAIL PROTECTED] On Behalf > > Of > > > havoc > > Sent: Monday, October 01, 2007 11:00 AM > > To: rsync@lists.samba.org > > Subject: Re: cygwin rsync windows to windows ACL problem > > > > Unfortunately I don't think it will work. > > We have two offices in the same corporate park connected by an unreliable > > radio backhaul, and several terabytes of data to sync daily, hence my > > desire > > > > to get rsync working :( > > > > PS: I will definitely check out robocopy for other uses, thank you :) > > > > On Monday 01 October 2007, Stephen Zemlicka wrote: > > > Robocopy does copy only the new or changed files. However it does copy > > > > the > > > > > whole files (similar to the -W switch in rsync). I use robocopy > > whenever > > > I > > > > > already have a secure connection (VPN) or when my backups don't include > > > large (multi GB) database files. To see if robocopy will work by > > > itself for you, add the -W switch and see if that's acceptable. It'll > > > take a bit longer for changed files but will be just as fast for new > > > files. > > > > > > _ > > > Stephen Zemlicka > > > Integrated Computer Technologies > > > PH. 608-558-5926 > > > E-Mail [EMAIL PROTECTED] > > > -Original Message- > > > From: [EMAIL PROTECTED] > > > [mailto:[EMAIL PROTECTED] On > > > Behalf > > > > Of > > > > > havoc > > > Sent: Monday, October 01, 2007 10:50 AM > > > To: rsync@lists.samba.org > > > Subject: Re: cygwin rsync windows to windows ACL problem > > > > > > Does robocopy handle partial transfers, and backups of changed deleted > > > files? > > > My reason for wanting rsync is to maintain a mirror, and accomplish > > > incremental backups via --backup --backup-dir= with rsync. > > > > > > On Monday 01 October 2007, Stephen Zemlicka wrote: > > > > I have also noticed that permissions aren't always copied under > > > > windows. I've heard you can use robocopy to do it. I have not > > > > because it hasn't been critical to my operation but supposedly, you > > > > can use something like > > > > > > > > ROBOCOPY source destination /XO /XN /XC /E /COPY:ATSOU > > > > > > > > After the backup script. This should not copy any files and just > > > > copy the file permissions and attributes. Let me know if that helps. > > > > > > > > BTW, robocopy is part of the windows 2003 resource kit. > > > > > > > > _ > > > > Stephen Zemlicka > > > > Integrated Computer Technologies > > > > PH. 608-558-5926 > > > > E-Mail [EMAIL PROTECTED] > > > > -Original Message- > > > > From: [EMAIL PROTECTED] > > > > [mailto:[EMAIL PROTECTED] On > > > > Behalf > > > >
RE: cygwin rsync windows to windows ACL problem
I don't think so. Let's get terminology out of the way first. The computer sending data is the client and the computer storing the backups is the server. Rsync needs to read the whole file stored on the server to know what data the client needs to send. Since you are only running rsync on the client, the entire file needs to be transmitted from the server to the client, then read and analyzed. Then, a partial transfer may occur. So you can do a partial transfer but before that is possible, the client needs a full transfer from the server to see what it needs to send. _ Stephen Zemlicka Integrated Computer Technologies PH. 608-558-5926 E-Mail [EMAIL PROTECTED] -Original Message- From: havoc [mailto:[EMAIL PROTECTED] Sent: Monday, October 01, 2007 11:54 AM To: Stephen Zemlicka Subject: Re: cygwin rsync windows to windows ACL problem So even with a mapped drive --partial will have no effect? Is this cygwin/Windows specific behavior (as it does work on linux)? On Monday 01 October 2007, Stephen Zemlicka wrote: > Remember, if you don't have the rsync daemon running on the remote > computer, rsync will transfer whole files anyway. I'm working at getting > around this issue with mapped drives but haven't had a lot of time recently > to get it ironed out and fully tested. If you are not running rsync on the > system you are backing up to, rsync will run exactly like robocopy (ie. > with the -W option). > > _ > Stephen Zemlicka > Integrated Computer Technologies > PH. 608-558-5926 > E-Mail [EMAIL PROTECTED] > > -Original Message- > From: [EMAIL PROTECTED] > [mailto:[EMAIL PROTECTED] On Behalf Of > havoc > Sent: Monday, October 01, 2007 11:46 AM > To: rsync@lists.samba.org > Subject: Re: cygwin rsync windows to windows ACL problem > > Yes, mapped drive, "kindof", it's a netbios default share, but essentially > the > same thing. > I am trying to avoid any situation that requires special handling on the > remote (client workstation) side, like additional software to install and > maintain. > > On Monday 01 October 2007, Stephen Zemlicka wrote: > > Yup, that's what I originally intended but I probably wasn't very clear. > > So basically you would add > > > > ROBOCOPY source destination /XO /XN /XC /E /COPY:ATSOU > > > > to run after the rsync finishes. > > > > How are you running rsync with no remote daemon running? Mapped drive? > > Why not run the remote daemon, I believe rsync can even initiate the > > remote > > > daemon from the client side if you want. (hopefully my terminology is > > correct there) > > > > _ > > Stephen Zemlicka > > Integrated Computer Technologies > > PH. 608-558-5926 > > E-Mail [EMAIL PROTECTED] > > > > -Original Message- > > From: [EMAIL PROTECTED] > > [mailto:[EMAIL PROTECTED] On Behalf > > Of > > > havoc > > Sent: Monday, October 01, 2007 11:28 AM > > To: rsync@lists.samba.org > > Subject: Re: cygwin rsync windows to windows ACL problem > > > > Intriguing, you're saying to use rsync to copy/sync the data, the use > > robocopy > > to only recursively set permissions? Robocopy can do this without > > transferring data? > > I haven't finished reading all about it yet, but have started with: > > http://en.wikipedia.org/wiki/Robocopy > > > > On Monday 01 October 2007, Stephen Zemlicka wrote: > > > I have synced terabytes of data across DSL connections using robocopy > > > with no problem. Robocopy is just as fast as rsync on whole files and > > > I find > > > > it > > > > > to be even faster on folders with large numbers of small files (though > > > I hear the next release of rsync is supposed to speed that up). > > > > > > However, if you must use rsync, you can still use the robocopy that I > > > specified earlier. Rsync would be responsible for all the file copying > > > > and > > > > > robocopy would be responsible for only the attributes and permissions. > > > Since rsync is a *nix utility, I doubt much effort will be put into > > > compatibility with windows permissions. > > > > > > _ > > > Stephen Zemlicka > > > Integrated Computer Technologies > > > PH. 608-558-5926 > > > E-Mail [EMAIL PROTECTED] > > > > > > -Original Message- > > > From: [EMAIL PROTECTED] > > > [mailto:[EMAIL PROTECTED] On > > > Behalf > > > > Of > > > > > havoc > > > Sent: Monday, October 01, 2007 11:00 AM > > > To: rsync@lists.samba.org > > > Subject: Re: cygwin rsync windows to windows ACL problem > > > > > > Unfortunately I don't think it will work. > > > We have two offices in the same corporate park connected by an > > unreliable > > > > radio backhaul, and several terabytes of data to sync daily, hence my > > > desire > > > > > > to get rsync working :( > > > > > > PS: I will definitely check out robocopy for other uses, thank you :) > > > > > > On Monday 01 October 2007, Stephen Zemlicka wrote: > > > > Robocopy does copy only the new or changed files.
Re: cygwin rsync windows to windows ACL problem
Ah, yes, was a terminology mismatch, I understand now. On Monday 01 October 2007, Stephen Zemlicka wrote: > I don't think so. Let's get terminology out of the way first. The > computer sending data is the client and the computer storing the backups is > the server. Rsync needs to read the whole file stored on the server to > know what data the client needs to send. Since you are only running rsync > on the client, the entire file needs to be transmitted from the server to > the client, then read and analyzed. Then, a partial transfer may occur. > So you can do a partial transfer but before that is possible, the client > needs a full transfer from the server to see what it needs to send. > > _ > Stephen Zemlicka > Integrated Computer Technologies > PH. 608-558-5926 > E-Mail [EMAIL PROTECTED] > > -Original Message- > From: havoc [mailto:[EMAIL PROTECTED] > Sent: Monday, October 01, 2007 11:54 AM > To: Stephen Zemlicka > Subject: Re: cygwin rsync windows to windows ACL problem > > So even with a mapped drive --partial will have no effect? > Is this cygwin/Windows specific behavior (as it does work on linux)? > > On Monday 01 October 2007, Stephen Zemlicka wrote: > > Remember, if you don't have the rsync daemon running on the remote > > computer, rsync will transfer whole files anyway. I'm working at getting > > around this issue with mapped drives but haven't had a lot of time > > recently > > > to get it ironed out and fully tested. If you are not running rsync on > > the > > > system you are backing up to, rsync will run exactly like robocopy (ie. > > with the -W option). > > > > _ > > Stephen Zemlicka > > Integrated Computer Technologies > > PH. 608-558-5926 > > E-Mail [EMAIL PROTECTED] > > > > -Original Message- > > From: [EMAIL PROTECTED] > > [mailto:[EMAIL PROTECTED] On Behalf > > Of > > > havoc > > Sent: Monday, October 01, 2007 11:46 AM > > To: rsync@lists.samba.org > > Subject: Re: cygwin rsync windows to windows ACL problem > > > > Yes, mapped drive, "kindof", it's a netbios default share, but > > essentially the > > same thing. > > I am trying to avoid any situation that requires special handling on the > > remote (client workstation) side, like additional software to install and > > maintain. > > > > On Monday 01 October 2007, Stephen Zemlicka wrote: > > > Yup, that's what I originally intended but I probably wasn't very > > > clear. So basically you would add > > > > > > ROBOCOPY source destination /XO /XN /XC /E /COPY:ATSOU > > > > > > to run after the rsync finishes. > > > > > > How are you running rsync with no remote daemon running? Mapped drive? > > > Why not run the remote daemon, I believe rsync can even initiate the > > > > remote > > > > > daemon from the client side if you want. (hopefully my terminology is > > > correct there) > > > > > > _ > > > Stephen Zemlicka > > > Integrated Computer Technologies > > > PH. 608-558-5926 > > > E-Mail [EMAIL PROTECTED] > > > > > > -Original Message- > > > From: [EMAIL PROTECTED] > > > [mailto:[EMAIL PROTECTED] On > > > Behalf > > > > Of > > > > > havoc > > > Sent: Monday, October 01, 2007 11:28 AM > > > To: rsync@lists.samba.org > > > Subject: Re: cygwin rsync windows to windows ACL problem > > > > > > Intriguing, you're saying to use rsync to copy/sync the data, the use > > > robocopy > > > to only recursively set permissions? Robocopy can do this without > > > transferring data? > > > I haven't finished reading all about it yet, but have started with: > > > http://en.wikipedia.org/wiki/Robocopy > > > > > > On Monday 01 October 2007, Stephen Zemlicka wrote: > > > > I have synced terabytes of data across DSL connections using robocopy > > > > with no problem. Robocopy is just as fast as rsync on whole files > > > > and I find > > > > > > it > > > > > > > to be even faster on folders with large numbers of small files > > > > (though I hear the next release of rsync is supposed to speed that > > > > up). > > > > > > > > However, if you must use rsync, you can still use the robocopy that I > > > > specified earlier. Rsync would be responsible for all the file > > copying > > > > and > > > > > > > robocopy would be responsible for only the attributes and > > > > permissions. Since rsync is a *nix utility, I doubt much effort will > > > > be put into compatibility with windows permissions. > > > > > > > > _ > > > > Stephen Zemlicka > > > > Integrated Computer Technologies > > > > PH. 608-558-5926 > > > > E-Mail [EMAIL PROTECTED] > > > > > > > > -Original Message- > > > > From: [EMAIL PROTECTED] > > > > [mailto:[EMAIL PROTECTED] On > > > > Behalf > > > > > > Of > > > > > > > havoc > > > > Sent: Monday, October 01, 2007 11:00 AM > > > > To: rsync@lists.samba.org > > > > Subject: Re: cygwin rsync windows to windows ACL problem > > > > > > > > Unfortunately I don't think it will work. > > > > We have two
Re: cygwin rsync windows to windows ACL problem
Would running an rsync daemon on the client side (using Matt's ACL enabled rsync) solve my ACL problem? On Monday 01 October 2007, havoc wrote: > Yes, mapped drive, "kindof", it's a netbios default share, but essentially > the same thing. > I am trying to avoid any situation that requires special handling on the > remote (client workstation) side, like additional software to install and > maintain. > > On Monday 01 October 2007, Stephen Zemlicka wrote: > > Yup, that's what I originally intended but I probably wasn't very clear. > > So basically you would add > > > > ROBOCOPY source destination /XO /XN /XC /E /COPY:ATSOU > > > > to run after the rsync finishes. > > > > How are you running rsync with no remote daemon running? Mapped drive? > > Why not run the remote daemon, I believe rsync can even initiate the > > remote daemon from the client side if you want. (hopefully my terminology > > is correct there) > > > > _ > > Stephen Zemlicka > > Integrated Computer Technologies > > PH. 608-558-5926 > > E-Mail [EMAIL PROTECTED] > > > > -Original Message- > > From: [EMAIL PROTECTED] > > [mailto:[EMAIL PROTECTED] On Behalf > > Of havoc > > Sent: Monday, October 01, 2007 11:28 AM > > To: rsync@lists.samba.org > > Subject: Re: cygwin rsync windows to windows ACL problem > > > > Intriguing, you're saying to use rsync to copy/sync the data, the use > > robocopy > > to only recursively set permissions? Robocopy can do this without > > transferring data? > > I haven't finished reading all about it yet, but have started with: > > http://en.wikipedia.org/wiki/Robocopy > > > > On Monday 01 October 2007, Stephen Zemlicka wrote: > > > I have synced terabytes of data across DSL connections using robocopy > > > with no problem. Robocopy is just as fast as rsync on whole files and > > > I find > > > > it > > > > > to be even faster on folders with large numbers of small files (though > > > I hear the next release of rsync is supposed to speed that up). > > > > > > However, if you must use rsync, you can still use the robocopy that I > > > specified earlier. Rsync would be responsible for all the file copying > > > > and > > > > > robocopy would be responsible for only the attributes and permissions. > > > Since rsync is a *nix utility, I doubt much effort will be put into > > > compatibility with windows permissions. > > > > > > _ > > > Stephen Zemlicka > > > Integrated Computer Technologies > > > PH. 608-558-5926 > > > E-Mail [EMAIL PROTECTED] > > > > > > -Original Message- > > > From: [EMAIL PROTECTED] > > > [mailto:[EMAIL PROTECTED] On > > > Behalf > > > > Of > > > > > havoc > > > Sent: Monday, October 01, 2007 11:00 AM > > > To: rsync@lists.samba.org > > > Subject: Re: cygwin rsync windows to windows ACL problem > > > > > > Unfortunately I don't think it will work. > > > We have two offices in the same corporate park connected by an > > > unreliable radio backhaul, and several terabytes of data to sync daily, > > > hence my desire > > > > > > to get rsync working :( > > > > > > PS: I will definitely check out robocopy for other uses, thank you :) > > > > > > On Monday 01 October 2007, Stephen Zemlicka wrote: > > > > Robocopy does copy only the new or changed files. However it does > > > > copy > > > > > > the > > > > > > > whole files (similar to the -W switch in rsync). I use robocopy > > > > whenever > > > > > I > > > > > > > already have a secure connection (VPN) or when my backups don't > > > > include large (multi GB) database files. To see if robocopy will > > > > work by itself for you, add the -W switch and see if that's > > > > acceptable. It'll take a bit longer for changed files but will be > > > > just as fast for new files. > > > > > > > > _ > > > > Stephen Zemlicka > > > > Integrated Computer Technologies > > > > PH. 608-558-5926 > > > > E-Mail [EMAIL PROTECTED] > > > > -Original Message- > > > > From: [EMAIL PROTECTED] > > > > [mailto:[EMAIL PROTECTED] On > > > > Behalf > > > > > > Of > > > > > > > havoc > > > > Sent: Monday, October 01, 2007 10:50 AM > > > > To: rsync@lists.samba.org > > > > Subject: Re: cygwin rsync windows to windows ACL problem > > > > > > > > Does robocopy handle partial transfers, and backups of changed > > > > deleted files? > > > > My reason for wanting rsync is to maintain a mirror, and accomplish > > > > incremental backups via --backup --backup-dir= with rsync. > > > > > > > > On Monday 01 October 2007, Stephen Zemlicka wrote: > > > > > I have also noticed that permissions aren't always copied under > > > > > windows. I've heard you can use robocopy to do it. I have not > > > > > because it hasn't been critical to my operation but supposedly, you > > > > > can use something like > > > > > > > > > > ROBOCOPY source destination /XO /XN /XC /E /COPY:ATSOU > > > > > > > > > > After the backup script. This should not copy any files and just > > > > > copy the file per
RE: why not a gui for rsync
> What exactly are you looking for in monitoring it? The -v > should give you a verbose output. If you want more details, I > think you can specify multiple -v to give you a more verbose > output. As my question indicates, I know the above. | So the question remains: In regard to output, rsync has | the following features: | | a) -v option with various levels of verbosity | b) --stats | c) --log-file=foo | d) messages rsync prints to stdout | e) messages rsync prints to stderr. | | Where can one find an explanation of the format, content | and interpretation of the outputs (a-e)? What I do not know is how to interpret the output from rsync. To give some specific examples: 1) consider the message: 2007/09/13 16:50:52 [13688] receiving file list Isn't the list of files determined from the command line used to invoke rsync? So what this new list of files that are being received from where and by whom? 2) In the following three lines, 2007/09/13 17:44:29 [13688] >f..t cmsstorage.lst 2007/09/13 17:50:53 [13688] >f.st WINDOWS/SYSTEM/FFASTLOG.TXT 2007/09/13 17:50:53 [13688] >f+++ WINDOWS/TEMP/CP1293.TMP what does the ">f" mean? 3) In the following, 2007/09/13 17:43:10 [13688] IO error encountered -- skipping file deletion for what transaction was the IO error encountered: while reading the source (which file exactly)?, while writing the destination (which file exactly)?, while talking from sender rsync process to receiver rsync process?, while talking from receiver rsync process to sender rsync process? 4) What are the consequences of the following skip? IO error encountered -- skipping file deletion How can I know determine whether or not the "skipping" had any bad effects? So the question is: Where can one find an explanation of the format, content and interpretation of the outputs (a-e)? --Suresh -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
RE: cygwin rsync windows to windows ACL problem
I'm not sure. If you can run the daemon on the server, you should. My situation doesn't allow me to do that but if yours does, you should. If you initiate the daemon from the client, then I don't believe there's anything extra running on the server except for during backups. _ Stephen Zemlicka Integrated Computer Technologies PH. 608-558-5926 E-Mail [EMAIL PROTECTED] -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of havoc Sent: Monday, October 01, 2007 12:06 PM To: rsync@lists.samba.org Subject: Re: cygwin rsync windows to windows ACL problem Would running an rsync daemon on the client side (using Matt's ACL enabled rsync) solve my ACL problem? On Monday 01 October 2007, havoc wrote: > Yes, mapped drive, "kindof", it's a netbios default share, but essentially > the same thing. > I am trying to avoid any situation that requires special handling on the > remote (client workstation) side, like additional software to install and > maintain. > > On Monday 01 October 2007, Stephen Zemlicka wrote: > > Yup, that's what I originally intended but I probably wasn't very clear. > > So basically you would add > > > > ROBOCOPY source destination /XO /XN /XC /E /COPY:ATSOU > > > > to run after the rsync finishes. > > > > How are you running rsync with no remote daemon running? Mapped drive? > > Why not run the remote daemon, I believe rsync can even initiate the > > remote daemon from the client side if you want. (hopefully my terminology > > is correct there) > > > > _ > > Stephen Zemlicka > > Integrated Computer Technologies > > PH. 608-558-5926 > > E-Mail [EMAIL PROTECTED] > > > > -Original Message- > > From: [EMAIL PROTECTED] > > [mailto:[EMAIL PROTECTED] On Behalf > > Of havoc > > Sent: Monday, October 01, 2007 11:28 AM > > To: rsync@lists.samba.org > > Subject: Re: cygwin rsync windows to windows ACL problem > > > > Intriguing, you're saying to use rsync to copy/sync the data, the use > > robocopy > > to only recursively set permissions? Robocopy can do this without > > transferring data? > > I haven't finished reading all about it yet, but have started with: > > http://en.wikipedia.org/wiki/Robocopy > > > > On Monday 01 October 2007, Stephen Zemlicka wrote: > > > I have synced terabytes of data across DSL connections using robocopy > > > with no problem. Robocopy is just as fast as rsync on whole files and > > > I find > > > > it > > > > > to be even faster on folders with large numbers of small files (though > > > I hear the next release of rsync is supposed to speed that up). > > > > > > However, if you must use rsync, you can still use the robocopy that I > > > specified earlier. Rsync would be responsible for all the file copying > > > > and > > > > > robocopy would be responsible for only the attributes and permissions. > > > Since rsync is a *nix utility, I doubt much effort will be put into > > > compatibility with windows permissions. > > > > > > _ > > > Stephen Zemlicka > > > Integrated Computer Technologies > > > PH. 608-558-5926 > > > E-Mail [EMAIL PROTECTED] > > > > > > -Original Message- > > > From: [EMAIL PROTECTED] > > > [mailto:[EMAIL PROTECTED] On > > > Behalf > > > > Of > > > > > havoc > > > Sent: Monday, October 01, 2007 11:00 AM > > > To: rsync@lists.samba.org > > > Subject: Re: cygwin rsync windows to windows ACL problem > > > > > > Unfortunately I don't think it will work. > > > We have two offices in the same corporate park connected by an > > > unreliable radio backhaul, and several terabytes of data to sync daily, > > > hence my desire > > > > > > to get rsync working :( > > > > > > PS: I will definitely check out robocopy for other uses, thank you :) > > > > > > On Monday 01 October 2007, Stephen Zemlicka wrote: > > > > Robocopy does copy only the new or changed files. However it does > > > > copy > > > > > > the > > > > > > > whole files (similar to the -W switch in rsync). I use robocopy > > > > whenever > > > > > I > > > > > > > already have a secure connection (VPN) or when my backups don't > > > > include large (multi GB) database files. To see if robocopy will > > > > work by itself for you, add the -W switch and see if that's > > > > acceptable. It'll take a bit longer for changed files but will be > > > > just as fast for new files. > > > > > > > > _ > > > > Stephen Zemlicka > > > > Integrated Computer Technologies > > > > PH. 608-558-5926 > > > > E-Mail [EMAIL PROTECTED] > > > > -Original Message- > > > > From: [EMAIL PROTECTED] > > > > [mailto:[EMAIL PROTECTED] On > > > > Behalf > > > > > > Of > > > > > > > havoc > > > > Sent: Monday, October 01, 2007 10:50 AM > > > > To: rsync@lists.samba.org > > > > Subject: Re: cygwin rsync windows to windows ACL problem > > > > > > > > Does robocopy handle partial transfers, and backups of changed > > > > deleted files? > > > > My reason for wanting rs
RE: why not a gui for rsync
RTM _ Stephen Zemlicka Integrated Computer Technologies PH. 608-558-5926 E-Mail [EMAIL PROTECTED] -Original Message- From: Suresh Govindachar [mailto:[EMAIL PROTECTED] Sent: Monday, October 01, 2007 12:06 PM To: 'Stephen Zemlicka'; rsync@lists.samba.org Subject: RE: why not a gui for rsync > What exactly are you looking for in monitoring it? The -v > should give you a verbose output. If you want more details, I > think you can specify multiple -v to give you a more verbose > output. As my question indicates, I know the above. | So the question remains: In regard to output, rsync has | the following features: | | a) -v option with various levels of verbosity | b) --stats | c) --log-file=foo | d) messages rsync prints to stdout | e) messages rsync prints to stderr. | | Where can one find an explanation of the format, content | and interpretation of the outputs (a-e)? What I do not know is how to interpret the output from rsync. To give some specific examples: 1) consider the message: 2007/09/13 16:50:52 [13688] receiving file list Isn't the list of files determined from the command line used to invoke rsync? So what this new list of files that are being received from where and by whom? 2) In the following three lines, 2007/09/13 17:44:29 [13688] >f..t cmsstorage.lst 2007/09/13 17:50:53 [13688] >f.st WINDOWS/SYSTEM/FFASTLOG.TXT 2007/09/13 17:50:53 [13688] >f+++ WINDOWS/TEMP/CP1293.TMP what does the ">f" mean? 3) In the following, 2007/09/13 17:43:10 [13688] IO error encountered -- skipping file deletion for what transaction was the IO error encountered: while reading the source (which file exactly)?, while writing the destination (which file exactly)?, while talking from sender rsync process to receiver rsync process?, while talking from receiver rsync process to sender rsync process? 4) What are the consequences of the following skip? IO error encountered -- skipping file deletion How can I know determine whether or not the "skipping" had any bad effects? So the question is: Where can one find an explanation of the format, content and interpretation of the outputs (a-e)? --Suresh -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
RE: why not a gui for rsync
Stephen Zemlicka wrote: > RTM Where is the Manual -- that was the question I asked: | Where can one find an explanation of the format, content | and interpretation of the outputs (a-e)? --Suresh -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: cygwin rsync windows to windows ACL problem
Well, I'll try installing cygwin and an rsync daemon on one of the XP workstations to be backed up later tonight to see if having rsync on both ends solves the ACL issue. I just can't do it now as the workstations are in use. On Monday 01 October 2007, Stephen Zemlicka wrote: > I'm not sure. If you can run the daemon on the server, you should. My > situation doesn't allow me to do that but if yours does, you should. If > you initiate the daemon from the client, then I don't believe there's > anything extra running on the server except for during backups. > > _ > Stephen Zemlicka > Integrated Computer Technologies > PH. 608-558-5926 > E-Mail [EMAIL PROTECTED] > > -Original Message- > From: [EMAIL PROTECTED] > [mailto:[EMAIL PROTECTED] On Behalf Of > havoc > Sent: Monday, October 01, 2007 12:06 PM > To: rsync@lists.samba.org > Subject: Re: cygwin rsync windows to windows ACL problem > > Would running an rsync daemon on the client side (using Matt's ACL enabled > rsync) solve my ACL problem? > > On Monday 01 October 2007, havoc wrote: > > Yes, mapped drive, "kindof", it's a netbios default share, but > > essentially the same thing. > > I am trying to avoid any situation that requires special handling on the > > remote (client workstation) side, like additional software to install and > > maintain. > > > > On Monday 01 October 2007, Stephen Zemlicka wrote: > > > Yup, that's what I originally intended but I probably wasn't very > > > clear. So basically you would add > > > > > > ROBOCOPY source destination /XO /XN /XC /E /COPY:ATSOU > > > > > > to run after the rsync finishes. > > > > > > How are you running rsync with no remote daemon running? Mapped drive? > > > Why not run the remote daemon, I believe rsync can even initiate the > > > remote daemon from the client side if you want. (hopefully my > > terminology > > > > is correct there) > > > > > > _ > > > Stephen Zemlicka > > > Integrated Computer Technologies > > > PH. 608-558-5926 > > > E-Mail [EMAIL PROTECTED] > > > > > > -Original Message- > > > From: [EMAIL PROTECTED] > > > [mailto:[EMAIL PROTECTED] On > > > Behalf Of havoc > > > Sent: Monday, October 01, 2007 11:28 AM > > > To: rsync@lists.samba.org > > > Subject: Re: cygwin rsync windows to windows ACL problem > > > > > > Intriguing, you're saying to use rsync to copy/sync the data, the use > > > robocopy > > > to only recursively set permissions? Robocopy can do this without > > > transferring data? > > > I haven't finished reading all about it yet, but have started with: > > > http://en.wikipedia.org/wiki/Robocopy > > > > > > On Monday 01 October 2007, Stephen Zemlicka wrote: > > > > I have synced terabytes of data across DSL connections using robocopy > > > > with no problem. Robocopy is just as fast as rsync on whole files > > > > and I find > > > > > > it > > > > > > > to be even faster on folders with large numbers of small files > > > > (though I hear the next release of rsync is supposed to speed that > > > > up). > > > > > > > > However, if you must use rsync, you can still use the robocopy that I > > > > specified earlier. Rsync would be responsible for all the file > > copying > > > > and > > > > > > > robocopy would be responsible for only the attributes and > > > > permissions. Since rsync is a *nix utility, I doubt much effort will > > > > be put into compatibility with windows permissions. > > > > > > > > _ > > > > Stephen Zemlicka > > > > Integrated Computer Technologies > > > > PH. 608-558-5926 > > > > E-Mail [EMAIL PROTECTED] > > > > > > > > -Original Message- > > > > From: [EMAIL PROTECTED] > > > > [mailto:[EMAIL PROTECTED] On > > > > Behalf > > > > > > Of > > > > > > > havoc > > > > Sent: Monday, October 01, 2007 11:00 AM > > > > To: rsync@lists.samba.org > > > > Subject: Re: cygwin rsync windows to windows ACL problem > > > > > > > > Unfortunately I don't think it will work. > > > > We have two offices in the same corporate park connected by an > > > > unreliable radio backhaul, and several terabytes of data to sync > > daily, > > > > > hence my desire > > > > > > > > to get rsync working :( > > > > > > > > PS: I will definitely check out robocopy for other uses, thank you :) > > > > > > > > On Monday 01 October 2007, Stephen Zemlicka wrote: > > > > > Robocopy does copy only the new or changed files. However it does > > > > > copy > > > > > > > > the > > > > > > > > > whole files (similar to the -W switch in rsync). I use robocopy > > > > > > whenever > > > > > > > I > > > > > > > > > already have a secure connection (VPN) or when my backups don't > > > > > include large (multi GB) database files. To see if robocopy will > > > > > work by itself for you, add the -W switch and see if that's > > > > > acceptable. It'll take a bit longer for changed files but will be > > > > > just as fast for new files. > > > > > > > > > > _ > > > >
RE: why not a gui for rsync
Gotta love Google. http://samba.anu.edu.au/ftp/rsync/rsync.html http://optics.ph.unimelb.edu.au/help/rsync/rsync.html http://www.mediacollege.com/cgi-bin/man/page.cgi?topic=rsync http://www.ss64.com/bash/rsync.html _ Stephen Zemlicka Integrated Computer Technologies PH. 608-558-5926 E-Mail [EMAIL PROTECTED] -Original Message- From: Suresh Govindachar [mailto:[EMAIL PROTECTED] Sent: Monday, October 01, 2007 12:42 PM To: 'Stephen Zemlicka'; rsync@lists.samba.org Subject: RE: why not a gui for rsync Stephen Zemlicka wrote: > RTM Where is the Manual -- that was the question I asked: | Where can one find an explanation of the format, content | and interpretation of the outputs (a-e)? --Suresh -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
RE: cygwin rsync windows to windows ACL problem
Check out cwRsync. Should allow you to install and use rsync without the entire cygwin installation. http://www.itefix.no/phpws/index.php?module=pagemaster&PAGE_user_op=view_pag e&PAGE_id=6&MMN_position=23:23 _ Stephen Zemlicka Integrated Computer Technologies PH. 608-558-5926 E-Mail [EMAIL PROTECTED] -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of havoc Sent: Monday, October 01, 2007 12:42 PM To: rsync@lists.samba.org Subject: Re: cygwin rsync windows to windows ACL problem Well, I'll try installing cygwin and an rsync daemon on one of the XP workstations to be backed up later tonight to see if having rsync on both ends solves the ACL issue. I just can't do it now as the workstations are in use. On Monday 01 October 2007, Stephen Zemlicka wrote: > I'm not sure. If you can run the daemon on the server, you should. My > situation doesn't allow me to do that but if yours does, you should. If > you initiate the daemon from the client, then I don't believe there's > anything extra running on the server except for during backups. > > _ > Stephen Zemlicka > Integrated Computer Technologies > PH. 608-558-5926 > E-Mail [EMAIL PROTECTED] > > -Original Message- > From: [EMAIL PROTECTED] > [mailto:[EMAIL PROTECTED] On Behalf Of > havoc > Sent: Monday, October 01, 2007 12:06 PM > To: rsync@lists.samba.org > Subject: Re: cygwin rsync windows to windows ACL problem > > Would running an rsync daemon on the client side (using Matt's ACL enabled > rsync) solve my ACL problem? > > On Monday 01 October 2007, havoc wrote: > > Yes, mapped drive, "kindof", it's a netbios default share, but > > essentially the same thing. > > I am trying to avoid any situation that requires special handling on the > > remote (client workstation) side, like additional software to install and > > maintain. > > > > On Monday 01 October 2007, Stephen Zemlicka wrote: > > > Yup, that's what I originally intended but I probably wasn't very > > > clear. So basically you would add > > > > > > ROBOCOPY source destination /XO /XN /XC /E /COPY:ATSOU > > > > > > to run after the rsync finishes. > > > > > > How are you running rsync with no remote daemon running? Mapped drive? > > > Why not run the remote daemon, I believe rsync can even initiate the > > > remote daemon from the client side if you want. (hopefully my > > terminology > > > > is correct there) > > > > > > _ > > > Stephen Zemlicka > > > Integrated Computer Technologies > > > PH. 608-558-5926 > > > E-Mail [EMAIL PROTECTED] > > > > > > -Original Message- > > > From: [EMAIL PROTECTED] > > > [mailto:[EMAIL PROTECTED] On > > > Behalf Of havoc > > > Sent: Monday, October 01, 2007 11:28 AM > > > To: rsync@lists.samba.org > > > Subject: Re: cygwin rsync windows to windows ACL problem > > > > > > Intriguing, you're saying to use rsync to copy/sync the data, the use > > > robocopy > > > to only recursively set permissions? Robocopy can do this without > > > transferring data? > > > I haven't finished reading all about it yet, but have started with: > > > http://en.wikipedia.org/wiki/Robocopy > > > > > > On Monday 01 October 2007, Stephen Zemlicka wrote: > > > > I have synced terabytes of data across DSL connections using robocopy > > > > with no problem. Robocopy is just as fast as rsync on whole files > > > > and I find > > > > > > it > > > > > > > to be even faster on folders with large numbers of small files > > > > (though I hear the next release of rsync is supposed to speed that > > > > up). > > > > > > > > However, if you must use rsync, you can still use the robocopy that I > > > > specified earlier. Rsync would be responsible for all the file > > copying > > > > and > > > > > > > robocopy would be responsible for only the attributes and > > > > permissions. Since rsync is a *nix utility, I doubt much effort will > > > > be put into compatibility with windows permissions. > > > > > > > > _ > > > > Stephen Zemlicka > > > > Integrated Computer Technologies > > > > PH. 608-558-5926 > > > > E-Mail [EMAIL PROTECTED] > > > > > > > > -Original Message- > > > > From: [EMAIL PROTECTED] > > > > [mailto:[EMAIL PROTECTED] On > > > > Behalf > > > > > > Of > > > > > > > havoc > > > > Sent: Monday, October 01, 2007 11:00 AM > > > > To: rsync@lists.samba.org > > > > Subject: Re: cygwin rsync windows to windows ACL problem > > > > > > > > Unfortunately I don't think it will work. > > > > We have two offices in the same corporate park connected by an > > > > unreliable radio backhaul, and several terabytes of data to sync > > daily, > > > > > hence my desire > > > > > > > > to get rsync working :( > > > > > > > > PS: I will definitely check out robocopy for other uses, thank you :) > > > > > > > > On Monday 01 October 2007, Stephen Zemlicka wrote: > > > > > Robocopy does copy only the new or changed files. However it does
Re: cygwin rsync windows to windows ACL problem
Heh, already found that via: http://www.gaztronics.net/rsync.php On Monday 01 October 2007, Stephen Zemlicka wrote: > Check out cwRsync. Should allow you to install and use rsync without the > entire cygwin installation. > > http://www.itefix.no/phpws/index.php?module=pagemaster&PAGE_user_op=view_pa >g e&PAGE_id=6&MMN_position=23:23 > > _ > Stephen Zemlicka > Integrated Computer Technologies > PH. 608-558-5926 > E-Mail [EMAIL PROTECTED] > > -Original Message- > From: [EMAIL PROTECTED] > [mailto:[EMAIL PROTECTED] On Behalf Of > havoc > Sent: Monday, October 01, 2007 12:42 PM > To: rsync@lists.samba.org > Subject: Re: cygwin rsync windows to windows ACL problem > > Well, I'll try installing cygwin and an rsync daemon on one of the XP > workstations to be backed up later tonight to see if having rsync on both > ends solves the ACL issue. I just can't do it now as the workstations are > in > > use. > > On Monday 01 October 2007, Stephen Zemlicka wrote: > > I'm not sure. If you can run the daemon on the server, you should. My > > situation doesn't allow me to do that but if yours does, you should. If > > you initiate the daemon from the client, then I don't believe there's > > anything extra running on the server except for during backups. > > > > _ > > Stephen Zemlicka > > Integrated Computer Technologies > > PH. 608-558-5926 > > E-Mail [EMAIL PROTECTED] > > > > -Original Message- > > From: [EMAIL PROTECTED] > > [mailto:[EMAIL PROTECTED] On Behalf > > Of > > > havoc > > Sent: Monday, October 01, 2007 12:06 PM > > To: rsync@lists.samba.org > > Subject: Re: cygwin rsync windows to windows ACL problem > > > > Would running an rsync daemon on the client side (using Matt's ACL > > enabled rsync) solve my ACL problem? > > > > On Monday 01 October 2007, havoc wrote: > > > Yes, mapped drive, "kindof", it's a netbios default share, but > > > essentially the same thing. > > > I am trying to avoid any situation that requires special handling on > > > the remote (client workstation) side, like additional software to > > > install > > and > > > > maintain. > > > > > > On Monday 01 October 2007, Stephen Zemlicka wrote: > > > > Yup, that's what I originally intended but I probably wasn't very > > > > clear. So basically you would add > > > > > > > > ROBOCOPY source destination /XO /XN /XC /E /COPY:ATSOU > > > > > > > > to run after the rsync finishes. > > > > > > > > How are you running rsync with no remote daemon running? Mapped > > drive? > > > > > Why not run the remote daemon, I believe rsync can even initiate the > > > > remote daemon from the client side if you want. (hopefully my > > > > terminology > > > > > > is correct there) > > > > > > > > _ > > > > Stephen Zemlicka > > > > Integrated Computer Technologies > > > > PH. 608-558-5926 > > > > E-Mail [EMAIL PROTECTED] > > > > > > > > -Original Message- > > > > From: [EMAIL PROTECTED] > > > > [mailto:[EMAIL PROTECTED] On > > > > Behalf Of havoc > > > > Sent: Monday, October 01, 2007 11:28 AM > > > > To: rsync@lists.samba.org > > > > Subject: Re: cygwin rsync windows to windows ACL problem > > > > > > > > Intriguing, you're saying to use rsync to copy/sync the data, the use > > > > robocopy > > > > to only recursively set permissions? Robocopy can do this without > > > > transferring data? > > > > I haven't finished reading all about it yet, but have started with: > > > > http://en.wikipedia.org/wiki/Robocopy > > > > > > > > On Monday 01 October 2007, Stephen Zemlicka wrote: > > > > > I have synced terabytes of data across DSL connections using > > robocopy > > > > > > with no problem. Robocopy is just as fast as rsync on whole files > > > > > and I find > > > > > > > > it > > > > > > > > > to be even faster on folders with large numbers of small files > > > > > (though I hear the next release of rsync is supposed to speed that > > > > > up). > > > > > > > > > > However, if you must use rsync, you can still use the robocopy that > > I > > > > > > specified earlier. Rsync would be responsible for all the file > > > > copying > > > > > > and > > > > > > > > > robocopy would be responsible for only the attributes and > > > > > permissions. Since rsync is a *nix utility, I doubt much effort > > > > > will be put into compatibility with windows permissions. > > > > > > > > > > _ > > > > > Stephen Zemlicka > > > > > Integrated Computer Technologies > > > > > PH. 608-558-5926 > > > > > E-Mail [EMAIL PROTECTED] > > > > > > > > > > -Original Message- > > > > > From: [EMAIL PROTECTED] > > > > > [mailto:[EMAIL PROTECTED] On > > > > > Behalf > > > > > > > > Of > > > > > > > > > havoc > > > > > Sent: Monday, October 01, 2007 11:00 AM > > > > > To: rsync@lists.samba.org > > > > > Subject: Re: cygwin rsync windows to windows ACL problem > > > > > > > > > > Unfortunately I don't think it will work. > > > > > We have two offices in the
Re: cygwin rsync windows to windows ACL problem
I forgot to mention that my concern with cwrsync is whether or not it is built with ACL support. On Monday 01 October 2007, havoc wrote: > Heh, already found that via: > http://www.gaztronics.net/rsync.php > > On Monday 01 October 2007, Stephen Zemlicka wrote: > > Check out cwRsync. Should allow you to install and use rsync without the > > entire cygwin installation. > > > > http://www.itefix.no/phpws/index.php?module=pagemaster&PAGE_user_op=view_ > >pa g e&PAGE_id=6&MMN_position=23:23 > > > > _ > > Stephen Zemlicka > > Integrated Computer Technologies > > PH. 608-558-5926 > > E-Mail [EMAIL PROTECTED] > > > > -Original Message- > > From: [EMAIL PROTECTED] > > [mailto:[EMAIL PROTECTED] On Behalf > > Of havoc > > Sent: Monday, October 01, 2007 12:42 PM > > To: rsync@lists.samba.org > > Subject: Re: cygwin rsync windows to windows ACL problem > > > > Well, I'll try installing cygwin and an rsync daemon on one of the XP > > workstations to be backed up later tonight to see if having rsync on both > > ends solves the ACL issue. I just can't do it now as the workstations are > > in > > > > use. > > > > On Monday 01 October 2007, Stephen Zemlicka wrote: > > > I'm not sure. If you can run the daemon on the server, you should. My > > > situation doesn't allow me to do that but if yours does, you should. > > > If you initiate the daemon from the client, then I don't believe > > > there's anything extra running on the server except for during backups. > > > > > > _ > > > Stephen Zemlicka > > > Integrated Computer Technologies > > > PH. 608-558-5926 > > > E-Mail [EMAIL PROTECTED] > > > > > > -Original Message- > > > From: [EMAIL PROTECTED] > > > [mailto:[EMAIL PROTECTED] On > > > Behalf > > > > Of > > > > > havoc > > > Sent: Monday, October 01, 2007 12:06 PM > > > To: rsync@lists.samba.org > > > Subject: Re: cygwin rsync windows to windows ACL problem > > > > > > Would running an rsync daemon on the client side (using Matt's ACL > > > enabled rsync) solve my ACL problem? > > > > > > On Monday 01 October 2007, havoc wrote: > > > > Yes, mapped drive, "kindof", it's a netbios default share, but > > > > essentially the same thing. > > > > I am trying to avoid any situation that requires special handling on > > > > the remote (client workstation) side, like additional software to > > > > install > > > > and > > > > > > maintain. > > > > > > > > On Monday 01 October 2007, Stephen Zemlicka wrote: > > > > > Yup, that's what I originally intended but I probably wasn't very > > > > > clear. So basically you would add > > > > > > > > > > ROBOCOPY source destination /XO /XN /XC /E /COPY:ATSOU > > > > > > > > > > to run after the rsync finishes. > > > > > > > > > > How are you running rsync with no remote daemon running? Mapped > > > > drive? > > > > > > > Why not run the remote daemon, I believe rsync can even initiate > > > > > the remote daemon from the client side if you want. (hopefully my > > > > > > terminology > > > > > > > > is correct there) > > > > > > > > > > _ > > > > > Stephen Zemlicka > > > > > Integrated Computer Technologies > > > > > PH. 608-558-5926 > > > > > E-Mail [EMAIL PROTECTED] > > > > > > > > > > -Original Message- > > > > > From: [EMAIL PROTECTED] > > > > > [mailto:[EMAIL PROTECTED] On > > > > > Behalf Of havoc > > > > > Sent: Monday, October 01, 2007 11:28 AM > > > > > To: rsync@lists.samba.org > > > > > Subject: Re: cygwin rsync windows to windows ACL problem > > > > > > > > > > Intriguing, you're saying to use rsync to copy/sync the data, the > > > > > use robocopy > > > > > to only recursively set permissions? Robocopy can do this without > > > > > transferring data? > > > > > I haven't finished reading all about it yet, but have started with: > > > > > http://en.wikipedia.org/wiki/Robocopy > > > > > > > > > > On Monday 01 October 2007, Stephen Zemlicka wrote: > > > > > > I have synced terabytes of data across DSL connections using > > > > robocopy > > > > > > > > with no problem. Robocopy is just as fast as rsync on whole > > > > > > files and I find > > > > > > > > > > it > > > > > > > > > > > to be even faster on folders with large numbers of small files > > > > > > (though I hear the next release of rsync is supposed to speed > > > > > > that up). > > > > > > > > > > > > However, if you must use rsync, you can still use the robocopy > > > > > > that > > > > I > > > > > > > > specified earlier. Rsync would be responsible for all the file > > > > > > copying > > > > > > > > and > > > > > > > > > > > robocopy would be responsible for only the attributes and > > > > > > permissions. Since rsync is a *nix utility, I doubt much effort > > > > > > will be put into compatibility with windows permissions. > > > > > > > > > > > > _ > > > > > > Stephen Zemlicka > > > > > > Integrated Computer Technologies > > > > > > PH. 608-558-5926 > > > > > > E-Mail [EMAIL PROT
RE: why not a gui for rsync
In response to > Stephen Zemlicka wrote: > >> RTM > > Where is the Manual -- that was the question I asked: > > | Where can one find an explanation of the format, content > | and interpretation of the outputs (a-e)? where (a-e) refer to: | So the question remains: In regard to output, rsync has the | following features: | | a) -v option with various levels of verbosity | b) --stats | c) --log-file=foo | d) messages rsync prints to stdout | e) messages rsync prints to stderr. | | Where can one find an explanation of the format, content | and interpretation of the outputs (a-e)? Stephen Zemlicka wrote: SZ> Gotta love Google. SZ> SZ> http://samba.anu.edu.au/ftp/rsync/rsync.html SZ> http://optics.ph.unimelb.edu.au/help/rsync/rsync.html SZ> http://www.mediacollege.com/cgi-bin/man/page.cgi?topic=rsync SZ> http://www.ss64.com/bash/rsync.html Have you actually looked at the above links? Do they in fact answer the question asked? They do not. Please do not blindly respond to posts -- your responses are just a waste of time. --Suresh -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
RE: why not a gui for rsync
Don't a "where's the manual" question buried in a page of text. Keep it short and concise and then people won't skim to try and help you without wasting their own time. _ Stephen Zemlicka Integrated Computer Technologies PH. 608-558-5926 E-Mail [EMAIL PROTECTED] -Original Message- From: Suresh Govindachar [mailto:[EMAIL PROTECTED] Sent: Monday, October 01, 2007 12:59 PM To: 'Stephen Zemlicka'; rsync@lists.samba.org Subject: RE: why not a gui for rsync In response to > Stephen Zemlicka wrote: > >> RTM > > Where is the Manual -- that was the question I asked: > > | Where can one find an explanation of the format, content > | and interpretation of the outputs (a-e)? where (a-e) refer to: | So the question remains: In regard to output, rsync has the | following features: | | a) -v option with various levels of verbosity | b) --stats | c) --log-file=foo | d) messages rsync prints to stdout | e) messages rsync prints to stderr. | | Where can one find an explanation of the format, content | and interpretation of the outputs (a-e)? Stephen Zemlicka wrote: SZ> Gotta love Google. SZ> SZ> http://samba.anu.edu.au/ftp/rsync/rsync.html SZ> http://optics.ph.unimelb.edu.au/help/rsync/rsync.html SZ> http://www.mediacollege.com/cgi-bin/man/page.cgi?topic=rsync SZ> http://www.ss64.com/bash/rsync.html Have you actually looked at the above links? Do they in fact answer the question asked? They do not. Please do not blindly respond to posts -- your responses are just a waste of time. --Suresh -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
RE: cygwin rsync windows to windows ACL problem
Someone more knowledgable in rsync correct me if I'm wrong but.. Wouldn't robocopy better serve these EXACT needs? It doesn't handle partial file transfers, but neither will rsync given that you are running it only on one end - I.e. to calculate the crc to compare the files contents it would have to read the whole file, then transfer back the changes - That would be SLOWER than just transferring the whole file (assuming symmetrical speed). Running rsync on both sides it should be dramatically faster *IF* there are several large files. If all small files and often changing then robocopy may be just about the same. Robocopy is part of the windows resource kit I believe, it's been around a long time. There's white papers on Microsoft's site about it. Steve Radich - http://www.aspdeveloper.net / http://www.virtualserverfaq.com BitShop, Inc. - Development, Training, Hosting, Troubleshooting - http://www.bitshop.com -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of havoc Sent: Monday, October 01, 2007 12:46 PM To: rsync@lists.samba.org Subject: Re: cygwin rsync windows to windows ACL problem Yes, mapped drive, "kindof", it's a netbios default share, but essentially the same thing. I am trying to avoid any situation that requires special handling on the remote (client workstation) side, like additional software to install and maintain. On Monday 01 October 2007, Stephen Zemlicka wrote: > Yup, that's what I originally intended but I probably wasn't very clear. > So basically you would add > > ROBOCOPY source destination /XO /XN /XC /E /COPY:ATSOU > > to run after the rsync finishes. > > How are you running rsync with no remote daemon running? Mapped drive? > Why not run the remote daemon, I believe rsync can even initiate the remote > daemon from the client side if you want. (hopefully my terminology is > correct there) > > _ > Stephen Zemlicka > Integrated Computer Technologies > PH. 608-558-5926 > E-Mail [EMAIL PROTECTED] > > -Original Message- > From: [EMAIL PROTECTED] > [mailto:[EMAIL PROTECTED] On Behalf Of > havoc > Sent: Monday, October 01, 2007 11:28 AM > To: rsync@lists.samba.org > Subject: Re: cygwin rsync windows to windows ACL problem > > Intriguing, you're saying to use rsync to copy/sync the data, the use > robocopy > to only recursively set permissions? Robocopy can do this without > transferring data? > I haven't finished reading all about it yet, but have started with: > http://en.wikipedia.org/wiki/Robocopy > > On Monday 01 October 2007, Stephen Zemlicka wrote: > > I have synced terabytes of data across DSL connections using robocopy > > with no problem. Robocopy is just as fast as rsync on whole files and I > > find > > it > > > to be even faster on folders with large numbers of small files (though I > > hear the next release of rsync is supposed to speed that up). > > > > However, if you must use rsync, you can still use the robocopy that I > > specified earlier. Rsync would be responsible for all the file copying > > and > > > robocopy would be responsible for only the attributes and permissions. > > Since rsync is a *nix utility, I doubt much effort will be put into > > compatibility with windows permissions. > > > > _ > > Stephen Zemlicka > > Integrated Computer Technologies > > PH. 608-558-5926 > > E-Mail [EMAIL PROTECTED] > > > > -Original Message- > > From: [EMAIL PROTECTED] > > [mailto:[EMAIL PROTECTED] On Behalf > > Of > > > havoc > > Sent: Monday, October 01, 2007 11:00 AM > > To: rsync@lists.samba.org > > Subject: Re: cygwin rsync windows to windows ACL problem > > > > Unfortunately I don't think it will work. > > We have two offices in the same corporate park connected by an unreliable > > radio backhaul, and several terabytes of data to sync daily, hence my > > desire > > > > to get rsync working :( > > > > PS: I will definitely check out robocopy for other uses, thank you :) > > > > On Monday 01 October 2007, Stephen Zemlicka wrote: > > > Robocopy does copy only the new or changed files. However it does copy > > > > the > > > > > whole files (similar to the -W switch in rsync). I use robocopy > > whenever > > > I > > > > > already have a secure connection (VPN) or when my backups don't include > > > large (multi GB) database files. To see if robocopy will work by > > > itself for you, add the -W switch and see if that's acceptable. It'll > > > take a bit longer for changed files but will be just as fast for new > > > files. > > > > > > _ > > > Stephen Zemlicka > > > Integrated Computer Technologies > > > PH. 608-558-5926 > > > E-Mail [EMAIL PROTECTED] > > > -Original Message- > > > From: [EMAIL PROTECTED] > > > [mailto:[EMAIL PROTECTED] On > > > Behalf > > > > Of > > > > > havoc > > > Sent: Monday, October 01, 2007 10:50 AM > > > To: rsync@lists.samba.org > > > Subject: Re: cygwin rsync windows to windows ACL probl
Re: cygwin rsync windows to windows ACL problem
I will run it at both ends if that's what it takes. On Monday 01 October 2007, Steve Radich wrote: > Someone more knowledgable in rsync correct me if I'm wrong but.. > > Wouldn't robocopy better serve these EXACT needs? It doesn't handle > partial file transfers, but neither will rsync given that you are > running it only on one end - I.e. to calculate the crc to compare the > files contents it would have to read the whole file, then transfer back > the changes - That would be SLOWER than just transferring the whole file > (assuming symmetrical speed). > > Running rsync on both sides it should be dramatically faster *IF* there > are several large files. If all small files and often changing then > robocopy may be just about the same. > > Robocopy is part of the windows resource kit I believe, it's been around > a long time. There's white papers on Microsoft's site about it. > > Steve Radich - http://www.aspdeveloper.net / > http://www.virtualserverfaq.com > BitShop, Inc. - Development, Training, Hosting, Troubleshooting - > http://www.bitshop.com > > -Original Message- > From: [EMAIL PROTECTED] > [mailto:[EMAIL PROTECTED] On Behalf Of > havoc > Sent: Monday, October 01, 2007 12:46 PM > To: rsync@lists.samba.org > Subject: Re: cygwin rsync windows to windows ACL problem > > Yes, mapped drive, "kindof", it's a netbios default share, but > essentially the > same thing. > I am trying to avoid any situation that requires special handling on the > > remote (client workstation) side, like additional software to install > and > maintain. > > On Monday 01 October 2007, Stephen Zemlicka wrote: > > Yup, that's what I originally intended but I probably wasn't very > > clear. > > > So basically you would add > > > > ROBOCOPY source destination /XO /XN /XC /E /COPY:ATSOU > > > > to run after the rsync finishes. > > > > How are you running rsync with no remote daemon running? Mapped > > drive? > > > Why not run the remote daemon, I believe rsync can even initiate the > > remote > > > daemon from the client side if you want. (hopefully my terminology is > > correct there) > > > > _ > > Stephen Zemlicka > > Integrated Computer Technologies > > PH. 608-558-5926 > > E-Mail [EMAIL PROTECTED] > > > > -Original Message- > > From: [EMAIL PROTECTED] > > [mailto:[EMAIL PROTECTED] On > > Behalf Of > > > havoc > > Sent: Monday, October 01, 2007 11:28 AM > > To: rsync@lists.samba.org > > Subject: Re: cygwin rsync windows to windows ACL problem > > > > Intriguing, you're saying to use rsync to copy/sync the data, the use > > robocopy > > to only recursively set permissions? Robocopy can do this without > > transferring data? > > I haven't finished reading all about it yet, but have started with: > > http://en.wikipedia.org/wiki/Robocopy > > > > On Monday 01 October 2007, Stephen Zemlicka wrote: > > > I have synced terabytes of data across DSL connections using > > robocopy > > > > with no problem. Robocopy is just as fast as rsync on whole files > > and I > > > > find > > > > it > > > > > to be even faster on folders with large numbers of small files > > (though I > > > > hear the next release of rsync is supposed to speed that up). > > > > > > However, if you must use rsync, you can still use the robocopy that > > I > > > > specified earlier. Rsync would be responsible for all the file > > copying > > > and > > > > > robocopy would be responsible for only the attributes and > > permissions. > > > > Since rsync is a *nix utility, I doubt much effort will be put into > > > compatibility with windows permissions. > > > > > > _ > > > Stephen Zemlicka > > > Integrated Computer Technologies > > > PH. 608-558-5926 > > > E-Mail [EMAIL PROTECTED] > > > > > > -Original Message- > > > From: [EMAIL PROTECTED] > > > [mailto:[EMAIL PROTECTED] On > > Behalf > > > Of > > > > > havoc > > > Sent: Monday, October 01, 2007 11:00 AM > > > To: rsync@lists.samba.org > > > Subject: Re: cygwin rsync windows to windows ACL problem > > > > > > Unfortunately I don't think it will work. > > > We have two offices in the same corporate park connected by an > > unreliable > > > > radio backhaul, and several terabytes of data to sync daily, hence > > my > > > > desire > > > > > > to get rsync working :( > > > > > > PS: I will definitely check out robocopy for other uses, thank you > : > :) > : > > > On Monday 01 October 2007, Stephen Zemlicka wrote: > > > > Robocopy does copy only the new or changed files. However it does > > copy > > > > the > > > > > > > whole files (similar to the -W switch in rsync). I use robocopy > > > > whenever > > > > > I > > > > > > > already have a secure connection (VPN) or when my backups don't > > include > > > > > large (multi GB) database files. To see if robocopy will work by > > > > itself for you, add the -W switch and see if that's acceptable. > > It'll > > > > > take a bit longer for changed files but will be just as fast for > > new > > > >
Re: why not a gui for rsync
If somebody is interesting to create this gui, let me know Try NasBackup It have rsync GUI. http://www.NasBackup.com/ Delta Copy unfortunately only works in client/server mode. As I also need local mode this is no option (though it looks nice). So me too I still haven't found a simple, user-friendly GUI. You can use the GUI for local mode only. Take a look at main.phase file Regards, Milutin Voinivich NasBackup Daniel Platteau wrote: I'm using rsync and I'm very glad, but, in some case, i'm not so happy. Some people are backing up the data with rsync but they have a lot of files, more than 10 and 20 Gb of data. We are using batch files and the task scheduling system of windows. It is difficult to see if the backup is well done, sometimes, they are error. We try to make some gui, one in java, an other in c++ and also one in delphi. The target was to make a service who can monitor the backup made with rsync and a gui that shown the state of the backup and allow the user to easily take back one file or, even, to take back old versions of the file. We are using rsync compiled with cygwin, the rsync software is launch in a shell and we try to collect the information in the "master programm" who have launched rsync. This way is maybe not the best way. My questions are : Is there a way to use the rsync protocol directly in a software without using rsync, like a dll with a lot of "rsync" functions. Is there some works in the world trying to make a good gui for rsync and to let all people using this very good method to make a backup. If somebody is interesting to create this gui, let me know begin:vcard fn:Milutin Voinivich n:Voinivich;Milutin email;internet:[EMAIL PROTECTED] note;quoted-printable:Try NasBackup.=0D=0A= http://www.nasbackup.com/ version:2.1 end:vcard -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
reducing file list bytes transferred
Hello, This is my first posting to the rsync list. I mirror a database containing directories which contain a very large number of files (say 30,000), and sending the file list can often take longer than transferring the new files.(Rsync ends up sending nearly the same file list on every transfer, with only the addition of a few new files.) Has the rsync team considered an rsync option which would remember the last file list on both ends, and only send changes to the list? In my case this would reduce the number of files in the file list from 300,000 per day to under 1,000 per day. Might be a good addition to rsync-3.0. Thanks in advance. Peter Salameh [EMAIL PROTECTED] -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: reducing file list bytes transferred
On 10/1/07, Peter Salameh <[EMAIL PROTECTED]> wrote: > Has the rsync team considered an rsync option which would remember the > last file list on both ends, and only send changes to the list? Perhaps a more natural approach is to use the delta-transfer algorithm to send the file list. Jamie Lokier suggested this approach here: http://lists.samba.org/archive/rsync/2007-August/018345.html Matt -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
RE: reducing file list bytes transferred
I think the next release is supposed to speed this up. _ Stephen Zemlicka Integrated Computer Technologies PH. 608-558-5926 E-Mail [EMAIL PROTECTED] -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Peter Salameh Sent: Monday, October 01, 2007 5:42 PM To: rsync@lists.samba.org Subject: reducing file list bytes transferred Hello, This is my first posting to the rsync list. I mirror a database containing directories which contain a very large number of files (say 30,000), and sending the file list can often take longer than transferring the new files.(Rsync ends up sending nearly the same file list on every transfer, with only the addition of a few new files.) Has the rsync team considered an rsync option which would remember the last file list on both ends, and only send changes to the list? In my case this would reduce the number of files in the file list from 300,000 per day to under 1,000 per day. Might be a good addition to rsync-3.0. Thanks in advance. Peter Salameh [EMAIL PROTECTED] -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: reducing file list bytes transferred
On 10/1/07, Stephen Zemlicka <[EMAIL PROTECTED]> wrote: > I think the next release is supposed to speed this up. Are you thinking of incremental recursion? It interleaves file list and file data transmission but does not decrease the total amount of file-list data sent. Matt -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
RE: reducing file list bytes transferred
I thought it was supposed to do it more effeciently _ Stephen Zemlicka Integrated Computer Technologies PH. 608-558-5926 E-Mail [EMAIL PROTECTED] -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Matt McCutchen Sent: Monday, October 01, 2007 8:10 PM To: Stephen Zemlicka Cc: Peter Salameh; rsync@lists.samba.org Subject: Re: reducing file list bytes transferred On 10/1/07, Stephen Zemlicka <[EMAIL PROTECTED]> wrote: > I think the next release is supposed to speed this up. Are you thinking of incremental recursion? It interleaves file list and file data transmission but does not decrease the total amount of file-list data sent. Matt -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: --delete not working, fixed!
On 9/25/07, Sylvain Viart <[EMAIL PROTECTED]> wrote: > As I said, Protect and Hide, are not "really" documented. It's only said in > the doc : > > hide, H specifies a pattern for hiding files from the transfer. You're right that that line is not enough to thoroughly explain hide filters. However, the man page does say later: "An s is used to indicate that the rule applies to the sending side. When a rule affects the sending side, it prevents files from being transferred. The default is for a rule to affect both sides unless --delete-excluded was specified, in which case default rules become sender-side only. See also the hide (H) and show (S) rules, which are an alternate way to specify sending-side includes/excludes." This adequately explains the "s" modifier, and from the last sentence, one can infer that "H foo" is equivalent to "-s foo". Similarly, the next bullet covers protect filters. Thus, the documentation is there; it just isn't at all obvious. I hope to improve the explanation of filters in my rewritten man page (see http://lists.samba.org/archive/rsync/2007-August/018214.html ). Matt -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: reducing file list bytes transferred
On 10/1/07, Stephen Zemlicka <[EMAIL PROTECTED]> wrote: > I thought it was supposed to do it more effeciently Not that I know of. (Wayne, please correct me if necessary.) Matt -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: cygwin rsync windows to windows ACL problem
On 10/1/07, Stephen Zemlicka <[EMAIL PROTECTED]> wrote: > Let's get terminology out of the way first. The computer > sending data is the client and the computer storing the backups is the > server. No, you may be pushing, but Havoc is pulling. Look at the command in the original message: > I am running: rsync -avPA //src_addr/some/path /local/dst/path/ The source path is remote, so the sender is the server and the receiver is the client. > Rsync needs to read the whole file stored on the server to know > what data the client needs to send. Since you are only running rsync on the > client, the entire file needs to be transmitted from the server to the > client, then read and analyzed. Then, a partial transfer may occur. Please call it a "delta transfer". A "partial transfer" is a transfer that is interrupted because rsync is killed or the connection drops, etc. Partial transfers are unrelated to the delta-transfer algorithm and are governed by --partial and --partial-dir. > So you > can do a partial transfer but before that is possible, the client needs a > full transfer from the server to see what it needs to send. Your explanation is correct only for a push. For a pull, the trouble is that there is nobody on the remote sender to tell the client that data from the source file matches one of the client's block checksums, so the client can't do better than pulling the entire source file. There is a "reverse" delta-transfer algorithm that can pull efficiently from dumb servers. Zsync ( http://zsync.moria.org.uk/ ) implements this algorithm, but I don't think it is nearly as capable as rsync in other areas. Matt -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: cygwin rsync windows to windows ACL problem
On 10/1/07, Steve Radich <[EMAIL PROTECTED]> wrote: > Wouldn't robocopy better serve these EXACT needs? It doesn't handle > partial file transfers, but neither will rsync given that you are > running it only on one end - I.e. to calculate the crc to compare the > files contents it would have to read the whole file, then transfer back > the changes - That would be SLOWER than just transferring the whole file > (assuming symmetrical speed). > > Running rsync on both sides it should be dramatically faster *IF* there > are several large files. If all small files and often changing then > robocopy may be just about the same. Correct. Havoc, if the speed benefit of delta transfers is not a priority, I would recommend that you just use robocopy. Otherwise, you could use rsync on both sides in combination with robocopy to copy ownership, or if you want to use rsync by itself, we can try to get the ownership preservation to work. Matt -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: Mapped Drive
On 9/30/07, Stephen Zemlicka <[EMAIL PROTECTED]> wrote: > OK, let's say this is the first sync and every file is being transferred. > The checksum for each of the files is cached on the local drive. Then, the > next time you sync, it checks the checksum from the cache against the file > to be copied. If it matches, it skips it. If it doesn't match, it just > transfers just the difference. It then replaces the checksum of that > transferred file to the cache. That way one could have a remote data store > and not have to run rsync on the remote system. IE, you could have a mapped > drive or FTP folder or S3 storage area that would all be rsyncable. That's a very clever idea, but I'd like to point out two caveats: (1) You're assuming nobody else modifies the files on the mapped drive. To remove that assumption, the checksum cache for each remote file could store the mtime of the revision of the file for which the cache is valid. Then, a destination file whose checksum cache is invalid could be identified and updated with a whole-file transfer. Optionally, you could store the caches on the mapped drive instead of the client, allowing anyone to push efficiently to the drive. (2) --inplace must be used. Furthermore, you save bandwidth only when a block of the destination file matches the source file *at the same offset*. If the offsets differ, a real delta transfer can just instruct the receiver to move the data, but in your case the data has to be written over again at the new offset. Thus, your scheme will give almost as much benefit as a real delta transfer for a database-style file that is modified in place, but if a single byte is inserted or deleted at the beginning of the source file, your scheme has to rewrite the entire destination file. You could overcome this by uploading a delta instead of updating the file itself, but that complicates matters for readers, who then have to pull the file and all deltas. If the remote filesystem supports efficient copying of a range of data from one offset to another, then #2 is moot and a smart client can do both pushes and pulls efficiently using your scheme and zsync's "reverse" delta-transfer algorithm, respectively. S3 doesn't appear to support any kind of range manipulation; perhaps Amazon could be convinced to add the necessary support. Matt -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: Mapped Drive
On 10/1/07, Matt McCutchen <[EMAIL PROTECTED]> wrote: > If the remote filesystem supports efficient copying of a range of data > from one offset to another, then #2 is moot and a smart client can do > both pushes and pulls efficiently using your scheme and zsync's > "reverse" delta-transfer algorithm, respectively. An alternative approach is to store the blocks of each file as separate files on the remote filesystem. For example, a file named "foo" of 1 MB might become files named "foo.1", ..., "foo.16" of 64 KB each. This works on even a completely dumb filesystem; a block of data can be "moved" from one offset to another by renaming the file holding it. However, this approach requires all clients to have special software to interpret the split files, and it may have unacceptable overhead depending on the remote filesystem implementation. At that point, it may make more sense to just run an rsync daemon on the remote machine. Matt -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: Interpreting output from rsync
On 10/1/07, Suresh Govindachar <[EMAIL PROTECTED]> wrote: > In regard to output, rsync has the following features: > Where can I find an explanation of the format, content > and interpretation of the outputs (a-e)? > a) -v option with various levels of verbosity Roughly, here is what is printed with each number of -v options. Errors are printed regardless of -v. 0: messages indicating that rsync might not be doing everything the user expected (e.g., "skipping directory foo/") 1: the name of each file as it is transferred; messages at various "significant" stages of rsync's operation 2: the name of each file as it is transferred, or the reason why rsync isn't transferring it; more detail about what rsync is doing and why (e.g., what filter caused each file to be included or excluded) 3+: debugging information about both rsync's internal operation and its interactions with the OS > b) --stats See the description of --stats in the rsync man page for a list of the statistics printed and what they mean. > c) --log-file=foo This makes rsync write a line to "foo" describing what it did to each file. You can control the format of the lines using --log-file-format; see its description in the rsync man page. > d) messages rsync prints to stdout > e) messages rsync prints to stderr. In general, errors go to stderr and information (governed by -v as above) goes to stdout. The messages are meant to be self-explanatory, so no one has bothered to make a list of all the messages and their meanings. If you get a specific message you don't understand, first search for it in the man page and Google; then if you don't find an explanation or need additional clarification, feel free to ask on the mailing list. Matt -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: why not a gui for rsync
On 10/1/07, Suresh Govindachar <[EMAIL PROTECTED]> wrote: > 1) consider the message: > > 2007/09/13 16:50:52 [13688] receiving file list > > Isn't the list of files determined from the command line used to > invoke rsync? So what this new list of files that are being > received from where and by whom? The "file list" is an rsync data structure that contains not only the names of the files to be transferred but also their attributes and some other auxiliary information. Furthermore, if you are using -r or -d, the file list has a separate entry for every file inside any of the directories you gave on the command line. One of the first steps performed by the sending rsync is to build the file list based on the command line arguments and send it to the receiving rsync. > 2) In the following three lines, > > 2007/09/13 17:44:29 [13688] >f..t cmsstorage.lst > 2007/09/13 17:50:53 [13688] >f.st WINDOWS/SYSTEM/FFASTLOG.TXT > 2007/09/13 17:50:53 [13688] >f+++ WINDOWS/TEMP/CP1293.TMP > > what does the ">f" mean? This is itemize output. See the description of --itemize-changes in the man page. > 3) In the following, > > 2007/09/13 17:43:10 [13688] IO error encountered -- skipping > file deletion > > for what transaction was the IO error encountered: Rsync should have printed a previous error message telling you that. If it didn't, that's a bug we can investigate. > 4) What are the consequences of the following skip? > > IO error encountered -- skipping file deletion > > How can I know determine whether or not the "skipping" had any > bad effects? The sole consequence is that rsync may not have deleted some destination files that it ordinarily would have. See the descriptions of --delete and --ignore-errors in the man page for more information. > Have you actually looked at the above links? Do they in fact > answer the question asked? They do not. True, it takes a bit of digging in the man page to find the parts I cited that answer #2 and #4. (I note that Stephen's RTM was in reply to your #1-4, not your (a)-(e).) But in the future, if you at least try to take the initiative to help yourself rather than demanding an answer on a silver platter, others will be more likely to take the initiative to help you. Matt -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: reducing file list bytes transferred
On 10/2/07, Peter Salameh <[EMAIL PROTECTED]> wrote: > Thanks for that. Doesn't the delta-transfer algorithm compare the files > on sender and receiver? Correct. > For the file list, we would only need compare the > new file list with the last one on the sender Unison ( http://www.cis.upenn.edu/~bcpierce/unison/ ) is a stateful two-way synchronizer that does essentially this by default; you can use Unison even for your one-way copy to get the performance benefit. Rsync is meant to be stateless, so if it were enhanced to reduce the amount of file list transferred, I think delta-transferring the file list would be more in keeping with its mission than saving a "last" file list. Matt -- To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
