Rsync options –update and –append-verify
‐‐‐ Original Message ‐‐‐ On Sunday, September 12, 2021 5:10 AM, Kevin Korb wrote: > --inplace can prevent rsync from running you out of disk space when > updating a large file. But you don't want to mix it with --update. > Judging by your other message you think that --update means modiify > files that are already on both ends. It doesn't. It only means that > rsync is forbidden to change files on the target that have a newer > timestamp than is on the source. If you don't need that then you don't > want --update. Correct, rereading things, with --update is used to transfer updated files at source. --inplace should help with somewhat faster transfer, that's what I want to use it for. What is the reason for not mixing --inplace and --update? > Also, when in doubt, --dry-run. > > On 9/11/21 11:51 PM, hancooper wrote: > > > ‐‐‐ Original Message ‐‐‐ > > On Sunday, September 12, 2021 2:34 AM, hancooper via rsync > > rsync@lists.samba.org wrote: > > > > > ‐‐‐ Original Message ‐‐‐ > > > On Sunday, September 12, 2021 2:03 AM, Kevin Korb k...@sanitarium.net > > > wrote: > > > > > > > I thought I did elaborate. If it is a problem for you then maybe you > > > > shouldn't be using --update. Or you should let rsync delete incomplete > > > > files upon abort as it does by default. > > > > > > I am using the following > > > rsync -av --inplace --update > > > --log-file=/media/hagbard/hc/snapshot/test1.log > > > /media/hagbard/hc1/snapshot/test1 /media/hagbard/hc/snapshot/ > > > I want that if I run the rsync command again, the files already > > > transferred are not resent, thus I used --update. > > > > Can I re-run without the --update option? Am I right to say that the files > > already successfully transferred will not be re-sent again using -av > > --inplace ? > > What can I do for the files which have been sent but got rsync aborted > > during transfer? > > > > > > On 9/11/21 9:29 PM, hancooper wrote: > > > > > > > > > ‐‐‐ Original Message ‐‐‐ > > > > > On Saturday, September 11, 2021 11:20 PM, Kevin Korb via rsync > > > > > rsync@lists.samba.org wrote: > > > > > > > > > > > --archive is all you really need. I actually wish --archive was the > > > > > > default because it is all most people need and with the exception of > > > > > > writing to a FAT filesystem it is almost always needed. > > > > > > --append is for very special cases and should only be used if you > > > > > > really > > > > > > know you need it and why. --append-verify only exists because people > > > > > > seem to think they need --append and get annoyed that it corrupts > > > > > > their > > > > > > files. > > > > > > --update is sometimes helpful however it interacts badly with > > > > > > --partial > > > > > > and --inplace. > > > > > > > > > > That's right. Can you elaborate how --update interacts badly with > > > > > --partial > > > > > and --inplace? > > > > > > > > > > > Since rsync doesn't set the timestamp of a file until it > > > > > > is finished then any file left incomplete by an aborted rsync will > > > > > > have > > > > > > the timestamp of the abort not the source file. Therefore it will be > > > > > > newer than the source file and unless the source is updated rsync > > > > > > --update will never complete the file. > > > > > > > > > > Is there a solution to this problem and should we consider it a bug? > > > > > I am encountering this, and it's a real problem for me if files are > > > > > not completed. > > > > > > > > > > > On 9/11/21 6:50 PM, hancooper via rsync wrote: > > > > > > > > > > > > > I am struggling to understand exactly what the rsync options > > > > > > > --update and --append-verify do. > > > > > > > Doing info rsync gives > > > > > > > -u, --update > > > > > > > This forces rsync to skip any files which exist on the destina‐ > > > > > > > tion and have a modified time that is newer than the source > > > > > > > file. (If an existing destination file has a modification time > > > > > > > equal to the source file’s, it will be updated if the sizes are > > > > > > > different.) > > > > > > > --append-verify > > > > > > > This works just like the --append option, but the existing data > > > > > > > on the receiving side is included in the full-file checksum > > > > > > > verification step, which will cause a file to be resent if the > > > > > > > final verification step fails (rsync uses a normal, non-append‐ > > > > > > > ing --inplace transfer for the resend). > > > > > > > I am using rsync to transfer directories recursively. There are > > > > > > > times where I have to stop the rsync transfer, and resume the > > > > > > > transfer a few hours or days later, without affecting the already > > > > > > > transferred files at destination. > > > > > > > I also got some files that return errors by rsync, such as > > > > > > > rsync: read errors mapping > > > > > > > "/media/hc1/a1-chaos/amvib/IACL-2017-07-19T00:00:00-2017-07-19T23:59:59.mseed": > > > > > >
Re: Rsync options –update and –append-verify
--inplace can prevent rsync from running you out of disk space when updating a large file. But you don't want to mix it with --update. Judging by your other message you think that --update means modiify files that are already on both ends. It doesn't. It only means that rsync is forbidden to change files on the target that have a newer timestamp than is on the source. If you don't need that then you don't want --update. Also, when in doubt, --dry-run. On 9/11/21 11:51 PM, hancooper wrote: > ‐‐‐ Original Message ‐‐‐ > On Sunday, September 12, 2021 2:34 AM, hancooper via rsync > wrote: > >> ‐‐‐ Original Message ‐‐‐ >> On Sunday, September 12, 2021 2:03 AM, Kevin Korb k...@sanitarium.net wrote: >> >>> I thought I did elaborate. If it is a problem for you then maybe you >>> shouldn't be using --update. Or you should let rsync delete incomplete >>> files upon abort as it does by default. >> >> I am using the following >> >> rsync -av --inplace --update --log-file=/media/hagbard/hc/snapshot/test1.log >> /media/hagbard/hc1/snapshot/test1 /media/hagbard/hc/snapshot/ >> >> I want that if I run the rsync command again, the files already transferred >> are not resent, thus I used --update. > > Can I re-run without the --update option? Am I right to say that the files > already successfully transferred will not be re-sent again using -av > --inplace ? > > What can I do for the files which have been sent but got rsync aborted during > transfer? > > >>> On 9/11/21 9:29 PM, hancooper wrote: >>> ‐‐‐ Original Message ‐‐‐ On Saturday, September 11, 2021 11:20 PM, Kevin Korb via rsync rsync@lists.samba.org wrote: > --archive is all you really need. I actually wish --archive was the > default because it is all most people need and with the exception of > writing to a FAT filesystem it is almost always needed. > --append is for very special cases and should only be used if you really > know you need it and why. --append-verify only exists because people > seem to think they need --append and get annoyed that it corrupts their > files. > --update is sometimes helpful however it interacts badly with --partial > and --inplace. That's right. Can you elaborate how --update interacts badly with --partial and --inplace? > Since rsync doesn't set the timestamp of a file until it > is finished then any file left incomplete by an aborted rsync will have > the timestamp of the abort not the source file. Therefore it will be > newer than the source file and unless the source is updated rsync > --update will never complete the file. Is there a solution to this problem and should we consider it a bug? I am encountering this, and it's a real problem for me if files are not completed. > On 9/11/21 6:50 PM, hancooper via rsync wrote: > >> I am struggling to understand exactly what the rsync options --update >> and --append-verify do. >> Doing info rsync gives >> -u, --update >> This forces rsync to skip any files which exist on the destina‐ >> tion and have a modified time that is newer than the source >> file. (If an existing destination file has a modification time >> equal to the source file’s, it will be updated if the sizes are >> different.) >> --append-verify >> This works just like the --append option, but the existing data >> on the receiving side is included in the full-file checksum >> verification step, which will cause a file to be resent if the >> final verification step fails (rsync uses a normal, non-append‐ >> ing --inplace transfer for the resend). >> I am using rsync to transfer directories recursively. There are times >> where I have to stop the rsync transfer, and resume the transfer a few >> hours or days later, without affecting the already transferred files at >> destination. >> I also got some files that return errors by rsync, such as >> rsync: read errors mapping >> "/media/hc1/a1-chaos/amvib/IACL-2017-07-19T00:00:00-2017-07-19T23:59:59.mseed": >> Input/output error (5) >> I would like to retry the transfer of these files, at a later time too, >> without affecting the files that had been transferred successfully. >>> >>> -- >>> ~-,..,-~'`^`'~-,..,-~'`^`'~-,..,-~'`^`'~-,..,-~'`^`'~-,.., >>> >>> Kevin Korb Phone: (407) 252-6853 >>> >>> Systems Administrator Internet: >>> >>> FutureQuest, Inc. ke...@futurequest.net (work) >>> >>> Orlando, Florida k...@sanitarium.net (personal) >>> >>> Web page: https://sanitarium.net/ >>> >>> PGP public key available on web site. >>> >>> ~-,..,-~'`^`'~-,..,-~'`^`'~-,..,-~'`^`'~-,..,-~'`^`'~-,.., >> >> -- >> >> Please use reply-all for most replies to avoid omitting the mailing list. >> To unsubscribe or change options: >> https://lists.samba.org/mailman/listinfo/rsync >> Before posting, read:
Rsync options –update and –append-verify
‐‐‐ Original Message ‐‐‐ On Sunday, September 12, 2021 2:34 AM, hancooper via rsync wrote: > ‐‐‐ Original Message ‐‐‐ > On Sunday, September 12, 2021 2:03 AM, Kevin Korb k...@sanitarium.net wrote: > > > I thought I did elaborate. If it is a problem for you then maybe you > > shouldn't be using --update. Or you should let rsync delete incomplete > > files upon abort as it does by default. > > I am using the following > > rsync -av --inplace --update --log-file=/media/hagbard/hc/snapshot/test1.log > /media/hagbard/hc1/snapshot/test1 /media/hagbard/hc/snapshot/ > > I want that if I run the rsync command again, the files already transferred > are not resent, thus I used --update. Can I re-run without the --update option? Am I right to say that the files already successfully transferred will not be re-sent again using -av --inplace ? What can I do for the files which have been sent but got rsync aborted during transfer? > > On 9/11/21 9:29 PM, hancooper wrote: > > > > > ‐‐‐ Original Message ‐‐‐ > > > On Saturday, September 11, 2021 11:20 PM, Kevin Korb via rsync > > > rsync@lists.samba.org wrote: > > > > > > > --archive is all you really need. I actually wish --archive was the > > > > default because it is all most people need and with the exception of > > > > writing to a FAT filesystem it is almost always needed. > > > > --append is for very special cases and should only be used if you really > > > > know you need it and why. --append-verify only exists because people > > > > seem to think they need --append and get annoyed that it corrupts their > > > > files. > > > > --update is sometimes helpful however it interacts badly with --partial > > > > and --inplace. > > > > > > That's right. Can you elaborate how --update interacts badly with > > > --partial > > > and --inplace? > > > > > > > Since rsync doesn't set the timestamp of a file until it > > > > is finished then any file left incomplete by an aborted rsync will have > > > > the timestamp of the abort not the source file. Therefore it will be > > > > newer than the source file and unless the source is updated rsync > > > > --update will never complete the file. > > > > > > Is there a solution to this problem and should we consider it a bug? > > > I am encountering this, and it's a real problem for me if files are > > > not completed. > > > > > > > On 9/11/21 6:50 PM, hancooper via rsync wrote: > > > > > > > > > I am struggling to understand exactly what the rsync options --update > > > > > and --append-verify do. > > > > > Doing info rsync gives > > > > > -u, --update > > > > > This forces rsync to skip any files which exist on the destina‐ > > > > > tion and have a modified time that is newer than the source > > > > > file. (If an existing destination file has a modification time > > > > > equal to the source file’s, it will be updated if the sizes are > > > > > different.) > > > > > --append-verify > > > > > This works just like the --append option, but the existing data > > > > > on the receiving side is included in the full-file checksum > > > > > verification step, which will cause a file to be resent if the > > > > > final verification step fails (rsync uses a normal, non-append‐ > > > > > ing --inplace transfer for the resend). > > > > > I am using rsync to transfer directories recursively. There are times > > > > > where I have to stop the rsync transfer, and resume the transfer a > > > > > few hours or days later, without affecting the already transferred > > > > > files at destination. > > > > > I also got some files that return errors by rsync, such as > > > > > rsync: read errors mapping > > > > > "/media/hc1/a1-chaos/amvib/IACL-2017-07-19T00:00:00-2017-07-19T23:59:59.mseed": > > > > > Input/output error (5) > > > > > I would like to retry the transfer of these files, at a later time > > > > > too, without affecting the files that had been transferred > > > > > successfully. > > > > -- > > ~-,..,-~'`^`'~-,..,-~'`^`'~-,..,-~'`^`'~-,..,-~'`^`'~-,.., > > > > Kevin Korb Phone: (407) 252-6853 > > > > Systems Administrator Internet: > > > > FutureQuest, Inc. ke...@futurequest.net (work) > > > > Orlando, Florida k...@sanitarium.net (personal) > > > > Web page: https://sanitarium.net/ > > > > PGP public key available on web site. > > > > ~-,..,-~'`^`'~-,..,-~'`^`'~-,..,-~'`^`'~-,..,-~'`^`'~-,.., > > -- > > Please use reply-all for most replies to avoid omitting the mailing list. > To unsubscribe or change options: > https://lists.samba.org/mailman/listinfo/rsync > Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: Rsync options –update and –append-verify
‐‐‐ Original Message ‐‐‐ On Sunday, September 12, 2021 2:03 AM, Kevin Korb wrote: > I thought I did elaborate. If it is a problem for you then maybe you > shouldn't be using --update. Or you should let rsync delete incomplete > files upon abort as it does by default. I am using the following rsync -av --inplace --update --log-file=/media/hagbard/hc/snapshot/test1.log /media/hagbard/hc1/snapshot/test1 /media/hagbard/hc/snapshot/ I want that if I run the rsync command again, the files already transferred are not resent, thus I used --update. > > On 9/11/21 9:29 PM, hancooper wrote: > > > ‐‐‐ Original Message ‐‐‐ > > On Saturday, September 11, 2021 11:20 PM, Kevin Korb via rsync > > rsync@lists.samba.org wrote: > > > > > --archive is all you really need. I actually wish --archive was the > > > default because it is all most people need and with the exception of > > > writing to a FAT filesystem it is almost always needed. > > > --append is for very special cases and should only be used if you really > > > know you need it and why. --append-verify only exists because people > > > seem to think they need --append and get annoyed that it corrupts their > > > files. > > > --update is sometimes helpful however it interacts badly with --partial > > > and --inplace. > > > > That's right. Can you elaborate how --update interacts badly with --partial > > and --inplace? > > > > > Since rsync doesn't set the timestamp of a file until it > > > is finished then any file left incomplete by an aborted rsync will have > > > the timestamp of the abort not the source file. Therefore it will be > > > newer than the source file and unless the source is updated rsync > > > --update will never complete the file. > > > > Is there a solution to this problem and should we consider it a bug? > > I am encountering this, and it's a real problem for me if files are > > not completed. > > > > > On 9/11/21 6:50 PM, hancooper via rsync wrote: > > > > > > > I am struggling to understand exactly what the rsync options --update > > > > and --append-verify do. > > > > Doing info rsync gives > > > > -u, --update > > > > This forces rsync to skip any files which exist on the destina‐ > > > > tion and have a modified time that is newer than the source > > > > file. (If an existing destination file has a modification time > > > > equal to the source file’s, it will be updated if the sizes are > > > > different.) > > > > --append-verify > > > > This works just like the --append option, but the existing data > > > > on the receiving side is included in the full-file checksum > > > > verification step, which will cause a file to be resent if the > > > > final verification step fails (rsync uses a normal, non-append‐ > > > > ing --inplace transfer for the resend). > > > > I am using rsync to transfer directories recursively. There are times > > > > where I have to stop the rsync transfer, and resume the transfer a few > > > > hours or days later, without affecting the already transferred files at > > > > destination. > > > > I also got some files that return errors by rsync, such as > > > > rsync: read errors mapping > > > > "/media/hc1/a1-chaos/amvib/IACL-2017-07-19T00:00:00-2017-07-19T23:59:59.mseed": > > > > Input/output error (5) > > > > I would like to retry the transfer of these files, at a later time too, > > > > without affecting the files that had been transferred successfully. > > -- > > ~-,._.,-~'`^`'~-,._.,-~'`^`'~-,._.,-~'`^`'~-,._.,-~'`^`'~-,._., > Kevin Korb Phone: (407) 252-6853 > Systems Administrator Internet: > FutureQuest, Inc. ke...@futurequest.net (work) > Orlando, Florida k...@sanitarium.net (personal) > Web page: https://sanitarium.net/ > PGP public key available on web site. > ~-,..,-~'`^`'~-,..,-~'`^`'~-,..,-~'`^`'~-,..,-~'`^`'~-,._., -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: Rsync options –update and –append-verify
I thought I did elaborate. If it is a problem for you then maybe you shouldn't be using --update. Or you should let rsync delete incomplete files upon abort as it does by default. On 9/11/21 9:29 PM, hancooper wrote: > ‐‐‐ Original Message ‐‐‐ > On Saturday, September 11, 2021 11:20 PM, Kevin Korb via rsync > wrote: > >> --archive is all you really need. I actually wish --archive was the >> default because it is all most people need and with the exception of >> writing to a FAT filesystem it is almost always needed. >> >> --append is for very special cases and should only be used if you really >> know you need it and why. --append-verify only exists because people >> seem to think they need --append and get annoyed that it corrupts their >> files. >> >> --update is sometimes helpful however it interacts badly with --partial >> and --inplace. > > That's right. Can you elaborate how --update interacts badly with --partial > and --inplace? > >> Since rsync doesn't set the timestamp of a file until it >> is finished then any file left incomplete by an aborted rsync will have >> the timestamp of the abort not the source file. Therefore it will be >> newer than the source file and unless the source is updated rsync >> --update will never complete the file. > > Is there a solution to this problem and should we consider it a bug? > I am encountering this, and it's a real problem for me if files are > not completed. > >> On 9/11/21 6:50 PM, hancooper via rsync wrote: >> >>> I am struggling to understand exactly what the rsync options --update and >>> --append-verify do. >>> Doing info rsync gives >>> -u, --update >>> This forces rsync to skip any files which exist on the destina‐ >>> tion and have a modified time that is newer than the source >>> file. (If an existing destination file has a modification time >>> equal to the source file’s, it will be updated if the sizes are >>> different.) >>> --append-verify >>> This works just like the --append option, but the existing data >>> on the receiving side is included in the full-file checksum >>> verification step, which will cause a file to be resent if the >>> final verification step fails (rsync uses a normal, non-append‐ >>> ing --inplace transfer for the resend). >>> I am using rsync to transfer directories recursively. There are times where >>> I have to stop the rsync transfer, and resume the transfer a few hours or >>> days later, without affecting the already transferred files at destination. >>> I also got some files that return errors by rsync, such as >>> rsync: read errors mapping >>> "/media/hc1/a1-chaos/amvib/IACL-2017-07-19T00:00:00-2017-07-19T23:59:59.mseed": >>> Input/output error (5) >>> I would like to retry the transfer of these files, at a later time too, >>> without affecting the files that had been transferred successfully. >> -- ~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._., Kevin Korb Phone:(407) 252-6853 Systems Administrator Internet: FutureQuest, Inc. ke...@futurequest.net (work) Orlando, Floridak...@sanitarium.net (personal) Web page: https://sanitarium.net/ PGP public key available on web site. ~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._., -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Rsync options –update and –append-verify
‐‐‐ Original Message ‐‐‐ On Saturday, September 11, 2021 11:20 PM, Kevin Korb via rsync wrote: > --archive is all you really need. I actually wish --archive was the > default because it is all most people need and with the exception of > writing to a FAT filesystem it is almost always needed. > > --append is for very special cases and should only be used if you really > know you need it and why. --append-verify only exists because people > seem to think they need --append and get annoyed that it corrupts their > files. > > --update is sometimes helpful however it interacts badly with --partial > and --inplace. That's right. Can you elaborate how --update interacts badly with --partial and --inplace? > Since rsync doesn't set the timestamp of a file until it > is finished then any file left incomplete by an aborted rsync will have > the timestamp of the abort not the source file. Therefore it will be > newer than the source file and unless the source is updated rsync > --update will never complete the file. Is there a solution to this problem and should we consider it a bug? I am encountering this, and it's a real problem for me if files are not completed. > On 9/11/21 6:50 PM, hancooper via rsync wrote: > > > I am struggling to understand exactly what the rsync options --update and > > --append-verify do. > > Doing info rsync gives > > -u, --update > > This forces rsync to skip any files which exist on the destina‐ > > tion and have a modified time that is newer than the source > > file. (If an existing destination file has a modification time > > equal to the source file’s, it will be updated if the sizes are > > different.) > > --append-verify > > This works just like the --append option, but the existing data > > on the receiving side is included in the full-file checksum > > verification step, which will cause a file to be resent if the > > final verification step fails (rsync uses a normal, non-append‐ > > ing --inplace transfer for the resend). > > I am using rsync to transfer directories recursively. There are times where > > I have to stop the rsync transfer, and resume the transfer a few hours or > > days later, without affecting the already transferred files at destination. > > I also got some files that return errors by rsync, such as > > rsync: read errors mapping > > "/media/hc1/a1-chaos/amvib/IACL-2017-07-19T00:00:00-2017-07-19T23:59:59.mseed": > > Input/output error (5) > > I would like to retry the transfer of these files, at a later time too, > > without affecting the files that had been transferred successfully. > -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Re: Rsync options –update and –append-verify
--archive is all you really need. I actually wish --archive was the default because it is all most people need and with the exception of writing to a FAT filesystem it is almost always needed. --append is for very special cases and should only be used if you really know you need it and why. --append-verify only exists because people seem to think they need --append and get annoyed that it corrupts their files. --update is sometimes helpful however it interacts badly with --partial and --inplace. Since rsync doesn't set the timestamp of a file until it is finished then any file left incomplete by an aborted rsync will have the timestamp of the abort not the source file. Therefore it will be newer than the source file and unless the source is updated rsync --update will never complete the file. On 9/11/21 6:50 PM, hancooper via rsync wrote: > I am struggling to understand exactly what the rsync options --update and > --append-verify do. > > Doing info rsync gives > > -u, --update > This forces rsync to skip any files which exist on the destina‐ > tion and have a modified time that is newer than the source > file. (If an existing destination file has a modification time > equal to the source file’s, it will be updated if the sizes are > different.) > > --append-verify > This works just like the --append option, but the existing data > on the receiving side is included in the full-file checksum > verification step, which will cause a file to be resent if the > final verification step fails (rsync uses a normal, non-append‐ > ing --inplace transfer for the resend). > > I am using rsync to transfer directories recursively. There are times where I > have to stop the rsync transfer, and resume the transfer a few hours or days > later, without affecting the already transferred files at destination. > > I also got some files that return errors by rsync, such as > > rsync: read errors mapping > "/media/hc1/a1-chaos/amvib/IACL-2017-07-19T00:00:00-2017-07-19T23:59:59.mseed": > Input/output error (5) > > I would like to retry the transfer of these files, at a later time too, > without affecting the files that had been transferred successfully. > -- ~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._., Kevin Korb Phone:(407) 252-6853 Systems Administrator Internet: FutureQuest, Inc. ke...@futurequest.net (work) Orlando, Floridak...@sanitarium.net (personal) Web page: https://sanitarium.net/ PGP public key available on web site. ~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._., -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
Rsync options –update and –append-verify
I am struggling to understand exactly what the rsync options --update and --append-verify do. Doing info rsync gives -u, --update This forces rsync to skip any files which exist on the destina‐ tion and have a modified time that is newer than the source file. (If an existing destination file has a modification time equal to the source file’s, it will be updated if the sizes are different.) --append-verify This works just like the --append option, but the existing data on the receiving side is included in the full-file checksum verification step, which will cause a file to be resent if the final verification step fails (rsync uses a normal, non-append‐ ing --inplace transfer for the resend). I am using rsync to transfer directories recursively. There are times where I have to stop the rsync transfer, and resume the transfer a few hours or days later, without affecting the already transferred files at destination. I also got some files that return errors by rsync, such as rsync: read errors mapping "/media/hc1/a1-chaos/amvib/IACL-2017-07-19T00:00:00-2017-07-19T23:59:59.mseed": Input/output error (5) I would like to retry the transfer of these files, at a later time too, without affecting the files that had been transferred successfully. -- Please use reply-all for most replies to avoid omitting the mailing list. To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html