Rsync options –update and –append-verify

2021-09-11 Thread hancooper via rsync


‐‐‐ Original Message ‐‐‐
On Sunday, September 12, 2021 5:10 AM, Kevin Korb  wrote:

> --inplace can prevent rsync from running you out of disk space when
> updating a large file. But you don't want to mix it with --update.
> Judging by your other message you think that --update means modiify
> files that are already on both ends. It doesn't. It only means that
> rsync is forbidden to change files on the target that have a newer
> timestamp than is on the source. If you don't need that then you don't
> want --update.

Correct, rereading things, with --update is used to transfer updated files at 
source.

--inplace should help with somewhat faster transfer, that's what I want to use 
it for.

What is the reason for not mixing --inplace and --update?


> Also, when in doubt, --dry-run.
>
> On 9/11/21 11:51 PM, hancooper wrote:
>
> > ‐‐‐ Original Message ‐‐‐
> > On Sunday, September 12, 2021 2:34 AM, hancooper via rsync 
> > rsync@lists.samba.org wrote:
> >
> > > ‐‐‐ Original Message ‐‐‐
> > > On Sunday, September 12, 2021 2:03 AM, Kevin Korb k...@sanitarium.net 
> > > wrote:
> > >
> > > > I thought I did elaborate. If it is a problem for you then maybe you
> > > > shouldn't be using --update. Or you should let rsync delete incomplete
> > > > files upon abort as it does by default.
> > >
> > > I am using the following
> > > rsync -av --inplace --update 
> > > --log-file=/media/hagbard/hc/snapshot/test1.log 
> > > /media/hagbard/hc1/snapshot/test1 /media/hagbard/hc/snapshot/
> > > I want that if I run the rsync command again, the files already 
> > > transferred are not resent, thus I used --update.
> >
> > Can I re-run without the --update option? Am I right to say that the files 
> > already successfully transferred will not be re-sent again using -av 
> > --inplace ?
> > What can I do for the files which have been sent but got rsync aborted 
> > during transfer?
> >
> > > > On 9/11/21 9:29 PM, hancooper wrote:
> > > >
> > > > > ‐‐‐ Original Message ‐‐‐
> > > > > On Saturday, September 11, 2021 11:20 PM, Kevin Korb via rsync 
> > > > > rsync@lists.samba.org wrote:
> > > > >
> > > > > > --archive is all you really need. I actually wish --archive was the
> > > > > > default because it is all most people need and with the exception of
> > > > > > writing to a FAT filesystem it is almost always needed.
> > > > > > --append is for very special cases and should only be used if you 
> > > > > > really
> > > > > > know you need it and why. --append-verify only exists because people
> > > > > > seem to think they need --append and get annoyed that it corrupts 
> > > > > > their
> > > > > > files.
> > > > > > --update is sometimes helpful however it interacts badly with 
> > > > > > --partial
> > > > > > and --inplace.
> > > > >
> > > > > That's right. Can you elaborate how --update interacts badly with 
> > > > > --partial
> > > > > and --inplace?
> > > > >
> > > > > > Since rsync doesn't set the timestamp of a file until it
> > > > > > is finished then any file left incomplete by an aborted rsync will 
> > > > > > have
> > > > > > the timestamp of the abort not the source file. Therefore it will be
> > > > > > newer than the source file and unless the source is updated rsync
> > > > > > --update will never complete the file.
> > > > >
> > > > > Is there a solution to this problem and should we consider it a bug?
> > > > > I am encountering this, and it's a real problem for me if files are
> > > > > not completed.
> > > > >
> > > > > > On 9/11/21 6:50 PM, hancooper via rsync wrote:
> > > > > >
> > > > > > > I am struggling to understand exactly what the rsync options 
> > > > > > > --update and --append-verify do.
> > > > > > > Doing info rsync gives
> > > > > > > -u, --update
> > > > > > > This forces rsync to skip any files which exist on the destina‐
> > > > > > > tion and have a modified time that is newer than the source
> > > > > > > file. (If an existing destination file has a modification time
> > > > > > > equal to the source file’s, it will be updated if the sizes are
> > > > > > > different.)
> > > > > > > --append-verify
> > > > > > > This works just like the --append option, but the existing data
> > > > > > > on the receiving side is included in the full-file checksum
> > > > > > > verification step, which will cause a file to be resent if the
> > > > > > > final verification step fails (rsync uses a normal, non-append‐
> > > > > > > ing --inplace transfer for the resend).
> > > > > > > I am using rsync to transfer directories recursively. There are 
> > > > > > > times where I have to stop the rsync transfer, and resume the 
> > > > > > > transfer a few hours or days later, without affecting the already 
> > > > > > > transferred files at destination.
> > > > > > > I also got some files that return errors by rsync, such as
> > > > > > > rsync: read errors mapping 
> > > > > > > "/media/hc1/a1-chaos/amvib/IACL-2017-07-19T00:00:00-2017-07-19T23:59:59.mseed":
> > > > > > 

Re: Rsync options –update and –append-verify

2021-09-11 Thread Kevin Korb via rsync
--inplace can prevent rsync from running you out of disk space when
updating a large file.  But you don't want to mix it with --update.
Judging by your other message you think that --update means modiify
files that are already on both ends.  It doesn't.  It only means that
rsync is forbidden  to change files on the target that have a newer
timestamp than is on the source.  If you don't need that then you don't
want --update.

Also, when in doubt, --dry-run.

On 9/11/21 11:51 PM, hancooper wrote:
> ‐‐‐ Original Message ‐‐‐
> On Sunday, September 12, 2021 2:34 AM, hancooper via rsync 
>  wrote:
> 
>> ‐‐‐ Original Message ‐‐‐
>> On Sunday, September 12, 2021 2:03 AM, Kevin Korb k...@sanitarium.net wrote:
>>
>>> I thought I did elaborate. If it is a problem for you then maybe you
>>> shouldn't be using --update. Or you should let rsync delete incomplete
>>> files upon abort as it does by default.
>>
>> I am using the following
>>
>> rsync -av --inplace --update --log-file=/media/hagbard/hc/snapshot/test1.log 
>> /media/hagbard/hc1/snapshot/test1 /media/hagbard/hc/snapshot/
>>
>> I want that if I run the rsync command again, the files already transferred 
>> are not resent, thus I used --update.
> 
> Can I re-run without the --update option?  Am I right to say that the files 
> already successfully transferred will not be re-sent again using -av 
> --inplace ?
> 
> What can I do for the files which have been sent but got rsync aborted during 
> transfer?
> 
> 
>>> On 9/11/21 9:29 PM, hancooper wrote:
>>>
 ‐‐‐ Original Message ‐‐‐
 On Saturday, September 11, 2021 11:20 PM, Kevin Korb via rsync 
 rsync@lists.samba.org wrote:

> --archive is all you really need. I actually wish --archive was the
> default because it is all most people need and with the exception of
> writing to a FAT filesystem it is almost always needed.
> --append is for very special cases and should only be used if you really
> know you need it and why. --append-verify only exists because people
> seem to think they need --append and get annoyed that it corrupts their
> files.
> --update is sometimes helpful however it interacts badly with --partial
> and --inplace.

 That's right. Can you elaborate how --update interacts badly with --partial
 and --inplace?

> Since rsync doesn't set the timestamp of a file until it
> is finished then any file left incomplete by an aborted rsync will have
> the timestamp of the abort not the source file. Therefore it will be
> newer than the source file and unless the source is updated rsync
> --update will never complete the file.

 Is there a solution to this problem and should we consider it a bug?
 I am encountering this, and it's a real problem for me if files are
 not completed.

> On 9/11/21 6:50 PM, hancooper via rsync wrote:
>
>> I am struggling to understand exactly what the rsync options --update 
>> and --append-verify do.
>> Doing info rsync gives
>> -u, --update
>> This forces rsync to skip any files which exist on the destina‐
>> tion and have a modified time that is newer than the source
>> file. (If an existing destination file has a modification time
>> equal to the source file’s, it will be updated if the sizes are
>> different.)
>> --append-verify
>> This works just like the --append option, but the existing data
>> on the receiving side is included in the full-file checksum
>> verification step, which will cause a file to be resent if the
>> final verification step fails (rsync uses a normal, non-append‐
>> ing --inplace transfer for the resend).
>> I am using rsync to transfer directories recursively. There are times 
>> where I have to stop the rsync transfer, and resume the transfer a few 
>> hours or days later, without affecting the already transferred files at 
>> destination.
>> I also got some files that return errors by rsync, such as
>> rsync: read errors mapping 
>> "/media/hc1/a1-chaos/amvib/IACL-2017-07-19T00:00:00-2017-07-19T23:59:59.mseed":
>>  Input/output error (5)
>> I would like to retry the transfer of these files, at a later time too, 
>> without affecting the files that had been transferred successfully.
>>>
>>> --
>>> ~-,..,-~'`^`'~-,..,-~'`^`'~-,..,-~'`^`'~-,..,-~'`^`'~-,..,
>>>
>>> Kevin Korb Phone: (407) 252-6853
>>>
>>> Systems Administrator Internet:
>>>
>>> FutureQuest, Inc. ke...@futurequest.net (work)
>>>
>>> Orlando, Florida k...@sanitarium.net (personal)
>>>
>>> Web page: https://sanitarium.net/
>>>
>>> PGP public key available on web site.
>>>
>>> ~-,..,-~'`^`'~-,..,-~'`^`'~-,..,-~'`^`'~-,..,-~'`^`'~-,..,
>>
>> --
>>
>> Please use reply-all for most replies to avoid omitting the mailing list.
>> To unsubscribe or change options: 
>> https://lists.samba.org/mailman/listinfo/rsync
>> Before posting, read: 

Rsync options –update and –append-verify

2021-09-11 Thread hancooper via rsync
‐‐‐ Original Message ‐‐‐
On Sunday, September 12, 2021 2:34 AM, hancooper via rsync 
 wrote:

> ‐‐‐ Original Message ‐‐‐
> On Sunday, September 12, 2021 2:03 AM, Kevin Korb k...@sanitarium.net wrote:
>
> > I thought I did elaborate. If it is a problem for you then maybe you
> > shouldn't be using --update. Or you should let rsync delete incomplete
> > files upon abort as it does by default.
>
> I am using the following
>
> rsync -av --inplace --update --log-file=/media/hagbard/hc/snapshot/test1.log 
> /media/hagbard/hc1/snapshot/test1 /media/hagbard/hc/snapshot/
>
> I want that if I run the rsync command again, the files already transferred 
> are not resent, thus I used --update.

Can I re-run without the --update option?  Am I right to say that the files 
already successfully transferred will not be re-sent again using -av --inplace ?

What can I do for the files which have been sent but got rsync aborted during 
transfer?


> > On 9/11/21 9:29 PM, hancooper wrote:
> >
> > > ‐‐‐ Original Message ‐‐‐
> > > On Saturday, September 11, 2021 11:20 PM, Kevin Korb via rsync 
> > > rsync@lists.samba.org wrote:
> > >
> > > > --archive is all you really need. I actually wish --archive was the
> > > > default because it is all most people need and with the exception of
> > > > writing to a FAT filesystem it is almost always needed.
> > > > --append is for very special cases and should only be used if you really
> > > > know you need it and why. --append-verify only exists because people
> > > > seem to think they need --append and get annoyed that it corrupts their
> > > > files.
> > > > --update is sometimes helpful however it interacts badly with --partial
> > > > and --inplace.
> > >
> > > That's right. Can you elaborate how --update interacts badly with 
> > > --partial
> > > and --inplace?
> > >
> > > > Since rsync doesn't set the timestamp of a file until it
> > > > is finished then any file left incomplete by an aborted rsync will have
> > > > the timestamp of the abort not the source file. Therefore it will be
> > > > newer than the source file and unless the source is updated rsync
> > > > --update will never complete the file.
> > >
> > > Is there a solution to this problem and should we consider it a bug?
> > > I am encountering this, and it's a real problem for me if files are
> > > not completed.
> > >
> > > > On 9/11/21 6:50 PM, hancooper via rsync wrote:
> > > >
> > > > > I am struggling to understand exactly what the rsync options --update 
> > > > > and --append-verify do.
> > > > > Doing info rsync gives
> > > > > -u, --update
> > > > > This forces rsync to skip any files which exist on the destina‐
> > > > > tion and have a modified time that is newer than the source
> > > > > file. (If an existing destination file has a modification time
> > > > > equal to the source file’s, it will be updated if the sizes are
> > > > > different.)
> > > > > --append-verify
> > > > > This works just like the --append option, but the existing data
> > > > > on the receiving side is included in the full-file checksum
> > > > > verification step, which will cause a file to be resent if the
> > > > > final verification step fails (rsync uses a normal, non-append‐
> > > > > ing --inplace transfer for the resend).
> > > > > I am using rsync to transfer directories recursively. There are times 
> > > > > where I have to stop the rsync transfer, and resume the transfer a 
> > > > > few hours or days later, without affecting the already transferred 
> > > > > files at destination.
> > > > > I also got some files that return errors by rsync, such as
> > > > > rsync: read errors mapping 
> > > > > "/media/hc1/a1-chaos/amvib/IACL-2017-07-19T00:00:00-2017-07-19T23:59:59.mseed":
> > > > >  Input/output error (5)
> > > > > I would like to retry the transfer of these files, at a later time 
> > > > > too, without affecting the files that had been transferred 
> > > > > successfully.
> >
> > --
> > ~-,..,-~'`^`'~-,..,-~'`^`'~-,..,-~'`^`'~-,..,-~'`^`'~-,..,
> >
> > Kevin Korb Phone: (407) 252-6853
> >
> > Systems Administrator Internet:
> >
> > FutureQuest, Inc. ke...@futurequest.net (work)
> >
> > Orlando, Florida k...@sanitarium.net (personal)
> >
> > Web page: https://sanitarium.net/
> >
> > PGP public key available on web site.
> >
> > ~-,..,-~'`^`'~-,..,-~'`^`'~-,..,-~'`^`'~-,..,-~'`^`'~-,..,
>
> --
>
> Please use reply-all for most replies to avoid omitting the mailing list.
> To unsubscribe or change options: 
> https://lists.samba.org/mailman/listinfo/rsync
> Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html



-- 
Please use reply-all for most replies to avoid omitting the mailing list.
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


Re: Rsync options –update and –append-verify

2021-09-11 Thread hancooper via rsync
‐‐‐ Original Message ‐‐‐
On Sunday, September 12, 2021 2:03 AM, Kevin Korb  wrote:

> I thought I did elaborate. If it is a problem for you then maybe you
> shouldn't be using --update. Or you should let rsync delete incomplete
> files upon abort as it does by default.

I am using the following

rsync -av --inplace --update --log-file=/media/hagbard/hc/snapshot/test1.log 
/media/hagbard/hc1/snapshot/test1 /media/hagbard/hc/snapshot/

I want that if I run the rsync command again, the files already transferred are 
not resent, thus I used --update.


>
> On 9/11/21 9:29 PM, hancooper wrote:
>
> > ‐‐‐ Original Message ‐‐‐
> > On Saturday, September 11, 2021 11:20 PM, Kevin Korb via rsync 
> > rsync@lists.samba.org wrote:
> >
> > > --archive is all you really need. I actually wish --archive was the
> > > default because it is all most people need and with the exception of
> > > writing to a FAT filesystem it is almost always needed.
> > > --append is for very special cases and should only be used if you really
> > > know you need it and why. --append-verify only exists because people
> > > seem to think they need --append and get annoyed that it corrupts their
> > > files.
> > > --update is sometimes helpful however it interacts badly with --partial
> > > and --inplace.
> >
> > That's right. Can you elaborate how --update interacts badly with --partial
> > and --inplace?
> >
> > > Since rsync doesn't set the timestamp of a file until it
> > > is finished then any file left incomplete by an aborted rsync will have
> > > the timestamp of the abort not the source file. Therefore it will be
> > > newer than the source file and unless the source is updated rsync
> > > --update will never complete the file.
> >
> > Is there a solution to this problem and should we consider it a bug?
> > I am encountering this, and it's a real problem for me if files are
> > not completed.
> >
> > > On 9/11/21 6:50 PM, hancooper via rsync wrote:
> > >
> > > > I am struggling to understand exactly what the rsync options --update 
> > > > and --append-verify do.
> > > > Doing info rsync gives
> > > > -u, --update
> > > > This forces rsync to skip any files which exist on the destina‐
> > > > tion and have a modified time that is newer than the source
> > > > file. (If an existing destination file has a modification time
> > > > equal to the source file’s, it will be updated if the sizes are
> > > > different.)
> > > > --append-verify
> > > > This works just like the --append option, but the existing data
> > > > on the receiving side is included in the full-file checksum
> > > > verification step, which will cause a file to be resent if the
> > > > final verification step fails (rsync uses a normal, non-append‐
> > > > ing --inplace transfer for the resend).
> > > > I am using rsync to transfer directories recursively. There are times 
> > > > where I have to stop the rsync transfer, and resume the transfer a few 
> > > > hours or days later, without affecting the already transferred files at 
> > > > destination.
> > > > I also got some files that return errors by rsync, such as
> > > > rsync: read errors mapping 
> > > > "/media/hc1/a1-chaos/amvib/IACL-2017-07-19T00:00:00-2017-07-19T23:59:59.mseed":
> > > >  Input/output error (5)
> > > > I would like to retry the transfer of these files, at a later time too, 
> > > > without affecting the files that had been transferred successfully.
>
> --
>
> ~-,._.,-~'`^`'~-,._.,-~'`^`'~-,._.,-~'`^`'~-,._.,-~'`^`'~-,._.,
> Kevin Korb Phone: (407) 252-6853
> Systems Administrator Internet:
> FutureQuest, Inc. ke...@futurequest.net (work)
> Orlando, Florida k...@sanitarium.net (personal)
> Web page: https://sanitarium.net/
> PGP public key available on web site.
> ~-,..,-~'`^`'~-,..,-~'`^`'~-,..,-~'`^`'~-,..,-~'`^`'~-,._.,



-- 
Please use reply-all for most replies to avoid omitting the mailing list.
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


Re: Rsync options –update and –append-verify

2021-09-11 Thread Kevin Korb via rsync
I thought I did elaborate.  If it is a problem for you then maybe you
shouldn't be using --update.  Or you should let rsync delete incomplete
files upon abort as it does by default.

On 9/11/21 9:29 PM, hancooper wrote:
> ‐‐‐ Original Message ‐‐‐
> On Saturday, September 11, 2021 11:20 PM, Kevin Korb via rsync 
>  wrote:
> 
>> --archive is all you really need. I actually wish --archive was the
>> default because it is all most people need and with the exception of
>> writing to a FAT filesystem it is almost always needed.
>>
>> --append is for very special cases and should only be used if you really
>> know you need it and why. --append-verify only exists because people
>> seem to think they need --append and get annoyed that it corrupts their
>> files.
>>
>> --update is sometimes helpful however it interacts badly with --partial
>> and --inplace.
> 
> That's right.  Can you elaborate how --update interacts badly with --partial
> and --inplace?
> 
>> Since rsync doesn't set the timestamp of a file until it
>> is finished then any file left incomplete by an aborted rsync will have
>> the timestamp of the abort not the source file. Therefore it will be
>> newer than the source file and unless the source is updated rsync
>> --update will never complete the file.
> 
> Is there a solution to this problem and should we consider it a bug?
> I am encountering this, and it's a real problem for me if files are
> not completed.
> 
>> On 9/11/21 6:50 PM, hancooper via rsync wrote:
>>
>>> I am struggling to understand exactly what the rsync options --update and 
>>> --append-verify do.
>>> Doing info rsync gives
>>> -u, --update
>>> This forces rsync to skip any files which exist on the destina‐
>>> tion and have a modified time that is newer than the source
>>> file. (If an existing destination file has a modification time
>>> equal to the source file’s, it will be updated if the sizes are
>>> different.)
>>> --append-verify
>>> This works just like the --append option, but the existing data
>>> on the receiving side is included in the full-file checksum
>>> verification step, which will cause a file to be resent if the
>>> final verification step fails (rsync uses a normal, non-append‐
>>> ing --inplace transfer for the resend).
>>> I am using rsync to transfer directories recursively. There are times where 
>>> I have to stop the rsync transfer, and resume the transfer a few hours or 
>>> days later, without affecting the already transferred files at destination.
>>> I also got some files that return errors by rsync, such as
>>> rsync: read errors mapping 
>>> "/media/hc1/a1-chaos/amvib/IACL-2017-07-19T00:00:00-2017-07-19T23:59:59.mseed":
>>>  Input/output error (5)
>>> I would like to retry the transfer of these files, at a later time too, 
>>> without affecting the files that had been transferred successfully.
>>

-- 
~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,
Kevin Korb  Phone:(407) 252-6853
Systems Administrator   Internet:
FutureQuest, Inc.   ke...@futurequest.net  (work)
Orlando, Floridak...@sanitarium.net (personal)
Web page:   https://sanitarium.net/
PGP public key available on web site.
~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,

-- 
Please use reply-all for most replies to avoid omitting the mailing list.
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


Rsync options –update and –append-verify

2021-09-11 Thread hancooper via rsync
‐‐‐ Original Message ‐‐‐
On Saturday, September 11, 2021 11:20 PM, Kevin Korb via rsync 
 wrote:

> --archive is all you really need. I actually wish --archive was the
> default because it is all most people need and with the exception of
> writing to a FAT filesystem it is almost always needed.
>
> --append is for very special cases and should only be used if you really
> know you need it and why. --append-verify only exists because people
> seem to think they need --append and get annoyed that it corrupts their
> files.
>
> --update is sometimes helpful however it interacts badly with --partial
> and --inplace.

That's right.  Can you elaborate how --update interacts badly with --partial
and --inplace?

> Since rsync doesn't set the timestamp of a file until it
> is finished then any file left incomplete by an aborted rsync will have
> the timestamp of the abort not the source file. Therefore it will be
> newer than the source file and unless the source is updated rsync
> --update will never complete the file.

Is there a solution to this problem and should we consider it a bug?
I am encountering this, and it's a real problem for me if files are
not completed.

> On 9/11/21 6:50 PM, hancooper via rsync wrote:
>
> > I am struggling to understand exactly what the rsync options --update and 
> > --append-verify do.
> > Doing info rsync gives
> > -u, --update
> > This forces rsync to skip any files which exist on the destina‐
> > tion and have a modified time that is newer than the source
> > file. (If an existing destination file has a modification time
> > equal to the source file’s, it will be updated if the sizes are
> > different.)
> > --append-verify
> > This works just like the --append option, but the existing data
> > on the receiving side is included in the full-file checksum
> > verification step, which will cause a file to be resent if the
> > final verification step fails (rsync uses a normal, non-append‐
> > ing --inplace transfer for the resend).
> > I am using rsync to transfer directories recursively. There are times where 
> > I have to stop the rsync transfer, and resume the transfer a few hours or 
> > days later, without affecting the already transferred files at destination.
> > I also got some files that return errors by rsync, such as
> > rsync: read errors mapping 
> > "/media/hc1/a1-chaos/amvib/IACL-2017-07-19T00:00:00-2017-07-19T23:59:59.mseed":
> >  Input/output error (5)
> > I would like to retry the transfer of these files, at a later time too, 
> > without affecting the files that had been transferred successfully.
>


-- 
Please use reply-all for most replies to avoid omitting the mailing list.
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


Re: Rsync options –update and –append-verify

2021-09-11 Thread Kevin Korb via rsync
--archive is all you really need.  I actually wish --archive was the
default because it is all most people need and with the exception of
writing to a FAT filesystem it is almost always needed.

--append is for very special cases and should only be used if you really
know you need it and why.  --append-verify only exists because people
seem to think they need --append and get annoyed that it corrupts their
files.

--update is sometimes helpful however it interacts badly with --partial
and --inplace.  Since rsync doesn't set the timestamp of a file until it
is finished then any file left incomplete by an aborted rsync will have
the timestamp of the abort not the source file.  Therefore it will be
newer than the source file and unless the source is updated rsync
--update will never complete the file.

On 9/11/21 6:50 PM, hancooper via rsync wrote:
> I am struggling to understand exactly what the rsync options --update and 
> --append-verify do.
> 
> Doing info rsync gives
> 
> -u, --update
>  This forces rsync to skip any files which exist on the destina‐
>  tion and have a modified time that is  newer  than  the  source
>  file.  (If an existing destination file has a modification time
>  equal to the source file’s, it will be updated if the sizes are
>  different.)
> 
> --append-verify
> This works just like the --append option, but the existing data
> on  the  receiving  side  is included in the full-file checksum
> verification step, which will cause a file to be resent if  the
> final verification step fails (rsync uses a normal, non-append‐
> ing --inplace transfer for the resend).
> 
> I am using rsync to transfer directories recursively. There are times where I 
> have to stop the rsync transfer, and resume the transfer a few hours or days 
> later, without affecting the already transferred files at destination.
> 
> I also got some files that return errors by rsync, such as
> 
> rsync: read errors mapping 
> "/media/hc1/a1-chaos/amvib/IACL-2017-07-19T00:00:00-2017-07-19T23:59:59.mseed":
>  Input/output error (5)
> 
> I would like to retry the transfer of these files, at a later time too, 
> without affecting the files that had been transferred successfully.
> 

-- 
~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,
Kevin Korb  Phone:(407) 252-6853
Systems Administrator   Internet:
FutureQuest, Inc.   ke...@futurequest.net  (work)
Orlando, Floridak...@sanitarium.net (personal)
Web page:   https://sanitarium.net/
PGP public key available on web site.
~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,

-- 
Please use reply-all for most replies to avoid omitting the mailing list.
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html


Rsync options –update and –append-verify

2021-09-11 Thread hancooper via rsync
I am struggling to understand exactly what the rsync options --update and 
--append-verify do.

Doing info rsync gives

-u, --update
 This forces rsync to skip any files which exist on the destina‐
 tion and have a modified time that is  newer  than  the  source
 file.  (If an existing destination file has a modification time
 equal to the source file’s, it will be updated if the sizes are
 different.)

--append-verify
This works just like the --append option, but the existing data
on  the  receiving  side  is included in the full-file checksum
verification step, which will cause a file to be resent if  the
final verification step fails (rsync uses a normal, non-append‐
ing --inplace transfer for the resend).

I am using rsync to transfer directories recursively. There are times where I 
have to stop the rsync transfer, and resume the transfer a few hours or days 
later, without affecting the already transferred files at destination.

I also got some files that return errors by rsync, such as

rsync: read errors mapping 
"/media/hc1/a1-chaos/amvib/IACL-2017-07-19T00:00:00-2017-07-19T23:59:59.mseed": 
Input/output error (5)

I would like to retry the transfer of these files, at a later time too, without 
affecting the files that had been transferred successfully.

-- 
Please use reply-all for most replies to avoid omitting the mailing list.
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html