Re: [External] Re: ctrl -c while executing --progress --size-only --partial results in unhidden but incomplete file

2023-06-08 Thread Lacey, Nathan via rsync 
Thank you Kevin!
--partial  --partial-dir {hidden relative_sub-dir}  is perfect!
Interrupted files stay there until they complete.

Thanks

From: Kevin Korb 
Sent: Wednesday, June 7, 2023 4:26 PM
To: Lacey, Nathan ; rsync@lists.samba.org 

Subject: Re: [External] Re: ctrl -c while executing --progress --size-only 
--partial results in unhidden but incomplete file

Rsync has no memory of what other instances of rsync have done in the
past.  An existing file with a different name is of no interest to it
unless --delete in which case it would be deleted.  Maybe what you
really want is --partial-dir?

On 6/7/23 16:17, Lacey, Nathan wrote:
> I'm suggesting a partial file that isn't hidden is worse.
> Because any other app looking at the file would think the transfer is
> complete and try to use it.
>
> It doesn't need to be a orphaned file,  when called next time with
> --partial rsync could re-opened the incomplete/hidden file, than it
> could  continue putting more bytes to the file until it was really
> completed.
>
> When running in --partial mode, the filename wouldn't have to be random,
> instead it could be based on the source ip address, so that rsync knows
> what file to continue processing on.
> 
> *From:* rsync  on behalf of Kevin Korb
> via rsync 
> *Sent:* Wednesday, June 7, 2023 3:26 PM
> *To:* rsync@lists.samba.org 
> *Subject:* [External] Re: ctrl -c while executing --progress --size-only
> --partial results in unhidden but incomplete file
> [You don't often get email from rsync@lists.samba.org. Learn why this is
> important at https://aka.ms/LearnAboutSenderIdentification
> <https://aka.ms/LearnAboutSenderIdentification> ]
>
> This message is from an EXTERNAL SENDER - be CAUTIOUS of links and
> attachments. THINK BEFORE YOU CLICK.
> 
>
>
> That is what --partial does.  It keeps the partial file.  If it kept the
> temporary file with the random file name that would just be a useless
> orphaned file.
>
> On 6/7/23 15:02, Lacey, Nathan via rsync wrote:
>> This is a clone from 
>> https://usg02.safelinks.protection.office365.us/?url=https%3A%2F%2Fgithub.com%2FWayneD%2Frsync%2Fissues%2F484=05%7C01%7Cnathan.lacey%40afs.com%7C06c4e9ad19584dd4615308db679575a1%7Ca01f407a85cb4a1698bbf28e6384bd28%7C0%7C0%7C638217663866905817%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C=l8oz6qys%2Fdeo%2FktQiLJCDwMaOTaz1gpjkjHbh0hH8QQ%3D=0
> <https://usg02.safelinks.protection.office365.us/?url=https%3A%2F%2Fgithub.com%2FWayneD%2Frsync%2Fissues%2F484=05%7C01%7Cnathan.lacey%40afs.com%7C06c4e9ad19584dd4615308db679575a1%7Ca01f407a85cb4a1698bbf28e6384bd28%7C0%7C0%7C638217663866905817%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C=l8oz6qys%2Fdeo%2FktQiLJCDwMaOTaz1gpjkjHbh0hH8QQ%3D=0>
>> <https://usg02.safelinks.protection.office365.us/?url=https%3A%2F%2Fgithub.com%2FWayneD%2Frsync%2Fissues%2F484=05%7C01%7Cnathan.lacey%40afs.com%7C06c4e9ad19584dd4615308db679575a1%7Ca01f407a85cb4a1698bbf28e6384bd28%7C0%7C0%7C638217663866905817%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C=l8oz6qys%2Fdeo%2FktQiLJCDwMaOTaz1gpjkjHbh0hH8QQ%3D=0
> <https://usg02.safelinks.protection.office365.us/?url=https%3A%2F%2Fgithub.com%2FWayneD%2Frsync%2Fissues%2F484=05%7C01%7Cnathan.lacey%40afs.com%7C06c4e9ad19584dd4615308db679575a1%7Ca01f407a85cb4a1698bbf28e6384bd28%7C0%7C0%7C638217663866905817%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C=l8oz6qys%2Fdeo%2FktQiLJCDwMaOTaz1gpjkjHbh0hH8QQ%3D=0>>
>>
>> run rsync with --progress --size-only --partial (version 3.1.2) also
>> tested/built current master ( 3.3.0pre1-5-g6f3c5ecc )
>> everything works fine unless I interrupt a transfer ( ctrl c )
>>
>> I would expect to see the incomplete, temporary, hidden file present on
>> the remote machine.
>> So that when I call rsync again, it could just pick up where it left off
>> and continue transferring data.
>>
>> But instead there is no hidden file, and the partial/incomplete file
>> exists, as the actual filename.
>>
>> This is bad, because any code that is expecting existing non-hidden
>> files to be complete will have issues.
>>
>> I apologize if I've missed the command line options I'm looking for
>> Thanks for maintaining a critical piece of software!
>>
>>
>>
>
> --
> ~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,
>  Kevin Korb  Phone:(407) 252-6853
&g

Re: [External] Re: ctrl -c while executing --progress --size-only --partial results in unhidden but incomplete file

2023-06-07 Thread Kevin Korb via rsync 
Rsync has no memory of what other instances of rsync have done in the 
past.  An existing file with a different name is of no interest to it 
unless --delete in which case it would be deleted.  Maybe what you 
really want is --partial-dir?


On 6/7/23 16:17, Lacey, Nathan wrote:

I'm suggesting a partial file that isn't hidden is worse.
Because any other app looking at the file would think the transfer is 
complete and try to use it.


It doesn't need to be a orphaned file,  when called next time with 
--partial rsync could re-opened the incomplete/hidden file, than it 
could  continue putting more bytes to the file until it was really 
completed.


When running in --partial mode, the filename wouldn't have to be random, 
instead it could be based on the source ip address, so that rsync knows 
what file to continue processing on.


*From:* rsync  on behalf of Kevin Korb 
via rsync 

*Sent:* Wednesday, June 7, 2023 3:26 PM
*To:* rsync@lists.samba.org 
*Subject:* [External] Re: ctrl -c while executing --progress --size-only 
--partial results in unhidden but incomplete file
[You don't often get email from rsync@lists.samba.org. Learn why this is 
important at https://aka.ms/LearnAboutSenderIdentification 
<https://aka.ms/LearnAboutSenderIdentification> ]


This message is from an EXTERNAL SENDER - be CAUTIOUS of links and 
attachments. THINK BEFORE YOU CLICK.




That is what --partial does.  It keeps the partial file.  If it kept the
temporary file with the random file name that would just be a useless
orphaned file.

On 6/7/23 15:02, Lacey, Nathan via rsync wrote:
This is a clone from https://usg02.safelinks.protection.office365.us/?url=https%3A%2F%2Fgithub.com%2FWayneD%2Frsync%2Fissues%2F484=05%7C01%7Cnathan.lacey%40afs.com%7C10b90a1b4f9d4615db4808db678d21e3%7Ca01f407a85cb4a1698bbf28e6384bd28%7C0%7C0%7C638217628080125247%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C=Au9lcV7aCmwXRKXFT3LA4X5g6QVabasCJy14f01ZMuI%3D=0 

<https://usg02.safelinks.protection.office365.us/?url=https%3A%2F%2Fgithub.com%2FWayneD%2Frsync%2Fissues%2F484=05%7C01%7Cnathan.lacey%40afs.com%7C10b90a1b4f9d4615db4808db678d21e3%7Ca01f407a85cb4a1698bbf28e6384bd28%7C0%7C0%7C638217628080125247%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C=Au9lcV7aCmwXRKXFT3LA4X5g6QVabasCJy14f01ZMuI%3D=0>
<https://usg02.safelinks.protection.office365.us/?url=https%3A%2F%2Fgithub.com%2FWayneD%2Frsync%2Fissues%2F484=05%7C01%7Cnathan.lacey%40afs.com%7C10b90a1b4f9d4615db4808db678d21e3%7Ca01f407a85cb4a1698bbf28e6384bd28%7C0%7C0%7C638217628080125247%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C=Au9lcV7aCmwXRKXFT3LA4X5g6QVabasCJy14f01ZMuI%3D=0 

<https://usg02.safelinks.protection.office365.us/?url=https%3A%2F%2Fgithub.com%2FWayneD%2Frsync%2Fissues%2F484=05%7C01%7Cnathan.lacey%40afs.com%7C10b90a1b4f9d4615db4808db678d21e3%7Ca01f407a85cb4a1698bbf28e6384bd28%7C0%7C0%7C638217628080125247%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C=Au9lcV7aCmwXRKXFT3LA4X5g6QVabasCJy14f01ZMuI%3D=0>>


run rsync with --progress --size-only --partial (version 3.1.2) also
tested/built current master ( 3.3.0pre1-5-g6f3c5ecc )
everything works fine unless I interrupt a transfer ( ctrl c )

I would expect to see the incomplete, temporary, hidden file present on
the remote machine.
So that when I call rsync again, it could just pick up where it left off
and continue transferring data.

But instead there is no hidden file, and the partial/incomplete file
exists, as the actual filename.

This is bad, because any code that is expecting existing non-hidden
files to be complete will have issues.

I apologize if I've missed the command line options I'm looking for
Thanks for maintaining a critical piece of software!





--
~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,
     Kevin Korb  Phone:    (407) 252-6853
     Systems Administrator   Internet:
     FutureQuest, Inc.   ke...@futurequest.net  (work)
     Orlando, Florida    k...@sanitarium.net (personal)
     Web page: 
https://usg02.safelinks.protection.office365.us/?url=https%3A%2F%2Fsanitarium.net%2F=05%7C01%7Cnathan.lacey%40afs.com%7C10b90a1b4f9d4615db4808db678d21e3%7Ca01f407a85cb4a1698bbf28e6384bd28%7C0%7C0%7C638217628080125247%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C=j42u1PbBcts8QAs7rqJTVuLXLW2mKy6WaifX756cEFI%3D=0 
<https://usg02.safelinks.protection.office365.us/?url=https%3A%2F%2Fsanitarium.net%2F=05%7C01%7Cnathan.lacey%40afs.com%7C10b90a1b4f9d4615db4808db678d21e3%7Ca01f407a85cb4a1698bbf28e6384bd28%7C0%7C0%7C6

Re: [External] Re: ctrl -c while executing --progress --size-only --partial results in unhidden but incomplete file

2023-06-07 Thread Lacey, Nathan via rsync 
I'm suggesting a partial file that isn't hidden is worse.
Because any other app looking at the file would think the transfer is complete 
and try to use it.

It doesn't need to be a orphaned file,  when called next time with --partial 
rsync could re-opened the incomplete/hidden file, than it could  continue 
putting more bytes to the file until it was really completed.

When running in --partial mode, the filename wouldn't have to be random, 
instead it could be based on the source ip address, so that rsync knows what 
file to continue processing on.

From: rsync  on behalf of Kevin Korb via rsync 

Sent: Wednesday, June 7, 2023 3:26 PM
To: rsync@lists.samba.org 
Subject: [External] Re: ctrl -c while executing --progress --size-only 
--partial results in unhidden but incomplete file

[You don't often get email from rsync@lists.samba.org. Learn why this is 
important at https://aka.ms/LearnAboutSenderIdentification ]

This message is from an EXTERNAL SENDER - be CAUTIOUS of links and attachments. 
THINK BEFORE YOU CLICK.



That is what --partial does.  It keeps the partial file.  If it kept the
temporary file with the random file name that would just be a useless
orphaned file.

On 6/7/23 15:02, Lacey, Nathan via rsync wrote:
> This is a clone from 
> https://usg02.safelinks.protection.office365.us/?url=https%3A%2F%2Fgithub.com%2FWayneD%2Frsync%2Fissues%2F484=05%7C01%7Cnathan.lacey%40afs.com%7C10b90a1b4f9d4615db4808db678d21e3%7Ca01f407a85cb4a1698bbf28e6384bd28%7C0%7C0%7C638217628080125247%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C=Au9lcV7aCmwXRKXFT3LA4X5g6QVabasCJy14f01ZMuI%3D=0
> <https://usg02.safelinks.protection.office365.us/?url=https%3A%2F%2Fgithub.com%2FWayneD%2Frsync%2Fissues%2F484=05%7C01%7Cnathan.lacey%40afs.com%7C10b90a1b4f9d4615db4808db678d21e3%7Ca01f407a85cb4a1698bbf28e6384bd28%7C0%7C0%7C638217628080125247%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C=Au9lcV7aCmwXRKXFT3LA4X5g6QVabasCJy14f01ZMuI%3D=0>
>
> run rsync with --progress --size-only --partial (version 3.1.2) also
> tested/built current master ( 3.3.0pre1-5-g6f3c5ecc )
> everything works fine unless I interrupt a transfer ( ctrl c )
>
> I would expect to see the incomplete, temporary, hidden file present on
> the remote machine.
> So that when I call rsync again, it could just pick up where it left off
> and continue transferring data.
>
> But instead there is no hidden file, and the partial/incomplete file
> exists, as the actual filename.
>
> This is bad, because any code that is expecting existing non-hidden
> files to be complete will have issues.
>
> I apologize if I've missed the command line options I'm looking for
> Thanks for maintaining a critical piece of software!
>
>
>

--
~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,
Kevin Korb  Phone:(407) 252-6853
Systems Administrator   Internet:
FutureQuest, Inc.   ke...@futurequest.net  (work)
Orlando, Floridak...@sanitarium.net (personal)
Web page:   
https://usg02.safelinks.protection.office365.us/?url=https%3A%2F%2Fsanitarium.net%2F=05%7C01%7Cnathan.lacey%40afs.com%7C10b90a1b4f9d4615db4808db678d21e3%7Ca01f407a85cb4a1698bbf28e6384bd28%7C0%7C0%7C638217628080125247%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C=j42u1PbBcts8QAs7rqJTVuLXLW2mKy6WaifX756cEFI%3D=0
PGP public key available on web site.
~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,

--
Please use reply-all for most replies to avoid omitting the mailing list.
To unsubscribe or change options: 
https://usg02.safelinks.protection.office365.us/?url=https%3A%2F%2Flists.samba.org%2Fmailman%2Flistinfo%2Frsync=05%7C01%7Cnathan.lacey%40afs.com%7C10b90a1b4f9d4615db4808db678d21e3%7Ca01f407a85cb4a1698bbf28e6384bd28%7C0%7C0%7C638217628080125247%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C=5p6rzPlJp5WD0dnK9zJUv6sCNpGyXAK9YqSCe%2BMB4Fk%3D=0
Before posting, read: 
https://usg02.safelinks.protection.office365.us/?url=http%3A%2F%2Fwww.catb.org%2F~esr%2Ffaqs%2Fsmart-questions.html=05%7C01%7Cnathan.lacey%40afs.com%7C10b90a1b4f9d4615db4808db678d21e3%7Ca01f407a85cb4a1698bbf28e6384bd28%7C0%7C0%7C638217628080125247%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C=aeRtF6sFctmGy7JNwuYnUhmr45bO0E5PsAmk452Tsvo%3D=0
-- 
Please use reply-all for most replies to avoid omitting the mailing list.
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html

Re: ctrl -c while executing --progress --size-only --partial results in unhidden but incomplete file

2023-06-07 Thread Kevin Korb via rsync 
That is what --partial does.  It keeps the partial file.  If it kept the 
temporary file with the random file name that would just be a useless 
orphaned file.


On 6/7/23 15:02, Lacey, Nathan via rsync wrote:
This is a clone from https://github.com/WayneD/rsync/issues/484 



run rsync with --progress --size-only --partial (version 3.1.2) also 
tested/built current master ( 3.3.0pre1-5-g6f3c5ecc )

everything works fine unless I interrupt a transfer ( ctrl c )

I would expect to see the incomplete, temporary, hidden file present on 
the remote machine.
So that when I call rsync again, it could just pick up where it left off 
and continue transferring data.


But instead there is no hidden file, and the partial/incomplete file 
exists, as the actual filename.


This is bad, because any code that is expecting existing non-hidden 
files to be complete will have issues.


I apologize if I've missed the command line options I'm looking for
Thanks for maintaining a critical piece of software!





--
~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,
Kevin Korb  Phone:(407) 252-6853
Systems Administrator   Internet:
FutureQuest, Inc.   ke...@futurequest.net  (work)
Orlando, Floridak...@sanitarium.net (personal)
Web page:   https://sanitarium.net/
PGP public key available on web site.
~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,

--
Please use reply-all for most replies to avoid omitting the mailing list.
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html

ctrl -c while executing --progress --size-only --partial results in unhidden but incomplete file

2023-06-07 Thread Lacey, Nathan via rsync 
This is a clone from https://github.com/WayneD/rsync/issues/484

run rsync with --progress --size-only --partial (version 3.1.2) also 
tested/built current master ( 3.3.0pre1-5-g6f3c5ecc )
everything works fine unless I interrupt a transfer ( ctrl c )

I would expect to see the incomplete, temporary, hidden file present on the 
remote machine.
So that when I call rsync again, it could just pick up where it left off and 
continue transferring data.

But instead there is no hidden file, and the partial/incomplete file exists, as 
the actual filename.

This is bad, because any code that is expecting existing non-hidden files to be 
complete will have issues.

I apologize if I've missed the command line options I'm looking for
Thanks for maintaining a critical piece of software!

-- 
Please use reply-all for most replies to avoid omitting the mailing list.
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html