Thank you Kevin!
--partial --partial-dir {hidden relative_sub-dir} is perfect!
Interrupted files stay there until they complete.
Thanks
________________________________
From: Kevin Korb <k...@sanitarium.net>
Sent: Wednesday, June 7, 2023 4:26 PM
To: Lacey, Nathan <nathan.la...@afs.com>; rsync@lists.samba.org
<rsync@lists.samba.org>
Subject: Re: [External] Re: ctrl -c while executing --progress --size-only
--partial results in unhidden but incomplete file
Rsync has no memory of what other instances of rsync have done in the
past. An existing file with a different name is of no interest to it
unless --delete in which case it would be deleted. Maybe what you
really want is --partial-dir?
On 6/7/23 16:17, Lacey, Nathan wrote:
> I'm suggesting a partial file that isn't hidden is worse.
> Because any other app looking at the file would think the transfer is
> complete and try to use it.
>
> It doesn't need to be a orphaned file, when called next time with
> --partial rsync could re-opened the incomplete/hidden file, than it
> could continue putting more bytes to the file until it was really
> completed.
>
> When running in --partial mode, the filename wouldn't have to be random,
> instead it could be based on the source ip address, so that rsync knows
> what file to continue processing on.
> ------------------------------------------------------------------------
> *From:* rsync <rsync-boun...@lists.samba.org> on behalf of Kevin Korb
> via rsync <rsync@lists.samba.org>
> *Sent:* Wednesday, June 7, 2023 3:26 PM
> *To:* rsync@lists.samba.org <rsync@lists.samba.org>
> *Subject:* [External] Re: ctrl -c while executing --progress --size-only
> --partial results in unhidden but incomplete file
> [You don't often get email from rsync@lists.samba.org. Learn why this is
> important at https://aka.ms/LearnAboutSenderIdentification
> <https://aka.ms/LearnAboutSenderIdentification> ]
>
> This message is from an EXTERNAL SENDER - be CAUTIOUS of links and
> attachments. THINK BEFORE YOU CLICK.
> ________________________________
>
>
> That is what --partial does. It keeps the partial file. If it kept the
> temporary file with the random file name that would just be a useless
> orphaned file.
>
> On 6/7/23 15:02, Lacey, Nathan via rsync wrote:
>> This is a clone from
>> https://usg02.safelinks.protection.office365.us/?url=https%3A%2F%2Fgithub.com%2FWayneD%2Frsync%2Fissues%2F484&data=05%7C01%7Cnathan.lacey%40afs.com%7C06c4e9ad19584dd4615308db679575a1%7Ca01f407a85cb4a1698bbf28e6384bd28%7C0%7C0%7C638217663866905817%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=l8oz6qys%2Fdeo%2FktQiLJCDwMaOTaz1gpjkjHbh0hH8QQ%3D&reserved=0
> <https://usg02.safelinks.protection.office365.us/?url=https%3A%2F%2Fgithub.com%2FWayneD%2Frsync%2Fissues%2F484&data=05%7C01%7Cnathan.lacey%40afs.com%7C06c4e9ad19584dd4615308db679575a1%7Ca01f407a85cb4a1698bbf28e6384bd28%7C0%7C0%7C638217663866905817%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=l8oz6qys%2Fdeo%2FktQiLJCDwMaOTaz1gpjkjHbh0hH8QQ%3D&reserved=0>
>> <https://usg02.safelinks.protection.office365.us/?url=https%3A%2F%2Fgithub.com%2FWayneD%2Frsync%2Fissues%2F484&data=05%7C01%7Cnathan.lacey%40afs.com%7C06c4e9ad19584dd4615308db679575a1%7Ca01f407a85cb4a1698bbf28e6384bd28%7C0%7C0%7C638217663866905817%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=l8oz6qys%2Fdeo%2FktQiLJCDwMaOTaz1gpjkjHbh0hH8QQ%3D&reserved=0
> <https://usg02.safelinks.protection.office365.us/?url=https%3A%2F%2Fgithub.com%2FWayneD%2Frsync%2Fissues%2F484&data=05%7C01%7Cnathan.lacey%40afs.com%7C06c4e9ad19584dd4615308db679575a1%7Ca01f407a85cb4a1698bbf28e6384bd28%7C0%7C0%7C638217663866905817%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=l8oz6qys%2Fdeo%2FktQiLJCDwMaOTaz1gpjkjHbh0hH8QQ%3D&reserved=0>>
>>
>> run rsync with --progress --size-only --partial (version 3.1.2) also
>> tested/built current master ( 3.3.0pre1-5-g6f3c5ecc )
>> everything works fine unless I interrupt a transfer ( ctrl c )
>>
>> I would expect to see the incomplete, temporary, hidden file present on
>> the remote machine.
>> So that when I call rsync again, it could just pick up where it left off
>> and continue transferring data.
>>
>> But instead there is no hidden file, and the partial/incomplete file
>> exists, as the actual filename.
>>
>> This is bad, because any code that is expecting existing non-hidden
>> files to be complete will have issues.
>>
>> I apologize if I've missed the command line options I'm looking for
>> Thanks for maintaining a critical piece of software!
>>
>>
>>
>
> --
> ~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,
> Kevin Korb Phone: (407) 252-6853
> Systems Administrator Internet:
> FutureQuest, Inc. ke...@futurequest.net (work)
> Orlando, Florida k...@sanitarium.net (personal)
> Web page:
> https://usg02.safelinks.protection.office365.us/?url=https%3A%2F%2Fsanitarium.net%2F&data=05%7C01%7Cnathan.lacey%40afs.com%7C06c4e9ad19584dd4615308db679575a1%7Ca01f407a85cb4a1698bbf28e6384bd28%7C0%7C0%7C638217663866905817%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=n8bPE3%2F4z6IHwxm4tTJRe0Wiu9Bd1tY1uDhRZFOkWnE%3D&reserved=0
> <https://usg02.safelinks.protection.office365.us/?url=https%3A%2F%2Fsanitarium.net%2F&data=05%7C01%7Cnathan.lacey%40afs.com%7C06c4e9ad19584dd4615308db679575a1%7Ca01f407a85cb4a1698bbf28e6384bd28%7C0%7C0%7C638217663866905817%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=n8bPE3%2F4z6IHwxm4tTJRe0Wiu9Bd1tY1uDhRZFOkWnE%3D&reserved=0>
> PGP public key available on web site.
> ~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,
>
> --
> Please use reply-all for most replies to avoid omitting the mailing list.
> To unsubscribe or change options:
> https://usg02.safelinks.protection.office365.us/?url=https%3A%2F%2Flists.samba.org%2Fmailman%2Flistinfo%2Frsync&data=05%7C01%7Cnathan.lacey%40afs.com%7C06c4e9ad19584dd4615308db679575a1%7Ca01f407a85cb4a1698bbf28e6384bd28%7C0%7C0%7C638217663866905817%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=ALtnyBZWkiuYvHLVR4LaPT454JuvmcK%2BrRcFAGb%2Fn7M%3D&reserved=0
> <https://usg02.safelinks.protection.office365.us/?url=https%3A%2F%2Flists.samba.org%2Fmailman%2Flistinfo%2Frsync&data=05%7C01%7Cnathan.lacey%40afs.com%7C06c4e9ad19584dd4615308db679575a1%7Ca01f407a85cb4a1698bbf28e6384bd28%7C0%7C0%7C638217663866905817%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=ALtnyBZWkiuYvHLVR4LaPT454JuvmcK%2BrRcFAGb%2Fn7M%3D&reserved=0>
> Before posting, read:
> https://usg02.safelinks.protection.office365.us/?url=http%3A%2F%2Fwww.catb.org%2F~esr%2Ffaqs%2Fsmart-questions.html&data=05%7C01%7Cnathan.lacey%40afs.com%7C06c4e9ad19584dd4615308db679575a1%7Ca01f407a85cb4a1698bbf28e6384bd28%7C0%7C0%7C638217663866905817%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=GlWRSwlSBb77rRDTLRvVgBgGDwPqIvTYHwgq0Lhe%2BpE%3D&reserved=0
> <https://usg02.safelinks.protection.office365.us/?url=http%3A%2F%2Fwww.catb.org%2F~esr%2Ffaqs%2Fsmart-questions.html&data=05%7C01%7Cnathan.lacey%40afs.com%7C06c4e9ad19584dd4615308db679575a1%7Ca01f407a85cb4a1698bbf28e6384bd28%7C0%7C0%7C638217663866905817%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=GlWRSwlSBb77rRDTLRvVgBgGDwPqIvTYHwgq0Lhe%2BpE%3D&reserved=0>
--
~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,
Kevin Korb Phone: (407) 252-6853
Systems Administrator Internet:
FutureQuest, Inc. ke...@futurequest.net (work)
Orlando, Florida k...@sanitarium.net (personal)
Web page:
https://usg02.safelinks.protection.office365.us/?url=https%3A%2F%2Fsanitarium.net%2F&data=05%7C01%7Cnathan.lacey%40afs.com%7C06c4e9ad19584dd4615308db679575a1%7Ca01f407a85cb4a1698bbf28e6384bd28%7C0%7C0%7C638217663866905817%7CUnknown%7CTWFpbGZsb3d8eyJWIjoiMC4wLjAwMDAiLCJQIjoiV2luMzIiLCJBTiI6Ik1haWwiLCJXVCI6Mn0%3D%7C3000%7C%7C%7C&sdata=n8bPE3%2F4z6IHwxm4tTJRe0Wiu9Bd1tY1uDhRZFOkWnE%3D&reserved=0
PGP public key available on web site.
~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,-*~'`^`'~*-,._.,
--
Please use reply-all for most replies to avoid omitting the mailing list.
To unsubscribe or change options: https://lists.samba.org/mailman/listinfo/rsync
Before posting, read: http://www.catb.org/~esr/faqs/smart-questions.html
