anshulbaliga7 commented on PR #58167: URL: https://github.com/apache/spark/pull/58167#issuecomment-6152555782
Thanks @LuciferYang for the review and especially for checking the recovery path on 4.1.1. I have done all four: the flag is now in `propertiesToReload` with a case in the streaming conf-recovery test. The count is written only after the read-back check passes, so a cluster-mode local-disk checkpoint keeps the SPARK-58770 diagnosis (I tested with a `listStatus` that drops the last file) and took your trim and write the file directly, which removed the temp-file handling and three tests, and the legacy-directory test now asserts no WARN is logged. Can you PTAL again? Thanks! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
