Spenserrrr opened a new pull request, #59976: URL: https://github.com/apache/spark/pull/59976
### What changes were proposed in this pull request? - Flush the Python worker init response before processing produces output. - Timestamp successful response receipt in Scala and use it for `pythonInitTime`. - Preserve the existing Python timestamps, boot/total accounting, and finish log calculation. - Add socket-delivery and reader-timing regressions, and update the reused-worker assertion for the new initialization endpoint. ### Why are the changes needed? The successful init response can remain buffered until task results are written, preventing its receipt from marking initialization completion. ### Does this PR introduce _any_ user-facing change? Python worker initialization timing ends when the executor receives the successful init response. ### How was this patch tested? Added buffered-socket and reader-timing regressions, ran the live SQL timing tests and a real-worker delivery probe, and verified that the socket regression fails without the flush. ### Was this patch authored or co-authored using generative AI tooling? Generated-by: Codex (GPT-6) -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
