wForget commented on PR #51437: URL: https://github.com/apache/spark/pull/51437#issuecomment-3076486373
> I want to understand the usecase better here. If the tasks completed, why is task result fetch taking a long time ? The result is not very large - just about 2 mb or so, and it took more than 1 min ?! From the log of use case in PR description, result fetch does not take 1 min but at least 2 seconds. Task finished log in executor: ``` 25/07/10 17:55:14 INFO Executor: Finished task 274.0 in stage 639.0 (TID 25061). 1865404 bytes result sent via BlockManager) ``` Executor killed log in driver: ``` 25/07/10 17:55:16 INFO ExecutorAllocationManager: Executors 260 removed due to idle timeout. ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: [email protected] For queries about this service, please contact Infrastructure at: [email protected] --------------------------------------------------------------------- To unsubscribe, e-mail: [email protected] For additional commands, e-mail: [email protected]
