[GitHub] [spark] mridulm commented on pull request #36162: [SPARK-32170][CORE] Improve the speculation through the stage task metrics.

2022-07-11 Thread GitBox
mridulm commented on PR #36162: URL: https://github.com/apache/spark/pull/36162#issuecomment-1180706514 It helps in two cases @weixiuli - the example you gave (generated input (like range()), etc where there is no input metrics). It also helps when reading shuffle input where there is a sor

[GitHub] [spark] mridulm commented on pull request #36162: [SPARK-32170][CORE] Improve the speculation through the stage task metrics.

2022-06-29 Thread GitBox
mridulm commented on PR #36162: URL: https://github.com/apache/spark/pull/36162#issuecomment-1170429727 Thanks for working on this @weixiuli ! This should really help with speculative execution. Thanks for merging it @Ngone51 :-) Traveling and don’t have access to my desktop to help

[GitHub] [spark] mridulm commented on pull request #36162: [SPARK-32170][CORE] Improve the speculation through the stage task metrics.

2022-05-29 Thread GitBox
mridulm commented on PR #36162: URL: https://github.com/apache/spark/pull/36162#issuecomment-1140638095 Thanks for the changes @weixiuli, I will take a look at this later this week. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to Git

[GitHub] [spark] mridulm commented on pull request #36162: [SPARK-32170][CORE] Improve the speculation through the stage task metrics.

2022-05-19 Thread GitBox
mridulm commented on PR #36162: URL: https://github.com/apache/spark/pull/36162#issuecomment-1131396197 Thanks for the changes @weixiuli. I will try to take a look early next week - a bit swamped by some other work unfortunately. -- This is an automated message from the Apache Git Serv

[GitHub] [spark] mridulm commented on pull request #36162: [SPARK-32170][CORE] Improve the speculation through the stage task metrics.

2022-04-29 Thread GitBox
mridulm commented on PR #36162: URL: https://github.com/apache/spark/pull/36162#issuecomment-1112948712 > @mridulm Thanks for your review, I have updated the PR description, PTAL. Thanks, really helped ! -- This is an automated message from the Apache Git Service. To respond to the