[GitHub] spark issue #16389: [SPARK-18981][Core]The job hang problem when speculation...

2017-05-11 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/spark/pull/16389 @zhaorongsheng, is this still active and any opinion on ^? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does no

[GitHub] spark issue #16389: [SPARK-18981][Core]The job hang problem when speculation...

2017-03-21 Thread jinxing64
Github user jinxing64 commented on the issue: https://github.com/apache/spark/pull/16389 @zhaorongsheng I think its better to just not reset `numRunningTasks` to 0. If we got some `ExecutorLostFailure`, the stage should not be marked as finished. --- If your project is set up fo

[GitHub] spark issue #16389: [SPARK-18981][Core]The job hang problem when speculation...

2017-01-23 Thread zhaorongsheng
Github user zhaorongsheng commented on the issue: https://github.com/apache/spark/pull/16389 @zsxwing @mridulm Would you check this PR please? Thanks~ --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your

[GitHub] spark issue #16389: [SPARK-18981][Core]The job hang problem when speculation...

2016-12-30 Thread zhaorongsheng
Github user zhaorongsheng commented on the issue: https://github.com/apache/spark/pull/16389 @zsxwing I think it may cause some other problem. For example, if we got some ExecutorLostFailure and the speculated task was running on it, the `numRunningTasks` will never be zero. ---

[GitHub] spark issue #16389: [SPARK-18981][Core]The job hang problem when speculation...

2016-12-29 Thread zsxwing
Github user zsxwing commented on the issue: https://github.com/apache/spark/pull/16389 Can we just not reset `numRunningTasks` to 0? I think it should include speculative tasks and we can add a comment about it. --- If your project is set up for it, you can reply to this email and ha

[GitHub] spark issue #16389: [SPARK-18981][Core]The job hang problem when speculation...

2016-12-28 Thread zhaorongsheng
Github user zhaorongsheng commented on the issue: https://github.com/apache/spark/pull/16389 Hi, is anyone can check this PR? thanks --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this f

[GitHub] spark issue #16389: [SPARK-18981][Core]The job hang problem when speculation...

2016-12-25 Thread zhaorongsheng
Github user zhaorongsheng commented on the issue: https://github.com/apache/spark/pull/16389 @mridulm Please check it. Thanks~ --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature ena

[GitHub] spark issue #16389: [SPARK-18981][Core]The job hang problem when speculation...

2016-12-24 Thread zhaorongsheng
Github user zhaorongsheng commented on the issue: https://github.com/apache/spark/pull/16389 Yes, I have checked it. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled and w

[GitHub] spark issue #16389: [SPARK-18981][Core]The job hang problem when speculation...

2016-12-23 Thread mridulm
Github user mridulm commented on the issue: https://github.com/apache/spark/pull/16389 Does it fail in master without the fix ? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature en

[GitHub] spark issue #16389: [SPARK-18981][Core]The job hang problem when speculation...

2016-12-23 Thread zhaorongsheng
Github user zhaorongsheng commented on the issue: https://github.com/apache/spark/pull/16389 Jenkins, retest this please --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feature enabled a

[GitHub] spark issue #16389: [SPARK-18981][Core]The job hang problem when speculation...

2016-12-23 Thread zhaorongsheng
Github user zhaorongsheng commented on the issue: https://github.com/apache/spark/pull/16389 Hi @mridulm . I have modified the tests. Please check it. Thanks~ --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your p

[GitHub] spark issue #16389: [SPARK-18981][Core]The job hang problem when speculation...

2016-12-23 Thread AmplabJenkins
Github user AmplabJenkins commented on the issue: https://github.com/apache/spark/pull/16389 Can one of the admins verify this patch? --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project does not have this feat