[GitHub] spark pull request #17750: [SPARK-4899][MESOS] Support for checkpointing on ...

2017-04-24 Thread gkc2104
GitHub user gkc2104 opened a pull request: https://github.com/apache/spark/pull/17750 [SPARK-4899][MESOS] Support for checkpointing on Coarse and Fine grai… Support for Mesos checkpointing https://issues.apache.org/jira/browse/SPARK-4899 apache#60 ## What changes

[GitHub] spark pull request #17846: [SPARK-20562][MESOS] Support for declining offers...

2017-05-03 Thread gkc2104
GitHub user gkc2104 opened a pull request: https://github.com/apache/spark/pull/17846 [SPARK-20562][MESOS] Support for declining offers under Unavailability. ## What changes were proposed in this pull request? Support Mesos Maintenance by making the Spark Scheduler only

[GitHub] spark issue #17750: [SPARK-4899][MESOS] Support for checkpointing on Coarse ...

2017-05-04 Thread gkc2104
Github user gkc2104 commented on the issue: https://github.com/apache/spark/pull/17750 Hey @lins05, thanks for taking the time to look into this. Yes, It is true that there is an associated overhead in both modes, that's why the defaults have not been changed. i.e. De

[GitHub] spark issue #17750: [SPARK-4899][MESOS] Support for checkpointing on Coarse ...

2017-05-06 Thread gkc2104
Github user gkc2104 commented on the issue: https://github.com/apache/spark/pull/17750 > In contrast, in the coarse grained mode the executor would send the 100MB data to the driver directly without going through mesos agents. The only thing that agents write to disk are small t

[GitHub] spark issue #17750: [SPARK-4899][MESOS] Support for checkpointing on Coarse ...

2017-05-24 Thread gkc2104
Github user gkc2104 commented on the issue: https://github.com/apache/spark/pull/17750 Updated the PR to only include checkpointing on Coarse grained mode. --- If your project is set up for it, you can reply to this email and have your reply appear on GitHub as well. If your project