GitHub user gkc2104 opened a pull request:
https://github.com/apache/spark/pull/17750
[SPARK-4899][MESOS] Support for checkpointing on Coarse and Fine graiâ¦
Support for Mesos checkpointing
https://issues.apache.org/jira/browse/SPARK-4899
apache#60
## What changes
GitHub user gkc2104 opened a pull request:
https://github.com/apache/spark/pull/17846
[SPARK-20562][MESOS] Support for declining offers under Unavailability.
## What changes were proposed in this pull request?
Support Mesos Maintenance by making the Spark Scheduler only
Github user gkc2104 commented on the issue:
https://github.com/apache/spark/pull/17750
Hey @lins05, thanks for taking the time to look into this.
Yes, It is true that there is an associated overhead in both modes, that's
why the defaults have not been changed. i.e. De
Github user gkc2104 commented on the issue:
https://github.com/apache/spark/pull/17750
> In contrast, in the coarse grained mode the executor would send the 100MB
data to the driver directly without going through mesos agents. The only thing
that agents write to disk are small t
Github user gkc2104 commented on the issue:
https://github.com/apache/spark/pull/17750
Updated the PR to only include checkpointing on Coarse grained mode.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project