[
https://issues.apache.org/jira/browse/SPARK-4280?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14202382#comment-14202382
]
Sandy Ryza commented on SPARK-4280:
-----------------------------------
So it looks like the block IDs of broadcast variables on each node are the same
broadcast IDs used on the driver. Which means it wouldn't be too hard to do
this filtering. Even without it, this would still be useful. What do you
think?
> In dynamic allocation, add option to never kill executors with cached blocks
> ----------------------------------------------------------------------------
>
> Key: SPARK-4280
> URL: https://issues.apache.org/jira/browse/SPARK-4280
> Project: Spark
> Issue Type: Improvement
> Components: Spark Core
> Affects Versions: 1.2.0
> Reporter: Sandy Ryza
>
> Even with the external shuffle service, this is useful in situations like
> Hive on Spark where a query might require caching some data. We want to be
> able to give back executors after the job ends, but not during the job if it
> would delete intermediate results.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
