[
https://issues.apache.org/jira/browse/SPARK-2521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Reynold Xin updated SPARK-2521:
---
Description:
Currently (as of Spark 1.0.1), Spark sends RDD object (which contains closures)
using A
[
https://issues.apache.org/jira/browse/SPARK-2521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Reynold Xin updated SPARK-2521:
---
Description:
This can substantially reduce task size, as well as being able to support very
large cl
[
https://issues.apache.org/jira/browse/SPARK-2521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Reynold Xin updated SPARK-2521:
---
Component/s: Spark Core
> Broadcast RDD object once per TaskSet (instead of sending it for every task