[ https://issues.apache.org/jira/browse/SPARK-2521?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Andrew Ash updated SPARK-2521: ------------------------------ Comment: was deleted (was: Reynold's PR: https://github.com/apache/spark/pull/1452) > Broadcast RDD object once per TaskSet (instead of sending it for every task) > ---------------------------------------------------------------------------- > > Key: SPARK-2521 > URL: https://issues.apache.org/jira/browse/SPARK-2521 > Project: Spark > Issue Type: Improvement > Components: Spark Core > Reporter: Reynold Xin > Assignee: Reynold Xin > > This can substantially reduce task size, as well as being able to support > very large closures (e.g. closures that reference large variables). > Once this is in, we can also remove broadcasting the Hadoop JobConf. -- This message was sent by Atlassian JIRA (v6.2#6252)