Reynold Xin created SPARK-2758:
----------------------------------

             Summary: UnionRDD's UnionPartition should not reference parent RDDs
                 Key: SPARK-2758
                 URL: https://issues.apache.org/jira/browse/SPARK-2758
             Project: Spark
          Issue Type: Improvement
    Affects Versions: 1.0.0, 1.0.1, 1.0.2
            Reporter: Reynold Xin
            Assignee: Reynold Xin


UnionPartition has a non-transient field referencing the parent RDD, to be used 
in compute (iterator). That causes some trouble with task size because 
partition objects are supposed to be small.





--
This message was sent by Atlassian JIRA
(v6.2#6252)

Reply via email to