[jira] [Created] (SPARK-12678) MapPartitionsRDD

2016-01-06 Thread Guillaume Poulin (JIRA)
Guillaume Poulin created SPARK-12678:


 Summary: MapPartitionsRDD
 Key: SPARK-12678
 URL: https://issues.apache.org/jira/browse/SPARK-12678
 Project: Spark
  Issue Type: Bug
  Components: Spark Core
Reporter: Guillaume Poulin
Priority: Minor


When `MapPartitionsRDD.clearDependencies()` is called, `MapPartitionsRDD` keep 
a reference to `prev` which may cause a memory leak.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org



[jira] [Created] (SPARK-12425) DStream union optimisation

2015-12-18 Thread Guillaume Poulin (JIRA)
Guillaume Poulin created SPARK-12425:


 Summary: DStream union optimisation
 Key: SPARK-12425
 URL: https://issues.apache.org/jira/browse/SPARK-12425
 Project: Spark
  Issue Type: Improvement
  Components: Streaming
Reporter: Guillaume Poulin
Priority: Minor


Currently, `DStream.union` always use `UnionRDD` on the underlying `RDD`. 
However using `PartitionerAwareUnionRDD` when possible would yield to better 
performance.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

-
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org