[jira] [Created] (SPARK-12678) MapPartitionsRDD
Guillaume Poulin created SPARK-12678: Summary: MapPartitionsRDD Key: SPARK-12678 URL: https://issues.apache.org/jira/browse/SPARK-12678 Project: Spark Issue Type: Bug Components: Spark Core Reporter: Guillaume Poulin Priority: Minor When `MapPartitionsRDD.clearDependencies()` is called, `MapPartitionsRDD` keep a reference to `prev` which may cause a memory leak. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org
[jira] [Created] (SPARK-12425) DStream union optimisation
Guillaume Poulin created SPARK-12425: Summary: DStream union optimisation Key: SPARK-12425 URL: https://issues.apache.org/jira/browse/SPARK-12425 Project: Spark Issue Type: Improvement Components: Streaming Reporter: Guillaume Poulin Priority: Minor Currently, `DStream.union` always use `UnionRDD` on the underlying `RDD`. However using `PartitionerAwareUnionRDD` when possible would yield to better performance. -- This message was sent by Atlassian JIRA (v6.3.4#6332) - To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org