Re: Splitting RDD by partition

2016-05-20 Thread Sun Rui
ny thought about this? Is this the right thing to do or am I missing > something important? > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/Splitting-RDD-by-partition-tp26983p26985.html > Sent from the Apache Spark Us

Re: Splitting RDD by partition

2016-05-20 Thread shlomi
t: http://apache-spark-user-list.1001560.n3.nabble.com/Splitting-RDD-by-partition-tp26983p26985.html Sent from the Apache Spark User List mailing list archive at Nabble.com. - To unsubscribe, e-mail: user-unsubscr...@spark.apache

Splitting RDD by partition

2016-05-19 Thread shlomi
Is this the best way? This seems to cause some shuffling, however I am not sure how they impact performance.. Is there another way, maybe even a more involved way, to achieve this? Thanks! -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.