Re: Preventing an RDD from shuffling

2015-12-16 Thread Koert Kuipers
ould already shuffle the RDD. > In addition, I'm only doing the join once per RDD read from MongoDB. Is > there a way to tell Spark to shuffle only the incoming data RDD? > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/Pr

Re: Preventing an RDD from shuffling

2015-12-16 Thread Igor Berman
t beforehand but partitioning would already shuffle the RDD. > In addition, I'm only doing the join once per RDD read from MongoDB. Is > there a way to tell Spark to shuffle only the incoming data RDD? > > > > -- > View this message in context: > http://apache-spark-user-

Re: Preventing an RDD from shuffling

2015-12-16 Thread PhuDuc Nguyen
'm only doing the join once per RDD read from MongoDB. Is > there a way to tell Spark to shuffle only the incoming data RDD? > > > > -- > View this message in context: > http://apache-spark-user-list.1001560.n3.nabble.com/Preventing-an-RDD-from

Preventing an RDD from shuffling

2015-12-16 Thread sparkuser2345
g the join once per RDD read from MongoDB. Is there a way to tell Spark to shuffle only the incoming data RDD? -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Preventing-an-RDD-from-shuffling-tp25717.html Sent from the Apache Spark User List mailing list