What is the efficient way to Join two RDDs?

2015-11-06 Thread swetha
Hi, What is the efficient way to join two RDDs? Would converting both the RDDs to IndexedRDDs be of any help? Thanks, Swetha -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/What-is-the-efficient-way-to-Join-two-RDDs-tp25310.html Sent from the Apache Spark

Re: What is the efficient way to Join two RDDs?

2015-11-06 Thread swetha kasireddy
> On Fri, Nov 6, 2015 at 3:21 PM, swetha <swethakasire...@gmail.com> wrote: > >> Hi, >> >> What is the efficient way to join two RDDs? Would converting both the RDDs >> to IndexedRDDs be of any help? >> >> Thanks, >> Swetha >> >> >

Re: What is the efficient way to Join two RDDs?

2015-11-06 Thread Ted Yu
Can you tell us a bit more about your use case ? Are the two RDDs expected to be of roughly equal size or, to be of vastly different sizes ? Thanks On Fri, Nov 6, 2015 at 3:21 PM, swetha <swethakasire...@gmail.com> wrote: > Hi, > > What is the efficient way to join two RDDs? W