Re: Does RDD.cartesian involve shuffling?

2015-08-04 Thread Richard Marscher
it > to every node (assuming B is relative small to fit)? > > > > On Tue, Aug 4, 2015 at 8:23 AM, Richard Marscher > wrote: > > Yes it does, in fact it's probably going to be one of the more expensive > > shuffles you could trigger. > > > > On Mon, Aug 3, 201

Re: Does RDD.cartesian involve shuffling?

2015-08-04 Thread Meihua Wu
B is relative small to fit)? On Tue, Aug 4, 2015 at 8:23 AM, Richard Marscher wrote: > Yes it does, in fact it's probably going to be one of the more expensive > shuffles you could trigger. > > On Mon, Aug 3, 2015 at 12:56 PM, Meihua Wu > wrote: >> >> Does RDD.cart

Re: Does RDD.cartesian involve shuffling?

2015-08-04 Thread Richard Marscher
Yes it does, in fact it's probably going to be one of the more expensive shuffles you could trigger. On Mon, Aug 3, 2015 at 12:56 PM, Meihua Wu wrote: > Does RDD.cartesian involve shuffling? > > Thanks! > > --

Does RDD.cartesian involve shuffling?

2015-08-03 Thread Meihua Wu
Does RDD.cartesian involve shuffling? Thanks! - To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional commands, e-mail: user-h...@spark.apache.org