RE: Force inner join to shuffle the smallest table

2015-06-25 Thread Ulanov, Alexander
Subject: Re: Force inner join to shuffle the smallest table Try below and see if it makes a difference: val result = sqlContext.sql(“select big.f1, big.f2 from small inner join big on big.s=small.s and big.d=small.d”) On Wed, Jun 24, 2015 at 11:35 AM, Ulanov, Alexander alexander.ula

Re: Force inner join to shuffle the smallest table

2015-06-24 Thread Stephen Carman
...@hp.commailto:alexander.ula...@hp.com wrote: It also fails, as I mentioned in the original question. From: CC GP [mailto:chandrika.gopalakris...@gmail.com] Sent: Wednesday, June 24, 2015 12:08 PM To: Ulanov, Alexander Cc: dev@spark.apache.orgmailto:dev@spark.apache.org Subject: Re: Force inner join to shuffle