Subject: Re: Force inner join to shuffle the smallest table
Try below and see if it makes a difference:
val result = sqlContext.sql(“select big.f1, big.f2 from small inner join big on
big.s=small.s and big.d=small.d”)
On Wed, Jun 24, 2015 at 11:35 AM, Ulanov, Alexander
alexander.ula
...@hp.commailto:alexander.ula...@hp.com wrote:
It also fails, as I mentioned in the original question.
From: CC GP [mailto:chandrika.gopalakris...@gmail.com]
Sent: Wednesday, June 24, 2015 12:08 PM
To: Ulanov, Alexander
Cc: dev@spark.apache.orgmailto:dev@spark.apache.org
Subject: Re: Force inner join to shuffle