There are some cases, shuffle hash join performs even better than sort merge
join.
While, I noticed that ShuffledHashJoinExec does not implement CodegenSupport,
is there any concern? And if there is any chance to improve the performance of
ShuffledHashJoinExec?
By default sort merge join is preferred over shuffle hash join, that's why
we haven't spend resources to implement codegen for it.
On Sun, Nov 10, 2019 at 3:15 PM Wang, Gang wrote:
> There are some cases, shuffle hash join performs even better than sort
> merge join.
>
> While, I noticed that Sh
Cc: "dev@spark.apache.org"
Subject: Re: Why not implement CodegenSupport in class ShuffledHashJoinExec?
By default sort merge join is preferred over shuffle hash join, that's why we
haven't spend resources to implement codegen for it.
On Sun, Nov 10, 2019 at 3:15 PM Wang, Gang
fle hash join? Like code generation for ShuffledHashJoinExec or
> something….
>
>
>
> *From: *Wenchen Fan
> *Date: *Sunday, November 10, 2019 at 5:57 PM
> *To: *"Wang, Gang"
> *Cc: *"dev@spark.apache.org"
> *Subject: *Re: Why not implement CodegenSupport