[
https://issues.apache.org/jira/browse/SPARK-1880?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Takuya Ueshin updated SPARK-1880:
---------------------------------
Description:
There are unnecessary job executions in {{BroadcastNestedLoopJoin}}.
When {{Innner}} or {{LeftOuter}} join, preparation of {{rightOuterMatches}} for
{{RightOuter}} or {{FullOuter}} join is not neccessary.
And when {{RightOuter}} or {{FullOuter}}, it should use not {{count}} and then
{{reduce}} but {{fold}}.
was:
There are unnecessary job executions in {{BroadcastNestedLoopJoin}}.
When Innner or LeftOuter join, preparation of {{rightOuterMatches}} for
{{RightOuter}} or {{FullOuter}} join is not neccessary.
And when {{RightOuter}} or {{FullOuter}}, it should use not {{count}} and then
{{reduce}} but {{fold}}.
> Eliminate unnecessary job executions.
> -------------------------------------
>
> Key: SPARK-1880
> URL: https://issues.apache.org/jira/browse/SPARK-1880
> Project: Spark
> Issue Type: Improvement
> Components: SQL
> Reporter: Takuya Ueshin
>
> There are unnecessary job executions in {{BroadcastNestedLoopJoin}}.
> When {{Innner}} or {{LeftOuter}} join, preparation of {{rightOuterMatches}}
> for {{RightOuter}} or {{FullOuter}} join is not neccessary.
> And when {{RightOuter}} or {{FullOuter}}, it should use not {{count}} and
> then {{reduce}} but {{fold}}.
--
This message was sent by Atlassian JIRA
(v6.2#6252)
