[
https://issues.apache.org/jira/browse/HIVE-8536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14221655#comment-14221655
]
Szehon Ho commented on HIVE-8536:
---------------------------------
Great work Rui! Left comments on the review-board.
Stage-3 does look weird to me, it should ideally be split into two works by the
SparkMapJoinResolver. Maybe its because they need to be connected together
(Map5 -> Map4). We could give that a try.
Also I think when we are ready, we can test to see if it works, with latest
branch and enabling mapjoin. Turning on (SparkMapJoinOptimizer,
SparkReduceSinkMapJoinProc) in generateTaskTree, and (SparkMapJoinResolver) in
optimizeTaskPlan. If HIVE-8946 is not finished until then.
> Enable SkewJoinResolver for spark [Spark Branch]
> ------------------------------------------------
>
> Key: HIVE-8536
> URL: https://issues.apache.org/jira/browse/HIVE-8536
> Project: Hive
> Issue Type: Improvement
> Components: Spark
> Reporter: Rui Li
> Assignee: Rui Li
> Attachments: HIVE-8536.1-spark.patch
>
>
> Sub-task of HIVE-8406
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
