[
https://issues.apache.org/jira/browse/HIVE-8536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14237465#comment-14237465
]
Xuefu Zhang commented on HIVE-8536:
---
+1
> Enable SkewJoinResolver for spark [Spark Branc
[
https://issues.apache.org/jira/browse/HIVE-8536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14237423#comment-14237423
]
Hive QA commented on HIVE-8536:
---
{color:red}Overall{color}: -1 at least one tests failed
H
[
https://issues.apache.org/jira/browse/HIVE-8536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14237359#comment-14237359
]
Rui Li commented on HIVE-8536:
--
Hi [~xuefuz], my uncertainty is mainly about the # map join ta
[
https://issues.apache.org/jira/browse/HIVE-8536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14236364#comment-14236364
]
Xuefu Zhang commented on HIVE-8536:
---
Hi [~lirui], in your original research doc, you seem
[
https://issues.apache.org/jira/browse/HIVE-8536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14235146#comment-14235146
]
Xuefu Zhang commented on HIVE-8536:
---
Hi [~lirui], I think we can disable SparkSkewJoinRes
[
https://issues.apache.org/jira/browse/HIVE-8536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14233870#comment-14233870
]
Rui Li commented on HIVE-8536:
--
The failures and diff in query plan is expected.
We can disabl
[
https://issues.apache.org/jira/browse/HIVE-8536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14232643#comment-14232643
]
Hive QA commented on HIVE-8536:
---
{color:red}Overall{color}: -1 at least one tests failed
H
[
https://issues.apache.org/jira/browse/HIVE-8536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14232500#comment-14232500
]
Szehon Ho commented on HIVE-8536:
-
Great. +1 pending tests
> Enable SkewJoinResolver for
[
https://issues.apache.org/jira/browse/HIVE-8536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14225677#comment-14225677
]
Rui Li commented on HIVE-8536:
--
Thanks [~csun], I can verify this later. For now, let's stick
[
https://issues.apache.org/jira/browse/HIVE-8536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14225643#comment-14225643
]
Chao commented on HIVE-8536:
[~lirui] I couldn't think up a query that has skewjoin AND multi-i
[
https://issues.apache.org/jira/browse/HIVE-8536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14225565#comment-14225565
]
Rui Li commented on HIVE-8536:
--
Hi [~csun] thanks for your input.
I'm removing the dependency
[
https://issues.apache.org/jira/browse/HIVE-8536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14224712#comment-14224712
]
Chao commented on HIVE-8536:
[~lirui] Yes, I remember dependency task is for multi-insert, so t
[
https://issues.apache.org/jira/browse/HIVE-8536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14224299#comment-14224299
]
Rui Li commented on HIVE-8536:
--
It seems the dependency task is created in {{GenSparkProcConte
[
https://issues.apache.org/jira/browse/HIVE-8536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14224182#comment-14224182
]
Rui Li commented on HIVE-8536:
--
OK I'll take a look.
> Enable SkewJoinResolver for spark [Spa
[
https://issues.apache.org/jira/browse/HIVE-8536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14224179#comment-14224179
]
Szehon Ho commented on HIVE-8536:
-
I honestly dont know too much about DependencyCollection
[
https://issues.apache.org/jira/browse/HIVE-8536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14224122#comment-14224122
]
Rui Li commented on HIVE-8536:
--
Hi [~szehon],
{{skewjoin_noskew}} failed to run because our r
[
https://issues.apache.org/jira/browse/HIVE-8536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14223025#comment-14223025
]
Hive QA commented on HIVE-8536:
---
{color:red}Overall{color}: -1 at least one tests failed
H
[
https://issues.apache.org/jira/browse/HIVE-8536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14222964#comment-14222964
]
Rui Li commented on HIVE-8536:
--
With the latest patch, the previous example query plan is:
{no
[
https://issues.apache.org/jira/browse/HIVE-8536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14221726#comment-14221726
]
Rui Li commented on HIVE-8536:
--
Got it. Thanks [~csun] for the explanation.
> Enable SkewJoin
[
https://issues.apache.org/jira/browse/HIVE-8536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14221721#comment-14221721
]
Chao commented on HIVE-8536:
Hi [~lirui], SparkMapJoinResolver will expect Map 4 to depend on M
[
https://issues.apache.org/jira/browse/HIVE-8536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14221716#comment-14221716
]
Szehon Ho commented on HIVE-8536:
-
Got it.
[~csun] may correct me if wrong, but I believ
[
https://issues.apache.org/jira/browse/HIVE-8536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14221696#comment-14221696
]
Rui Li commented on HIVE-8536:
--
[~szehon] - thanks for the review! Stage 3 is not split becaus
[
https://issues.apache.org/jira/browse/HIVE-8536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14221655#comment-14221655
]
Szehon Ho commented on HIVE-8536:
-
Great work Rui! Left comments on the review-board.
Sta
[
https://issues.apache.org/jira/browse/HIVE-8536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14220915#comment-14220915
]
Hive QA commented on HIVE-8536:
---
{color:red}Overall{color}: -1 at least one tests failed
H
[
https://issues.apache.org/jira/browse/HIVE-8536?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14220838#comment-14220838
]
Rui Li commented on HIVE-8536:
--
{noformat}
Listening for transport dt_socket at address: 5005
25 matches
Mail list logo