[ 
https://issues.apache.org/jira/browse/HIVE-13525?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Rui Li updated HIVE-13525:
--------------------------
    Attachment: HIVE-13525.3.patch

Update patch to solve the metrics lost problem.

Due to SPARK-14958, it's still possible the job can hang if task fails. What we 
can do on our side to mitigate it is:
# Avoid task failure.
# Avoid deserialization error that triggers SPARK-14958.

For 1, the v3 patch makes HoS able to handle empty small table for map join.
For 2, the error that triggers SPARK-14958 is {{NoClassDefFoundError: 
org/antlr/runtime/tree/CommonTree}}. So the v3 patch adds {{antlr-runtime}} to 
driver's class path.
With the patch all the disabled tests can run (but may fail). I'll fix and 
re-enable them in a follow on JIRA.

> HoS hangs when job is empty
> ---------------------------
>
>                 Key: HIVE-13525
>                 URL: https://issues.apache.org/jira/browse/HIVE-13525
>             Project: Hive
>          Issue Type: Bug
>            Reporter: Rui Li
>            Assignee: Rui Li
>         Attachments: HIVE-13525.1.patch, HIVE-13525.2.patch, 
> HIVE-13525.3.patch
>
>
> Observed in local tests. This should be the cause of HIVE-13402.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to