[
https://issues.apache.org/jira/browse/HIVE-21796?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16855973#comment-16855973
]
Hive QA commented on HIVE-21796:
--------------------------------
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12970829/HIVE-21796.1.patch
{color:green}SUCCESS:{color} +1 due to 1 test(s) being added or modified.
{color:green}SUCCESS:{color} +1 due to 16080 tests passed
Test results:
https://builds.apache.org/job/PreCommit-HIVE-Build/17418/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/17418/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-17418/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.YetusPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12970829 - PreCommit-HIVE-Build
> ArrayWritableObjectInspector.equals can take O(2^nesting_depth) time
> --------------------------------------------------------------------
>
> Key: HIVE-21796
> URL: https://issues.apache.org/jira/browse/HIVE-21796
> Project: Hive
> Issue Type: Bug
> Reporter: Csaba Ringhofer
> Assignee: Csaba Ringhofer
> Priority: Major
> Attachments: HIVE-21796.1.patch, HIVE-21796.patch, jstack.txt
>
>
> The issue came up during an Impala test when we tried to run it with Hive
> 3.1. The a query hanged: it tried to insert 1 row from a Parquet file with a
> 99 level nested column to a similar Orc file, and spent its time in
> ArrayWritableObjectInspector.equals() according to jstack.
> The problem seems to be that equals() calls both fields.equals(that.fields)
> and fieldsByName.equals(that.fieldsByName), and both try to compare all
> nested fields recursively, which leads to the O(2^nesting_depth) complexity.
> The commit that introduced this behavior:
> https://github.com/apache/hive/commit/98a25f2d831ab27e174bc99792047eaa8ec08b82#diff-8c6363e90d442f239bc252a104f1bfed
> The Impala test:
> https://github.com/apache/impala/blob/9ee4a5e1940afa47227a92e0f6fba6d4c9909f63/tests/query_test/test_nested_types.py#L612
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
