[jira] [Commented] (HIVE-16114) NullPointerException in TezSessionPoolManager when getting the session
[
https://issues.apache.org/jira/browse/HIVE-16114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15901992#comment-15901992
]
Hive QA commented on HIVE-16114:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12856770/HIVE-16114.2.patch
{color:red}ERROR:{color} -1 due to no test(s) being added or modified.
{color:red}ERROR:{color} -1 due to 1 failed/errored test(s), 10333 tests
executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[schema_evol_text_vec_table]
(batchId=147)
{noformat}
Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/4024/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/4024/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-4024/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 1 tests failed
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12856770 - PreCommit-HIVE-Build
> NullPointerException in TezSessionPoolManager when getting the session
> --
>
> Key: HIVE-16114
> URL: https://issues.apache.org/jira/browse/HIVE-16114
> Project: Hive
> Issue Type: Bug
> Components: HiveServer2
>Reporter: Zhihua Deng
>Assignee: Zhihua Deng
>Priority: Minor
> Attachments: HIVE-16114.1.patch, HIVE-16114.2.patch, HIVE-16114.patch
>
>
> hive version: apache-hive-2.1.1
> we use hue(3.11.0) connecting to the HiveServer2. when hue starts up, it
> works with no problems, a few hours passed, when we use the same sql, an
> exception about unable to execute TezTask will come into being.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Commented] (HIVE-16114) NullPointerException in TezSessionPoolManager when getting the session
[ https://issues.apache.org/jira/browse/HIVE-16114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15901844#comment-15901844 ] Sergey Shelukhin commented on HIVE-16114: - +1, thanks for the patch! Will commit later today if noone objects. cc [~sseth] > NullPointerException in TezSessionPoolManager when getting the session > -- > > Key: HIVE-16114 > URL: https://issues.apache.org/jira/browse/HIVE-16114 > Project: Hive > Issue Type: Bug > Components: HiveServer2 >Reporter: Zhihua Deng >Assignee: Zhihua Deng >Priority: Minor > Attachments: HIVE-16114.1.patch, HIVE-16114.2.patch, HIVE-16114.patch > > > hive version: apache-hive-2.1.1 > we use hue(3.11.0) connecting to the HiveServer2. when hue starts up, it > works with no problems, a few hours passed, when we use the same sql, an > exception about unable to execute TezTask will come into being. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (HIVE-16114) NullPointerException in TezSessionPoolManager when getting the session
[ https://issues.apache.org/jira/browse/HIVE-16114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15900910#comment-15900910 ] Zhihua Deng commented on HIVE-16114: fixed the test failures shown above and passed on my laptop. > NullPointerException in TezSessionPoolManager when getting the session > -- > > Key: HIVE-16114 > URL: https://issues.apache.org/jira/browse/HIVE-16114 > Project: Hive > Issue Type: Bug > Components: HiveServer2 >Reporter: Zhihua Deng >Assignee: Zhihua Deng >Priority: Minor > Attachments: HIVE-16114.1.patch, HIVE-16114.2.patch, HIVE-16114.patch > > > hive version: apache-hive-2.1.1 > we use hue(3.11.0) connecting to the HiveServer2. when hue starts up, it > works with no problems, a few hours passed, when we use the same sql, an > exception about unable to execute TezTask will come into being. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (HIVE-16114) NullPointerException in TezSessionPoolManager when getting the session
[ https://issues.apache.org/jira/browse/HIVE-16114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15900128#comment-15900128 ] Sergey Shelukhin commented on HIVE-16114: - testGetNonDefaultSession failure may be related > NullPointerException in TezSessionPoolManager when getting the session > -- > > Key: HIVE-16114 > URL: https://issues.apache.org/jira/browse/HIVE-16114 > Project: Hive > Issue Type: Bug > Components: HiveServer2 >Reporter: Zhihua Deng >Assignee: Zhihua Deng >Priority: Minor > Attachments: HIVE-16114.1.patch, HIVE-16114.patch > > > hive version: apache-hive-2.1.1 > we use hue(3.11.0) connecting to the HiveServer2. when hue starts up, it > works with no problems, a few hours passed, when we use the same sql, an > exception about unable to execute TezTask will come into being. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (HIVE-16114) NullPointerException in TezSessionPoolManager when getting the session
[
https://issues.apache.org/jira/browse/HIVE-16114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15899891#comment-15899891
]
Hive QA commented on HIVE-16114:
Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12856595/HIVE-16114.1.patch
{color:red}ERROR:{color} -1 due to no test(s) being added or modified.
{color:red}ERROR:{color} -1 due to 5 failed/errored test(s), 10328 tests
executed
*Failed tests:*
{noformat}
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[schema_evol_text_vec_table]
(batchId=147)
org.apache.hadoop.hive.cli.TestMiniLlapLocalCliDriver.testCliDriver[vector_if_expr]
(batchId=140)
org.apache.hadoop.hive.cli.TestPerfCliDriver.testCliDriver[query23]
(batchId=224)
org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver[vector_between_in]
(batchId=119)
org.apache.hadoop.hive.ql.exec.tez.TestTezSessionPool.testGetNonDefaultSession
(batchId=264)
{noformat}
Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/3998/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/3998/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-3998/
Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 5 tests failed
{noformat}
This message is automatically generated.
ATTACHMENT ID: 12856595 - PreCommit-HIVE-Build
> NullPointerException in TezSessionPoolManager when getting the session
> --
>
> Key: HIVE-16114
> URL: https://issues.apache.org/jira/browse/HIVE-16114
> Project: Hive
> Issue Type: Bug
> Components: HiveServer2
>Reporter: Zhihua Deng
>Assignee: Zhihua Deng
>Priority: Minor
> Attachments: HIVE-16114.1.patch, HIVE-16114.patch
>
>
> hive version: apache-hive-2.1.1
> we use hue(3.11.0) connecting to the HiveServer2. when hue starts up, it
> works with no problems, a few hours passed, when we use the same sql, an
> exception about unable to execute TezTask will come into being.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Commented] (HIVE-16114) NullPointerException in TezSessionPoolManager when getting the session
[ https://issues.apache.org/jira/browse/HIVE-16114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15899395#comment-15899395 ] Zhihua Deng commented on HIVE-16114: Thanks [~sershe]. Add some comments in TezTask as needed. > NullPointerException in TezSessionPoolManager when getting the session > -- > > Key: HIVE-16114 > URL: https://issues.apache.org/jira/browse/HIVE-16114 > Project: Hive > Issue Type: Bug > Components: HiveServer2 >Reporter: Zhihua Deng >Assignee: Zhihua Deng >Priority: Minor > Attachments: HIVE-16114.1.patch, HIVE-16114.patch > > > hive version: apache-hive-2.1.1 > we use hue(3.11.0) connecting to the HiveServer2. when hue starts up, it > works with no problems, a few hours passed, when we use the same sql, an > exception about unable to execute TezTask will come into being. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (HIVE-16114) NullPointerException in TezSessionPoolManager when getting the session
[ https://issues.apache.org/jira/browse/HIVE-16114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15898607#comment-15898607 ] Sergey Shelukhin commented on HIVE-16114: - The patch makes sense to me... I wonder though how a closed session state ends up there. Can you add a warning if the session is closed? Might be worth checking and adding it even in TezTask, near the "Need to remove this static hack" comment :) > NullPointerException in TezSessionPoolManager when getting the session > -- > > Key: HIVE-16114 > URL: https://issues.apache.org/jira/browse/HIVE-16114 > Project: Hive > Issue Type: Bug > Components: HiveServer2 >Reporter: Zhihua Deng >Assignee: Zhihua Deng >Priority: Minor > Attachments: HIVE-16114.patch > > > hive version: apache-hive-2.1.1 > we use hue(3.11.0) connecting to the HiveServer2. when hue starts up, it > works with no problems, a few hours passed, when we use the same sql, an > exception about unable to execute TezTask will come into being. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (HIVE-16114) NullPointerException in TezSessionPoolManager when getting the session
[ https://issues.apache.org/jira/browse/HIVE-16114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15896695#comment-15896695 ] Zhihua Deng commented on HIVE-16114: [~sershe] can you take a look? thanks > NullPointerException in TezSessionPoolManager when getting the session > -- > > Key: HIVE-16114 > URL: https://issues.apache.org/jira/browse/HIVE-16114 > Project: Hive > Issue Type: Bug > Components: HiveServer2 >Reporter: Zhihua Deng >Priority: Minor > Attachments: HIVE-16114.patch > > > hive version: apache-hive-2.1.1 > we use hue(3.11.0) connecting to the HiveServer2. when hue starts up, it > works with no problems, a few hours passed, when we use the same sql, an > exception about unable to execute TezTask will come into being. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (HIVE-16114) NullPointerException in TezSessionPoolManager when getting the session
[ https://issues.apache.org/jira/browse/HIVE-16114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15896682#comment-15896682 ] Zhihua Deng commented on HIVE-16114: the blame code snippet: if (doAsEnabled != session.getConf().getBoolVar(HiveConf.ConfVars.HIVE_SERVER2_ENABLE_DOAS)) it seems that the session got from threadlocal has not been opened yet or has been closed, So the session.getConf() is probably null. > NullPointerException in TezSessionPoolManager when getting the session > -- > > Key: HIVE-16114 > URL: https://issues.apache.org/jira/browse/HIVE-16114 > Project: Hive > Issue Type: Bug > Components: HiveServer2 >Reporter: Zhihua Deng >Priority: Minor > > hive version: apache-hive-2.1.1 > we use hue(3.11.0) connecting to the HiveServer2. when hue starts up, it > works with no problems, a few hours passed, when we use the same sql, an > exception about unable to initialize TezTask will come into being. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
[jira] [Commented] (HIVE-16114) NullPointerException in TezSessionPoolManager when getting the session
[ https://issues.apache.org/jira/browse/HIVE-16114?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15896677#comment-15896677 ] Zhihua Deng commented on HIVE-16114: the corresponding HiveServer2 stack: 2017-03-02T10:50:31,986 ERROR [HiveServer2-Background-Pool: Thread-982] exec.Task: Failed to execute tez graph. java.lang.NullPointerException at org.apache.hadoop.hive.ql.exec.tez.TezSessionPoolManager.canWorkWithSameSession(TezSessionPoolManager.java:430) at org.apache.hadoop.hive.ql.exec.tez.TezSessionPoolManager.getSession(TezSessionPoolManager.java:451) at org.apache.hadoop.hive.ql.exec.tez.TezSessionPoolManager.getSession(TezSessionPoolManager.java:396) at org.apache.hadoop.hive.ql.exec.tez.TezTask.execute(TezTask.java:134) at org.apache.hadoop.hive.ql.exec.Task.executeTask(Task.java:197) at org.apache.hadoop.hive.ql.exec.TaskRunner.runSequential(TaskRunner.java:100) at org.apache.hadoop.hive.ql.Driver.launchTask(Driver.java:2073) at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1744) at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1453) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1171) at org.apache.hadoop.hive.ql.Driver.run(Driver.java:1166) at org.apache.hive.service.cli.operation.SQLOperation.runQuery(SQLOperation.java:242) at org.apache.hive.service.cli.operation.SQLOperation.access$800(SQLOperation.java:91) at org.apache.hive.service.cli.operation.SQLOperation$BackgroundWork$1.run(SQLOperation.java:334) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1660) at org.apache.hive.service.cli.operation.SQLOperation$BackgroundWork.run(SQLOperation.java:347) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) at java.util.concurrent.FutureTask.run(FutureTask.java:266) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) at java.lang.Thread.run(Thread.java:745) > NullPointerException in TezSessionPoolManager when getting the session > -- > > Key: HIVE-16114 > URL: https://issues.apache.org/jira/browse/HIVE-16114 > Project: Hive > Issue Type: Bug > Components: HiveServer2 >Reporter: Zhihua Deng >Priority: Minor > > hive version: apache-hive-2.1.1 > we use hue(3.11.0) connecting to the HiveServer2. when hue starts up, it > works with no problems, a few hours passed, when we use the same sql, an > exception about unable to initialize TezTask will come into being. -- This message was sent by Atlassian JIRA (v6.3.15#6346)
