[
https://issues.apache.org/jira/browse/LENS-300?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Arshad Matin updated LENS-300:
------------------------------
Description:
Scenario : If session gets closed while the query is still getting submitted
then it will throw NPE
{noformat}
09 Feb 2015 19:22:15,934 [QuerySubmitter] INFO
org.apache.lens.driver.hive.HiveDriver - New hive session for user: test, lens
session: 18166fa3-a0e1-4530-9f99-80a0aaef9adf session handle:
994c099a-6a3c-49c3-a25f-f42f6db44f2c
09 Feb 2015 19:22:15,934 [QuerySubmitter] INFO
org.apache.lens.server.query.QueryExecutionServiceImpl - New driver event by
driver org.apache.lens.driver.hive.HiveDriver@77424e9
09 Feb 2015 19:22:15,934 [QuerySubmitter] WARN
org.apache.lens.server.query.QueryExecutionServiceImpl - Lens session went
away for sessionid:18166fa3-a0e1-4530-9f99-80a0aaef9adf
09 Feb 2015 19:22:15,968 [QuerySubmitter] INFO
org.apache.lens.driver.hive.HiveDriver - No hive operation available for
91c18966-7fe4-47de-b0a7-3519df1e2a27
09 Feb 2015 19:22:15,968 [QuerySubmitter] ERROR
org.apache.lens.server.query.QueryExecutionServiceImpl - Error launching query
91c18966-7fe4-47de-b0a7-3519df1e2a27
org.apache.lens.api.LensException: Error executing async query
at
org.apache.lens.driver.hive.HiveDriver.executeAsync(HiveDriver.java:443)
at
org.apache.lens.server.query.QueryExecutionServiceImpl$QuerySubmitter.run(QueryExecutionServiceImpl.java:483)
at java.lang.Thread.run(Thread.java:701)
Caused by: org.apache.hive.service.cli.HiveSQLException: Error while compiling
statement: FAILED: SemanticException java.lang.RuntimeException:
java.lang.ClassNotFoundException: org.apache.lens.lib.query.CSVSerde
at
org.apache.hive.service.cli.thrift.ThriftCLIServiceClient.checkStatus(ThriftCLIServiceClient.java:52)
at
org.apache.hive.service.cli.thrift.ThriftCLIServiceClient.executeStatementInternal(ThriftCLIServiceClient.java:151)
at
org.apache.hive.service.cli.thrift.ThriftCLIServiceClient.executeStatementAsync(ThriftCLIServiceClient.java:139)
at sun.reflect.GeneratedMethodAccessor26.invoke(Unknown Source)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:622)
at
org.apache.hive.service.cli.thrift.RetryingThriftCLIServiceClient.invokeInternal(RetryingThriftCLIServiceClient.java:301)
at
org.apache.hive.service.cli.thrift.RetryingThriftCLIServiceClient.invoke(RetryingThriftCLIServiceClient.java:329)
at com.sun.proxy.$Proxy56.executeStatementAsync(Unknown Source)
at
org.apache.hive.service.cli.thrift.RetryingThriftCLIServiceClient$CLIServiceClientWrapper.executeStatementAsync(RetryingThriftCLIServiceClient.java:118)
at
org.apache.lens.driver.hive.HiveDriver.executeAsync(HiveDriver.java:434)
... 2 more
09 Feb 2015 19:22:15,969 [QuerySubmitter] ERROR
org.apache.lens.server.query.QueryExecutionServiceImpl - Error in query
submitter
java.lang.NullPointerException
at
org.apache.lens.server.LensService.getHiveSessionHandle(LensService.java:349)
at org.apache.lens.server.LensService.getSession(LensService.java:245)
at org.apache.lens.server.LensService.release(LensService.java:298)
at
org.apache.lens.server.query.QueryExecutionServiceImpl$QuerySubmitter.run(QueryExecutionServiceImpl.java:490)
at java.lang.Thread.run(Thread.java:701)
{noformat}
was:
Scenario : Some queries are in queued state and restarted the lens server. Got
NPE when server tried to rerun it
{noformat}
09 Feb 2015 18:23:13,986 [QuerySubmitter] INFO hive.ql.parse.ParseDriver -
Parsing command: cube select id,name from sample_db_dim where name != 'first'
09 Feb 2015 18:23:13,987 [QuerySubmitter] INFO hive.ql.parse.ParseDriver -
Parse Completed
09 Feb 2015 18:23:13,987 [QuerySubmitter] WARN
org.apache.lens.driver.cube.RewriteUtil - Driver :
org.apache.lens.driver.hive.HiveDriver Skipped for the query rewriting due to
java.lang.NullPointerException
at
org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.processTable(SemanticAnalyzer.java:658)
at
org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.doPhase1(SemanticAnalyzer.java:982)
at
org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.doPhase1(SemanticAnalyzer.java:1186)
at
org.apache.lens.cube.parse.CubeSemanticAnalyzer.analyzeInternal(CubeSemanticAnalyzer.java:72)
at
org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:327)
at
org.apache.lens.cube.parse.CubeQueryRewriter.rewrite(CubeQueryRewriter.java:168)
at
org.apache.lens.cube.parse.CubeQueryRewriter.rewrite(CubeQueryRewriter.java:181)
at
org.apache.lens.driver.cube.RewriteUtil.rewriteQuery(RewriteUtil.java:247)
at
org.apache.lens.server.query.QueryExecutionServiceImpl.rewriteAndSelect(QueryExecutionServiceImpl.java:970)
at
org.apache.lens.server.query.QueryExecutionServiceImpl.access$800(QueryExecutionServiceImpl.java:91)
at
org.apache.lens.server.query.QueryExecutionServiceImpl$QuerySubmitter.run(QueryExecutionServiceImpl.java:479)
at java.lang.Thread.run(Thread.java:701)
09 Feb 2015 18:23:13,987 [QuerySubmitter] ERROR
org.apache.lens.server.query.QueryExecutionServiceImpl - Error launching query
242ffe1c-c411-4224-94dd-866a745035c7
org.apache.lens.api.LensException: Rewriting failed, cause :No driver accepted
the query, because null
at
org.apache.lens.driver.cube.RewriteUtil.rewriteQuery(RewriteUtil.java:277)
at
org.apache.lens.server.query.QueryExecutionServiceImpl.rewriteAndSelect(QueryExecutionServiceImpl.java:970)
at
org.apache.lens.server.query.QueryExecutionServiceImpl.access$800(QueryExecutionServiceImpl.java:91)
at
org.apache.lens.server.query.QueryExecutionServiceImpl$QuerySubmitter.run(QueryExecutionServiceImpl.java:479)
at java.lang.Thread.run(Thread.java:701)
Caused by: org.apache.lens.api.LensException: No driver accepted the query,
because null
at
org.apache.lens.driver.cube.RewriteUtil.rewriteQuery(RewriteUtil.java:272)
... 4 more
09 Feb 2015 18:23:13,987 [QuerySubmitter] ERROR
org.apache.lens.server.query.QueryExecutionServiceImpl - Error in query
submitter
java.lang.NullPointerException
at
org.apache.lens.server.LensService.getHiveSessionHandle(LensService.java:349)
at org.apache.lens.server.LensService.getSession(LensService.java:245)
at org.apache.lens.server.LensService.release(LensService.java:298)
at
org.apache.lens.server.query.QueryExecutionServiceImpl$QuerySubmitter.run(QueryExecutionServiceImpl.java:490)
at java.lang.Thread.run(Thread.java:701)
{noformat}
> NPE while restarting lens-server when some queries are in "QUEUED" state
> ------------------------------------------------------------------------
>
> Key: LENS-300
> URL: https://issues.apache.org/jira/browse/LENS-300
> Project: Apache Lens
> Issue Type: Bug
> Reporter: Arshad Matin
>
> Scenario : If session gets closed while the query is still getting submitted
> then it will throw NPE
> {noformat}
> 09 Feb 2015 19:22:15,934 [QuerySubmitter] INFO
> org.apache.lens.driver.hive.HiveDriver - New hive session for user: test,
> lens session: 18166fa3-a0e1-4530-9f99-80a0aaef9adf session handle:
> 994c099a-6a3c-49c3-a25f-f42f6db44f2c
> 09 Feb 2015 19:22:15,934 [QuerySubmitter] INFO
> org.apache.lens.server.query.QueryExecutionServiceImpl - New driver event by
> driver org.apache.lens.driver.hive.HiveDriver@77424e9
> 09 Feb 2015 19:22:15,934 [QuerySubmitter] WARN
> org.apache.lens.server.query.QueryExecutionServiceImpl - Lens session went
> away for sessionid:18166fa3-a0e1-4530-9f99-80a0aaef9adf
> 09 Feb 2015 19:22:15,968 [QuerySubmitter] INFO
> org.apache.lens.driver.hive.HiveDriver - No hive operation available for
> 91c18966-7fe4-47de-b0a7-3519df1e2a27
> 09 Feb 2015 19:22:15,968 [QuerySubmitter] ERROR
> org.apache.lens.server.query.QueryExecutionServiceImpl - Error launching
> query 91c18966-7fe4-47de-b0a7-3519df1e2a27
> org.apache.lens.api.LensException: Error executing async query
> at
> org.apache.lens.driver.hive.HiveDriver.executeAsync(HiveDriver.java:443)
> at
> org.apache.lens.server.query.QueryExecutionServiceImpl$QuerySubmitter.run(QueryExecutionServiceImpl.java:483)
> at java.lang.Thread.run(Thread.java:701)
> Caused by: org.apache.hive.service.cli.HiveSQLException: Error while
> compiling statement: FAILED: SemanticException java.lang.RuntimeException:
> java.lang.ClassNotFoundException: org.apache.lens.lib.query.CSVSerde
> at
> org.apache.hive.service.cli.thrift.ThriftCLIServiceClient.checkStatus(ThriftCLIServiceClient.java:52)
> at
> org.apache.hive.service.cli.thrift.ThriftCLIServiceClient.executeStatementInternal(ThriftCLIServiceClient.java:151)
> at
> org.apache.hive.service.cli.thrift.ThriftCLIServiceClient.executeStatementAsync(ThriftCLIServiceClient.java:139)
> at sun.reflect.GeneratedMethodAccessor26.invoke(Unknown Source)
> at
> sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:622)
> at
> org.apache.hive.service.cli.thrift.RetryingThriftCLIServiceClient.invokeInternal(RetryingThriftCLIServiceClient.java:301)
> at
> org.apache.hive.service.cli.thrift.RetryingThriftCLIServiceClient.invoke(RetryingThriftCLIServiceClient.java:329)
> at com.sun.proxy.$Proxy56.executeStatementAsync(Unknown Source)
> at
> org.apache.hive.service.cli.thrift.RetryingThriftCLIServiceClient$CLIServiceClientWrapper.executeStatementAsync(RetryingThriftCLIServiceClient.java:118)
> at
> org.apache.lens.driver.hive.HiveDriver.executeAsync(HiveDriver.java:434)
> ... 2 more
> 09 Feb 2015 19:22:15,969 [QuerySubmitter] ERROR
> org.apache.lens.server.query.QueryExecutionServiceImpl - Error in query
> submitter
> java.lang.NullPointerException
> at
> org.apache.lens.server.LensService.getHiveSessionHandle(LensService.java:349)
> at org.apache.lens.server.LensService.getSession(LensService.java:245)
> at org.apache.lens.server.LensService.release(LensService.java:298)
> at
> org.apache.lens.server.query.QueryExecutionServiceImpl$QuerySubmitter.run(QueryExecutionServiceImpl.java:490)
> at java.lang.Thread.run(Thread.java:701)
> {noformat}
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)