[ https://issues.apache.org/jira/browse/KYLIN-3518?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16610072#comment-16610072 ]
ASF subversion and git services commented on KYLIN-3518: -------------------------------------------------------- Commit 45b20ca17a6070c35d3a8967f595a06cbae3a108 in kylin's branch refs/heads/2.5.x-hadoop3.1 from [~caolijun1166] [ https://gitbox.apache.org/repos/asf?p=kylin.git;h=45b20ca ] KYLIN-3518 Fix Coprocessor NPE problem on hbase 2 > Coprocessor reports NPE when execute a query on HBase 2.0 > --------------------------------------------------------- > > Key: KYLIN-3518 > URL: https://issues.apache.org/jira/browse/KYLIN-3518 > Project: Kylin > Issue Type: Bug > Components: Storage - HBase > Reporter: Shaofeng SHI > Assignee: Lijun Cao > Priority: Major > Fix For: v2.5.0 > > > On HDP 3.0, build a cube and then run a simple count query, NPE occurred: > > {code:java} > 2018-08-28 01:30:16,969 DEBUG [Query f7bf8004-b516-e372-18df-0d507075d471-71] > v2.CubeHBaseRPC:315 : hbase.rpc.timeout = 90000 ms, use 81000 ms as timeout > for coprocessor > 2018-08-28 01:30:16,983 INFO [Query f7bf8004-b516-e372-18df-0d507075d471-71] > v2.CubeHBaseEndpointRPC:141 : Serialized scanRequestBytes 522 bytes, > rawScanBytesString 44 bytes > 2018-08-28 01:30:16,984 INFO [Query f7bf8004-b516-e372-18df-0d507075d471-71] > v2.CubeHBaseEndpointRPC:143 : The scan 67b41fc6 for segment > kylin_sales_cube_clone[20120101000000_20130101000000] is as below with 1 > separate raw scans, shard part of start/end key is set to 0 > 2018-08-28 01:30:16,991 INFO [Query f7bf8004-b516-e372-18df-0d507075d471-71] > v2.CubeHBaseRPC:288 : Visiting hbase table KYLIN_5Q088VO5I0: cuboid require > post aggregation, from 0 to 16384 Start: > \x00\x00\x00\x00\x00\x00\x00\x00\x40\x00\x00\x00\x00 > (\x00\x00\x00\x00\x00\x00\x00\x00@\x00\x00\x00\x00) Stop: > \x00\x00\x00\x00\x00\x00\x00\x00\x40\x00\xFF\xFF\xFF\x00 > (\x00\x00\x00\x00\x00\x00\x00\x00@\x00\xFF\xFF\xFF\x00), No Fuzzy Key > 2018-08-28 01:30:16,991 DEBUG [Query f7bf8004-b516-e372-18df-0d507075d471-71] > v2.CubeHBaseEndpointRPC:148 : Submitting rpc to 1 shards starting from shard > 0, scan range count 1 > 2018-08-28 01:30:17,010 INFO [Query f7bf8004-b516-e372-18df-0d507075d471-71] > common.KylinConfig:332 : Loading kylin-defaults.properties from > file:/root/shaofengshi/apache-kylin-2.5.0-SNAPSHOT-bin/tomcat/webapps/kylin/WEB-INF/lib/kylin-core-common-2.5.0-SNAPSHOT.jar!/kylin-defaults.properties > 2018-08-28 01:30:17,033 DEBUG [Query f7bf8004-b516-e372-18df-0d507075d471-71] > common.KylinConfig:291 : KYLIN_CONF property was not set, will seek > KYLIN_HOME env variable > 2018-08-28 01:30:17,051 INFO [pool-14-thread-1] hbase.HBaseConnection:110 : > Creating coprocessor thread pool with max of 2048, core of 2048 > 2018-08-28 01:30:17,094 INFO [Query f7bf8004-b516-e372-18df-0d507075d471-71] > gtrecord.SequentialCubeTupleIterator:73 : Using SortedIteratorMergerWithLimit > to merge segment results > 2018-08-28 01:30:17,097 DEBUG [Query f7bf8004-b516-e372-18df-0d507075d471-71] > enumerator.OLAPEnumerator:117 : return TupleIterator... > 2018-08-28 01:30:21,607 INFO [kylin-coproc--pool9-t1] > client.RpcRetryingCallerImpl:134 : Call exception, tries=6, retries=6, > started=4410 ms ago, cancelled=false, msg=java.io.IOException > at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:468) > at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:131) > at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:324) > at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:304) > Caused by: java.lang.NullPointerException > at > org.apache.kylin.storage.hbase.cube.v2.coprocessor.endpoint.CubeVisitService.visitCube(CubeVisitService.java:253) > at > org.apache.kylin.storage.hbase.cube.v2.coprocessor.endpoint.generated.CubeVisitProtos$CubeVisitService.callMethod(CubeVisitProtos.java:5555) > at org.apache.hadoop.hbase.regionserver.HRegion.execService(HRegion.java:8032) > at > org.apache.hadoop.hbase.regionserver.RSRpcServices.execServiceOnRegion(RSRpcServices.java:2426) > at > org.apache.hadoop.hbase.regionserver.RSRpcServices.execService(RSRpcServices.java:2408) > at > org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:42010) > at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:409) > ... 3 more > , details=row '' on table 'KYLIN_5Q088VO5I0' at > region=KYLIN_5Q088VO5I0,,1535417272444.27b82cb4702db4557a98b9a7e60b7692., > hostname=ignite03.com,16020,1534313612401, seqNum=2 > 2018-08-28 01:30:25,633 INFO [kylin-coproc--pool9-t1] > client.RpcRetryingCallerImpl:134 : Call exception, tries=7, retries=7, > started=8436 ms ago, cancelled=false, msg=java.io.IOException > at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:468) > at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:131) > at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:324) > at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:304) > Caused by: java.lang.NullPointerException > at > org.apache.kylin.storage.hbase.cube.v2.coprocessor.endpoint.CubeVisitService.visitCube(CubeVisitService.java:253) > at > org.apache.kylin.storage.hbase.cube.v2.coprocessor.endpoint.generated.CubeVisitProtos$CubeVisitService.callMethod(CubeVisitProtos.java:5555) > at org.apache.hadoop.hbase.regionserver.HRegion.execService(HRegion.java:8032) > at > org.apache.hadoop.hbase.regionserver.RSRpcServices.execServiceOnRegion(RSRpcServices.java:2426) > at > org.apache.hadoop.hbase.regionserver.RSRpcServices.execService(RSRpcServices.java:2408) > at > org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:42010) > at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:409) > ... 3 more > {code} -- This message was sent by Atlassian JIRA (v7.6.3#76005)