[
https://issues.apache.org/jira/browse/KYLIN-4040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16866197#comment-16866197
]
Marc Wu commented on KYLIN-4040:
--------------------------------
Thanks, [~hit_lacus]. I'll have a try.
Have you got HBase RPC timeout also? I'm facing plenty of them, and the
RegionServer just went to dead. Any suggestions for proper value of HBase
settings?
{code:java}
2019-06-18 03:42:30,667 ERROR [FetcherRunner 1899404826-285]
dao.ExecutableDao:292 : error get all Jobs:
org.apache.hadoop.hbase.client.RetriesExhaustedException: Failed after
attempts=1, exceptions:
Tue Jun 18 03:42:30 UTC 2019, RpcRetryingCaller{globalStartTime=1560829341431,
pause=100, retries=1}, java.io.IOException: Call to
sandbox.hortonworks.com/192.168.40.129:16020 failed on local exception:
org.apache.hadoop.hbase.ipc.CallTimeoutException: Call id=4595, waitTime=9015,
operationTimeout=5000 expired.
at
org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithRetries(RpcRetryingCaller.java:147)
at
org.apache.hadoop.hbase.client.ResultBoundedCompletionService$QueueingFuture.run(ResultBoundedCompletionService.java:64)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.io.IOException: Call to
sandbox.hortonworks.com/192.168.40.129:16020 failed on local exception:
org.apache.hadoop.hbase.ipc.CallTimeoutException: Call id=4595, waitTime=9015,
operationTimeout=5000 expired.
at
org.apache.hadoop.hbase.ipc.RpcClientImpl.wrapException(RpcClientImpl.java:1242)
at org.apache.hadoop.hbase.ipc.RpcClientImpl.call(RpcClientImpl.java:1210)
at
org.apache.hadoop.hbase.ipc.AbstractRpcClient.callBlockingMethod(AbstractRpcClient.java:213)
at
org.apache.hadoop.hbase.ipc.AbstractRpcClient$BlockingRpcChannelImplementation.callBlockingMethod(AbstractRpcClient.java:287)
at
org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$BlockingStub.scan(ClientProtos.java:32651)
at
org.apache.hadoop.hbase.client.ScannerCallable.openScanner(ScannerCallable.java:372)
at org.apache.hadoop.hbase.client.ScannerCallable.call(ScannerCallable.java:199)
at org.apache.hadoop.hbase.client.ScannerCallable.call(ScannerCallable.java:62)
at
org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithoutRetries(RpcRetryingCaller.java:200)
at
org.apache.hadoop.hbase.client.ScannerCallableWithReplicas$RetryingRPC.call(ScannerCallableWithReplicas.java:369)
at
org.apache.hadoop.hbase.client.ScannerCallableWithReplicas$RetryingRPC.call(ScannerCallableWithReplicas.java:343)
at
org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithRetries(RpcRetryingCaller.java:126)
... 4 more
Caused by: org.apache.hadoop.hbase.ipc.CallTimeoutException: Call id=4595,
waitTime=9015, operationTimeout=5000 expired.
at org.apache.hadoop.hbase.ipc.Call.checkAndSetTimeout(Call.java:70)
at org.apache.hadoop.hbase.ipc.RpcClientImpl.call(RpcClientImpl.java:1184)
... 14 more
{code}
> Couldn't Pass the Integration Test on 2.6.x
> -------------------------------------------
>
> Key: KYLIN-4040
> URL: https://issues.apache.org/jira/browse/KYLIN-4040
> Project: Kylin
> Issue Type: Bug
> Components: Integration, Tools, Build and Test
> Affects Versions: v2.6.2
> Environment: HDP Sandbox 2.6.5
> Reporter: Marc Wu
> Priority: Major
> Attachments: mvnverify.zip
>
>
> Hi Kylin Team:
>
> I've been working on integration testing recently. Because the version 2.4.0
> of HDP Sandbox is not provided anymore. I used the HDP 2.6.5 to do the
> testing.
>
> After I adjusting some configurations and files to fit the 2.6.5 environment.
> I found I couldn't pass the integration testing due to the failure of some
> test cases.
>
> {code:java}
> [ERROR] Failures:
> [ERROR]
> ITCombinationTest>ITKylinQueryTest.testCachedQuery:259->KylinTestBase.execAndCompQuery:546->KylinTestBase.execAndCompQuery:649->KylinTestBase.assertTableEquals:693
> value (table=query result of query01, row=0, col=CAL_DT)
> expected:<2012-01-02> but was:<2012-01-02>
> [ERROR]
> ITCombinationTest>ITKylinQueryTest.testCachedQuery:259->KylinTestBase.execAndCompQuery:546->KylinTestBase.execAndCompQuery:649->KylinTestBase.assertTableEquals:693
> value (table=query result of query01, row=0, col=CAL_DT)
> expected:<2012-01-02> but was:<2012-01-02>
> [ERROR]
> ITCombinationTest>ITKylinQueryTest.testCommonQuery:176->KylinTestBase.execAndCompQuery:546->KylinTestBase.execAndCompQuery:649->KylinTestBase.assertTableEquals:693
> value (table=query result of query09, row=0, col=WEEK_BEG_DT)
> expected:<2012-01-01> but was:<2012-01-01>
> [ERROR]
> ITCombinationTest>ITKylinQueryTest.testCommonQuery:176->KylinTestBase.execAndCompQuery:546->KylinTestBase.execAndCompQuery:649->KylinTestBase.assertTableEquals:693
> value (table=query result of query09, row=0, col=WEEK_BEG_DT)
> expected:<2012-01-01> but was:<2012-01-01>
> [ERROR]
> ITCombinationTest>ITKylinQueryTest.testDateTimeQuery:186->KylinTestBase.execAndCompQuery:546->KylinTestBase.execAndCompQuery:649->KylinTestBase.assertTableEquals:693
> value (table=query result of query00, row=0, col=TEST_DATE)
> expected:<2010-09-20> but was:<2010-09-20>
> [ERROR]
> ITCombinationTest>ITKylinQueryTest.testDateTimeQuery:186->KylinTestBase.execAndCompQuery:546->KylinTestBase.execAndCompQuery:649->KylinTestBase.assertTableEquals:693
> value (table=query result of query00, row=0, col=TEST_DATE)
> expected:<2010-09-20> but was:<2010-09-20>
> [ERROR]
> ITCombinationTest>ITKylinQueryTest.testDerivedColumnQuery:264->KylinTestBase.execAndCompQuery:546->KylinTestBase.execAndCompQuery:649->KylinTestBase.assertTableEquals:693
> value (table=query result of query01, row=0, col=WEEK_BEG_DT)
> expected:<2012-05-26> but was:<2012-05-26>
> [ERROR]
> ITCombinationTest>ITKylinQueryTest.testDerivedColumnQuery:264->KylinTestBase.execAndCompQuery:546->KylinTestBase.execAndCompQuery:649->KylinTestBase.assertTableEquals:693
> value (table=query result of query01, row=0, col=WEEK_BEG_DT)
> expected:<2012-05-26> but was:<2012-05-26>
> [ERROR]
> ITCombinationTest>ITKylinQueryTest.testDynamicQuery:368->KylinTestBase.execAndCompDynamicQuery:686->KylinTestBase.assertTableEquals:693
> value (table=query result of query01, row=0, col=WEEK_BEG_DT)
> expected:<2013-05-05> but was:<2013-05-05>
> [ERROR]
> ITCombinationTest>ITKylinQueryTest.testDynamicQuery:368->KylinTestBase.execAndCompDynamicQuery:686->KylinTestBase.assertTableEquals:693
> value (table=query result of query01, row=0, col=WEEK_BEG_DT)
> expected:<2013-05-05> but was:<2013-05-05>
> [ERROR]
> ITCombinationTest>ITKylinQueryTest.testLookupQuery:234->KylinTestBase.execAndCompQuery:546->KylinTestBase.execAndCompQuery:649->KylinTestBase.assertTableEquals:693
> value (table=query result of query01, row=0, col=CAL_DT)
> expected:<2012-01-01> but was:<2012-01-01>
> [ERROR]
> ITCombinationTest>ITKylinQueryTest.testLookupQuery:234->KylinTestBase.execAndCompQuery:546->KylinTestBase.execAndCompQuery:649->KylinTestBase.assertTableEquals:693
> value (table=query result of query01, row=0, col=CAL_DT)
> expected:<2012-01-01> but was:<2012-01-01>
> [ERROR]
> ITCombinationTest>ITKylinQueryTest.testMultiModelQuery:303->KylinTestBase.execAndCompQuery:546->KylinTestBase.execAndCompQuery:649->KylinTestBase.assertTableEquals:693
> value (table=query result of query01, row=0, col=CAL_DT)
> expected:<2012-01-01> but was:<2012-01-01>
> [ERROR]
> ITCombinationTest>ITKylinQueryTest.testOrderByQuery:225->KylinTestBase.execAndCompQuery:546->KylinTestBase.execAndCompQuery:649->KylinTestBase.assertTableEquals:693
> value (table=query result of query01, row=0, col=WEEK_BEG_DT)
> expected:<2013-06-09> but was:<2013-06-09>
> [ERROR]
> ITCombinationTest>ITKylinQueryTest.testOrderByQuery:225->KylinTestBase.execAndCompQuery:546->KylinTestBase.execAndCompQuery:649->KylinTestBase.assertTableEquals:693
> value (table=query result of query01, row=0, col=WEEK_BEG_DT)
> expected:<2013-06-09> but was:<2013-06-09>
> [ERROR]
> ITCombinationTest>ITKylinQueryTest.testPreciselyDistinctCountQuery:279->KylinTestBase.execAndCompQuery:546->KylinTestBase.execAndCompQuery:649->KylinTestBase.assertTableEquals:693
> value (table=query result of query00, row=0, col=CAL_DT)
> expected:<2012-01-01> but was:<2012-01-01>
> [ERROR]
> ITCombinationTest>ITKylinQueryTest.testPreciselyDistinctCountQuery:279->KylinTestBase.execAndCompQuery:546->KylinTestBase.execAndCompQuery:649->KylinTestBase.assertTableEquals:693
> value (table=query result of query00, row=0, col=CAL_DT)
> expected:<2012-01-01> but was:<2012-01-01>
> [ERROR]
> ITCombinationTest>ITKylinQueryTest.testPreciselyDistinctCountRollupQuery:286->KylinTestBase.execAndCompQuery:546->KylinTestBase.execAndCompQuery:649->KylinTestBase.assertTableEquals:693
> value (table=query result of query03, row=0, col=WEEK_BEG_DT)
> expected:<2013-05-05> but was:<2013-05-05>
> [ERROR]
> ITCombinationTest>ITKylinQueryTest.testRawQuery:393->KylinTestBase.execAndCompQuery:546->KylinTestBase.execAndCompQuery:649->KylinTestBase.assertTableEquals:693
> value (table=query result of query03, row=0, col=CAL_DT)
> expected:<2012-01-01> but was:<2012-01-01>
> [ERROR]
> ITCombinationTest>ITKylinQueryTest.testRawQuery:393->KylinTestBase.execAndCompQuery:546->KylinTestBase.execAndCompQuery:649->KylinTestBase.assertTableEquals:693
> value (table=query result of query03, row=0, col=CAL_DT)
> expected:<2012-01-01> but was:<2012-01-01>
> [ERROR]
> ITCombinationTest>ITKylinQueryTest.testStreamingTableQuery:315->KylinTestBase.execAndCompQuery:546->KylinTestBase.execAndCompQuery:649->KylinTestBase.assertTableEquals:693
> value (table=query result of query03, row=0, col=H) expected:<2012-01-0[2
> 04]:00:00.0> but was:<2012-01-0[1 20]:00:00.0>
> [ERROR]
> ITCombinationTest>ITKylinQueryTest.testStreamingTableQuery:315->KylinTestBase.execAndCompQuery:546->KylinTestBase.execAndCompQuery:649->KylinTestBase.assertTableEquals:693
> value (table=query result of query03, row=0, col=H) expected:<2012-01-0[2
> 04]:00:00.0> but was:<2012-01-0[1 20]:00:00.0>
> [ERROR]
> ITCombinationTest>ITKylinQueryTest.testSubQuery:325->KylinTestBase.execAndCompQuery:546->KylinTestBase.execAndCompQuery:649->KylinTestBase.assertTableEquals:693
> value (table=query result of query00, row=0, col=WEEK_BEG_DT)
> expected:<2012-01-01> but was:<2012-01-01>
> [ERROR]
> ITCombinationTest>ITKylinQueryTest.testSubQuery:325->KylinTestBase.execAndCompQuery:546->KylinTestBase.execAndCompQuery:649->KylinTestBase.assertTableEquals:693
> value (table=query result of query00, row=0, col=WEEK_BEG_DT)
> expected:<2012-01-01> but was:<2012-01-01>
> [ERROR]
> ITCombinationTest>ITKylinQueryTest.testTimeStampAdd:254->KylinTestBase.execAndCompQuery:546->KylinTestBase.execAndCompQuery:649->KylinTestBase.assertTableEquals:693
> value (table=query result of query01, row=0, col=CAL_DT)
> expected:<2012-01-01> but was:<2012-01-01>
> [ERROR]
> ITCombinationTest>ITKylinQueryTest.testTimeStampAdd:254->KylinTestBase.execAndCompQuery:546->KylinTestBase.execAndCompQuery:649->KylinTestBase.assertTableEquals:693
> value (table=query result of query01, row=0, col=CAL_DT)
> expected:<2012-01-01> but was:<2012-01-01>
> [ERROR]
> ITCombinationTest>ITKylinQueryTest.testTopNQuery:274->KylinTestBase.execAndCompQuery:546->KylinTestBase.execAndCompQuery:649->KylinTestBase.assertTableEquals:693
> value (table=query result of query81, row=0, col=WEEK_BEG_DT)
> expected:<2013-09-01> but was:<2013-09-01>
> [ERROR]
> ITCombinationTest>ITKylinQueryTest.testTopNQuery:274->KylinTestBase.execAndCompQuery:546->KylinTestBase.execAndCompQuery:649->KylinTestBase.assertTableEquals:693
> value (table=query result of query81, row=0, col=WEEK_BEG_DT)
> expected:<2013-09-01> but was:<2013-09-01>
> [ERROR] Errors:
> [ERROR]
> ITCombinationTest>ITKylinQueryTest.testLimitCorrectness:387->KylinTestBase.execLimitAndValidate:531->KylinTestBase.assertTableContains:700
> » IllegalState
> [ERROR]
> ITCombinationTest>ITKylinQueryTest.testLimitCorrectness:387->KylinTestBase.execLimitAndValidate:531->KylinTestBase.assertTableContains:700
> » IllegalState
> {code}
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
