hi,
hive has integrated with hbase, and i can create and query external
hbase table by hive client,but when i use beeline to operate hbase sth wrong ,
i guess this issue is hive jdbc error, pls give me
some advice many thx , here is the error msg :
2016-10-12T10:42:31,803 DEBUG [HiveServer2-Handler-Pool: Thread-115]:
security.UserGroupInformation (UserGroupInformation.java:doAs(1702)) -
PrivilegedActionException as:hadoop (auth:PROXY) via hadoop (auth:SIMPLE)
cause:org.apache.hive.service.cli.HiveSQLException: java.io.IOException:
org.apache.hadoop.hbase.client.RetriesExhaustedException: Failed after
attempts=36, exceptions:
Wed Oct 12 10:42:31 CST 2016, null, java.net.SocketTimeoutException:
callTimeout=60000, callDuration=68422: row 'data_visit_year_2,,00000000000000'
on table 'hbase:meta' at region=hbase:meta,,1.1588230740,
hostname=slave3,16020,1476072663759, seqNum=0
2016-10-12T10:42:31,803 WARN [HiveServer2-Handler-Pool: Thread-115]:
thrift.ThriftCLIService (ThriftCLIService.java:FetchResults(702)) - Error
fetching results:
org.apache.hive.service.cli.HiveSQLException: java.io.IOException:
org.apache.hadoop.hbase.client.RetriesExhaustedException: Failed after
attempts=36, exceptions:
Wed Oct 12 10:42:31 CST 2016, null, java.net.SocketTimeoutException:
callTimeout=60000, callDuration=68422: row 'data_visit_year_2,,00000000000000'
on table 'hbase:meta' at region=hbase:meta,,1.1588230740,
hostname=slave3,16020,1476072663759, seqNum=0
at
org.apache.hive.service.cli.operation.SQLOperation.getNextRowSet(SQLOperation.java:361)
~[hive-service-2.0.1.jar:2.0.1]
at
org.apache.hive.service.cli.operation.OperationManager.getOperationNextRowSet(OperationManager.java:241)
~[hive-service-2.0.1.jar:2.0.1]
at
org.apache.hive.service.cli.session.HiveSessionImpl.fetchResults(HiveSessionImpl.java:777)
~[hive-service-2.0.1.jar:2.0.1]
at sun.reflect.GeneratedMethodAccessor11.invoke(Unknown Source) ~[?:?]
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
~[?:1.8.0_20]
at java.lang.reflect.Method.invoke(Method.java:483) ~[?:1.8.0_20]
at
org.apache.hive.service.cli.session.HiveSessionProxy.invoke(HiveSessionProxy.java:78)
~[hive-service-2.0.1.jar:2.0.1]
at
org.apache.hive.service.cli.session.HiveSessionProxy.access$000(HiveSessionProxy.java:36)
~[hive-service-2.0.1.jar:2.0.1]
at
org.apache.hive.service.cli.session.HiveSessionProxy$1.run(HiveSessionProxy.java:63)
~[hive-service-2.0.1.jar:2.0.1]
at java.security.AccessController.doPrivileged(Native Method)
~[?:1.8.0_20]
at javax.security.auth.Subject.doAs(Subject.java:422) ~[?:1.8.0_20]
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1698)
~[hadoop-common-2.7.3.jar:?]
at
org.apache.hive.service.cli.session.HiveSessionProxy.invoke(HiveSessionProxy.java:59)
~[hive-service-2.0.1.jar:2.0.1]
at com.sun.proxy.$Proxy35.fetchResults(Unknown Source) ~[?:?]
at
org.apache.hive.service.cli.CLIService.fetchResults(CLIService.java:439)
~[hive-service-2.0.1.jar:2.0.1]
at
org.apache.hive.service.cli.thrift.ThriftCLIService.FetchResults(ThriftCLIService.java:693)
[hive-service-2.0.1.jar:2.0.1]
at
org.apache.hive.service.cli.thrift.TCLIService$Processor$FetchResults.getResult(TCLIService.java:1557)
[hive-service-2.0.1.jar:2.0.1]
at
org.apache.hive.service.cli.thrift.TCLIService$Processor$FetchResults.getResult(TCLIService.java:1542)
[hive-service-2.0.1.jar:2.0.1]
at org.apache.thrift.ProcessFunction.process(ProcessFunction.java:39)
[hive-exec-2.0.1.jar:2.0.1]
at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:39)
[hive-exec-2.0.1.jar:2.0.1]
at
org.apache.hive.service.auth.TSetIpAddressProcessor.process(TSetIpAddressProcessor.java:56)
[hive-service-2.0.1.jar:2.0.1]
at
org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:286)
[hive-exec-2.0.1.jar:2.0.1]
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
[?:1.8.0_20]
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[?:1.8.0_20]
at java.lang.Thread.run(Thread.java:745) [?:1.8.0_20]
Caused by: java.io.IOException:
org.apache.hadoop.hbase.client.RetriesExhaustedException: Failed after
attempts=36, exceptions:
Wed Oct 12 10:42:31 CST 2016, null, java.net.SocketTimeoutException:
callTimeout=60000, callDuration=68422: row 'data_visit_year_2,,00000000000000'
on table 'hbase:meta' at region=hbase:meta,,1.1588230740,
hostname=slave3,16020,1476072663759, seqNum=0
at
org.apache.hadoop.hive.ql.exec.FetchOperator.getNextRow(FetchOperator.java:513)
~[hive-exec-2.0.1.jar:2.0.1]
at
org.apache.hadoop.hive.ql.exec.FetchOperator.pushRow(FetchOperator.java:420)
~[hive-exec-2.0.1.jar:2.0.1]
at org.apache.hadoop.hive.ql.exec.FetchTask.fetch(FetchTask.java:145)
~[hive-exec-2.0.1.jar:2.0.1]
at org.apache.hadoop.hive.ql.Driver.getResults(Driver.java:1850)
~[hive-exec-2.0.1.jar:2.0.1]
at
org.apache.hive.service.cli.operation.SQLOperation.getNextRowSet(SQLOperation.java:356)
~[hive-service-2.0.1.jar:2.0.1]
... 24 more
Caused by: org.apache.hadoop.hbase.client.RetriesExhaustedException: Failed
after attempts=36, exceptions:
Wed Oct 12 10:42:31 CST 2016, null, java.net.SocketTimeoutException:
callTimeout=60000, callDuration=68422: row 'data_visit_year_2,,00000000000000'
on table 'hbase:meta' at region=hbase:meta,,1.1588230740,
hostname=slave3,16020,1476072663759, seqNum=0
at
org.apache.hadoop.hbase.client.RpcRetryingCallerWithReadReplicas.throwEnrichedException(RpcRetryingCallerWithReadReplicas.java:276)
~[hbase-client-1.2.3.jar:1.2.3]
at
org.apache.hadoop.hbase.client.ScannerCallableWithReplicas.call(ScannerCallableWithReplicas.java:210)
~[hbase-client-1.2.3.jar:1.2.3]
at
org.apache.hadoop.hbase.client.ScannerCallableWithReplicas.call(ScannerCallableWithReplicas.java:60)
~[hbase-client-1.2.3.jar:1.2.3]
at
org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithoutRetries(RpcRetryingCaller.java:210)
~[hbase-client-1.2.3.jar:1.2.3]
at
org.apache.hadoop.hbase.client.ClientScanner.call(ClientScanner.java:326)
~[hbase-client-1.2.3.jar:1.2.3]
at
org.apache.hadoop.hbase.client.ClientScanner.nextScanner(ClientScanner.java:301)
~[hbase-client-1.2.3.jar:1.2.3]
at
org.apache.hadoop.hbase.client.ClientScanner.initializeScannerInConstruction(ClientScanner.java:166)
~[hbase-client-1.2.3.jar:1.2.3]
at
org.apache.hadoop.hbase.client.ClientScanner.<init>(ClientScanner.java:161)
~[hbase-client-1.2.3.jar:1.2.3]
at org.apache.hadoop.hbase.client.HTable.getScanner(HTable.java:797)
~[hbase-client-1.2.3.jar:1.2.3]
at
org.apache.hadoop.hbase.client.MetaScanner.metaScan(MetaScanner.java:193)
~[hbase-client-1.2.3.jar:1.2.3]
at
org.apache.hadoop.hbase.client.MetaScanner.metaScan(MetaScanner.java:89)
~[hbase-client-1.2.3.jar:1.2.3]
at
org.apache.hadoop.hbase.client.MetaScanner.allTableRegions(MetaScanner.java:324)
~[hbase-client-1.2.3.jar:1.2.3]
at
org.apache.hadoop.hbase.client.HRegionLocator.getAllRegionLocations(HRegionLocator.java:89)
~[hbase-client-1.2.3.jar:1.2.3]
at
org.apache.hadoop.hbase.util.RegionSizeCalculator.init(RegionSizeCalculator.java:94)
~[hbase-server-1.2.3.jar:1.2.3]
at
org.apache.hadoop.hbase.util.RegionSizeCalculator.<init>(RegionSizeCalculator.java:81)
~[hbase-server-1.2.3.jar:1.2.3]
at
org.apache.hadoop.hbase.mapreduce.TableInputFormatBase.getSplits(TableInputFormatBase.java:256)
~[hbase-server-1.2.3.jar:1.2.3]
at
org.apache.hadoop.hive.hbase.HiveHBaseTableInputFormat.getSplitsInternal(HiveHBaseTableInputFormat.java:501)
~[hive-hbase-handler-2.0.1.jar:2.0.1]
at
org.apache.hadoop.hive.hbase.HiveHBaseTableInputFormat.getSplits(HiveHBaseTableInputFormat.java:433)
~[hive-hbase-handler-2.0.1.jar:2.0.1]
at
org.apache.hadoop.hive.ql.exec.FetchOperator.getNextSplits(FetchOperator.java:368)
~[hive-exec-2.0.1.jar:2.0.1]
at
org.apache.hadoop.hive.ql.exec.FetchOperator.getRecordReader(FetchOperator.java:300)
~[hive-exec-2.0.1.jar:2.0.1]
at
org.apache.hadoop.hive.ql.exec.FetchOperator.getNextRow(FetchOperator.java:451)
~[hive-exec-2.0.1.jar:2.0.1]
at
org.apache.hadoop.hive.ql.exec.FetchOperator.pushRow(FetchOperator.java:420)
~[hive-exec-2.0.1.jar:2.0.1]
at org.apache.hadoop.hive.ql.exec.FetchTask.fetch(FetchTask.java:145)
~[hive-exec-2.0.1.jar:2.0.1]
at org.apache.hadoop.hive.ql.Driver.getResults(Driver.java:1850)
~[hive-exec-2.0.1.jar:2.0.1]
at
org.apache.hive.service.cli.operation.SQLOperation.getNextRowSet(SQLOperation.java:356)
~[hive-service-2.0.1.jar:2.0.1]
... 24 more
Caused by: java.net.SocketTimeoutException: callTimeout=60000,
callDuration=68422: row 'data_visit_year_2,,00000000000000' on table
'hbase:meta' at region=hbase:meta,,1.1588230740,
hostname=slave3,16020,1476072663759, seqNum=0
at
org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithRetries(RpcRetryingCaller.java:169)
~[hbase-client-1.2.3.jar:1.2.3]
at
org.apache.hadoop.hbase.client.ResultBoundedCompletionService$QueueingFuture.run(ResultBoundedCompletionService.java:65)
~[hbase-client-1.2.3.jar:1.2.3]
... 3 more
Caused by: org.apache.hadoop.hbase.exceptions.ConnectionClosingException: Call
to slave3/10.0.5.58:16020 failed on local exception:
org.apache.hadoop.hbase.exceptions.ConnectionClosingException: Connection to
slave3/10.0.5.58:16020 is closing. Call id=11, waitTime=2
at
org.apache.hadoop.hbase.ipc.AbstractRpcClient.wrapException(AbstractRpcClient.java:289)
~[hbase-client-1.2.3.jar:1.2.3]
at
org.apache.hadoop.hbase.ipc.RpcClientImpl.call(RpcClientImpl.java:1271)
~[hbase-client-1.2.3.jar:1.2.3]
at
org.apache.hadoop.hbase.ipc.AbstractRpcClient.callBlockingMethod(AbstractRpcClient.java:227)
~[hbase-client-1.2.3.jar:1.2.3]
at
org.apache.hadoop.hbase.ipc.AbstractRpcClient$BlockingRpcChannelImplementation.callBlockingMethod(AbstractRpcClient.java:336)
~[hbase-client-1.2.3.jar:1.2.3]
at
org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$BlockingStub.scan(ClientProtos.java:34094)
~[hbase-protocol-1.2.3.jar:1.2.3]
at
org.apache.hadoop.hbase.client.ScannerCallable.openScanner(ScannerCallable.java:394)
~[hbase-client-1.2.3.jar:1.2.3]
at
org.apache.hadoop.hbase.client.ScannerCallable.call(ScannerCallable.java:203)
~[hbase-client-1.2.3.jar:1.2.3]
at
org.apache.hadoop.hbase.client.ScannerCallable.call(ScannerCallable.java:64)
~[hbase-client-1.2.3.jar:1.2.3]
at
org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithoutRetries(RpcRetryingCaller.java:210)
~[hbase-client-1.2.3.jar:1.2.3]
at
org.apache.hadoop.hbase.client.ScannerCallableWithReplicas$RetryingRPC.call(ScannerCallableWithReplicas.java:364)
~[hbase-client-1.2.3.jar:1.2.3]
at
org.apache.hadoop.hbase.client.ScannerCallableWithReplicas$RetryingRPC.call(ScannerCallableWithReplicas.java:338)
~[hbase-client-1.2.3.jar:1.2.3]
at
org.apache.hadoop.hbase.client.RpcRetryingCaller.callWithRetries(RpcRetryingCaller.java:136)
~[hbase-client-1.2.3.jar:1.2.3]
at
org.apache.hadoop.hbase.client.ResultBoundedCompletionService$QueueingFuture.run(ResultBoundedCompletionService.java:65)
~[hbase-client-1.2.3.jar:1.2.3]
... 3 more
Caused by: org.apache.hadoop.hbase.exceptions.ConnectionClosingException:
Connection to slave3/10.0.5.58:16020 is closing. Call id=11, waitTime=2
at
org.apache.hadoop.hbase.ipc.RpcClientImpl$Connection.cleanupCalls(RpcClientImpl.java:1084)
~[hbase-client-1.2.3.jar:1.2.3]
at
org.apache.hadoop.hbase.ipc.RpcClientImpl$Connection.close(RpcClientImpl.java:863)
~[hbase-client-1.2.3.jar:1.2.3]
at
org.apache.hadoop.hbase.ipc.RpcClientImpl$Connection.run(RpcClientImpl.java:580)
~[hbase-client-1.2.3.jar:1.2.3]
2016-10-12T10:42:31,809 DEBUG [HiveServer2-Handler-Pool: Thread-115]:
transport.TSaslTransport (TSaslTransport.java:flush(498)) - writing data
length: 8170
2016-10-12T10:42:31,823 DEBUG [HiveServer2-Handler-Pool: Thread-115]:
transport.TSaslTransport (TSaslTransport.java:readFrame(459)) - SERVER: reading
data length: 117
2016-10-12T10:42:31,824 DEBUG [HiveServer2-Handler-Pool: Thread-115]:
security.UserGroupInformation
(UserGroupInformation.java:logPrivilegedAction(1722)) - PrivilegedAction
as:hadoop (auth:PROXY) via hadoop (auth:SIMPLE)
from:org.apache.hive.service.cli.session.HiveSessionProxy.invoke(HiveSessionProxy.java:59)
2016-10-12T10:42:31,824 INFO [HiveServer2-Handler-Pool: Thread-115]:
conf.HiveConf (HiveConf.java:getLogIdVar(3177)) - Using the default value
passed in for log id: aa2fdf23-ec0d-487f-94da-2584ed1e2acb
2016-10-12T10:42:31,824 INFO [HiveServer2-Handler-Pool: Thread-115]:
session.SessionState (SessionState.java:updateThreadName(406)) - Updating
thread name to aa2fdf23-ec0d-487f-94da-2584ed1e2acb HiveServer2-Handler-Pool:
Thread-115
2016-10-12T10:42:31,825 INFO [aa2fdf23-ec0d-487f-94da-2584ed1e2acb
HiveServer2-Handler-Pool: Thread-115]: conf.HiveConf
(HiveConf.java:getLogIdVar(3177)) - Using the default value passed in for log
id: aa2fdf23-ec0d-487f-94da-2584ed1e2acb
2016-10-12T10:42:31,825 INFO [aa2fdf23-ec0d-487f-94da-2584ed1e2acb
HiveServer2-Handler-Pool: Thread-115]: session.SessionState
(SessionState.java:resetThreadName(417)) - Resetting thread name to
HiveServer2-Handler-Pool: Thread-115
2016-10-12T10:42:31,825 DEBUG [HiveServer2-Handler-Pool: Thread-115]:
cli.CLIService (CLIService.java:fetchResults(441)) - OperationHandle
[opType=EXECUTE_STATEMENT,
getHandleIdentifier()=ab9981a6-baf1-4306-b7a5-ecdf321c6394]: fetchResults()
2016-10-12T10:42:31,825 DEBUG [HiveServer2-Handler-Pool: Thread-115]:
transport.TSaslTransport (TSaslTransport.java:flush(498)) - writing data
length: 1127
