Hi,
We have a secured cluster. All components are working well, except hbase.
Specifically, this is what I see on regionserver:
2015-03-14 02:16:11,657 DEBUG [RpcServer.reader=5,port=60020]
ipc.RpcServer: Kerberos principal name is hbase/
sfdvgctsn001.xx...@sfdvgct.com
2015-03-14 02:16:11,658 DEBUG [RpcServer.reader=5,port=60020]
ipc.RpcServer: Created SASL server with mechanism = GSSAPI
2015-03-14 02:16:11,658 DEBUG [RpcServer.reader=5,port=60020]
ipc.RpcServer: Have read input token of size 627 for processing by
saslServer.evaluateResponse()
2015-03-14 02:16:11,659 DEBUG [RpcServer.reader=5,port=60020]
ipc.RpcServer: RpcServer.listener,port=60020: Caught exception while
reading:GSS initiate fail
and on the master:
java.io.IOException: Couldn't setup connection for hbase/sfdvgctmn004.
xx...@sfdvgct.com to hbase/sfdvgctsn001.xx...@sfdvgct.com
at
org.apache.hadoop.hbase.ipc.RpcClient$Connection$1.run(RpcClient.java:869)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:415)
at
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628)
at
org.apache.hadoop.hbase.ipc.RpcClient$Connection.handleSaslConnectionFailure(RpcClient.java:841)
at
org.apache.hadoop.hbase.ipc.RpcClient$Connection.setupIOstreams(RpcClient.java:951)
at
org.apache.hadoop.hbase.ipc.RpcClient$Connection.writeRequest(RpcClient.java:1094)
at
org.apache.hadoop.hbase.ipc.RpcClient$Connection.tracedWriteRequest(RpcClient.java:1061)
All the keytabs are set properly. Has anyone seen this before? Appreciate
the time.
Manoj
