Btw, ignore ganglia exceptions. We don't have that configured. On Sun, Mar 15, 2015 at 8:52 AM, Manoj Murumkar <manoj.murum...@gmail.com> wrote:
> Attached both files. > > > > On Sat, Mar 14, 2015 at 2:10 AM, Mikhail Antonov <olorinb...@gmail.com> > wrote: > >> Hi, >> >> Traces (especially one for region server) look a bit incomplete, did >> you copy them fully? >> >> Also may help if you post relevant pieces of hbase-site.xml (with >> security configs). >> >> Thanks, >> Mikhail >> >> On Fri, Mar 13, 2015 at 11:28 PM, Manoj Murumkar >> <manoj.murum...@gmail.com> wrote: >> > Hi, >> > >> > We have a secured cluster. All components are working well, except >> hbase. >> > Specifically, this is what I see on regionserver: >> > >> > 2015-03-14 02:16:11,657 DEBUG [RpcServer.reader=5,port=60020] >> > ipc.RpcServer: Kerberos principal name is hbase/ >> > sfdvgctsn001.xx...@sfdvgct.com >> > >> > 2015-03-14 02:16:11,658 DEBUG [RpcServer.reader=5,port=60020] >> > ipc.RpcServer: Created SASL server with mechanism = GSSAPI >> > >> > 2015-03-14 02:16:11,658 DEBUG [RpcServer.reader=5,port=60020] >> > ipc.RpcServer: Have read input token of size 627 for processing by >> > saslServer.evaluateResponse() >> > 2015-03-14 02:16:11,659 DEBUG [RpcServer.reader=5,port=60020] >> > ipc.RpcServer: RpcServer.listener,port=60020: Caught exception while >> > reading:GSS initiate fail >> > >> > >> > and on the master: >> > >> > >> > java.io.IOException: Couldn't setup connection for hbase/sfdvgctmn004. >> > xx...@sfdvgct.com to hbase/sfdvgctsn001.xx...@sfdvgct.com >> > >> > at >> > >> org.apache.hadoop.hbase.ipc.RpcClient$Connection$1.run(RpcClient.java:869) >> > >> > at java.security.AccessController.doPrivileged(Native Method) >> > >> > at javax.security.auth.Subject.doAs(Subject.java:415) >> > >> > at >> > >> org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1628) >> > >> > at >> > >> org.apache.hadoop.hbase.ipc.RpcClient$Connection.handleSaslConnectionFailure(RpcClient.java:841) >> > >> > at >> > >> org.apache.hadoop.hbase.ipc.RpcClient$Connection.setupIOstreams(RpcClient.java:951) >> > >> > at >> > >> org.apache.hadoop.hbase.ipc.RpcClient$Connection.writeRequest(RpcClient.java:1094) >> > >> > at >> > >> org.apache.hadoop.hbase.ipc.RpcClient$Connection.tracedWriteRequest(RpcClient.java:1061) >> > >> > All the keytabs are set properly. Has anyone seen this before? >> Appreciate >> > the time. >> > >> > Manoj >> >> >> >> -- >> Thanks, >> Michael Antonov >> > >
