Re: HBase acl commands are too slow

2016-10-11 Thread Ted Yu 
I recently worked on HBASE-16773 where 20 PriorityRpcServer handlers were
all occupied accessing acl table.

Can you take a few jstack of the server hosting acl table when acl command
was executing ?

Pastebin one or two stack trace.

Please also check server log where acl table is hosted.

Thanks

On Tue, Oct 11, 2016 at 12:14 AM, mathes waran 
wrote:

> Hi ,
>
> I have configured HBase-1.1.3 and Hadoop-2.7.2 with Kerberos security.
>
> I have enabled authorization for HBase.
>
> When executing any authorization command like user_permission, grant,
> revoke,
> etc.
>
> Its getting more than 30 seconds to display the result.
>
> Below are hbase-site.xml configuration properties
>
> 
> hbase.master
> IP:6
> 
> 
> hbase.rootdir
> hdfs://IP:9000/HBase
> 
> 
> hbase.cluster.distributed
> true
> 
> 
> hbase.zookeeper.quorum
> IP1:2181,IP2:2181,IP3:2181
> 
> 
> hbase.master.port
> 6
> 
> 
> hbase.master.info.port
> 60010
> 
> 
> hbase.regionserver.port
> 60020
> 
> 
> hbase.regionserver.info.port
> 60030
> 
> 
> hbase.security.authentication
> KERBEROS
> 
> 
> hbase.master.keytab.file
> masterkeytab
> 
> 
> hbase.regionserver.keytab.file
> regionserverkeytab
> 
> 
> hbase.master.kerberos.principal
> masterprincipal
> 
> 
> hbase.regionserver.kerberos.principal
> regionserverprincipal
> 
> 
> hbase.rpc.engine
> org.apache.hadoop.hbase.ipc.SecureRpcEngine
> 
> 
> hbase.ssl.enabled
> true
> 
> 
> hbase.superuser
> @HadoopUser
> 
> 
> hbase.security.authorization
> true
> 
> 
> hbase.coprocessor.master.classes
> org.apache.hadoop.hbase.security.access.
> AccessController
> 
> 
> hbase.coprocessor.region.classes
> org.apache.hadoop.hbase.security.token.
> TokenProvider,org.apache.hadoop.hbase.security.access.
> AccessController
> 
>
> Help me to improve performance on HBase acl.
>
> Thanks,
>
> Matheswaran.S
>

HBase acl commands are too slow

2016-10-11 Thread mathes waran 
Hi ,

I have configured HBase-1.1.3 and Hadoop-2.7.2 with Kerberos security.

I have enabled authorization for HBase.

When executing any authorization command like user_permission, grant, revoke,
etc.

Its getting more than 30 seconds to display the result.

Below are hbase-site.xml configuration properties


hbase.master
IP:6


hbase.rootdir
hdfs://IP:9000/HBase


hbase.cluster.distributed
true


hbase.zookeeper.quorum
IP1:2181,IP2:2181,IP3:2181


hbase.master.port
6


hbase.master.info.port
60010


hbase.regionserver.port
60020


hbase.regionserver.info.port
60030


hbase.security.authentication
KERBEROS


hbase.master.keytab.file
masterkeytab


hbase.regionserver.keytab.file
regionserverkeytab


hbase.master.kerberos.principal
masterprincipal


hbase.regionserver.kerberos.principal
regionserverprincipal


hbase.rpc.engine
org.apache.hadoop.hbase.ipc.SecureRpcEngine


hbase.ssl.enabled
true


hbase.superuser
@HadoopUser


hbase.security.authorization
true


hbase.coprocessor.master.classes
org.apache.hadoop.hbase.security.access.AccessController


hbase.coprocessor.region.classes

org.apache.hadoop.hbase.security.token.TokenProvider,org.apache.hadoop.hbase.security.access.AccessController


Help me to improve performance on HBase acl.

Thanks,

Matheswaran.S

Re: HBase acl commands are too slow

2016-06-18 Thread Ted Yu 
t; > > > >
>> > > > > > Thanks,
>> > > > > >
>> > > > > > Kumar
>> > > > > >
>> > > > > >
>> > > > > > On Mon, Jun 13, 2016 at 7:42 PM, Ted Yu <yuzhih...@gmail.com>
>> > wrote:
>> > > > > >
>> > > > > > > Can you inspect master log for the corresponding 40 seconds to
>> > see
>> > > if
>> > > > > > there
>> > > > > > > was some clue ?
>> > > > > > >
>> > > > > > > Feel free to pastebin the log snippet for this period if you
>> > cannot
>> > > > > > > determine the cause.
>> > > > > > >
>> > > > > > > Cheers
>> > > > > > >
>> > > > > > > On Sun, Jun 12, 2016 at 10:19 PM, kumar r <kumarc...@gmail.com>
>> > > > wrote:
>> > > > > > >
>> > > > > > > > Hi,
>> > > > > > > >
>> > > > > > > > I have configured secure HBase-1.1.3. Hadoop version using
>> > 2.7.2.
>> > > > > > > >
>> > > > > > > > I have enabled authorization in HBase.
>> > > > > > > >
>> > > > > > > > When executing any authorization command like user_permission,
>> > > > grant,
>> > > > > > > > revoke,
>> > > > > > > > etc.
>> > > > > > > >
>> > > > > > > > Its getting more than 40 seconds to display the result.
>> > > > > > > >
>> > > > > > > > Below are hbase-site.xml configuration properties
>> > > > > > > >
>> > > > > > > >
>> > > > > > > > 
>> > > > > > > > hbase.master
>> > > > > > > > IP:6
>> > > > > > > > 
>> > > > > > > > 
>> > > > > > > > hbase.rootdir
>> > > > > > > >     hdfs://IP:9000/HBase
>> > > > > > > > 
>> > > > > > > > 
>> > > > > > > > hbase.cluster.distributed
>> > > > > > > > true
>> > > > > > > > 
>> > > > > > > > 
>> > > > > > > > hbase.zookeeper.quorum
>> > > > > > > > IP1:2181,IP2:2181,IP3:2181
>> > > > > > > > 
>> > > > > > > > 
>> > > > > > > > hbase.master.port
>> > > > > > > > 6
>> > > > > > > > 
>> > > > > > > > 
>> > > > > > > > hbase.master.info.port
>> > > > > > > > 60010
>> > > > > > > > 
>> > > > > > > > 
>> > > > > > > > hbase.regionserver.port
>> > > > > > > > 60020
>> > > > > > > > 
>> > > > > > > > 
>> > > > > > > > hbase.regionserver.info.port
>> > > > > > > > 60030
>> > > > > > > > 
>> > > > > > > > 
>> > > > > > > > hbase.security.authentication
>> > > > > > > > KERBEROS
>> > > > > > > > 
>> > > > > > > > 
>> > > > > > > > hbase.master.keytab.file
>> > > > > > > > masterkeytab
>> > > > > > > > 
>> > > > > > > > 
>> > > > > > > > hbase.regionserver.keytab.file
>> > > > > > > > regionserverkeytab
>> > > > > > > > 
>> > > > > > > > 
>> > > > > > > > hbase.master.kerberos.principal
>> > > > > > > > masterprincipal
>> > > > > > > > 
>> > > > > > > > 
>> > > > > > > > hbase.regionserver.kerberos.principal
>> > > > > > > > regionserverprincipal
>> > > > > > > > 
>> > > > > > > > 
>> > > > > > > > hbase.rpc.engine
>> > > > > > > > org.apache.hadoop.hbase.ipc.SecureRpcEngine
>> > > > > > > > 
>> > > > > > > > 
>> > > > > > > > hbase.ssl.enabled
>> > > > > > > > true
>> > > > > > > > 
>> > > > > > > > 
>> > > > > > > > hbase.superuser
>> > > > > > > > @HadoopUser
>> > > > > > > > 
>> > > > > > > > 
>> > > > > > > > hbase.security.authorization
>> > > > > > > > true
>> > > > > > > > 
>> > > > > > > > 
>> > > > > > > > hbase.coprocessor.master.classes
>> > > > > > > >
>> > > > > > >
>> > > > >
>> > org.apache.hadoop.hbase.security.access.AccessController
>> > > > > > > > 
>> > > > > > > > 
>> > > > > > > > hbase.coprocessor.region.classes
>> > > > > > > >
>> > > > > > > >
>> > > > > > >
>> > > > > >
>> > > > >
>> > > >
>> > >
>> > org.apache.hadoop.hbase.security.token.TokenProvider,org.apache.hadoop.hbase.security.access.AccessController
>> > > > > > > > 
>> > > > > > > >
>> > > > > > > > Find my stack overflow question here
>> > > > > > > >
>> > > > > > >
>> > > > > >
>> > > > >
>> > > >
>> > >
>> > http://stackoverflow.com/questions/37782043/hbase-acl-commands-are-too-slow
>> > > > > > > >
>> > > > > > > > Thanks,
>> > > > > > > >
>> > > > > > > > Kumar
>> > > > > > > >
>> > > > > > >
>> > > > > >
>> > > > >
>> > > >
>> > >
>> >
>

Re: HBase acl commands are too slow

2016-06-17 Thread kumar r 
 > > > determine the cause.
> > > > > > >
> > > > > > > Cheers
> > > > > > >
> > > > > > > On Sun, Jun 12, 2016 at 10:19 PM, kumar r <kumarc...@gmail.com
> >
> > > > wrote:
> > > > > > >
> > > > > > > > Hi,
> > > > > > > >
> > > > > > > > I have configured secure HBase-1.1.3. Hadoop version using
> > 2.7.2.
> > > > > > > >
> > > > > > > > I have enabled authorization in HBase.
> > > > > > > >
> > > > > > > > When executing any authorization command like
> user_permission,
> > > > grant,
> > > > > > > > revoke,
> > > > > > > > etc.
> > > > > > > >
> > > > > > > > Its getting more than 40 seconds to display the result.
> > > > > > > >
> > > > > > > > Below are hbase-site.xml configuration properties
> > > > > > > >
> > > > > > > >
> > > > > > > > 
> > > > > > > > hbase.master
> > > > > > > > IP:6
> > > > > > > > 
> > > > > > > > 
> > > > > > > > hbase.rootdir
> > > > > > > > hdfs://IP:9000/HBase
> > > > > > > > 
> > > > > > > > 
> > > > > > > > hbase.cluster.distributed
> > > > > > > > true
> > > > > > > > 
> > > > > > > > 
> > > > > > > > hbase.zookeeper.quorum
> > > > > > > > IP1:2181,IP2:2181,IP3:2181
> > > > > > > > 
> > > > > > > > 
> > > > > > > > hbase.master.port
> > > > > > > > 6
> > > > > > > > 
> > > > > > > > 
> > > > > > > > hbase.master.info.port
> > > > > > > > 60010
> > > > > > > > 
> > > > > > > > 
> > > > > > > > hbase.regionserver.port
> > > > > > > > 60020
> > > > > > > > 
> > > > > > > > 
> > > > > > > > hbase.regionserver.info.port
> > > > > > > > 60030
> > > > > > > > 
> > > > > > > > 
> > > > > > > > hbase.security.authentication
> > > > > > > > KERBEROS
> > > > > > > > 
> > > > > > > > 
> > > > > > > > hbase.master.keytab.file
> > > > > > > > masterkeytab
> > > > > > > > 
> > > > > > > > 
> > > > > > > > hbase.regionserver.keytab.file
> > > > > > > > regionserverkeytab
> > > > > > > > 
> > > > > > > > 
> > > > > > > > hbase.master.kerberos.principal
> > > > > > > > masterprincipal
> > > > > > > > 
> > > > > > > > 
> > > > > > > > hbase.regionserver.kerberos.principal
> > > > > > > > regionserverprincipal
> > > > > > > > 
> > > > > > > > 
> > > > > > > > hbase.rpc.engine
> > > > > > > >
>  org.apache.hadoop.hbase.ipc.SecureRpcEngine
> > > > > > > > 
> > > > > > > > 
> > > > > > > > hbase.ssl.enabled
> > > > > > > > true
> > > > > > > > 
> > > > > > > > 
> > > > > > > > hbase.superuser
> > > > > > > > @HadoopUser
> > > > > > > > 
> > > > > > > > 
> > > > > > > > hbase.security.authorization
> > > > > > > > true
> > > > > > > > 
> > > > > > > > 
> > > > > > > > hbase.coprocessor.master.classes
> > > > > > > >
> > > > > > >
> > > > >
> > org.apache.hadoop.hbase.security.access.AccessController
> > > > > > > > 
> > > > > > > > 
> > > > > > > > hbase.coprocessor.region.classes
> > > > > > > >
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.security.token.TokenProvider,org.apache.hadoop.hbase.security.access.AccessController
> > > > > > > > 
> > > > > > > >
> > > > > > > > Find my stack overflow question here
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> http://stackoverflow.com/questions/37782043/hbase-acl-commands-are-too-slow
> > > > > > > >
> > > > > > > > Thanks,
> > > > > > > >
> > > > > > > > Kumar
> > > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>

Re: HBase acl commands are too slow

2016-06-17 Thread Ted Yu 
> > >
> > > > > > > 
> > > > > > > hbase.master
> > > > > > > IP:6
> > > > > > > 
> > > > > > > 
> > > > > > > hbase.rootdir
> > > > > > > hdfs://IP:9000/HBase
> > > > > > > 
> > > > > > > 
> > > > > > > hbase.cluster.distributed
> > > > > > > true
> > > > > > > 
> > > > > > > 
> > > > > > > hbase.zookeeper.quorum
> > > > > > > IP1:2181,IP2:2181,IP3:2181
> > > > > > > 
> > > > > > > 
> > > > > > > hbase.master.port
> > > > > > > 6
> > > > > > > 
> > > > > > > 
> > > > > > > hbase.master.info.port
> > > > > > > 60010
> > > > > > > 
> > > > > > > 
> > > > > > > hbase.regionserver.port
> > > > > > > 60020
> > > > > > > 
> > > > > > > 
> > > > > > > hbase.regionserver.info.port
> > > > > > > 60030
> > > > > > > 
> > > > > > > 
> > > > > > > hbase.security.authentication
> > > > > > > KERBEROS
> > > > > > > 
> > > > > > > 
> > > > > > > hbase.master.keytab.file
> > > > > > > masterkeytab
> > > > > > > 
> > > > > > > 
> > > > > > > hbase.regionserver.keytab.file
> > > > > > > regionserverkeytab
> > > > > > > 
> > > > > > > 
> > > > > > > hbase.master.kerberos.principal
> > > > > > > masterprincipal
> > > > > > > 
> > > > > > > 
> > > > > > > hbase.regionserver.kerberos.principal
> > > > > > > regionserverprincipal
> > > > > > > 
> > > > > > > 
> > > > > > > hbase.rpc.engine
> > > > > > > org.apache.hadoop.hbase.ipc.SecureRpcEngine
> > > > > > > 
> > > > > > > 
> > > > > > > hbase.ssl.enabled
> > > > > > > true
> > > > > > > 
> > > > > > > 
> > > > > > > hbase.superuser
> > > > > > > @HadoopUser
> > > > > > > 
> > > > > > > 
> > > > > > > hbase.security.authorization
> > > > > > > true
> > > > > > > 
> > > > > > > 
> > > > > > > hbase.coprocessor.master.classes
> > > > > > >
> > > > > >
> > > >
> org.apache.hadoop.hbase.security.access.AccessController
> > > > > > > 
> > > > > > > 
> > > > > > > hbase.coprocessor.region.classes
> > > > > > >
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.security.token.TokenProvider,org.apache.hadoop.hbase.security.access.AccessController
> > > > > > > 
> > > > > > >
> > > > > > > Find my stack overflow question here
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> http://stackoverflow.com/questions/37782043/hbase-acl-commands-are-too-slow
> > > > > > >
> > > > > > > Thanks,
> > > > > > >
> > > > > > > Kumar
> > > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
>

Re: HBase acl commands are too slow

2016-06-17 Thread kumar r 
> > > > 60010
> > > > > > 
> > > > > > 
> > > > > > hbase.regionserver.port
> > > > > > 60020
> > > > > > 
> > > > > > 
> > > > > > hbase.regionserver.info.port
> > > > > > 60030
> > > > > > 
> > > > > > 
> > > > > > hbase.security.authentication
> > > > > > KERBEROS
> > > > > > 
> > > > > > 
> > > > > > hbase.master.keytab.file
> > > > > > masterkeytab
> > > > > > 
> > > > > > 
> > > > > > hbase.regionserver.keytab.file
> > > > > > regionserverkeytab
> > > > > > 
> > > > > > 
> > > > > > hbase.master.kerberos.principal
> > > > > > masterprincipal
> > > > > > 
> > > > > > 
> > > > > > hbase.regionserver.kerberos.principal
> > > > > > regionserverprincipal
> > > > > > 
> > > > > > 
> > > > > > hbase.rpc.engine
> > > > > > org.apache.hadoop.hbase.ipc.SecureRpcEngine
> > > > > > 
> > > > > > 
> > > > > > hbase.ssl.enabled
> > > > > > true
> > > > > > 
> > > > > > 
> > > > > > hbase.superuser
> > > > > > @HadoopUser
> > > > > > 
> > > > > > 
> > > > > > hbase.security.authorization
> > > > > > true
> > > > > > 
> > > > > > 
> > > > > > hbase.coprocessor.master.classes
> > > > > >
> > > > >
> > > org.apache.hadoop.hbase.security.access.AccessController
> > > > > > 
> > > > > > 
> > > > > > hbase.coprocessor.region.classes
> > > > > >
> > > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.security.token.TokenProvider,org.apache.hadoop.hbase.security.access.AccessController
> > > > > > 
> > > > > >
> > > > > > Find my stack overflow question here
> > > > > >
> > > > >
> > > >
> > >
> >
> http://stackoverflow.com/questions/37782043/hbase-acl-commands-are-too-slow
> > > > > >
> > > > > > Thanks,
> > > > > >
> > > > > > Kumar
> > > > > >
> > > > >
> > > >
> > >
> >
>

Re: HBase acl commands are too slow

2016-06-15 Thread Ted Yu 
Have you looked at http://hbase.apache.org/book.html#security ?

I noticed that DEBUG logging was not on in the log you posted earlier.
Is it possible to turn on DEBUG logging and repeat the operation ?

Thanks

On Wed, Jun 15, 2016 at 2:12 AM, kumar r <kumarc...@gmail.com> wrote:

> Hi Ted,
>
> Thanks for your reply.
>
> I cannot find anything in configuration. Can you tell me what might be root
> cause for this issue?
>
> What will be major cause for acl command taking more than 30 seconds to
> process. I cannot find anything other than this in hbase log. Is there any
> documentation available to secure zookeeper and hbase with kerberos
> properly?
>
> The same log occurs in normal cluster also and i have enabled
> authorization. The same authorization command runs in 5 to 6 seconds.
>
> Thanks,
> Kumar
>
> On Tue, Jun 14, 2016 at 7:59 PM, Ted Yu <yuzhih...@gmail.com> wrote:
>
> > bq.  Opening socket connection to server machine2/192.168.60.3:2181.
> Will
> > not attempt to authenticate using SASL (unknown error)
> >
> > It seems connection to zookeeper might have some issue.
> > Can you double check configuration ?
> >
> > On Mon, Jun 13, 2016 at 11:56 PM, kumar r <kumarc...@gmail.com> wrote:
> >
> > > Hi,
> > >
> > > Thanks for the reply.
> > >
> > > Please find the command and time took to process it,
> > >
> > >
> > >
> > >
> > >
> > > *hbase(main):006:0> grant 'Selva','RW','@default'0 row(s) in 11.8830
> > > secondshbase(main):007:0> revoke 'Selva','@default'0 row(s) in 32.4330
> > > seconds*
> > >
> > > Find my HBase log in below pastebin
> > >
> > > http://pastebin.com/MHMjhHuF
> > >
> > >
> > > Thanks,
> > >
> > > Kumar
> > >
> > >
> > > On Mon, Jun 13, 2016 at 7:42 PM, Ted Yu <yuzhih...@gmail.com> wrote:
> > >
> > > > Can you inspect master log for the corresponding 40 seconds to see if
> > > there
> > > > was some clue ?
> > > >
> > > > Feel free to pastebin the log snippet for this period if you cannot
> > > > determine the cause.
> > > >
> > > > Cheers
> > > >
> > > > On Sun, Jun 12, 2016 at 10:19 PM, kumar r <kumarc...@gmail.com>
> wrote:
> > > >
> > > > > Hi,
> > > > >
> > > > > I have configured secure HBase-1.1.3. Hadoop version using 2.7.2.
> > > > >
> > > > > I have enabled authorization in HBase.
> > > > >
> > > > > When executing any authorization command like user_permission,
> grant,
> > > > > revoke,
> > > > > etc.
> > > > >
> > > > > Its getting more than 40 seconds to display the result.
> > > > >
> > > > > Below are hbase-site.xml configuration properties
> > > > >
> > > > >
> > > > > 
> > > > > hbase.master
> > > > > IP:6
> > > > > 
> > > > > 
> > > > > hbase.rootdir
> > > > > hdfs://IP:9000/HBase
> > > > > 
> > > > > 
> > > > > hbase.cluster.distributed
> > > > > true
> > > > > 
> > > > > 
> > > > > hbase.zookeeper.quorum
> > > > > IP1:2181,IP2:2181,IP3:2181
> > > > > 
> > > > > 
> > > > > hbase.master.port
> > > > > 6
> > > > > 
> > > > > 
> > > > > hbase.master.info.port
> > > > > 60010
> > > > > 
> > > > > 
> > > > > hbase.regionserver.port
> > > > > 60020
> > > > > 
> > > > > 
> > > > > hbase.regionserver.info.port
> > > > > 60030
> > > > > 
> > > > > 
> > > > > hbase.security.authentication
> > > > > KERBEROS
> > > > > 
> > > > > 
> > > > > hbase.master.keytab.file
> > > > > masterkeytab
> > > > > 
> > > > > 
> > > > > hbase.regionserver.keytab.file
> > > > > regionserverkeytab
> > > > > 
> > > > > 
> > > > > hbase.master.kerberos.principal
> > > > > masterprincipal
> > > > > 
> > > > > 
> > > > > hbase.regionserver.kerberos.principal
> > > > > regionserverprincipal
> > > > > 
> > > > > 
> > > > > hbase.rpc.engine
> > > > > org.apache.hadoop.hbase.ipc.SecureRpcEngine
> > > > > 
> > > > > 
> > > > > hbase.ssl.enabled
> > > > > true
> > > > > 
> > > > > 
> > > > > hbase.superuser
> > > > > @HadoopUser
> > > > > 
> > > > > 
> > > > > hbase.security.authorization
> > > > > true
> > > > > 
> > > > > 
> > > > > hbase.coprocessor.master.classes
> > > > >
> > > >
> > org.apache.hadoop.hbase.security.access.AccessController
> > > > > 
> > > > > 
> > > > > hbase.coprocessor.region.classes
> > > > >
> > > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.security.token.TokenProvider,org.apache.hadoop.hbase.security.access.AccessController
> > > > > 
> > > > >
> > > > > Find my stack overflow question here
> > > > >
> > > >
> > >
> >
> http://stackoverflow.com/questions/37782043/hbase-acl-commands-are-too-slow
> > > > >
> > > > > Thanks,
> > > > >
> > > > > Kumar
> > > > >
> > > >
> > >
> >
>

Re: HBase acl commands are too slow

2016-06-15 Thread kumar r 
Hi Ted,

Thanks for your reply.

I cannot find anything in configuration. Can you tell me what might be root
cause for this issue?

What will be major cause for acl command taking more than 30 seconds to
process. I cannot find anything other than this in hbase log. Is there any
documentation available to secure zookeeper and hbase with kerberos
properly?

The same log occurs in normal cluster also and i have enabled
authorization. The same authorization command runs in 5 to 6 seconds.

Thanks,
Kumar

On Tue, Jun 14, 2016 at 7:59 PM, Ted Yu <yuzhih...@gmail.com> wrote:

> bq.  Opening socket connection to server machine2/192.168.60.3:2181. Will
> not attempt to authenticate using SASL (unknown error)
>
> It seems connection to zookeeper might have some issue.
> Can you double check configuration ?
>
> On Mon, Jun 13, 2016 at 11:56 PM, kumar r <kumarc...@gmail.com> wrote:
>
> > Hi,
> >
> > Thanks for the reply.
> >
> > Please find the command and time took to process it,
> >
> >
> >
> >
> >
> > *hbase(main):006:0> grant 'Selva','RW','@default'0 row(s) in 11.8830
> > secondshbase(main):007:0> revoke 'Selva','@default'0 row(s) in 32.4330
> > seconds*
> >
> > Find my HBase log in below pastebin
> >
> > http://pastebin.com/MHMjhHuF
> >
> >
> > Thanks,
> >
> > Kumar
> >
> >
> > On Mon, Jun 13, 2016 at 7:42 PM, Ted Yu <yuzhih...@gmail.com> wrote:
> >
> > > Can you inspect master log for the corresponding 40 seconds to see if
> > there
> > > was some clue ?
> > >
> > > Feel free to pastebin the log snippet for this period if you cannot
> > > determine the cause.
> > >
> > > Cheers
> > >
> > > On Sun, Jun 12, 2016 at 10:19 PM, kumar r <kumarc...@gmail.com> wrote:
> > >
> > > > Hi,
> > > >
> > > > I have configured secure HBase-1.1.3. Hadoop version using 2.7.2.
> > > >
> > > > I have enabled authorization in HBase.
> > > >
> > > > When executing any authorization command like user_permission, grant,
> > > > revoke,
> > > > etc.
> > > >
> > > > Its getting more than 40 seconds to display the result.
> > > >
> > > > Below are hbase-site.xml configuration properties
> > > >
> > > >
> > > > 
> > > > hbase.master
> > > > IP:6
> > > > 
> > > > 
> > > > hbase.rootdir
> > > > hdfs://IP:9000/HBase
> > > > 
> > > > 
> > > > hbase.cluster.distributed
> > > > true
> > > > 
> > > > 
> > > > hbase.zookeeper.quorum
> > > > IP1:2181,IP2:2181,IP3:2181
> > > > 
> > > > 
> > > > hbase.master.port
> > > > 6
> > > > 
> > > > 
> > > > hbase.master.info.port
> > > > 60010
> > > > 
> > > > 
> > > > hbase.regionserver.port
> > > > 60020
> > > > 
> > > > 
> > > > hbase.regionserver.info.port
> > > > 60030
> > > > 
> > > > 
> > > > hbase.security.authentication
> > > > KERBEROS
> > > > 
> > > > 
> > > > hbase.master.keytab.file
> > > > masterkeytab
> > > > 
> > > > 
> > > > hbase.regionserver.keytab.file
> > > > regionserverkeytab
> > > > 
> > > > 
> > > > hbase.master.kerberos.principal
> > > > masterprincipal
> > > > 
> > > > 
> > > > hbase.regionserver.kerberos.principal
> > > > regionserverprincipal
> > > > 
> > > > 
> > > > hbase.rpc.engine
> > > > org.apache.hadoop.hbase.ipc.SecureRpcEngine
> > > > 
> > > > 
> > > > hbase.ssl.enabled
> > > > true
> > > > 
> > > > 
> > > > hbase.superuser
> > > > @HadoopUser
> > > > 
> > > > 
> > > > hbase.security.authorization
> > > > true
> > > > 
> > > > 
> > > > hbase.coprocessor.master.classes
> > > >
> > >
> org.apache.hadoop.hbase.security.access.AccessController
> > > > 
> > > > 
> > > > hbase.coprocessor.region.classes
> > > >
> > > >
> > >
> >
> org.apache.hadoop.hbase.security.token.TokenProvider,org.apache.hadoop.hbase.security.access.AccessController
> > > > 
> > > >
> > > > Find my stack overflow question here
> > > >
> > >
> >
> http://stackoverflow.com/questions/37782043/hbase-acl-commands-are-too-slow
> > > >
> > > > Thanks,
> > > >
> > > > Kumar
> > > >
> > >
> >
>

Re: HBase acl commands are too slow

2016-06-14 Thread Ted Yu 
bq.  Opening socket connection to server machine2/192.168.60.3:2181. Will
not attempt to authenticate using SASL (unknown error)

It seems connection to zookeeper might have some issue.
Can you double check configuration ?

On Mon, Jun 13, 2016 at 11:56 PM, kumar r <kumarc...@gmail.com> wrote:

> Hi,
>
> Thanks for the reply.
>
> Please find the command and time took to process it,
>
>
>
>
>
> *hbase(main):006:0> grant 'Selva','RW','@default'0 row(s) in 11.8830
> secondshbase(main):007:0> revoke 'Selva','@default'0 row(s) in 32.4330
> seconds*
>
> Find my HBase log in below pastebin
>
> http://pastebin.com/MHMjhHuF
>
>
> Thanks,
>
> Kumar
>
>
> On Mon, Jun 13, 2016 at 7:42 PM, Ted Yu <yuzhih...@gmail.com> wrote:
>
> > Can you inspect master log for the corresponding 40 seconds to see if
> there
> > was some clue ?
> >
> > Feel free to pastebin the log snippet for this period if you cannot
> > determine the cause.
> >
> > Cheers
> >
> > On Sun, Jun 12, 2016 at 10:19 PM, kumar r <kumarc...@gmail.com> wrote:
> >
> > > Hi,
> > >
> > > I have configured secure HBase-1.1.3. Hadoop version using 2.7.2.
> > >
> > > I have enabled authorization in HBase.
> > >
> > > When executing any authorization command like user_permission, grant,
> > > revoke,
> > > etc.
> > >
> > > Its getting more than 40 seconds to display the result.
> > >
> > > Below are hbase-site.xml configuration properties
> > >
> > >
> > > 
> > > hbase.master
> > > IP:6
> > > 
> > > 
> > > hbase.rootdir
> > > hdfs://IP:9000/HBase
> > > 
> > > 
> > > hbase.cluster.distributed
> > > true
> > > 
> > > 
> > > hbase.zookeeper.quorum
> > > IP1:2181,IP2:2181,IP3:2181
> > > 
> > > 
> > > hbase.master.port
> > > 6
> > > 
> > > 
> > > hbase.master.info.port
> > > 60010
> > > 
> > > 
> > > hbase.regionserver.port
> > > 60020
> > > 
> > > 
> > > hbase.regionserver.info.port
> > > 60030
> > > 
> > > 
> > > hbase.security.authentication
> > > KERBEROS
> > > 
> > > 
> > > hbase.master.keytab.file
> > > masterkeytab
> > > 
> > > 
> > > hbase.regionserver.keytab.file
> > > regionserverkeytab
> > > 
> > > 
> > > hbase.master.kerberos.principal
> > > masterprincipal
> > > 
> > > 
> > > hbase.regionserver.kerberos.principal
> > >     regionserverprincipal
> > > 
> > > 
> > > hbase.rpc.engine
> > > org.apache.hadoop.hbase.ipc.SecureRpcEngine
> > > 
> > > 
> > > hbase.ssl.enabled
> > > true
> > > 
> > > 
> > > hbase.superuser
> > > @HadoopUser
> > > 
> > > 
> > > hbase.security.authorization
> > > true
> > > 
> > > 
> > > hbase.coprocessor.master.classes
> > >
> >  org.apache.hadoop.hbase.security.access.AccessController
> > > 
> > > 
> > > hbase.coprocessor.region.classes
> > >
> > >
> >
> org.apache.hadoop.hbase.security.token.TokenProvider,org.apache.hadoop.hbase.security.access.AccessController
> > > 
> > >
> > > Find my stack overflow question here
> > >
> >
> http://stackoverflow.com/questions/37782043/hbase-acl-commands-are-too-slow
> > >
> > > Thanks,
> > >
> > > Kumar
> > >
> >
>

Re: HBase acl commands are too slow

2016-06-14 Thread kumar r 
Hi,

Thanks for the reply.

Please find the command and time took to process it,





*hbase(main):006:0> grant 'Selva','RW','@default'0 row(s) in 11.8830
secondshbase(main):007:0> revoke 'Selva','@default'0 row(s) in 32.4330
seconds*

Find my HBase log in below pastebin

http://pastebin.com/MHMjhHuF


Thanks,

Kumar


On Mon, Jun 13, 2016 at 7:42 PM, Ted Yu <yuzhih...@gmail.com> wrote:

> Can you inspect master log for the corresponding 40 seconds to see if there
> was some clue ?
>
> Feel free to pastebin the log snippet for this period if you cannot
> determine the cause.
>
> Cheers
>
> On Sun, Jun 12, 2016 at 10:19 PM, kumar r <kumarc...@gmail.com> wrote:
>
> > Hi,
> >
> > I have configured secure HBase-1.1.3. Hadoop version using 2.7.2.
> >
> > I have enabled authorization in HBase.
> >
> > When executing any authorization command like user_permission, grant,
> > revoke,
> > etc.
> >
> > Its getting more than 40 seconds to display the result.
> >
> > Below are hbase-site.xml configuration properties
> >
> >
> > 
> > hbase.master
> > IP:6
> > 
> > 
> > hbase.rootdir
> > hdfs://IP:9000/HBase
> > 
> > 
> > hbase.cluster.distributed
> > true
> > 
> > 
> > hbase.zookeeper.quorum
> > IP1:2181,IP2:2181,IP3:2181
> > 
> > 
> > hbase.master.port
> > 6
> > 
> > 
> > hbase.master.info.port
> > 60010
> > 
> > 
> > hbase.regionserver.port
> > 60020
> > 
> > 
> > hbase.regionserver.info.port
> > 60030
> > 
> > 
> > hbase.security.authentication
> > KERBEROS
> > 
> > 
> > hbase.master.keytab.file
> > masterkeytab
> > 
> > 
> > hbase.regionserver.keytab.file
> > regionserverkeytab
> > 
> > 
> > hbase.master.kerberos.principal
> > masterprincipal
> > 
> > 
> > hbase.regionserver.kerberos.principal
> > regionserverprincipal
> > 
> > 
> > hbase.rpc.engine
> > org.apache.hadoop.hbase.ipc.SecureRpcEngine
> > 
> > 
> > hbase.ssl.enabled
> > true
> > 
> > 
> >     hbase.superuser
> > @HadoopUser
> > 
> > 
> > hbase.security.authorization
> > true
> > 
> > 
> > hbase.coprocessor.master.classes
> >
>  org.apache.hadoop.hbase.security.access.AccessController
> > 
> > 
> > hbase.coprocessor.region.classes
> >
> >
> org.apache.hadoop.hbase.security.token.TokenProvider,org.apache.hadoop.hbase.security.access.AccessController
> > 
> >
> > Find my stack overflow question here
> >
> http://stackoverflow.com/questions/37782043/hbase-acl-commands-are-too-slow
> >
> > Thanks,
> >
> > Kumar
> >
>

Re: HBase acl commands are too slow

2016-06-13 Thread Ted Yu 
Can you inspect master log for the corresponding 40 seconds to see if there
was some clue ?

Feel free to pastebin the log snippet for this period if you cannot
determine the cause.

Cheers

On Sun, Jun 12, 2016 at 10:19 PM, kumar r <kumarc...@gmail.com> wrote:

> Hi,
>
> I have configured secure HBase-1.1.3. Hadoop version using 2.7.2.
>
> I have enabled authorization in HBase.
>
> When executing any authorization command like user_permission, grant,
> revoke,
> etc.
>
> Its getting more than 40 seconds to display the result.
>
> Below are hbase-site.xml configuration properties
>
>
> 
> hbase.master
> IP:6
> 
> 
> hbase.rootdir
> hdfs://IP:9000/HBase
> 
> 
> hbase.cluster.distributed
> true
> 
> 
> hbase.zookeeper.quorum
> IP1:2181,IP2:2181,IP3:2181
> 
> 
> hbase.master.port
> 6
> 
> 
> hbase.master.info.port
> 60010
> 
> 
> hbase.regionserver.port
> 60020
> 
> 
> hbase.regionserver.info.port
> 60030
> 
> 
> hbase.security.authentication
> KERBEROS
> 
> 
> hbase.master.keytab.file
> masterkeytab
> 
> 
> hbase.regionserver.keytab.file
> regionserverkeytab
> 
> 
> hbase.master.kerberos.principal
> masterprincipal
> 
> 
> hbase.regionserver.kerberos.principal
> regionserverprincipal
> 
> 
> hbase.rpc.engine
> org.apache.hadoop.hbase.ipc.SecureRpcEngine
> 
> 
> hbase.ssl.enabled
> true
> 
> 
> hbase.superuser
> @HadoopUser
> 
> 
> hbase.security.authorization
> true
> 
> 
> hbase.coprocessor.master.classes
> org.apache.hadoop.hbase.security.access.AccessController
> 
> 
> hbase.coprocessor.region.classes
>
> org.apache.hadoop.hbase.security.token.TokenProvider,org.apache.hadoop.hbase.security.access.AccessController
> 
>
> Find my stack overflow question here
> http://stackoverflow.com/questions/37782043/hbase-acl-commands-are-too-slow
>
> Thanks,
>
> Kumar
>

HBase acl commands are too slow

2016-06-12 Thread kumar r 
Hi,

I have configured secure HBase-1.1.3. Hadoop version using 2.7.2.

I have enabled authorization in HBase.

When executing any authorization command like user_permission, grant, revoke,
etc.

Its getting more than 40 seconds to display the result.

Below are hbase-site.xml configuration properties



hbase.master
IP:6


hbase.rootdir
hdfs://IP:9000/HBase


hbase.cluster.distributed
true


hbase.zookeeper.quorum
IP1:2181,IP2:2181,IP3:2181


hbase.master.port
6


hbase.master.info.port
60010


hbase.regionserver.port
60020


hbase.regionserver.info.port
60030


hbase.security.authentication
KERBEROS


hbase.master.keytab.file
masterkeytab


hbase.regionserver.keytab.file
regionserverkeytab


hbase.master.kerberos.principal
masterprincipal


hbase.regionserver.kerberos.principal
regionserverprincipal


hbase.rpc.engine
org.apache.hadoop.hbase.ipc.SecureRpcEngine


hbase.ssl.enabled
true


hbase.superuser
@HadoopUser


hbase.security.authorization
true


hbase.coprocessor.master.classes
org.apache.hadoop.hbase.security.access.AccessController


hbase.coprocessor.region.classes

org.apache.hadoop.hbase.security.token.TokenProvider,org.apache.hadoop.hbase.security.access.AccessController


Find my stack overflow question here
http://stackoverflow.com/questions/37782043/hbase-acl-commands-are-too-slow

Thanks,

Kumar