Re: access audit logs are not being shown on ranger ui

[Hafiz Mujadid]

Hi Bosco,
I checked the hadoop/lib folder there was no httpclient jar file so i
downloaded and placed 4.2.5 version of httpclient. httpmime is 4.2.5
version already. so both the jars are of same version now. But when i start
hadoop, face following exception as you mentioned

java.lang.NoClassDefFoundError:
org/apache/http/entity/mime/content/ContentBody
at
org.apache.solr.client.solrj.impl.LBHttpSolrClient.makeSolrClient(LBHttpSolrClient.java:265)
at
org.apache.solr.client.solrj.impl.LBHttpSolrClient.(LBHttpSolrClient.java:237)
at
org.apache.solr.client.solrj.impl.LBHttpSolrClient.(LBHttpSolrClient.java:217)
at
org.apache.solr.client.solrj.impl.LBHttpSolrClient.(LBHttpSolrClient.java:212)
at
org.apache.ranger.audit.destination.SolrAuditDestination.connect(SolrAuditDestination.java:92)
at
org.apache.ranger.audit.destination.SolrAuditDestination.init(SolrAuditDestination.java:56)
at
org.apache.ranger.audit.provider.AuditProviderFactory.init(AuditProviderFactory.java:163)
at
org.apache.ranger.authorization.hadoop.config.RangerConfiguration.initAudit(RangerConfiguration.java:127)
at
org.apache.ranger.plugin.service.RangerBasePlugin.init(RangerBasePlugin.java:89)
at
org.apache.ranger.authorization.hadoop.RangerHdfsPlugin.init(RangerHdfsAuthorizer.java:400)
at
org.apache.ranger.authorization.hadoop.RangerHdfsAuthorizer.start(RangerHdfsAuthorizer.java:84)
at
org.apache.hadoop.hdfs.server.namenode.FSNamesystem.startCommonServices(FSNamesystem.java:1074)
at
org.apache.hadoop.hdfs.server.namenode.NameNode.startCommonServices(NameNode.java:678)
at
org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:664)
at
org.apache.hadoop.hdfs.server.namenode.NameNode.(NameNode.java:811)
at
org.apache.hadoop.hdfs.server.namenode.NameNode.(NameNode.java:795)
at
org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1488)
at
org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1554)
Caused by: java.lang.ClassNotFoundException:
org.apache.http.entity.mime.content.ContentBody
at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308)
at java.lang.ClassLoader.loadClass(ClassLoader.java:358)


On Tue, Dec 1, 2015 at 4:04 AM, Don Bosco Durai  wrote:

> I see the following errors:
> 2015-12-01 02:56:30,065 FATAL
> org.apache.ranger.audit.destination.SolrAuditDestination: Can't connect to
> Solr server. URL=[http://192.168.23.105:6083/solr/ranger_audits]
> java.lang.NoClassDefFoundError:
> org/apache/http/entity/mime/content/ContentBody
> at
> org.apache.solr.client.solrj.impl.LBHttpSolrClient.makeSolrClient(LBHttpSolrClient.java:265)
>
> I had similar issues previously with incompatible http-client and
> http-mime jar files. I am not sure whether you are hitting the sample.
>
> Can you check the hadoop lib folders for *http*.jar files? Mine
> is httpclient-4.2.5.jar and we package httpmime-4.2.5.jar with HDFS
> plugin.
>
> Thanks
>
> Bosco
>
>
> From: Hafiz Mujadid 
> Reply-To: 
> Date: Monday, November 30, 2015 at 2:22 PM
> To: 
>
> Subject: Re: access audit logs are not being shown on ranger ui
>
> Hi Bosco,
>
> Attached is the content of namenode log file.
> Solr is working fine, i checked from the web UI
> Also /var/log/hadoop/hdfs/audit/solr/spool  contains following contents:
>
> archive
> index_batch_batch.solr_hdfs.json
> index_batch_batch.solr_hdfs_closed.json
>
> and all  of these files and folders are empty
>
>
> Hi Madhan,
>
> I have used same URL but still it does not work.
>
>
>
>
>
> On Tue, Dec 1, 2015 at 12:26 AM, Madhan Neethiraj 
> wrote:
>
>> Hafiz,
>>
>> Different Solr URLs are specified in configuration of HDFS plugin and
>> Ranger Admin. Can you please review and update such that they both point to
>> the same Solr instance?
>>
>> properties for hdfs plugin:
>>
>> *XAAUDIT.SOLR.URL=http://192.168.23.105:6083/solr/ranger_audits
>> *
>>
>>
>> properties in ranger-admin:
>>
>>
>> *audit_solr_urls=http://122.129.79.70:6083/solr/ranger_audits
>> *
>>
>>
>> Madhan
>>
>>
>> From: Don Bosco Durai 
>> Reply-To: "user@ranger.incubator.apache.org" <
>> user@ranger.incubator.apache.org>
>> Date: Monday, November 30, 2015 at 10:48 AM
>> To: "user@ranger.incubator.apache.org" 
>> Subject: Re: access audit logs are not being shown on ranger ui
>>
>> The properties seems correct. Best way to test  is to :
>>
>>1. Check the HDFS logs.
>>2. Check Solr from web interface (use the same ur

Re: access audit logs are not being shown on ranger ui

[Don Bosco Durai]

I see the following errors:
2015-12-01 02:56:30,065 FATAL 
org.apache.ranger.audit.destination.SolrAuditDestination: Can't connect to Solr 
server. URL=[http://192.168.23.105:6083/solr/ranger_audits]
java.lang.NoClassDefFoundError: org/apache/http/entity/mime/content/ContentBody
at 
org.apache.solr.client.solrj.impl.LBHttpSolrClient.makeSolrClient(LBHttpSolrClient.java:265)

I had similar issues previously with incompatible http-client and http-mime jar 
files. I am not sure whether you are hitting the sample.

Can you check the hadoop lib folders for *http*.jar files? Mine is 
httpclient-4.2.5.jar and we package httpmime-4.2.5.jar with HDFS plugin.

Thanks

Bosco


From:  Hafiz Mujadid 
Reply-To:  
Date:  Monday, November 30, 2015 at 2:22 PM
To:  
Subject:  Re: access audit logs are not being shown on ranger ui

Hi Bosco,

Attached is the content of namenode log file.
Solr is working fine, i checked from the web UI
Also /var/log/hadoop/hdfs/audit/solr/spool  contains following contents:

archive 
index_batch_batch.solr_hdfs.json
index_batch_batch.solr_hdfs_closed.json

and all  of these files and folders are empty


Hi Madhan,

I have used same URL but still it does not work.





On Tue, Dec 1, 2015 at 12:26 AM, Madhan Neethiraj  wrote:
Hafiz,

Different Solr URLs are specified in configuration of HDFS plugin and Ranger 
Admin. Can you please review and update such that they both point to the same 
Solr instance?

properties for hdfs plugin:
XAAUDIT.SOLR.URL=http://192.168.23.105:6083/solr/ranger_audits

properties in ranger-admin:
audit_solr_urls=http://122.129.79.70:6083/solr/ranger_audits

Madhan


From:  Don Bosco Durai 
Reply-To:  "user@ranger.incubator.apache.org" 
Date:  Monday, November 30, 2015 at 10:48 AM
To:  "user@ranger.incubator.apache.org" 
Subject:  Re: access audit logs are not being shown on ranger ui

The properties seems correct. Best way to test  is to :
Check the HDFS logs. 
Check Solr from web interface (use the same url you configured)
See if there are any unprocessed files in /var/log/hadoop/hdfs/audit/solr/spool
Bosco

From: Hafiz Mujadid 
Reply-To: 
Date: Monday, November 30, 2015 at 7:22 AM
To: 
Subject: access audit logs are not being shown on ranger ui

hi,

I have enabled ranger audits in solr, but access audits are not being shown.
properties for hdfs plugin
XAAUDIT.SOLR.ENABLE=true
XAAUDIT.SOLR.URL=http://192.168.23.105:6083/solr/ranger_audits
XAAUDIT.SOLR.USER=ranger_solr
XAAUDIT.SOLR.PASSWORD=NONE
XAAUDIT.SOLR.ZOOKEEPER=NONE
XAAUDIT.SOLR.FILE_SPOOL_DIR=/var/log/hadoop/hdfs/audit/solr/spool

properties in ranger-admin


audit_store=solr
audit_solr_urls=http://122.129.79.70:6083/solr/ranger_audits
audit_solr_user=ranger_solr
audit_solr_password=NONE
audit_solr_zookeepers=

But no audits logs are shown in ranger-admin


how can i check the issue ?

thanks



-- 
Regards: HAFIZ MUJADID

Re: hdfs plugin enable issue

[Ramesh Mani]

Bosco,

For now I don’t see any change, what I see in Hafiz manual installation is that 
classpath hadoop/share/hdfs/lib is the one where the hadoop is looking for.

Action item here would be do a manual install using apache bits on a raw hadoop 
cluster and test it.

Internally,   I tested it with Sandbox with manual installation and it works 
fine.

Regards,
Ramesh

From: Don Bosco Durai mailto:bo...@apache.org>>
Reply-To: 
"user@ranger.incubator.apache.org" 
mailto:user@ranger.incubator.apache.org>>
Date: Monday, November 30, 2015 at 11:27 AM
To: "user@ranger.incubator.apache.org" 
mailto:user@ranger.incubator.apache.org>>
Subject: Re: hdfs plugin enable issue

Great. Thanks. Can we also update the JIRA with the findings and workarounds.

Ramesh, do we need to do any changes from our side?

Thanks

Bosco


From: Hafiz Mujadid mailto:hafizmujadi...@gmail.com>>
Reply-To: 
mailto:user@ranger.incubator.apache.org>>
Date: Monday, November 30, 2015 at 10:47 AM
To: mailto:user@ranger.incubator.apache.org>>
Subject: Re: hdfs plugin enable issue

yes it worked, name node is started

On Mon, Nov 30, 2015 at 11:41 PM, Ramesh Mani 
mailto:rm...@hortonworks.com>> wrote:
Hafiz!

Please try placing it in hadoop/share/hdfs/lib and try again.

Thanks,
Ramesh
From: Hafiz Mujadid mailto:hafizmujadi...@gmail.com>>
Reply-To: 
"user@ranger.incubator.apache.org" 
mailto:user@ranger.incubator.apache.org>>
Date: Monday, November 30, 2015 at 10:21 AM

To: "user@ranger.incubator.apache.org" 
mailto:user@ranger.incubator.apache.org>>
Subject: Re: hdfs plugin enable issue

Ramesh!

I tried by copying ranger-hdfs-plugin-impl to hadoop/lib  but still same issue

On Mon, Nov 30, 2015 at 10:58 PM, Hafiz Mujadid 
mailto:hafizmujadi...@gmail.com>> wrote:
Yes I am using manual install

On Mon, Nov 30, 2015 at 10:56 PM, Don Bosco Durai 
mailto:bo...@apache.org>> wrote:
Ramesh, Hafiz might be using manual install. Have we tried that with the recent 
code? We selectively pick jars to be packaged in the components.

Thanks

Bosco


From: Ramesh Mani mailto:rm...@hortonworks.com>>
Reply-To: 
mailto:user@ranger.incubator.apache.org>>
Date: Monday, November 30, 2015 at 9:53 AM

To: "user@ranger.incubator.apache.org" 
mailto:user@ranger.incubator.apache.org>>
Subject: Re: hdfs plugin enable issue

Hafiz,

Under lib directory there is a folder ranger-hdfs-plugin-impl, please copy this 
folder to hadoop/lib  and try?

Regards,
Ramesh

From: Hafiz Mujadid mailto:hafizmujadi...@gmail.com>>
Reply-To: 
"user@ranger.incubator.apache.org" 
mailto:user@ranger.incubator.apache.org>>
Date: Monday, November 30, 2015 at 8:44 AM
To: "user@ranger.incubator.apache.org" 
mailto:user@ranger.incubator.apache.org>>
Subject: Re: hdfs plugin enable issue

Following are the contents Ramesh!

  1.  isable-hdfs-plugin.sh
  2.  install
  3.  lib
  4.  upgrade-hdfs-plugin.sh
  5.  enable-hdfs-plugin.sh
  6.  install.properties
  7.  ranger_credential_helper.py
  8.  upgrade-plugin.py

On Mon, Nov 30, 2015 at 9:39 PM, Hafiz Mujadid 
mailto:hafizmujadi...@gmail.com>> wrote:
in jira i have attached install.properties, which files else you need?



On Mon, Nov 30, 2015 at 9:37 PM, Ramesh Mani 
mailto:rm...@hortonworks.com>> wrote:
Hafiz,

Can I get the details on the files where you untarred the plugging tar, it  
should be like ranger-hdfs-plugin?

This issue seems to be that installation is not completely correct.

Regards,
Ramesh

From: Hafiz Mujadid mailto:hafizmujadi...@gmail.com>>
Reply-To: 
"user@ranger.incubator.apache.org" 
mailto:user@ranger.incubator.apache.org>>
Date: Monday, November 30, 2015 at 5:21 AM

To: "user@ranger.incubator.apache.org" 
mailto:user@ranger.incubator.apache.org>>
Subject: Re: hdfs plugin enable issue

Ramesh,

when i removed the following jars from the  hadoop/share/hdfs/lib and try 
enabling

 ranger-hdfs-plugin-shim-0.5.0.jar
 ranger-plugin-classloader-0.5.0.jar

I faced following exception

java.lang.ClassNotFoundException: Class 
org.apache.ranger.authorization.hadoop.RangerHdfsAuthorizer

On Mon, Nov 30, 2015 at 10:16 AM, Ramesh Mani 
mailto:rm...@hortonworks.com>> wrote:
Hafiz,

Can you remove the following jars from the  hadoop/share/hdfs/lib and try 
enabling?

 ranger-hdfs-plugin-shim-0.5.0.jar
 ranger-plugin-classloader-0.5.0.jar

Regards,
Ramesh

From: Hafiz Mujadid mailto:hafizmujadi...@gmail.com>>
Reply-To: 
"user@ranger.incubator.apache.org" 
mailto:user@ranger.incubator.apache.org>>
Date: Sunday, November 29, 2015 at 1:52 AM
To: "user@ranger.incubator.apache.org" 
mailto:user@ranger.in

Re: hdfs plugin enable issue

[Don Bosco Durai]

Great. Thanks. Can we also update the JIRA with the findings and workarounds.

Ramesh, do we need to do any changes from our side?

Thanks

Bosco


From:  Hafiz Mujadid 
Reply-To:  
Date:  Monday, November 30, 2015 at 10:47 AM
To:  
Subject:  Re: hdfs plugin enable issue

yes it worked, name node is started 

On Mon, Nov 30, 2015 at 11:41 PM, Ramesh Mani  wrote:
Hafiz!

Please try placing it in hadoop/share/hdfs/lib and try again.

Thanks,
Ramesh
From: Hafiz Mujadid 
Reply-To: "user@ranger.incubator.apache.org" 
Date: Monday, November 30, 2015 at 10:21 AM

To: "user@ranger.incubator.apache.org" 
Subject: Re: hdfs plugin enable issue

Ramesh! 

I tried by copying ranger-hdfs-plugin-impl to hadoop/lib  but still same issue

On Mon, Nov 30, 2015 at 10:58 PM, Hafiz Mujadid  
wrote:
Yes I am using manual install 

On Mon, Nov 30, 2015 at 10:56 PM, Don Bosco Durai  wrote:
Ramesh, Hafiz might be using manual install. Have we tried that with the recent 
code? We selectively pick jars to be packaged in the components.

Thanks

Bosco


From: Ramesh Mani 
Reply-To: 
Date: Monday, November 30, 2015 at 9:53 AM 

To: "user@ranger.incubator.apache.org" 
Subject: Re: hdfs plugin enable issue

Hafiz,

Under lib directory there is a folder ranger-hdfs-plugin-impl, please copy this 
folder to hadoop/lib  and try?

Regards,
Ramesh

From: Hafiz Mujadid 
Reply-To: "user@ranger.incubator.apache.org" 
Date: Monday, November 30, 2015 at 8:44 AM
To: "user@ranger.incubator.apache.org" 
Subject: Re: hdfs plugin enable issue

Following are the contents Ramesh!
isable-hdfs-plugin.sh  

install 

lib  

upgrade-hdfs-plugin.sh

enable-hdfs-plugin.sh   

install.properties  

ranger_credential_helper.py  

upgrade-plugin.py
On Mon, Nov 30, 2015 at 9:39 PM, Hafiz Mujadid  wrote:
in jira i have attached install.properties, which files else you need? 



On Mon, Nov 30, 2015 at 9:37 PM, Ramesh Mani  wrote:
Hafiz,

Can I get the details on the files where you untarred the plugging tar, it  
should be like ranger-hdfs-plugin?

This issue seems to be that installation is not completely correct.

Regards,
Ramesh

From: Hafiz Mujadid 
Reply-To: "user@ranger.incubator.apache.org" 
Date: Monday, November 30, 2015 at 5:21 AM 

To: "user@ranger.incubator.apache.org" 
Subject: Re: hdfs plugin enable issue

Ramesh,

when i removed the following jars from the  hadoop/share/hdfs/lib and try 
enabling

 ranger-hdfs-plugin-shim-0.5.0.jar  
 ranger-plugin-classloader-0.5.0.jar

I faced following exception

java.lang.ClassNotFoundException: Class 
org.apache.ranger.authorization.hadoop.RangerHdfsAuthorizer

On Mon, Nov 30, 2015 at 10:16 AM, Ramesh Mani  wrote:
Hafiz,

Can you remove the following jars from the  hadoop/share/hdfs/lib and try 
enabling?

 ranger-hdfs-plugin-shim-0.5.0.jar  
 ranger-plugin-classloader-0.5.0.jar

Regards,
Ramesh

From: Hafiz Mujadid 
Reply-To: "user@ranger.incubator.apache.org" 
Date: Sunday, November 29, 2015 at 1:52 AM
To: "user@ranger.incubator.apache.org" 
Subject: Re: hdfs plugin enable issue

hadoop/lib contains following jar files, I also placed these ranger related 
jars in hadoop/share/hdfs/lib folder

 ranger-hdfs-plugin-shim-0.5.0.jar  
 ranger-plugin-classloader-0.5.0.jar
native folder with following files
libhadoop.a  libhadooppipes.a  libhadoop.so  libhadoop.so.1.0.0  
libhadooputils.a  libhdfs.a  libhdfs.so  libhdfs.so.0.0.0



attached is the complete log file 

thanks


On Sun, Nov 29, 2015 at 11:37 AM, Ramesh Mani  wrote:
Hafiz,

Please list the files in  hadoop/lib directory , also provide the complete 
namenode log for me to review?

Thanks,
Rame

From: Hafiz Mujadid 
Reply-To: "user@ranger.incubator.apache.org" 
Date: Saturday, November 28, 2015 at 11:51 AM
To: "user@ranger.incubator.apache.org" 
Subject: hdfs plugin enable issue

Hi!

I have enabled hdfs plugin but after that name node is not starting, when i 
start namenode, i get following exception


2015-11-29 00:44:20,534 ERROR org.apache.hadoop.hdfs.server.namenode.NameNode: 
Failed to start namenode.
java.lang.RuntimeException: java.lang.reflect.InvocationTargetException
at 
org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:134)
at 
org.apache.hadoop.hdfs.server.namenode.FSNamesystem.(FSNamesystem.java:843)
at 
org.apache.hadoop.hdfs.server.namenode.FSNamesystem.loadFromDisk(FSNamesystem.java:673)
at 
org.apache.hadoop.hdfs.server.namenode.NameNode.loadNamesystem(NameNode.java:584)
at 
org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:644)
at 
org.apache.hadoop.hdfs.server.namenode.NameNode.(NameNode.java:811)
at 
org.apache.hadoop.hdfs.server.namenode.NameNode.(NameNode.java:795)
at 
org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1488)
at 
org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1554)
Caused by: java.lang.reflect.InvocationTargetException

Re: access audit logs are not being shown on ranger ui

[Madhan Neethiraj]

Hafiz,

Different Solr URLs are specified in configuration of HDFS plugin and Ranger 
Admin. Can you please review and update such that they both point to the same 
Solr instance?

properties for hdfs plugin:
XAAUDIT.SOLR.URL=http://192.168.23.105:6083/solr/ranger_audits

properties in ranger-admin:
audit_solr_urls=http://122.129.79.70:6083/solr/ranger_audits

Madhan


From:  Don Bosco Durai 
Reply-To:  "user@ranger.incubator.apache.org" 
Date:  Monday, November 30, 2015 at 10:48 AM
To:  "user@ranger.incubator.apache.org" 
Subject:  Re: access audit logs are not being shown on ranger ui

The properties seems correct. Best way to test  is to :
Check the HDFS logs. 
Check Solr from web interface (use the same url you configured)
See if there are any unprocessed files in /var/log/hadoop/hdfs/audit/solr/spool
Bosco

From: Hafiz Mujadid 
Reply-To: 
Date: Monday, November 30, 2015 at 7:22 AM
To: 
Subject: access audit logs are not being shown on ranger ui

hi,

I have enabled ranger audits in solr, but access audits are not being shown.
properties for hdfs plugin
XAAUDIT.SOLR.ENABLE=true
XAAUDIT.SOLR.URL=http://192.168.23.105:6083/solr/ranger_audits
XAAUDIT.SOLR.USER=ranger_solr
XAAUDIT.SOLR.PASSWORD=NONE
XAAUDIT.SOLR.ZOOKEEPER=NONE
XAAUDIT.SOLR.FILE_SPOOL_DIR=/var/log/hadoop/hdfs/audit/solr/spool

properties in ranger-admin


audit_store=solr
audit_solr_urls=http://122.129.79.70:6083/solr/ranger_audits
audit_solr_user=ranger_solr
audit_solr_password=NONE
audit_solr_zookeepers=

But no audits logs are shown in ranger-admin


how can i check the issue ?

thanks

Re: hdfs plugin enable issue

[Hafiz Mujadid]

of course we can whenever you wan here is my skypeid hafizmujadid

On Mon, Nov 30, 2015 at 11:47 PM, Hafiz Mujadid 
wrote:

> yes it worked, name node is started
>
> On Mon, Nov 30, 2015 at 11:41 PM, Ramesh Mani 
> wrote:
>
>> Hafiz!
>>
>> Please try placing it in hadoop/share/hdfs/lib and try again.
>>
>> Thanks,
>> Ramesh
>> From: Hafiz Mujadid 
>> Reply-To: "user@ranger.incubator.apache.org" <
>> user@ranger.incubator.apache.org>
>> Date: Monday, November 30, 2015 at 10:21 AM
>>
>> To: "user@ranger.incubator.apache.org" 
>> Subject: Re: hdfs plugin enable issue
>>
>> Ramesh!
>>
>> I tried by copying ranger-hdfs-plugin-impl to hadoop/lib  but still same
>> issue
>>
>> On Mon, Nov 30, 2015 at 10:58 PM, Hafiz Mujadid > > wrote:
>>
>>> Yes I am using manual install
>>>
>>> On Mon, Nov 30, 2015 at 10:56 PM, Don Bosco Durai 
>>> wrote:
>>>
 Ramesh, Hafiz might be using manual install. Have we tried that with
 the recent code? We selectively pick jars to be packaged in the components.

 Thanks

 Bosco


 From: Ramesh Mani 
 Reply-To: 
 Date: Monday, November 30, 2015 at 9:53 AM

 To: "user@ranger.incubator.apache.org" <
 user@ranger.incubator.apache.org>
 Subject: Re: hdfs plugin enable issue

 Hafiz,

 Under lib directory there is a folder ranger-hdfs-plugin-impl, please
 copy this folder to hadoop/lib  and try?

 Regards,
 Ramesh

 From: Hafiz Mujadid 
 Reply-To: "user@ranger.incubator.apache.org" <
 user@ranger.incubator.apache.org>
 Date: Monday, November 30, 2015 at 8:44 AM
 To: "user@ranger.incubator.apache.org" <
 user@ranger.incubator.apache.org>
 Subject: Re: hdfs plugin enable issue

 Following are the contents Ramesh!

1. isable-hdfs-plugin.sh
2. install
3. lib
4. upgrade-hdfs-plugin.sh
5. enable-hdfs-plugin.sh
6. install.properties
7. ranger_credential_helper.py
8. upgrade-plugin.py


 On Mon, Nov 30, 2015 at 9:39 PM, Hafiz Mujadid <
 hafizmujadi...@gmail.com> wrote:

> in jira i have attached install.properties, which files else you need?
>
>
>
> On Mon, Nov 30, 2015 at 9:37 PM, Ramesh Mani 
> wrote:
>
>> Hafiz,
>>
>> Can I get the details on the files where you untarred the plugging
>> tar, it  should be like ranger-hdfs-plugin?
>>
>> This issue seems to be that installation is not completely correct.
>>
>> Regards,
>> Ramesh
>>
>> From: Hafiz Mujadid 
>> Reply-To: "user@ranger.incubator.apache.org" <
>> user@ranger.incubator.apache.org>
>> Date: Monday, November 30, 2015 at 5:21 AM
>>
>> To: "user@ranger.incubator.apache.org" <
>> user@ranger.incubator.apache.org>
>> Subject: Re: hdfs plugin enable issue
>>
>> Ramesh,
>>
>> when i removed the following jars from the  hadoop/share/hdfs/lib
>> and try enabling
>>
>>
>> *ranger-hdfs-plugin-shim-0.5.0.jar
>>  ranger-plugin-classloader-0.5.0.jar*
>>
>> I faced following exception
>>
>> *java.lang.ClassNotFoundException: Class
>> org.apache.ranger.authorization.hadoop.RangerHdfsAuthorizer*
>>
>> On Mon, Nov 30, 2015 at 10:16 AM, Ramesh Mani 
>> wrote:
>>
>>> Hafiz,
>>>
>>> Can you remove the following jars from the  hadoop/share/hdfs/lib
>>> and try enabling?
>>>
>>>
>>> *ranger-hdfs-plugin-shim-0.5.0.jar
>>>  ranger-plugin-classloader-0.5.0.jar*
>>>
>>> Regards,
>>> Ramesh
>>>
>>> From: Hafiz Mujadid 
>>> Reply-To: "user@ranger.incubator.apache.org" <
>>> user@ranger.incubator.apache.org>
>>> Date: Sunday, November 29, 2015 at 1:52 AM
>>> To: "user@ranger.incubator.apache.org" <
>>> user@ranger.incubator.apache.org>
>>> Subject: Re: hdfs plugin enable issue
>>>
>>> hadoop/lib contains following jar files, I also placed these ranger
>>> related jars in hadoop/share/hdfs/lib folder
>>>
>>>
>>> *ranger-hdfs-plugin-shim-0.5.0.jar
>>>  ranger-plugin-classloader-0.5.0.jar*
>>> *native folder with following files*
>>> libhadoop.a  libhadooppipes.a  libhadoop.so  libhadoop.so.1.0.0
>>>  libhadooputils.a  libhdfs.a  libhdfs.so  libhdfs.so.0.0.0
>>>
>>>
>>>
>>> *attached is the complete log file *
>>>
>>> *thanks*
>>>
>>>
>>> On Sun, Nov 29, 2015 at 11:37 AM, Ramesh Mani >> > wrote:
>>>
 Hafiz,

 Please list the files in  hadoop/lib directory , also provide the
 complete namenode log for me to review?

 Thanks,
 Rame

 From: Hafiz Mujadid 
 Reply-To: "user@ranger.incubator.apache.org" <
 user@ranger.incubator.apache.org>
 Date: Saturday, November 28, 2015 at 11:51 AM
 To: "user@ranger.incubator.apache.org" <

Re: hdfs plugin enable issue

[Hafiz Mujadid]

yes it worked, name node is started

On Mon, Nov 30, 2015 at 11:41 PM, Ramesh Mani  wrote:

> Hafiz!
>
> Please try placing it in hadoop/share/hdfs/lib and try again.
>
> Thanks,
> Ramesh
> From: Hafiz Mujadid 
> Reply-To: "user@ranger.incubator.apache.org" <
> user@ranger.incubator.apache.org>
> Date: Monday, November 30, 2015 at 10:21 AM
>
> To: "user@ranger.incubator.apache.org" 
> Subject: Re: hdfs plugin enable issue
>
> Ramesh!
>
> I tried by copying ranger-hdfs-plugin-impl to hadoop/lib  but still same
> issue
>
> On Mon, Nov 30, 2015 at 10:58 PM, Hafiz Mujadid 
> wrote:
>
>> Yes I am using manual install
>>
>> On Mon, Nov 30, 2015 at 10:56 PM, Don Bosco Durai 
>> wrote:
>>
>>> Ramesh, Hafiz might be using manual install. Have we tried that with the
>>> recent code? We selectively pick jars to be packaged in the components.
>>>
>>> Thanks
>>>
>>> Bosco
>>>
>>>
>>> From: Ramesh Mani 
>>> Reply-To: 
>>> Date: Monday, November 30, 2015 at 9:53 AM
>>>
>>> To: "user@ranger.incubator.apache.org" >> >
>>> Subject: Re: hdfs plugin enable issue
>>>
>>> Hafiz,
>>>
>>> Under lib directory there is a folder ranger-hdfs-plugin-impl, please
>>> copy this folder to hadoop/lib  and try?
>>>
>>> Regards,
>>> Ramesh
>>>
>>> From: Hafiz Mujadid 
>>> Reply-To: "user@ranger.incubator.apache.org" <
>>> user@ranger.incubator.apache.org>
>>> Date: Monday, November 30, 2015 at 8:44 AM
>>> To: "user@ranger.incubator.apache.org" >> >
>>> Subject: Re: hdfs plugin enable issue
>>>
>>> Following are the contents Ramesh!
>>>
>>>1. isable-hdfs-plugin.sh
>>>2. install
>>>3. lib
>>>4. upgrade-hdfs-plugin.sh
>>>5. enable-hdfs-plugin.sh
>>>6. install.properties
>>>7. ranger_credential_helper.py
>>>8. upgrade-plugin.py
>>>
>>>
>>> On Mon, Nov 30, 2015 at 9:39 PM, Hafiz Mujadid >> > wrote:
>>>
 in jira i have attached install.properties, which files else you need?



 On Mon, Nov 30, 2015 at 9:37 PM, Ramesh Mani 
 wrote:

> Hafiz,
>
> Can I get the details on the files where you untarred the plugging
> tar, it  should be like ranger-hdfs-plugin?
>
> This issue seems to be that installation is not completely correct.
>
> Regards,
> Ramesh
>
> From: Hafiz Mujadid 
> Reply-To: "user@ranger.incubator.apache.org" <
> user@ranger.incubator.apache.org>
> Date: Monday, November 30, 2015 at 5:21 AM
>
> To: "user@ranger.incubator.apache.org" <
> user@ranger.incubator.apache.org>
> Subject: Re: hdfs plugin enable issue
>
> Ramesh,
>
> when i removed the following jars from the  hadoop/share/hdfs/lib and
> try enabling
>
>
> *ranger-hdfs-plugin-shim-0.5.0.jar
>  ranger-plugin-classloader-0.5.0.jar*
>
> I faced following exception
>
> *java.lang.ClassNotFoundException: Class
> org.apache.ranger.authorization.hadoop.RangerHdfsAuthorizer*
>
> On Mon, Nov 30, 2015 at 10:16 AM, Ramesh Mani 
> wrote:
>
>> Hafiz,
>>
>> Can you remove the following jars from the  hadoop/share/hdfs/lib and
>> try enabling?
>>
>>
>> *ranger-hdfs-plugin-shim-0.5.0.jar
>>  ranger-plugin-classloader-0.5.0.jar*
>>
>> Regards,
>> Ramesh
>>
>> From: Hafiz Mujadid 
>> Reply-To: "user@ranger.incubator.apache.org" <
>> user@ranger.incubator.apache.org>
>> Date: Sunday, November 29, 2015 at 1:52 AM
>> To: "user@ranger.incubator.apache.org" <
>> user@ranger.incubator.apache.org>
>> Subject: Re: hdfs plugin enable issue
>>
>> hadoop/lib contains following jar files, I also placed these ranger
>> related jars in hadoop/share/hdfs/lib folder
>>
>>
>> *ranger-hdfs-plugin-shim-0.5.0.jar
>>  ranger-plugin-classloader-0.5.0.jar*
>> *native folder with following files*
>> libhadoop.a  libhadooppipes.a  libhadoop.so  libhadoop.so.1.0.0
>>  libhadooputils.a  libhdfs.a  libhdfs.so  libhdfs.so.0.0.0
>>
>>
>>
>> *attached is the complete log file *
>>
>> *thanks*
>>
>>
>> On Sun, Nov 29, 2015 at 11:37 AM, Ramesh Mani 
>> wrote:
>>
>>> Hafiz,
>>>
>>> Please list the files in  hadoop/lib directory , also provide the
>>> complete namenode log for me to review?
>>>
>>> Thanks,
>>> Rame
>>>
>>> From: Hafiz Mujadid 
>>> Reply-To: "user@ranger.incubator.apache.org" <
>>> user@ranger.incubator.apache.org>
>>> Date: Saturday, November 28, 2015 at 11:51 AM
>>> To: "user@ranger.incubator.apache.org" <
>>> user@ranger.incubator.apache.org>
>>> Subject: hdfs plugin enable issue
>>>
>>> Hi!
>>>
>>> I have enabled hdfs plugin but after that name node is not starting,
>>> when i start namenode, i get following exception
>>>
>>>
>>> 2015-11-29 00:44:20,534 ERROR
>>> org.apache.hadoop.hdfs.server.namenode.NameNode: Failed to start 
>>> namenode.
>>> java.la

Re: access audit logs are not being shown on ranger ui

[Don Bosco Durai]

The properties seems correct. Best way to test  is to :
Check the HDFS logs. 
Check Solr from web interface (use the same url you configured)
See if there are any unprocessed files in /var/log/hadoop/hdfs/audit/solr/spool
Bosco

From:  Hafiz Mujadid 
Reply-To:  
Date:  Monday, November 30, 2015 at 7:22 AM
To:  
Subject:  access audit logs are not being shown on ranger ui

hi,

I have enabled ranger audits in solr, but access audits are not being shown.
properties for hdfs plugin
XAAUDIT.SOLR.ENABLE=true
XAAUDIT.SOLR.URL=http://192.168.23.105:6083/solr/ranger_audits
XAAUDIT.SOLR.USER=ranger_solr
XAAUDIT.SOLR.PASSWORD=NONE
XAAUDIT.SOLR.ZOOKEEPER=NONE
XAAUDIT.SOLR.FILE_SPOOL_DIR=/var/log/hadoop/hdfs/audit/solr/spool

properties in ranger-admin


audit_store=solr
audit_solr_urls=http://122.129.79.70:6083/solr/ranger_audits
audit_solr_user=ranger_solr
audit_solr_password=NONE
audit_solr_zookeepers=

But no audits logs are shown in ranger-admin


how can i check the issue ?

thanks

Re: hdfs plugin enable issue

[Ramesh Mani]

Hafiz!

Please try placing it in hadoop/share/hdfs/lib and try again.

Thanks,
Ramesh
From: Hafiz Mujadid mailto:hafizmujadi...@gmail.com>>
Reply-To: 
"user@ranger.incubator.apache.org" 
mailto:user@ranger.incubator.apache.org>>
Date: Monday, November 30, 2015 at 10:21 AM
To: "user@ranger.incubator.apache.org" 
mailto:user@ranger.incubator.apache.org>>
Subject: Re: hdfs plugin enable issue

Ramesh!

I tried by copying ranger-hdfs-plugin-impl to hadoop/lib  but still same issue

On Mon, Nov 30, 2015 at 10:58 PM, Hafiz Mujadid 
mailto:hafizmujadi...@gmail.com>> wrote:
Yes I am using manual install

On Mon, Nov 30, 2015 at 10:56 PM, Don Bosco Durai 
mailto:bo...@apache.org>> wrote:
Ramesh, Hafiz might be using manual install. Have we tried that with the recent 
code? We selectively pick jars to be packaged in the components.

Thanks

Bosco


From: Ramesh Mani mailto:rm...@hortonworks.com>>
Reply-To: 
mailto:user@ranger.incubator.apache.org>>
Date: Monday, November 30, 2015 at 9:53 AM

To: "user@ranger.incubator.apache.org" 
mailto:user@ranger.incubator.apache.org>>
Subject: Re: hdfs plugin enable issue

Hafiz,

Under lib directory there is a folder ranger-hdfs-plugin-impl, please copy this 
folder to hadoop/lib  and try?

Regards,
Ramesh

From: Hafiz Mujadid mailto:hafizmujadi...@gmail.com>>
Reply-To: 
"user@ranger.incubator.apache.org" 
mailto:user@ranger.incubator.apache.org>>
Date: Monday, November 30, 2015 at 8:44 AM
To: "user@ranger.incubator.apache.org" 
mailto:user@ranger.incubator.apache.org>>
Subject: Re: hdfs plugin enable issue

Following are the contents Ramesh!

  1.  isable-hdfs-plugin.sh
  2.  install
  3.  lib
  4.  upgrade-hdfs-plugin.sh
  5.  enable-hdfs-plugin.sh
  6.  install.properties
  7.  ranger_credential_helper.py
  8.  upgrade-plugin.py

On Mon, Nov 30, 2015 at 9:39 PM, Hafiz Mujadid 
mailto:hafizmujadi...@gmail.com>> wrote:
in jira i have attached install.properties, which files else you need?



On Mon, Nov 30, 2015 at 9:37 PM, Ramesh Mani 
mailto:rm...@hortonworks.com>> wrote:
Hafiz,

Can I get the details on the files where you untarred the plugging tar, it  
should be like ranger-hdfs-plugin?

This issue seems to be that installation is not completely correct.

Regards,
Ramesh

From: Hafiz Mujadid mailto:hafizmujadi...@gmail.com>>
Reply-To: 
"user@ranger.incubator.apache.org" 
mailto:user@ranger.incubator.apache.org>>
Date: Monday, November 30, 2015 at 5:21 AM

To: "user@ranger.incubator.apache.org" 
mailto:user@ranger.incubator.apache.org>>
Subject: Re: hdfs plugin enable issue

Ramesh,

when i removed the following jars from the  hadoop/share/hdfs/lib and try 
enabling

 ranger-hdfs-plugin-shim-0.5.0.jar
 ranger-plugin-classloader-0.5.0.jar

I faced following exception

java.lang.ClassNotFoundException: Class 
org.apache.ranger.authorization.hadoop.RangerHdfsAuthorizer

On Mon, Nov 30, 2015 at 10:16 AM, Ramesh Mani 
mailto:rm...@hortonworks.com>> wrote:
Hafiz,

Can you remove the following jars from the  hadoop/share/hdfs/lib and try 
enabling?

 ranger-hdfs-plugin-shim-0.5.0.jar
 ranger-plugin-classloader-0.5.0.jar

Regards,
Ramesh

From: Hafiz Mujadid mailto:hafizmujadi...@gmail.com>>
Reply-To: 
"user@ranger.incubator.apache.org" 
mailto:user@ranger.incubator.apache.org>>
Date: Sunday, November 29, 2015 at 1:52 AM
To: "user@ranger.incubator.apache.org" 
mailto:user@ranger.incubator.apache.org>>
Subject: Re: hdfs plugin enable issue

hadoop/lib contains following jar files, I also placed these ranger related 
jars in hadoop/share/hdfs/lib folder

 ranger-hdfs-plugin-shim-0.5.0.jar
 ranger-plugin-classloader-0.5.0.jar
native folder with following files
libhadoop.a  libhadooppipes.a  libhadoop.so  libhadoop.so.1.0.0  
libhadooputils.a  libhdfs.a  libhdfs.so  libhdfs.so.0.0.0



attached is the complete log file

thanks


On Sun, Nov 29, 2015 at 11:37 AM, Ramesh Mani 
mailto:rm...@hortonworks.com>> wrote:
Hafiz,

Please list the files in  hadoop/lib directory , also provide the complete 
namenode log for me to review?

Thanks,
Rame

From: Hafiz Mujadid mailto:hafizmujadi...@gmail.com>>
Reply-To: 
"user@ranger.incubator.apache.org" 
mailto:user@ranger.incubator.apache.org>>
Date: Saturday, November 28, 2015 at 11:51 AM
To: "user@ranger.incubator.apache.org" 
mailto:user@ranger.incubator.apache.org>>
Subject: hdfs plugin enable issue

Hi!

I have enabled hdfs plugin but after that name node is not starting, when i 
start namenode, i get following exception


2015-11-29 00:44:20,534 ERROR org.apache.hadoop.hdfs.server.namenode.NameNode: 

Re: hdfs plugin enable issue

[Ramesh Mani]

Bosco,

We haven’t tried manual install using the apache bits, I see that the issue 
Hafiz facing is that more related to how the manual installation put the plugin 
jars in hadoop lib path.

So if ranger-hdfs-plugin-impl is copied to hadoop/lib, it namenode should come 
up without issue.

I shall test this and see how this issue can be addressed.

Regards,
Ramesh

From: Don Bosco Durai mailto:bo...@apache.org>>
Reply-To: 
"user@ranger.incubator.apache.org" 
mailto:user@ranger.incubator.apache.org>>
Date: Monday, November 30, 2015 at 9:56 AM
To: "user@ranger.incubator.apache.org" 
mailto:user@ranger.incubator.apache.org>>
Subject: Re: hdfs plugin enable issue

Ramesh, Hafiz might be using manual install. Have we tried that with the recent 
code? We selectively pick jars to be packaged in the components.

Thanks

Bosco


From: Ramesh Mani mailto:rm...@hortonworks.com>>
Reply-To: 
mailto:user@ranger.incubator.apache.org>>
Date: Monday, November 30, 2015 at 9:53 AM
To: "user@ranger.incubator.apache.org" 
mailto:user@ranger.incubator.apache.org>>
Subject: Re: hdfs plugin enable issue

Hafiz,

Under lib directory there is a folder ranger-hdfs-plugin-impl, please copy this 
folder to hadoop/lib  and try?

Regards,
Ramesh

From: Hafiz Mujadid mailto:hafizmujadi...@gmail.com>>
Reply-To: 
"user@ranger.incubator.apache.org" 
mailto:user@ranger.incubator.apache.org>>
Date: Monday, November 30, 2015 at 8:44 AM
To: "user@ranger.incubator.apache.org" 
mailto:user@ranger.incubator.apache.org>>
Subject: Re: hdfs plugin enable issue

Following are the contents Ramesh!

  1.  isable-hdfs-plugin.sh
  2.  install
  3.  lib
  4.  upgrade-hdfs-plugin.sh
  5.  enable-hdfs-plugin.sh
  6.  install.properties
  7.  ranger_credential_helper.py
  8.  upgrade-plugin.py

On Mon, Nov 30, 2015 at 9:39 PM, Hafiz Mujadid 
mailto:hafizmujadi...@gmail.com>> wrote:
in jira i have attached install.properties, which files else you need?



On Mon, Nov 30, 2015 at 9:37 PM, Ramesh Mani 
mailto:rm...@hortonworks.com>> wrote:
Hafiz,

Can I get the details on the files where you untarred the plugging tar, it  
should be like ranger-hdfs-plugin?

This issue seems to be that installation is not completely correct.

Regards,
Ramesh

From: Hafiz Mujadid mailto:hafizmujadi...@gmail.com>>
Reply-To: 
"user@ranger.incubator.apache.org" 
mailto:user@ranger.incubator.apache.org>>
Date: Monday, November 30, 2015 at 5:21 AM

To: "user@ranger.incubator.apache.org" 
mailto:user@ranger.incubator.apache.org>>
Subject: Re: hdfs plugin enable issue

Ramesh,

when i removed the following jars from the  hadoop/share/hdfs/lib and try 
enabling

 ranger-hdfs-plugin-shim-0.5.0.jar
 ranger-plugin-classloader-0.5.0.jar

I faced following exception

java.lang.ClassNotFoundException: Class 
org.apache.ranger.authorization.hadoop.RangerHdfsAuthorizer

On Mon, Nov 30, 2015 at 10:16 AM, Ramesh Mani 
mailto:rm...@hortonworks.com>> wrote:
Hafiz,

Can you remove the following jars from the  hadoop/share/hdfs/lib and try 
enabling?

 ranger-hdfs-plugin-shim-0.5.0.jar
 ranger-plugin-classloader-0.5.0.jar

Regards,
Ramesh

From: Hafiz Mujadid mailto:hafizmujadi...@gmail.com>>
Reply-To: 
"user@ranger.incubator.apache.org" 
mailto:user@ranger.incubator.apache.org>>
Date: Sunday, November 29, 2015 at 1:52 AM
To: "user@ranger.incubator.apache.org" 
mailto:user@ranger.incubator.apache.org>>
Subject: Re: hdfs plugin enable issue

hadoop/lib contains following jar files, I also placed these ranger related 
jars in hadoop/share/hdfs/lib folder

 ranger-hdfs-plugin-shim-0.5.0.jar
 ranger-plugin-classloader-0.5.0.jar
native folder with following files
libhadoop.a  libhadooppipes.a  libhadoop.so  libhadoop.so.1.0.0  
libhadooputils.a  libhdfs.a  libhdfs.so  libhdfs.so.0.0.0



attached is the complete log file

thanks


On Sun, Nov 29, 2015 at 11:37 AM, Ramesh Mani 
mailto:rm...@hortonworks.com>> wrote:
Hafiz,

Please list the files in  hadoop/lib directory , also provide the complete 
namenode log for me to review?

Thanks,
Rame

From: Hafiz Mujadid mailto:hafizmujadi...@gmail.com>>
Reply-To: 
"user@ranger.incubator.apache.org" 
mailto:user@ranger.incubator.apache.org>>
Date: Saturday, November 28, 2015 at 11:51 AM
To: "user@ranger.incubator.apache.org" 
mailto:user@ranger.incubator.apache.org>>
Subject: hdfs plugin enable issue

Hi!

I have enabled hdfs plugin but after that name node is not starting, when i 
start namenode, i get following exception


2015-11-29 00:44:20,534 ERROR org.apache.hadoop.hdfs.server.namenode.NameNode: 
Failed to start name

Re: hdfs plugin enable issue

[Hafiz Mujadid]

Ramesh!

I tried by copying ranger-hdfs-plugin-impl to hadoop/lib  but still same
issue

On Mon, Nov 30, 2015 at 10:58 PM, Hafiz Mujadid 
wrote:

> Yes I am using manual install
>
> On Mon, Nov 30, 2015 at 10:56 PM, Don Bosco Durai 
> wrote:
>
>> Ramesh, Hafiz might be using manual install. Have we tried that with the
>> recent code? We selectively pick jars to be packaged in the components.
>>
>> Thanks
>>
>> Bosco
>>
>>
>> From: Ramesh Mani 
>> Reply-To: 
>> Date: Monday, November 30, 2015 at 9:53 AM
>>
>> To: "user@ranger.incubator.apache.org" 
>> Subject: Re: hdfs plugin enable issue
>>
>> Hafiz,
>>
>> Under lib directory there is a folder ranger-hdfs-plugin-impl, please
>> copy this folder to hadoop/lib  and try?
>>
>> Regards,
>> Ramesh
>>
>> From: Hafiz Mujadid 
>> Reply-To: "user@ranger.incubator.apache.org" <
>> user@ranger.incubator.apache.org>
>> Date: Monday, November 30, 2015 at 8:44 AM
>> To: "user@ranger.incubator.apache.org" 
>> Subject: Re: hdfs plugin enable issue
>>
>> Following are the contents Ramesh!
>>
>>1. isable-hdfs-plugin.sh
>>2. install
>>3. lib
>>4. upgrade-hdfs-plugin.sh
>>5. enable-hdfs-plugin.sh
>>6. install.properties
>>7. ranger_credential_helper.py
>>8. upgrade-plugin.py
>>
>>
>> On Mon, Nov 30, 2015 at 9:39 PM, Hafiz Mujadid 
>> wrote:
>>
>>> in jira i have attached install.properties, which files else you need?
>>>
>>>
>>>
>>> On Mon, Nov 30, 2015 at 9:37 PM, Ramesh Mani 
>>> wrote:
>>>
 Hafiz,

 Can I get the details on the files where you untarred the plugging tar,
 it  should be like ranger-hdfs-plugin?

 This issue seems to be that installation is not completely correct.

 Regards,
 Ramesh

 From: Hafiz Mujadid 
 Reply-To: "user@ranger.incubator.apache.org" <
 user@ranger.incubator.apache.org>
 Date: Monday, November 30, 2015 at 5:21 AM

 To: "user@ranger.incubator.apache.org" <
 user@ranger.incubator.apache.org>
 Subject: Re: hdfs plugin enable issue

 Ramesh,

 when i removed the following jars from the  hadoop/share/hdfs/lib and
 try enabling


 *ranger-hdfs-plugin-shim-0.5.0.jar
  ranger-plugin-classloader-0.5.0.jar*

 I faced following exception

 *java.lang.ClassNotFoundException: Class
 org.apache.ranger.authorization.hadoop.RangerHdfsAuthorizer*

 On Mon, Nov 30, 2015 at 10:16 AM, Ramesh Mani 
 wrote:

> Hafiz,
>
> Can you remove the following jars from the  hadoop/share/hdfs/lib and
> try enabling?
>
>
> *ranger-hdfs-plugin-shim-0.5.0.jar
>  ranger-plugin-classloader-0.5.0.jar*
>
> Regards,
> Ramesh
>
> From: Hafiz Mujadid 
> Reply-To: "user@ranger.incubator.apache.org" <
> user@ranger.incubator.apache.org>
> Date: Sunday, November 29, 2015 at 1:52 AM
> To: "user@ranger.incubator.apache.org" <
> user@ranger.incubator.apache.org>
> Subject: Re: hdfs plugin enable issue
>
> hadoop/lib contains following jar files, I also placed these ranger
> related jars in hadoop/share/hdfs/lib folder
>
>
> *ranger-hdfs-plugin-shim-0.5.0.jar
>  ranger-plugin-classloader-0.5.0.jar*
> *native folder with following files*
> libhadoop.a  libhadooppipes.a  libhadoop.so  libhadoop.so.1.0.0
>  libhadooputils.a  libhdfs.a  libhdfs.so  libhdfs.so.0.0.0
>
>
>
> *attached is the complete log file *
>
> *thanks*
>
>
> On Sun, Nov 29, 2015 at 11:37 AM, Ramesh Mani 
> wrote:
>
>> Hafiz,
>>
>> Please list the files in  hadoop/lib directory , also provide the
>> complete namenode log for me to review?
>>
>> Thanks,
>> Rame
>>
>> From: Hafiz Mujadid 
>> Reply-To: "user@ranger.incubator.apache.org" <
>> user@ranger.incubator.apache.org>
>> Date: Saturday, November 28, 2015 at 11:51 AM
>> To: "user@ranger.incubator.apache.org" <
>> user@ranger.incubator.apache.org>
>> Subject: hdfs plugin enable issue
>>
>> Hi!
>>
>> I have enabled hdfs plugin but after that name node is not starting,
>> when i start namenode, i get following exception
>>
>>
>> 2015-11-29 00:44:20,534 ERROR
>> org.apache.hadoop.hdfs.server.namenode.NameNode: Failed to start 
>> namenode.
>> java.lang.RuntimeException:
>> java.lang.reflect.InvocationTargetException
>> at
>> org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:134)
>> at
>> org.apache.hadoop.hdfs.server.namenode.FSNamesystem.(FSNamesystem.java:843)
>> at
>> org.apache.hadoop.hdfs.server.namenode.FSNamesystem.loadFromDisk(FSNamesystem.java:673)
>> at
>> org.apache.hadoop.hdfs.server.namenode.NameNode.loadNamesystem(NameNode.java:584)
>> at
>> org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:644)
>>

Re: Group level permission are not working in ranger

[Hafiz Mujadid]

Bosco, I have tried both mysql db and solr as well, only plugin related
auditing is being shown

On Mon, Nov 30, 2015 at 10:53 PM, Don Bosco Durai  wrote:

> Yes, you should fix audit first. That will help in debugging these issues
> also.
>
> BTW, are you using Solr or DB?
>
> Recommendation is to use Solr. Yesterday, I have uploaded a new package
> for setting up Solr. It is available as attachment in
> https://issues.apache.org/jira/browse/RANGER-728. The instructions are in
> https://cwiki.apache.org/confluence/display/RANGER/Install+and+Configure+Solr+for+Ranger+Audits+-+Apache+Ranger+0.5
>
> Give it a try.
>
> Thanks
>
> Bosco
>
>
> From: Madhan Neethiraj 
> Reply-To: 
> Date: Monday, November 30, 2015 at 8:57 AM
>
> To: "user@ranger.incubator.apache.org" 
> Subject: Re: Group level permission are not working in ranger
>
> Hafiz,
>
> Few things to check:
>  1. Do you have another policy in Ranger that allows WRITE access?
>  2. Can you disable this policy and try mkdir?
>
> Fixing the issue with audit will help; audit log will have the details of
> how the access was allowed (hadoop-acl or ranger-acl; in case of
> ranger-acl, the policy-ID that determined the access).
>
> Madhan
>
> From: Hafiz Mujadid 
> Reply-To: "user@ranger.incubator.apache.org" <
> user@ranger.incubator.apache.org>
> Date: Monday, November 30, 2015 at 6:16 AM
> To: "user@ranger.incubator.apache.org" 
> Subject: Re: Group level permission are not working in ranger
>
> Bosco,
>
> I have followed above steps
>
>1. drwxr-xr-x   - hduser hadoop  0 2015-11-30 18:49 /pg
>2. changed the umask so newly created folder or files have following
>permissions
>d---rwxrwx   - asma hadoop  0 2015-11-30 19:03 /pg/b
>3. i changed the ownership of all folders in hdfs with hduser:hadoop
>4. ran the command hdfs dfs -chmod -R 000 /pg
>
>
> but still group level permissions are not working.
>
> my audits are not working, i am trying to figure out the issue with
> audits. i will let you know when audits are available.
>
>
> thanks
>
> On Mon, Nov 30, 2015 at 7:13 PM, Hafiz Mujadid 
> wrote:
>
>> Bosco,
>>
>> I have followed above steps
>> drwxr-xr-x   - hduser hadoop  0 2015-11-30 18:49 /pg
>> changed the umask so newly created folder or files have following
>> permissions
>> d---rwxrwx   - asma hadoop  0 2015-11-30 19:03 /pg/b
>> i changed the ownership of all folders in hdfs with hduser:hadoop
>>
>> but still group level permissions are not working.
>>
>>
>> my audits are not working, i am trying to figure out the issue with
>> audits. i will let you know when audits are available.
>>
>>
>> thanks
>>
>>
>> On Mon, Nov 30, 2015 at 9:34 AM, Don Bosco Durai 
>> wrote:
>>
>>> Can you check Ranger Audits?
>>>
>>> Also, do couple of things:
>>> 1. hdfs dfs -ls /pg  (check the HDFS level permissions)
>>> 2. In HDFS settngs, set the umask to 700 and restart name node.
>>> 3. hdfs dfs -chown hdfs:hdfs /pg
>>> 4. hdfs dfs -chmod -R 000 /pg
>>>
>>> For all user folders, e.g. /app/hive, do #3 and #4 as above.
>>>
>>> Bosco
>>>
>>>
>>> From: Hafiz Mujadid 
>>> Reply-To: 
>>> Date: Sunday, November 29, 2015 at 8:29 PM
>>> To: 
>>> Subject: Re: Group level permission are not working in ranger
>>>
>>> Yes Bosco, directory is being created.
>>>
>>> On Mon, Nov 30, 2015 at 2:47 AM, Don Bosco Durai 
>>> wrote:
>>>
 What is happening here? Is the directory getting created?

 Thanks

 Bosco


 From: Hafiz Mujadid 
 Reply-To: 
 Date: Sunday, November 29, 2015 at 1:44 PM
 To: 
 Subject: Group level permission are not working in ranger

 Hi all

 I am trying to apply permission on an ldap group but it's not working

 [image: Inline image 1]


 But when i run following command
 *HADOOP_USER_NAME=asma hdfs dfs -mkdir /pg/b*

 i works successfully
 what is the issue? ldap users and groups are synced correctly as when i
 run the command  *hdfs groups asma*   it returns correct group
 asma : datascientist


>>>
>>>
>>> --
>>> Regards: HAFIZ MUJADID
>>>
>>>
>>
>>
>> --
>> Regards: HAFIZ MUJADID
>>
>
>
>
> --
> Regards: HAFIZ MUJADID
>
>


-- 
Regards: HAFIZ MUJADID

Re: hdfs plugin enable issue

[Hafiz Mujadid]

Yes I am using manual install

On Mon, Nov 30, 2015 at 10:56 PM, Don Bosco Durai  wrote:

> Ramesh, Hafiz might be using manual install. Have we tried that with the
> recent code? We selectively pick jars to be packaged in the components.
>
> Thanks
>
> Bosco
>
>
> From: Ramesh Mani 
> Reply-To: 
> Date: Monday, November 30, 2015 at 9:53 AM
>
> To: "user@ranger.incubator.apache.org" 
> Subject: Re: hdfs plugin enable issue
>
> Hafiz,
>
> Under lib directory there is a folder ranger-hdfs-plugin-impl, please copy
> this folder to hadoop/lib  and try?
>
> Regards,
> Ramesh
>
> From: Hafiz Mujadid 
> Reply-To: "user@ranger.incubator.apache.org" <
> user@ranger.incubator.apache.org>
> Date: Monday, November 30, 2015 at 8:44 AM
> To: "user@ranger.incubator.apache.org" 
> Subject: Re: hdfs plugin enable issue
>
> Following are the contents Ramesh!
>
>1. isable-hdfs-plugin.sh
>2. install
>3. lib
>4. upgrade-hdfs-plugin.sh
>5. enable-hdfs-plugin.sh
>6. install.properties
>7. ranger_credential_helper.py
>8. upgrade-plugin.py
>
>
> On Mon, Nov 30, 2015 at 9:39 PM, Hafiz Mujadid 
> wrote:
>
>> in jira i have attached install.properties, which files else you need?
>>
>>
>>
>> On Mon, Nov 30, 2015 at 9:37 PM, Ramesh Mani 
>> wrote:
>>
>>> Hafiz,
>>>
>>> Can I get the details on the files where you untarred the plugging tar,
>>> it  should be like ranger-hdfs-plugin?
>>>
>>> This issue seems to be that installation is not completely correct.
>>>
>>> Regards,
>>> Ramesh
>>>
>>> From: Hafiz Mujadid 
>>> Reply-To: "user@ranger.incubator.apache.org" <
>>> user@ranger.incubator.apache.org>
>>> Date: Monday, November 30, 2015 at 5:21 AM
>>>
>>> To: "user@ranger.incubator.apache.org" >> >
>>> Subject: Re: hdfs plugin enable issue
>>>
>>> Ramesh,
>>>
>>> when i removed the following jars from the  hadoop/share/hdfs/lib and
>>> try enabling
>>>
>>>
>>> *ranger-hdfs-plugin-shim-0.5.0.jar
>>>  ranger-plugin-classloader-0.5.0.jar*
>>>
>>> I faced following exception
>>>
>>> *java.lang.ClassNotFoundException: Class
>>> org.apache.ranger.authorization.hadoop.RangerHdfsAuthorizer*
>>>
>>> On Mon, Nov 30, 2015 at 10:16 AM, Ramesh Mani 
>>> wrote:
>>>
 Hafiz,

 Can you remove the following jars from the  hadoop/share/hdfs/lib and
 try enabling?


 *ranger-hdfs-plugin-shim-0.5.0.jar
  ranger-plugin-classloader-0.5.0.jar*

 Regards,
 Ramesh

 From: Hafiz Mujadid 
 Reply-To: "user@ranger.incubator.apache.org" <
 user@ranger.incubator.apache.org>
 Date: Sunday, November 29, 2015 at 1:52 AM
 To: "user@ranger.incubator.apache.org" <
 user@ranger.incubator.apache.org>
 Subject: Re: hdfs plugin enable issue

 hadoop/lib contains following jar files, I also placed these ranger
 related jars in hadoop/share/hdfs/lib folder


 *ranger-hdfs-plugin-shim-0.5.0.jar
  ranger-plugin-classloader-0.5.0.jar*
 *native folder with following files*
 libhadoop.a  libhadooppipes.a  libhadoop.so  libhadoop.so.1.0.0
  libhadooputils.a  libhdfs.a  libhdfs.so  libhdfs.so.0.0.0



 *attached is the complete log file *

 *thanks*


 On Sun, Nov 29, 2015 at 11:37 AM, Ramesh Mani 
 wrote:

> Hafiz,
>
> Please list the files in  hadoop/lib directory , also provide the
> complete namenode log for me to review?
>
> Thanks,
> Rame
>
> From: Hafiz Mujadid 
> Reply-To: "user@ranger.incubator.apache.org" <
> user@ranger.incubator.apache.org>
> Date: Saturday, November 28, 2015 at 11:51 AM
> To: "user@ranger.incubator.apache.org" <
> user@ranger.incubator.apache.org>
> Subject: hdfs plugin enable issue
>
> Hi!
>
> I have enabled hdfs plugin but after that name node is not starting,
> when i start namenode, i get following exception
>
>
> 2015-11-29 00:44:20,534 ERROR
> org.apache.hadoop.hdfs.server.namenode.NameNode: Failed to start namenode.
> java.lang.RuntimeException: java.lang.reflect.InvocationTargetException
> at
> org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:134)
> at
> org.apache.hadoop.hdfs.server.namenode.FSNamesystem.(FSNamesystem.java:843)
> at
> org.apache.hadoop.hdfs.server.namenode.FSNamesystem.loadFromDisk(FSNamesystem.java:673)
> at
> org.apache.hadoop.hdfs.server.namenode.NameNode.loadNamesystem(NameNode.java:584)
> at
> org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:644)
> at
> org.apache.hadoop.hdfs.server.namenode.NameNode.(NameNode.java:811)
> at
> org.apache.hadoop.hdfs.server.namenode.NameNode.(NameNode.java:795)
> at
> org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1488)
> at
> org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java

Re: hdfs plugin enable issue

[Don Bosco Durai]

Ramesh, Hafiz might be using manual install. Have we tried that with the recent 
code? We selectively pick jars to be packaged in the components.

Thanks

Bosco


From:  Ramesh Mani 
Reply-To:  
Date:  Monday, November 30, 2015 at 9:53 AM
To:  "user@ranger.incubator.apache.org" 
Subject:  Re: hdfs plugin enable issue

Hafiz,

Under lib directory there is a folder ranger-hdfs-plugin-impl, please copy this 
folder to hadoop/lib  and try?

Regards,
Ramesh

From: Hafiz Mujadid 
Reply-To: "user@ranger.incubator.apache.org" 
Date: Monday, November 30, 2015 at 8:44 AM
To: "user@ranger.incubator.apache.org" 
Subject: Re: hdfs plugin enable issue

Following are the contents Ramesh!
isable-hdfs-plugin.sh  

install 

lib  

upgrade-hdfs-plugin.sh

enable-hdfs-plugin.sh   

install.properties  

ranger_credential_helper.py  

upgrade-plugin.py
On Mon, Nov 30, 2015 at 9:39 PM, Hafiz Mujadid  wrote:
in jira i have attached install.properties, which files else you need? 



On Mon, Nov 30, 2015 at 9:37 PM, Ramesh Mani  wrote:
Hafiz,

Can I get the details on the files where you untarred the plugging tar, it  
should be like ranger-hdfs-plugin?

This issue seems to be that installation is not completely correct.

Regards,
Ramesh

From: Hafiz Mujadid 
Reply-To: "user@ranger.incubator.apache.org" 
Date: Monday, November 30, 2015 at 5:21 AM 

To: "user@ranger.incubator.apache.org" 
Subject: Re: hdfs plugin enable issue

Ramesh,

when i removed the following jars from the  hadoop/share/hdfs/lib and try 
enabling

 ranger-hdfs-plugin-shim-0.5.0.jar  
 ranger-plugin-classloader-0.5.0.jar

I faced following exception

java.lang.ClassNotFoundException: Class 
org.apache.ranger.authorization.hadoop.RangerHdfsAuthorizer

On Mon, Nov 30, 2015 at 10:16 AM, Ramesh Mani  wrote:
Hafiz,

Can you remove the following jars from the  hadoop/share/hdfs/lib and try 
enabling?

 ranger-hdfs-plugin-shim-0.5.0.jar  
 ranger-plugin-classloader-0.5.0.jar

Regards,
Ramesh

From: Hafiz Mujadid 
Reply-To: "user@ranger.incubator.apache.org" 
Date: Sunday, November 29, 2015 at 1:52 AM
To: "user@ranger.incubator.apache.org" 
Subject: Re: hdfs plugin enable issue

hadoop/lib contains following jar files, I also placed these ranger related 
jars in hadoop/share/hdfs/lib folder

 ranger-hdfs-plugin-shim-0.5.0.jar  
 ranger-plugin-classloader-0.5.0.jar
native folder with following files
libhadoop.a  libhadooppipes.a  libhadoop.so  libhadoop.so.1.0.0  
libhadooputils.a  libhdfs.a  libhdfs.so  libhdfs.so.0.0.0



attached is the complete log file 

thanks


On Sun, Nov 29, 2015 at 11:37 AM, Ramesh Mani  wrote:
Hafiz,

Please list the files in  hadoop/lib directory , also provide the complete 
namenode log for me to review?

Thanks,
Rame

From: Hafiz Mujadid 
Reply-To: "user@ranger.incubator.apache.org" 
Date: Saturday, November 28, 2015 at 11:51 AM
To: "user@ranger.incubator.apache.org" 
Subject: hdfs plugin enable issue

Hi!

I have enabled hdfs plugin but after that name node is not starting, when i 
start namenode, i get following exception


2015-11-29 00:44:20,534 ERROR org.apache.hadoop.hdfs.server.namenode.NameNode: 
Failed to start namenode.
java.lang.RuntimeException: java.lang.reflect.InvocationTargetException
at 
org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:134)
at 
org.apache.hadoop.hdfs.server.namenode.FSNamesystem.(FSNamesystem.java:843)
at 
org.apache.hadoop.hdfs.server.namenode.FSNamesystem.loadFromDisk(FSNamesystem.java:673)
at 
org.apache.hadoop.hdfs.server.namenode.NameNode.loadNamesystem(NameNode.java:584)
at 
org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:644)
at 
org.apache.hadoop.hdfs.server.namenode.NameNode.(NameNode.java:811)
at 
org.apache.hadoop.hdfs.server.namenode.NameNode.(NameNode.java:795)
at 
org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1488)
at 
org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1554)
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at 
sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
at 
sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
at 
org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:132)
... 8 more
Caused by: java.lang.StackOverflowError
at java.lang.Exception.(Exception.java:102)
at 
java.lang.ReflectiveOperationException.(ReflectiveOperationException.java:89)
at 
java.lang.reflect.InvocationTargetException.(InvocationTargetException.java:72)
at sun.reflect.GeneratedConstructorAccessor7.newInstance(Unknown Source)
at 
sun.reflect.DelegatingConst

Re: hdfs plugin enable issue

[Ramesh Mani]

Hafiz,

Under lib directory there is a folder ranger-hdfs-plugin-impl, please copy this 
folder to hadoop/lib  and try?

Regards,
Ramesh

From: Hafiz Mujadid mailto:hafizmujadi...@gmail.com>>
Reply-To: 
"user@ranger.incubator.apache.org" 
mailto:user@ranger.incubator.apache.org>>
Date: Monday, November 30, 2015 at 8:44 AM
To: "user@ranger.incubator.apache.org" 
mailto:user@ranger.incubator.apache.org>>
Subject: Re: hdfs plugin enable issue

Following are the contents Ramesh!

  1.  isable-hdfs-plugin.sh
  2.  install
  3.  lib
  4.  upgrade-hdfs-plugin.sh
  5.  enable-hdfs-plugin.sh
  6.  install.properties
  7.  ranger_credential_helper.py
  8.  upgrade-plugin.py

On Mon, Nov 30, 2015 at 9:39 PM, Hafiz Mujadid 
mailto:hafizmujadi...@gmail.com>> wrote:
in jira i have attached install.properties, which files else you need?



On Mon, Nov 30, 2015 at 9:37 PM, Ramesh Mani 
mailto:rm...@hortonworks.com>> wrote:
Hafiz,

Can I get the details on the files where you untarred the plugging tar, it  
should be like ranger-hdfs-plugin?

This issue seems to be that installation is not completely correct.

Regards,
Ramesh

From: Hafiz Mujadid mailto:hafizmujadi...@gmail.com>>
Reply-To: 
"user@ranger.incubator.apache.org" 
mailto:user@ranger.incubator.apache.org>>
Date: Monday, November 30, 2015 at 5:21 AM

To: "user@ranger.incubator.apache.org" 
mailto:user@ranger.incubator.apache.org>>
Subject: Re: hdfs plugin enable issue

Ramesh,

when i removed the following jars from the  hadoop/share/hdfs/lib and try 
enabling

 ranger-hdfs-plugin-shim-0.5.0.jar
 ranger-plugin-classloader-0.5.0.jar

I faced following exception

java.lang.ClassNotFoundException: Class 
org.apache.ranger.authorization.hadoop.RangerHdfsAuthorizer

On Mon, Nov 30, 2015 at 10:16 AM, Ramesh Mani 
mailto:rm...@hortonworks.com>> wrote:
Hafiz,

Can you remove the following jars from the  hadoop/share/hdfs/lib and try 
enabling?

 ranger-hdfs-plugin-shim-0.5.0.jar
 ranger-plugin-classloader-0.5.0.jar

Regards,
Ramesh

From: Hafiz Mujadid mailto:hafizmujadi...@gmail.com>>
Reply-To: 
"user@ranger.incubator.apache.org" 
mailto:user@ranger.incubator.apache.org>>
Date: Sunday, November 29, 2015 at 1:52 AM
To: "user@ranger.incubator.apache.org" 
mailto:user@ranger.incubator.apache.org>>
Subject: Re: hdfs plugin enable issue

hadoop/lib contains following jar files, I also placed these ranger related 
jars in hadoop/share/hdfs/lib folder

 ranger-hdfs-plugin-shim-0.5.0.jar
 ranger-plugin-classloader-0.5.0.jar
native folder with following files
libhadoop.a  libhadooppipes.a  libhadoop.so  libhadoop.so.1.0.0  
libhadooputils.a  libhdfs.a  libhdfs.so  libhdfs.so.0.0.0



attached is the complete log file

thanks


On Sun, Nov 29, 2015 at 11:37 AM, Ramesh Mani 
mailto:rm...@hortonworks.com>> wrote:
Hafiz,

Please list the files in  hadoop/lib directory , also provide the complete 
namenode log for me to review?

Thanks,
Rame

From: Hafiz Mujadid mailto:hafizmujadi...@gmail.com>>
Reply-To: 
"user@ranger.incubator.apache.org" 
mailto:user@ranger.incubator.apache.org>>
Date: Saturday, November 28, 2015 at 11:51 AM
To: "user@ranger.incubator.apache.org" 
mailto:user@ranger.incubator.apache.org>>
Subject: hdfs plugin enable issue

Hi!

I have enabled hdfs plugin but after that name node is not starting, when i 
start namenode, i get following exception


2015-11-29 00:44:20,534 ERROR org.apache.hadoop.hdfs.server.namenode.NameNode: 
Failed to start namenode.
java.lang.RuntimeException: java.lang.reflect.InvocationTargetException
at 
org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:134)
at 
org.apache.hadoop.hdfs.server.namenode.FSNamesystem.(FSNamesystem.java:843)
at 
org.apache.hadoop.hdfs.server.namenode.FSNamesystem.loadFromDisk(FSNamesystem.java:673)
at 
org.apache.hadoop.hdfs.server.namenode.NameNode.loadNamesystem(NameNode.java:584)
at 
org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:644)
at 
org.apache.hadoop.hdfs.server.namenode.NameNode.(NameNode.java:811)
at 
org.apache.hadoop.hdfs.server.namenode.NameNode.(NameNode.java:795)
at 
org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1488)
at 
org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1554)
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at 
sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
at 
sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorIm

Re: Group level permission are not working in ranger

[Don Bosco Durai]

Yes, you should fix audit first. That will help in debugging these issues also.

BTW, are you using Solr or DB?

Recommendation is to use Solr. Yesterday, I have uploaded a new package for 
setting up Solr. It is available as attachment in  
https://issues.apache.org/jira/browse/RANGER-728. The instructions are in 
https://cwiki.apache.org/confluence/display/RANGER/Install+and+Configure+Solr+for+Ranger+Audits+-+Apache+Ranger+0.5

Give it a try.

Thanks

Bosco


From:  Madhan Neethiraj 
Reply-To:  
Date:  Monday, November 30, 2015 at 8:57 AM
To:  "user@ranger.incubator.apache.org" 
Subject:  Re: Group level permission are not working in ranger

Hafiz,

Few things to check:
 1. Do you have another policy in Ranger that allows WRITE access?
 2. Can you disable this policy and try mkdir?

Fixing the issue with audit will help; audit log will have the details of how 
the access was allowed (hadoop-acl or ranger-acl; in case of ranger-acl, the 
policy-ID that determined the access).

Madhan

From: Hafiz Mujadid 
Reply-To: "user@ranger.incubator.apache.org" 
Date: Monday, November 30, 2015 at 6:16 AM
To: "user@ranger.incubator.apache.org" 
Subject: Re: Group level permission are not working in ranger

Bosco, 

I have followed above steps
drwxr-xr-x   - hduser hadoop  0 2015-11-30 18:49 /pg

changed the umask so newly created folder or files have following permissions
d---rwxrwx   - asma hadoop  0 2015-11-30 19:03 /pg/b
i changed the ownership of all folders in hdfs with hduser:hadoop

ran the command hdfs dfs -chmod -R 000 /pg
but still group level permissions are not working.

my audits are not working, i am trying to figure out the issue with audits. i 
will let you know when audits are available.


thanks

On Mon, Nov 30, 2015 at 7:13 PM, Hafiz Mujadid  wrote:
Bosco, 

I have followed above steps
drwxr-xr-x   - hduser hadoop  0 2015-11-30 18:49 /pg 
changed the umask so newly created folder or files have following permissions
d---rwxrwx   - asma hadoop  0 2015-11-30 19:03 /pg/b
i changed the ownership of all folders in hdfs with hduser:hadoop

but still group level permissions are not working.


my audits are not working, i am trying to figure out the issue with audits. i 
will let you know when audits are available.


thanks


On Mon, Nov 30, 2015 at 9:34 AM, Don Bosco Durai  wrote:
Can you check Ranger Audits?

Also, do couple of things:
1. hdfs dfs -ls /pg  (check the HDFS level permissions)
2. In HDFS settngs, set the umask to 700 and restart name node.
3. hdfs dfs -chown hdfs:hdfs /pg
4. hdfs dfs -chmod -R 000 /pg

For all user folders, e.g. /app/hive, do #3 and #4 as above.

Bosco


From: Hafiz Mujadid 
Reply-To: 
Date: Sunday, November 29, 2015 at 8:29 PM
To: 
Subject: Re: Group level permission are not working in ranger

Yes Bosco, directory is being created.

On Mon, Nov 30, 2015 at 2:47 AM, Don Bosco Durai  wrote:
What is happening here? Is the directory getting created?

Thanks

Bosco


From: Hafiz Mujadid 
Reply-To: 
Date: Sunday, November 29, 2015 at 1:44 PM
To: 
Subject: Group level permission are not working in ranger

Hi all 

I am trying to apply permission on an ldap group but it's not working




But when i run following command
HADOOP_USER_NAME=asma hdfs dfs -mkdir /pg/b

i works successfully
what is the issue? ldap users and groups are synced correctly as when i run the 
command  hdfs groups asma   it returns correct group
asma : datascientist




-- 
Regards: HAFIZ MUJADID



-- 
Regards: HAFIZ MUJADID



-- 
Regards: HAFIZ MUJADID

Re: Group level permission are not working in ranger

[Don Bosco Durai]

Sorry, my mistake, you have to set the umask as 077 and restart name node.

By default, the HDFS umask is 022, which means group and others have rx 
permissions. So regardless what you set in Ranger, all users will have read 
access. So you need to change the mask to 077, so by default group and others 
have no permissions.

The reason you need to run do chmod –R 000 one time is to reset all the 
permissions. So going forward all permission will be x00.

Bosco

From:  Hafiz Mujadid 
Reply-To:  
Date:  Monday, November 30, 2015 at 6:18 AM
To:  
Subject:  Re: Group level permission are not working in ranger

Bosco,

By the way, i could not understand the reason to perform above steps, can you 
explain them?


thanks

On Mon, Nov 30, 2015 at 7:16 PM, Hafiz Mujadid  wrote:
Bosco, 

I have followed above steps
drwxr-xr-x   - hduser hadoop  0 2015-11-30 18:49 /pg

changed the umask so newly created folder or files have following permissions
d---rwxrwx   - asma hadoop  0 2015-11-30 19:03 /pg/b
i changed the ownership of all folders in hdfs with hduser:hadoop

ran the command hdfs dfs -chmod -R 000 /pg
but still group level permissions are not working.

my audits are not working, i am trying to figure out the issue with audits. i 
will let you know when audits are available.


thanks

On Mon, Nov 30, 2015 at 7:13 PM, Hafiz Mujadid  wrote:
Bosco, 

I have followed above steps
drwxr-xr-x   - hduser hadoop  0 2015-11-30 18:49 /pg
changed the umask so newly created folder or files have following permissions
d---rwxrwx   - asma hadoop  0 2015-11-30 19:03 /pg/b
i changed the ownership of all folders in hdfs with hduser:hadoop

but still group level permissions are not working.


my audits are not working, i am trying to figure out the issue with audits. i 
will let you know when audits are available.


thanks


On Mon, Nov 30, 2015 at 9:34 AM, Don Bosco Durai  wrote:
Can you check Ranger Audits?

Also, do couple of things:
1. hdfs dfs -ls /pg  (check the HDFS level permissions)
2. In HDFS settngs, set the umask to 700 and restart name node.
3. hdfs dfs -chown hdfs:hdfs /pg
4. hdfs dfs -chmod -R 000 /pg

For all user folders, e.g. /app/hive, do #3 and #4 as above.

Bosco


From:  Hafiz Mujadid 
Reply-To:  
Date:  Sunday, November 29, 2015 at 8:29 PM
To:  
Subject:  Re: Group level permission are not working in ranger

Yes Bosco, directory is being created.

On Mon, Nov 30, 2015 at 2:47 AM, Don Bosco Durai  wrote:
What is happening here? Is the directory getting created?

Thanks

Bosco


From:  Hafiz Mujadid 
Reply-To:  
Date:  Sunday, November 29, 2015 at 1:44 PM
To:  
Subject:  Group level permission are not working in ranger

Hi all 

I am trying to apply permission on an ldap group but it's not working




But when i run following command
HADOOP_USER_NAME=asma hdfs dfs -mkdir /pg/b

i works successfully
what is the issue? ldap users and groups are synced correctly as when i run the 
command  hdfs groups asma   it returns correct group
asma : datascientist




-- 
Regards: HAFIZ MUJADID



-- 
Regards: HAFIZ MUJADID



-- 
Regards: HAFIZ MUJADID



-- 
Regards: HAFIZ MUJADID

Re: Group level permission are not working in ranger

[Madhan Neethiraj]

Hafiz,

Few things to check:
 1. Do you have another policy in Ranger that allows WRITE access?
 2. Can you disable this policy and try mkdir?

Fixing the issue with audit will help; audit log will have the details of how 
the access was allowed (hadoop-acl or ranger-acl; in case of ranger-acl, the 
policy-ID that determined the access).

Madhan

From: Hafiz Mujadid mailto:hafizmujadi...@gmail.com>>
Reply-To: 
"user@ranger.incubator.apache.org" 
mailto:user@ranger.incubator.apache.org>>
Date: Monday, November 30, 2015 at 6:16 AM
To: "user@ranger.incubator.apache.org" 
mailto:user@ranger.incubator.apache.org>>
Subject: Re: Group level permission are not working in ranger

Bosco,

I have followed above steps

  1.  drwxr-xr-x   - hduser hadoop  0 2015-11-30 18:49 /pg
  2.  changed the umask so newly created folder or files have following 
permissions
d---rwxrwx   - asma hadoop  0 2015-11-30 19:03 /pg/b
  3.  i changed the ownership of all folders in hdfs with hduser:hadoop
  4.  ran the command hdfs dfs -chmod -R 000 /pg

but still group level permissions are not working.

my audits are not working, i am trying to figure out the issue with audits. i 
will let you know when audits are available.


thanks

On Mon, Nov 30, 2015 at 7:13 PM, Hafiz Mujadid 
mailto:hafizmujadi...@gmail.com>> wrote:
Bosco,

I have followed above steps
drwxr-xr-x   - hduser hadoop  0 2015-11-30 18:49 /pg
changed the umask so newly created folder or files have following permissions
d---rwxrwx   - asma hadoop  0 2015-11-30 19:03 /pg/b
i changed the ownership of all folders in hdfs with hduser:hadoop

but still group level permissions are not working.


my audits are not working, i am trying to figure out the issue with audits. i 
will let you know when audits are available.


thanks


On Mon, Nov 30, 2015 at 9:34 AM, Don Bosco Durai 
mailto:bo...@apache.org>> wrote:
Can you check Ranger Audits?

Also, do couple of things:
1. hdfs dfs -ls /pg  (check the HDFS level permissions)
2. In HDFS settngs, set the umask to 700 and restart name node.
3. hdfs dfs -chown hdfs:hdfs /pg
4. hdfs dfs -chmod -R 000 /pg

For all user folders, e.g. /app/hive, do #3 and #4 as above.

Bosco


From: Hafiz Mujadid mailto:hafizmujadi...@gmail.com>>
Reply-To: 
mailto:user@ranger.incubator.apache.org>>
Date: Sunday, November 29, 2015 at 8:29 PM
To: mailto:user@ranger.incubator.apache.org>>
Subject: Re: Group level permission are not working in ranger

Yes Bosco, directory is being created.

On Mon, Nov 30, 2015 at 2:47 AM, Don Bosco Durai 
mailto:bo...@apache.org>> wrote:
What is happening here? Is the directory getting created?

Thanks

Bosco


From: Hafiz Mujadid mailto:hafizmujadi...@gmail.com>>
Reply-To: 
mailto:user@ranger.incubator.apache.org>>
Date: Sunday, November 29, 2015 at 1:44 PM
To: mailto:user@ranger.incubator.apache.org>>
Subject: Group level permission are not working in ranger

Hi all

I am trying to apply permission on an ldap group but it's not working

[Inline image 1]


But when i run following command
HADOOP_USER_NAME=asma hdfs dfs -mkdir /pg/b

i works successfully
what is the issue? ldap users and groups are synced correctly as when i run the 
command  hdfs groups asma   it returns correct group
asma : datascientist




--
Regards: HAFIZ MUJADID



--
Regards: HAFIZ MUJADID



--
Regards: HAFIZ MUJADID

Re: hdfs plugin enable issue

[Hafiz Mujadid]

Following are the contents Ramesh!

   1. isable-hdfs-plugin.sh
   2. install
   3. lib
   4. upgrade-hdfs-plugin.sh
   5. enable-hdfs-plugin.sh
   6. install.properties
   7. ranger_credential_helper.py
   8. upgrade-plugin.py


On Mon, Nov 30, 2015 at 9:39 PM, Hafiz Mujadid 
wrote:

> in jira i have attached install.properties, which files else you need?
>
>
>
> On Mon, Nov 30, 2015 at 9:37 PM, Ramesh Mani 
> wrote:
>
>> Hafiz,
>>
>> Can I get the details on the files where you untarred the plugging tar,
>> it  should be like ranger-hdfs-plugin?
>>
>> This issue seems to be that installation is not completely correct.
>>
>> Regards,
>> Ramesh
>>
>> From: Hafiz Mujadid 
>> Reply-To: "user@ranger.incubator.apache.org" <
>> user@ranger.incubator.apache.org>
>> Date: Monday, November 30, 2015 at 5:21 AM
>>
>> To: "user@ranger.incubator.apache.org" 
>> Subject: Re: hdfs plugin enable issue
>>
>> Ramesh,
>>
>> when i removed the following jars from the  hadoop/share/hdfs/lib and
>> try enabling
>>
>>
>> *ranger-hdfs-plugin-shim-0.5.0.jarranger-plugin-classloader-0.5.0.jar*
>>
>> I faced following exception
>>
>> *java.lang.ClassNotFoundException: Class
>> org.apache.ranger.authorization.hadoop.RangerHdfsAuthorizer*
>>
>> On Mon, Nov 30, 2015 at 10:16 AM, Ramesh Mani 
>> wrote:
>>
>>> Hafiz,
>>>
>>> Can you remove the following jars from the  hadoop/share/hdfs/lib and
>>> try enabling?
>>>
>>>
>>> *ranger-hdfs-plugin-shim-0.5.0.jar
>>>  ranger-plugin-classloader-0.5.0.jar*
>>>
>>> Regards,
>>> Ramesh
>>>
>>> From: Hafiz Mujadid 
>>> Reply-To: "user@ranger.incubator.apache.org" <
>>> user@ranger.incubator.apache.org>
>>> Date: Sunday, November 29, 2015 at 1:52 AM
>>> To: "user@ranger.incubator.apache.org" >> >
>>> Subject: Re: hdfs plugin enable issue
>>>
>>> hadoop/lib contains following jar files, I also placed these ranger
>>> related jars in hadoop/share/hdfs/lib folder
>>>
>>>
>>> *ranger-hdfs-plugin-shim-0.5.0.jar
>>>  ranger-plugin-classloader-0.5.0.jar*
>>> *native folder with following files*
>>> libhadoop.a  libhadooppipes.a  libhadoop.so  libhadoop.so.1.0.0
>>>  libhadooputils.a  libhdfs.a  libhdfs.so  libhdfs.so.0.0.0
>>>
>>>
>>>
>>> *attached is the complete log file *
>>>
>>> *thanks*
>>>
>>>
>>> On Sun, Nov 29, 2015 at 11:37 AM, Ramesh Mani 
>>> wrote:
>>>
 Hafiz,

 Please list the files in  hadoop/lib directory , also provide the
 complete namenode log for me to review?

 Thanks,
 Rame

 From: Hafiz Mujadid 
 Reply-To: "user@ranger.incubator.apache.org" <
 user@ranger.incubator.apache.org>
 Date: Saturday, November 28, 2015 at 11:51 AM
 To: "user@ranger.incubator.apache.org" <
 user@ranger.incubator.apache.org>
 Subject: hdfs plugin enable issue

 Hi!

 I have enabled hdfs plugin but after that name node is not starting,
 when i start namenode, i get following exception


 2015-11-29 00:44:20,534 ERROR
 org.apache.hadoop.hdfs.server.namenode.NameNode: Failed to start namenode.
 java.lang.RuntimeException: java.lang.reflect.InvocationTargetException
 at
 org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:134)
 at
 org.apache.hadoop.hdfs.server.namenode.FSNamesystem.(FSNamesystem.java:843)
 at
 org.apache.hadoop.hdfs.server.namenode.FSNamesystem.loadFromDisk(FSNamesystem.java:673)
 at
 org.apache.hadoop.hdfs.server.namenode.NameNode.loadNamesystem(NameNode.java:584)
 at
 org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:644)
 at
 org.apache.hadoop.hdfs.server.namenode.NameNode.(NameNode.java:811)
 at
 org.apache.hadoop.hdfs.server.namenode.NameNode.(NameNode.java:795)
 at
 org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1488)
 at
 org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1554)
 Caused by: java.lang.reflect.InvocationTargetException
 at
 sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
 at
 sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
 at
 sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
 at
 java.lang.reflect.Constructor.newInstance(Constructor.java:526)
 at
 org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:132)
 ... 8 more
 Caused by: java.lang.StackOverflowError
 at java.lang.Exception.(Exception.java:102)
 at
 java.lang.ReflectiveOperationException.(ReflectiveOperationException.java:89)
 at
 java.lang.reflect.InvocationTargetException.(InvocationTargetException.java:72)
 at
 sun.reflect.GeneratedConstructorAccessor7.newInstance(Unknown Source)
 

Re: hdfs plugin enable issue

[Hafiz Mujadid]

in jira i have attached install.properties, which files else you need?



On Mon, Nov 30, 2015 at 9:37 PM, Ramesh Mani  wrote:

> Hafiz,
>
> Can I get the details on the files where you untarred the plugging tar, it
>  should be like ranger-hdfs-plugin?
>
> This issue seems to be that installation is not completely correct.
>
> Regards,
> Ramesh
>
> From: Hafiz Mujadid 
> Reply-To: "user@ranger.incubator.apache.org" <
> user@ranger.incubator.apache.org>
> Date: Monday, November 30, 2015 at 5:21 AM
>
> To: "user@ranger.incubator.apache.org" 
> Subject: Re: hdfs plugin enable issue
>
> Ramesh,
>
> when i removed the following jars from the  hadoop/share/hdfs/lib and try
> enabling
>
>
> *ranger-hdfs-plugin-shim-0.5.0.jarranger-plugin-classloader-0.5.0.jar*
>
> I faced following exception
>
> *java.lang.ClassNotFoundException: Class
> org.apache.ranger.authorization.hadoop.RangerHdfsAuthorizer*
>
> On Mon, Nov 30, 2015 at 10:16 AM, Ramesh Mani 
> wrote:
>
>> Hafiz,
>>
>> Can you remove the following jars from the  hadoop/share/hdfs/lib and try
>> enabling?
>>
>>
>> *ranger-hdfs-plugin-shim-0.5.0.jarranger-plugin-classloader-0.5.0.jar*
>>
>> Regards,
>> Ramesh
>>
>> From: Hafiz Mujadid 
>> Reply-To: "user@ranger.incubator.apache.org" <
>> user@ranger.incubator.apache.org>
>> Date: Sunday, November 29, 2015 at 1:52 AM
>> To: "user@ranger.incubator.apache.org" 
>> Subject: Re: hdfs plugin enable issue
>>
>> hadoop/lib contains following jar files, I also placed these ranger
>> related jars in hadoop/share/hdfs/lib folder
>>
>>
>> *ranger-hdfs-plugin-shim-0.5.0.jarranger-plugin-classloader-0.5.0.jar*
>> *native folder with following files*
>> libhadoop.a  libhadooppipes.a  libhadoop.so  libhadoop.so.1.0.0
>>  libhadooputils.a  libhdfs.a  libhdfs.so  libhdfs.so.0.0.0
>>
>>
>>
>> *attached is the complete log file *
>>
>> *thanks*
>>
>>
>> On Sun, Nov 29, 2015 at 11:37 AM, Ramesh Mani 
>> wrote:
>>
>>> Hafiz,
>>>
>>> Please list the files in  hadoop/lib directory , also provide the
>>> complete namenode log for me to review?
>>>
>>> Thanks,
>>> Rame
>>>
>>> From: Hafiz Mujadid 
>>> Reply-To: "user@ranger.incubator.apache.org" <
>>> user@ranger.incubator.apache.org>
>>> Date: Saturday, November 28, 2015 at 11:51 AM
>>> To: "user@ranger.incubator.apache.org" >> >
>>> Subject: hdfs plugin enable issue
>>>
>>> Hi!
>>>
>>> I have enabled hdfs plugin but after that name node is not starting,
>>> when i start namenode, i get following exception
>>>
>>>
>>> 2015-11-29 00:44:20,534 ERROR
>>> org.apache.hadoop.hdfs.server.namenode.NameNode: Failed to start namenode.
>>> java.lang.RuntimeException: java.lang.reflect.InvocationTargetException
>>> at
>>> org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:134)
>>> at
>>> org.apache.hadoop.hdfs.server.namenode.FSNamesystem.(FSNamesystem.java:843)
>>> at
>>> org.apache.hadoop.hdfs.server.namenode.FSNamesystem.loadFromDisk(FSNamesystem.java:673)
>>> at
>>> org.apache.hadoop.hdfs.server.namenode.NameNode.loadNamesystem(NameNode.java:584)
>>> at
>>> org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:644)
>>> at
>>> org.apache.hadoop.hdfs.server.namenode.NameNode.(NameNode.java:811)
>>> at
>>> org.apache.hadoop.hdfs.server.namenode.NameNode.(NameNode.java:795)
>>> at
>>> org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1488)
>>> at
>>> org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1554)
>>> Caused by: java.lang.reflect.InvocationTargetException
>>> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
>>> Method)
>>> at
>>> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
>>> at
>>> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
>>> at
>>> java.lang.reflect.Constructor.newInstance(Constructor.java:526)
>>> at
>>> org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:132)
>>> ... 8 more
>>> Caused by: java.lang.StackOverflowError
>>> at java.lang.Exception.(Exception.java:102)
>>> at
>>> java.lang.ReflectiveOperationException.(ReflectiveOperationException.java:89)
>>> at
>>> java.lang.reflect.InvocationTargetException.(InvocationTargetException.java:72)
>>> at sun.reflect.GeneratedConstructorAccessor7.newInstance(Unknown
>>> Source)
>>> at
>>> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
>>> at
>>> java.lang.reflect.Constructor.newInstance(Constructor.java:526)
>>> at java.lang.Class.newInstance(Class.java:383)
>>> at
>>> org.apache.ranger.authorization.hadoop.RangerHdfsAuthorizer.init(RangerHdfsAuthorizer.java:65)
>>>
>>>
>>>
>>>
>>>
>>
>>
>> --
>> Regards: HAFIZ MUJADID
>>
>
>
>
> --
> Regards: HAFIZ MUJADID
>



-- 
Rega

Re: hdfs plugin enable issue

[Ramesh Mani]

Hafiz,

Can I get the details on the files where you untarred the plugging tar, it  
should be like ranger-hdfs-plugin?

This issue seems to be that installation is not completely correct.

Regards,
Ramesh

From: Hafiz Mujadid mailto:hafizmujadi...@gmail.com>>
Reply-To: 
"user@ranger.incubator.apache.org" 
mailto:user@ranger.incubator.apache.org>>
Date: Monday, November 30, 2015 at 5:21 AM
To: "user@ranger.incubator.apache.org" 
mailto:user@ranger.incubator.apache.org>>
Subject: Re: hdfs plugin enable issue

Ramesh,

when i removed the following jars from the  hadoop/share/hdfs/lib and try 
enabling

 ranger-hdfs-plugin-shim-0.5.0.jar
 ranger-plugin-classloader-0.5.0.jar

I faced following exception

java.lang.ClassNotFoundException: Class 
org.apache.ranger.authorization.hadoop.RangerHdfsAuthorizer

On Mon, Nov 30, 2015 at 10:16 AM, Ramesh Mani 
mailto:rm...@hortonworks.com>> wrote:
Hafiz,

Can you remove the following jars from the  hadoop/share/hdfs/lib and try 
enabling?

 ranger-hdfs-plugin-shim-0.5.0.jar
 ranger-plugin-classloader-0.5.0.jar

Regards,
Ramesh

From: Hafiz Mujadid mailto:hafizmujadi...@gmail.com>>
Reply-To: 
"user@ranger.incubator.apache.org" 
mailto:user@ranger.incubator.apache.org>>
Date: Sunday, November 29, 2015 at 1:52 AM
To: "user@ranger.incubator.apache.org" 
mailto:user@ranger.incubator.apache.org>>
Subject: Re: hdfs plugin enable issue

hadoop/lib contains following jar files, I also placed these ranger related 
jars in hadoop/share/hdfs/lib folder

 ranger-hdfs-plugin-shim-0.5.0.jar
 ranger-plugin-classloader-0.5.0.jar
native folder with following files
libhadoop.a  libhadooppipes.a  libhadoop.so  libhadoop.so.1.0.0  
libhadooputils.a  libhdfs.a  libhdfs.so  libhdfs.so.0.0.0



attached is the complete log file

thanks


On Sun, Nov 29, 2015 at 11:37 AM, Ramesh Mani 
mailto:rm...@hortonworks.com>> wrote:
Hafiz,

Please list the files in  hadoop/lib directory , also provide the complete 
namenode log for me to review?

Thanks,
Rame

From: Hafiz Mujadid mailto:hafizmujadi...@gmail.com>>
Reply-To: 
"user@ranger.incubator.apache.org" 
mailto:user@ranger.incubator.apache.org>>
Date: Saturday, November 28, 2015 at 11:51 AM
To: "user@ranger.incubator.apache.org" 
mailto:user@ranger.incubator.apache.org>>
Subject: hdfs plugin enable issue

Hi!

I have enabled hdfs plugin but after that name node is not starting, when i 
start namenode, i get following exception


2015-11-29 00:44:20,534 ERROR org.apache.hadoop.hdfs.server.namenode.NameNode: 
Failed to start namenode.
java.lang.RuntimeException: java.lang.reflect.InvocationTargetException
at 
org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:134)
at 
org.apache.hadoop.hdfs.server.namenode.FSNamesystem.(FSNamesystem.java:843)
at 
org.apache.hadoop.hdfs.server.namenode.FSNamesystem.loadFromDisk(FSNamesystem.java:673)
at 
org.apache.hadoop.hdfs.server.namenode.NameNode.loadNamesystem(NameNode.java:584)
at 
org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:644)
at 
org.apache.hadoop.hdfs.server.namenode.NameNode.(NameNode.java:811)
at 
org.apache.hadoop.hdfs.server.namenode.NameNode.(NameNode.java:795)
at 
org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1488)
at 
org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1554)
Caused by: java.lang.reflect.InvocationTargetException
at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
at 
sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
at 
sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
at 
org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:132)
... 8 more
Caused by: java.lang.StackOverflowError
at java.lang.Exception.(Exception.java:102)
at 
java.lang.ReflectiveOperationException.(ReflectiveOperationException.java:89)
at 
java.lang.reflect.InvocationTargetException.(InvocationTargetException.java:72)
at sun.reflect.GeneratedConstructorAccessor7.newInstance(Unknown Source)
at 
sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
at java.lang.Class.newInstance(Class.java:383)
at 
org.apache.ranger.authorization.hadoop.RangerHdfsAuthorizer.init(RangerHdfsAuthorizer.java:65)







--
Regards: HAFIZ MUJADID



--
Regards: HAFIZ MUJADID

access audit logs are not being shown on ranger ui

[Hafiz Mujadid]

hi,

I have enabled ranger audits in solr, but access audits are not being shown.
properties for hdfs plugin
*XAAUDIT.SOLR.ENABLE=true*
*XAAUDIT.SOLR.URL=http://192.168.23.105:6083/solr/ranger_audits
*
*XAAUDIT.SOLR.USER=ranger_solr*
*XAAUDIT.SOLR.PASSWORD=NONE*
*XAAUDIT.SOLR.ZOOKEEPER=NONE*
*XAAUDIT.SOLR.FILE_SPOOL_DIR=/var/log/hadoop/hdfs/audit/solr/spool*

properties in ranger-admin


*audit_store=solr*

*audit_solr_urls=http://122.129.79.70:6083/solr/ranger_audits
*
*audit_solr_user=ranger_solr*
*audit_solr_password=NONE*
*audit_solr_zookeepers=*

But no audits logs are shown in ranger-admin


how can i check the issue ?

thanks

Re: hdfs plugin enable issue

[Hafiz Mujadid]

Ramesh,

when i removed the following jars from the  hadoop/share/hdfs/lib and try
enabling


*ranger-hdfs-plugin-shim-0.5.0.jar   ranger-plugin-classloader-0.5.0.jar*

I faced following exception

*java.lang.ClassNotFoundException: Class
org.apache.ranger.authorization.hadoop.RangerHdfsAuthorizer*

On Mon, Nov 30, 2015 at 10:16 AM, Ramesh Mani  wrote:

> Hafiz,
>
> Can you remove the following jars from the  hadoop/share/hdfs/lib and try
> enabling?
>
>
> *ranger-hdfs-plugin-shim-0.5.0.jarranger-plugin-classloader-0.5.0.jar*
>
> Regards,
> Ramesh
>
> From: Hafiz Mujadid 
> Reply-To: "user@ranger.incubator.apache.org" <
> user@ranger.incubator.apache.org>
> Date: Sunday, November 29, 2015 at 1:52 AM
> To: "user@ranger.incubator.apache.org" 
> Subject: Re: hdfs plugin enable issue
>
> hadoop/lib contains following jar files, I also placed these ranger
> related jars in hadoop/share/hdfs/lib folder
>
>
> *ranger-hdfs-plugin-shim-0.5.0.jarranger-plugin-classloader-0.5.0.jar*
> *native folder with following files*
> libhadoop.a  libhadooppipes.a  libhadoop.so  libhadoop.so.1.0.0
>  libhadooputils.a  libhdfs.a  libhdfs.so  libhdfs.so.0.0.0
>
>
>
> *attached is the complete log file *
>
> *thanks*
>
>
> On Sun, Nov 29, 2015 at 11:37 AM, Ramesh Mani 
> wrote:
>
>> Hafiz,
>>
>> Please list the files in  hadoop/lib directory , also provide the
>> complete namenode log for me to review?
>>
>> Thanks,
>> Rame
>>
>> From: Hafiz Mujadid 
>> Reply-To: "user@ranger.incubator.apache.org" <
>> user@ranger.incubator.apache.org>
>> Date: Saturday, November 28, 2015 at 11:51 AM
>> To: "user@ranger.incubator.apache.org" 
>> Subject: hdfs plugin enable issue
>>
>> Hi!
>>
>> I have enabled hdfs plugin but after that name node is not starting, when
>> i start namenode, i get following exception
>>
>>
>> 2015-11-29 00:44:20,534 ERROR
>> org.apache.hadoop.hdfs.server.namenode.NameNode: Failed to start namenode.
>> java.lang.RuntimeException: java.lang.reflect.InvocationTargetException
>> at
>> org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:134)
>> at
>> org.apache.hadoop.hdfs.server.namenode.FSNamesystem.(FSNamesystem.java:843)
>> at
>> org.apache.hadoop.hdfs.server.namenode.FSNamesystem.loadFromDisk(FSNamesystem.java:673)
>> at
>> org.apache.hadoop.hdfs.server.namenode.NameNode.loadNamesystem(NameNode.java:584)
>> at
>> org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:644)
>> at
>> org.apache.hadoop.hdfs.server.namenode.NameNode.(NameNode.java:811)
>> at
>> org.apache.hadoop.hdfs.server.namenode.NameNode.(NameNode.java:795)
>> at
>> org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1488)
>> at
>> org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1554)
>> Caused by: java.lang.reflect.InvocationTargetException
>> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
>> Method)
>> at
>> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
>> at
>> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
>> at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
>> at
>> org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:132)
>> ... 8 more
>> Caused by: java.lang.StackOverflowError
>> at java.lang.Exception.(Exception.java:102)
>> at
>> java.lang.ReflectiveOperationException.(ReflectiveOperationException.java:89)
>> at
>> java.lang.reflect.InvocationTargetException.(InvocationTargetException.java:72)
>> at sun.reflect.GeneratedConstructorAccessor7.newInstance(Unknown
>> Source)
>> at
>> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
>> at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
>> at java.lang.Class.newInstance(Class.java:383)
>> at
>> org.apache.ranger.authorization.hadoop.RangerHdfsAuthorizer.init(RangerHdfsAuthorizer.java:65)
>>
>>
>>
>>
>>
>
>
> --
> Regards: HAFIZ MUJADID
>



-- 
Regards: HAFIZ MUJADID

Re: hdfs plugin enable issue

[Hafiz Mujadid]

Bosco,

Here is the jira against this issue RANGER-752



thanks

On Mon, Nov 30, 2015 at 6:21 PM, Hafiz Mujadid 
wrote:

> Ramesh,
>
> when i removed the following jars from the  hadoop/share/hdfs/lib and try
> enabling
>
>
> *ranger-hdfs-plugin-shim-0.5.0.jar   ranger-plugin-classloader-0.5.0.jar*
>
> I faced following exception
>
> *java.lang.ClassNotFoundException: Class
> org.apache.ranger.authorization.hadoop.RangerHdfsAuthorizer*
>
> On Mon, Nov 30, 2015 at 10:16 AM, Ramesh Mani 
> wrote:
>
>> Hafiz,
>>
>> Can you remove the following jars from the  hadoop/share/hdfs/lib and try
>> enabling?
>>
>>
>> *ranger-hdfs-plugin-shim-0.5.0.jarranger-plugin-classloader-0.5.0.jar*
>>
>> Regards,
>> Ramesh
>>
>> From: Hafiz Mujadid 
>> Reply-To: "user@ranger.incubator.apache.org" <
>> user@ranger.incubator.apache.org>
>> Date: Sunday, November 29, 2015 at 1:52 AM
>> To: "user@ranger.incubator.apache.org" 
>> Subject: Re: hdfs plugin enable issue
>>
>> hadoop/lib contains following jar files, I also placed these ranger
>> related jars in hadoop/share/hdfs/lib folder
>>
>>
>> *ranger-hdfs-plugin-shim-0.5.0.jarranger-plugin-classloader-0.5.0.jar*
>> *native folder with following files*
>> libhadoop.a  libhadooppipes.a  libhadoop.so  libhadoop.so.1.0.0
>>  libhadooputils.a  libhdfs.a  libhdfs.so  libhdfs.so.0.0.0
>>
>>
>>
>> *attached is the complete log file *
>>
>> *thanks*
>>
>>
>> On Sun, Nov 29, 2015 at 11:37 AM, Ramesh Mani 
>> wrote:
>>
>>> Hafiz,
>>>
>>> Please list the files in  hadoop/lib directory , also provide the
>>> complete namenode log for me to review?
>>>
>>> Thanks,
>>> Rame
>>>
>>> From: Hafiz Mujadid 
>>> Reply-To: "user@ranger.incubator.apache.org" <
>>> user@ranger.incubator.apache.org>
>>> Date: Saturday, November 28, 2015 at 11:51 AM
>>> To: "user@ranger.incubator.apache.org" >> >
>>> Subject: hdfs plugin enable issue
>>>
>>> Hi!
>>>
>>> I have enabled hdfs plugin but after that name node is not starting,
>>> when i start namenode, i get following exception
>>>
>>>
>>> 2015-11-29 00:44:20,534 ERROR
>>> org.apache.hadoop.hdfs.server.namenode.NameNode: Failed to start namenode.
>>> java.lang.RuntimeException: java.lang.reflect.InvocationTargetException
>>> at
>>> org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:134)
>>> at
>>> org.apache.hadoop.hdfs.server.namenode.FSNamesystem.(FSNamesystem.java:843)
>>> at
>>> org.apache.hadoop.hdfs.server.namenode.FSNamesystem.loadFromDisk(FSNamesystem.java:673)
>>> at
>>> org.apache.hadoop.hdfs.server.namenode.NameNode.loadNamesystem(NameNode.java:584)
>>> at
>>> org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:644)
>>> at
>>> org.apache.hadoop.hdfs.server.namenode.NameNode.(NameNode.java:811)
>>> at
>>> org.apache.hadoop.hdfs.server.namenode.NameNode.(NameNode.java:795)
>>> at
>>> org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1488)
>>> at
>>> org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1554)
>>> Caused by: java.lang.reflect.InvocationTargetException
>>> at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native
>>> Method)
>>> at
>>> sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
>>> at
>>> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
>>> at
>>> java.lang.reflect.Constructor.newInstance(Constructor.java:526)
>>> at
>>> org.apache.hadoop.util.ReflectionUtils.newInstance(ReflectionUtils.java:132)
>>> ... 8 more
>>> Caused by: java.lang.StackOverflowError
>>> at java.lang.Exception.(Exception.java:102)
>>> at
>>> java.lang.ReflectiveOperationException.(ReflectiveOperationException.java:89)
>>> at
>>> java.lang.reflect.InvocationTargetException.(InvocationTargetException.java:72)
>>> at sun.reflect.GeneratedConstructorAccessor7.newInstance(Unknown
>>> Source)
>>> at
>>> sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
>>> at
>>> java.lang.reflect.Constructor.newInstance(Constructor.java:526)
>>> at java.lang.Class.newInstance(Class.java:383)
>>> at
>>> org.apache.ranger.authorization.hadoop.RangerHdfsAuthorizer.init(RangerHdfsAuthorizer.java:65)
>>>
>>>
>>>
>>>
>>>
>>
>>
>> --
>> Regards: HAFIZ MUJADID
>>
>
>
>
> --
> Regards: HAFIZ MUJADID
>



-- 
Regards: HAFIZ MUJADID

Re: Group level permission are not working in ranger

[Hafiz Mujadid]

Bosco,

I have followed above steps
drwxr-xr-x   - hduser hadoop  0 2015-11-30 18:49 /pg
changed the umask so newly created folder or files have following
permissions
d---rwxrwx   - asma hadoop  0 2015-11-30 19:03 /pg/b
i changed the ownership of all folders in hdfs with hduser:hadoop

but still group level permissions are not working.


my audits are not working, i am trying to figure out the issue with audits.
i will let you know when audits are available.


thanks


On Mon, Nov 30, 2015 at 9:34 AM, Don Bosco Durai  wrote:

> Can you check Ranger Audits?
>
> Also, do couple of things:
> 1. hdfs dfs -ls /pg  (check the HDFS level permissions)
> 2. In HDFS settngs, set the umask to 700 and restart name node.
> 3. hdfs dfs -chown hdfs:hdfs /pg
> 4. hdfs dfs -chmod -R 000 /pg
>
> For all user folders, e.g. /app/hive, do #3 and #4 as above.
>
> Bosco
>
>
> From: Hafiz Mujadid 
> Reply-To: 
> Date: Sunday, November 29, 2015 at 8:29 PM
> To: 
> Subject: Re: Group level permission are not working in ranger
>
> Yes Bosco, directory is being created.
>
> On Mon, Nov 30, 2015 at 2:47 AM, Don Bosco Durai  wrote:
>
>> What is happening here? Is the directory getting created?
>>
>> Thanks
>>
>> Bosco
>>
>>
>> From: Hafiz Mujadid 
>> Reply-To: 
>> Date: Sunday, November 29, 2015 at 1:44 PM
>> To: 
>> Subject: Group level permission are not working in ranger
>>
>> Hi all
>>
>> I am trying to apply permission on an ldap group but it's not working
>>
>> [image: Inline image 1]
>>
>>
>> But when i run following command
>> *HADOOP_USER_NAME=asma hdfs dfs -mkdir /pg/b*
>>
>> i works successfully
>> what is the issue? ldap users and groups are synced correctly as when i
>> run the command  *hdfs groups asma*   it returns correct group
>> asma : datascientist
>>
>>
>
>
> --
> Regards: HAFIZ MUJADID
>
>


-- 
Regards: HAFIZ MUJADID

Re: Group level permission are not working in ranger

[Hafiz Mujadid]

Bosco,

By the way, i could not understand the reason to perform above steps, can
you explain them?


thanks

On Mon, Nov 30, 2015 at 7:16 PM, Hafiz Mujadid 
wrote:

> Bosco,
>
> I have followed above steps
>
>1. drwxr-xr-x   - hduser hadoop  0 2015-11-30 18:49 /pg
>2. changed the umask so newly created folder or files have following
>permissions
>d---rwxrwx   - asma hadoop  0 2015-11-30 19:03 /pg/b
>3. i changed the ownership of all folders in hdfs with hduser:hadoop
>4. ran the command hdfs dfs -chmod -R 000 /pg
>
>
> but still group level permissions are not working.
>
> my audits are not working, i am trying to figure out the issue with
> audits. i will let you know when audits are available.
>
>
> thanks
>
> On Mon, Nov 30, 2015 at 7:13 PM, Hafiz Mujadid 
> wrote:
>
>> Bosco,
>>
>> I have followed above steps
>> drwxr-xr-x   - hduser hadoop  0 2015-11-30 18:49 /pg
>> changed the umask so newly created folder or files have following
>> permissions
>> d---rwxrwx   - asma hadoop  0 2015-11-30 19:03 /pg/b
>> i changed the ownership of all folders in hdfs with hduser:hadoop
>>
>> but still group level permissions are not working.
>>
>>
>> my audits are not working, i am trying to figure out the issue with
>> audits. i will let you know when audits are available.
>>
>>
>> thanks
>>
>>
>> On Mon, Nov 30, 2015 at 9:34 AM, Don Bosco Durai 
>> wrote:
>>
>>> Can you check Ranger Audits?
>>>
>>> Also, do couple of things:
>>> 1. hdfs dfs -ls /pg  (check the HDFS level permissions)
>>> 2. In HDFS settngs, set the umask to 700 and restart name node.
>>> 3. hdfs dfs -chown hdfs:hdfs /pg
>>> 4. hdfs dfs -chmod -R 000 /pg
>>>
>>> For all user folders, e.g. /app/hive, do #3 and #4 as above.
>>>
>>> Bosco
>>>
>>>
>>> From: Hafiz Mujadid 
>>> Reply-To: 
>>> Date: Sunday, November 29, 2015 at 8:29 PM
>>> To: 
>>> Subject: Re: Group level permission are not working in ranger
>>>
>>> Yes Bosco, directory is being created.
>>>
>>> On Mon, Nov 30, 2015 at 2:47 AM, Don Bosco Durai 
>>> wrote:
>>>
 What is happening here? Is the directory getting created?

 Thanks

 Bosco


 From: Hafiz Mujadid 
 Reply-To: 
 Date: Sunday, November 29, 2015 at 1:44 PM
 To: 
 Subject: Group level permission are not working in ranger

 Hi all

 I am trying to apply permission on an ldap group but it's not working

 [image: Inline image 1]


 But when i run following command
 *HADOOP_USER_NAME=asma hdfs dfs -mkdir /pg/b*

 i works successfully
 what is the issue? ldap users and groups are synced correctly as when i
 run the command  *hdfs groups asma*   it returns correct group
 asma : datascientist


>>>
>>>
>>> --
>>> Regards: HAFIZ MUJADID
>>>
>>>
>>
>>
>> --
>> Regards: HAFIZ MUJADID
>>
>
>
>
> --
> Regards: HAFIZ MUJADID
>



-- 
Regards: HAFIZ MUJADID

Re: Group level permission are not working in ranger

[Hafiz Mujadid]

Bosco,

I have followed above steps

   1. drwxr-xr-x   - hduser hadoop  0 2015-11-30 18:49 /pg
   2. changed the umask so newly created folder or files have following
   permissions
   d---rwxrwx   - asma hadoop  0 2015-11-30 19:03 /pg/b
   3. i changed the ownership of all folders in hdfs with hduser:hadoop
   4. ran the command hdfs dfs -chmod -R 000 /pg


but still group level permissions are not working.

my audits are not working, i am trying to figure out the issue with audits.
i will let you know when audits are available.


thanks

On Mon, Nov 30, 2015 at 7:13 PM, Hafiz Mujadid 
wrote:

> Bosco,
>
> I have followed above steps
> drwxr-xr-x   - hduser hadoop  0 2015-11-30 18:49 /pg
> changed the umask so newly created folder or files have following
> permissions
> d---rwxrwx   - asma hadoop  0 2015-11-30 19:03 /pg/b
> i changed the ownership of all folders in hdfs with hduser:hadoop
>
> but still group level permissions are not working.
>
>
> my audits are not working, i am trying to figure out the issue with
> audits. i will let you know when audits are available.
>
>
> thanks
>
>
> On Mon, Nov 30, 2015 at 9:34 AM, Don Bosco Durai  wrote:
>
>> Can you check Ranger Audits?
>>
>> Also, do couple of things:
>> 1. hdfs dfs -ls /pg  (check the HDFS level permissions)
>> 2. In HDFS settngs, set the umask to 700 and restart name node.
>> 3. hdfs dfs -chown hdfs:hdfs /pg
>> 4. hdfs dfs -chmod -R 000 /pg
>>
>> For all user folders, e.g. /app/hive, do #3 and #4 as above.
>>
>> Bosco
>>
>>
>> From: Hafiz Mujadid 
>> Reply-To: 
>> Date: Sunday, November 29, 2015 at 8:29 PM
>> To: 
>> Subject: Re: Group level permission are not working in ranger
>>
>> Yes Bosco, directory is being created.
>>
>> On Mon, Nov 30, 2015 at 2:47 AM, Don Bosco Durai 
>> wrote:
>>
>>> What is happening here? Is the directory getting created?
>>>
>>> Thanks
>>>
>>> Bosco
>>>
>>>
>>> From: Hafiz Mujadid 
>>> Reply-To: 
>>> Date: Sunday, November 29, 2015 at 1:44 PM
>>> To: 
>>> Subject: Group level permission are not working in ranger
>>>
>>> Hi all
>>>
>>> I am trying to apply permission on an ldap group but it's not working
>>>
>>> [image: Inline image 1]
>>>
>>>
>>> But when i run following command
>>> *HADOOP_USER_NAME=asma hdfs dfs -mkdir /pg/b*
>>>
>>> i works successfully
>>> what is the issue? ldap users and groups are synced correctly as when i
>>> run the command  *hdfs groups asma*   it returns correct group
>>> asma : datascientist
>>>
>>>
>>
>>
>> --
>> Regards: HAFIZ MUJADID
>>
>>
>
>
> --
> Regards: HAFIZ MUJADID
>



-- 
Regards: HAFIZ MUJADID