subject:"Re\: Error Setting up Ranger\-Admin"

I just came to know that Ranger 0.5 is compatible with HDFS 2.7.x and mine
HDFS version is 2.6.0

Is it the case? do i need to upgrade Hadoop?

On Wed, Jul 29, 2015 at 8:09 PM, Aneela Saleem ane...@platalytics.com
wrote:

 Hi Hanish,

 Plugin is still not visible on Audit screen UI

 On Wed, Jul 29, 2015 at 7:22 PM, Hanish Bansal 
 hanish.ban...@impetus.co.in wrote:

  Hi Aneela,


  By following below conversation thread, I am getting that you ranger
 admin UI is working fine but hdfs plugin is not shown in audit logs. If I
 am right then please try below steps:


  1. Copy all the ranger libraries files from lib folder to
 share/hadoop/hdfs/lib/
 cp hadoop-home/lib/* hadoop-home/share/hadoop/hdfs/lib/


  2. Check if you have created symbolic link for hadoop configuration
 folder etc/hadoop as conf. If not then create using below command:

 $ ln -s hadoop-home/etc/hadoop hadoop-home/conf


  3. Restart namenode service.


  4. Now login into some other user on machine and try listing files in
 Hadoop.


  hadoop fs -ls /


  Note: In last step, run command using some other user who didn't start
 the hadoop services.


  Now check if plugin is visible on audit screen of UI.



  ---

 *Thanks  Regards, Hanish Bansal*
 Software Engineer, iLabs
 Impetus Infotech Pvt. Ltd.
 --
 *From:* Aneela Saleem ane...@platalytics.com
 *Sent:* Wednesday, July 29, 2015 7:19 PM
 *To:* user@ranger.incubator.apache.org

 *Subject:* Re: Error Setting up Ranger-Admin

  When i run *./setup.sh * in ranger-admin, i get the following error:

  SLF4J: Failed to load class org.slf4j.impl.StaticLoggerBinder.

 On Wed, Jul 29, 2015 at 6:46 PM, Aneela Saleem ane...@platalytics.com
 wrote:

 Yes NameNode is running. And i don't see any Ranger-related logs in
 NameNode logs

 On Wed, Jul 29, 2015 at 5:41 PM, Loïc Chanel 
 loic.cha...@telecomnancy.net wrote:

  At least, is your NameNode running ?
  And do you can see any Ranger-related logs in the NameNode logs ?

Loïc CHANEL
 Engineering student at TELECOM Nancy
 Trainee at Worldline - Villeurbanne

   2015-07-29 14:37 GMT+02:00 Aneela Saleem ane...@platalytics.com:

 I can't figure out what is the issue? as there are no errors in log
 file

 On Wed, Jul 29, 2015 at 5:05 PM, Loïc Chanel 
 loic.cha...@telecomnancy.net wrote:

 The logs for ranger plugins are in the NameNode logs, that's why
 Bosco told you to take a look there.

Loïc CHANEL
 Engineering student at TELECOM Nancy
 Trainee at Worldline - Villeurbanne

 2015-07-29 12:43 GMT+02:00 Aneela Saleem ane...@platalytics.com:

 Hi Bosco,

  I tried your solution but it still does not work for me

 On Wed, Jul 29, 2015 at 3:22 PM, Aneela Saleem 
 ane...@platalytics.com wrote:

 How can i see logs for ranger-hdfs plugin ?

  Can you please have a look on install.properties file? is it
 correct?


 On Wed, Jul 29, 2015 at 10:57 AM, Don Bosco Durai bo...@apache.org
  wrote:

  Yes, this issues seems to be HDFS namenode was not stopped. Can
 you check the running process by running “ps –eafww | grep 
 proc_namenode”
 and if it is running you have to stop it and start it again.

  Regarding the chown error, it seems the scripts assumes the user
 to be “hdfs”. Can you manually update enable-hdfs-plugin.sh and
 rerun it?

  Line number 89 of enable-hdfs-plugin.sh

  #CFG_OWNER_INF=${HCOMPONENT_NAME}:${HCOMPONENT_NAME}”

 CFG_OWNER_INF=hduser

  And run ./enable-hdfs-plugin.sh again?

  Thanks

  Bosco


   From: Ramesh Mani rm...@hortonworks.com
 Reply-To: user@ranger.incubator.apache.org 
 user@ranger.incubator.apache.org
 Date: Tuesday, July 28, 2015 at 4:45 PM

 To: user@ranger.incubator.apache.org 
 user@ranger.incubator.apache.org
 Subject: Re: Error Setting up Ranger-Admin

   By looking at this error it seems that port 50070
 http://0.0.0.0:50070 is in use. Check that namenode is already
 running. If so stop and start.

  Regards,
 Ramesh

   From: Aneela Saleem ane...@platalytics.com
 Reply-To: user@ranger.incubator.apache.org 
 user@ranger.incubator.apache.org
 Date: Tuesday, July 28, 2015 at 4:37 PM
 To: user@ranger.incubator.apache.org 
 user@ranger.incubator.apache.org
 Subject: Re: Error Setting up Ranger-Admin

   I'm continuously stuck at this point

 Regards,
 Aneela Saleem
 On Jul 29, 2015 4:37 AM, Aneela Saleem ane...@platalytics.com
 wrote:

 How can we check whether the problem is in Ranger's configuration
 or Hadoop?

 Regards,
 Aneela Saleem
 On Jul 29, 2015 2:03 AM, Aneela Saleem ane...@platalytics.com
 wrote:

 Following are the Logs:

  2015-07-29 02:01:22,126 FATAL
 org.apache.hadoop.hdfs.server.namenode.NameNode: Failed to start 
 namenode.
 java.net.BindException: Port in use: 0.0.0.0:50070
 at
 org.apache.hadoop.http.HttpServer2.openListeners(HttpServer2.java:891)
 at org.apache.hadoop.http.HttpServer2.start(HttpServer2.java:827)
 at
 org.apache.hadoop.hdfs.server.namenode.NameNodeHttpServer.start(NameNodeHttpServer.java:142

Re: Error Setting up Ranger-Admin

2015-07-29 Thread Alok Lal

The log is telling you is that ranger was not able to connect to your 
configured service  You may not have logging enabled at debug level.  You can 
do by editing: ranger-admin-install-dir/ews/webapp/WEB-INF/log4j.xml

Add/edit the following:

category name=org.apache.ranger additivity=false
priority value=debug /
appender-ref ref=xa_log_appender /
/category

Hopefully that tells you what is wrong with config.

xasecure-audit.xml is relevant for the plugins, e.g. Hdfs plugin.  It should be 
under conf directory of your hdfs install, i.e., same as where your 
hdfs-site.xml is located.

From: Aneela Saleem
Reply-To: 
user@ranger.incubator.apache.orgmailto:user@ranger.incubator.apache.org
Date: Wednesday, July 29, 2015 at 1:28 PM
To: user@ranger.incubator.apache.orgmailto:user@ranger.incubator.apache.org
Subject: Re: Error Setting up Ranger-Admin

I'm still unable to see any plugins under Audits, even after upgrading my HDFS 
to 2.7.0

When i create the Service/Repo from Ranger Admin UI, i get the following 
Exception:

Unable to retrieve any files using given parameters, You can still save the 
repository and start creating policies, but you would not be able to use 
autocomplete for resource names. Check xa_portal.log for more info.

xa_portal.log has the following latest logs:

2015-07-30 00:46:51,977 [http-bio-6080-exec-12] INFO  
org.apache.ranger.biz.SessionMgr (SessionMgr.java:140) - Login Success: 
loginId=admin, sessionId=71, sessionId=7BF27DADE24C1A2F3A7D4D386A6273BC, 
requestId=127.0.0.1
2015-07-30 00:47:10,747 [http-bio-6080-exec-8] INFO  
org.apache.ranger.biz.ServiceDBStore (ServiceDBStore.java:1224) - Deleting 
Policy, policyName: hadoopdev-1-20150729133217
2015-07-30 00:47:10,905 [http-bio-6080-exec-8] INFO  
org.apache.ranger.biz.ServiceDBStore (ServiceDBStore.java:1513) - Policy 
Deleted Successfully. PolicyName : hadoopdev-1-20150729133217
2015-07-30 00:48:03,684 [http-bio-6080-exec-8] WARN  
org.apache.ranger.biz.ServiceMgr (ServiceMgr.java:279) - 
getFilesInDirectory('ranger-plugins/hdfs'): adding 
/usr/local/ranger-0.5.0-admin/ews/webapp/WEB-INF/classes/ranger-plugins/hdfs/ranger-hdfs-plugin-0.5.0.jar
2015-07-30 00:48:03,684 [http-bio-6080-exec-8] WARN  
org.apache.ranger.biz.ServiceMgr (ServiceMgr.java:279) - 
getFilesInDirectory('ranger-plugins/hdfs'): adding 
/usr/local/ranger-0.5.0-admin/ews/webapp/WEB-INF/classes/ranger-plugins/hdfs/ranger-hdfs-plugin-0.5.0-tests.jar
2015-07-30 00:48:03,734 [timed-executor-pool-0] INFO  
org.apache.ranger.plugin.client.BaseClient (BaseClient.java:104) - Init Login: 
security not enabled, using username
2015-07-30 00:48:38,154 [timed-executor-pool-0] INFO  
org.apache.ranger.plugin.client.BaseClient (BaseClient.java:104) - Init Login: 
security not enabled, using username
2015-07-30 01:22:41,436 [http-bio-6080-exec-4] INFO  
org.apache.ranger.biz.ServiceDBStore (ServiceDBStore.java:1224) - Deleting 
Policy, policyName: hadoopdev-1-20150729202236
2015-07-30 01:22:41,526 [http-bio-6080-exec-4] INFO  
org.apache.ranger.biz.ServiceDBStore (ServiceDBStore.java:1513) - Policy 
Deleted Successfully. PolicyName : hadoopdev-1-20150729202236
2015-07-30 01:23:10,391 [timed-executor-pool-0] INFO  
org.apache.ranger.plugin.client.BaseClient (BaseClient.java:104) - Init Login: 
security not enabled, using username

And where is xasecure-audit.xml file located?

On Wed, Jul 29, 2015 at 10:36 PM, Don Bosco Durai 
bo...@apache.orgmailto:bo...@apache.org wrote:
Yes, either you have to upgrade Hadoop or use Ranger 0.4

Thanks

Bosco


From: Aneela Saleem ane...@platalytics.commailto:ane...@platalytics.com
Reply-To: 
user@ranger.incubator.apache.orgmailto:user@ranger.incubator.apache.org 
user@ranger.incubator.apache.orgmailto:user@ranger.incubator.apache.org
Date: Wednesday, July 29, 2015 at 10:26 AM

To: user@ranger.incubator.apache.orgmailto:user@ranger.incubator.apache.org 
user@ranger.incubator.apache.orgmailto:user@ranger.incubator.apache.org
Subject: Re: Error Setting up Ranger-Admin

I just came to know that Ranger 0.5 is compatible with HDFS 2.7.x and mine HDFS 
version is 2.6.0

Is it the case? do i need to upgrade Hadoop?

On Wed, Jul 29, 2015 at 8:09 PM, Aneela Saleem 
ane...@platalytics.commailto:ane...@platalytics.com wrote:
Hi Hanish,

Plugin is still not visible on Audit screen UI

On Wed, Jul 29, 2015 at 7:22 PM, Hanish Bansal 
hanish.ban...@impetus.co.inmailto:hanish.ban...@impetus.co.in wrote:

Hi Aneela,


By following below conversation thread, I am getting that you ranger admin UI 
is working fine but hdfs plugin is not shown in audit logs. If I am right then 
please try below steps:


1. Copy all the ranger libraries files from lib folder to 
share/hadoop/hdfs/lib/
cp hadoop-home/lib/* hadoop-home/share/hadoop/hdfs/lib/


2. Check if you have created symbolic link for hadoop configuration folder 
etc/hadoop as conf. If not then create using below command:

$ ln -s hadoop-home/etc/hadoop hadoop-home/conf


3. Restart

Re: Error Setting up Ranger-Admin

Hdfs Plugin has been shown under Audits. Thanks All

On Thu, Jul 30, 2015 at 1:28 AM, Aneela Saleem ane...@platalytics.com
wrote:

 I'm still unable to see any plugins under Audits, even after upgrading my
 HDFS to 2.7.0

 When i create the Service/Repo from Ranger Admin UI, i get the following
 Exception:

 Unable to retrieve any files using given parameters, You can still save
 the repository and start creating policies, but you would not be able to
 use autocomplete for resource names. Check *xa_portal.log* for more info.

 *xa_portal.log *has the following latest logs:

 2015-07-30 00:46:51,977 [http-bio-6080-exec-12] INFO
  org.apache.ranger.biz.SessionMgr (SessionMgr.java:140) - Login Success:
 loginId=admin, sessionId=71, sessionId=7BF27DADE24C1A2F3A7D4D386A6273BC,
 requestId=127.0.0.1
 2015-07-30 00:47:10,747 [http-bio-6080-exec-8] INFO
  org.apache.ranger.biz.ServiceDBStore (ServiceDBStore.java:1224) - Deleting
 Policy, policyName: hadoopdev-1-20150729133217
 2015-07-30 00:47:10,905 [http-bio-6080-exec-8] INFO
  org.apache.ranger.biz.ServiceDBStore (ServiceDBStore.java:1513) - Policy
 Deleted Successfully. PolicyName : hadoopdev-1-20150729133217
 2015-07-30 00:48:03,684 [http-bio-6080-exec-8] WARN
  org.apache.ranger.biz.ServiceMgr (ServiceMgr.java:279) -
 getFilesInDirectory('ranger-plugins/hdfs'): adding
 /usr/local/ranger-0.5.0-admin/ews/webapp/WEB-INF/classes/ranger-plugins/hdfs/ranger-hdfs-plugin-0.5.0.jar
 2015-07-30 00:48:03,684 [http-bio-6080-exec-8] WARN
  org.apache.ranger.biz.ServiceMgr (ServiceMgr.java:279) -
 getFilesInDirectory('ranger-plugins/hdfs'): adding
 /usr/local/ranger-0.5.0-admin/ews/webapp/WEB-INF/classes/ranger-plugins/hdfs/ranger-hdfs-plugin-0.5.0-tests.jar
 2015-07-30 00:48:03,734 [timed-executor-pool-0] INFO
  org.apache.ranger.plugin.client.BaseClient (BaseClient.java:104) - Init
 Login: security not enabled, using username
 2015-07-30 00:48:38,154 [timed-executor-pool-0] INFO
  org.apache.ranger.plugin.client.BaseClient (BaseClient.java:104) - Init
 Login: security not enabled, using username
 2015-07-30 01:22:41,436 [http-bio-6080-exec-4] INFO
  org.apache.ranger.biz.ServiceDBStore (ServiceDBStore.java:1224) - Deleting
 Policy, policyName: hadoopdev-1-20150729202236
 2015-07-30 01:22:41,526 [http-bio-6080-exec-4] INFO
  org.apache.ranger.biz.ServiceDBStore (ServiceDBStore.java:1513) - Policy
 Deleted Successfully. PolicyName : hadoopdev-1-20150729202236
 2015-07-30 01:23:10,391 [timed-executor-pool-0] INFO
  org.apache.ranger.plugin.client.BaseClient (BaseClient.java:104) - Init
 Login: security not enabled, using username

 And where is *xasecure-audit.xml* file located?

 On Wed, Jul 29, 2015 at 10:36 PM, Don Bosco Durai bo...@apache.org
 wrote:

 Yes, either you have to upgrade Hadoop or use Ranger 0.4

 Thanks

 Bosco


 From: Aneela Saleem ane...@platalytics.com
 Reply-To: user@ranger.incubator.apache.org 
 user@ranger.incubator.apache.org
 Date: Wednesday, July 29, 2015 at 10:26 AM

 To: user@ranger.incubator.apache.org user@ranger.incubator.apache.org
 Subject: Re: Error Setting up Ranger-Admin

 I just came to know that Ranger 0.5 is compatible with HDFS 2.7.x and
 mine HDFS version is 2.6.0

 Is it the case? do i need to upgrade Hadoop?

 On Wed, Jul 29, 2015 at 8:09 PM, Aneela Saleem ane...@platalytics.com
 wrote:

 Hi Hanish,

 Plugin is still not visible on Audit screen UI

 On Wed, Jul 29, 2015 at 7:22 PM, Hanish Bansal 
 hanish.ban...@impetus.co.in wrote:

 Hi Aneela,


 By following below conversation thread, I am getting that you ranger
 admin UI is working fine but hdfs plugin is not shown in audit logs. If I
 am right then please try below steps:


 1. Copy all the ranger libraries files from lib folder to
 share/hadoop/hdfs/lib/
 cp hadoop-home/lib/* hadoop-home/share/hadoop/hdfs/lib/


 2. Check if you have created symbolic link for hadoop configuration
 folder etc/hadoop as conf. If not then create using below command:

 $ ln -s hadoop-home/etc/hadoop hadoop-home/conf


 3. Restart namenode service.


 4. Now login into some other user on machine and try listing files in
 Hadoop.


 hadoop fs -ls /


 Note: In last step, run command using some other user who didn't start
 the hadoop services.


 Now check if plugin is visible on audit screen of UI.



 ---

 *Thanks  Regards, Hanish Bansal*
 Software Engineer, iLabs
 Impetus Infotech Pvt. Ltd.
 --
 *From:* Aneela Saleem ane...@platalytics.com
 *Sent:* Wednesday, July 29, 2015 7:19 PM
 *To:* user@ranger.incubator.apache.org

 *Subject:* Re: Error Setting up Ranger-Admin

 When i run *./setup.sh * in ranger-admin, i get the following error:

 SLF4J: Failed to load class org.slf4j.impl.StaticLoggerBinder.

 On Wed, Jul 29, 2015 at 6:46 PM, Aneela Saleem ane...@platalytics.com
 wrote:

 Yes NameNode is running. And i don't see any Ranger-related logs in
 NameNode logs

 On Wed, Jul 29, 2015 at 5:41 PM, Loïc Chanel 
 loic.cha...@telecomnancy.net wrote:

 At least

Re: Error Setting up Ranger-Admin

I'm still unable to see any plugins under Audits, even after upgrading my
HDFS to 2.7.0

When i create the Service/Repo from Ranger Admin UI, i get the following
Exception:

Unable to retrieve any files using given parameters, You can still save the
repository and start creating policies, but you would not be able to use
autocomplete for resource names. Check *xa_portal.log* for more info.

*xa_portal.log *has the following latest logs:

2015-07-30 00:46:51,977 [http-bio-6080-exec-12] INFO
 org.apache.ranger.biz.SessionMgr (SessionMgr.java:140) - Login Success:
loginId=admin, sessionId=71, sessionId=7BF27DADE24C1A2F3A7D4D386A6273BC,
requestId=127.0.0.1
2015-07-30 00:47:10,747 [http-bio-6080-exec-8] INFO
 org.apache.ranger.biz.ServiceDBStore (ServiceDBStore.java:1224) - Deleting
Policy, policyName: hadoopdev-1-20150729133217
2015-07-30 00:47:10,905 [http-bio-6080-exec-8] INFO
 org.apache.ranger.biz.ServiceDBStore (ServiceDBStore.java:1513) - Policy
Deleted Successfully. PolicyName : hadoopdev-1-20150729133217
2015-07-30 00:48:03,684 [http-bio-6080-exec-8] WARN
 org.apache.ranger.biz.ServiceMgr (ServiceMgr.java:279) -
getFilesInDirectory('ranger-plugins/hdfs'): adding
/usr/local/ranger-0.5.0-admin/ews/webapp/WEB-INF/classes/ranger-plugins/hdfs/ranger-hdfs-plugin-0.5.0.jar
2015-07-30 00:48:03,684 [http-bio-6080-exec-8] WARN
 org.apache.ranger.biz.ServiceMgr (ServiceMgr.java:279) -
getFilesInDirectory('ranger-plugins/hdfs'): adding
/usr/local/ranger-0.5.0-admin/ews/webapp/WEB-INF/classes/ranger-plugins/hdfs/ranger-hdfs-plugin-0.5.0-tests.jar
2015-07-30 00:48:03,734 [timed-executor-pool-0] INFO
 org.apache.ranger.plugin.client.BaseClient (BaseClient.java:104) - Init
Login: security not enabled, using username
2015-07-30 00:48:38,154 [timed-executor-pool-0] INFO
 org.apache.ranger.plugin.client.BaseClient (BaseClient.java:104) - Init
Login: security not enabled, using username
2015-07-30 01:22:41,436 [http-bio-6080-exec-4] INFO
 org.apache.ranger.biz.ServiceDBStore (ServiceDBStore.java:1224) - Deleting
Policy, policyName: hadoopdev-1-20150729202236
2015-07-30 01:22:41,526 [http-bio-6080-exec-4] INFO
 org.apache.ranger.biz.ServiceDBStore (ServiceDBStore.java:1513) - Policy
Deleted Successfully. PolicyName : hadoopdev-1-20150729202236
2015-07-30 01:23:10,391 [timed-executor-pool-0] INFO
 org.apache.ranger.plugin.client.BaseClient (BaseClient.java:104) - Init
Login: security not enabled, using username

And where is *xasecure-audit.xml* file located?

On Wed, Jul 29, 2015 at 10:36 PM, Don Bosco Durai bo...@apache.org wrote:

 Yes, either you have to upgrade Hadoop or use Ranger 0.4

 Thanks

 Bosco


 From: Aneela Saleem ane...@platalytics.com
 Reply-To: user@ranger.incubator.apache.org 
 user@ranger.incubator.apache.org
 Date: Wednesday, July 29, 2015 at 10:26 AM

 To: user@ranger.incubator.apache.org user@ranger.incubator.apache.org
 Subject: Re: Error Setting up Ranger-Admin

 I just came to know that Ranger 0.5 is compatible with HDFS 2.7.x and mine
 HDFS version is 2.6.0

 Is it the case? do i need to upgrade Hadoop?

 On Wed, Jul 29, 2015 at 8:09 PM, Aneela Saleem ane...@platalytics.com
 wrote:

 Hi Hanish,

 Plugin is still not visible on Audit screen UI

 On Wed, Jul 29, 2015 at 7:22 PM, Hanish Bansal 
 hanish.ban...@impetus.co.in wrote:

 Hi Aneela,


 By following below conversation thread, I am getting that you ranger
 admin UI is working fine but hdfs plugin is not shown in audit logs. If I
 am right then please try below steps:


 1. Copy all the ranger libraries files from lib folder to
 share/hadoop/hdfs/lib/
 cp hadoop-home/lib/* hadoop-home/share/hadoop/hdfs/lib/


 2. Check if you have created symbolic link for hadoop configuration
 folder etc/hadoop as conf. If not then create using below command:

 $ ln -s hadoop-home/etc/hadoop hadoop-home/conf


 3. Restart namenode service.


 4. Now login into some other user on machine and try listing files in
 Hadoop.


 hadoop fs -ls /


 Note: In last step, run command using some other user who didn't start
 the hadoop services.


 Now check if plugin is visible on audit screen of UI.



 ---

 *Thanks  Regards, Hanish Bansal*
 Software Engineer, iLabs
 Impetus Infotech Pvt. Ltd.
 --
 *From:* Aneela Saleem ane...@platalytics.com
 *Sent:* Wednesday, July 29, 2015 7:19 PM
 *To:* user@ranger.incubator.apache.org

 *Subject:* Re: Error Setting up Ranger-Admin

 When i run *./setup.sh * in ranger-admin, i get the following error:

 SLF4J: Failed to load class org.slf4j.impl.StaticLoggerBinder.

 On Wed, Jul 29, 2015 at 6:46 PM, Aneela Saleem ane...@platalytics.com
 wrote:

 Yes NameNode is running. And i don't see any Ranger-related logs in
 NameNode logs

 On Wed, Jul 29, 2015 at 5:41 PM, Loïc Chanel 
 loic.cha...@telecomnancy.net wrote:

 At least, is your NameNode running ?
 And do you can see any Ranger-related logs in the NameNode logs ?

 Loïc CHANEL
 Engineering student at TELECOM Nancy
 Trainee at Worldline

Re: Error Setting up Ranger-Admin

2015-07-29 Thread Don Bosco Durai

Yes, either you have to upgrade Hadoop or use Ranger 0.4

Thanks

Bosco


From:  Aneela Saleem ane...@platalytics.com
Reply-To:  user@ranger.incubator.apache.org
user@ranger.incubator.apache.org
Date:  Wednesday, July 29, 2015 at 10:26 AM
To:  user@ranger.incubator.apache.org user@ranger.incubator.apache.org
Subject:  Re: Error Setting up Ranger-Admin

 I just came to know that Ranger 0.5 is compatible with HDFS 2.7.x and mine
 HDFS version is 2.6.0
 
 Is it the case? do i need to upgrade Hadoop?
 
 On Wed, Jul 29, 2015 at 8:09 PM, Aneela Saleem ane...@platalytics.com wrote:
 Hi Hanish, 
 
 Plugin is still not visible on Audit screen UI
 
 On Wed, Jul 29, 2015 at 7:22 PM, Hanish Bansal hanish.ban...@impetus.co.in
 wrote:
 Hi Aneela,
 
 
 
 By following below conversation thread, I am getting that you ranger admin
 UI is working fine but hdfs plugin is not shown in audit logs. If I am right
 then please try below steps:
 
 
 
 1. Copy all the ranger libraries files from lib folder to
 share/hadoop/hdfs/lib/
 cp hadoop-home/lib/* hadoop-home/share/hadoop/hdfs/lib/
 
 
 
 2. Check if you have created symbolic link for hadoop configuration folder
 etc/hadoop as conf. If not then create using below command:
 
 $ ln -s hadoop-home/etc/hadoop hadoop-home/conf
 
 
 
 3. Restart namenode service.
 
 
 
 4. Now login into some other user on machine and try listing files in
 Hadoop.
 
 
 
 hadoop fs -ls /
 
 
 
 Note: In last step, run command using some other user who didn't start the
 hadoop services.
 
 
 
 Now check if plugin is visible on audit screen of UI.
 
 
 
 
 ---
 Thanks  Regards,
 Hanish Bansal
 Software Engineer, iLabs
 Impetus Infotech Pvt. Ltd.
 
 From: Aneela Saleem ane...@platalytics.com
 Sent: Wednesday, July 29, 2015 7:19 PM
 To: user@ranger.incubator.apache.org
 
 Subject: Re: Error Setting up Ranger-Admin
  
 When i run ./setup.sh  in ranger-admin, i get the following error:
 
 SLF4J: Failed to load class org.slf4j.impl.StaticLoggerBinder.
 
 On Wed, Jul 29, 2015 at 6:46 PM, Aneela Saleem ane...@platalytics.com
 wrote:
 Yes NameNode is running. And i don't see any Ranger-related logs in
 NameNode logs
 
 On Wed, Jul 29, 2015 at 5:41 PM, Loïc Chanel loic.cha...@telecomnancy.net
 wrote:
 At least, is your NameNode running ?
 And do you can see any Ranger-related logs in the NameNode logs ?
 
 Loïc CHANEL
 Engineering student at TELECOM Nancy
 Trainee at Worldline - Villeurbanne
 
 2015-07-29 14:37 GMT+02:00 Aneela Saleem ane...@platalytics.com:
 I can't figure out what is the issue? as there are no errors in log file
 
 On Wed, Jul 29, 2015 at 5:05 PM, Loïc Chanel
 loic.cha...@telecomnancy.net wrote:
 The logs for ranger plugins are in the NameNode logs, that's why Bosco
 told you to take a look there.
 
 Loïc CHANEL
 Engineering student at TELECOM Nancy
 Trainee at Worldline - Villeurbanne
 
 2015-07-29 12:43 GMT+02:00 Aneela Saleem ane...@platalytics.com:
 Hi Bosco, 
 
 I tried your solution but it still does not work for me
 
 On Wed, Jul 29, 2015 at 3:22 PM, Aneela Saleem ane...@platalytics.com
 wrote:
 How can i see logs for ranger-hdfs plugin ?
 
 Can you please have a look on install.properties file? is it correct?
 
 
 On Wed, Jul 29, 2015 at 10:57 AM, Don Bosco Durai bo...@apache.org
 wrote:
 Yes, this issues seems to be HDFS namenode was not stopped. Can you
 check the running process by running “ps –eafww | grep proc_namenode”
 and if it is running you have to stop it and start it again.
 
 Regarding the chown error, it seems the scripts assumes the user to be
 “hdfs”. Can you manually update enable-hdfs-plugin.sh and rerun it?
 
 Line number 89 of enable-hdfs-plugin.sh
 
 #CFG_OWNER_INF=${HCOMPONENT_NAME}:${HCOMPONENT_NAME}”
 
 CFG_OWNER_INF=hduser
 
 
 And run ./enable-hdfs-plugin.sh again?
 
 Thanks
 
 Bosco
 
 
 From: Ramesh Mani rm...@hortonworks.com
 Reply-To: user@ranger.incubator.apache.org
 user@ranger.incubator.apache.org
 Date: Tuesday, July 28, 2015 at 4:45 PM
 
 To: user@ranger.incubator.apache.org
 user@ranger.incubator.apache.org
 Subject: Re: Error Setting up Ranger-Admin
 
 By looking at this error it seems that port 50070 http://0.0.0.0:50070
 is in use. Check that namenode is already running. If so stop and start.
 
 Regards,
 Ramesh
 
 From: Aneela Saleem ane...@platalytics.com
 Reply-To: user@ranger.incubator.apache.org
 user@ranger.incubator.apache.org
 Date: Tuesday, July 28, 2015 at 4:37 PM
 To: user@ranger.incubator.apache.org
 user@ranger.incubator.apache.org
 Subject: Re: Error Setting up Ranger-Admin
 
 I'm continuously stuck at this point
 
 Regards,
 Aneela Saleem
 
 On Jul 29, 2015 4:37 AM, Aneela Saleem ane...@platalytics.com wrote:
 
 How can we check whether the problem is in Ranger's configuration or
 Hadoop?
 
 Regards,
 Aneela Saleem
 
 On Jul 29, 2015 2:03 AM, Aneela Saleem ane...@platalytics.com wrote:
 Following are the Logs:
 
 2015-07-29 02:01:22,126 FATAL
 org.apache.hadoop.hdfs.server.namenode.NameNode: Failed to start
 namenode

Re: Error Setting up Ranger-Admin

2015-07-29 Thread Don Bosco Durai

This is good. Are the access audits also showing up now?

Did you do anything special to get this working?

Thanks

Bosco


From:  Aneela Saleem ane...@platalytics.com
Reply-To:  user@ranger.incubator.apache.org
user@ranger.incubator.apache.org
Date:  Wednesday, July 29, 2015 at 1:51 PM
To:  user@ranger.incubator.apache.org user@ranger.incubator.apache.org
Subject:  Re: Error Setting up Ranger-Admin

 Hdfs Plugin has been shown under Audits. Thanks All
 
 On Thu, Jul 30, 2015 at 1:28 AM, Aneela Saleem ane...@platalytics.com wrote:
 I'm still unable to see any plugins under Audits, even after upgrading my
 HDFS to 2.7.0
 
 When i create the Service/Repo from Ranger Admin UI, i get the following
 Exception:
 
 Unable to retrieve any files using given parameters, You can still save the
 repository and start creating policies, but you would not be able to use
 autocomplete for resource names. Check xa_portal.log for more info.
 
 xa_portal.log has the following latest logs:
 
 2015-07-30 00:46:51,977 [http-bio-6080-exec-12] INFO
 org.apache.ranger.biz.SessionMgr (SessionMgr.java:140) - Login Success:
 loginId=admin, sessionId=71, sessionId=7BF27DADE24C1A2F3A7D4D386A6273BC,
 requestId=127.0.0.1
 2015-07-30 00:47:10,747 [http-bio-6080-exec-8] INFO
 org.apache.ranger.biz.ServiceDBStore (ServiceDBStore.java:1224) - Deleting
 Policy, policyName: hadoopdev-1-20150729133217
 2015-07-30 00:47:10,905 [http-bio-6080-exec-8] INFO
 org.apache.ranger.biz.ServiceDBStore (ServiceDBStore.java:1513) - Policy
 Deleted Successfully. PolicyName : hadoopdev-1-20150729133217
 2015-07-30 00:48:03,684 [http-bio-6080-exec-8] WARN
 org.apache.ranger.biz.ServiceMgr (ServiceMgr.java:279) -
 getFilesInDirectory('ranger-plugins/hdfs'): adding
 /usr/local/ranger-0.5.0-admin/ews/webapp/WEB-INF/classes/ranger-plugins/hdfs/
 ranger-hdfs-plugin-0.5.0.jar
 2015-07-30 00:48:03,684 [http-bio-6080-exec-8] WARN
 org.apache.ranger.biz.ServiceMgr (ServiceMgr.java:279) -
 getFilesInDirectory('ranger-plugins/hdfs'): adding
 /usr/local/ranger-0.5.0-admin/ews/webapp/WEB-INF/classes/ranger-plugins/hdfs/
 ranger-hdfs-plugin-0.5.0-tests.jar
 2015-07-30 00:48:03,734 [timed-executor-pool-0] INFO
 org.apache.ranger.plugin.client.BaseClient (BaseClient.java:104) - Init
 Login: security not enabled, using username
 2015-07-30 00:48:38,154 [timed-executor-pool-0] INFO
 org.apache.ranger.plugin.client.BaseClient (BaseClient.java:104) - Init
 Login: security not enabled, using username
 2015-07-30 01:22:41,436 [http-bio-6080-exec-4] INFO
 org.apache.ranger.biz.ServiceDBStore (ServiceDBStore.java:1224) - Deleting
 Policy, policyName: hadoopdev-1-20150729202236
 2015-07-30 01:22:41,526 [http-bio-6080-exec-4] INFO
 org.apache.ranger.biz.ServiceDBStore (ServiceDBStore.java:1513) - Policy
 Deleted Successfully. PolicyName : hadoopdev-1-20150729202236
 2015-07-30 01:23:10,391 [timed-executor-pool-0] INFO
 org.apache.ranger.plugin.client.BaseClient (BaseClient.java:104) - Init
 Login: security not enabled, using username
 
 And where is xasecure-audit.xml file located?
 
 On Wed, Jul 29, 2015 at 10:36 PM, Don Bosco Durai bo...@apache.org wrote:
 Yes, either you have to upgrade Hadoop or use Ranger 0.4
 
 Thanks
 
 Bosco
 
 
 From: Aneela Saleem ane...@platalytics.com
 Reply-To: user@ranger.incubator.apache.org
 user@ranger.incubator.apache.org
 Date: Wednesday, July 29, 2015 at 10:26 AM
 
 To: user@ranger.incubator.apache.org user@ranger.incubator.apache.org
 Subject: Re: Error Setting up Ranger-Admin
 
 I just came to know that Ranger 0.5 is compatible with HDFS 2.7.x and mine
 HDFS version is 2.6.0
 
 Is it the case? do i need to upgrade Hadoop?
 
 On Wed, Jul 29, 2015 at 8:09 PM, Aneela Saleem ane...@platalytics.com
 wrote:
 Hi Hanish, 
 
 Plugin is still not visible on Audit screen UI
 
 On Wed, Jul 29, 2015 at 7:22 PM, Hanish Bansal
 hanish.ban...@impetus.co.in wrote:
 Hi Aneela,
 
 
 
 By following below conversation thread, I am getting that you ranger
 admin UI is working fine but hdfs plugin is not shown in audit logs. If I
 am right then please try below steps:
 
 
 
 1. Copy all the ranger libraries files from lib folder to
 share/hadoop/hdfs/lib/
 cp hadoop-home/lib/* hadoop-home/share/hadoop/hdfs/lib/
 
 
 
 2. Check if you have created symbolic link for hadoop configuration
 folder etc/hadoop as conf. If not then create using below command:
 
 $ ln -s hadoop-home/etc/hadoop hadoop-home/conf
 
 
 
 3. Restart namenode service.
 
 
 
 4. Now login into some other user on machine and try listing files in
 Hadoop.
 
 
 
 hadoop fs -ls /
 
 
 
 Note: In last step, run command using some other user who didn't start
 the hadoop services.
 
 
 
 Now check if plugin is visible on audit screen of UI.
 
 
 
 
 ---
 Thanks  Regards,
 Hanish Bansal
 Software Engineer, iLabs
 Impetus Infotech Pvt. Ltd.
 
 From: Aneela Saleem ane...@platalytics.com
 Sent: Wednesday, July 29, 2015 7:19 PM
 To: user@ranger.incubator.apache.org
 
 Subject: Re: Error Setting up Ranger

Re: Error Setting up Ranger-Admin

Yes Audits are being shown now. I just upgraded my hadoop to 2.7.0.

And secondly another process was running on same port 6080. So I killed
that one and restarted hadoop. And the problem was resolved.

Now heading towards LDAP user sync and having some issues. I'll start
another thread for this.

Regards,
Aneela Saleem
On Jul 30, 2015 4:32 AM, Don Bosco Durai bo...@apache.org wrote:

 This is good. Are the access audits also showing up now?

 Did you do anything special to get this working?

 Thanks

 Bosco


 From: Aneela Saleem ane...@platalytics.com
 Reply-To: user@ranger.incubator.apache.org 
 user@ranger.incubator.apache.org
 Date: Wednesday, July 29, 2015 at 1:51 PM
 To: user@ranger.incubator.apache.org user@ranger.incubator.apache.org
 Subject: Re: Error Setting up Ranger-Admin

 Hdfs Plugin has been shown under Audits. Thanks All

 On Thu, Jul 30, 2015 at 1:28 AM, Aneela Saleem ane...@platalytics.com
 wrote:

 I'm still unable to see any plugins under Audits, even after upgrading my
 HDFS to 2.7.0

 When i create the Service/Repo from Ranger Admin UI, i get the following
 Exception:

 Unable to retrieve any files using given parameters, You can still save
 the repository and start creating policies, but you would not be able to
 use autocomplete for resource names. Check *xa_portal.log* for more info.

 *xa_portal.log *has the following latest logs:

 2015-07-30 00:46:51,977 [http-bio-6080-exec-12] INFO
  org.apache.ranger.biz.SessionMgr (SessionMgr.java:140) - Login Success:
 loginId=admin, sessionId=71, sessionId=7BF27DADE24C1A2F3A7D4D386A6273BC,
 requestId=127.0.0.1
 2015-07-30 00:47:10,747 [http-bio-6080-exec-8] INFO
  org.apache.ranger.biz.ServiceDBStore (ServiceDBStore.java:1224) - Deleting
 Policy, policyName: hadoopdev-1-20150729133217
 2015-07-30 00:47:10,905 [http-bio-6080-exec-8] INFO
  org.apache.ranger.biz.ServiceDBStore (ServiceDBStore.java:1513) - Policy
 Deleted Successfully. PolicyName : hadoopdev-1-20150729133217
 2015-07-30 00:48:03,684 [http-bio-6080-exec-8] WARN
  org.apache.ranger.biz.ServiceMgr (ServiceMgr.java:279) -
 getFilesInDirectory('ranger-plugins/hdfs'): adding
 /usr/local/ranger-0.5.0-admin/ews/webapp/WEB-INF/classes/ranger-plugins/hdfs/ranger-hdfs-plugin-0.5.0.jar
 2015-07-30 00:48:03,684 [http-bio-6080-exec-8] WARN
  org.apache.ranger.biz.ServiceMgr (ServiceMgr.java:279) -
 getFilesInDirectory('ranger-plugins/hdfs'): adding
 /usr/local/ranger-0.5.0-admin/ews/webapp/WEB-INF/classes/ranger-plugins/hdfs/ranger-hdfs-plugin-0.5.0-tests.jar
 2015-07-30 00:48:03,734 [timed-executor-pool-0] INFO
  org.apache.ranger.plugin.client.BaseClient (BaseClient.java:104) - Init
 Login: security not enabled, using username
 2015-07-30 00:48:38,154 [timed-executor-pool-0] INFO
  org.apache.ranger.plugin.client.BaseClient (BaseClient.java:104) - Init
 Login: security not enabled, using username
 2015-07-30 01:22:41,436 [http-bio-6080-exec-4] INFO
  org.apache.ranger.biz.ServiceDBStore (ServiceDBStore.java:1224) - Deleting
 Policy, policyName: hadoopdev-1-20150729202236
 2015-07-30 01:22:41,526 [http-bio-6080-exec-4] INFO
  org.apache.ranger.biz.ServiceDBStore (ServiceDBStore.java:1513) - Policy
 Deleted Successfully. PolicyName : hadoopdev-1-20150729202236
 2015-07-30 01:23:10,391 [timed-executor-pool-0] INFO
  org.apache.ranger.plugin.client.BaseClient (BaseClient.java:104) - Init
 Login: security not enabled, using username

 And where is *xasecure-audit.xml* file located?

 On Wed, Jul 29, 2015 at 10:36 PM, Don Bosco Durai bo...@apache.org
 wrote:

 Yes, either you have to upgrade Hadoop or use Ranger 0.4

 Thanks

 Bosco


 From: Aneela Saleem ane...@platalytics.com
 Reply-To: user@ranger.incubator.apache.org 
 user@ranger.incubator.apache.org
 Date: Wednesday, July 29, 2015 at 10:26 AM

 To: user@ranger.incubator.apache.org user@ranger.incubator.apache.org
 
 Subject: Re: Error Setting up Ranger-Admin

 I just came to know that Ranger 0.5 is compatible with HDFS 2.7.x and
 mine HDFS version is 2.6.0

 Is it the case? do i need to upgrade Hadoop?

 On Wed, Jul 29, 2015 at 8:09 PM, Aneela Saleem ane...@platalytics.com
 wrote:

 Hi Hanish,

 Plugin is still not visible on Audit screen UI

 On Wed, Jul 29, 2015 at 7:22 PM, Hanish Bansal 
 hanish.ban...@impetus.co.in wrote:

 Hi Aneela,


 By following below conversation thread, I am getting that you ranger
 admin UI is working fine but hdfs plugin is not shown in audit logs. If I
 am right then please try below steps:


 1. Copy all the ranger libraries files from lib folder to
 share/hadoop/hdfs/lib/
 cp hadoop-home/lib/* hadoop-home/share/hadoop/hdfs/lib/


 2. Check if you have created symbolic link for hadoop configuration
 folder etc/hadoop as conf. If not then create using below command:

 $ ln -s hadoop-home/etc/hadoop hadoop-home/conf


 3. Restart namenode service.


 4. Now login into some other user on machine and try listing files in
 Hadoop.


 hadoop fs -ls /


 Note: In last step, run command using some other user who

Re: Error Setting up Ranger-Admin

Sorry hit send too early.

Actually Access audit tab is still empty. But I can see the HDFS services
under audit  plugins tab

Regards,
Aneela Saleem
On Jul 30, 2015 4:37 AM, Aneela Saleem ane...@platalytics.com wrote:

 Yes Audits are being shown now. I just upgraded my hadoop to 2.7.0.

 And secondly another process was running on same port 6080. So I killed
 that one and restarted hadoop. And the problem was resolved.

 Now heading towards LDAP user sync and having some issues. I'll start
 another thread for this.

 Regards,
 Aneela Saleem
 On Jul 30, 2015 4:32 AM, Don Bosco Durai bo...@apache.org wrote:

 This is good. Are the access audits also showing up now?

 Did you do anything special to get this working?

 Thanks

 Bosco


 From: Aneela Saleem ane...@platalytics.com
 Reply-To: user@ranger.incubator.apache.org 
 user@ranger.incubator.apache.org
 Date: Wednesday, July 29, 2015 at 1:51 PM
 To: user@ranger.incubator.apache.org user@ranger.incubator.apache.org
 Subject: Re: Error Setting up Ranger-Admin

 Hdfs Plugin has been shown under Audits. Thanks All

 On Thu, Jul 30, 2015 at 1:28 AM, Aneela Saleem ane...@platalytics.com
 wrote:

 I'm still unable to see any plugins under Audits, even after upgrading
 my HDFS to 2.7.0

 When i create the Service/Repo from Ranger Admin UI, i get the following
 Exception:

 Unable to retrieve any files using given parameters, You can still save
 the repository and start creating policies, but you would not be able to
 use autocomplete for resource names. Check *xa_portal.log* for more
 info.

 *xa_portal.log *has the following latest logs:

 2015-07-30 00:46:51,977 [http-bio-6080-exec-12] INFO
  org.apache.ranger.biz.SessionMgr (SessionMgr.java:140) - Login Success:
 loginId=admin, sessionId=71, sessionId=7BF27DADE24C1A2F3A7D4D386A6273BC,
 requestId=127.0.0.1
 2015-07-30 00:47:10,747 [http-bio-6080-exec-8] INFO
  org.apache.ranger.biz.ServiceDBStore (ServiceDBStore.java:1224) - Deleting
 Policy, policyName: hadoopdev-1-20150729133217
 2015-07-30 00:47:10,905 [http-bio-6080-exec-8] INFO
  org.apache.ranger.biz.ServiceDBStore (ServiceDBStore.java:1513) - Policy
 Deleted Successfully. PolicyName : hadoopdev-1-20150729133217
 2015-07-30 00:48:03,684 [http-bio-6080-exec-8] WARN
  org.apache.ranger.biz.ServiceMgr (ServiceMgr.java:279) -
 getFilesInDirectory('ranger-plugins/hdfs'): adding
 /usr/local/ranger-0.5.0-admin/ews/webapp/WEB-INF/classes/ranger-plugins/hdfs/ranger-hdfs-plugin-0.5.0.jar
 2015-07-30 00:48:03,684 [http-bio-6080-exec-8] WARN
  org.apache.ranger.biz.ServiceMgr (ServiceMgr.java:279) -
 getFilesInDirectory('ranger-plugins/hdfs'): adding
 /usr/local/ranger-0.5.0-admin/ews/webapp/WEB-INF/classes/ranger-plugins/hdfs/ranger-hdfs-plugin-0.5.0-tests.jar
 2015-07-30 00:48:03,734 [timed-executor-pool-0] INFO
  org.apache.ranger.plugin.client.BaseClient (BaseClient.java:104) - Init
 Login: security not enabled, using username
 2015-07-30 00:48:38,154 [timed-executor-pool-0] INFO
  org.apache.ranger.plugin.client.BaseClient (BaseClient.java:104) - Init
 Login: security not enabled, using username
 2015-07-30 01:22:41,436 [http-bio-6080-exec-4] INFO
  org.apache.ranger.biz.ServiceDBStore (ServiceDBStore.java:1224) - Deleting
 Policy, policyName: hadoopdev-1-20150729202236
 2015-07-30 01:22:41,526 [http-bio-6080-exec-4] INFO
  org.apache.ranger.biz.ServiceDBStore (ServiceDBStore.java:1513) - Policy
 Deleted Successfully. PolicyName : hadoopdev-1-20150729202236
 2015-07-30 01:23:10,391 [timed-executor-pool-0] INFO
  org.apache.ranger.plugin.client.BaseClient (BaseClient.java:104) - Init
 Login: security not enabled, using username

 And where is *xasecure-audit.xml* file located?

 On Wed, Jul 29, 2015 at 10:36 PM, Don Bosco Durai bo...@apache.org
 wrote:

 Yes, either you have to upgrade Hadoop or use Ranger 0.4

 Thanks

 Bosco


 From: Aneela Saleem ane...@platalytics.com
 Reply-To: user@ranger.incubator.apache.org 
 user@ranger.incubator.apache.org
 Date: Wednesday, July 29, 2015 at 10:26 AM

 To: user@ranger.incubator.apache.org 
 user@ranger.incubator.apache.org
 Subject: Re: Error Setting up Ranger-Admin

 I just came to know that Ranger 0.5 is compatible with HDFS 2.7.x and
 mine HDFS version is 2.6.0

 Is it the case? do i need to upgrade Hadoop?

 On Wed, Jul 29, 2015 at 8:09 PM, Aneela Saleem ane...@platalytics.com
 wrote:

 Hi Hanish,

 Plugin is still not visible on Audit screen UI

 On Wed, Jul 29, 2015 at 7:22 PM, Hanish Bansal 
 hanish.ban...@impetus.co.in wrote:

 Hi Aneela,


 By following below conversation thread, I am getting that you ranger
 admin UI is working fine but hdfs plugin is not shown in audit logs. If I
 am right then please try below steps:


 1. Copy all the ranger libraries files from lib folder to
 share/hadoop/hdfs/lib/
 cp hadoop-home/lib/* hadoop-home/share/hadoop/hdfs/lib/


 2. Check if you have created symbolic link for hadoop configuration
 folder etc/hadoop as conf. If not then create using below command:

 $ ln -s

Re: Error Setting up Ranger-Admin

2015-07-29 Thread Don Bosco Durai

No issues. Generally getting the plugin connected is difficult part due to
flavors of deployments and deployment structures. Seems you got that right.

Are you using DB as the destination?

Thanks

Bosco



From:  Aneela Saleem ane...@platalytics.com
Reply-To:  user@ranger.incubator.apache.org
user@ranger.incubator.apache.org
Date:  Wednesday, July 29, 2015 at 4:39 PM
To:  user@ranger.incubator.apache.org user@ranger.incubator.apache.org
Subject:  Re: Error Setting up Ranger-Admin

 Sorry hit send too early.
 
 Actually Access audit tab is still empty. But I can see the HDFS services
 under audit  plugins tab
 
 Regards,
 Aneela Saleem
 
 On Jul 30, 2015 4:37 AM, Aneela Saleem ane...@platalytics.com wrote:
 
 Yes Audits are being shown now. I just upgraded my hadoop to 2.7.0.
 
 And secondly another process was running on same port 6080. So I killed that
 one and restarted hadoop. And the problem was resolved.
 
 Now heading towards LDAP user sync and having some issues. I'll start another
 thread for this.
 
 Regards,
 Aneela Saleem
 
 On Jul 30, 2015 4:32 AM, Don Bosco Durai bo...@apache.org wrote:
 This is good. Are the access audits also showing up now?
 
 Did you do anything special to get this working?
 
 Thanks
 
 Bosco
 
 
 From: Aneela Saleem ane...@platalytics.com
 Reply-To: user@ranger.incubator.apache.org
 user@ranger.incubator.apache.org
 Date: Wednesday, July 29, 2015 at 1:51 PM
 To: user@ranger.incubator.apache.org user@ranger.incubator.apache.org
 Subject: Re: Error Setting up Ranger-Admin
 
 Hdfs Plugin has been shown under Audits. Thanks All
 
 On Thu, Jul 30, 2015 at 1:28 AM, Aneela Saleem ane...@platalytics.com
 wrote:
 I'm still unable to see any plugins under Audits, even after upgrading my
 HDFS to 2.7.0
 
 When i create the Service/Repo from Ranger Admin UI, i get the following
 Exception:
 
 Unable to retrieve any files using given parameters, You can still save
 the repository and start creating policies, but you would not be able to
 use autocomplete for resource names. Check xa_portal.log for more info.
 
 xa_portal.log has the following latest logs:
 
 2015-07-30 00:46:51,977 [http-bio-6080-exec-12] INFO
 org.apache.ranger.biz.SessionMgr (SessionMgr.java:140) - Login Success:
 loginId=admin, sessionId=71, sessionId=7BF27DADE24C1A2F3A7D4D386A6273BC,
 requestId=127.0.0.1
 2015-07-30 00:47:10,747 [http-bio-6080-exec-8] INFO
 org.apache.ranger.biz.ServiceDBStore (ServiceDBStore.java:1224) - Deleting
 Policy, policyName: hadoopdev-1-20150729133217
 2015-07-30 00:47:10,905 [http-bio-6080-exec-8] INFO
 org.apache.ranger.biz.ServiceDBStore (ServiceDBStore.java:1513) - Policy
 Deleted Successfully. PolicyName : hadoopdev-1-20150729133217
 2015-07-30 00:48:03,684 [http-bio-6080-exec-8] WARN
 org.apache.ranger.biz.ServiceMgr (ServiceMgr.java:279) -
 getFilesInDirectory('ranger-plugins/hdfs'): adding
 /usr/local/ranger-0.5.0-admin/ews/webapp/WEB-INF/classes/ranger-plugins/hd
 fs/ranger-hdfs-plugin-0.5.0.jar
 2015-07-30 00:48:03,684 [http-bio-6080-exec-8] WARN
 org.apache.ranger.biz.ServiceMgr (ServiceMgr.java:279) -
 getFilesInDirectory('ranger-plugins/hdfs'): adding
 /usr/local/ranger-0.5.0-admin/ews/webapp/WEB-INF/classes/ranger-plugins/hd
 fs/ranger-hdfs-plugin-0.5.0-tests.jar
 2015-07-30 00:48:03,734 [timed-executor-pool-0] INFO
 org.apache.ranger.plugin.client.BaseClient (BaseClient.java:104) - Init
 Login: security not enabled, using username
 2015-07-30 00:48:38,154 [timed-executor-pool-0] INFO
 org.apache.ranger.plugin.client.BaseClient (BaseClient.java:104) - Init
 Login: security not enabled, using username
 2015-07-30 01:22:41,436 [http-bio-6080-exec-4] INFO
 org.apache.ranger.biz.ServiceDBStore (ServiceDBStore.java:1224) - Deleting
 Policy, policyName: hadoopdev-1-20150729202236
 2015-07-30 01:22:41,526 [http-bio-6080-exec-4] INFO
 org.apache.ranger.biz.ServiceDBStore (ServiceDBStore.java:1513) - Policy
 Deleted Successfully. PolicyName : hadoopdev-1-20150729202236
 2015-07-30 01:23:10,391 [timed-executor-pool-0] INFO
 org.apache.ranger.plugin.client.BaseClient (BaseClient.java:104) - Init
 Login: security not enabled, using username
 
 And where is xasecure-audit.xml file located?
 
 On Wed, Jul 29, 2015 at 10:36 PM, Don Bosco Durai bo...@apache.org
 wrote:
 Yes, either you have to upgrade Hadoop or use Ranger 0.4
 
 Thanks
 
 Bosco
 
 
 From: Aneela Saleem ane...@platalytics.com
 Reply-To: user@ranger.incubator.apache.org
 user@ranger.incubator.apache.org
 Date: Wednesday, July 29, 2015 at 10:26 AM
 
 To: user@ranger.incubator.apache.org user@ranger.incubator.apache.org
 Subject: Re: Error Setting up Ranger-Admin
 
 I just came to know that Ranger 0.5 is compatible with HDFS 2.7.x and
 mine HDFS version is 2.6.0
 
 Is it the case? do i need to upgrade Hadoop?
 
 On Wed, Jul 29, 2015 at 8:09 PM, Aneela Saleem ane...@platalytics.com
 wrote:
 Hi Hanish, 
 
 Plugin is still not visible on Audit screen UI
 
 On Wed, Jul 29, 2015 at 7:22 PM, Hanish Bansal
 hanish.ban

Re: Error Setting up Ranger-Admin

How can i see logs for ranger-hdfs plugin ?

Can you please have a look on install.properties file? is it correct?


On Wed, Jul 29, 2015 at 10:57 AM, Don Bosco Durai bo...@apache.org wrote:

 Yes, this issues seems to be HDFS namenode was not stopped. Can you check
 the running process by running “ps –eafww | grep proc_namenode” and if it
 is running you have to stop it and start it again.

 Regarding the chown error, it seems the scripts assumes the user to be
 “hdfs”. Can you manually update enable-hdfs-plugin.sh and rerun it?

 Line number 89 of enable-hdfs-plugin.sh

 #CFG_OWNER_INF=${HCOMPONENT_NAME}:${HCOMPONENT_NAME}”

 CFG_OWNER_INF=hduser

 And run ./enable-hdfs-plugin.sh again?

 Thanks

 Bosco


 From: Ramesh Mani rm...@hortonworks.com
 Reply-To: user@ranger.incubator.apache.org 
 user@ranger.incubator.apache.org
 Date: Tuesday, July 28, 2015 at 4:45 PM

 To: user@ranger.incubator.apache.org user@ranger.incubator.apache.org
 Subject: Re: Error Setting up Ranger-Admin

 By looking at this error it seems that port 50070 http://0.0.0.0:50070 is
 in use. Check that namenode is already running. If so stop and start.

 Regards,
 Ramesh

 From: Aneela Saleem ane...@platalytics.com
 Reply-To: user@ranger.incubator.apache.org 
 user@ranger.incubator.apache.org
 Date: Tuesday, July 28, 2015 at 4:37 PM
 To: user@ranger.incubator.apache.org user@ranger.incubator.apache.org
 Subject: Re: Error Setting up Ranger-Admin

 I'm continuously stuck at this point

 Regards,
 Aneela Saleem
 On Jul 29, 2015 4:37 AM, Aneela Saleem ane...@platalytics.com wrote:

 How can we check whether the problem is in Ranger's configuration or
 Hadoop?

 Regards,
 Aneela Saleem
 On Jul 29, 2015 2:03 AM, Aneela Saleem ane...@platalytics.com wrote:

 Following are the Logs:

 2015-07-29 02:01:22,126 FATAL
 org.apache.hadoop.hdfs.server.namenode.NameNode: Failed to start namenode.
 java.net.BindException: Port in use: 0.0.0.0:50070
 at org.apache.hadoop.http.HttpServer2.openListeners(HttpServer2.java:891)
 at org.apache.hadoop.http.HttpServer2.start(HttpServer2.java:827)
 at
 org.apache.hadoop.hdfs.server.namenode.NameNodeHttpServer.start(NameNodeHttpServer.java:142)
 at
 org.apache.hadoop.hdfs.server.namenode.NameNode.startHttpServer(NameNode.java:703)
 at
 org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:590)
 at
 org.apache.hadoop.hdfs.server.namenode.NameNode.init(NameNode.java:762)
 at
 org.apache.hadoop.hdfs.server.namenode.NameNode.init(NameNode.java:746)
 at
 org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1438)
 at
 org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1504)
 Caused by: java.net.BindException: Address already in use
 at sun.nio.ch.Net.bind0(Native Method)
 at sun.nio.ch.Net.bind(Net.java:463)
 at sun.nio.ch.Net.bind(Net.java:455)
 at
 sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:223)
 at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:74)
 at
 org.mortbay.jetty.nio.SelectChannelConnector.open(SelectChannelConnector.java:216)
 at org.apache.hadoop.http.HttpServer2.openListeners(HttpServer2.java:886)
 ... 8 more
 2015-07-29 02:01:22,128 INFO org.apache.hadoop.util.ExitUtil: Exiting
 with status 1
 2015-07-29 02:01:22,129 INFO
 org.apache.hadoop.hdfs.server.namenode.NameNode: SHUTDOWN_MSG:
 /
 SHUTDOWN_MSG: Shutting down NameNode at aneela-Lenovo-G50-70/192.168.1.4
 /


 On Wed, Jul 29, 2015 at 1:53 AM, Aneela Saleem ane...@platalytics.com
 wrote:

 hduser

 On Wed, Jul 29, 2015 at 1:51 AM, Don Bosco Durai bo...@apache.org
 wrote:

 This seems to be one of the reason HDFS plugin is not enabled. As what
 user have you installed Hadoop?

 Thanks

 Bosco

 From: Aneela Saleem ane...@platalytics.com
 Reply-To: user@ranger.incubator.apache.org 
 user@ranger.incubator.apache.org
 Date: Tuesday, July 28, 2015 at 1:31 PM
 To: user@ranger.incubator.apache.org 
 user@ranger.incubator.apache.org
 Subject: Re: Error Setting up Ranger-Admin

 Also when i run *./enable-hdfs-plugin.sh *

 i get the following at the end:

 + بدھ جولاي 29 01:28:20 PKT 2015 : Saving current JCE file:
 /etc/ranger/hadoopdev/cred.jceks to
 /etc/ranger/hadoopdev/.cred.jceks.20150729012820 ...
 *chown: invalid user: ‘hdfs:hdfs’*
 Ranger Plugin for hadoop has been enabled. Please restart hadoop to
 ensure that changes are effective.








install.properties
Description: Binary data

Re: Error Setting up Ranger-Admin

2015-07-29 Thread Loïc Chanel

The logs for ranger plugins are in the NameNode logs, that's why Bosco told
you to take a look there.

Loïc CHANEL
Engineering student at TELECOM Nancy
Trainee at Worldline - Villeurbanne

2015-07-29 12:43 GMT+02:00 Aneela Saleem ane...@platalytics.com:

 Hi Bosco,

 I tried your solution but it still does not work for me

 On Wed, Jul 29, 2015 at 3:22 PM, Aneela Saleem ane...@platalytics.com
 wrote:

 How can i see logs for ranger-hdfs plugin ?

 Can you please have a look on install.properties file? is it correct?


 On Wed, Jul 29, 2015 at 10:57 AM, Don Bosco Durai bo...@apache.org
 wrote:

 Yes, this issues seems to be HDFS namenode was not stopped. Can you
 check the running process by running “ps –eafww | grep proc_namenode” and
 if it is running you have to stop it and start it again.

 Regarding the chown error, it seems the scripts assumes the user to be
 “hdfs”. Can you manually update enable-hdfs-plugin.sh and rerun it?

 Line number 89 of enable-hdfs-plugin.sh

 #CFG_OWNER_INF=${HCOMPONENT_NAME}:${HCOMPONENT_NAME}”

 CFG_OWNER_INF=hduser

 And run ./enable-hdfs-plugin.sh again?

 Thanks

 Bosco


 From: Ramesh Mani rm...@hortonworks.com
 Reply-To: user@ranger.incubator.apache.org 
 user@ranger.incubator.apache.org
 Date: Tuesday, July 28, 2015 at 4:45 PM

 To: user@ranger.incubator.apache.org user@ranger.incubator.apache.org
 
 Subject: Re: Error Setting up Ranger-Admin

 By looking at this error it seems that port 50070 http://0.0.0.0:50070 is
 in use. Check that namenode is already running. If so stop and start.

 Regards,
 Ramesh

 From: Aneela Saleem ane...@platalytics.com
 Reply-To: user@ranger.incubator.apache.org 
 user@ranger.incubator.apache.org
 Date: Tuesday, July 28, 2015 at 4:37 PM
 To: user@ranger.incubator.apache.org user@ranger.incubator.apache.org
 
 Subject: Re: Error Setting up Ranger-Admin

 I'm continuously stuck at this point

 Regards,
 Aneela Saleem
 On Jul 29, 2015 4:37 AM, Aneela Saleem ane...@platalytics.com wrote:

 How can we check whether the problem is in Ranger's configuration or
 Hadoop?

 Regards,
 Aneela Saleem
 On Jul 29, 2015 2:03 AM, Aneela Saleem ane...@platalytics.com
 wrote:

 Following are the Logs:

 2015-07-29 02:01:22,126 FATAL
 org.apache.hadoop.hdfs.server.namenode.NameNode: Failed to start namenode.
 java.net.BindException: Port in use: 0.0.0.0:50070
 at
 org.apache.hadoop.http.HttpServer2.openListeners(HttpServer2.java:891)
 at org.apache.hadoop.http.HttpServer2.start(HttpServer2.java:827)
 at
 org.apache.hadoop.hdfs.server.namenode.NameNodeHttpServer.start(NameNodeHttpServer.java:142)
 at
 org.apache.hadoop.hdfs.server.namenode.NameNode.startHttpServer(NameNode.java:703)
 at
 org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:590)
 at
 org.apache.hadoop.hdfs.server.namenode.NameNode.init(NameNode.java:762)
 at
 org.apache.hadoop.hdfs.server.namenode.NameNode.init(NameNode.java:746)
 at
 org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1438)
 at
 org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1504)
 Caused by: java.net.BindException: Address already in use
 at sun.nio.ch.Net.bind0(Native Method)
 at sun.nio.ch.Net.bind(Net.java:463)
 at sun.nio.ch.Net.bind(Net.java:455)
 at
 sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:223)
 at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:74)
 at
 org.mortbay.jetty.nio.SelectChannelConnector.open(SelectChannelConnector.java:216)
 at
 org.apache.hadoop.http.HttpServer2.openListeners(HttpServer2.java:886)
 ... 8 more
 2015-07-29 02:01:22,128 INFO org.apache.hadoop.util.ExitUtil: Exiting
 with status 1
 2015-07-29 02:01:22,129 INFO
 org.apache.hadoop.hdfs.server.namenode.NameNode: SHUTDOWN_MSG:
 /
 SHUTDOWN_MSG: Shutting down NameNode at aneela-Lenovo-G50-70/
 192.168.1.4
 /


 On Wed, Jul 29, 2015 at 1:53 AM, Aneela Saleem ane...@platalytics.com
  wrote:

 hduser

 On Wed, Jul 29, 2015 at 1:51 AM, Don Bosco Durai bo...@apache.org
 wrote:

 This seems to be one of the reason HDFS plugin is not enabled. As
 what user have you installed Hadoop?

 Thanks

 Bosco

 From: Aneela Saleem ane...@platalytics.com
 Reply-To: user@ranger.incubator.apache.org 
 user@ranger.incubator.apache.org
 Date: Tuesday, July 28, 2015 at 1:31 PM
 To: user@ranger.incubator.apache.org 
 user@ranger.incubator.apache.org
 Subject: Re: Error Setting up Ranger-Admin

 Also when i run *./enable-hdfs-plugin.sh *

 i get the following at the end:

 + بدھ جولاي 29 01:28:20 PKT 2015 : Saving current JCE file:
 /etc/ranger/hadoopdev/cred.jceks to
 /etc/ranger/hadoopdev/.cred.jceks.20150729012820 ...
 *chown: invalid user: ‘hdfs:hdfs’*
 Ranger Plugin for hadoop has been enabled. Please restart hadoop to
 ensure that changes are effective.

Re: Error Setting up Ranger-Admin

I can't figure out what is the issue? as there are no errors in log file

On Wed, Jul 29, 2015 at 5:05 PM, Loïc Chanel loic.cha...@telecomnancy.net
wrote:

 The logs for ranger plugins are in the NameNode logs, that's why Bosco
 told you to take a look there.

 Loïc CHANEL
 Engineering student at TELECOM Nancy
 Trainee at Worldline - Villeurbanne

 2015-07-29 12:43 GMT+02:00 Aneela Saleem ane...@platalytics.com:

 Hi Bosco,

 I tried your solution but it still does not work for me

 On Wed, Jul 29, 2015 at 3:22 PM, Aneela Saleem ane...@platalytics.com
 wrote:

 How can i see logs for ranger-hdfs plugin ?

 Can you please have a look on install.properties file? is it correct?


 On Wed, Jul 29, 2015 at 10:57 AM, Don Bosco Durai bo...@apache.org
 wrote:

 Yes, this issues seems to be HDFS namenode was not stopped. Can you
 check the running process by running “ps –eafww | grep proc_namenode” and
 if it is running you have to stop it and start it again.

 Regarding the chown error, it seems the scripts assumes the user to be
 “hdfs”. Can you manually update enable-hdfs-plugin.sh and rerun it?

 Line number 89 of enable-hdfs-plugin.sh

 #CFG_OWNER_INF=${HCOMPONENT_NAME}:${HCOMPONENT_NAME}”

 CFG_OWNER_INF=hduser

 And run ./enable-hdfs-plugin.sh again?

 Thanks

 Bosco


 From: Ramesh Mani rm...@hortonworks.com
 Reply-To: user@ranger.incubator.apache.org 
 user@ranger.incubator.apache.org
 Date: Tuesday, July 28, 2015 at 4:45 PM

 To: user@ranger.incubator.apache.org 
 user@ranger.incubator.apache.org
 Subject: Re: Error Setting up Ranger-Admin

 By looking at this error it seems that port 50070
 http://0.0.0.0:50070 is in use. Check that namenode is already
 running. If so stop and start.

 Regards,
 Ramesh

 From: Aneela Saleem ane...@platalytics.com
 Reply-To: user@ranger.incubator.apache.org 
 user@ranger.incubator.apache.org
 Date: Tuesday, July 28, 2015 at 4:37 PM
 To: user@ranger.incubator.apache.org 
 user@ranger.incubator.apache.org
 Subject: Re: Error Setting up Ranger-Admin

 I'm continuously stuck at this point

 Regards,
 Aneela Saleem
 On Jul 29, 2015 4:37 AM, Aneela Saleem ane...@platalytics.com
 wrote:

 How can we check whether the problem is in Ranger's configuration or
 Hadoop?

 Regards,
 Aneela Saleem
 On Jul 29, 2015 2:03 AM, Aneela Saleem ane...@platalytics.com
 wrote:

 Following are the Logs:

 2015-07-29 02:01:22,126 FATAL
 org.apache.hadoop.hdfs.server.namenode.NameNode: Failed to start 
 namenode.
 java.net.BindException: Port in use: 0.0.0.0:50070
 at
 org.apache.hadoop.http.HttpServer2.openListeners(HttpServer2.java:891)
 at org.apache.hadoop.http.HttpServer2.start(HttpServer2.java:827)
 at
 org.apache.hadoop.hdfs.server.namenode.NameNodeHttpServer.start(NameNodeHttpServer.java:142)
 at
 org.apache.hadoop.hdfs.server.namenode.NameNode.startHttpServer(NameNode.java:703)
 at
 org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:590)
 at
 org.apache.hadoop.hdfs.server.namenode.NameNode.init(NameNode.java:762)
 at
 org.apache.hadoop.hdfs.server.namenode.NameNode.init(NameNode.java:746)
 at
 org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1438)
 at
 org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1504)
 Caused by: java.net.BindException: Address already in use
 at sun.nio.ch.Net.bind0(Native Method)
 at sun.nio.ch.Net.bind(Net.java:463)
 at sun.nio.ch.Net.bind(Net.java:455)
 at
 sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:223)
 at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:74)
 at
 org.mortbay.jetty.nio.SelectChannelConnector.open(SelectChannelConnector.java:216)
 at
 org.apache.hadoop.http.HttpServer2.openListeners(HttpServer2.java:886)
 ... 8 more
 2015-07-29 02:01:22,128 INFO org.apache.hadoop.util.ExitUtil: Exiting
 with status 1
 2015-07-29 02:01:22,129 INFO
 org.apache.hadoop.hdfs.server.namenode.NameNode: SHUTDOWN_MSG:
 /
 SHUTDOWN_MSG: Shutting down NameNode at aneela-Lenovo-G50-70/
 192.168.1.4
 /


 On Wed, Jul 29, 2015 at 1:53 AM, Aneela Saleem 
 ane...@platalytics.com wrote:

 hduser

 On Wed, Jul 29, 2015 at 1:51 AM, Don Bosco Durai bo...@apache.org
 wrote:

 This seems to be one of the reason HDFS plugin is not enabled. As
 what user have you installed Hadoop?

 Thanks

 Bosco

 From: Aneela Saleem ane...@platalytics.com
 Reply-To: user@ranger.incubator.apache.org 
 user@ranger.incubator.apache.org
 Date: Tuesday, July 28, 2015 at 1:31 PM
 To: user@ranger.incubator.apache.org 
 user@ranger.incubator.apache.org
 Subject: Re: Error Setting up Ranger-Admin

 Also when i run *./enable-hdfs-plugin.sh *

 i get the following at the end:

 + بدھ جولاي 29 01:28:20 PKT 2015 : Saving current JCE file:
 /etc/ranger/hadoopdev/cred.jceks to
 /etc/ranger/hadoopdev/.cred.jceks.20150729012820 ...
 *chown: invalid user: ‘hdfs:hdfs’*
 Ranger Plugin for hadoop

Re: Error Setting up Ranger-Admin

When i run *./setup.sh * in ranger-admin, i get the following error:

SLF4J: Failed to load class org.slf4j.impl.StaticLoggerBinder.

On Wed, Jul 29, 2015 at 6:46 PM, Aneela Saleem ane...@platalytics.com
wrote:

 Yes NameNode is running. And i don't see any Ranger-related logs in
 NameNode logs

 On Wed, Jul 29, 2015 at 5:41 PM, Loïc Chanel loic.cha...@telecomnancy.net
  wrote:

 At least, is your NameNode running ?
 And do you can see any Ranger-related logs in the NameNode logs ?

 Loïc CHANEL
 Engineering student at TELECOM Nancy
 Trainee at Worldline - Villeurbanne

 2015-07-29 14:37 GMT+02:00 Aneela Saleem ane...@platalytics.com:

 I can't figure out what is the issue? as there are no errors in log file

 On Wed, Jul 29, 2015 at 5:05 PM, Loïc Chanel 
 loic.cha...@telecomnancy.net wrote:

 The logs for ranger plugins are in the NameNode logs, that's why Bosco
 told you to take a look there.

 Loïc CHANEL
 Engineering student at TELECOM Nancy
 Trainee at Worldline - Villeurbanne

 2015-07-29 12:43 GMT+02:00 Aneela Saleem ane...@platalytics.com:

 Hi Bosco,

 I tried your solution but it still does not work for me

 On Wed, Jul 29, 2015 at 3:22 PM, Aneela Saleem ane...@platalytics.com
  wrote:

 How can i see logs for ranger-hdfs plugin ?

 Can you please have a look on install.properties file? is it correct?


 On Wed, Jul 29, 2015 at 10:57 AM, Don Bosco Durai bo...@apache.org
 wrote:

 Yes, this issues seems to be HDFS namenode was not stopped. Can you
 check the running process by running “ps –eafww | grep proc_namenode” 
 and
 if it is running you have to stop it and start it again.

 Regarding the chown error, it seems the scripts assumes the user to
 be “hdfs”. Can you manually update enable-hdfs-plugin.sh and rerun
 it?

 Line number 89 of enable-hdfs-plugin.sh

 #CFG_OWNER_INF=${HCOMPONENT_NAME}:${HCOMPONENT_NAME}”

 CFG_OWNER_INF=hduser

 And run ./enable-hdfs-plugin.sh again?

 Thanks

 Bosco


 From: Ramesh Mani rm...@hortonworks.com
 Reply-To: user@ranger.incubator.apache.org 
 user@ranger.incubator.apache.org
 Date: Tuesday, July 28, 2015 at 4:45 PM

 To: user@ranger.incubator.apache.org 
 user@ranger.incubator.apache.org
 Subject: Re: Error Setting up Ranger-Admin

 By looking at this error it seems that port 50070
 http://0.0.0.0:50070 is in use. Check that namenode is already
 running. If so stop and start.

 Regards,
 Ramesh

 From: Aneela Saleem ane...@platalytics.com
 Reply-To: user@ranger.incubator.apache.org 
 user@ranger.incubator.apache.org
 Date: Tuesday, July 28, 2015 at 4:37 PM
 To: user@ranger.incubator.apache.org 
 user@ranger.incubator.apache.org
 Subject: Re: Error Setting up Ranger-Admin

 I'm continuously stuck at this point

 Regards,
 Aneela Saleem
 On Jul 29, 2015 4:37 AM, Aneela Saleem ane...@platalytics.com
 wrote:

 How can we check whether the problem is in Ranger's configuration
 or Hadoop?

 Regards,
 Aneela Saleem
 On Jul 29, 2015 2:03 AM, Aneela Saleem ane...@platalytics.com
 wrote:

 Following are the Logs:

 2015-07-29 02:01:22,126 FATAL
 org.apache.hadoop.hdfs.server.namenode.NameNode: Failed to start 
 namenode.
 java.net.BindException: Port in use: 0.0.0.0:50070
 at
 org.apache.hadoop.http.HttpServer2.openListeners(HttpServer2.java:891)
 at org.apache.hadoop.http.HttpServer2.start(HttpServer2.java:827)
 at
 org.apache.hadoop.hdfs.server.namenode.NameNodeHttpServer.start(NameNodeHttpServer.java:142)
 at
 org.apache.hadoop.hdfs.server.namenode.NameNode.startHttpServer(NameNode.java:703)
 at
 org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:590)
 at
 org.apache.hadoop.hdfs.server.namenode.NameNode.init(NameNode.java:762)
 at
 org.apache.hadoop.hdfs.server.namenode.NameNode.init(NameNode.java:746)
 at
 org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1438)
 at
 org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1504)
 Caused by: java.net.BindException: Address already in use
 at sun.nio.ch.Net.bind0(Native Method)
 at sun.nio.ch.Net.bind(Net.java:463)
 at sun.nio.ch.Net.bind(Net.java:455)
 at
 sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:223)
 at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:74)
 at
 org.mortbay.jetty.nio.SelectChannelConnector.open(SelectChannelConnector.java:216)
 at
 org.apache.hadoop.http.HttpServer2.openListeners(HttpServer2.java:886)
 ... 8 more
 2015-07-29 02:01:22,128 INFO org.apache.hadoop.util.ExitUtil:
 Exiting with status 1
 2015-07-29 02:01:22,129 INFO
 org.apache.hadoop.hdfs.server.namenode.NameNode: SHUTDOWN_MSG:
 /
 SHUTDOWN_MSG: Shutting down NameNode at aneela-Lenovo-G50-70/
 192.168.1.4
 /


 On Wed, Jul 29, 2015 at 1:53 AM, Aneela Saleem 
 ane...@platalytics.com wrote:

 hduser

 On Wed, Jul 29, 2015 at 1:51 AM, Don Bosco Durai 
 bo...@apache.org wrote:

 This seems to be one of the reason HDFS plugin

Re: Error Setting up Ranger-Admin

2015-07-29 Thread Loïc Chanel

At least, is your NameNode running ?
And do you can see any Ranger-related logs in the NameNode logs ?

Loïc CHANEL
Engineering student at TELECOM Nancy
Trainee at Worldline - Villeurbanne

2015-07-29 14:37 GMT+02:00 Aneela Saleem ane...@platalytics.com:

 I can't figure out what is the issue? as there are no errors in log file

 On Wed, Jul 29, 2015 at 5:05 PM, Loïc Chanel loic.cha...@telecomnancy.net
  wrote:

 The logs for ranger plugins are in the NameNode logs, that's why Bosco
 told you to take a look there.

 Loïc CHANEL
 Engineering student at TELECOM Nancy
 Trainee at Worldline - Villeurbanne

 2015-07-29 12:43 GMT+02:00 Aneela Saleem ane...@platalytics.com:

 Hi Bosco,

 I tried your solution but it still does not work for me

 On Wed, Jul 29, 2015 at 3:22 PM, Aneela Saleem ane...@platalytics.com
 wrote:

 How can i see logs for ranger-hdfs plugin ?

 Can you please have a look on install.properties file? is it correct?


 On Wed, Jul 29, 2015 at 10:57 AM, Don Bosco Durai bo...@apache.org
 wrote:

 Yes, this issues seems to be HDFS namenode was not stopped. Can you
 check the running process by running “ps –eafww | grep proc_namenode” and
 if it is running you have to stop it and start it again.

 Regarding the chown error, it seems the scripts assumes the user to be
 “hdfs”. Can you manually update enable-hdfs-plugin.sh and rerun it?

 Line number 89 of enable-hdfs-plugin.sh

 #CFG_OWNER_INF=${HCOMPONENT_NAME}:${HCOMPONENT_NAME}”

 CFG_OWNER_INF=hduser

 And run ./enable-hdfs-plugin.sh again?

 Thanks

 Bosco


 From: Ramesh Mani rm...@hortonworks.com
 Reply-To: user@ranger.incubator.apache.org 
 user@ranger.incubator.apache.org
 Date: Tuesday, July 28, 2015 at 4:45 PM

 To: user@ranger.incubator.apache.org 
 user@ranger.incubator.apache.org
 Subject: Re: Error Setting up Ranger-Admin

 By looking at this error it seems that port 50070
 http://0.0.0.0:50070 is in use. Check that namenode is already
 running. If so stop and start.

 Regards,
 Ramesh

 From: Aneela Saleem ane...@platalytics.com
 Reply-To: user@ranger.incubator.apache.org 
 user@ranger.incubator.apache.org
 Date: Tuesday, July 28, 2015 at 4:37 PM
 To: user@ranger.incubator.apache.org 
 user@ranger.incubator.apache.org
 Subject: Re: Error Setting up Ranger-Admin

 I'm continuously stuck at this point

 Regards,
 Aneela Saleem
 On Jul 29, 2015 4:37 AM, Aneela Saleem ane...@platalytics.com
 wrote:

 How can we check whether the problem is in Ranger's configuration or
 Hadoop?

 Regards,
 Aneela Saleem
 On Jul 29, 2015 2:03 AM, Aneela Saleem ane...@platalytics.com
 wrote:

 Following are the Logs:

 2015-07-29 02:01:22,126 FATAL
 org.apache.hadoop.hdfs.server.namenode.NameNode: Failed to start 
 namenode.
 java.net.BindException: Port in use: 0.0.0.0:50070
 at
 org.apache.hadoop.http.HttpServer2.openListeners(HttpServer2.java:891)
 at org.apache.hadoop.http.HttpServer2.start(HttpServer2.java:827)
 at
 org.apache.hadoop.hdfs.server.namenode.NameNodeHttpServer.start(NameNodeHttpServer.java:142)
 at
 org.apache.hadoop.hdfs.server.namenode.NameNode.startHttpServer(NameNode.java:703)
 at
 org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:590)
 at
 org.apache.hadoop.hdfs.server.namenode.NameNode.init(NameNode.java:762)
 at
 org.apache.hadoop.hdfs.server.namenode.NameNode.init(NameNode.java:746)
 at
 org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1438)
 at
 org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1504)
 Caused by: java.net.BindException: Address already in use
 at sun.nio.ch.Net.bind0(Native Method)
 at sun.nio.ch.Net.bind(Net.java:463)
 at sun.nio.ch.Net.bind(Net.java:455)
 at
 sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:223)
 at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:74)
 at
 org.mortbay.jetty.nio.SelectChannelConnector.open(SelectChannelConnector.java:216)
 at
 org.apache.hadoop.http.HttpServer2.openListeners(HttpServer2.java:886)
 ... 8 more
 2015-07-29 02:01:22,128 INFO org.apache.hadoop.util.ExitUtil:
 Exiting with status 1
 2015-07-29 02:01:22,129 INFO
 org.apache.hadoop.hdfs.server.namenode.NameNode: SHUTDOWN_MSG:
 /
 SHUTDOWN_MSG: Shutting down NameNode at aneela-Lenovo-G50-70/
 192.168.1.4
 /


 On Wed, Jul 29, 2015 at 1:53 AM, Aneela Saleem 
 ane...@platalytics.com wrote:

 hduser

 On Wed, Jul 29, 2015 at 1:51 AM, Don Bosco Durai bo...@apache.org
 wrote:

 This seems to be one of the reason HDFS plugin is not enabled. As
 what user have you installed Hadoop?

 Thanks

 Bosco

 From: Aneela Saleem ane...@platalytics.com
 Reply-To: user@ranger.incubator.apache.org 
 user@ranger.incubator.apache.org
 Date: Tuesday, July 28, 2015 at 1:31 PM
 To: user@ranger.incubator.apache.org 
 user@ranger.incubator.apache.org
 Subject: Re: Error Setting up Ranger-Admin

 Also when i run *./enable-hdfs

Re: Error Setting up Ranger-Admin

Yes NameNode is running. And i don't see any Ranger-related logs in
NameNode logs

On Wed, Jul 29, 2015 at 5:41 PM, Loïc Chanel loic.cha...@telecomnancy.net
wrote:

 At least, is your NameNode running ?
 And do you can see any Ranger-related logs in the NameNode logs ?

 Loïc CHANEL
 Engineering student at TELECOM Nancy
 Trainee at Worldline - Villeurbanne

 2015-07-29 14:37 GMT+02:00 Aneela Saleem ane...@platalytics.com:

 I can't figure out what is the issue? as there are no errors in log file

 On Wed, Jul 29, 2015 at 5:05 PM, Loïc Chanel 
 loic.cha...@telecomnancy.net wrote:

 The logs for ranger plugins are in the NameNode logs, that's why Bosco
 told you to take a look there.

 Loïc CHANEL
 Engineering student at TELECOM Nancy
 Trainee at Worldline - Villeurbanne

 2015-07-29 12:43 GMT+02:00 Aneela Saleem ane...@platalytics.com:

 Hi Bosco,

 I tried your solution but it still does not work for me

 On Wed, Jul 29, 2015 at 3:22 PM, Aneela Saleem ane...@platalytics.com
 wrote:

 How can i see logs for ranger-hdfs plugin ?

 Can you please have a look on install.properties file? is it correct?


 On Wed, Jul 29, 2015 at 10:57 AM, Don Bosco Durai bo...@apache.org
 wrote:

 Yes, this issues seems to be HDFS namenode was not stopped. Can you
 check the running process by running “ps –eafww | grep proc_namenode” and
 if it is running you have to stop it and start it again.

 Regarding the chown error, it seems the scripts assumes the user to
 be “hdfs”. Can you manually update enable-hdfs-plugin.sh and rerun
 it?

 Line number 89 of enable-hdfs-plugin.sh

 #CFG_OWNER_INF=${HCOMPONENT_NAME}:${HCOMPONENT_NAME}”

 CFG_OWNER_INF=hduser

 And run ./enable-hdfs-plugin.sh again?

 Thanks

 Bosco


 From: Ramesh Mani rm...@hortonworks.com
 Reply-To: user@ranger.incubator.apache.org 
 user@ranger.incubator.apache.org
 Date: Tuesday, July 28, 2015 at 4:45 PM

 To: user@ranger.incubator.apache.org 
 user@ranger.incubator.apache.org
 Subject: Re: Error Setting up Ranger-Admin

 By looking at this error it seems that port 50070
 http://0.0.0.0:50070 is in use. Check that namenode is already
 running. If so stop and start.

 Regards,
 Ramesh

 From: Aneela Saleem ane...@platalytics.com
 Reply-To: user@ranger.incubator.apache.org 
 user@ranger.incubator.apache.org
 Date: Tuesday, July 28, 2015 at 4:37 PM
 To: user@ranger.incubator.apache.org 
 user@ranger.incubator.apache.org
 Subject: Re: Error Setting up Ranger-Admin

 I'm continuously stuck at this point

 Regards,
 Aneela Saleem
 On Jul 29, 2015 4:37 AM, Aneela Saleem ane...@platalytics.com
 wrote:

 How can we check whether the problem is in Ranger's configuration or
 Hadoop?

 Regards,
 Aneela Saleem
 On Jul 29, 2015 2:03 AM, Aneela Saleem ane...@platalytics.com
 wrote:

 Following are the Logs:

 2015-07-29 02:01:22,126 FATAL
 org.apache.hadoop.hdfs.server.namenode.NameNode: Failed to start 
 namenode.
 java.net.BindException: Port in use: 0.0.0.0:50070
 at
 org.apache.hadoop.http.HttpServer2.openListeners(HttpServer2.java:891)
 at org.apache.hadoop.http.HttpServer2.start(HttpServer2.java:827)
 at
 org.apache.hadoop.hdfs.server.namenode.NameNodeHttpServer.start(NameNodeHttpServer.java:142)
 at
 org.apache.hadoop.hdfs.server.namenode.NameNode.startHttpServer(NameNode.java:703)
 at
 org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:590)
 at
 org.apache.hadoop.hdfs.server.namenode.NameNode.init(NameNode.java:762)
 at
 org.apache.hadoop.hdfs.server.namenode.NameNode.init(NameNode.java:746)
 at
 org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1438)
 at
 org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1504)
 Caused by: java.net.BindException: Address already in use
 at sun.nio.ch.Net.bind0(Native Method)
 at sun.nio.ch.Net.bind(Net.java:463)
 at sun.nio.ch.Net.bind(Net.java:455)
 at
 sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:223)
 at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:74)
 at
 org.mortbay.jetty.nio.SelectChannelConnector.open(SelectChannelConnector.java:216)
 at
 org.apache.hadoop.http.HttpServer2.openListeners(HttpServer2.java:886)
 ... 8 more
 2015-07-29 02:01:22,128 INFO org.apache.hadoop.util.ExitUtil:
 Exiting with status 1
 2015-07-29 02:01:22,129 INFO
 org.apache.hadoop.hdfs.server.namenode.NameNode: SHUTDOWN_MSG:
 /
 SHUTDOWN_MSG: Shutting down NameNode at aneela-Lenovo-G50-70/
 192.168.1.4
 /


 On Wed, Jul 29, 2015 at 1:53 AM, Aneela Saleem 
 ane...@platalytics.com wrote:

 hduser

 On Wed, Jul 29, 2015 at 1:51 AM, Don Bosco Durai bo...@apache.org
  wrote:

 This seems to be one of the reason HDFS plugin is not enabled. As
 what user have you installed Hadoop?

 Thanks

 Bosco

 From: Aneela Saleem ane...@platalytics.com
 Reply-To: user@ranger.incubator.apache.org 
 user@ranger.incubator.apache.org
 Date: Tuesday, July

Re: Error Setting up Ranger-Admin

2015-07-29 Thread Hanish Bansal

Hi Aneela,


By following below conversation thread, I am getting that you ranger admin UI 
is working fine but hdfs plugin is not shown in audit logs. If I am right then 
please try below steps:


1. Copy all the ranger libraries files from lib folder to 
share/hadoop/hdfs/lib/
cp hadoop-home/lib/* hadoop-home/share/hadoop/hdfs/lib/


2. Check if you have created symbolic link for hadoop configuration folder 
etc/hadoop as conf. If not then create using below command:

$ ln -s hadoop-home/etc/hadoop hadoop-home/conf


3. Restart namenode service.


4. Now login into some other user on machine and try listing files in Hadoop.


hadoop fs -ls /


Note: In last step, run command using some other user who didn't start the 
hadoop services.


Now check if plugin is visible on audit screen of UI.



---
Thanks  Regards,
Hanish Bansal
Software Engineer, iLabs
Impetus Infotech Pvt. Ltd.

From: Aneela Saleem ane...@platalytics.com
Sent: Wednesday, July 29, 2015 7:19 PM
To: user@ranger.incubator.apache.org
Subject: Re: Error Setting up Ranger-Admin

When i run ./setup.sh  in ranger-admin, i get the following error:

SLF4J: Failed to load class org.slf4j.impl.StaticLoggerBinder.

On Wed, Jul 29, 2015 at 6:46 PM, Aneela Saleem 
ane...@platalytics.commailto:ane...@platalytics.com wrote:
Yes NameNode is running. And i don't see any Ranger-related logs in NameNode 
logs

On Wed, Jul 29, 2015 at 5:41 PM, Loïc Chanel 
loic.cha...@telecomnancy.netmailto:loic.cha...@telecomnancy.net wrote:
At least, is your NameNode running ?
And do you can see any Ranger-related logs in the NameNode logs ?

Loïc CHANEL
Engineering student at TELECOM Nancy
Trainee at Worldline - Villeurbanne

2015-07-29 14:37 GMT+02:00 Aneela Saleem 
ane...@platalytics.commailto:ane...@platalytics.com:
I can't figure out what is the issue? as there are no errors in log file

On Wed, Jul 29, 2015 at 5:05 PM, Loïc Chanel 
loic.cha...@telecomnancy.netmailto:loic.cha...@telecomnancy.net wrote:
The logs for ranger plugins are in the NameNode logs, that's why Bosco told you 
to take a look there.

Loïc CHANEL
Engineering student at TELECOM Nancy
Trainee at Worldline - Villeurbanne

2015-07-29 12:43 GMT+02:00 Aneela Saleem 
ane...@platalytics.commailto:ane...@platalytics.com:
Hi Bosco,

I tried your solution but it still does not work for me

On Wed, Jul 29, 2015 at 3:22 PM, Aneela Saleem 
ane...@platalytics.commailto:ane...@platalytics.com wrote:
How can i see logs for ranger-hdfs plugin ?

Can you please have a look on install.properties file? is it correct?


On Wed, Jul 29, 2015 at 10:57 AM, Don Bosco Durai 
bo...@apache.orgmailto:bo...@apache.org wrote:
Yes, this issues seems to be HDFS namenode was not stopped. Can you check the 
running process by running “ps –eafww | grep proc_namenode” and if it is 
running you have to stop it and start it again.

Regarding the chown error, it seems the scripts assumes the user to be “hdfs”. 
Can you manually update enable-hdfs-plugin.sh and rerun it?

Line number 89 of enable-hdfs-plugin.sh


#CFG_OWNER_INF=${HCOMPONENT_NAME}:${HCOMPONENT_NAME}”

CFG_OWNER_INF=hduser

And run ./enable-hdfs-plugin.sh again?

Thanks

Bosco


From: Ramesh Mani rm...@hortonworks.commailto:rm...@hortonworks.com
Reply-To: 
user@ranger.incubator.apache.orgmailto:user@ranger.incubator.apache.org 
user@ranger.incubator.apache.orgmailto:user@ranger.incubator.apache.org
Date: Tuesday, July 28, 2015 at 4:45 PM

To: user@ranger.incubator.apache.orgmailto:user@ranger.incubator.apache.org 
user@ranger.incubator.apache.orgmailto:user@ranger.incubator.apache.org
Subject: Re: Error Setting up Ranger-Admin

By looking at this error it seems that port 50070http://0.0.0.0:50070 is in 
use. Check that namenode is already running. If so stop and start.

Regards,
Ramesh

From: Aneela Saleem ane...@platalytics.commailto:ane...@platalytics.com
Reply-To: 
user@ranger.incubator.apache.orgmailto:user@ranger.incubator.apache.org 
user@ranger.incubator.apache.orgmailto:user@ranger.incubator.apache.org
Date: Tuesday, July 28, 2015 at 4:37 PM
To: user@ranger.incubator.apache.orgmailto:user@ranger.incubator.apache.org 
user@ranger.incubator.apache.orgmailto:user@ranger.incubator.apache.org
Subject: Re: Error Setting up Ranger-Admin


I'm continuously stuck at this point

Regards,
Aneela Saleem

On Jul 29, 2015 4:37 AM, Aneela Saleem 
ane...@platalytics.commailto:ane...@platalytics.com wrote:

How can we check whether the problem is in Ranger's configuration or Hadoop?

Regards,
Aneela Saleem

On Jul 29, 2015 2:03 AM, Aneela Saleem 
ane...@platalytics.commailto:ane...@platalytics.com wrote:
Following are the Logs:

2015-07-29 02:01:22,126 FATAL org.apache.hadoop.hdfs.server.namenode.NameNode: 
Failed to start namenode.
java.net.BindException: Port in use: 0.0.0.0:50070http://0.0.0.0:50070
at org.apache.hadoop.http.HttpServer2.openListeners(HttpServer2.java:891)
at org.apache.hadoop.http.HttpServer2.start(HttpServer2.java:827

Re: Error Setting up Ranger-Admin

Hi Bosco,

I did as you suggested but still getting same error.

On Tue, Jul 28, 2015 at 4:49 AM, Don Bosco Durai bo...@apache.org wrote:

 The properties file looks good..

 I am not sure whether it is because of python 2.7. Is it possible for you
 to use python 2.6?

 Try changing the below to where 2.6 is installed.

 PYTHON_COMMAND_INVOKER=python


 Thanks

 Bosco


 From: Aneela Saleem ane...@platalytics.com
 Reply-To: user@ranger.incubator.apache.org 
 user@ranger.incubator.apache.org
 Date: Monday, July 27, 2015 at 2:02 PM
 To: user@ranger.incubator.apache.org user@ranger.incubator.apache.org
 Subject: Error Setting up Ranger-Admin

 Hi all,

 I have followed this link


 https://cwiki.apache.org/confluence/display/RANGER/Apache+Ranger+0.5.0+Installation

 But when i run *./setupsh, *i get the following error at the end:

 Traceback (most recent call last):
   File update_property.py, line 40, in module

 write_properties_to_xml(ranger_admin_site_xml_path,parameter_name,parameter_value)
   File update_property.py, line 21, in write_properties_to_xml
 if(os.path.isfile(xml_path)):
   File /usr/lib/python2.7/genericpath.py, line 29, in isfile
 st = os.stat(path)
 TypeError: coercing to Unicode: need string or buffer, NoneType found
 2015-07-28 01:38:57,308  [E] Update property failed for:

 Attached is the *install.proprties* file.

 I'm new to Apache Knox, can anyone please guide me. I'm having troubles in
 installing Apache Ranger.

 Thanks

Re: Error Setting up Ranger-Admin

Yes, this issues seems to be HDFS namenode was not stopped. Can you check
the running process by running “ps –eafww | grep proc_namenode” and if it is
running you have to stop it and start it again.

Regarding the chown error, it seems the scripts assumes the user to be
“hdfs”. Can you manually update enable-hdfs-plugin.sh and rerun it?

Line number 89 of enable-hdfs-plugin.sh

#CFG_OWNER_INF=${HCOMPONENT_NAME}:${HCOMPONENT_NAME}”

CFG_OWNER_INF=hduser


And run ./enable-hdfs-plugin.sh again?

Thanks

Bosco


From:  Ramesh Mani rm...@hortonworks.com
Reply-To:  user@ranger.incubator.apache.org
user@ranger.incubator.apache.org
Date:  Tuesday, July 28, 2015 at 4:45 PM
To:  user@ranger.incubator.apache.org user@ranger.incubator.apache.org
Subject:  Re: Error Setting up Ranger-Admin

 By looking at this error it seems that port 50070 http://0.0.0.0:50070  is
 in use. Check that namenode is already running. If so stop and start.
 
 Regards,
 Ramesh
 
 From: Aneela Saleem ane...@platalytics.com
 Reply-To: user@ranger.incubator.apache.org
 user@ranger.incubator.apache.org
 Date: Tuesday, July 28, 2015 at 4:37 PM
 To: user@ranger.incubator.apache.org user@ranger.incubator.apache.org
 Subject: Re: Error Setting up Ranger-Admin
 
 I'm continuously stuck at this point
 
 Regards,
 Aneela Saleem
 
 On Jul 29, 2015 4:37 AM, Aneela Saleem ane...@platalytics.com wrote:
 
 How can we check whether the problem is in Ranger's configuration or Hadoop?
 
 Regards,
 Aneela Saleem
 
 On Jul 29, 2015 2:03 AM, Aneela Saleem ane...@platalytics.com wrote:
 Following are the Logs:
 
 2015-07-29 02:01:22,126 FATAL
 org.apache.hadoop.hdfs.server.namenode.NameNode: Failed to start namenode.
 java.net.BindException: Port in use: 0.0.0.0:50070 http://0.0.0.0:50070
 at org.apache.hadoop.http.HttpServer2.openListeners(HttpServer2.java:891)
 at org.apache.hadoop.http.HttpServer2.start(HttpServer2.java:827)
 at 
 org.apache.hadoop.hdfs.server.namenode.NameNodeHttpServer.start(NameNodeHttp
 Server.java:142)
 at 
 org.apache.hadoop.hdfs.server.namenode.NameNode.startHttpServer(NameNode.jav
 a:703)
 at 
 
org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:590
)
 at org.apache.hadoop.hdfs.server.namenode.NameNode.init(NameNode.java:762)
 at org.apache.hadoop.hdfs.server.namenode.NameNode.init(NameNode.java:746)
 at 
 org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java
 :1438)
 at org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1504)
 Caused by: java.net.BindException: Address already in use
 at sun.nio.ch.Net.bind0(Native Method)
 at sun.nio.ch.Net.bind(Net.java:463)
 at sun.nio.ch.Net.bind(Net.java:455)
 at sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:223)
 at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:74)
 at 
 org.mortbay.jetty.nio.SelectChannelConnector.open(SelectChannelConnector.jav
 a:216)
 at org.apache.hadoop.http.HttpServer2.openListeners(HttpServer2.java:886)
 ... 8 more
 2015-07-29 02:01:22,128 INFO org.apache.hadoop.util.ExitUtil: Exiting with
 status 1
 2015-07-29 02:01:22,129 INFO
 org.apache.hadoop.hdfs.server.namenode.NameNode: SHUTDOWN_MSG:
 /
 SHUTDOWN_MSG: Shutting down NameNode at aneela-Lenovo-G50-70/192.168.1.4
 http://192.168.1.4
 /
 
 
 On Wed, Jul 29, 2015 at 1:53 AM, Aneela Saleem ane...@platalytics.com
 wrote:
 hduser
 
 On Wed, Jul 29, 2015 at 1:51 AM, Don Bosco Durai bo...@apache.org wrote:
 This seems to be one of the reason HDFS plugin is not enabled. As what
 user have you installed Hadoop?
 
 Thanks
 
 Bosco
 
 From: Aneela Saleem ane...@platalytics.com
 Reply-To: user@ranger.incubator.apache.org
 user@ranger.incubator.apache.org
 Date: Tuesday, July 28, 2015 at 1:31 PM
 To: user@ranger.incubator.apache.org user@ranger.incubator.apache.org
 Subject: Re: Error Setting up Ranger-Admin
 
 Also when i run ./enable-hdfs-plugin.sh
 
 i get the following at the end:
 
 + بدھ جولاي 29 01:28:20 PKT 2015 : Saving current JCE file:
 /etc/ranger/hadoopdev/cred.jceks to
 /etc/ranger/hadoopdev/.cred.jceks.20150729012820 ...
 chown: invalid user: ‘hdfs:hdfs’
 Ranger Plugin for hadoop has been enabled. Please restart hadoop to
 ensure that changes are effective.

Re: Error Setting up Ranger-Admin

And i'm using following link for installation:

https://cwiki.apache.org/confluence/display/RANGER/Apache+Ranger+0.5.0+Installation

I'm upto *Enabling Ranger HDFS Plugins *section (e)

   - You can verify by logging into the Ranger Admin Web interface  Audit
Agents.
   -

   You can verify the plugin is communicating to Ranger admin in
   Audit-plugins tab


where i don't see any audits ensuring hdfs plugin is communicating to
Ranger Admin.

On Tue, Jul 28, 2015 at 10:11 PM, Aneela Saleem ane...@platalytics.com
wrote:

 I'm planning to secure HDFS and i'm using Knox for authentication using
 REST API.

 Yes i'm still able to access the RangerAdmin UI. I'm just curious how to
 sync LDAP contacts in APache Ranger.

 Secondly if the document is related to 0.4 and i'm linked with 0.5, then
 how should i proceed? Do you have any fruitful link, i should follow?
 (being a novice)

 On Tue, Jul 28, 2015 at 10:04 PM, Don Bosco Durai bo...@apache.org
 wrote:

 Aneela

 The document you linked is for Apache Ranger 0.4. There subtle changes in
 Apache Ranger 0.5.

 Just curious, how you were able to access RangerAdmin UI? Did the
 installation continued after the install failure?

 Also, can you give additional information of your env? I can try
 reproducing it.

 Also, which components are you planning secure? (HDFS, Hive, Hbase, Solr,
 YARN, Storm, etc)

 Thanks

 Bosco


 From: Aneela Saleem ane...@platalytics.com
 Reply-To: user@ranger.incubator.apache.org 
 user@ranger.incubator.apache.org
 Date: Tuesday, July 28, 2015 at 5:19 AM
 To: user@ranger.incubator.apache.org user@ranger.incubator.apache.org
 Subject: Re: Error Setting up Ranger-Admin

 And secondly my Ranger UI does not Match the UI as shown in the following
 link:

 http://pivotalhd.docs.pivotal.io/docs/ranger-user-guide.html#Item1.4.2

 There is no Policy Manager Tab and no Manage Repository Thing.

 On Tue, Jul 28, 2015 at 5:17 PM, Aneela Saleem ane...@platalytics.com
 wrote:

 Hi Bosco,

 I did as you suggested but still getting same error.

 On Tue, Jul 28, 2015 at 4:49 AM, Don Bosco Durai bo...@apache.org
 wrote:

 The properties file looks good..

 I am not sure whether it is because of python 2.7. Is it possible for
 you to use python 2.6?

 Try changing the below to where 2.6 is installed.

 PYTHON_COMMAND_INVOKER=python


 Thanks

 Bosco


 From: Aneela Saleem ane...@platalytics.com
 Reply-To: user@ranger.incubator.apache.org 
 user@ranger.incubator.apache.org
 Date: Monday, July 27, 2015 at 2:02 PM
 To: user@ranger.incubator.apache.org 
 user@ranger.incubator.apache.org
 Subject: Error Setting up Ranger-Admin

 Hi all,

 I have followed this link


 https://cwiki.apache.org/confluence/display/RANGER/Apache+Ranger+0.5.0+Installation

 But when i run *./setupsh, *i get the following error at the end:

 Traceback (most recent call last):
   File update_property.py, line 40, in module

 write_properties_to_xml(ranger_admin_site_xml_path,parameter_name,parameter_value)
   File update_property.py, line 21, in write_properties_to_xml
 if(os.path.isfile(xml_path)):
   File /usr/lib/python2.7/genericpath.py, line 29, in isfile
 st = os.stat(path)
 TypeError: coercing to Unicode: need string or buffer, NoneType found
 2015-07-28 01:38:57,308  [E] Update property failed for:

 Attached is the *install.proprties* file.

 I'm new to Apache Knox, can anyone please guide me. I'm having troubles
 in installing Apache Ranger.

 Thanks

Re: Error Setting up Ranger-Admin

Aneela

The document you linked is for Apache Ranger 0.4. There subtle changes in
Apache Ranger 0.5. 

Just curious, how you were able to access RangerAdmin UI? Did the
installation continued after the install failure?

Also, can you give additional information of your env? I can try reproducing
it.

Also, which components are you planning secure? (HDFS, Hive, Hbase, Solr,
YARN, Storm, etc)

Thanks

Bosco


From:  Aneela Saleem ane...@platalytics.com
Reply-To:  user@ranger.incubator.apache.org
user@ranger.incubator.apache.org
Date:  Tuesday, July 28, 2015 at 5:19 AM
To:  user@ranger.incubator.apache.org user@ranger.incubator.apache.org
Subject:  Re: Error Setting up Ranger-Admin

 And secondly my Ranger UI does not Match the UI as shown in the following
 link: 
 
 http://pivotalhd.docs.pivotal.io/docs/ranger-user-guide.html#Item1.4.2
 
 There is no Policy Manager Tab and no Manage Repository Thing.
 
 On Tue, Jul 28, 2015 at 5:17 PM, Aneela Saleem ane...@platalytics.com wrote:
 Hi Bosco, 
 
 I did as you suggested but still getting same error.
 
 On Tue, Jul 28, 2015 at 4:49 AM, Don Bosco Durai bo...@apache.org wrote:
 The properties file looks good..
 
 I am not sure whether it is because of python 2.7. Is it possible for you to
 use python 2.6?
 
 Try changing the below to where 2.6 is installed.
 
 PYTHON_COMMAND_INVOKER=python
 
 
 Thanks
 
 Bosco
 
 
 From: Aneela Saleem ane...@platalytics.com
 Reply-To: user@ranger.incubator.apache.org
 user@ranger.incubator.apache.org
 Date: Monday, July 27, 2015 at 2:02 PM
 To: user@ranger.incubator.apache.org user@ranger.incubator.apache.org
 Subject: Error Setting up Ranger-Admin
 
 Hi all, 
 
 I have followed this link
 
 https://cwiki.apache.org/confluence/display/RANGER/Apache+Ranger+0.5.0+Inst
 allation
 
 But when i run ./setupsh, i get the following error at the end:
 
 Traceback (most recent call last):
   File update_property.py, line 40, in module
 
 write_properties_to_xml(ranger_admin_site_xml_path,parameter_name,parameter
 _value)
   File update_property.py, line 21, in write_properties_to_xml
 if(os.path.isfile(xml_path)):
   File /usr/lib/python2.7/genericpath.py, line 29, in isfile
 st = os.stat(path)
 TypeError: coercing to Unicode: need string or buffer, NoneType found
 2015-07-28 01:38:57,308  [E] Update property failed for:
 
 Attached is the install.proprties file.
 
 I'm new to Apache Knox, can anyone please guide me. I'm having troubles in
 installing Apache Ranger.
 
 Thanks

Re: Error Setting up Ranger-Admin

Thank you so much Bosco. I created JIRA for this. Can be found here
https://issues.apache.org/jira/browse/RANGER-582

Let me try UserSync, then i will approach yyou in case of any problem.

On Tue, Jul 28, 2015 at 11:28 PM, Don Bosco Durai bdu...@hortonworks.com
wrote:

  Good. I already typed it, so let me paste it for the benefit of others.
 We need to update the doc also. If you don’t mind, can you create a JIRA to
 track this?

1. Go to RangerAdmin UI - AccessManager (first menu tab is already
opened by default)
2. Click on “+” in the HDFS panel title
3. Enter Service Name: e.g. “${cluster_name}_hdfs. Cluster name could
be anything. You can call the repo “test_hdfs” if you want to
4. UserName: ranger  (doesn’t matter whether it exists because you are
not using kerberos)
5. Password: ranger (doesn’t matter what you give)
6. Namenode URL: hdfs://namenode_host:8020
7. Authorization Enabled: No
8. Authentication Type: Simple
9. Rest you can leave it as default.

 Save this screen. Then use the same name e.g “test_hdfs” in your
 install.properties for enabling Ranger in HDFS. Then restart namenode.

  Is the plugin request showing up in the Audit-Plugin tab?

  If the plugin is showing up, then that means authorization and auditing
 is already working.

  For configuring policies, we need to configure UserSync. The
 install/configure process is same for all processes. You need to update the
 install.properties with the appropriate values.
 Set  SYNC_SOURCE = ldap
 And check the section Table: LDAP/AD Properties with sample values” for
 reference values.

  Please note that for using LDAP within Hadoop, you need to configure
 Hadoop core-site.xml to use LDAP. You might be already knowing it. Just
 want to make sure.

  Thanks

  Bosco


   From: Aneela Saleem ane...@platalytics.com
 Reply-To: user@ranger.incubator.apache.org 
 user@ranger.incubator.apache.org
 Date: Tuesday, July 28, 2015 at 11:13 AM

 To: user@ranger.incubator.apache.org user@ranger.incubator.apache.org
 Subject: Re: Error Setting up Ranger-Admin

   Luckily i have created the service myself. Thanks for your timely help.

  Can you please tell me now what should be the next step. I want to
 explore all the functionality i.e.,

  sync LDAP contacts
 perform authorization etc

 On Tue, Jul 28, 2015 at 11:07 PM, Aneela Saleem ane...@platalytics.com
 wrote:

 There are no errors in NameNode logs.

  Can you please tell me how to create service/repo using Ranger Admin?

 On Tue, Jul 28, 2015 at 10:48 PM, Don Bosco Durai bo...@apache.org
 wrote:

  Yes, this is link I was about to redirect you to.

  Sorry, I might have assumed incorrectly on your initial question.
 ./setup.sh is called only for installing RangerAdmin. Good it seems you
 have made progress on installing RangerAdmin.

  I also assume, your ./enable-hdfs-plugin.sh went through fine.

  Looking into the Apache Ranger document, it seems it doesn’t
 explicitly call out to create a repo/service for HDFS in RangerAdmin. In
 the install.properties for HDFS, what value have you given for the property
 “REPOSITORY_NAME”? You need to create a service/repo in RangerAdmin
 with the same name.

  Also, after you restart HDFS namenode, can you check the namenode logs
 for any error?

  Thanks

  Bosco


   From: Aneela Saleem ane...@platalytics.com
 Reply-To: user@ranger.incubator.apache.org 
 user@ranger.incubator.apache.org
 Date: Tuesday, July 28, 2015 at 10:16 AM

 To: user@ranger.incubator.apache.org user@ranger.incubator.apache.org
 
 Subject: Re: Error Setting up Ranger-Admin

   And i'm using following link for installation:


 https://cwiki.apache.org/confluence/display/RANGER/Apache+Ranger+0.5.0+Installation

  I'm upto *Enabling Ranger HDFS Plugins *section (e)

- You can verify by logging into the Ranger Admin Web interface 
Audit  Agents.
-

You can verify the plugin is communicating to Ranger admin in
Audit-plugins tab


  where i don't see any audits ensuring hdfs plugin is communicating to
 Ranger Admin.

 On Tue, Jul 28, 2015 at 10:11 PM, Aneela Saleem ane...@platalytics.com
 wrote:

 I'm planning to secure HDFS and i'm using Knox for authentication using
 REST API.

  Yes i'm still able to access the RangerAdmin UI. I'm just curious how
 to sync LDAP contacts in APache Ranger.

  Secondly if the document is related to 0.4 and i'm linked with 0.5,
 then how should i proceed? Do you have any fruitful link, i should follow?
 (being a novice)

 On Tue, Jul 28, 2015 at 10:04 PM, Don Bosco Durai bo...@apache.org
 wrote:

  Aneela

  The document you linked is for Apache Ranger 0.4. There subtle
 changes in Apache Ranger 0.5.

  Just curious, how you were able to access RangerAdmin UI? Did the
 installation continued after the install failure?

  Also, can you give additional information of your env? I can try
 reproducing it.

  Also, which components are you planning secure? (HDFS, Hive, Hbase,
 Solr, YARN

Re: Error Setting up Ranger-Admin

Yes, this is link I was about to redirect you to.

Sorry, I might have assumed incorrectly on your initial question. ./setup.sh
is called only for installing RangerAdmin. Good it seems you have made
progress on installing RangerAdmin.

I also assume, your ./enable-hdfs-plugin.sh went through fine.

Looking into the Apache Ranger document, it seems it doesn’t explicitly call
out to create a repo/service for HDFS in RangerAdmin. In the
install.properties for HDFS, what value have you given for the property
“REPOSITORY_NAME”? You need to create a service/repo in RangerAdmin with the
same name.

Also, after you restart HDFS namenode, can you check the namenode logs for
any error?

Thanks

Bosco


From:  Aneela Saleem ane...@platalytics.com
Reply-To:  user@ranger.incubator.apache.org
user@ranger.incubator.apache.org
Date:  Tuesday, July 28, 2015 at 10:16 AM
To:  user@ranger.incubator.apache.org user@ranger.incubator.apache.org
Subject:  Re: Error Setting up Ranger-Admin

 And i'm using following link for installation:
 
 https://cwiki.apache.org/confluence/display/RANGER/Apache+Ranger+0.5.0+Install
 ation
 
 I'm upto Enabling Ranger HDFS Plugins section (e)
 * You can verify by logging into the Ranger Admin Web interface  Audit 
 Agents.
 * You can verify the plugin is communicating to Ranger admin in
 Audit-plugins tab
 
 
 where i don't see any audits ensuring hdfs plugin is communicating to Ranger
 Admin. 
 
 On Tue, Jul 28, 2015 at 10:11 PM, Aneela Saleem ane...@platalytics.com
 wrote:
 I'm planning to secure HDFS and i'm using Knox for authentication using REST
 API. 
 
 Yes i'm still able to access the RangerAdmin UI. I'm just curious how to sync
 LDAP contacts in APache Ranger.
 
 Secondly if the document is related to 0.4 and i'm linked with 0.5, then how
 should i proceed? Do you have any fruitful link, i should follow? (being a
 novice)
 
 On Tue, Jul 28, 2015 at 10:04 PM, Don Bosco Durai bo...@apache.org wrote:
 Aneela
 
 The document you linked is for Apache Ranger 0.4. There subtle changes in
 Apache Ranger 0.5.
 
 Just curious, how you were able to access RangerAdmin UI? Did the
 installation continued after the install failure?
 
 Also, can you give additional information of your env? I can try reproducing
 it.
 
 Also, which components are you planning secure? (HDFS, Hive, Hbase, Solr,
 YARN, Storm, etc)
 
 Thanks
 
 Bosco
 
 
 From: Aneela Saleem ane...@platalytics.com
 Reply-To: user@ranger.incubator.apache.org
 user@ranger.incubator.apache.org
 Date: Tuesday, July 28, 2015 at 5:19 AM
 To: user@ranger.incubator.apache.org user@ranger.incubator.apache.org
 Subject: Re: Error Setting up Ranger-Admin
 
 And secondly my Ranger UI does not Match the UI as shown in the following
 link: 
 
 http://pivotalhd.docs.pivotal.io/docs/ranger-user-guide.html#Item1.4.2
 
 There is no Policy Manager Tab and no Manage Repository Thing.
 
 On Tue, Jul 28, 2015 at 5:17 PM, Aneela Saleem ane...@platalytics.com
 wrote:
 Hi Bosco, 
 
 I did as you suggested but still getting same error.
 
 On Tue, Jul 28, 2015 at 4:49 AM, Don Bosco Durai bo...@apache.org wrote:
 The properties file looks good..
 
 I am not sure whether it is because of python 2.7. Is it possible for you
 to use python 2.6?
 
 Try changing the below to where 2.6 is installed.
 
 PYTHON_COMMAND_INVOKER=python
 
 
 Thanks
 
 Bosco
 
 
 From: Aneela Saleem ane...@platalytics.com
 Reply-To: user@ranger.incubator.apache.org
 user@ranger.incubator.apache.org
 Date: Monday, July 27, 2015 at 2:02 PM
 To: user@ranger.incubator.apache.org user@ranger.incubator.apache.org
 Subject: Error Setting up Ranger-Admin
 
 Hi all, 
 
 I have followed this link
 
 https://cwiki.apache.org/confluence/display/RANGER/Apache+Ranger+0.5.0+I
 nstallation
 
 But when i run ./setupsh, i get the following error at the end:
 
 Traceback (most recent call last):
   File update_property.py, line 40, in module
 
 write_properties_to_xml(ranger_admin_site_xml_path,parameter_name,parame
 ter_value)
   File update_property.py, line 21, in write_properties_to_xml
 if(os.path.isfile(xml_path)):
   File /usr/lib/python2.7/genericpath.py, line 29, in isfile
 st = os.stat(path)
 TypeError: coercing to Unicode: need string or buffer, NoneType found
 2015-07-28 01:38:57,308  [E] Update property failed for:
 
 Attached is the install.proprties file.
 
 I'm new to Apache Knox, can anyone please guide me. I'm having troubles
 in installing Apache Ranger.
 
 Thanks

Re: Error Setting up Ranger-Admin

Luckily i have created the service myself. Thanks for your timely help.

Can you please tell me now what should be the next step. I want to explore
all the functionality i.e.,

sync LDAP contacts
perform authorization etc

On Tue, Jul 28, 2015 at 11:07 PM, Aneela Saleem ane...@platalytics.com
wrote:

 There are no errors in NameNode logs.

 Can you please tell me how to create service/repo using Ranger Admin?

 On Tue, Jul 28, 2015 at 10:48 PM, Don Bosco Durai bo...@apache.org
 wrote:

 Yes, this is link I was about to redirect you to.

 Sorry, I might have assumed incorrectly on your initial question.
 ./setup.sh is called only for installing RangerAdmin. Good it seems you
 have made progress on installing RangerAdmin.

 I also assume, your ./enable-hdfs-plugin.sh went through fine.

 Looking into the Apache Ranger document, it seems it doesn’t explicitly
 call out to create a repo/service for HDFS in RangerAdmin. In the
 install.properties for HDFS, what value have you given for the property 
 “REPOSITORY_NAME”?
 You need to create a service/repo in RangerAdmin with the same name.

 Also, after you restart HDFS namenode, can you check the namenode logs
 for any error?

 Thanks

 Bosco


 From: Aneela Saleem ane...@platalytics.com
 Reply-To: user@ranger.incubator.apache.org 
 user@ranger.incubator.apache.org
 Date: Tuesday, July 28, 2015 at 10:16 AM

 To: user@ranger.incubator.apache.org user@ranger.incubator.apache.org
 Subject: Re: Error Setting up Ranger-Admin

 And i'm using following link for installation:


 https://cwiki.apache.org/confluence/display/RANGER/Apache+Ranger+0.5.0+Installation

 I'm upto *Enabling Ranger HDFS Plugins *section (e)

- You can verify by logging into the Ranger Admin Web interface 
Audit  Agents.
-

You can verify the plugin is communicating to Ranger admin in
Audit-plugins tab


 where i don't see any audits ensuring hdfs plugin is communicating to
 Ranger Admin.

 On Tue, Jul 28, 2015 at 10:11 PM, Aneela Saleem ane...@platalytics.com
 wrote:

 I'm planning to secure HDFS and i'm using Knox for authentication using
 REST API.

 Yes i'm still able to access the RangerAdmin UI. I'm just curious how to
 sync LDAP contacts in APache Ranger.

 Secondly if the document is related to 0.4 and i'm linked with 0.5, then
 how should i proceed? Do you have any fruitful link, i should follow?
 (being a novice)

 On Tue, Jul 28, 2015 at 10:04 PM, Don Bosco Durai bo...@apache.org
 wrote:

 Aneela

 The document you linked is for Apache Ranger 0.4. There subtle changes
 in Apache Ranger 0.5.

 Just curious, how you were able to access RangerAdmin UI? Did the
 installation continued after the install failure?

 Also, can you give additional information of your env? I can try
 reproducing it.

 Also, which components are you planning secure? (HDFS, Hive, Hbase,
 Solr, YARN, Storm, etc)

 Thanks

 Bosco


 From: Aneela Saleem ane...@platalytics.com
 Reply-To: user@ranger.incubator.apache.org 
 user@ranger.incubator.apache.org
 Date: Tuesday, July 28, 2015 at 5:19 AM
 To: user@ranger.incubator.apache.org 
 user@ranger.incubator.apache.org
 Subject: Re: Error Setting up Ranger-Admin

 And secondly my Ranger UI does not Match the UI as shown in the
 following link:

 http://pivotalhd.docs.pivotal.io/docs/ranger-user-guide.html#Item1.4.2

 There is no Policy Manager Tab and no Manage Repository Thing.

 On Tue, Jul 28, 2015 at 5:17 PM, Aneela Saleem ane...@platalytics.com
 wrote:

 Hi Bosco,

 I did as you suggested but still getting same error.

 On Tue, Jul 28, 2015 at 4:49 AM, Don Bosco Durai bo...@apache.org
 wrote:

 The properties file looks good..

 I am not sure whether it is because of python 2.7. Is it possible for
 you to use python 2.6?

 Try changing the below to where 2.6 is installed.

 PYTHON_COMMAND_INVOKER=python


 Thanks

 Bosco


 From: Aneela Saleem ane...@platalytics.com
 Reply-To: user@ranger.incubator.apache.org 
 user@ranger.incubator.apache.org
 Date: Monday, July 27, 2015 at 2:02 PM
 To: user@ranger.incubator.apache.org 
 user@ranger.incubator.apache.org
 Subject: Error Setting up Ranger-Admin

 Hi all,

 I have followed this link


 https://cwiki.apache.org/confluence/display/RANGER/Apache+Ranger+0.5.0+Installation

 But when i run *./setupsh, *i get the following error at the end:

 Traceback (most recent call last):
   File update_property.py, line 40, in module

 write_properties_to_xml(ranger_admin_site_xml_path,parameter_name,parameter_value)
   File update_property.py, line 21, in write_properties_to_xml
 if(os.path.isfile(xml_path)):
   File /usr/lib/python2.7/genericpath.py, line 29, in isfile
 st = os.stat(path)
 TypeError: coercing to Unicode: need string or buffer, NoneType found
 2015-07-28 01:38:57,308  [E] Update property failed for:

 Attached is the *install.proprties* file.

 I'm new to Apache Knox, can anyone please guide me. I'm having
 troubles in installing Apache Ranger.

 Thanks

Re: Error Setting up Ranger-Admin

Good. I already typed it, so let me paste it for the benefit of others. We need 
to update the doc also. If you don’t mind, can you create a JIRA to track this?

  1.  Go to RangerAdmin UI - AccessManager (first menu tab is already opened 
by default)
  2.  Click on “+” in the HDFS panel title
  3.  Enter Service Name: e.g. “${cluster_name}_hdfs. Cluster name could be 
anything. You can call the repo “test_hdfs” if you want to
  4.  UserName: ranger  (doesn’t matter whether it exists because you are not 
using kerberos)
  5.  Password: ranger (doesn’t matter what you give)
  6.  Namenode URL: hdfs://namenode_host:8020
  7.  Authorization Enabled: No
  8.  Authentication Type: Simple
  9.  Rest you can leave it as default.

Save this screen. Then use the same name e.g “test_hdfs” in your 
install.properties for enabling Ranger in HDFS. Then restart namenode.

Is the plugin request showing up in the Audit-Plugin tab?

If the plugin is showing up, then that means authorization and auditing is 
already working.

For configuring policies, we need to configure UserSync. The install/configure 
process is same for all processes. You need to update the install.properties 
with the appropriate values.
Set  SYNC_SOURCE = ldap
And check the section Table: LDAP/AD Properties with sample values” for 
reference values.

Please note that for using LDAP within Hadoop, you need to configure Hadoop 
core-site.xml to use LDAP. You might be already knowing it. Just want to make 
sure.

Thanks

Bosco


From: Aneela Saleem ane...@platalytics.commailto:ane...@platalytics.com
Reply-To: 
user@ranger.incubator.apache.orgmailto:user@ranger.incubator.apache.org 
user@ranger.incubator.apache.orgmailto:user@ranger.incubator.apache.org
Date: Tuesday, July 28, 2015 at 11:13 AM
To: user@ranger.incubator.apache.orgmailto:user@ranger.incubator.apache.org 
user@ranger.incubator.apache.orgmailto:user@ranger.incubator.apache.org
Subject: Re: Error Setting up Ranger-Admin

Luckily i have created the service myself. Thanks for your timely help.

Can you please tell me now what should be the next step. I want to explore all 
the functionality i.e.,

sync LDAP contacts
perform authorization etc

On Tue, Jul 28, 2015 at 11:07 PM, Aneela Saleem 
ane...@platalytics.commailto:ane...@platalytics.com wrote:
There are no errors in NameNode logs.

Can you please tell me how to create service/repo using Ranger Admin?

On Tue, Jul 28, 2015 at 10:48 PM, Don Bosco Durai 
bo...@apache.orgmailto:bo...@apache.org wrote:
Yes, this is link I was about to redirect you to.

Sorry, I might have assumed incorrectly on your initial question. ./setup.sh is 
called only for installing RangerAdmin. Good it seems you have made progress on 
installing RangerAdmin.

I also assume, your ./enable-hdfs-plugin.sh went through fine.

Looking into the Apache Ranger document, it seems it doesn’t explicitly call 
out to create a repo/service for HDFS in RangerAdmin. In the install.properties 
for HDFS, what value have you given for the property “REPOSITORY_NAME”? You 
need to create a service/repo in RangerAdmin with the same name.

Also, after you restart HDFS namenode, can you check the namenode logs for any 
error?

Thanks

Bosco


From: Aneela Saleem ane...@platalytics.commailto:ane...@platalytics.com
Reply-To: 
user@ranger.incubator.apache.orgmailto:user@ranger.incubator.apache.org 
user@ranger.incubator.apache.orgmailto:user@ranger.incubator.apache.org
Date: Tuesday, July 28, 2015 at 10:16 AM

To: user@ranger.incubator.apache.orgmailto:user@ranger.incubator.apache.org 
user@ranger.incubator.apache.orgmailto:user@ranger.incubator.apache.org
Subject: Re: Error Setting up Ranger-Admin

And i'm using following link for installation:

https://cwiki.apache.org/confluence/display/RANGER/Apache+Ranger+0.5.0+Installation

I'm upto Enabling Ranger HDFS Plugins section (e)

  *   You can verify by logging into the Ranger Admin Web interface  Audit  
Agents.
  *   You can verify the plugin is communicating to Ranger admin in 
Audit-plugins tab

where i don't see any audits ensuring hdfs plugin is communicating to Ranger 
Admin.

On Tue, Jul 28, 2015 at 10:11 PM, Aneela Saleem 
ane...@platalytics.commailto:ane...@platalytics.com wrote:
I'm planning to secure HDFS and i'm using Knox for authentication using REST 
API.

Yes i'm still able to access the RangerAdmin UI. I'm just curious how to sync 
LDAP contacts in APache Ranger.

Secondly if the document is related to 0.4 and i'm linked with 0.5, then how 
should i proceed? Do you have any fruitful link, i should follow? (being a 
novice)

On Tue, Jul 28, 2015 at 10:04 PM, Don Bosco Durai 
bo...@apache.orgmailto:bo...@apache.org wrote:
Aneela

The document you linked is for Apache Ranger 0.4. There subtle changes in 
Apache Ranger 0.5.

Just curious, how you were able to access RangerAdmin UI? Did the installation 
continued after the install failure?

Also, can you give additional information of your env? I can try reproducing it.

Also

Re: Error Setting up Ranger-Admin

There are no errors in NameNode logs.

Can you please tell me how to create service/repo using Ranger Admin?

On Tue, Jul 28, 2015 at 10:48 PM, Don Bosco Durai bo...@apache.org wrote:

 Yes, this is link I was about to redirect you to.

 Sorry, I might have assumed incorrectly on your initial question.
 ./setup.sh is called only for installing RangerAdmin. Good it seems you
 have made progress on installing RangerAdmin.

 I also assume, your ./enable-hdfs-plugin.sh went through fine.

 Looking into the Apache Ranger document, it seems it doesn’t explicitly
 call out to create a repo/service for HDFS in RangerAdmin. In the
 install.properties for HDFS, what value have you given for the property 
 “REPOSITORY_NAME”?
 You need to create a service/repo in RangerAdmin with the same name.

 Also, after you restart HDFS namenode, can you check the namenode logs for
 any error?

 Thanks

 Bosco


 From: Aneela Saleem ane...@platalytics.com
 Reply-To: user@ranger.incubator.apache.org 
 user@ranger.incubator.apache.org
 Date: Tuesday, July 28, 2015 at 10:16 AM

 To: user@ranger.incubator.apache.org user@ranger.incubator.apache.org
 Subject: Re: Error Setting up Ranger-Admin

 And i'm using following link for installation:


 https://cwiki.apache.org/confluence/display/RANGER/Apache+Ranger+0.5.0+Installation

 I'm upto *Enabling Ranger HDFS Plugins *section (e)

- You can verify by logging into the Ranger Admin Web interface 
Audit  Agents.
-

You can verify the plugin is communicating to Ranger admin in
Audit-plugins tab


 where i don't see any audits ensuring hdfs plugin is communicating to
 Ranger Admin.

 On Tue, Jul 28, 2015 at 10:11 PM, Aneela Saleem ane...@platalytics.com
 wrote:

 I'm planning to secure HDFS and i'm using Knox for authentication using
 REST API.

 Yes i'm still able to access the RangerAdmin UI. I'm just curious how to
 sync LDAP contacts in APache Ranger.

 Secondly if the document is related to 0.4 and i'm linked with 0.5, then
 how should i proceed? Do you have any fruitful link, i should follow?
 (being a novice)

 On Tue, Jul 28, 2015 at 10:04 PM, Don Bosco Durai bo...@apache.org
 wrote:

 Aneela

 The document you linked is for Apache Ranger 0.4. There subtle changes
 in Apache Ranger 0.5.

 Just curious, how you were able to access RangerAdmin UI? Did the
 installation continued after the install failure?

 Also, can you give additional information of your env? I can try
 reproducing it.

 Also, which components are you planning secure? (HDFS, Hive, Hbase,
 Solr, YARN, Storm, etc)

 Thanks

 Bosco


 From: Aneela Saleem ane...@platalytics.com
 Reply-To: user@ranger.incubator.apache.org 
 user@ranger.incubator.apache.org
 Date: Tuesday, July 28, 2015 at 5:19 AM
 To: user@ranger.incubator.apache.org user@ranger.incubator.apache.org
 
 Subject: Re: Error Setting up Ranger-Admin

 And secondly my Ranger UI does not Match the UI as shown in the
 following link:

 http://pivotalhd.docs.pivotal.io/docs/ranger-user-guide.html#Item1.4.2

 There is no Policy Manager Tab and no Manage Repository Thing.

 On Tue, Jul 28, 2015 at 5:17 PM, Aneela Saleem ane...@platalytics.com
 wrote:

 Hi Bosco,

 I did as you suggested but still getting same error.

 On Tue, Jul 28, 2015 at 4:49 AM, Don Bosco Durai bo...@apache.org
 wrote:

 The properties file looks good..

 I am not sure whether it is because of python 2.7. Is it possible for
 you to use python 2.6?

 Try changing the below to where 2.6 is installed.

 PYTHON_COMMAND_INVOKER=python


 Thanks

 Bosco


 From: Aneela Saleem ane...@platalytics.com
 Reply-To: user@ranger.incubator.apache.org 
 user@ranger.incubator.apache.org
 Date: Monday, July 27, 2015 at 2:02 PM
 To: user@ranger.incubator.apache.org 
 user@ranger.incubator.apache.org
 Subject: Error Setting up Ranger-Admin

 Hi all,

 I have followed this link


 https://cwiki.apache.org/confluence/display/RANGER/Apache+Ranger+0.5.0+Installation

 But when i run *./setupsh, *i get the following error at the end:

 Traceback (most recent call last):
   File update_property.py, line 40, in module

 write_properties_to_xml(ranger_admin_site_xml_path,parameter_name,parameter_value)
   File update_property.py, line 21, in write_properties_to_xml
 if(os.path.isfile(xml_path)):
   File /usr/lib/python2.7/genericpath.py, line 29, in isfile
 st = os.stat(path)
 TypeError: coercing to Unicode: need string or buffer, NoneType found
 2015-07-28 01:38:57,308  [E] Update property failed for:

 Attached is the *install.proprties* file.

 I'm new to Apache Knox, can anyone please guide me. I'm having
 troubles in installing Apache Ranger.

 Thanks

Re: Error Setting up Ranger-Admin

I have seen this issue before in OpenStack environment where the DFS folders
were configured to /tmp/… and they were wiped out after restart.

If it is a test env, you can try formatting. First check dfs.name.dir
property in HDFS.
% $HADOOP_INSTALL/hadoop/bin/hadoop namenode -format


http://wiki.apache.org/hadoop/GettingStartedWithHadoop
Formatting the Namenode
The first step to starting up your Hadoop installation is formatting the
Hadoop filesystem, which is implemented on top of the local filesystems of
your cluster. You need to do this the first time you set up a Hadoop
installation. Do not format a running Hadoop filesystem, this will cause all
your data to be erased. Before formatting, ensure that the dfs.name.dir
directory exists. If you just used the default, then mkdir -p
/tmp/hadoop-username/dfs/name will create the directory. To format the
filesystem (which simply initializes the directory specified by the
dfs.name.dir variable), run the command:
% $HADOOP_INSTALL/hadoop/bin/hadoop namenode -format

If asked to [re]format, you must reply Y (not just y) if you want to
reformat, else Hadoop will abort the format.


Thanks

Bosco

From:  Aneela Saleem ane...@platalytics.com
Reply-To:  user@ranger.incubator.apache.org
user@ranger.incubator.apache.org
Date:  Tuesday, July 28, 2015 at 12:40 PM
To:  user@ranger.incubator.apache.org user@ranger.incubator.apache.org
Subject:  Re: Error Setting up Ranger-Admin

 NameNode error Logs:
 
 2015-06-30 00:30:05,933 FATAL org.apache.hadoop.hdfs.server.namenode.NameNode:
 Failed to start namenode.
 java.io.IOException: NameNode is not formatted.
 
 On Wed, Jul 29, 2015 at 12:22 AM, Don Bosco Durai bo...@apache.org wrote:
 Anything in the namenode log file?
 
 Thanks
 
 Bosco
 
 From: Aneela Saleem ane...@platalytics.com
 Reply-To: user@ranger.incubator.apache.org
 user@ranger.incubator.apache.org
 Date: Tuesday, July 28, 2015 at 12:18 PM
 To: user@ranger.incubator.apache.org user@ranger.incubator.apache.org
 Subject: Re: Error Setting up Ranger-Admin
 
 Hdfs Plugin request is not being shown in Audit  Plugins tab. I followed
 all steps and verified with your steps. Restarted namenode but still can't
 see any plugin request
 
 On Wed, Jul 29, 2015 at 12:03 AM, Aneela Saleem ane...@platalytics.com
 wrote:
 Thank you so much Bosco. I created JIRA for this. Can be found here
 https://issues.apache.org/jira/browse/RANGER-582
 
 Let me try UserSync, then i will approach yyou in case of any problem.
 
 On Tue, Jul 28, 2015 at 11:28 PM, Don Bosco Durai bdu...@hortonworks.com
 wrote:
 Good. I already typed it, so let me paste it for the benefit of others. We
 need to update the doc also. If you don’t mind, can you create a JIRA to
 track this?
 1. Go to RangerAdmin UI - AccessManager (first menu tab is already opened
 by default)
 2. Click on “+” in the HDFS panel title
 3. Enter Service Name: e.g. “${cluster_name}_hdfs. Cluster name could be
 anything. You can call the repo “test_hdfs” if you want to
 4. UserName: ranger  (doesn’t matter whether it exists because you are not
 using kerberos)
 5. Password: ranger (doesn’t matter what you give)
 6. Namenode URL: hdfs://namenode_host:8020
 7. Authorization Enabled: No
 8. Authentication Type: Simple
 9. Rest you can leave it as default.
 Save this screen. Then use the same name e.g “test_hdfs” in your
 install.properties for enabling Ranger in HDFS. Then restart namenode.
 
 Is the plugin request showing up in the Audit-Plugin tab?
 
 If the plugin is showing up, then that means authorization and auditing is
 already working.
 
 For configuring policies, we need to configure UserSync. The
 install/configure process is same for all processes. You need to update
 the install.properties with the appropriate values.
 Set  SYNC_SOURCE = ldap
 And check the section Table: LDAP/AD Properties with sample values” for
 reference values.
 
 Please note that for using LDAP within Hadoop, you need to configure
 Hadoop core-site.xml to use LDAP. You might be already knowing it. Just
 want to make sure.
 
 Thanks
 
 Bosco
 
 
 From: Aneela Saleem ane...@platalytics.com
 Reply-To: user@ranger.incubator.apache.org
 user@ranger.incubator.apache.org
 Date: Tuesday, July 28, 2015 at 11:13 AM
 
 To: user@ranger.incubator.apache.org user@ranger.incubator.apache.org
 Subject: Re: Error Setting up Ranger-Admin
 
 Luckily i have created the service myself. Thanks for your timely help.
 
 Can you please tell me now what should be the next step. I want to
 explore all the functionality i.e.,
 
 sync LDAP contacts
 perform authorization etc
 
 On Tue, Jul 28, 2015 at 11:07 PM, Aneela Saleem ane...@platalytics.com
 wrote:
 There are no errors in NameNode logs.
 
 Can you please tell me how to create service/repo using Ranger Admin?
 
 On Tue, Jul 28, 2015 at 10:48 PM, Don Bosco Durai bo...@apache.org
 wrote:
 Yes, this is link I was about to redirect you to.
 
 Sorry, I might have assumed incorrectly on your initial question.
 ./setup.sh is called

Re: Error Setting up Ranger-Admin

That error has been resolved.

Following is the latest error:

class org.apache.hadoop.hdfs.web.resources.UserProvider
class org.apache.hadoop.hdfs.web.resources.ExceptionHandler
Jul 28, 2015 10:39:46 PM
com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17
AM'
Jul 28, 2015 10:39:51 PM com.sun.jersey.spi.inject.Errors
processErrorMessages
WARNING: The following warnings have been detected with resource and/or
provider classes:
WARNING: A sub-resource method, public javax.ws.rs.core.Response
org.apache.hadoop.hdfs.server.namenode.web.resources.NamenodeWebHdfsMethods.getRoot(org.apache.hadoop.security.UserGroupInformation,org.apache.hadoop.hdfs.web.resources.DelegationParam,org.apache.hadoop.hdfs.web.resources.UserParam,org.apache.hadoop.hdfs.web.resources.DoAsParam,org.apache.hadoop.hdfs.web.resources.GetOpParam,org.apache.hadoop.hdfs.web.resources.OffsetParam,org.apache.hadoop.hdfs.web.resources.LengthParam,org.apache.hadoop.hdfs.web.resources.RenewerParam,org.apache.hadoop.hdfs.web.resources.BufferSizeParam,java.util.List,org.apache.hadoop.hdfs.web.resources.XAttrEncodingParam,org.apache.hadoop.hdfs.web.resources.ExcludeDatanodesParam,org.apache.hadoop.hdfs.web.resources.FsActionParam,org.apache.hadoop.hdfs.web.resources.TokenKindParam,org.apache.hadoop.hdfs.web.resources.TokenServiceParam)
throws java.io.IOException,java.lang.InterruptedException, with URI
template, /, is treated as a resource method

On Wed, Jul 29, 2015 at 12:50 AM, Don Bosco Durai bo...@apache.org wrote:

I have seen this issue before in OpenStack environment where the DFS
folders were configured to /tmp/… and they were wiped out after restart.

If it is a test env, you can try formatting. First check dfs.name.dir
property in HDFS.

% $HADOOP_INSTALL/hadoop/bin/hadoop namenode -format

http://wiki.apache.org/hadoop/GettingStartedWithHadoop
Formatting the Namenode

The first step to starting up your Hadoop installation is formatting the
Hadoop filesystem, which is implemented on top of the local filesystems of
your cluster. You need to do this the first time you set up a Hadoop
installation. *Do not* format a running Hadoop filesystem, this will
cause all your data to be erased. Before formatting, ensure that the
dfs.name.dir directory exists. If you just used the default, then
mkdir -p /tmp/hadoop-username/dfs/name will create the directory. To
format the filesystem (which simply initializes the directory specified by
the dfs.name.dir variable), run the command:
% $HADOOP_INSTALL/hadoop/bin/hadoop namenode -format

If asked to [re]format, you must reply Y (not just y) if you want to
reformat, else Hadoop will abort the format.

Thanks

Bosco

From: Aneela Saleem ane...@platalytics.com
Reply-To: user@ranger.incubator.apache.org
user@ranger.incubator.apache.org
Date: Tuesday, July 28, 2015 at 12:40 PM

To: user@ranger.incubator.apache.org user@ranger.incubator.apache.org
Subject: Re: Error Setting up Ranger-Admin

NameNode error Logs:

2015-06-30 00:30:05,933 FATAL
org.apache.hadoop.hdfs.server.namenode.NameNode: Failed to start namenode.
java.io.IOException: NameNode is not formatted.

On Wed, Jul 29, 2015 at 12:22 AM, Don Bosco Durai bo...@apache.org
wrote:

Anything in the namenode log file?

Thanks

Bosco

From: Aneela Saleem ane...@platalytics.com
Reply-To: user@ranger.incubator.apache.org
user@ranger.incubator.apache.org
Date: Tuesday, July 28, 2015 at 12:18 PM
To: user@ranger.incubator.apache.org user@ranger.incubator.apache.org
Subject: Re: Error Setting up Ranger-Admin

Hdfs Plugin request is not being shown in Audit Plugins tab. I followed
all steps and verified with your steps. Restarted namenode but still can't
see any plugin request

On Wed, Jul 29, 2015 at 12:03 AM, Aneela Saleem ane...@platalytics.com
wrote:

Thank you so much Bosco. I created JIRA for this. Can be found here
https://issues.apache.org/jira/browse/RANGER-582

Let me try UserSync, then i will approach yyou in case of any problem.

On Tue, Jul 28, 2015 at 11:28 PM, Don Bosco Durai
bdu...@hortonworks.com wrote:

Good. I already typed it, so let me paste it for the benefit of others.
We need to update the doc also. If you don’t mind, can you create a JIRA to
track this?

1. Go to RangerAdmin UI - AccessManager (first menu tab is already
opened by default)
2. Click on “+” in the HDFS panel title
3. Enter Service Name: e.g. “${cluster_name}_hdfs. Cluster name
could be anything. You can call the repo “test_hdfs” if you want to
4. UserName: ranger (doesn’t matter whether it exists because you
are not using kerberos)
5. Password: ranger (doesn’t matter what you give)
6. Namenode URL: hdfs://namenode_host:8020
7. Authorization Enabled: No
8. Authentication Type: Simple
9. Rest you can leave it as default.

Save this screen. Then use the same name e.g “test_hdfs

Re: Error Setting up Ranger-Admin

Did the original startup issue get resolved?

Your errors seems to be coming from WebHDFS. Can we check whether  “hdfs dfs
-ls /“ works from command line?

Thanks

Bosco


From:  Aneela Saleem ane...@platalytics.com
Reply-To:  user@ranger.incubator.apache.org
user@ranger.incubator.apache.org
Date:  Tuesday, July 28, 2015 at 1:05 PM
To:  user@ranger.incubator.apache.org user@ranger.incubator.apache.org
Subject:  Re: Error Setting up Ranger-Admin

 That error has been resolved.
 
 Following is the latest error:
 
  class org.apache.hadoop.hdfs.web.resources.UserProvider
   class org.apache.hadoop.hdfs.web.resources.ExceptionHandler
 Jul 28, 2015 10:39:46 PM
 com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
 INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
 Jul 28, 2015 10:39:51 PM com.sun.jersey.spi.inject.Errors processErrorMessages
 WARNING: The following warnings have been detected with resource and/or
 provider classes:
   WARNING: A sub-resource method, public javax.ws.rs.core.Response
 org.apache.hadoop.hdfs.server.namenode.web.resources.NamenodeWebHdfsMethods.ge
 tRoot(org.apache.hadoop.security.UserGroupInformation,org.apache.hadoop.hdfs.w
 eb.resources.DelegationParam,org.apache.hadoop.hdfs.web.resources.UserParam,or
 g.apache.hadoop.hdfs.web.resources.DoAsParam,org.apache.hadoop.hdfs.web.resour
 ces.GetOpParam,org.apache.hadoop.hdfs.web.resources.OffsetParam,org.apache.had
 oop.hdfs.web.resources.LengthParam,org.apache.hadoop.hdfs.web.resources.Renewe
 rParam,org.apache.hadoop.hdfs.web.resources.BufferSizeParam,java.util.List,org
 .apache.hadoop.hdfs.web.resources.XAttrEncodingParam,org.apache.hadoop.hdfs.we
 b.resources.ExcludeDatanodesParam,org.apache.hadoop.hdfs.web.resources.FsActio
 nParam,org.apache.hadoop.hdfs.web.resources.TokenKindParam,org.apache.hadoop.h
 dfs.web.resources.TokenServiceParam) throws
 java.io.IOException,java.lang.InterruptedException, with URI template, /, is
 treated as a resource method
 
 
 
 On Wed, Jul 29, 2015 at 12:50 AM, Don Bosco Durai bo...@apache.org wrote:
 I have seen this issue before in OpenStack environment where the DFS folders
 were configured to /tmp/… and they were wiped out after restart.
 
 If it is a test env, you can try formatting. First check dfs.name.dir
 property in HDFS.
 % $HADOOP_INSTALL/hadoop/bin/hadoop namenode -format
 
 
 http://wiki.apache.org/hadoop/GettingStartedWithHadoop
 Formatting the Namenode
 The first step to starting up your Hadoop installation is formatting the
 Hadoop filesystem, which is implemented on top of the local filesystems of
 your cluster. You need to do this the first time you set up a Hadoop
 installation. Do not format a running Hadoop filesystem, this will cause all
 your data to be erased. Before formatting, ensure that the dfs.name.dir
 directory exists. If you just used the default, then mkdir -p
 /tmp/hadoop-username/dfs/name will create the directory. To format the
 filesystem (which simply initializes the directory specified by the
 dfs.name.dir variable), run the command:
 % $HADOOP_INSTALL/hadoop/bin/hadoop namenode -format
 
 If asked to [re]format, you must reply Y (not just y) if you want to
 reformat, else Hadoop will abort the format.
 
 
 Thanks
 
 Bosco
 
 From: Aneela Saleem ane...@platalytics.com
 Reply-To: user@ranger.incubator.apache.org
 user@ranger.incubator.apache.org
 Date: Tuesday, July 28, 2015 at 12:40 PM
 
 To: user@ranger.incubator.apache.org user@ranger.incubator.apache.org
 Subject: Re: Error Setting up Ranger-Admin
 
 NameNode error Logs:
 
 2015-06-30 00:30:05,933 FATAL
 org.apache.hadoop.hdfs.server.namenode.NameNode: Failed to start namenode.
 java.io.IOException: NameNode is not formatted.
 
 On Wed, Jul 29, 2015 at 12:22 AM, Don Bosco Durai bo...@apache.org wrote:
 Anything in the namenode log file?
 
 Thanks
 
 Bosco
 
 From: Aneela Saleem ane...@platalytics.com
 Reply-To: user@ranger.incubator.apache.org
 user@ranger.incubator.apache.org
 Date: Tuesday, July 28, 2015 at 12:18 PM
 To: user@ranger.incubator.apache.org user@ranger.incubator.apache.org
 Subject: Re: Error Setting up Ranger-Admin
 
 Hdfs Plugin request is not being shown in Audit  Plugins tab. I followed
 all steps and verified with your steps. Restarted namenode but still can't
 see any plugin request
 
 On Wed, Jul 29, 2015 at 12:03 AM, Aneela Saleem ane...@platalytics.com
 wrote:
 Thank you so much Bosco. I created JIRA for this. Can be found here
 https://issues.apache.org/jira/browse/RANGER-582
 
 Let me try UserSync, then i will approach yyou in case of any problem.
 
 On Tue, Jul 28, 2015 at 11:28 PM, Don Bosco Durai
 bdu...@hortonworks.com wrote:
 Good. I already typed it, so let me paste it for the benefit of others.
 We need to update the doc also. If you don’t mind, can you create a JIRA
 to track this?
 1. Go to RangerAdmin UI - AccessManager (first menu tab is already
 opened by default)
 2. Click on “+” in the HDFS panel title
 3. Enter Service

Re: Error Setting up Ranger-Admin

Anything in the namenode log file?

Thanks

Bosco

From:  Aneela Saleem ane...@platalytics.com
Reply-To:  user@ranger.incubator.apache.org
user@ranger.incubator.apache.org
Date:  Tuesday, July 28, 2015 at 12:18 PM
To:  user@ranger.incubator.apache.org user@ranger.incubator.apache.org
Subject:  Re: Error Setting up Ranger-Admin

 Hdfs Plugin request is not being shown in Audit  Plugins tab. I followed all
 steps and verified with your steps. Restarted namenode but still can't see any
 plugin request

 On Wed, Jul 29, 2015 at 12:03 AM, Aneela Saleem ane...@platalytics.com
 wrote:
 Thank you so much Bosco. I created JIRA for this. Can be found here
 https://issues.apache.org/jira/browse/RANGER-582

 Let me try UserSync, then i will approach yyou in case of any problem.

 On Tue, Jul 28, 2015 at 11:28 PM, Don Bosco Durai bdu...@hortonworks.com
 wrote:
 Good. I already typed it, so let me paste it for the benefit of others. We
 need to update the doc also. If you don’t mind, can you create a JIRA to
 track this?
 1. Go to RangerAdmin UI - AccessManager (first menu tab is already opened
 by default)
 2. Click on “+” in the HDFS panel title
 3. Enter Service Name: e.g. “${cluster_name}_hdfs. Cluster name could be
 anything. You can call the repo “test_hdfs” if you want to
 4. UserName: ranger  (doesn’t matter whether it exists because you are not
 using kerberos)
 5. Password: ranger (doesn’t matter what you give)
 6. Namenode URL: hdfs://namenode_host:8020
 7. Authorization Enabled: No
 8. Authentication Type: Simple
 9. Rest you can leave it as default.
 Save this screen. Then use the same name e.g “test_hdfs” in your
 install.properties for enabling Ranger in HDFS. Then restart namenode.

 Is the plugin request showing up in the Audit-Plugin tab?

 If the plugin is showing up, then that means authorization and auditing is
 already working.

 For configuring policies, we need to configure UserSync. The
 install/configure process is same for all processes. You need to update the
 install.properties with the appropriate values.
 Set  SYNC_SOURCE = ldap
 And check the section Table: LDAP/AD Properties with sample values” for
 reference values.

 Please note that for using LDAP within Hadoop, you need to configure Hadoop
 core-site.xml to use LDAP. You might be already knowing it. Just want to
 make sure.

 Thanks

 Bosco

 From: Aneela Saleem ane...@platalytics.com
 Reply-To: user@ranger.incubator.apache.org
 user@ranger.incubator.apache.org
 Date: Tuesday, July 28, 2015 at 11:13 AM

 To: user@ranger.incubator.apache.org user@ranger.incubator.apache.org
 Subject: Re: Error Setting up Ranger-Admin

 Luckily i have created the service myself. Thanks for your timely help.

 Can you please tell me now what should be the next step. I want to explore
 all the functionality i.e.,

 sync LDAP contacts
 perform authorization etc

 On Tue, Jul 28, 2015 at 11:07 PM, Aneela Saleem ane...@platalytics.com
 wrote:
 There are no errors in NameNode logs.

 Can you please tell me how to create service/repo using Ranger Admin?

 On Tue, Jul 28, 2015 at 10:48 PM, Don Bosco Durai bo...@apache.org
 wrote:
 Yes, this is link I was about to redirect you to.

 Sorry, I might have assumed incorrectly on your initial question.
 ./setup.sh is called only for installing RangerAdmin. Good it seems you
 have made progress on installing RangerAdmin.

 I also assume, your ./enable-hdfs-plugin.sh went through fine.

 Looking into the Apache Ranger document, it seems it doesn’t explicitly
 call out to create a repo/service for HDFS in RangerAdmin. In the
 install.properties for HDFS, what value have you given for the property
 “REPOSITORY_NAME”? You need to create a service/repo in RangerAdmin with
 the same name.

 Also, after you restart HDFS namenode, can you check the namenode logs
 for any error?

 Thanks

 Bosco

 From: Aneela Saleem ane...@platalytics.com
 Reply-To: user@ranger.incubator.apache.org
 user@ranger.incubator.apache.org
 Date: Tuesday, July 28, 2015 at 10:16 AM

 To: user@ranger.incubator.apache.org user@ranger.incubator.apache.org
 Subject: Re: Error Setting up Ranger-Admin

 And i'm using following link for installation:

 https://cwiki.apache.org/confluence/display/RANGER/Apache+Ranger+0.5.0+I
 nstallation

 I'm upto Enabling Ranger HDFS Plugins section (e)
 * You can verify by logging into the Ranger Admin Web interface  Audit
  Agents.
 * You can verify the plugin is communicating to Ranger admin in
 Audit-plugins tab

 where i don't see any audits ensuring hdfs plugin is communicating to
 Ranger Admin.

 On Tue, Jul 28, 2015 at 10:11 PM, Aneela Saleem ane...@platalytics.com
 wrote:
 I'm planning to secure HDFS and i'm using Knox for authentication using
 REST API. 

 Yes i'm still able to access the RangerAdmin UI. I'm just curious how to
 sync LDAP contacts in APache Ranger.

 Secondly if the document is related to 0.4 and i'm linked with 0.5, then
 how should i proceed? Do you have

Re: Error Setting up Ranger-Admin

Yes the command is working

On Wed, Jul 29, 2015 at 1:11 AM, Don Bosco Durai bo...@apache.org wrote:

 Did the original startup issue get resolved?

 Your errors seems to be coming from WebHDFS. Can we check whether  “hdfs
 dfs -ls /“ works from command line?

 Thanks

 Bosco


 From: Aneela Saleem ane...@platalytics.com
 Reply-To: user@ranger.incubator.apache.org 
 user@ranger.incubator.apache.org
 Date: Tuesday, July 28, 2015 at 1:05 PM

 To: user@ranger.incubator.apache.org user@ranger.incubator.apache.org
 Subject: Re: Error Setting up Ranger-Admin

 That error has been resolved.

 Following is the latest error:

  class org.apache.hadoop.hdfs.web.resources.UserProvider
   class org.apache.hadoop.hdfs.web.resources.ExceptionHandler
 Jul 28, 2015 10:39:46 PM
 com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
 INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17
 AM'
 Jul 28, 2015 10:39:51 PM com.sun.jersey.spi.inject.Errors
 processErrorMessages
 WARNING: The following warnings have been detected with resource and/or
 provider classes:
   WARNING: A sub-resource method, public javax.ws.rs.core.Response
 org.apache.hadoop.hdfs.server.namenode.web.resources.NamenodeWebHdfsMethods.getRoot(org.apache.hadoop.security.UserGroupInformation,org.apache.hadoop.hdfs.web.resources.DelegationParam,org.apache.hadoop.hdfs.web.resources.UserParam,org.apache.hadoop.hdfs.web.resources.DoAsParam,org.apache.hadoop.hdfs.web.resources.GetOpParam,org.apache.hadoop.hdfs.web.resources.OffsetParam,org.apache.hadoop.hdfs.web.resources.LengthParam,org.apache.hadoop.hdfs.web.resources.RenewerParam,org.apache.hadoop.hdfs.web.resources.BufferSizeParam,java.util.List,org.apache.hadoop.hdfs.web.resources.XAttrEncodingParam,org.apache.hadoop.hdfs.web.resources.ExcludeDatanodesParam,org.apache.hadoop.hdfs.web.resources.FsActionParam,org.apache.hadoop.hdfs.web.resources.TokenKindParam,org.apache.hadoop.hdfs.web.resources.TokenServiceParam)
 throws java.io.IOException,java.lang.InterruptedException, with URI
 template, /, is treated as a resource method



 On Wed, Jul 29, 2015 at 12:50 AM, Don Bosco Durai bo...@apache.org
 wrote:

 I have seen this issue before in OpenStack environment where the DFS
 folders were configured to /tmp/… and they were wiped out after restart.

 If it is a test env, you can try formatting. First check dfs.name.dir
 property in HDFS.

 % $HADOOP_INSTALL/hadoop/bin/hadoop namenode -format

 http://wiki.apache.org/hadoop/GettingStartedWithHadoop
 Formatting the Namenode

 The first step to starting up your Hadoop installation is formatting the
 Hadoop filesystem, which is implemented on top of the local filesystems of
 your cluster. You need to do this the first time you set up a Hadoop
 installation. *Do not* format a running Hadoop filesystem, this will
 cause all your data to be erased. Before formatting, ensure that the
 dfs.name.dir directory exists. If you just used the default, then
 mkdir -p /tmp/hadoop-username/dfs/name will create the directory. To
 format the filesystem (which simply initializes the directory specified by
 the dfs.name.dir variable), run the command:
 % $HADOOP_INSTALL/hadoop/bin/hadoop namenode -format

 If asked to [re]format, you must reply Y (not just y) if you want to
 reformat, else Hadoop will abort the format.


 Thanks

 Bosco

 From: Aneela Saleem ane...@platalytics.com
 Reply-To: user@ranger.incubator.apache.org 
 user@ranger.incubator.apache.org
 Date: Tuesday, July 28, 2015 at 12:40 PM

 To: user@ranger.incubator.apache.org user@ranger.incubator.apache.org
 Subject: Re: Error Setting up Ranger-Admin

 NameNode error Logs:

 2015-06-30 00:30:05,933 FATAL
 org.apache.hadoop.hdfs.server.namenode.NameNode: Failed to start namenode.
 java.io.IOException: NameNode is not formatted.

 On Wed, Jul 29, 2015 at 12:22 AM, Don Bosco Durai bo...@apache.org
 wrote:

 Anything in the namenode log file?

 Thanks

 Bosco

 From: Aneela Saleem ane...@platalytics.com
 Reply-To: user@ranger.incubator.apache.org 
 user@ranger.incubator.apache.org
 Date: Tuesday, July 28, 2015 at 12:18 PM
 To: user@ranger.incubator.apache.org user@ranger.incubator.apache.org
 
 Subject: Re: Error Setting up Ranger-Admin

 Hdfs Plugin request is not being shown in Audit  Plugins tab. I
 followed all steps and verified with your steps. Restarted namenode but
 still can't see any plugin request

 On Wed, Jul 29, 2015 at 12:03 AM, Aneela Saleem ane...@platalytics.com
 wrote:

 Thank you so much Bosco. I created JIRA for this. Can be found here
 https://issues.apache.org/jira/browse/RANGER-582

 Let me try UserSync, then i will approach yyou in case of any problem.

 On Tue, Jul 28, 2015 at 11:28 PM, Don Bosco Durai 
 bdu...@hortonworks.com wrote:

 Good. I already typed it, so let me paste it for the benefit of
 others. We need to update the doc also. If you don’t mind, can you create 
 a
 JIRA to track this?

1. Go to RangerAdmin UI - AccessManager (first menu tab

Re: Error Setting up Ranger-Admin

This seems to be one of the reason HDFS plugin is not enabled. As what user
have you installed Hadoop?

Thanks

Bosco

From:  Aneela Saleem ane...@platalytics.com
Reply-To:  user@ranger.incubator.apache.org
user@ranger.incubator.apache.org
Date:  Tuesday, July 28, 2015 at 1:31 PM
To:  user@ranger.incubator.apache.org user@ranger.incubator.apache.org
Subject:  Re: Error Setting up Ranger-Admin

 Also when i run ./enable-hdfs-plugin.sh
 
 i get the following at the end:
 
 + بدھ جولاي 29 01:28:20 PKT 2015 : Saving current JCE file:
 /etc/ranger/hadoopdev/cred.jceks to
 /etc/ranger/hadoopdev/.cred.jceks.20150729012820 ...
 chown: invalid user: ‘hdfs:hdfs’
 Ranger Plugin for hadoop has been enabled. Please restart hadoop to ensure
 that changes are effective.

Re: Error Setting up Ranger-Admin

hduser

On Wed, Jul 29, 2015 at 1:51 AM, Don Bosco Durai bo...@apache.org wrote:

 This seems to be one of the reason HDFS plugin is not enabled. As what
 user have you installed Hadoop?

 Thanks

 Bosco

 From: Aneela Saleem ane...@platalytics.com
 Reply-To: user@ranger.incubator.apache.org 
 user@ranger.incubator.apache.org
 Date: Tuesday, July 28, 2015 at 1:31 PM
 To: user@ranger.incubator.apache.org user@ranger.incubator.apache.org
 Subject: Re: Error Setting up Ranger-Admin

 Also when i run *./enable-hdfs-plugin.sh *

 i get the following at the end:

 + بدھ جولاي 29 01:28:20 PKT 2015 : Saving current JCE file:
 /etc/ranger/hadoopdev/cred.jceks to
 /etc/ranger/hadoopdev/.cred.jceks.20150729012820 ...
 *chown: invalid user: ‘hdfs:hdfs’*
 Ranger Plugin for hadoop has been enabled. Please restart hadoop to ensure
 that changes are effective.

Re: Error Setting up Ranger-Admin