Re: Error Setting up Ranger-Admin

[Aneela Saleem]

Hi Bosco,

I did as you suggested but still getting same error.

On Tue, Jul 28, 2015 at 4:49 AM, Don Bosco Durai  wrote:

> The properties file looks good..
>
> I am not sure whether it is because of python 2.7. Is it possible for you
> to use python 2.6?
>
> Try changing the below to where 2.6 is installed.
>
> PYTHON_COMMAND_INVOKER=python
>
>
> Thanks
>
> Bosco
>
>
> From: Aneela Saleem 
> Reply-To: "user@ranger.incubator.apache.org" <
> user@ranger.incubator.apache.org>
> Date: Monday, July 27, 2015 at 2:02 PM
> To: "user@ranger.incubator.apache.org" 
> Subject: Error Setting up Ranger-Admin
>
> Hi all,
>
> I have followed this link
>
>
> https://cwiki.apache.org/confluence/display/RANGER/Apache+Ranger+0.5.0+Installation
>
> But when i run *./setupsh, *i get the following error at the end:
>
> Traceback (most recent call last):
>   File "update_property.py", line 40, in 
>
> write_properties_to_xml(ranger_admin_site_xml_path,parameter_name,parameter_value)
>   File "update_property.py", line 21, in write_properties_to_xml
> if(os.path.isfile(xml_path)):
>   File "/usr/lib/python2.7/genericpath.py", line 29, in isfile
> st = os.stat(path)
> TypeError: coercing to Unicode: need string or buffer, NoneType found
> 2015-07-28 01:38:57,308  [E] Update property failed for:
>
> Attached is the *install.proprties* file.
>
> I'm new to Apache Knox, can anyone please guide me. I'm having troubles in
> installing Apache Ranger.
>
> Thanks
>
>
>

Re: Error Setting up Ranger-Admin

[Aneela Saleem]

And secondly my Ranger UI does not Match the UI as shown in the following
link:

http://pivotalhd.docs.pivotal.io/docs/ranger-user-guide.html#Item1.4.2

There is no Policy Manager Tab and no Manage Repository Thing.

On Tue, Jul 28, 2015 at 5:17 PM, Aneela Saleem 
wrote:

> Hi Bosco,
>
> I did as you suggested but still getting same error.
>
> On Tue, Jul 28, 2015 at 4:49 AM, Don Bosco Durai  wrote:
>
>> The properties file looks good..
>>
>> I am not sure whether it is because of python 2.7. Is it possible for you
>> to use python 2.6?
>>
>> Try changing the below to where 2.6 is installed.
>>
>> PYTHON_COMMAND_INVOKER=python
>>
>>
>> Thanks
>>
>> Bosco
>>
>>
>> From: Aneela Saleem 
>> Reply-To: "user@ranger.incubator.apache.org" <
>> user@ranger.incubator.apache.org>
>> Date: Monday, July 27, 2015 at 2:02 PM
>> To: "user@ranger.incubator.apache.org" 
>> Subject: Error Setting up Ranger-Admin
>>
>> Hi all,
>>
>> I have followed this link
>>
>>
>> https://cwiki.apache.org/confluence/display/RANGER/Apache+Ranger+0.5.0+Installation
>>
>> But when i run *./setupsh, *i get the following error at the end:
>>
>> Traceback (most recent call last):
>>   File "update_property.py", line 40, in 
>>
>> write_properties_to_xml(ranger_admin_site_xml_path,parameter_name,parameter_value)
>>   File "update_property.py", line 21, in write_properties_to_xml
>> if(os.path.isfile(xml_path)):
>>   File "/usr/lib/python2.7/genericpath.py", line 29, in isfile
>> st = os.stat(path)
>> TypeError: coercing to Unicode: need string or buffer, NoneType found
>> 2015-07-28 01:38:57,308  [E] Update property failed for:
>>
>> Attached is the *install.proprties* file.
>>
>> I'm new to Apache Knox, can anyone please guide me. I'm having troubles
>> in installing Apache Ranger.
>>
>> Thanks
>>
>>
>>
>

Re: Error Setting up Ranger-Admin

[Don Bosco Durai]

Aneela

The document you linked is for Apache Ranger 0.4. There subtle changes in
Apache Ranger 0.5. 

Just curious, how you were able to access RangerAdmin UI? Did the
installation continued after the install failure?

Also, can you give additional information of your env? I can try reproducing
it.

Also, which components are you planning secure? (HDFS, Hive, Hbase, Solr,
YARN, Storm, etc)

Thanks

Bosco


From:  Aneela Saleem 
Reply-To:  "user@ranger.incubator.apache.org"

Date:  Tuesday, July 28, 2015 at 5:19 AM
To:  "user@ranger.incubator.apache.org" 
Subject:  Re: Error Setting up Ranger-Admin

> And secondly my Ranger UI does not Match the UI as shown in the following
> link: 
> 
> http://pivotalhd.docs.pivotal.io/docs/ranger-user-guide.html#Item1.4.2
> 
> There is no Policy Manager Tab and no Manage Repository Thing.
> 
> On Tue, Jul 28, 2015 at 5:17 PM, Aneela Saleem  wrote:
>> Hi Bosco, 
>> 
>> I did as you suggested but still getting same error.
>> 
>> On Tue, Jul 28, 2015 at 4:49 AM, Don Bosco Durai  wrote:
>>> The properties file looks good..
>>> 
>>> I am not sure whether it is because of python 2.7. Is it possible for you to
>>> use python 2.6?
>>> 
>>> Try changing the below to where 2.6 is installed.
>>> 
>>> PYTHON_COMMAND_INVOKER=python
>>> 
>>> 
>>> Thanks
>>> 
>>> Bosco
>>> 
>>> 
>>> From: Aneela Saleem 
>>> Reply-To: "user@ranger.incubator.apache.org"
>>> 
>>> Date: Monday, July 27, 2015 at 2:02 PM
>>> To: "user@ranger.incubator.apache.org" 
>>> Subject: Error Setting up Ranger-Admin
>>> 
 Hi all, 
 
 I have followed this link
 
 https://cwiki.apache.org/confluence/display/RANGER/Apache+Ranger+0.5.0+Inst
 allation
 
 But when i run ./setupsh, i get the following error at the end:
 
 Traceback (most recent call last):
   File "update_property.py", line 40, in 
 
 write_properties_to_xml(ranger_admin_site_xml_path,parameter_name,parameter
 _value)
   File "update_property.py", line 21, in write_properties_to_xml
 if(os.path.isfile(xml_path)):
   File "/usr/lib/python2.7/genericpath.py", line 29, in isfile
 st = os.stat(path)
 TypeError: coercing to Unicode: need string or buffer, NoneType found
 2015-07-28 01:38:57,308  [E] Update property failed for:
 
 Attached is the install.proprties file.
 
 I'm new to Apache Knox, can anyone please guide me. I'm having troubles in
 installing Apache Ranger.
 
 Thanks
 
 
>> 
> 

Re: Error Setting up Ranger-Admin

[Aneela Saleem]

I'm planning to secure HDFS and i'm using Knox for authentication using
REST API.

Yes i'm still able to access the RangerAdmin UI. I'm just curious how to
sync LDAP contacts in APache Ranger.

Secondly if the document is related to 0.4 and i'm linked with 0.5, then
how should i proceed? Do you have any fruitful link, i should follow?
(being a novice)

On Tue, Jul 28, 2015 at 10:04 PM, Don Bosco Durai  wrote:

> Aneela
>
> The document you linked is for Apache Ranger 0.4. There subtle changes in
> Apache Ranger 0.5.
>
> Just curious, how you were able to access RangerAdmin UI? Did the
> installation continued after the install failure?
>
> Also, can you give additional information of your env? I can try
> reproducing it.
>
> Also, which components are you planning secure? (HDFS, Hive, Hbase, Solr,
> YARN, Storm, etc)
>
> Thanks
>
> Bosco
>
>
> From: Aneela Saleem 
> Reply-To: "user@ranger.incubator.apache.org" <
> user@ranger.incubator.apache.org>
> Date: Tuesday, July 28, 2015 at 5:19 AM
> To: "user@ranger.incubator.apache.org" 
> Subject: Re: Error Setting up Ranger-Admin
>
> And secondly my Ranger UI does not Match the UI as shown in the following
> link:
>
> http://pivotalhd.docs.pivotal.io/docs/ranger-user-guide.html#Item1.4.2
>
> There is no Policy Manager Tab and no Manage Repository Thing.
>
> On Tue, Jul 28, 2015 at 5:17 PM, Aneela Saleem 
> wrote:
>
>> Hi Bosco,
>>
>> I did as you suggested but still getting same error.
>>
>> On Tue, Jul 28, 2015 at 4:49 AM, Don Bosco Durai 
>> wrote:
>>
>>> The properties file looks good..
>>>
>>> I am not sure whether it is because of python 2.7. Is it possible for
>>> you to use python 2.6?
>>>
>>> Try changing the below to where 2.6 is installed.
>>>
>>> PYTHON_COMMAND_INVOKER=python
>>>
>>>
>>> Thanks
>>>
>>> Bosco
>>>
>>>
>>> From: Aneela Saleem 
>>> Reply-To: "user@ranger.incubator.apache.org" <
>>> user@ranger.incubator.apache.org>
>>> Date: Monday, July 27, 2015 at 2:02 PM
>>> To: "user@ranger.incubator.apache.org" >> >
>>> Subject: Error Setting up Ranger-Admin
>>>
>>> Hi all,
>>>
>>> I have followed this link
>>>
>>>
>>> https://cwiki.apache.org/confluence/display/RANGER/Apache+Ranger+0.5.0+Installation
>>>
>>> But when i run *./setupsh, *i get the following error at the end:
>>>
>>> Traceback (most recent call last):
>>>   File "update_property.py", line 40, in 
>>>
>>> write_properties_to_xml(ranger_admin_site_xml_path,parameter_name,parameter_value)
>>>   File "update_property.py", line 21, in write_properties_to_xml
>>> if(os.path.isfile(xml_path)):
>>>   File "/usr/lib/python2.7/genericpath.py", line 29, in isfile
>>> st = os.stat(path)
>>> TypeError: coercing to Unicode: need string or buffer, NoneType found
>>> 2015-07-28 01:38:57,308  [E] Update property failed for:
>>>
>>> Attached is the *install.proprties* file.
>>>
>>> I'm new to Apache Knox, can anyone please guide me. I'm having troubles
>>> in installing Apache Ranger.
>>>
>>> Thanks
>>>
>>>
>>>
>>
>

Re: Error Setting up Ranger-Admin

[Aneela Saleem]

And i'm using following link for installation:

https://cwiki.apache.org/confluence/display/RANGER/Apache+Ranger+0.5.0+Installation

I'm upto *Enabling Ranger HDFS Plugins *section (e)

   - You can verify by logging into the Ranger Admin Web interface ­> Audit
   > Agents.
   -

   You can verify the plugin is communicating to Ranger admin in
   Audit-­>plugins tab


where i don't see any audits ensuring hdfs plugin is communicating to
Ranger Admin.

On Tue, Jul 28, 2015 at 10:11 PM, Aneela Saleem 
wrote:

> I'm planning to secure HDFS and i'm using Knox for authentication using
> REST API.
>
> Yes i'm still able to access the RangerAdmin UI. I'm just curious how to
> sync LDAP contacts in APache Ranger.
>
> Secondly if the document is related to 0.4 and i'm linked with 0.5, then
> how should i proceed? Do you have any fruitful link, i should follow?
> (being a novice)
>
> On Tue, Jul 28, 2015 at 10:04 PM, Don Bosco Durai 
> wrote:
>
>> Aneela
>>
>> The document you linked is for Apache Ranger 0.4. There subtle changes in
>> Apache Ranger 0.5.
>>
>> Just curious, how you were able to access RangerAdmin UI? Did the
>> installation continued after the install failure?
>>
>> Also, can you give additional information of your env? I can try
>> reproducing it.
>>
>> Also, which components are you planning secure? (HDFS, Hive, Hbase, Solr,
>> YARN, Storm, etc)
>>
>> Thanks
>>
>> Bosco
>>
>>
>> From: Aneela Saleem 
>> Reply-To: "user@ranger.incubator.apache.org" <
>> user@ranger.incubator.apache.org>
>> Date: Tuesday, July 28, 2015 at 5:19 AM
>> To: "user@ranger.incubator.apache.org" 
>> Subject: Re: Error Setting up Ranger-Admin
>>
>> And secondly my Ranger UI does not Match the UI as shown in the following
>> link:
>>
>> http://pivotalhd.docs.pivotal.io/docs/ranger-user-guide.html#Item1.4.2
>>
>> There is no Policy Manager Tab and no Manage Repository Thing.
>>
>> On Tue, Jul 28, 2015 at 5:17 PM, Aneela Saleem 
>> wrote:
>>
>>> Hi Bosco,
>>>
>>> I did as you suggested but still getting same error.
>>>
>>> On Tue, Jul 28, 2015 at 4:49 AM, Don Bosco Durai 
>>> wrote:
>>>
 The properties file looks good..

 I am not sure whether it is because of python 2.7. Is it possible for
 you to use python 2.6?

 Try changing the below to where 2.6 is installed.

 PYTHON_COMMAND_INVOKER=python


 Thanks

 Bosco


 From: Aneela Saleem 
 Reply-To: "user@ranger.incubator.apache.org" <
 user@ranger.incubator.apache.org>
 Date: Monday, July 27, 2015 at 2:02 PM
 To: "user@ranger.incubator.apache.org" <
 user@ranger.incubator.apache.org>
 Subject: Error Setting up Ranger-Admin

 Hi all,

 I have followed this link


 https://cwiki.apache.org/confluence/display/RANGER/Apache+Ranger+0.5.0+Installation

 But when i run *./setupsh, *i get the following error at the end:

 Traceback (most recent call last):
   File "update_property.py", line 40, in 

 write_properties_to_xml(ranger_admin_site_xml_path,parameter_name,parameter_value)
   File "update_property.py", line 21, in write_properties_to_xml
 if(os.path.isfile(xml_path)):
   File "/usr/lib/python2.7/genericpath.py", line 29, in isfile
 st = os.stat(path)
 TypeError: coercing to Unicode: need string or buffer, NoneType found
 2015-07-28 01:38:57,308  [E] Update property failed for:

 Attached is the *install.proprties* file.

 I'm new to Apache Knox, can anyone please guide me. I'm having troubles
 in installing Apache Ranger.

 Thanks



>>>
>>
>

Re: Error Setting up Ranger-Admin

[Don Bosco Durai]

Yes, this is link I was about to redirect you to.

Sorry, I might have assumed incorrectly on your initial question. ./setup.sh
is called only for installing RangerAdmin. Good it seems you have made
progress on installing RangerAdmin.

I also assume, your ./enable-hdfs-plugin.sh went through fine.

Looking into the Apache Ranger document, it seems it doesn’t explicitly call
out to create a repo/service for HDFS in RangerAdmin. In the
install.properties for HDFS, what value have you given for the property
“REPOSITORY_NAME”? You need to create a service/repo in RangerAdmin with the
same name.

Also, after you restart HDFS namenode, can you check the namenode logs for
any error?

Thanks

Bosco


From:  Aneela Saleem 
Reply-To:  "user@ranger.incubator.apache.org"

Date:  Tuesday, July 28, 2015 at 10:16 AM
To:  "user@ranger.incubator.apache.org" 
Subject:  Re: Error Setting up Ranger-Admin

> And i'm using following link for installation:
> 
> https://cwiki.apache.org/confluence/display/RANGER/Apache+Ranger+0.5.0+Install
> ation
> 
> I'm upto Enabling Ranger HDFS Plugins section (e)
> * You can verify by logging into the Ranger Admin Web interface ­> Audit >
> Agents.
> * You can verify the plugin is communicating to Ranger admin in
> Audit-­>plugins tab
> 
> 
> where i don't see any audits ensuring hdfs plugin is communicating to Ranger
> Admin. 
> 
> On Tue, Jul 28, 2015 at 10:11 PM, Aneela Saleem 
> wrote:
>> I'm planning to secure HDFS and i'm using Knox for authentication using REST
>> API. 
>> 
>> Yes i'm still able to access the RangerAdmin UI. I'm just curious how to sync
>> LDAP contacts in APache Ranger.
>> 
>> Secondly if the document is related to 0.4 and i'm linked with 0.5, then how
>> should i proceed? Do you have any fruitful link, i should follow? (being a
>> novice)
>> 
>> On Tue, Jul 28, 2015 at 10:04 PM, Don Bosco Durai  wrote:
>>> Aneela
>>> 
>>> The document you linked is for Apache Ranger 0.4. There subtle changes in
>>> Apache Ranger 0.5.
>>> 
>>> Just curious, how you were able to access RangerAdmin UI? Did the
>>> installation continued after the install failure?
>>> 
>>> Also, can you give additional information of your env? I can try reproducing
>>> it.
>>> 
>>> Also, which components are you planning secure? (HDFS, Hive, Hbase, Solr,
>>> YARN, Storm, etc)
>>> 
>>> Thanks
>>> 
>>> Bosco
>>> 
>>> 
>>> From: Aneela Saleem 
>>> Reply-To: "user@ranger.incubator.apache.org"
>>> 
>>> Date: Tuesday, July 28, 2015 at 5:19 AM
>>> To: "user@ranger.incubator.apache.org" 
>>> Subject: Re: Error Setting up Ranger-Admin
>>> 
 And secondly my Ranger UI does not Match the UI as shown in the following
 link: 
 
 http://pivotalhd.docs.pivotal.io/docs/ranger-user-guide.html#Item1.4.2
 
 There is no Policy Manager Tab and no Manage Repository Thing.
 
 On Tue, Jul 28, 2015 at 5:17 PM, Aneela Saleem 
 wrote:
> Hi Bosco, 
> 
> I did as you suggested but still getting same error.
> 
> On Tue, Jul 28, 2015 at 4:49 AM, Don Bosco Durai  wrote:
>> The properties file looks good..
>> 
>> I am not sure whether it is because of python 2.7. Is it possible for you
>> to use python 2.6?
>> 
>> Try changing the below to where 2.6 is installed.
>> 
>> PYTHON_COMMAND_INVOKER=python
>> 
>> 
>> Thanks
>> 
>> Bosco
>> 
>> 
>> From: Aneela Saleem 
>> Reply-To: "user@ranger.incubator.apache.org"
>> 
>> Date: Monday, July 27, 2015 at 2:02 PM
>> To: "user@ranger.incubator.apache.org" 
>> Subject: Error Setting up Ranger-Admin
>> 
>>> Hi all, 
>>> 
>>> I have followed this link
>>> 
>>> https://cwiki.apache.org/confluence/display/RANGER/Apache+Ranger+0.5.0+I
>>> nstallation
>>> 
>>> But when i run ./setupsh, i get the following error at the end:
>>> 
>>> Traceback (most recent call last):
>>>   File "update_property.py", line 40, in 
>>> 
>>> write_properties_to_xml(ranger_admin_site_xml_path,parameter_name,parame
>>> ter_value)
>>>   File "update_property.py", line 21, in write_properties_to_xml
>>> if(os.path.isfile(xml_path)):
>>>   File "/usr/lib/python2.7/genericpath.py", line 29, in isfile
>>> st = os.stat(path)
>>> TypeError: coercing to Unicode: need string or buffer, NoneType found
>>> 2015-07-28 01:38:57,308  [E] Update property failed for:
>>> 
>>> Attached is the install.proprties file.
>>> 
>>> I'm new to Apache Knox, can anyone please guide me. I'm having troubles
>>> in installing Apache Ranger.
>>> 
>>> Thanks
>>> 
>>> 
> 
 
>> 
> 

Re: Error Setting up Ranger-Admin

[Aneela Saleem]

There are no errors in NameNode logs.

Can you please tell me how to create service/repo using Ranger Admin?

On Tue, Jul 28, 2015 at 10:48 PM, Don Bosco Durai  wrote:

> Yes, this is link I was about to redirect you to.
>
> Sorry, I might have assumed incorrectly on your initial question.
> ./setup.sh is called only for installing RangerAdmin. Good it seems you
> have made progress on installing RangerAdmin.
>
> I also assume, your ./enable-hdfs-plugin.sh went through fine.
>
> Looking into the Apache Ranger document, it seems it doesn’t explicitly
> call out to create a repo/service for HDFS in RangerAdmin. In the
> install.properties for HDFS, what value have you given for the property 
> “REPOSITORY_NAME”?
> You need to create a service/repo in RangerAdmin with the same name.
>
> Also, after you restart HDFS namenode, can you check the namenode logs for
> any error?
>
> Thanks
>
> Bosco
>
>
> From: Aneela Saleem 
> Reply-To: "user@ranger.incubator.apache.org" <
> user@ranger.incubator.apache.org>
> Date: Tuesday, July 28, 2015 at 10:16 AM
>
> To: "user@ranger.incubator.apache.org" 
> Subject: Re: Error Setting up Ranger-Admin
>
> And i'm using following link for installation:
>
>
> https://cwiki.apache.org/confluence/display/RANGER/Apache+Ranger+0.5.0+Installation
>
> I'm upto *Enabling Ranger HDFS Plugins *section (e)
>
>- You can verify by logging into the Ranger Admin Web interface ­>
>Audit > Agents.
>-
>
>You can verify the plugin is communicating to Ranger admin in
>Audit-­>plugins tab
>
>
> where i don't see any audits ensuring hdfs plugin is communicating to
> Ranger Admin.
>
> On Tue, Jul 28, 2015 at 10:11 PM, Aneela Saleem 
> wrote:
>
>> I'm planning to secure HDFS and i'm using Knox for authentication using
>> REST API.
>>
>> Yes i'm still able to access the RangerAdmin UI. I'm just curious how to
>> sync LDAP contacts in APache Ranger.
>>
>> Secondly if the document is related to 0.4 and i'm linked with 0.5, then
>> how should i proceed? Do you have any fruitful link, i should follow?
>> (being a novice)
>>
>> On Tue, Jul 28, 2015 at 10:04 PM, Don Bosco Durai 
>> wrote:
>>
>>> Aneela
>>>
>>> The document you linked is for Apache Ranger 0.4. There subtle changes
>>> in Apache Ranger 0.5.
>>>
>>> Just curious, how you were able to access RangerAdmin UI? Did the
>>> installation continued after the install failure?
>>>
>>> Also, can you give additional information of your env? I can try
>>> reproducing it.
>>>
>>> Also, which components are you planning secure? (HDFS, Hive, Hbase,
>>> Solr, YARN, Storm, etc)
>>>
>>> Thanks
>>>
>>> Bosco
>>>
>>>
>>> From: Aneela Saleem 
>>> Reply-To: "user@ranger.incubator.apache.org" <
>>> user@ranger.incubator.apache.org>
>>> Date: Tuesday, July 28, 2015 at 5:19 AM
>>> To: "user@ranger.incubator.apache.org" >> >
>>> Subject: Re: Error Setting up Ranger-Admin
>>>
>>> And secondly my Ranger UI does not Match the UI as shown in the
>>> following link:
>>>
>>> http://pivotalhd.docs.pivotal.io/docs/ranger-user-guide.html#Item1.4.2
>>>
>>> There is no Policy Manager Tab and no Manage Repository Thing.
>>>
>>> On Tue, Jul 28, 2015 at 5:17 PM, Aneela Saleem 
>>> wrote:
>>>
 Hi Bosco,

 I did as you suggested but still getting same error.

 On Tue, Jul 28, 2015 at 4:49 AM, Don Bosco Durai 
 wrote:

> The properties file looks good..
>
> I am not sure whether it is because of python 2.7. Is it possible for
> you to use python 2.6?
>
> Try changing the below to where 2.6 is installed.
>
> PYTHON_COMMAND_INVOKER=python
>
>
> Thanks
>
> Bosco
>
>
> From: Aneela Saleem 
> Reply-To: "user@ranger.incubator.apache.org" <
> user@ranger.incubator.apache.org>
> Date: Monday, July 27, 2015 at 2:02 PM
> To: "user@ranger.incubator.apache.org" <
> user@ranger.incubator.apache.org>
> Subject: Error Setting up Ranger-Admin
>
> Hi all,
>
> I have followed this link
>
>
> https://cwiki.apache.org/confluence/display/RANGER/Apache+Ranger+0.5.0+Installation
>
> But when i run *./setupsh, *i get the following error at the end:
>
> Traceback (most recent call last):
>   File "update_property.py", line 40, in 
>
> write_properties_to_xml(ranger_admin_site_xml_path,parameter_name,parameter_value)
>   File "update_property.py", line 21, in write_properties_to_xml
> if(os.path.isfile(xml_path)):
>   File "/usr/lib/python2.7/genericpath.py", line 29, in isfile
> st = os.stat(path)
> TypeError: coercing to Unicode: need string or buffer, NoneType found
> 2015-07-28 01:38:57,308  [E] Update property failed for:
>
> Attached is the *install.proprties* file.
>
> I'm new to Apache Knox, can anyone please guide me. I'm having
> troubles in installing Apache Ranger.
>
> Thanks
>
>
>

>>>
>>
>

Re: Error Setting up Ranger-Admin

[Aneela Saleem]

Luckily i have created the service myself. Thanks for your timely help.

Can you please tell me now what should be the next step. I want to explore
all the functionality i.e.,

sync LDAP contacts
perform authorization etc

On Tue, Jul 28, 2015 at 11:07 PM, Aneela Saleem 
wrote:

> There are no errors in NameNode logs.
>
> Can you please tell me how to create service/repo using Ranger Admin?
>
> On Tue, Jul 28, 2015 at 10:48 PM, Don Bosco Durai 
> wrote:
>
>> Yes, this is link I was about to redirect you to.
>>
>> Sorry, I might have assumed incorrectly on your initial question.
>> ./setup.sh is called only for installing RangerAdmin. Good it seems you
>> have made progress on installing RangerAdmin.
>>
>> I also assume, your ./enable-hdfs-plugin.sh went through fine.
>>
>> Looking into the Apache Ranger document, it seems it doesn’t explicitly
>> call out to create a repo/service for HDFS in RangerAdmin. In the
>> install.properties for HDFS, what value have you given for the property 
>> “REPOSITORY_NAME”?
>> You need to create a service/repo in RangerAdmin with the same name.
>>
>> Also, after you restart HDFS namenode, can you check the namenode logs
>> for any error?
>>
>> Thanks
>>
>> Bosco
>>
>>
>> From: Aneela Saleem 
>> Reply-To: "user@ranger.incubator.apache.org" <
>> user@ranger.incubator.apache.org>
>> Date: Tuesday, July 28, 2015 at 10:16 AM
>>
>> To: "user@ranger.incubator.apache.org" 
>> Subject: Re: Error Setting up Ranger-Admin
>>
>> And i'm using following link for installation:
>>
>>
>> https://cwiki.apache.org/confluence/display/RANGER/Apache+Ranger+0.5.0+Installation
>>
>> I'm upto *Enabling Ranger HDFS Plugins *section (e)
>>
>>- You can verify by logging into the Ranger Admin Web interface ­>
>>Audit > Agents.
>>-
>>
>>You can verify the plugin is communicating to Ranger admin in
>>Audit-­>plugins tab
>>
>>
>> where i don't see any audits ensuring hdfs plugin is communicating to
>> Ranger Admin.
>>
>> On Tue, Jul 28, 2015 at 10:11 PM, Aneela Saleem 
>> wrote:
>>
>>> I'm planning to secure HDFS and i'm using Knox for authentication using
>>> REST API.
>>>
>>> Yes i'm still able to access the RangerAdmin UI. I'm just curious how to
>>> sync LDAP contacts in APache Ranger.
>>>
>>> Secondly if the document is related to 0.4 and i'm linked with 0.5, then
>>> how should i proceed? Do you have any fruitful link, i should follow?
>>> (being a novice)
>>>
>>> On Tue, Jul 28, 2015 at 10:04 PM, Don Bosco Durai 
>>> wrote:
>>>
 Aneela

 The document you linked is for Apache Ranger 0.4. There subtle changes
 in Apache Ranger 0.5.

 Just curious, how you were able to access RangerAdmin UI? Did the
 installation continued after the install failure?

 Also, can you give additional information of your env? I can try
 reproducing it.

 Also, which components are you planning secure? (HDFS, Hive, Hbase,
 Solr, YARN, Storm, etc)

 Thanks

 Bosco


 From: Aneela Saleem 
 Reply-To: "user@ranger.incubator.apache.org" <
 user@ranger.incubator.apache.org>
 Date: Tuesday, July 28, 2015 at 5:19 AM
 To: "user@ranger.incubator.apache.org" <
 user@ranger.incubator.apache.org>
 Subject: Re: Error Setting up Ranger-Admin

 And secondly my Ranger UI does not Match the UI as shown in the
 following link:

 http://pivotalhd.docs.pivotal.io/docs/ranger-user-guide.html#Item1.4.2

 There is no Policy Manager Tab and no Manage Repository Thing.

 On Tue, Jul 28, 2015 at 5:17 PM, Aneela Saleem 
 wrote:

> Hi Bosco,
>
> I did as you suggested but still getting same error.
>
> On Tue, Jul 28, 2015 at 4:49 AM, Don Bosco Durai 
> wrote:
>
>> The properties file looks good..
>>
>> I am not sure whether it is because of python 2.7. Is it possible for
>> you to use python 2.6?
>>
>> Try changing the below to where 2.6 is installed.
>>
>> PYTHON_COMMAND_INVOKER=python
>>
>>
>> Thanks
>>
>> Bosco
>>
>>
>> From: Aneela Saleem 
>> Reply-To: "user@ranger.incubator.apache.org" <
>> user@ranger.incubator.apache.org>
>> Date: Monday, July 27, 2015 at 2:02 PM
>> To: "user@ranger.incubator.apache.org" <
>> user@ranger.incubator.apache.org>
>> Subject: Error Setting up Ranger-Admin
>>
>> Hi all,
>>
>> I have followed this link
>>
>>
>> https://cwiki.apache.org/confluence/display/RANGER/Apache+Ranger+0.5.0+Installation
>>
>> But when i run *./setupsh, *i get the following error at the end:
>>
>> Traceback (most recent call last):
>>   File "update_property.py", line 40, in 
>>
>> write_properties_to_xml(ranger_admin_site_xml_path,parameter_name,parameter_value)
>>   File "update_property.py", line 21, in write_properties_to_xml
>> if(os.path.isfile(xml_path)):
>>   File "/usr/lib/python2.7/gen

Re: Error Setting up Ranger-Admin

[Don Bosco Durai]

Good. I already typed it, so let me paste it for the benefit of others. We need 
to update the doc also. If you don’t mind, can you create a JIRA to track this?

  1.  Go to RangerAdmin UI -> AccessManager (first menu tab is already opened 
by default)
  2.  Click on “+” in the HDFS panel title
  3.  Enter Service Name: e.g. “${cluster_name}_hdfs. Cluster name could be 
anything. You can call the repo “test_hdfs” if you want to
  4.  UserName: ranger  (doesn’t matter whether it exists because you are not 
using kerberos)
  5.  Password: ranger (doesn’t matter what you give)
  6.  Namenode URL: hdfs://:8020
  7.  Authorization Enabled: No
  8.  Authentication Type: Simple
  9.  Rest you can leave it as default.

Save this screen. Then use the same name e.g “test_hdfs” in your 
install.properties for enabling Ranger in HDFS. Then restart namenode.

Is the plugin request showing up in the Audit->Plugin tab?

If the plugin is showing up, then that means authorization and auditing is 
already working.

For configuring policies, we need to configure UserSync. The install/configure 
process is same for all processes. You need to update the install.properties 
with the appropriate values.
Set  SYNC_SOURCE = ldap
And check the section "Table: LDAP/AD Properties with sample values” for 
reference values.

Please note that for using LDAP within Hadoop, you need to configure Hadoop 
core-site.xml to use LDAP. You might be already knowing it. Just want to make 
sure.

Thanks

Bosco


From: Aneela Saleem mailto:ane...@platalytics.com>>
Reply-To: 
"user@ranger.incubator.apache.org" 
mailto:user@ranger.incubator.apache.org>>
Date: Tuesday, July 28, 2015 at 11:13 AM
To: "user@ranger.incubator.apache.org" 
mailto:user@ranger.incubator.apache.org>>
Subject: Re: Error Setting up Ranger-Admin

Luckily i have created the service myself. Thanks for your timely help.

Can you please tell me now what should be the next step. I want to explore all 
the functionality i.e.,

sync LDAP contacts
perform authorization etc

On Tue, Jul 28, 2015 at 11:07 PM, Aneela Saleem 
mailto:ane...@platalytics.com>> wrote:
There are no errors in NameNode logs.

Can you please tell me how to create service/repo using Ranger Admin?

On Tue, Jul 28, 2015 at 10:48 PM, Don Bosco Durai 
mailto:bo...@apache.org>> wrote:
Yes, this is link I was about to redirect you to.

Sorry, I might have assumed incorrectly on your initial question. ./setup.sh is 
called only for installing RangerAdmin. Good it seems you have made progress on 
installing RangerAdmin.

I also assume, your ./enable-hdfs-plugin.sh went through fine.

Looking into the Apache Ranger document, it seems it doesn’t explicitly call 
out to create a repo/service for HDFS in RangerAdmin. In the install.properties 
for HDFS, what value have you given for the property “REPOSITORY_NAME”? You 
need to create a service/repo in RangerAdmin with the same name.

Also, after you restart HDFS namenode, can you check the namenode logs for any 
error?

Thanks

Bosco


From: Aneela Saleem mailto:ane...@platalytics.com>>
Reply-To: 
"user@ranger.incubator.apache.org" 
mailto:user@ranger.incubator.apache.org>>
Date: Tuesday, July 28, 2015 at 10:16 AM

To: "user@ranger.incubator.apache.org" 
mailto:user@ranger.incubator.apache.org>>
Subject: Re: Error Setting up Ranger-Admin

And i'm using following link for installation:

https://cwiki.apache.org/confluence/display/RANGER/Apache+Ranger+0.5.0+Installation

I'm upto Enabling Ranger HDFS Plugins section (e)

  *   You can verify by logging into the Ranger Admin Web interface ­> Audit > 
Agents.
  *   You can verify the plugin is communicating to Ranger admin in 
Audit-­>plugins tab

where i don't see any audits ensuring hdfs plugin is communicating to Ranger 
Admin.

On Tue, Jul 28, 2015 at 10:11 PM, Aneela Saleem 
mailto:ane...@platalytics.com>> wrote:
I'm planning to secure HDFS and i'm using Knox for authentication using REST 
API.

Yes i'm still able to access the RangerAdmin UI. I'm just curious how to sync 
LDAP contacts in APache Ranger.

Secondly if the document is related to 0.4 and i'm linked with 0.5, then how 
should i proceed? Do you have any fruitful link, i should follow? (being a 
novice)

On Tue, Jul 28, 2015 at 10:04 PM, Don Bosco Durai 
mailto:bo...@apache.org>> wrote:
Aneela

The document you linked is for Apache Ranger 0.4. There subtle changes in 
Apache Ranger 0.5.

Just curious, how you were able to access RangerAdmin UI? Did the installation 
continued after the install failure?

Also, can you give additional information of your env? I can try reproducing it.

Also, which components are you planning secure? (HDFS, Hive, Hbase, Solr, YARN, 
Storm, etc)

Thanks

Bosco


From: Aneela Saleem mailto:ane...@platalytics.com>>
Reply-To: 
"user@ranger.incubator.apache.org

Re: Error Setting up Ranger-Admin

[Aneela Saleem]

Thank you so much Bosco. I created JIRA for this. Can be found here


Let me try UserSync, then i will approach yyou in case of any problem.

On Tue, Jul 28, 2015 at 11:28 PM, Don Bosco Durai 
wrote:

>  Good. I already typed it, so let me paste it for the benefit of others.
> We need to update the doc also. If you don’t mind, can you create a JIRA to
> track this?
>
>1. Go to RangerAdmin UI -> AccessManager (first menu tab is already
>opened by default)
>2. Click on “+” in the HDFS panel title
>3. Enter Service Name: e.g. “${cluster_name}_hdfs. Cluster name could
>be anything. You can call the repo “test_hdfs” if you want to
>4. UserName: ranger  (doesn’t matter whether it exists because you are
>not using kerberos)
>5. Password: ranger (doesn’t matter what you give)
>6. Namenode URL: hdfs://:8020
>7. Authorization Enabled: No
>8. Authentication Type: Simple
>9. Rest you can leave it as default.
>
> Save this screen. Then use the same name e.g “test_hdfs” in your
> install.properties for enabling Ranger in HDFS. Then restart namenode.
>
>  Is the plugin request showing up in the Audit->Plugin tab?
>
>  If the plugin is showing up, then that means authorization and auditing
> is already working.
>
>  For configuring policies, we need to configure UserSync. The
> install/configure process is same for all processes. You need to update the
> install.properties with the appropriate values.
> Set  SYNC_SOURCE = ldap
> And check the section "Table: LDAP/AD Properties with sample values” for
> reference values.
>
>  Please note that for using LDAP within Hadoop, you need to configure
> Hadoop core-site.xml to use LDAP. You might be already knowing it. Just
> want to make sure.
>
>  Thanks
>
>  Bosco
>
>
>   From: Aneela Saleem 
> Reply-To: "user@ranger.incubator.apache.org" <
> user@ranger.incubator.apache.org>
> Date: Tuesday, July 28, 2015 at 11:13 AM
>
> To: "user@ranger.incubator.apache.org" 
> Subject: Re: Error Setting up Ranger-Admin
>
>   Luckily i have created the service myself. Thanks for your timely help.
>
>  Can you please tell me now what should be the next step. I want to
> explore all the functionality i.e.,
>
>  sync LDAP contacts
> perform authorization etc
>
> On Tue, Jul 28, 2015 at 11:07 PM, Aneela Saleem 
> wrote:
>
>> There are no errors in NameNode logs.
>>
>>  Can you please tell me how to create service/repo using Ranger Admin?
>>
>> On Tue, Jul 28, 2015 at 10:48 PM, Don Bosco Durai 
>> wrote:
>>
>>>  Yes, this is link I was about to redirect you to.
>>>
>>>  Sorry, I might have assumed incorrectly on your initial question.
>>> ./setup.sh is called only for installing RangerAdmin. Good it seems you
>>> have made progress on installing RangerAdmin.
>>>
>>>  I also assume, your ./enable-hdfs-plugin.sh went through fine.
>>>
>>>  Looking into the Apache Ranger document, it seems it doesn’t
>>> explicitly call out to create a repo/service for HDFS in RangerAdmin. In
>>> the install.properties for HDFS, what value have you given for the property
>>> “REPOSITORY_NAME”? You need to create a service/repo in RangerAdmin
>>> with the same name.
>>>
>>>  Also, after you restart HDFS namenode, can you check the namenode logs
>>> for any error?
>>>
>>>  Thanks
>>>
>>>  Bosco
>>>
>>>
>>>   From: Aneela Saleem 
>>> Reply-To: "user@ranger.incubator.apache.org" <
>>> user@ranger.incubator.apache.org>
>>> Date: Tuesday, July 28, 2015 at 10:16 AM
>>>
>>> To: "user@ranger.incubator.apache.org" >> >
>>> Subject: Re: Error Setting up Ranger-Admin
>>>
>>>   And i'm using following link for installation:
>>>
>>>
>>> https://cwiki.apache.org/confluence/display/RANGER/Apache+Ranger+0.5.0+Installation
>>>
>>>  I'm upto *Enabling Ranger HDFS Plugins *section (e)
>>>
>>>- You can verify by logging into the Ranger Admin Web interface ­>
>>>Audit > Agents.
>>>-
>>>
>>>You can verify the plugin is communicating to Ranger admin in
>>>Audit-­>plugins tab
>>>
>>>
>>>  where i don't see any audits ensuring hdfs plugin is communicating to
>>> Ranger Admin.
>>>
>>> On Tue, Jul 28, 2015 at 10:11 PM, Aneela Saleem 
>>> wrote:
>>>
 I'm planning to secure HDFS and i'm using Knox for authentication using
 REST API.

  Yes i'm still able to access the RangerAdmin UI. I'm just curious how
 to sync LDAP contacts in APache Ranger.

  Secondly if the document is related to 0.4 and i'm linked with 0.5,
 then how should i proceed? Do you have any fruitful link, i should follow?
 (being a novice)

 On Tue, Jul 28, 2015 at 10:04 PM, Don Bosco Durai 
 wrote:

>  Aneela
>
>  The document you linked is for Apache Ranger 0.4. There subtle
> changes in Apache Ranger 0.5.
>
>  Just curious, how you were able to access RangerAdmin UI? Did the
> installation continued after the install failure?
>
>  Also, can you give additional information of

Re: Error Setting up Ranger-Admin

[Aneela Saleem]

Hdfs Plugin request is not being shown in Audit > Plugins tab. I followed
all steps and verified with your steps. Restarted namenode but still can't
see any plugin request

On Wed, Jul 29, 2015 at 12:03 AM, Aneela Saleem 
wrote:

> Thank you so much Bosco. I created JIRA for this. Can be found here
> 
>
> Let me try UserSync, then i will approach yyou in case of any problem.
>
> On Tue, Jul 28, 2015 at 11:28 PM, Don Bosco Durai 
> wrote:
>
>>  Good. I already typed it, so let me paste it for the benefit of others.
>> We need to update the doc also. If you don’t mind, can you create a JIRA to
>> track this?
>>
>>1. Go to RangerAdmin UI -> AccessManager (first menu tab is already
>>opened by default)
>>2. Click on “+” in the HDFS panel title
>>3. Enter Service Name: e.g. “${cluster_name}_hdfs. Cluster name could
>>be anything. You can call the repo “test_hdfs” if you want to
>>4. UserName: ranger  (doesn’t matter whether it exists because you
>>are not using kerberos)
>>5. Password: ranger (doesn’t matter what you give)
>>6. Namenode URL: hdfs://:8020
>>7. Authorization Enabled: No
>>8. Authentication Type: Simple
>>9. Rest you can leave it as default.
>>
>> Save this screen. Then use the same name e.g “test_hdfs” in your
>> install.properties for enabling Ranger in HDFS. Then restart namenode.
>>
>>  Is the plugin request showing up in the Audit->Plugin tab?
>>
>>  If the plugin is showing up, then that means authorization and auditing
>> is already working.
>>
>>  For configuring policies, we need to configure UserSync. The
>> install/configure process is same for all processes. You need to update the
>> install.properties with the appropriate values.
>> Set  SYNC_SOURCE = ldap
>> And check the section "Table: LDAP/AD Properties with sample values” for
>> reference values.
>>
>>  Please note that for using LDAP within Hadoop, you need to configure
>> Hadoop core-site.xml to use LDAP. You might be already knowing it. Just
>> want to make sure.
>>
>>  Thanks
>>
>>  Bosco
>>
>>
>>   From: Aneela Saleem 
>> Reply-To: "user@ranger.incubator.apache.org" <
>> user@ranger.incubator.apache.org>
>> Date: Tuesday, July 28, 2015 at 11:13 AM
>>
>> To: "user@ranger.incubator.apache.org" 
>> Subject: Re: Error Setting up Ranger-Admin
>>
>>   Luckily i have created the service myself. Thanks for your timely
>> help.
>>
>>  Can you please tell me now what should be the next step. I want to
>> explore all the functionality i.e.,
>>
>>  sync LDAP contacts
>> perform authorization etc
>>
>> On Tue, Jul 28, 2015 at 11:07 PM, Aneela Saleem 
>> wrote:
>>
>>> There are no errors in NameNode logs.
>>>
>>>  Can you please tell me how to create service/repo using Ranger Admin?
>>>
>>> On Tue, Jul 28, 2015 at 10:48 PM, Don Bosco Durai 
>>> wrote:
>>>
  Yes, this is link I was about to redirect you to.

  Sorry, I might have assumed incorrectly on your initial question.
 ./setup.sh is called only for installing RangerAdmin. Good it seems you
 have made progress on installing RangerAdmin.

  I also assume, your ./enable-hdfs-plugin.sh went through fine.

  Looking into the Apache Ranger document, it seems it doesn’t
 explicitly call out to create a repo/service for HDFS in RangerAdmin. In
 the install.properties for HDFS, what value have you given for the property
 “REPOSITORY_NAME”? You need to create a service/repo in RangerAdmin
 with the same name.

  Also, after you restart HDFS namenode, can you check the namenode
 logs for any error?

  Thanks

  Bosco


   From: Aneela Saleem 
 Reply-To: "user@ranger.incubator.apache.org" <
 user@ranger.incubator.apache.org>
 Date: Tuesday, July 28, 2015 at 10:16 AM

 To: "user@ranger.incubator.apache.org" <
 user@ranger.incubator.apache.org>
 Subject: Re: Error Setting up Ranger-Admin

   And i'm using following link for installation:


 https://cwiki.apache.org/confluence/display/RANGER/Apache+Ranger+0.5.0+Installation

  I'm upto *Enabling Ranger HDFS Plugins *section (e)

- You can verify by logging into the Ranger Admin Web interface ­>
Audit > Agents.
-

You can verify the plugin is communicating to Ranger admin in
Audit-­>plugins tab


  where i don't see any audits ensuring hdfs plugin is communicating to
 Ranger Admin.

 On Tue, Jul 28, 2015 at 10:11 PM, Aneela Saleem >>> > wrote:

> I'm planning to secure HDFS and i'm using Knox for authentication
> using REST API.
>
>  Yes i'm still able to access the RangerAdmin UI. I'm just curious
> how to sync LDAP contacts in APache Ranger.
>
>  Secondly if the document is related to 0.4 and i'm linked with 0.5,
> then how should i proceed? Do you have any fruitful link, i should follow?
> (bei

Re: Error Setting up Ranger-Admin

[Don Bosco Durai]

Anything in the namenode log file?

Thanks

Bosco

From:  Aneela Saleem 
Reply-To:  "user@ranger.incubator.apache.org"

Date:  Tuesday, July 28, 2015 at 12:18 PM
To:  "user@ranger.incubator.apache.org" 
Subject:  Re: Error Setting up Ranger-Admin

> Hdfs Plugin request is not being shown in Audit > Plugins tab. I followed all
> steps and verified with your steps. Restarted namenode but still can't see any
> plugin request
> 
> On Wed, Jul 29, 2015 at 12:03 AM, Aneela Saleem 
> wrote:
>> Thank you so much Bosco. I created JIRA for this. Can be found here
>> 
>> 
>> Let me try UserSync, then i will approach yyou in case of any problem.
>> 
>> On Tue, Jul 28, 2015 at 11:28 PM, Don Bosco Durai 
>> wrote:
>>> Good. I already typed it, so let me paste it for the benefit of others. We
>>> need to update the doc also. If you don’t mind, can you create a JIRA to
>>> track this?
>>> 1. Go to RangerAdmin UI -> AccessManager (first menu tab is already opened
>>> by default)
>>> 2. Click on “+” in the HDFS panel title
>>> 3. Enter Service Name: e.g. “${cluster_name}_hdfs. Cluster name could be
>>> anything. You can call the repo “test_hdfs” if you want to
>>> 4. UserName: ranger  (doesn’t matter whether it exists because you are not
>>> using kerberos)
>>> 5. Password: ranger (doesn’t matter what you give)
>>> 6. Namenode URL: hdfs://:8020
>>> 7. Authorization Enabled: No
>>> 8. Authentication Type: Simple
>>> 9. Rest you can leave it as default.
>>> Save this screen. Then use the same name e.g “test_hdfs” in your
>>> install.properties for enabling Ranger in HDFS. Then restart namenode.
>>> 
>>> Is the plugin request showing up in the Audit->Plugin tab?
>>> 
>>> If the plugin is showing up, then that means authorization and auditing is
>>> already working.
>>> 
>>> For configuring policies, we need to configure UserSync. The
>>> install/configure process is same for all processes. You need to update the
>>> install.properties with the appropriate values.
>>> Set  SYNC_SOURCE = ldap
>>> And check the section "Table: LDAP/AD Properties with sample values” for
>>> reference values.
>>> 
>>> Please note that for using LDAP within Hadoop, you need to configure Hadoop
>>> core-site.xml to use LDAP. You might be already knowing it. Just want to
>>> make sure.
>>> 
>>> Thanks
>>> 
>>> Bosco
>>> 
>>> 
>>> From: Aneela Saleem 
>>> Reply-To: "user@ranger.incubator.apache.org"
>>> 
>>> Date: Tuesday, July 28, 2015 at 11:13 AM
>>> 
>>> To: "user@ranger.incubator.apache.org" 
>>> Subject: Re: Error Setting up Ranger-Admin
>>> 
 Luckily i have created the service myself. Thanks for your timely help.
 
 Can you please tell me now what should be the next step. I want to explore
 all the functionality i.e.,
 
 sync LDAP contacts
 perform authorization etc
 
 On Tue, Jul 28, 2015 at 11:07 PM, Aneela Saleem 
 wrote:
> There are no errors in NameNode logs.
> 
> Can you please tell me how to create service/repo using Ranger Admin?
> 
> On Tue, Jul 28, 2015 at 10:48 PM, Don Bosco Durai 
> wrote:
>> Yes, this is link I was about to redirect you to.
>> 
>> Sorry, I might have assumed incorrectly on your initial question.
>> ./setup.sh is called only for installing RangerAdmin. Good it seems you
>> have made progress on installing RangerAdmin.
>> 
>> I also assume, your ./enable-hdfs-plugin.sh went through fine.
>> 
>> Looking into the Apache Ranger document, it seems it doesn’t explicitly
>> call out to create a repo/service for HDFS in RangerAdmin. In the
>> install.properties for HDFS, what value have you given for the property
>> “REPOSITORY_NAME”? You need to create a service/repo in RangerAdmin with
>> the same name.
>> 
>> Also, after you restart HDFS namenode, can you check the namenode logs
>> for any error?
>> 
>> Thanks
>> 
>> Bosco
>> 
>> 
>> From: Aneela Saleem 
>> Reply-To: "user@ranger.incubator.apache.org"
>> 
>> Date: Tuesday, July 28, 2015 at 10:16 AM
>> 
>> To: "user@ranger.incubator.apache.org" 
>> Subject: Re: Error Setting up Ranger-Admin
>> 
>>> And i'm using following link for installation:
>>> 
>>> https://cwiki.apache.org/confluence/display/RANGER/Apache+Ranger+0.5.0+I
>>> nstallation
>>> 
>>> I'm upto Enabling Ranger HDFS Plugins section (e)
>>> * You can verify by logging into the Ranger Admin Web interface ­> Audit
>>> > Agents.
>>> * You can verify the plugin is communicating to Ranger admin in
>>> Audit-­>plugins tab
>>> 
>>> 
>>> where i don't see any audits ensuring hdfs plugin is communicating to
>>> Ranger Admin.
>>> 
>>> On Tue, Jul 28, 2015 at 10:11 PM, Aneela Saleem 
>>> wrote:
>>> I'm planning to secure HDFS and i'm using Knox for authentication using
>>> REST API. 
>>> 
>>> Yes i'm still able

Re: Error Setting up Ranger-Admin

[Aneela Saleem]

NameNode error Logs:

2015-06-30 00:30:05,933 FATAL
org.apache.hadoop.hdfs.server.namenode.NameNode: Failed to start namenode.
java.io.IOException: NameNode is not formatted.

On Wed, Jul 29, 2015 at 12:22 AM, Don Bosco Durai  wrote:

> Anything in the namenode log file?
>
> Thanks
>
> Bosco
>
> From: Aneela Saleem 
> Reply-To: "user@ranger.incubator.apache.org" <
> user@ranger.incubator.apache.org>
> Date: Tuesday, July 28, 2015 at 12:18 PM
> To: "user@ranger.incubator.apache.org" 
> Subject: Re: Error Setting up Ranger-Admin
>
> Hdfs Plugin request is not being shown in Audit > Plugins tab. I followed
> all steps and verified with your steps. Restarted namenode but still can't
> see any plugin request
>
> On Wed, Jul 29, 2015 at 12:03 AM, Aneela Saleem 
> wrote:
>
>> Thank you so much Bosco. I created JIRA for this. Can be found here
>> 
>>
>> Let me try UserSync, then i will approach yyou in case of any problem.
>>
>> On Tue, Jul 28, 2015 at 11:28 PM, Don Bosco Durai > > wrote:
>>
>>> Good. I already typed it, so let me paste it for the benefit of others.
>>> We need to update the doc also. If you don’t mind, can you create a JIRA to
>>> track this?
>>>
>>>1. Go to RangerAdmin UI -> AccessManager (first menu tab is already
>>>opened by default)
>>>2. Click on “+” in the HDFS panel title
>>>3. Enter Service Name: e.g. “${cluster_name}_hdfs. Cluster name
>>>could be anything. You can call the repo “test_hdfs” if you want to
>>>4. UserName: ranger  (doesn’t matter whether it exists because you
>>>are not using kerberos)
>>>5. Password: ranger (doesn’t matter what you give)
>>>6. Namenode URL: hdfs://:8020
>>>7. Authorization Enabled: No
>>>8. Authentication Type: Simple
>>>9. Rest you can leave it as default.
>>>
>>> Save this screen. Then use the same name e.g “test_hdfs” in your
>>> install.properties for enabling Ranger in HDFS. Then restart namenode.
>>>
>>> Is the plugin request showing up in the Audit->Plugin tab?
>>>
>>> If the plugin is showing up, then that means authorization and auditing
>>> is already working.
>>>
>>> For configuring policies, we need to configure UserSync. The
>>> install/configure process is same for all processes. You need to update the
>>> install.properties with the appropriate values.
>>> Set  SYNC_SOURCE = ldap
>>> And check the section "Table: LDAP/AD Properties with sample values” for
>>> reference values.
>>>
>>> Please note that for using LDAP within Hadoop, you need to configure
>>> Hadoop core-site.xml to use LDAP. You might be already knowing it. Just
>>> want to make sure.
>>>
>>> Thanks
>>>
>>> Bosco
>>>
>>>
>>> From: Aneela Saleem 
>>> Reply-To: "user@ranger.incubator.apache.org" <
>>> user@ranger.incubator.apache.org>
>>> Date: Tuesday, July 28, 2015 at 11:13 AM
>>>
>>> To: "user@ranger.incubator.apache.org" >> >
>>> Subject: Re: Error Setting up Ranger-Admin
>>>
>>> Luckily i have created the service myself. Thanks for your timely help.
>>>
>>> Can you please tell me now what should be the next step. I want to
>>> explore all the functionality i.e.,
>>>
>>> sync LDAP contacts
>>> perform authorization etc
>>>
>>> On Tue, Jul 28, 2015 at 11:07 PM, Aneela Saleem 
>>> wrote:
>>>
 There are no errors in NameNode logs.

 Can you please tell me how to create service/repo using Ranger Admin?

 On Tue, Jul 28, 2015 at 10:48 PM, Don Bosco Durai 
 wrote:

> Yes, this is link I was about to redirect you to.
>
> Sorry, I might have assumed incorrectly on your initial question.
> ./setup.sh is called only for installing RangerAdmin. Good it seems you
> have made progress on installing RangerAdmin.
>
> I also assume, your ./enable-hdfs-plugin.sh went through fine.
>
> Looking into the Apache Ranger document, it seems it doesn’t
> explicitly call out to create a repo/service for HDFS in RangerAdmin. In
> the install.properties for HDFS, what value have you given for the 
> property
> “REPOSITORY_NAME”? You need to create a service/repo in RangerAdmin
> with the same name.
>
> Also, after you restart HDFS namenode, can you check the namenode logs
> for any error?
>
> Thanks
>
> Bosco
>
>
> From: Aneela Saleem 
> Reply-To: "user@ranger.incubator.apache.org" <
> user@ranger.incubator.apache.org>
> Date: Tuesday, July 28, 2015 at 10:16 AM
>
> To: "user@ranger.incubator.apache.org" <
> user@ranger.incubator.apache.org>
> Subject: Re: Error Setting up Ranger-Admin
>
> And i'm using following link for installation:
>
>
> https://cwiki.apache.org/confluence/display/RANGER/Apache+Ranger+0.5.0+Installation
>
> I'm upto *Enabling Ranger HDFS Plugins *section (e)
>
>- You can verify by logging into the Ranger Admin Web interface ­>
>Audit > Agents.
>-
>
>You can verify the 

Re: Error Setting up Ranger-Admin

[Don Bosco Durai]

I have seen this issue before in OpenStack environment where the DFS folders
were configured to /tmp/… and they were wiped out after restart.

If it is a test env, you can try formatting. First check dfs.name.dir
property in HDFS.
% $HADOOP_INSTALL/hadoop/bin/hadoop namenode -format


http://wiki.apache.org/hadoop/GettingStartedWithHadoop
Formatting the Namenode
The first step to starting up your Hadoop installation is formatting the
Hadoop filesystem, which is implemented on top of the local filesystems of
your cluster. You need to do this the first time you set up a Hadoop
installation. Do not format a running Hadoop filesystem, this will cause all
your data to be erased. Before formatting, ensure that the dfs.name.dir
directory exists. If you just used the default, then mkdir -p
/tmp/hadoop-username/dfs/name will create the directory. To format the
filesystem (which simply initializes the directory specified by the
dfs.name.dir variable), run the command:
% $HADOOP_INSTALL/hadoop/bin/hadoop namenode -format

If asked to [re]format, you must reply Y (not just y) if you want to
reformat, else Hadoop will abort the format.


Thanks

Bosco

From:  Aneela Saleem 
Reply-To:  "user@ranger.incubator.apache.org"

Date:  Tuesday, July 28, 2015 at 12:40 PM
To:  "user@ranger.incubator.apache.org" 
Subject:  Re: Error Setting up Ranger-Admin

> NameNode error Logs:
> 
> 2015-06-30 00:30:05,933 FATAL org.apache.hadoop.hdfs.server.namenode.NameNode:
> Failed to start namenode.
> java.io.IOException: NameNode is not formatted.
> 
> On Wed, Jul 29, 2015 at 12:22 AM, Don Bosco Durai  wrote:
>> Anything in the namenode log file?
>> 
>> Thanks
>> 
>> Bosco
>> 
>> From: Aneela Saleem 
>> Reply-To: "user@ranger.incubator.apache.org"
>> 
>> Date: Tuesday, July 28, 2015 at 12:18 PM
>> To: "user@ranger.incubator.apache.org" 
>> Subject: Re: Error Setting up Ranger-Admin
>> 
>>> Hdfs Plugin request is not being shown in Audit > Plugins tab. I followed
>>> all steps and verified with your steps. Restarted namenode but still can't
>>> see any plugin request
>>> 
>>> On Wed, Jul 29, 2015 at 12:03 AM, Aneela Saleem 
>>> wrote:
 Thank you so much Bosco. I created JIRA for this. Can be found here
 
 
 Let me try UserSync, then i will approach yyou in case of any problem.
 
 On Tue, Jul 28, 2015 at 11:28 PM, Don Bosco Durai 
 wrote:
> Good. I already typed it, so let me paste it for the benefit of others. We
> need to update the doc also. If you don’t mind, can you create a JIRA to
> track this?
> 1. Go to RangerAdmin UI -> AccessManager (first menu tab is already opened
> by default)
> 2. Click on “+” in the HDFS panel title
> 3. Enter Service Name: e.g. “${cluster_name}_hdfs. Cluster name could be
> anything. You can call the repo “test_hdfs” if you want to
> 4. UserName: ranger  (doesn’t matter whether it exists because you are not
> using kerberos)
> 5. Password: ranger (doesn’t matter what you give)
> 6. Namenode URL: hdfs://:8020
> 7. Authorization Enabled: No
> 8. Authentication Type: Simple
> 9. Rest you can leave it as default.
> Save this screen. Then use the same name e.g “test_hdfs” in your
> install.properties for enabling Ranger in HDFS. Then restart namenode.
> 
> Is the plugin request showing up in the Audit->Plugin tab?
> 
> If the plugin is showing up, then that means authorization and auditing is
> already working.
> 
> For configuring policies, we need to configure UserSync. The
> install/configure process is same for all processes. You need to update
> the install.properties with the appropriate values.
> Set  SYNC_SOURCE = ldap
> And check the section "Table: LDAP/AD Properties with sample values” for
> reference values.
> 
> Please note that for using LDAP within Hadoop, you need to configure
> Hadoop core-site.xml to use LDAP. You might be already knowing it. Just
> want to make sure.
> 
> Thanks
> 
> Bosco
> 
> 
> From: Aneela Saleem 
> Reply-To: "user@ranger.incubator.apache.org"
> 
> Date: Tuesday, July 28, 2015 at 11:13 AM
> 
> To: "user@ranger.incubator.apache.org" 
> Subject: Re: Error Setting up Ranger-Admin
> 
>> Luckily i have created the service myself. Thanks for your timely help.
>> 
>> Can you please tell me now what should be the next step. I want to
>> explore all the functionality i.e.,
>> 
>> sync LDAP contacts
>> perform authorization etc
>> 
>> On Tue, Jul 28, 2015 at 11:07 PM, Aneela Saleem 
>> wrote:
>>> There are no errors in NameNode logs.
>>> 
>>> Can you please tell me how to create service/repo using Ranger Admin?
>>> 
>>> On Tue, Jul 28, 2015 at 10:48 PM, Don Bosco Durai 
>>> wrote:
>>> Yes, this is link I was about to redirect you to.
>>> 
>>> Sorry

Re: Error Setting up Ranger-Admin

[Aneela Saleem]

That error has been resolved.

Following is the latest error:

 class org.apache.hadoop.hdfs.web.resources.UserProvider
  class org.apache.hadoop.hdfs.web.resources.ExceptionHandler
Jul 28, 2015 10:39:46 PM
com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17
AM'
Jul 28, 2015 10:39:51 PM com.sun.jersey.spi.inject.Errors
processErrorMessages
WARNING: The following warnings have been detected with resource and/or
provider classes:
  WARNING: A sub-resource method, public javax.ws.rs.core.Response
org.apache.hadoop.hdfs.server.namenode.web.resources.NamenodeWebHdfsMethods.getRoot(org.apache.hadoop.security.UserGroupInformation,org.apache.hadoop.hdfs.web.resources.DelegationParam,org.apache.hadoop.hdfs.web.resources.UserParam,org.apache.hadoop.hdfs.web.resources.DoAsParam,org.apache.hadoop.hdfs.web.resources.GetOpParam,org.apache.hadoop.hdfs.web.resources.OffsetParam,org.apache.hadoop.hdfs.web.resources.LengthParam,org.apache.hadoop.hdfs.web.resources.RenewerParam,org.apache.hadoop.hdfs.web.resources.BufferSizeParam,java.util.List,org.apache.hadoop.hdfs.web.resources.XAttrEncodingParam,org.apache.hadoop.hdfs.web.resources.ExcludeDatanodesParam,org.apache.hadoop.hdfs.web.resources.FsActionParam,org.apache.hadoop.hdfs.web.resources.TokenKindParam,org.apache.hadoop.hdfs.web.resources.TokenServiceParam)
throws java.io.IOException,java.lang.InterruptedException, with URI
template, "/", is treated as a resource method



On Wed, Jul 29, 2015 at 12:50 AM, Don Bosco Durai  wrote:

> I have seen this issue before in OpenStack environment where the DFS
> folders were configured to /tmp/… and they were wiped out after restart.
>
> If it is a test env, you can try formatting. First check dfs.name.dir
> property in HDFS.
>
> % $HADOOP_INSTALL/hadoop/bin/hadoop namenode -format
>
> http://wiki.apache.org/hadoop/GettingStartedWithHadoop
> Formatting the Namenode
>
> The first step to starting up your Hadoop installation is formatting the
> Hadoop filesystem, which is implemented on top of the local filesystems of
> your cluster. You need to do this the first time you set up a Hadoop
> installation. *Do not* format a running Hadoop filesystem, this will
> cause all your data to be erased. Before formatting, ensure that the
> dfs.name.dir directory exists. If you just used the default, then
> mkdir -p /tmp/hadoop-username/dfs/name will create the directory. To
> format the filesystem (which simply initializes the directory specified by
> the dfs.name.dir variable), run the command:
> % $HADOOP_INSTALL/hadoop/bin/hadoop namenode -format
>
> If asked to [re]format, you must reply Y (not just y) if you want to
> reformat, else Hadoop will abort the format.
>
>
> Thanks
>
> Bosco
>
> From: Aneela Saleem 
> Reply-To: "user@ranger.incubator.apache.org" <
> user@ranger.incubator.apache.org>
> Date: Tuesday, July 28, 2015 at 12:40 PM
>
> To: "user@ranger.incubator.apache.org" 
> Subject: Re: Error Setting up Ranger-Admin
>
> NameNode error Logs:
>
> 2015-06-30 00:30:05,933 FATAL
> org.apache.hadoop.hdfs.server.namenode.NameNode: Failed to start namenode.
> java.io.IOException: NameNode is not formatted.
>
> On Wed, Jul 29, 2015 at 12:22 AM, Don Bosco Durai 
> wrote:
>
>> Anything in the namenode log file?
>>
>> Thanks
>>
>> Bosco
>>
>> From: Aneela Saleem 
>> Reply-To: "user@ranger.incubator.apache.org" <
>> user@ranger.incubator.apache.org>
>> Date: Tuesday, July 28, 2015 at 12:18 PM
>> To: "user@ranger.incubator.apache.org" 
>> Subject: Re: Error Setting up Ranger-Admin
>>
>> Hdfs Plugin request is not being shown in Audit > Plugins tab. I followed
>> all steps and verified with your steps. Restarted namenode but still can't
>> see any plugin request
>>
>> On Wed, Jul 29, 2015 at 12:03 AM, Aneela Saleem 
>> wrote:
>>
>>> Thank you so much Bosco. I created JIRA for this. Can be found here
>>> 
>>>
>>> Let me try UserSync, then i will approach yyou in case of any problem.
>>>
>>> On Tue, Jul 28, 2015 at 11:28 PM, Don Bosco Durai <
>>> bdu...@hortonworks.com> wrote:
>>>
 Good. I already typed it, so let me paste it for the benefit of others.
 We need to update the doc also. If you don’t mind, can you create a JIRA to
 track this?

1. Go to RangerAdmin UI -> AccessManager (first menu tab is already
opened by default)
2. Click on “+” in the HDFS panel title
3. Enter Service Name: e.g. “${cluster_name}_hdfs. Cluster name
could be anything. You can call the repo “test_hdfs” if you want to
4. UserName: ranger  (doesn’t matter whether it exists because you
are not using kerberos)
5. Password: ranger (doesn’t matter what you give)
6. Namenode URL: hdfs://:8020
7. Authorization Enabled: No
8. Authentication Type: Simple
9. Rest you can leave it as default.

 Save this screen. Then use the

Re: Error Setting up Ranger-Admin

[Don Bosco Durai]

Did the original startup issue get resolved?

Your errors seems to be coming from WebHDFS. Can we check whether  “hdfs dfs
-ls /“ works from command line?

Thanks

Bosco


From:  Aneela Saleem 
Reply-To:  "user@ranger.incubator.apache.org"

Date:  Tuesday, July 28, 2015 at 1:05 PM
To:  "user@ranger.incubator.apache.org" 
Subject:  Re: Error Setting up Ranger-Admin

> That error has been resolved.
> 
> Following is the latest error:
> 
>  class org.apache.hadoop.hdfs.web.resources.UserProvider
>   class org.apache.hadoop.hdfs.web.resources.ExceptionHandler
> Jul 28, 2015 10:39:46 PM
> com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
> INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17 AM'
> Jul 28, 2015 10:39:51 PM com.sun.jersey.spi.inject.Errors processErrorMessages
> WARNING: The following warnings have been detected with resource and/or
> provider classes:
>   WARNING: A sub-resource method, public javax.ws.rs.core.Response
> org.apache.hadoop.hdfs.server.namenode.web.resources.NamenodeWebHdfsMethods.ge
> tRoot(org.apache.hadoop.security.UserGroupInformation,org.apache.hadoop.hdfs.w
> eb.resources.DelegationParam,org.apache.hadoop.hdfs.web.resources.UserParam,or
> g.apache.hadoop.hdfs.web.resources.DoAsParam,org.apache.hadoop.hdfs.web.resour
> ces.GetOpParam,org.apache.hadoop.hdfs.web.resources.OffsetParam,org.apache.had
> oop.hdfs.web.resources.LengthParam,org.apache.hadoop.hdfs.web.resources.Renewe
> rParam,org.apache.hadoop.hdfs.web.resources.BufferSizeParam,java.util.List,org
> .apache.hadoop.hdfs.web.resources.XAttrEncodingParam,org.apache.hadoop.hdfs.we
> b.resources.ExcludeDatanodesParam,org.apache.hadoop.hdfs.web.resources.FsActio
> nParam,org.apache.hadoop.hdfs.web.resources.TokenKindParam,org.apache.hadoop.h
> dfs.web.resources.TokenServiceParam) throws
> java.io.IOException,java.lang.InterruptedException, with URI template, "/", is
> treated as a resource method
> 
> 
> 
> On Wed, Jul 29, 2015 at 12:50 AM, Don Bosco Durai  wrote:
>> I have seen this issue before in OpenStack environment where the DFS folders
>> were configured to /tmp/… and they were wiped out after restart.
>> 
>> If it is a test env, you can try formatting. First check dfs.name.dir
>> property in HDFS.
>> % $HADOOP_INSTALL/hadoop/bin/hadoop namenode -format
>> 
>> 
>> http://wiki.apache.org/hadoop/GettingStartedWithHadoop
>> Formatting the Namenode
>> The first step to starting up your Hadoop installation is formatting the
>> Hadoop filesystem, which is implemented on top of the local filesystems of
>> your cluster. You need to do this the first time you set up a Hadoop
>> installation. Do not format a running Hadoop filesystem, this will cause all
>> your data to be erased. Before formatting, ensure that the dfs.name.dir
>> directory exists. If you just used the default, then mkdir -p
>> /tmp/hadoop-username/dfs/name will create the directory. To format the
>> filesystem (which simply initializes the directory specified by the
>> dfs.name.dir variable), run the command:
>> % $HADOOP_INSTALL/hadoop/bin/hadoop namenode -format
>> 
>> If asked to [re]format, you must reply Y (not just y) if you want to
>> reformat, else Hadoop will abort the format.
>> 
>> 
>> Thanks
>> 
>> Bosco
>> 
>> From: Aneela Saleem 
>> Reply-To: "user@ranger.incubator.apache.org"
>> 
>> Date: Tuesday, July 28, 2015 at 12:40 PM
>> 
>> To: "user@ranger.incubator.apache.org" 
>> Subject: Re: Error Setting up Ranger-Admin
>> 
>>> NameNode error Logs:
>>> 
>>> 2015-06-30 00:30:05,933 FATAL
>>> org.apache.hadoop.hdfs.server.namenode.NameNode: Failed to start namenode.
>>> java.io.IOException: NameNode is not formatted.
>>> 
>>> On Wed, Jul 29, 2015 at 12:22 AM, Don Bosco Durai  wrote:
 Anything in the namenode log file?
 
 Thanks
 
 Bosco
 
 From: Aneela Saleem 
 Reply-To: "user@ranger.incubator.apache.org"
 
 Date: Tuesday, July 28, 2015 at 12:18 PM
 To: "user@ranger.incubator.apache.org" 
 Subject: Re: Error Setting up Ranger-Admin
 
> Hdfs Plugin request is not being shown in Audit > Plugins tab. I followed
> all steps and verified with your steps. Restarted namenode but still can't
> see any plugin request
> 
> On Wed, Jul 29, 2015 at 12:03 AM, Aneela Saleem 
> wrote:
>> Thank you so much Bosco. I created JIRA for this. Can be found here
>> 
>> 
>> Let me try UserSync, then i will approach yyou in case of any problem.
>> 
>> On Tue, Jul 28, 2015 at 11:28 PM, Don Bosco Durai
>>  wrote:
>>> Good. I already typed it, so let me paste it for the benefit of others.
>>> We need to update the doc also. If you don’t mind, can you create a JIRA
>>> to track this?
>>> 1. Go to RangerAdmin UI -> AccessManager (first menu tab is already
>>> opened by default)
>>> 2. Click on “+” in the HDFS panel title
>>> 3. Enter Service Name: e.g. “${cluster_

Re: Error Setting up Ranger-Admin

[Aneela Saleem]

Yes the command is working

On Wed, Jul 29, 2015 at 1:11 AM, Don Bosco Durai  wrote:

> Did the original startup issue get resolved?
>
> Your errors seems to be coming from WebHDFS. Can we check whether  “hdfs
> dfs -ls /“ works from command line?
>
> Thanks
>
> Bosco
>
>
> From: Aneela Saleem 
> Reply-To: "user@ranger.incubator.apache.org" <
> user@ranger.incubator.apache.org>
> Date: Tuesday, July 28, 2015 at 1:05 PM
>
> To: "user@ranger.incubator.apache.org" 
> Subject: Re: Error Setting up Ranger-Admin
>
> That error has been resolved.
>
> Following is the latest error:
>
>  class org.apache.hadoop.hdfs.web.resources.UserProvider
>   class org.apache.hadoop.hdfs.web.resources.ExceptionHandler
> Jul 28, 2015 10:39:46 PM
> com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
> INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17
> AM'
> Jul 28, 2015 10:39:51 PM com.sun.jersey.spi.inject.Errors
> processErrorMessages
> WARNING: The following warnings have been detected with resource and/or
> provider classes:
>   WARNING: A sub-resource method, public javax.ws.rs.core.Response
> org.apache.hadoop.hdfs.server.namenode.web.resources.NamenodeWebHdfsMethods.getRoot(org.apache.hadoop.security.UserGroupInformation,org.apache.hadoop.hdfs.web.resources.DelegationParam,org.apache.hadoop.hdfs.web.resources.UserParam,org.apache.hadoop.hdfs.web.resources.DoAsParam,org.apache.hadoop.hdfs.web.resources.GetOpParam,org.apache.hadoop.hdfs.web.resources.OffsetParam,org.apache.hadoop.hdfs.web.resources.LengthParam,org.apache.hadoop.hdfs.web.resources.RenewerParam,org.apache.hadoop.hdfs.web.resources.BufferSizeParam,java.util.List,org.apache.hadoop.hdfs.web.resources.XAttrEncodingParam,org.apache.hadoop.hdfs.web.resources.ExcludeDatanodesParam,org.apache.hadoop.hdfs.web.resources.FsActionParam,org.apache.hadoop.hdfs.web.resources.TokenKindParam,org.apache.hadoop.hdfs.web.resources.TokenServiceParam)
> throws java.io.IOException,java.lang.InterruptedException, with URI
> template, "/", is treated as a resource method
>
>
>
> On Wed, Jul 29, 2015 at 12:50 AM, Don Bosco Durai 
> wrote:
>
>> I have seen this issue before in OpenStack environment where the DFS
>> folders were configured to /tmp/… and they were wiped out after restart.
>>
>> If it is a test env, you can try formatting. First check dfs.name.dir
>> property in HDFS.
>>
>> % $HADOOP_INSTALL/hadoop/bin/hadoop namenode -format
>>
>> http://wiki.apache.org/hadoop/GettingStartedWithHadoop
>> Formatting the Namenode
>>
>> The first step to starting up your Hadoop installation is formatting the
>> Hadoop filesystem, which is implemented on top of the local filesystems of
>> your cluster. You need to do this the first time you set up a Hadoop
>> installation. *Do not* format a running Hadoop filesystem, this will
>> cause all your data to be erased. Before formatting, ensure that the
>> dfs.name.dir directory exists. If you just used the default, then
>> mkdir -p /tmp/hadoop-username/dfs/name will create the directory. To
>> format the filesystem (which simply initializes the directory specified by
>> the dfs.name.dir variable), run the command:
>> % $HADOOP_INSTALL/hadoop/bin/hadoop namenode -format
>>
>> If asked to [re]format, you must reply Y (not just y) if you want to
>> reformat, else Hadoop will abort the format.
>>
>>
>> Thanks
>>
>> Bosco
>>
>> From: Aneela Saleem 
>> Reply-To: "user@ranger.incubator.apache.org" <
>> user@ranger.incubator.apache.org>
>> Date: Tuesday, July 28, 2015 at 12:40 PM
>>
>> To: "user@ranger.incubator.apache.org" 
>> Subject: Re: Error Setting up Ranger-Admin
>>
>> NameNode error Logs:
>>
>> 2015-06-30 00:30:05,933 FATAL
>> org.apache.hadoop.hdfs.server.namenode.NameNode: Failed to start namenode.
>> java.io.IOException: NameNode is not formatted.
>>
>> On Wed, Jul 29, 2015 at 12:22 AM, Don Bosco Durai 
>> wrote:
>>
>>> Anything in the namenode log file?
>>>
>>> Thanks
>>>
>>> Bosco
>>>
>>> From: Aneela Saleem 
>>> Reply-To: "user@ranger.incubator.apache.org" <
>>> user@ranger.incubator.apache.org>
>>> Date: Tuesday, July 28, 2015 at 12:18 PM
>>> To: "user@ranger.incubator.apache.org" >> >
>>> Subject: Re: Error Setting up Ranger-Admin
>>>
>>> Hdfs Plugin request is not being shown in Audit > Plugins tab. I
>>> followed all steps and verified with your steps. Restarted namenode but
>>> still can't see any plugin request
>>>
>>> On Wed, Jul 29, 2015 at 12:03 AM, Aneela Saleem 
>>> wrote:
>>>
 Thank you so much Bosco. I created JIRA for this. Can be found here
 

 Let me try UserSync, then i will approach yyou in case of any problem.

 On Tue, Jul 28, 2015 at 11:28 PM, Don Bosco Durai <
 bdu...@hortonworks.com> wrote:

> Good. I already typed it, so let me paste it for the benefit of
> others. We need to update the doc also. If you don’t mind, can you create 
> a
> JIRA to track this?
>
>1. Go to 

Re: Error Setting up Ranger-Admin

[Don Bosco Durai]

Cool. Can we check RangerAdmin->Audit to see if there are any audit records?

Thanks

Bosco


From:  Aneela Saleem 
Reply-To:  "user@ranger.incubator.apache.org"

Date:  Tuesday, July 28, 2015 at 1:14 PM
To:  "user@ranger.incubator.apache.org" 
Subject:  Re: Error Setting up Ranger-Admin

> Yes the command is working
> 
> On Wed, Jul 29, 2015 at 1:11 AM, Don Bosco Durai  wrote:
>> Did the original startup issue get resolved?
>> 
>> Your errors seems to be coming from WebHDFS. Can we check whether  “hdfs dfs
>> -ls /“ works from command line?
>> 
>> Thanks
>> 
>> Bosco
>> 
>> 
>> From: Aneela Saleem 
>> Reply-To: "user@ranger.incubator.apache.org"
>> 
>> Date: Tuesday, July 28, 2015 at 1:05 PM
>> 
>> To: "user@ranger.incubator.apache.org" 
>> Subject: Re: Error Setting up Ranger-Admin
>> 
>>> That error has been resolved.
>>> 
>>> Following is the latest error:
>>> 
>>>  class org.apache.hadoop.hdfs.web.resources.UserProvider
>>>   class org.apache.hadoop.hdfs.web.resources.ExceptionHandler
>>> Jul 28, 2015 10:39:46 PM
>>> com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
>>> INFO: Initiating Jersey application, version 'Jersey: 1.9 09/02/2011 11:17
>>> AM'
>>> Jul 28, 2015 10:39:51 PM com.sun.jersey.spi.inject.Errors
>>> processErrorMessages
>>> WARNING: The following warnings have been detected with resource and/or
>>> provider classes:
>>>   WARNING: A sub-resource method, public javax.ws.rs.core.Response
>>> org.apache.hadoop.hdfs.server.namenode.web.resources.NamenodeWebHdfsMethods.
>>> getRoot(org.apache.hadoop.security.UserGroupInformation,org.apache.hadoop.hd
>>> fs.web.resources.DelegationParam,org.apache.hadoop.hdfs.web.resources.UserPa
>>> ram,org.apache.hadoop.hdfs.web.resources.DoAsParam,org.apache.hadoop.hdfs.we
>>> b.resources.GetOpParam,org.apache.hadoop.hdfs.web.resources.OffsetParam,org.
>>> apache.hadoop.hdfs.web.resources.LengthParam,org.apache.hadoop.hdfs.web.reso
>>> urces.RenewerParam,org.apache.hadoop.hdfs.web.resources.BufferSizeParam,java
>>> .util.List,org.apache.hadoop.hdfs.web.resources.XAttrEncodingParam,org.apach
>>> e.hadoop.hdfs.web.resources.ExcludeDatanodesParam,org.apache.hadoop.hdfs.web
>>> .resources.FsActionParam,org.apache.hadoop.hdfs.web.resources.TokenKindParam
>>> ,org.apache.hadoop.hdfs.web.resources.TokenServiceParam) throws
>>> java.io.IOException,java.lang.InterruptedException, with URI template, "/",
>>> is treated as a resource method
>>> 
>>> 
>>> 
>>> On Wed, Jul 29, 2015 at 12:50 AM, Don Bosco Durai  wrote:
 I have seen this issue before in OpenStack environment where the DFS
 folders were configured to /tmp/… and they were wiped out after restart.
 
 If it is a test env, you can try formatting. First check dfs.name.dir
 property in HDFS.
 % $HADOOP_INSTALL/hadoop/bin/hadoop namenode -format
 
 
 http://wiki.apache.org/hadoop/GettingStartedWithHadoop
 Formatting the Namenode
 The first step to starting up your Hadoop installation is formatting the
 Hadoop filesystem, which is implemented on top of the local filesystems of
 your cluster. You need to do this the first time you set up a Hadoop
 installation. Do not format a running Hadoop filesystem, this will cause
 all your data to be erased. Before formatting, ensure that the dfs.name.dir
 directory exists. If you just used the default, then mkdir -p
 /tmp/hadoop-username/dfs/name will create the directory. To format the
 filesystem (which simply initializes the directory specified by the
 dfs.name.dir variable), run the command:
 % $HADOOP_INSTALL/hadoop/bin/hadoop namenode -format
 
 If asked to [re]format, you must reply Y (not just y) if you want to
 reformat, else Hadoop will abort the format.
 
 
 Thanks
 
 Bosco
 
 From: Aneela Saleem 
 Reply-To: "user@ranger.incubator.apache.org"
 
 Date: Tuesday, July 28, 2015 at 12:40 PM
 
 To: "user@ranger.incubator.apache.org" 
 Subject: Re: Error Setting up Ranger-Admin
 
> NameNode error Logs:
> 
> 2015-06-30 00:30:05,933 FATAL
> org.apache.hadoop.hdfs.server.namenode.NameNode: Failed to start namenode.
> java.io.IOException: NameNode is not formatted.
> 
> On Wed, Jul 29, 2015 at 12:22 AM, Don Bosco Durai 
> wrote:
>> Anything in the namenode log file?
>> 
>> Thanks
>> 
>> Bosco
>> 
>> From: Aneela Saleem 
>> Reply-To: "user@ranger.incubator.apache.org"
>> 
>> Date: Tuesday, July 28, 2015 at 12:18 PM
>> To: "user@ranger.incubator.apache.org" 
>> Subject: Re: Error Setting up Ranger-Admin
>> 
>>> Hdfs Plugin request is not being shown in Audit > Plugins tab. I
>>> followed all steps and verified with your steps. Restarted namenode but
>>> still can't see any plugin request
>>> 
>>> On Wed, Jul 29, 2015 at 12:03 AM, Aneela Saleem 
>>> wrote:
>>> Thank you so much Bosco. I created JIRA fo

Rearranging Ranger Wiki pages ...

[Don Bosco Durai]

We might need to do some rearrangement of the wiki pages to make it more
scalable. At the high level, this is the principal we originally organized
the wiki pages:
1. Dashboard/Index page as the link to all important pages and links
2. Top level page tree is limited to top level pages (so we can avoid
clutters)
3. Each release has it¹s own page. All release related artifacts are
contained within the respective release page

Proposed change is to have top level release page under home/index and move
all the release folders/pages underneath it. This will help us limit the
pages under home/index.

If there are no objections, I will move the existing release specific
folders into /Release Folders. The downside is that anyone linking to
existing pages will break. But this is the downside of us using Wiki. The
search engines will reindex the new pages (eventually)

Seems our website also needs updates based on the 0.5 release. And it will
be good to overall it in the process. Any volunteers?

Thanks

Bosco

Re: Error Setting up Ranger-Admin

[Don Bosco Durai]

This seems to be one of the reason HDFS plugin is not enabled. As what user
have you installed Hadoop?

Thanks

Bosco

From:  Aneela Saleem 
Reply-To:  "user@ranger.incubator.apache.org"

Date:  Tuesday, July 28, 2015 at 1:31 PM
To:  "user@ranger.incubator.apache.org" 
Subject:  Re: Error Setting up Ranger-Admin

> Also when i run ./enable-hdfs-plugin.sh
> 
> i get the following at the end:
> 
> + بدھ جولاي 29 01:28:20 PKT 2015 : Saving current JCE file:
> /etc/ranger/hadoopdev/cred.jceks to
> /etc/ranger/hadoopdev/.cred.jceks.20150729012820 ...
> chown: invalid user: ‘hdfs:hdfs’
> Ranger Plugin for hadoop has been enabled. Please restart hadoop to ensure
> that changes are effective.
>  
> 
> 

Re: Error Setting up Ranger-Admin

[Aneela Saleem]

hduser

On Wed, Jul 29, 2015 at 1:51 AM, Don Bosco Durai  wrote:

> This seems to be one of the reason HDFS plugin is not enabled. As what
> user have you installed Hadoop?
>
> Thanks
>
> Bosco
>
> From: Aneela Saleem 
> Reply-To: "user@ranger.incubator.apache.org" <
> user@ranger.incubator.apache.org>
> Date: Tuesday, July 28, 2015 at 1:31 PM
> To: "user@ranger.incubator.apache.org" 
> Subject: Re: Error Setting up Ranger-Admin
>
> Also when i run *./enable-hdfs-plugin.sh *
>
> i get the following at the end:
>
> + بدھ جولاي 29 01:28:20 PKT 2015 : Saving current JCE file:
> /etc/ranger/hadoopdev/cred.jceks to
> /etc/ranger/hadoopdev/.cred.jceks.20150729012820 ...
> *chown: invalid user: ‘hdfs:hdfs’*
> Ranger Plugin for hadoop has been enabled. Please restart hadoop to ensure
> that changes are effective.
>
>
>
>

Re: Error Setting up Ranger-Admin

[Aneela Saleem]

Following are the Logs:

2015-07-29 02:01:22,126 FATAL
org.apache.hadoop.hdfs.server.namenode.NameNode: Failed to start namenode.
java.net.BindException: Port in use: 0.0.0.0:50070
at org.apache.hadoop.http.HttpServer2.openListeners(HttpServer2.java:891)
at org.apache.hadoop.http.HttpServer2.start(HttpServer2.java:827)
at
org.apache.hadoop.hdfs.server.namenode.NameNodeHttpServer.start(NameNodeHttpServer.java:142)
at
org.apache.hadoop.hdfs.server.namenode.NameNode.startHttpServer(NameNode.java:703)
at
org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:590)
at org.apache.hadoop.hdfs.server.namenode.NameNode.(NameNode.java:762)
at org.apache.hadoop.hdfs.server.namenode.NameNode.(NameNode.java:746)
at
org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1438)
at org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1504)
Caused by: java.net.BindException: Address already in use
at sun.nio.ch.Net.bind0(Native Method)
at sun.nio.ch.Net.bind(Net.java:463)
at sun.nio.ch.Net.bind(Net.java:455)
at sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:223)
at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:74)
at
org.mortbay.jetty.nio.SelectChannelConnector.open(SelectChannelConnector.java:216)
at org.apache.hadoop.http.HttpServer2.openListeners(HttpServer2.java:886)
... 8 more
2015-07-29 02:01:22,128 INFO org.apache.hadoop.util.ExitUtil: Exiting with
status 1
2015-07-29 02:01:22,129 INFO
org.apache.hadoop.hdfs.server.namenode.NameNode: SHUTDOWN_MSG:
/
SHUTDOWN_MSG: Shutting down NameNode at aneela-Lenovo-G50-70/192.168.1.4
/


On Wed, Jul 29, 2015 at 1:53 AM, Aneela Saleem 
wrote:

> hduser
>
> On Wed, Jul 29, 2015 at 1:51 AM, Don Bosco Durai  wrote:
>
>> This seems to be one of the reason HDFS plugin is not enabled. As what
>> user have you installed Hadoop?
>>
>> Thanks
>>
>> Bosco
>>
>> From: Aneela Saleem 
>> Reply-To: "user@ranger.incubator.apache.org" <
>> user@ranger.incubator.apache.org>
>> Date: Tuesday, July 28, 2015 at 1:31 PM
>> To: "user@ranger.incubator.apache.org" 
>> Subject: Re: Error Setting up Ranger-Admin
>>
>> Also when i run *./enable-hdfs-plugin.sh *
>>
>> i get the following at the end:
>>
>> + بدھ جولاي 29 01:28:20 PKT 2015 : Saving current JCE file:
>> /etc/ranger/hadoopdev/cred.jceks to
>> /etc/ranger/hadoopdev/.cred.jceks.20150729012820 ...
>> *chown: invalid user: ‘hdfs:hdfs’*
>> Ranger Plugin for hadoop has been enabled. Please restart hadoop to
>> ensure that changes are effective.
>>
>>
>>
>>
>

Re: Error Setting up Ranger-Admin

[Aneela Saleem]

I'm continuously stuck at this point

Regards,
Aneela Saleem
On Jul 29, 2015 4:37 AM, "Aneela Saleem"  wrote:

> How can we check whether the problem is in Ranger's configuration or
> Hadoop?
>
> Regards,
> Aneela Saleem
> On Jul 29, 2015 2:03 AM, "Aneela Saleem"  wrote:
>
>> Following are the Logs:
>>
>> 2015-07-29 02:01:22,126 FATAL
>> org.apache.hadoop.hdfs.server.namenode.NameNode: Failed to start namenode.
>> java.net.BindException: Port in use: 0.0.0.0:50070
>> at org.apache.hadoop.http.HttpServer2.openListeners(HttpServer2.java:891)
>> at org.apache.hadoop.http.HttpServer2.start(HttpServer2.java:827)
>> at
>> org.apache.hadoop.hdfs.server.namenode.NameNodeHttpServer.start(NameNodeHttpServer.java:142)
>> at
>> org.apache.hadoop.hdfs.server.namenode.NameNode.startHttpServer(NameNode.java:703)
>> at
>> org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:590)
>> at
>> org.apache.hadoop.hdfs.server.namenode.NameNode.(NameNode.java:762)
>> at
>> org.apache.hadoop.hdfs.server.namenode.NameNode.(NameNode.java:746)
>> at
>> org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1438)
>> at
>> org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1504)
>> Caused by: java.net.BindException: Address already in use
>> at sun.nio.ch.Net.bind0(Native Method)
>> at sun.nio.ch.Net.bind(Net.java:463)
>> at sun.nio.ch.Net.bind(Net.java:455)
>> at
>> sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:223)
>> at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:74)
>> at
>> org.mortbay.jetty.nio.SelectChannelConnector.open(SelectChannelConnector.java:216)
>> at org.apache.hadoop.http.HttpServer2.openListeners(HttpServer2.java:886)
>> ... 8 more
>> 2015-07-29 02:01:22,128 INFO org.apache.hadoop.util.ExitUtil: Exiting
>> with status 1
>> 2015-07-29 02:01:22,129 INFO
>> org.apache.hadoop.hdfs.server.namenode.NameNode: SHUTDOWN_MSG:
>> /
>> SHUTDOWN_MSG: Shutting down NameNode at aneela-Lenovo-G50-70/192.168.1.4
>> /
>>
>>
>> On Wed, Jul 29, 2015 at 1:53 AM, Aneela Saleem 
>> wrote:
>>
>>> hduser
>>>
>>> On Wed, Jul 29, 2015 at 1:51 AM, Don Bosco Durai 
>>> wrote:
>>>
 This seems to be one of the reason HDFS plugin is not enabled. As what
 user have you installed Hadoop?

 Thanks

 Bosco

 From: Aneela Saleem 
 Reply-To: "user@ranger.incubator.apache.org" <
 user@ranger.incubator.apache.org>
 Date: Tuesday, July 28, 2015 at 1:31 PM
 To: "user@ranger.incubator.apache.org" <
 user@ranger.incubator.apache.org>
 Subject: Re: Error Setting up Ranger-Admin

 Also when i run *./enable-hdfs-plugin.sh *

 i get the following at the end:

 + بدھ جولاي 29 01:28:20 PKT 2015 : Saving current JCE file:
 /etc/ranger/hadoopdev/cred.jceks to
 /etc/ranger/hadoopdev/.cred.jceks.20150729012820 ...
 *chown: invalid user: ‘hdfs:hdfs’*
 Ranger Plugin for hadoop has been enabled. Please restart hadoop to
 ensure that changes are effective.




>>>
>>

Re: Error Setting up Ranger-Admin

[Aneela Saleem]

How can we check whether the problem is in Ranger's configuration or Hadoop?

Regards,
Aneela Saleem
On Jul 29, 2015 2:03 AM, "Aneela Saleem"  wrote:

> Following are the Logs:
>
> 2015-07-29 02:01:22,126 FATAL
> org.apache.hadoop.hdfs.server.namenode.NameNode: Failed to start namenode.
> java.net.BindException: Port in use: 0.0.0.0:50070
> at org.apache.hadoop.http.HttpServer2.openListeners(HttpServer2.java:891)
> at org.apache.hadoop.http.HttpServer2.start(HttpServer2.java:827)
> at
> org.apache.hadoop.hdfs.server.namenode.NameNodeHttpServer.start(NameNodeHttpServer.java:142)
> at
> org.apache.hadoop.hdfs.server.namenode.NameNode.startHttpServer(NameNode.java:703)
> at
> org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:590)
> at
> org.apache.hadoop.hdfs.server.namenode.NameNode.(NameNode.java:762)
> at
> org.apache.hadoop.hdfs.server.namenode.NameNode.(NameNode.java:746)
> at
> org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1438)
> at org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1504)
> Caused by: java.net.BindException: Address already in use
> at sun.nio.ch.Net.bind0(Native Method)
> at sun.nio.ch.Net.bind(Net.java:463)
> at sun.nio.ch.Net.bind(Net.java:455)
> at
> sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:223)
> at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:74)
> at
> org.mortbay.jetty.nio.SelectChannelConnector.open(SelectChannelConnector.java:216)
> at org.apache.hadoop.http.HttpServer2.openListeners(HttpServer2.java:886)
> ... 8 more
> 2015-07-29 02:01:22,128 INFO org.apache.hadoop.util.ExitUtil: Exiting with
> status 1
> 2015-07-29 02:01:22,129 INFO
> org.apache.hadoop.hdfs.server.namenode.NameNode: SHUTDOWN_MSG:
> /
> SHUTDOWN_MSG: Shutting down NameNode at aneela-Lenovo-G50-70/192.168.1.4
> /
>
>
> On Wed, Jul 29, 2015 at 1:53 AM, Aneela Saleem 
> wrote:
>
>> hduser
>>
>> On Wed, Jul 29, 2015 at 1:51 AM, Don Bosco Durai 
>> wrote:
>>
>>> This seems to be one of the reason HDFS plugin is not enabled. As what
>>> user have you installed Hadoop?
>>>
>>> Thanks
>>>
>>> Bosco
>>>
>>> From: Aneela Saleem 
>>> Reply-To: "user@ranger.incubator.apache.org" <
>>> user@ranger.incubator.apache.org>
>>> Date: Tuesday, July 28, 2015 at 1:31 PM
>>> To: "user@ranger.incubator.apache.org" >> >
>>> Subject: Re: Error Setting up Ranger-Admin
>>>
>>> Also when i run *./enable-hdfs-plugin.sh *
>>>
>>> i get the following at the end:
>>>
>>> + بدھ جولاي 29 01:28:20 PKT 2015 : Saving current JCE file:
>>> /etc/ranger/hadoopdev/cred.jceks to
>>> /etc/ranger/hadoopdev/.cred.jceks.20150729012820 ...
>>> *chown: invalid user: ‘hdfs:hdfs’*
>>> Ranger Plugin for hadoop has been enabled. Please restart hadoop to
>>> ensure that changes are effective.
>>>
>>>
>>>
>>>
>>
>

Re: Error Setting up Ranger-Admin

[Ramesh Mani]

By looking at this error it seems that port 50070 is in 
use. Check that namenode is already running. If so stop and start.

Regards,
Ramesh

From: Aneela Saleem mailto:ane...@platalytics.com>>
Reply-To: 
"user@ranger.incubator.apache.org" 
mailto:user@ranger.incubator.apache.org>>
Date: Tuesday, July 28, 2015 at 4:37 PM
To: "user@ranger.incubator.apache.org" 
mailto:user@ranger.incubator.apache.org>>
Subject: Re: Error Setting up Ranger-Admin


I'm continuously stuck at this point

Regards,
Aneela Saleem

On Jul 29, 2015 4:37 AM, "Aneela Saleem" 
mailto:ane...@platalytics.com>> wrote:

How can we check whether the problem is in Ranger's configuration or Hadoop?

Regards,
Aneela Saleem

On Jul 29, 2015 2:03 AM, "Aneela Saleem" 
mailto:ane...@platalytics.com>> wrote:
Following are the Logs:

2015-07-29 02:01:22,126 FATAL org.apache.hadoop.hdfs.server.namenode.NameNode: 
Failed to start namenode.
java.net.BindException: Port in use: 0.0.0.0:50070
at org.apache.hadoop.http.HttpServer2.openListeners(HttpServer2.java:891)
at org.apache.hadoop.http.HttpServer2.start(HttpServer2.java:827)
at 
org.apache.hadoop.hdfs.server.namenode.NameNodeHttpServer.start(NameNodeHttpServer.java:142)
at 
org.apache.hadoop.hdfs.server.namenode.NameNode.startHttpServer(NameNode.java:703)
at org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:590)
at org.apache.hadoop.hdfs.server.namenode.NameNode.(NameNode.java:762)
at org.apache.hadoop.hdfs.server.namenode.NameNode.(NameNode.java:746)
at 
org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1438)
at org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1504)
Caused by: java.net.BindException: Address already in use
at sun.nio.ch.Net.bind0(Native Method)
at sun.nio.ch.Net.bind(Net.java:463)
at sun.nio.ch.Net.bind(Net.java:455)
at sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:223)
at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:74)
at 
org.mortbay.jetty.nio.SelectChannelConnector.open(SelectChannelConnector.java:216)
at org.apache.hadoop.http.HttpServer2.openListeners(HttpServer2.java:886)
... 8 more
2015-07-29 02:01:22,128 INFO org.apache.hadoop.util.ExitUtil: Exiting with 
status 1
2015-07-29 02:01:22,129 INFO org.apache.hadoop.hdfs.server.namenode.NameNode: 
SHUTDOWN_MSG:
/
SHUTDOWN_MSG: Shutting down NameNode at 
aneela-Lenovo-G50-70/192.168.1.4
/


On Wed, Jul 29, 2015 at 1:53 AM, Aneela Saleem 
mailto:ane...@platalytics.com>> wrote:
hduser

On Wed, Jul 29, 2015 at 1:51 AM, Don Bosco Durai 
mailto:bo...@apache.org>> wrote:
This seems to be one of the reason HDFS plugin is not enabled. As what user 
have you installed Hadoop?

Thanks

Bosco

From: Aneela Saleem mailto:ane...@platalytics.com>>
Reply-To: 
"user@ranger.incubator.apache.org" 
mailto:user@ranger.incubator.apache.org>>
Date: Tuesday, July 28, 2015 at 1:31 PM
To: "user@ranger.incubator.apache.org" 
mailto:user@ranger.incubator.apache.org>>
Subject: Re: Error Setting up Ranger-Admin

Also when i run ./enable-hdfs-plugin.sh

i get the following at the end:

+ بدھ جولاي 29 01:28:20 PKT 2015 : Saving current JCE file: 
/etc/ranger/hadoopdev/cred.jceks to 
/etc/ranger/hadoopdev/.cred.jceks.20150729012820 ...
chown: invalid user: ‘hdfs:hdfs’
Ranger Plugin for hadoop has been enabled. Please restart hadoop to ensure that 
changes are effective.

Re: Error Setting up Ranger-Admin

[Don Bosco Durai]

Yes, this issues seems to be HDFS namenode was not stopped. Can you check
the running process by running “ps –eafww | grep proc_namenode” and if it is
running you have to stop it and start it again.

Regarding the chown error, it seems the scripts assumes the user to be
“hdfs”. Can you manually update enable-hdfs-plugin.sh and rerun it?

Line number 89 of enable-hdfs-plugin.sh

#CFG_OWNER_INF="${HCOMPONENT_NAME}:${HCOMPONENT_NAME}”

CFG_OWNER_INF=hduser


And run ./enable-hdfs-plugin.sh again?

Thanks

Bosco


From:  Ramesh Mani 
Reply-To:  "user@ranger.incubator.apache.org"

Date:  Tuesday, July 28, 2015 at 4:45 PM
To:  "user@ranger.incubator.apache.org" 
Subject:  Re: Error Setting up Ranger-Admin

> By looking at this error it seems that port 50070   is
> in use. Check that namenode is already running. If so stop and start.
> 
> Regards,
> Ramesh
> 
> From: Aneela Saleem 
> Reply-To: "user@ranger.incubator.apache.org"
> 
> Date: Tuesday, July 28, 2015 at 4:37 PM
> To: "user@ranger.incubator.apache.org" 
> Subject: Re: Error Setting up Ranger-Admin
> 
> I'm continuously stuck at this point
> 
> Regards,
> Aneela Saleem
> 
> On Jul 29, 2015 4:37 AM, "Aneela Saleem"  wrote:
>> 
>> How can we check whether the problem is in Ranger's configuration or Hadoop?
>> 
>> Regards,
>> Aneela Saleem
>> 
>> On Jul 29, 2015 2:03 AM, "Aneela Saleem"  wrote:
>>> Following are the Logs:
>>> 
>>> 2015-07-29 02:01:22,126 FATAL
>>> org.apache.hadoop.hdfs.server.namenode.NameNode: Failed to start namenode.
>>> java.net.BindException: Port in use: 0.0.0.0:50070 
>>> at org.apache.hadoop.http.HttpServer2.openListeners(HttpServer2.java:891)
>>> at org.apache.hadoop.http.HttpServer2.start(HttpServer2.java:827)
>>> at 
>>> org.apache.hadoop.hdfs.server.namenode.NameNodeHttpServer.start(NameNodeHttp
>>> Server.java:142)
>>> at 
>>> org.apache.hadoop.hdfs.server.namenode.NameNode.startHttpServer(NameNode.jav
>>> a:703)
>>> at 
>>> 
org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:590>>>
)
>>> at org.apache.hadoop.hdfs.server.namenode.NameNode.(NameNode.java:762)
>>> at org.apache.hadoop.hdfs.server.namenode.NameNode.(NameNode.java:746)
>>> at 
>>> org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java
>>> :1438)
>>> at org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1504)
>>> Caused by: java.net.BindException: Address already in use
>>> at sun.nio.ch.Net.bind0(Native Method)
>>> at sun.nio.ch.Net.bind(Net.java:463)
>>> at sun.nio.ch.Net.bind(Net.java:455)
>>> at sun.nio.ch.ServerSocketChannelImpl.bind(ServerSocketChannelImpl.java:223)
>>> at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:74)
>>> at 
>>> org.mortbay.jetty.nio.SelectChannelConnector.open(SelectChannelConnector.jav
>>> a:216)
>>> at org.apache.hadoop.http.HttpServer2.openListeners(HttpServer2.java:886)
>>> ... 8 more
>>> 2015-07-29 02:01:22,128 INFO org.apache.hadoop.util.ExitUtil: Exiting with
>>> status 1
>>> 2015-07-29 02:01:22,129 INFO
>>> org.apache.hadoop.hdfs.server.namenode.NameNode: SHUTDOWN_MSG:
>>> /
>>> SHUTDOWN_MSG: Shutting down NameNode at aneela-Lenovo-G50-70/192.168.1.4
>>> 
>>> /
>>> 
>>> 
>>> On Wed, Jul 29, 2015 at 1:53 AM, Aneela Saleem 
>>> wrote:
 hduser
 
 On Wed, Jul 29, 2015 at 1:51 AM, Don Bosco Durai  wrote:
> This seems to be one of the reason HDFS plugin is not enabled. As what
> user have you installed Hadoop?
> 
> Thanks
> 
> Bosco
> 
> From: Aneela Saleem 
> Reply-To: "user@ranger.incubator.apache.org"
> 
> Date: Tuesday, July 28, 2015 at 1:31 PM
> To: "user@ranger.incubator.apache.org" 
> Subject: Re: Error Setting up Ranger-Admin
> 
>> Also when i run ./enable-hdfs-plugin.sh
>> 
>> i get the following at the end:
>> 
>> + بدھ جولاي 29 01:28:20 PKT 2015 : Saving current JCE file:
>> /etc/ranger/hadoopdev/cred.jceks to
>> /etc/ranger/hadoopdev/.cred.jceks.20150729012820 ...
>> chown: invalid user: ‘hdfs:hdfs’
>> Ranger Plugin for hadoop has been enabled. Please restart hadoop to
>> ensure that changes are effective.
>>  
>> 
>> 
 
>>>