Hadoop group mapping LDAP integration

2015-08-22 Thread Aneela Saleem
Hi all, I'm trying to sync ldap users and groups into my HDFS. It was working well with ldap:/// but when i switched to ldaps:/// ( LDAP over ssl ) it shows no groups when i run 'hdfs groups username' command. Attached is my core-site.xml file. Can anyone please look at this and guide me what i'm

Fwd: Hadoop group mapping LDAP integration

2015-08-22 Thread Aneela Saleem
-- Forwarded message -- From: Aneela Saleem Date: Sun, Aug 23, 2015 at 3:04 AM Subject: Hadoop group mapping LDAP integration To: user@hadoop.apache.org Hi all, I'm trying to sync ldap users and groups into my HDFS. It was working well with ldap:/// but when i switched to

Re: Hadoop group mapping LDAP integration

2015-08-25 Thread Aneela Saleem
2015 at 2:33 PM, Aneela Saleem wrote: > Attached is the core-site.xml file > > On Mon, Aug 24, 2015 at 2:32 PM, Aneela Saleem > wrote: > >> I created it in pem format. Then i came to know hadoop accepts it in jks >> format so i converted it >> >> On Mon, Aug

Re: KMS for hadoop

2016-06-01 Thread Aneela Saleem
Hi Paul, Can you please guide me what are the basic steps to configure KMS with Hadoop. Because the documentation here is very brief. And i have non-kerberized cluster. Can you please guide us to take a very well start. Thanks On Wed,

Configure Hadoop Kerberos to authenticate LDAP users

2016-06-19 Thread Aneela Saleem
Hi all, I have configured Kerberos on Hadoop cluster which successfully authenticates users that reside in Kerberos database. Now i want to make Hadoop Kerberos to authenticate LDAP users directly instead of local users. I've been looking it for days but didn't find the correct direction. I follow

Kerberos Impersonation in Hadoop

2016-06-23 Thread Aneela Saleem
Hi all, I'm trying Kerberos Impersonation in Hadoop. But i can't get the clear idea what the impersonation is? Whether it's effective in doing HADOOP_USER_NAME from command line or it's something else. It's confusing. I can't understand it from the documentation. Actually what i'm trying to do is

Re: Kerberos Impersonation in Hadoop

2016-06-26 Thread Aneela Saleem
iable named HADOOP_PROXY_USER that can be set to achieve this. > > Does that help? > > --Chris Nauroth > > From: Aneela Saleem > Date: Thursday, June 23, 2016 at 12:45 PM > To: "user@hadoop.apache.org" > Subject: Kerberos Impersonation in Hadoop > > H

Setting up secure Multi-Node cluster

2016-06-27 Thread Aneela Saleem
Hi all, I have configured Kerberos for single node cluster successfully. I used this documentation for configurations. Now i'm enabling security for multi node cluster and i

Re: Setting up secure Multi-Node cluster

2016-06-28 Thread Aneela Saleem
ou need to place these in appropriate paths in all the machines. > > Regards, > Rakesh > > On Tue, Jun 28, 2016 at 3:15 AM, Aneela Saleem > wrote: > >> Hi all, >> >> I have configured Kerberos for single node cluster successfully. I used >>

datanode is unable to connect to namenode

2016-06-28 Thread Aneela Saleem
Hi all, I have setup two nodes cluster with security enabled. I have everything running successful like namenode, datanode, resourcemanager, nodemanager, jobhistoryserver etc. But datanode is unable to connect to namenode, as i can see only one node on the web UI. checking logs of datanode gives f

Re: datanode is unable to connect to namenode

2016-06-28 Thread Aneela Saleem
, Jun 29, 2016 at 12:11 AM, sreebalineni . wrote: > Are you able to telnet ping. Check the firewalls as well > On Jun 29, 2016 12:39 AM, "Aneela Saleem" wrote: > >> Hi all, >> >> I have setup two nodes cluster with security enabled. I have everything >

Re: datanode is unable to connect to namenode

2016-06-28 Thread Aneela Saleem
Following is the result of telnet Trying 192.168.23.206... Connected to hadoop-master. Escape character is '^]'. On Wed, Jun 29, 2016 at 3:57 AM, Aneela Saleem wrote: > Thanks Sreebalineni for the response. > > This is the result of the *netstat -a | grep 8020* command >

Fwd: datanode is unable to connect to namenode

2016-06-29 Thread Aneela Saleem
Sent from my iPhoneBegin forwarded message:From: Aneela Saleem <ane...@platalytics.com>Date: 29 June 2016 at 10:16:36 GMT+5To: "sreebalineni ." <sreebalin...@gmail.com>Subject: Re: datanode is unable to connect to namenodeAttached are the log files for datanode and namenode

Re: datanode is unable to connect to namenode

2016-06-30 Thread Aneela Saleem
. > > > > Please change this configuration in all nodes to 'dn/_HOST@platalyticsrealm' > and restart all NNs and DNs, and check again. > > > > If this does not help, then please share the hdfs-site.xml of hadoop-slave > node too. > > > > -Vinay >

Re: datanode is unable to connect to namenode

2016-06-30 Thread Aneela Saleem
t; > > > dfs.datanode.kerberos.principal à dn/_HOST > > dfs.namenode.kerberos.principal à nn/_HOST > > > > “nn/_HOST” will be used only in namenode side. > > > > -Vinay > > *From:* Aneela Saleem [mailto:ane...@platalytics.com] > *Sent:* 30 June 2016 13

Hadoop-Kerberos aunthentication flow

2016-07-12 Thread Aneela Saleem
Hi all, I have configured Kerberos with Hadoop. I'm facing difficulty in mapping the Kerberos architecture and whole flow of authentication to my application. Following is my usecase: We have a web application that calls backend services, which communicates with Hadoop ecosystem internally. Now i

Re: Hadoop-Kerberos aunthentication flow

2016-07-12 Thread Aneela Saleem
Sorry could not load the image. Please see the attached screen shot On Tue, Jul 12, 2016 at 5:09 PM, Aneela Saleem wrote: > Hi all, > > I have configured Kerberos with Hadoop. I'm facing difficulty in mapping > the Kerberos architecture and whole flow of authentication to

issue starting regionserver with SASL authentication failed

2016-08-02 Thread Aneela Saleem
Hi all, I'm facing issue starting region server in HBase. I have enabled Kerberos debugging in Hadoop command line, so when i run the "hadoop fs -ls /" command, i get following output, I can't interpret this. Can anyone please tell me is something wrong with Kerberos configuration or everything is

Encrypt a directory using some key (JAVA)

2016-12-14 Thread Aneela Saleem
Hi, I have successfully enables Hadoop with KMS and now I want to write some java code to create key, get keys and encrypt a directory using a key. In other words, I want to translate this command hdfs hdfs crypto -createZone -keyName -path /encryption_zone and hdfs hdfs crypto -listZones in

Re: Encrypt a directory using some key (JAVA)

2016-12-15 Thread Aneela Saleem
gt; > Regards, > Wei-Chiu Chuang > A very happy Clouderan > > On Dec 14, 2016, at 5:39 AM, Aneela Saleem wrote: > > Hi, > > I have successfully enables Hadoop with KMS and now I want to write some > java code to create key, get keys and encrypt a directory using a key.