RE: Authenticating to Kerberos enabled Hadoop cluster using Java

2015-11-03 Thread Vishwakarma, Chhaya
cluster's machine. And place it in class path of the client program. Principal you are using to login is the client principal. It can be different from server principal. -Vinay On Nov 2, 2015 22:37, "Vishwakarma, Chhaya" mailto:chhaya.vishwaka...@thinkbiganalytics.com>>

RE: Authenticating to Kerberos enabled Hadoop cluster using Java

2015-11-02 Thread Vishwakarma, Chhaya
op.com<mailto:hdfs/had...@hadoop.com> fs.defaultFS=hdfs://host:port Further you need to use org.apache.hadoop.security.UserGroupInformation.loginUserFromKeytab(String, String) as suggested in one of the trailing mail. Cheers, Subroto Sanyal On Mon, Nov 2, 2015 at 3:13 PM, Vishwak

RE: Authenticating to Kerberos enabled Hadoop cluster using Java

2015-11-02 Thread Vishwakarma, Chhaya
/ Login using keytab if have access to keytab. else UserGroupInformation.loginUserFromKeytab("hdfs/had...@hadoop.com<mailto:hdfs/had...@hadoop.com>", " D:\\data\\Desktop\\cluster-test\\conf\\hdfs.keytab"); Note: Above 2 lines should be at the beginni

RE: Authenticating to Kerberos enabled Hadoop cluster using Java

2015-11-02 Thread Vishwakarma, Chhaya
UserGroupInformation class from org.apache.hadoop.security package. Specifically following 2 methods of that class UserGroupInformation.setConfiguration(hdfsConfiguration); UserGroupInformation.loginUserFromKeytab(principal, keytabPath); Regards, Niranjan On 02-Nov-2015, at 4:15 pm, Vishwakarma

Authenticating to Kerberos enabled Hadoop cluster using Java

2015-11-02 Thread Vishwakarma, Chhaya
I have Kerberos enabled Hadoop cluster, I need to perform HDFS operations using JAVA code. I have keytab file and username can someone please suggest how can I autheticate to Kerberos using JAVA code? Regards, Chhaya

Reading/Writing files to HDFS from Windwos server

2015-10-31 Thread Vishwakarma, Chhaya
I want to write files to HDFS from windows server. Hadoop cluster is on Linux. I tried researching everywhere I got a java code that can be run using "hadoop jar" Can somebody help me to understand how can I run HDFS file write java code from windows? What is required on Windows box? Even a pro

Hdfs put VS webhdfs

2015-07-27 Thread Vishwakarma, Chhaya
Hi, I'm loading 28 GB file in hadoop hdfs using webhdfs and it takes ~25 mins to load. I tried loading same file using hdfs put and It took ~6 mins. Why there is so much difference in performance? What is recommended to use? Can somebody explain or direct me to some good link it will be really h