RE: datanode is unable to connect to namenode

2016-06-29 Thread Vinayakumar B
Hi Aneela, 1. Looks like you have attached the hdfs-site.xml from 'hadoop-master' node. For this node datanode connection is successfull as mentioned in below logs. 2016-06-29 10:01:35,700 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for nn/hadoop-master@platalyti

Fwd: datanode is unable to connect to namenode

2016-06-29 Thread Aneela Saleem
Sent from my iPhoneBegin forwarded message:From: Aneela Saleem Date: 29 June 2016 at 10:16:36 GMT+5To: "sreebalineni ." Subject: Re: datanode is unable to connect to namenodeAttached are the log files for datanode and namenode. Also i have attached hd

Re: cp command in webhdfs (and Filesystem Java Object)

2016-06-29 Thread Chris Nauroth
Hello Jérôme, WebHDFS provides an HTTP binding to the FileSystem API, which defines the primitive operations offered by the file system. The FileSystem Shell builds on top of the FileSystem API to provide higher-level workflows, implemented using the FileSystem primitives. In the case of "cp"

Re: Bulk chmod,chown operations on HDFS

2016-06-29 Thread Chris Nauroth
The community has nearly always steered away from NameNode RPC implementations that operate recursively on an entire sub-tree, instead implementing recursion on the client side. (The getContentSummary RPC is a notable exception.) This helps avoid unpredictable long execution time and long lock

unsubscribe

2016-06-29 Thread Mike Rapuano
-- Michael Rapuano Dev/Ops Engineer 617-498-7800 | 617-468-1774 25 Drydock Ave Boston, MA 02210

unsubscribe

2016-06-29 Thread Julio Paulo
To unsubscribe, e-mail: user-unsubscr...@hadoop.apache.org For additional commands, e-mail: user-h...@hadoop.apache.org -- Julio Paulo.

unsubscribe

2016-06-29 Thread Bob Krier

unsubscribe

2016-06-29 Thread siscia
- To unsubscribe, e-mail: user-unsubscr...@hadoop.apache.org For additional commands, e-mail: user-h...@hadoop.apache.org

Re: Bulk chmod,chown operations on HDFS

2016-06-29 Thread ravi teja
Thanks for the info Nauroth, will try the distch. Sorry for the late response. For a chmod -R call on one directory, I see that there are many calls to the namenode, I assume the recursion is done by the client. Isn't it better that the recursion is done by the name and having a re-entrant lock,

Namenode Fairscheduler's weight configs

2016-06-29 Thread ravi teja
Hi Community, Have some doubts in the fairscheduler, which was introduced as part of the QoS (HADOOP-9640) . The default queue weights for 4 priority queues are 8,4,2,1. I couldn't find any information about the rational behind choosing these configs. Why 8,4,2,1 , why not 64,32,16,8 or 128,64,3

hadoop with swift storage

2016-06-29 Thread Yoann Moulin
Hello, I'd like to use swift storage provided by a ceph cluster (not under Openstack and no keystone installed) with hadoop (Ambari). Version : HDP 2.4.0.0-169 HDFS 2.7.1.2. YARN 2.7.1.2.4 Ceph 10.2.2 (jewel) I'm able to connect to my swift bucket with rclone but I can't connect with hadoo

Re: cp command in webhdfs (and Filesystem Java Object)

2016-06-29 Thread Jérôme BAROTIN
I'm not thinking that is the same : - CREATE is for a local file : in my case, I just want to copy one hdfs path to another on the same cluster - Distcp, is for copying file between two differents clusters. I'm using HTTPFs/webhdfsREST API to acces to my cluster, and I need to execute a "cp" comma