Re: Appending to HDFS file

2014-08-23 Thread rab ra
Hi By default, it is true in hadoop 2.4.1. Nevertheless, I have set it to true explicitly in hdfs-site.xml. Still, I am not able to achieve append. Regards On 23 Aug 2014 11:20, Jagat Singh jagatsi...@gmail.com wrote: What is value of dfs.support.append in hdfs-site.cml

Hadoop YARM Cluster Setup Questions

2014-08-23 Thread S.L
Hi Folks, I was not able to find a clear answer to this , I know that on the master node we need to have a slaves file listing all the slaves , but do we need to have the slave nodes have a master file listing the single name node( I am not using a secondary name node). I only have the slaves

Re: Hadoop YARM Cluster Setup Questions

2014-08-23 Thread rab ra
Hi, 1. Typically,we used to copy the slaves file all the participating nodes though I do not have concrete theory to back up this. Atleast, this is what I was doing in hadoop 1.2 and I am doing the same in hadoop 2x 2. I think, you should investigate the yarn GUI and see how many maps it has

Re: Hadoop YARM Cluster Setup Questions

2014-08-23 Thread S.L
Ok, Ill copy the slaves file to the other slave nodes as well. What about the masters file though? Sent from my HTC - Reply message - From: rab ra rab...@gmail.com To: user@hadoop.apache.org user@hadoop.apache.org Subject: Hadoop YARM Cluster Setup Questions Date: Sat, Aug 23, 2014 5:03

Re: Hadoop YARM Cluster Setup Questions

2014-08-23 Thread Chris MacKenzie
Hi, The requirement is simply to have the slaves and masters files on the resource manager it's used by the shell script that starts the demons :-) Sent from my iPhone On 23 Aug 2014, at 16:02, S.L simpleliving...@gmail.com wrote: Ok, Ill copy the slaves file to the other slave nodes as

Re: Hadoop YARM Cluster Setup Questions

2014-08-23 Thread Alec Ten Harmsel
On Sat 23 Aug 2014 01:52:38 PM EDT, S.L wrote: Thats what I thought too, but please check the Answer #2 here in this question , I am facing a similar problem. http://stackoverflow.com/questions/12135949/why-map-task-always-running-on-a-single-node We were having the same problem; a map with

winutils and security

2014-08-23 Thread John Lilley
Up to this point, we've been able to run as a Hadoop client application (HDFS + YARN) from Windows without winutils.exe, despite always seeing messages complaining about it in the logs. However, we are now integrating with secure clusters and are having some mysterious errors. Before these