Sequence files and merging

2014-08-23 Thread rab ra
Hello, I need few clarifications for the following questions related to sequenceFiles 1. I have a bunch of sequence file. Each file has 8 keys and corresponding values. The values are float array bytes, and key is a name which is a string. Now, storing these smaller files and processing is not e

winutils and security

2014-08-23 Thread John Lilley
Up to this point, we've been able to run as a Hadoop client application (HDFS + YARN) from Windows without winutils.exe, despite always seeing messages complaining about it in the logs. However, we are now integrating with secure clusters and are having some mysterious errors. Before these err

Re: Hadoop YARM Cluster Setup Questions

2014-08-23 Thread Alec Ten Harmsel
On Sat 23 Aug 2014 01:52:38 PM EDT, S.L wrote: > Thats what I thought too, but please check the Answer #2 here in this > question , I am facing a similar problem. > > http://stackoverflow.com/questions/12135949/why-map-task-always-running-on-a-single-node We were having the same problem; a map wit

Re: Hadoop YARM Cluster Setup Questions

2014-08-23 Thread S.L
Thats what I thought too, but please check the Answer #2 here in this question , I am facing a similar problem. http://stackoverflow.com/questions/12135949/why-map-task-always-running-on-a-single-node On Sat, Aug 23, 2014 at 12:44 PM, Chris MacKenzie < stu...@chrismackenziephotography.co.uk> wro

Re: Hadoop YARM Cluster Setup Questions

2014-08-23 Thread Chris MacKenzie
Hi, The requirement is simply to have the slaves and masters files on the resource manager it's used by the shell script that starts the demons :-) Sent from my iPhone > On 23 Aug 2014, at 16:02, "S.L" wrote: > > Ok, Ill copy the slaves file to the other slave nodes as well. > > What about t

Re: Hadoop YARM Cluster Setup Questions

2014-08-23 Thread S.L
Ok, Ill copy the slaves file to the other slave nodes as well. What about the masters file though? Sent from my HTC - Reply message - From: "rab ra" To: "user@hadoop.apache.org" Subject: Hadoop YARM Cluster Setup Questions Date: Sat, Aug 23, 2014 5:03 AM Hi, 1. Typically,we used to c

Re: Hadoop YARM Cluster Setup Questions

2014-08-23 Thread rab ra
Hi, 1. Typically,we used to copy the slaves file all the participating nodes though I do not have concrete theory to back up this. Atleast, this is what I was doing in hadoop 1.2 and I am doing the same in hadoop 2x 2. I think, you should investigate the yarn GUI and see how many maps it has span