Re: ACCEPTED: waiting for AM container to be allocated, launched and register with RM

2016-08-19 Thread rammohan ganapavarapu
yes, I did configured. On Aug 19, 2016 7:22 PM, "Rohith Sharma K S" wrote: > Hi > > From below discussion and AM logs, I see that AM container has launched > but not able to connect to RM. > > This looks like your configuration issue. Would you check your job.xml jar >

Re: ACCEPTED: waiting for AM container to be allocated, launched and register with RM

2016-08-19 Thread Rohith Sharma K S
Hi From below discussion and AM logs, I see that AM container has launched but not able to connect to RM. This looks like your configuration issue. Would you check your job.xml jar that does yarn.resourcemanager.scheduler.address has been configured? Essentially, this address required by

Re: ACCEPTED: waiting for AM container to be allocated, launched and register with RM

2016-08-19 Thread rammohan ganapavarapu
Even if the cluster dont have enough resources it should connect to " /0.0.0.0:8030" right? it should connect to my , not sure why its trying to connect to 0.0.0.0:8030. I have verified the config and i removed traces of 0.0.0.0 still no luck. org.apache.hadoop.yarn.client.RMProxy: Connecting

Re: ACCEPTED: waiting for AM container to be allocated, launched and register with RM

2016-08-19 Thread rammohan ganapavarapu
When i submit a job using yarn its seems working only with oozie its failing i guess, not sure what is missing. yarn jar /uap/hadoop/share/hadoop/mapreduce/hadoop-mapreduce-examples-2.7.1.jar pi 20 1000 Number of Maps = 20 Samples per Map = 1000 . . . Job Finished in 19.622 seconds Estimated

Re: hfs downgrade from 2.7.2 to 2.5.0

2016-08-19 Thread Chris Nauroth
Hello Jin, 1. I believe there may have been a recent bug around slow DataNode upgrade times, but I can’t find the relevant JIRA issue right now. Perhaps someone else on the list remembers. HDFS-8791 is relevant to performance of the block layout on disk in versions 2.6.0 and later, but I

Re: Fast way to read thousands of double value in hadoop jobs

2016-08-19 Thread Daniel Haviv
That was the idea :) Thanks for the update On Friday, 19 August 2016, Madhav Sharan wrote: > Thanks for your suggestion Daniel. I was already using SequenceFile but my > format was poor. I was storing file contents as Text in my SeqFile, > > So all my map jobs did repeated

Re: Is it possible to configure hdfs in a federation mode and in an HA mode in the same time?

2016-08-19 Thread Alexandr Porunov
Hello Rakesh, Thank you for your help. I will try to configure a cluster and will respond later about it. Best regards, Alexandr On Fri, Aug 19, 2016 at 6:39 AM, Rakesh Radhakrishnan wrote: > Yes, it is possible is to enable HA mode and Automatic Failover in > a federated