Submit a Hadoop 1.1.1 job remotely to a Hadoop 2 cluster

2014-04-16 Thread Kim Chew
I have a cluster running Hadoop 2 but it is not running YARN, i.e. mapreduce.framework.name is set to classic therefore the ResourceManager is not running. On the Client side, I want to submit a job compiled with Hadoop-1.1.1 to the above cluster. Here how my Hadoop-1.1.1 mapred-site.xml looks

Re: Submit a Hadoop 1.1.1 job remotely to a Hadoop 2 cluster

2014-04-16 Thread Vinod Kumar Vavilapalli
You cannot run JobTracker/TaskTracker in Hadoop 2. It's neither supported nor even possible. +Vinod On Apr 16, 2014, at 2:27 PM, Kim Chew kchew...@gmail.com wrote: I have a cluster running Hadoop 2 but it is not running YARN, i.e. mapreduce.framework.name is set to classic therefore the

Re: Submit a Hadoop 1.1.1 job remotely to a Hadoop 2 cluster

2014-04-16 Thread Kim Chew
Vinod, I am confused here. So could you please explain what actually happened under the hood if mapreduce.framework.name is set to classic on the cluster side? Or it is supposed to be set to yarn in the first place? Thanks. Kim On Wed, Apr 16, 2014 at 7:06 PM, Vinod Kumar Vavilapalli

Re: Submit a Hadoop 1.1.1 job remotely to a Hadoop 2 cluster

2014-04-16 Thread Mike
On Apr 16, 2014, at 9:16 PM, Kim Chew kchew...@gmail.com wrote: Vinod, I am confused here. So could you please explain what actually happened under the hood if mapreduce.framework.name is set to classic on the cluster side? Or it is supposed to be set to yarn in the first place?