Hi,
I was wondering is it possible to submit MapReduce job on remote Hadoop cluster.
(i.e) Submitting the job from the machine which doesn't have Hadoop installed
and submitting to different machine where Hadoop installed.
Is it possible to do this?
I guess at least data can be uploaded to HDFS
Both are possible. You may have to have access to the data and task nodes
for some operations. If you can see all of the nodes in your cluster, you
should be able to do everything.
On 5/23/08 1:46 PM, Natarajan, Senthil [EMAIL PROTECTED] wrote:
Hi,
I was wondering is it possible to submit
To: core-user@hadoop.apache.org; '[EMAIL PROTECTED]'
Subject: Re: Remote Job Submission
Both are possible. You may have to have access to the data and task nodes
for some operations. If you can see all of the nodes in your cluster, you
should be able to do everything.
On 5/23/08 1:46 PM
Ted Dunning wrote:
- in order to submit the job, I think you only need to see the job-tracker.
Somebody should correct me if I am wrong.
No, you also need to be able to write the job.xml, job.jar, and
job.split into HDFS. Someday perhaps we'll pass these via RPC to the
jobtracker and have
be
submitted remotely from the client machine.
Thanks,
Senthil
-Original Message-
From: Ted Dunning [mailto:[EMAIL PROTECTED]
Sent: Friday, May 23, 2008 4:52 PM
To: core-user@hadoop.apache.org; '[EMAIL PROTECTED]'
Subject: Re: Remote Job Submission
Both are possible. You may have
