RE: How to manage hadoop job submit?

2011-11-21 Thread WangRamon
Hi Harsh It seems the hadoop i'm using doesn't have the API you talked about, the version i'm using is hadoop-branch-0.20-append. Thanks Ramon > From: ha...@cloudera.com > Subject: Re: How to manage hadoop job submit? > Date: Mon, 21 Nov 2011 13:39:06 +0530 > To: co

Re: How to manage hadoop job submit?

2011-11-21 Thread Harsh J
Ramon, If you want to submit with an attached priority, use the APIs [0] and [1] to set the appropriate level before you submit from your JobClient/Job instances. [0 - New API] - http://hadoop.apache.org/mapreduce/docs/current/api/org/apache/hadoop/mapreduce/Job.html#setPriority(org.apache.hado

Re: How to manage hadoop job submit?

2011-11-20 Thread Ronnie Dove
mon To: common-user@hadoop.apache.org Sent: Monday, November 21, 2011 1:26 AM Subject: RE: How to manage hadoop job submit? Thanks Richard, but i still have a question, if i'm using hadoop jar to submit a job, how can i set the priority for each job? I do see something like this "mapred.job.p

RE: How to manage hadoop job submit?

2011-11-20 Thread WangRamon
, "HIGH"), it seems it doesn't work. Thanks Cheers Ramon > Date: Sun, 20 Nov 2011 09:42:43 -0800 > From: rich.dixon2...@yahoo.com > Subject: Re: How to manage hadoop job submit? > To: common-user@hadoop.apache.org > > Ramon, > > You might issue an ./hadoo

Re: How to manage hadoop job submit?

2011-11-20 Thread Prashant Sharma
Richard and Ramon Yes, I think there should be a way as you see there is a class named JobClient in org.apache.hadoop.mapred which is basically invoked from commandline , if you open hadoop shell script my point will be clearer. Also I suggest you take a look at oozie there using java apis you can

Re: How to manage hadoop job submit?

2011-11-20 Thread Richard Dixon
Ramon, You might issue an ./hadoop -list all to get the jobs and then -set-priority .  I know that someone from that Ocean Sync (http://www.oceansync.com) Hadoop management project is working with interacting with MapReduce jobs through a GUI, to set priorities through that, but they are stil