----- Original Message -----
From: Bejoy KS <bejoy.had...@gmail.com>
Date: Tuesday, October 18, 2011 5:25 pm
Subject: Re: execute hadoop job from remote web application
To: common-user@hadoop.apache.org

> Oleg
>      If you are looking at how to submit your jobs using 
> JobClient then the
> below sample can give you a start.
> 
> //get the configuration parameters and assigns a job name
>        JobConf conf = new JobConf(getConf(), MyClass.class);
>        conf.setJobName("SMS Reports");
> 
>        //setting key value types for mapper and reducer outputs
>        conf.setOutputKeyClass(Text.class);
>        conf.setOutputValueClass(Text.class);
> 
>        //specifying the custom reducer class
>        conf.setReducerClass(SmsReducer.class);
> 
>        //Specifying the input directories(@ runtime) and Mappers
> independently for inputs from multiple sources
>        FileInputFormat.addInputPath(conf, new Path(args[0]));
> 
>        //Specifying the output directory @ runtime
>        FileOutputFormat.setOutputPath(conf, new Path(args[1]));
> 
>        JobClient.runJob(conf);
> 
> Along with the hadoop jars you may need to have the config files 
> as well on
> your client.
> 
> The sample is from old map reduce API. You can use the new one as 
> well in
> that we use the Job instead of JobClient.
> 
> Hope it helps!..
> 
> Regards
> Bejoy.K.S
> 
> 
> On Tue, Oct 18, 2011 at 5:00 PM, Oleg Ruchovets 
> <oruchov...@gmail.com>wrote:
> > Excellent. Can you give a small example of code.
> >
Good samle by Bejoy
hope, you have access for this site.
Also please go through this docs,
http://hadoop.apache.org/common/docs/r0.20.2/mapred_tutorial.html#Example%3A+WordCount+v2.0
Here is the wordcount example.

> >
> > On Tue, Oct 18, 2011 at 1:13 PM, Uma Maheswara Rao G 72686 <
> > mahesw...@huawei.com> wrote:
> >
> > >
> > > ----- Original Message -----
> > > From: Oleg Ruchovets <oruchov...@gmail.com>
> > > Date: Tuesday, October 18, 2011 4:11 pm
> > > Subject: execute hadoop job from remote web application
> > > To: common-user@hadoop.apache.org
> > >
> > > > Hi , what is the way to execute hadoop job on remote 
> cluster. I
> > > > want to
> > > > execute my hadoop job from remote web  application , but I 
> didn't> > > find any
> > > > hadoop client (remote API) to do it.
> > > >
> > > > Please advice.
> > > > Oleg
> > > >
> > > You can put the Hadoop jars in your web applications classpath 
> and find
> > the
> > > Class JobClient and submit the jobs using it.
> > >
> > > Regards,
> > > Uma
> > >
> > >
> >
> 
Regards
Uma

Reply via email to