----- Original Message ----- From: Bejoy KS <bejoy.had...@gmail.com> Date: Tuesday, October 18, 2011 5:25 pm Subject: Re: execute hadoop job from remote web application To: common-user@hadoop.apache.org
> Oleg > If you are looking at how to submit your jobs using > JobClient then the > below sample can give you a start. > > //get the configuration parameters and assigns a job name > JobConf conf = new JobConf(getConf(), MyClass.class); > conf.setJobName("SMS Reports"); > > //setting key value types for mapper and reducer outputs > conf.setOutputKeyClass(Text.class); > conf.setOutputValueClass(Text.class); > > //specifying the custom reducer class > conf.setReducerClass(SmsReducer.class); > > //Specifying the input directories(@ runtime) and Mappers > independently for inputs from multiple sources > FileInputFormat.addInputPath(conf, new Path(args[0])); > > //Specifying the output directory @ runtime > FileOutputFormat.setOutputPath(conf, new Path(args[1])); > > JobClient.runJob(conf); > > Along with the hadoop jars you may need to have the config files > as well on > your client. > > The sample is from old map reduce API. You can use the new one as > well in > that we use the Job instead of JobClient. > > Hope it helps!.. > > Regards > Bejoy.K.S > > > On Tue, Oct 18, 2011 at 5:00 PM, Oleg Ruchovets > <oruchov...@gmail.com>wrote: > > Excellent. Can you give a small example of code. > > Good samle by Bejoy hope, you have access for this site. Also please go through this docs, http://hadoop.apache.org/common/docs/r0.20.2/mapred_tutorial.html#Example%3A+WordCount+v2.0 Here is the wordcount example. > > > > On Tue, Oct 18, 2011 at 1:13 PM, Uma Maheswara Rao G 72686 < > > mahesw...@huawei.com> wrote: > > > > > > > > ----- Original Message ----- > > > From: Oleg Ruchovets <oruchov...@gmail.com> > > > Date: Tuesday, October 18, 2011 4:11 pm > > > Subject: execute hadoop job from remote web application > > > To: common-user@hadoop.apache.org > > > > > > > Hi , what is the way to execute hadoop job on remote > cluster. I > > > > want to > > > > execute my hadoop job from remote web application , but I > didn't> > > find any > > > > hadoop client (remote API) to do it. > > > > > > > > Please advice. > > > > Oleg > > > > > > > You can put the Hadoop jars in your web applications classpath > and find > > the > > > Class JobClient and submit the jobs using it. > > > > > > Regards, > > > Uma > > > > > > > > > Regards Uma