Hi Alejandro, Thanks for the quick reply. Your suggestion looks good and will try that approach.
Thanks Sunil ________________________________ From: Alejandro Abdelnur <[email protected]> To: [email protected]; Sunil Tripathy <[email protected]> Sent: Friday, June 1, 2012 8:47 PM Subject: Re: Running multiple insance of the same MR job with diff param values using oozie Sunil, Currently you cannot do this as you suggest. I refer to this a sharding, I have played with some prototype code that does this but still have not managed todo a full integration so it is in condition to be submitted as patch. However, you could use an alternative approach, using subworkflow calls from the fork lanes, all calls to the same subworkflow app, but with different params. Hope this helps. Thx On Fri, Jun 1, 2012 at 6:50 PM, Sunil Tripathy <[email protected]> wrote: I need to run multiple instance of the same MR job with slightly different parameters and join at the end of the completion of all the MR jobs. I know I can use fork/join to launch multiple MR jobs in oozie workflow and join at the end. But is it possible to use the same <map-reduce> jab name and pass different params to the job in the workflow definition? I do not want to repeat the RM job definition multple times with different names. >Will appreciate any help. >thanks > >-Sunil > -- Alejandro
