Running Back to Back Map-reduce jobs

2011-06-02 Thread Adarsh Sharma
Dear all, I ran several map-reduce jobs in Hadoop Cluster of 4 nodes. Now this time I want a map-reduce job to be run again after one. Fore.g to clear my point, suppose a wordcount is run on gutenberg file in HDFS and after completion 11/06/02 15:14:35 WARN mapred.JobClient: No job jar file

Re: Running Back to Back Map-reduce jobs

2011-06-02 Thread Harsh J
Oozie's workflow feature may exactly be what you're looking for. It can also do much more than just chain jobs. Check out additional features at: http://yahoo.github.com/oozie/ On Thu, Jun 2, 2011 at 4:48 PM, Adarsh Sharma wrote: > Dear all, > > I ran several map-reduce jobs in Hadoop Cluster of

Re: Running Back to Back Map-reduce jobs

2011-06-02 Thread Adarsh Sharma
Ok, Is it valid for running jobs through Hadoop Pipes too. Thanks Harsh J wrote: Oozie's workflow feature may exactly be what you're looking for. It can also do much more than just chain jobs. Check out additional features at: http://yahoo.github.com/oozie/ On Thu, Jun 2, 2011 at 4:48 PM, Ada

Re: Running Back to Back Map-reduce jobs

2011-06-02 Thread Harsh J
Yes, I believe Oozie does have Pipes and Streaming action helpers as well. On Thu, Jun 2, 2011 at 5:05 PM, Adarsh Sharma wrote: > Ok, Is it valid for running jobs through Hadoop Pipes too. > > Thanks > > Harsh J wrote: >> >> Oozie's workflow feature may exactly be what you're looking for. It >> c

Re: Running Back to Back Map-reduce jobs

2011-06-02 Thread Adarsh Sharma
Thanks a lot, I will let you know after some work on it. :-) Harsh J wrote: Yes, I believe Oozie does have Pipes and Streaming action helpers as well. On Thu, Jun 2, 2011 at 5:05 PM, Adarsh Sharma wrote: Ok, Is it valid for running jobs through Hadoop Pipes too. Thanks Harsh J wrote:

Re: Running Back to Back Map-reduce jobs

2011-06-07 Thread Adarsh Sharma
Harsh J wrote: Yes, I believe Oozie does have Pipes and Streaming action helpers as well. On Thu, Jun 2, 2011 at 5:05 PM, Adarsh Sharma wrote: Ok, Is it valid for running jobs through Hadoop Pipes too. Thanks Harsh J wrote: Oozie's workflow feature may exactly be what you're looking

Re: Running Back to Back Map-reduce jobs

2011-06-21 Thread madhu phatak
You can use ControlledJob's addDependingJob to handle dependency between multiple jobs. On Tue, Jun 7, 2011 at 4:15 PM, Adarsh Sharma wrote: > Harsh J wrote: > >> Yes, I believe Oozie does have Pipes and Streaming action helpers as well. >> >> On Thu, Jun 2, 2011 at 5:05 PM, Adarsh Sharma >> wro