Dear all,
I ran several map-reduce jobs in Hadoop Cluster of 4 nodes.
Now this time I want a map-reduce job to be run again after one.
Fore.g to clear my point, suppose a wordcount is run on gutenberg file
in HDFS and after completion
11/06/02 15:14:35 WARN mapred.JobClient: No job jar file
Oozie's workflow feature may exactly be what you're looking for. It
can also do much more than just chain jobs.
Check out additional features at: http://yahoo.github.com/oozie/
On Thu, Jun 2, 2011 at 4:48 PM, Adarsh Sharma wrote:
> Dear all,
>
> I ran several map-reduce jobs in Hadoop Cluster of
Ok, Is it valid for running jobs through Hadoop Pipes too.
Thanks
Harsh J wrote:
Oozie's workflow feature may exactly be what you're looking for. It
can also do much more than just chain jobs.
Check out additional features at: http://yahoo.github.com/oozie/
On Thu, Jun 2, 2011 at 4:48 PM, Ada
Yes, I believe Oozie does have Pipes and Streaming action helpers as well.
On Thu, Jun 2, 2011 at 5:05 PM, Adarsh Sharma wrote:
> Ok, Is it valid for running jobs through Hadoop Pipes too.
>
> Thanks
>
> Harsh J wrote:
>>
>> Oozie's workflow feature may exactly be what you're looking for. It
>> c
Thanks a lot, I will let you know after some work on it.
:-)
Harsh J wrote:
Yes, I believe Oozie does have Pipes and Streaming action helpers as well.
On Thu, Jun 2, 2011 at 5:05 PM, Adarsh Sharma wrote:
Ok, Is it valid for running jobs through Hadoop Pipes too.
Thanks
Harsh J wrote:
Harsh J wrote:
Yes, I believe Oozie does have Pipes and Streaming action helpers as well.
On Thu, Jun 2, 2011 at 5:05 PM, Adarsh Sharma wrote:
Ok, Is it valid for running jobs through Hadoop Pipes too.
Thanks
Harsh J wrote:
Oozie's workflow feature may exactly be what you're looking
You can use ControlledJob's addDependingJob to handle dependency between
multiple jobs.
On Tue, Jun 7, 2011 at 4:15 PM, Adarsh Sharma wrote:
> Harsh J wrote:
>
>> Yes, I believe Oozie does have Pipes and Streaming action helpers as well.
>>
>> On Thu, Jun 2, 2011 at 5:05 PM, Adarsh Sharma
>> wro