gt; From: Joey Echeverria [mailto:j...@cloudera.com]
> > Sent: Tuesday, October 04, 2011 11:06 AM
> > To: mapreduce-user@hadoop.apache.org
> > Subject: Re: Submitting a Hadoop task from withing a reducer
> >
> > You may want to check out Yarn, coming in Hadoop 0.23:
ustom application master for his job type right?
>
> Matt
>
> -Original Message-
> From: Joey Echeverria [mailto:j...@cloudera.com]
> Sent: Tuesday, October 04, 2011 11:06 AM
> To: mapreduce-user@hadoop.apache.org
> Subject: Re: Submitting a Hadoop task from withing a r
Subject: Re: Submitting a Hadoop task from withing a reducer
You may want to check out Yarn, coming in Hadoop 0.23:
https://issues.apache.org/jira/browse/MAPREDUCE-279
-Joey
On Tue, Oct 4, 2011 at 11:45 AM, Yaron Gonen wrote:
> Hi,
> Hadoop tasks are always stacked to form a linear user-m
As long as your reduce task can kick off the MR job asynchronously then it
shouldn't be too much of an issue but it could very quickly result in a
deadlock otherwise. If you set this up as two stages 1) to kick off the
recursive MR and 2) analyze the final result set then it should work but off
You may want to check out Yarn, coming in Hadoop 0.23:
https://issues.apache.org/jira/browse/MAPREDUCE-279
-Joey
On Tue, Oct 4, 2011 at 11:45 AM, Yaron Gonen wrote:
> Hi,
> Hadoop tasks are always stacked to form a linear user-managed workflow (a
> reduce step cannot start before all previous m
