You could have a look at the MapReduce pipelines in Apache Mahout
(http://mahout.apache.org). See for instance
org.apache.mahout.cf.taste.hadoop.item.RecommenderJob. This shows how
most of Mahout constructs and runs a series of rounds of MapReduce to
accomplish a task. Each job feeds into one or mo
Actually, HaLoop is a new framework above Hadoop which targets the problem
of transitive closure algorithms. This type of algorithms contain rounds of
hadoop jobs, so I think it may contain some useful examples for you.
On Mon, Jun 13, 2011 at 6:39 PM, Arko Provo Mukherjee <
arkoprovomukher...@gma
Hello,
Thanks everyone for your responses.
I am new to Hadoop, so this was a lot of new information for me. I will
surely go though all of these.
However, I was actually hoping that someone could point me to some example
codes where multiple rounds of map-reduce has been used.
Please let me kno
I think HaLoop is a framework which can answer your question:
http://code.google.com/p/haloop/
On Mon, Jun 13, 2011 at 5:46 PM, Arko Provo Mukherjee <
arkoprovomukher...@gmail.com> wrote:
> Hello,
>
> I am trying to write a program where I need to write multiple rounds of map
> and reduce.
>
> Th
t; -Original Message-
> From: Marcos Ortiz [mailto:mlor...@uci.cu]
> Sent: Monday, June 13, 2011 4:57 PM
> To: mapreduce-user@hadoop.apache.org
> Cc: Arko Provo Mukherjee
> Subject: Re: Programming Multiple rounds of mapreduce
>
> Well, you can define a job for each rou
PPORT/CDH3+Downloadable+Tarballs
Matt
-Original Message-
From: Marcos Ortiz [mailto:mlor...@uci.cu]
Sent: Monday, June 13, 2011 4:57 PM
To: mapreduce-user@hadoop.apache.org
Cc: Arko Provo Mukherjee
Subject: Re: Programming Multiple rounds of mapreduce
Well, you can define a job for each round and
Well, you can define a job for each round and then, you can define the
running workflow based in your implementation and to chain your jobs
El 6/13/2011 5:46 PM, Arko Provo Mukherjee escribió:
Hello,
I am trying to write a program where I need to write multiple rounds
of map and reduce.
The
Hi,
On Mon, Jun 13, 2011 at 11:46 PM, Arko Provo Mukherjee
wrote:
> Hello,
>
> I am trying to write a program where I need to write multiple rounds of map
> and reduce.
>
> The output of the last round of map-reduce must be fed into the input of the
> next round.
>
> Can anyone please guide me to
Hello,
I am trying to write a program where I need to write multiple rounds of map
and reduce.
The output of the last round of map-reduce must be fed into the input of the
next round.
Can anyone please guide me to any link / material that can teach me as to
how I can achieve this.
Thanks a lot
