Also take a look at the optimizations as done in this paper:
http://www.deepdyve.com/lp/association-for-computing-machinery/flumejava-easy-efficient-data-parallel-pipelines-wwPgFt2hWB
On Tue, Dec 28, 2010 at 9:13 PM, Harsh J wrote:
> Have a look at MultipleInputs
>
> On Wed, Dec 29, 2010 at 4:39
Have a look at MultipleInputs
On Wed, Dec 29, 2010 at 4:39 AM, Jander g wrote:
> Hi James,
>
> Thanks for your attention.
>
> Suppose there are only 2 map running in Hadoop cluster, I want to using one
> map to sort and another to wordcount in the same time in the same Hadoop
> cluster.
>
> On We
Simple answer is: submit two jobs.
Hadoop is designed to run many tasks simultaneously.
Cheers
J
Sent from my mobile. Please excuse the typos.
On 2010-12-28, at 4:09 PM, Jander g wrote:
> Hi James,
>
> Thanks for your attention.
>
> Suppose there are only 2 map running in Hadoop cluster, I w
Hi Jander,
If I understand what u want , u would like to run the map instances of two
different mapreduces (so obviously different mapper codes) simultaneously on
the same machine. If I am correct, it has got more to do with the number of
simultaneous mapper instances setting (I guess its default
Hi Jander,
You mean write Map in another language? like python or C, then yes. Check
this http://hadoop.apache.org/common/docs/r0.18.0/streaming.html for Hadoop
Streaming.
Maha
On Dec 28, 2010, at 2:53 PM, Jander g wrote:
> Hi, all
>
> Whether Hadoop supports the map function running dif
Yes, that is what I mean.
But what the condition is if I want to using one map to sort and another to
wordcount in the same time in the same Hadoop cluster. I have no idea.
Thanks,
Jander
On Wed, Dec 29, 2010 at 7:08 AM, Ted Dunning wrote:
> if you mean running different code in different mapp
Hi James,
Thanks for your attention.
Suppose there are only 2 map running in Hadoop cluster, I want to using one
map to sort and another to wordcount in the same time in the same Hadoop
cluster.
On Wed, Dec 29, 2010 at 6:58 AM, James Seigel wrote:
> Not sure what you mean.
>
> Can you write cu
if you mean running different code in different mappers, I recommend using
an if statement.
On Tue, Dec 28, 2010 at 2:53 PM, Jander g wrote:
> Whether Hadoop supports the map function running different code? If yes,
> how
> to realize this?
>
Not sure what you mean.
Can you write custom code for your map functions?: yes
Cheers
James
Sent from my mobile. Please excuse the typos.
On 2010-12-28, at 3:54 PM, Jander g wrote:
> Hi, all
>
> Whether Hadoop supports the map function running different code? If yes, how
> to realize this?
>
Hi, all
Whether Hadoop supports the map function running different code? If yes, how
to realize this?
Thanks in advance!
--
Regards,
Jander
10 matches
Mail list logo
