t: Monday, June 27, 2011 3:29 PM
> To: mapreduce-u...@hadoop.apache.org
> Cc: core-u...@hadoop.apache.org
> Subject: Re: How to select random n records using mapreduce ?
>
> The only solution I can think of is by creating a counter in Hadoop
> that is incremented each time a mapper
Wait - Habermaas like in Critical Theory
-Original Message-
From: Habermaas, William [mailto:william.haberm...@fatwire.com]
Sent: Monday, June 27, 2011 2:55 PM
To: common-user@hadoop.apache.org
Subject: RE: How to select random n records using mapreduce ?
I did something similar
, June 27, 2011 3:29 PM
To: mapreduce-u...@hadoop.apache.org
Cc: core-u...@hadoop.apache.org
Subject: Re: How to select random n records using mapreduce ?
The only solution I can think of is by creating a counter in Hadoop
that is incremented each time a mapper lets a record through.
As soon as the
The only solution I can think of is by creating a counter in Hadoop
that is incremented each time a mapper lets a record through.
As soon as the value reaches a preselected value the mappers simply
discard the additional input they receive.
Note that this will not at all be random yet it's the