Thanks Owen ! Mark On Mon, Apr 25, 2011 at 11:43 AM, Owen O'Malley <omal...@apache.org> wrote:
> The SequenceFile sorter is ok. It used to be the sort used in the shuffle. > *grin* > > Make sure to set io.sort.factor and io.sort.mb to appropriate values for > your hardware. I'd usually use io.sort.factor as 25 * drives and io.sort.mb > is the amount of memory you can allocate to the sorting. > > -- Owen >
