.20.0, Partitioners?

2009-04-27 Thread Ryan Farris
Is there some magic to get a Partitioner working on .20.0? Setting the partitioner class on the Job object doesn't take, hadoop always uses the HashPartitioner. Looking through the source code, it looks like the MapOutputBuffer in MapTask only ever fetches the "mapred.partitioner.class", and does

Re: .20.0, Partitioners?

2009-04-27 Thread Jothi Padmanabhan
Ryan, I observed this behavior too -- Partitioner does not seems to work with the new API exactly for the reason you have mentioned. Till this gets fixed, you probably need to use the old API. Jothi On 4/27/09 7:14 PM, "Ryan Farris" wrote: > Is there some magic to get a Partitioner working on

Re: .20.0, Partitioners?

2009-04-27 Thread Jothi Padmanabhan
I created https://issues.apache.org/jira/browse/HADOOP-5750 to follow this up. Thanks Jothi On 4/27/09 10:10 PM, "Jothi Padmanabhan" wrote: > Ryan, > > I observed this behavior too -- Partitioner does not seems to work with the > new API exactly for the reason you have mentioned. Till thi