Hi,
I am considering to implement a Partitioner that needs to access the parameters
in Configuration of job. However, there is no straightforward way for this
task. Are there any suggestions?
Thanks,
Jianmin
Hi Jianmin,
Partitioner extends JobConfigurable, so you can implement the
configure() method to access the JobConf.
Hope that helps.
Cheers,
Tom
On Tue, Jul 14, 2009 at 10:27 AM, Jianmin Woo wrote:
> Hi,
>
> I am considering to implement a Partitioner that needs to access the
> parameters in C
From: Tom White
To: common-user@hadoop.apache.org
Sent: Tuesday, July 14, 2009 6:03:34 PM
Subject: Re: access Configuration object in Partioner??
Hi Jianmin,
Partitioner extends JobConfigurable, so you can implement the
configure() method to access the JobConf.
Hope that helps.
Cheers
.apache.org
> Sent: Tuesday, July 14, 2009 6:03:34 PM
> Subject: Re: access Configuration object in Partioner??
>
> Hi Jianmin,
>
> Partitioner extends JobConfigurable, so you can implement the
> configure() method to access the JobConf.
>
> Hope that helps.
>
> Ch
OK, I see. Thanks a lot for the help, Tom.
Best Regards,
Jianmin
From: Tom White
To: common-user@hadoop.apache.org
Sent: Tuesday, July 14, 2009 8:28:55 PM
Subject: Re: access Configuration object in Partioner??
Hi Jianmin,
Sorry - I (incorrectly) assumed
: access Configuration object in Partioner??
Hi Jianmin,
Partitioner extends JobConfigurable, so you can implement the
configure() method to access the JobConf.
Hope that helps.
Cheers,
Tom
On Tue, Jul 14, 2009 at 10:27 AM, Jianmin Woo wrote:
Hi,
I am considering to implement a Partitioner
On Tue, Jul 14, 2009 at 5:28 AM, Tom White wrote:
> Hi Jianmin,
>
> Sorry - I (incorrectly) assumed you were using the old API.
> Partitioners don't yet work with the new API (see
> https://issues.apache.org/jira/browse/MAPREDUCE-565).
MAPREDUCE-565 just went in, so new API partitioners will be
@hadoop.apache.org
Sent: Wednesday, July 15, 2009 12:05:16 PM
Subject: Re: access Configuration object in Partioner??
Your partitioner can implement Configurable (setConf(conf) and
getConf()). Please see
org.apache.hadoop.mapreduce.lib.partition.BinaryPartitioner
Thanks
Amareshwari
Jianmin Woo wrote:
> Tha
