All,
What I want to do is output from my reducer multiple files one for each key
value.
Can this still be done in the current API?
It seems that using MultipleTextOutputFormat requires one to use deprecated
parts of API.
It this correct?
I would like to use the class or its equivalent and stay
Geoffry,
The new API comes with a related OF, called MultipleOutputs
(o.a.h.mapreduce.lib.output.MultipleOutputs). You may want to look into
using this instead.
- Aaron
On Tue, Sep 29, 2009 at 4:44 PM, Geoffry Roberts
wrote:
> All,
>
> What I want to do is output from my reducer multiple files
All,
This one has me stumped.
What I want to do is output from my reducer multiple files, one for each key
value. I also want to avoid any deprecated parts of the API.
As suggested, I switched from using MultipleTextOutputFormat to
MultipleOutputs but have run into an impasse. MultipleOutputs'
Geoffry,
There are two MultipleOutputs implementations; one for the new API, one for
the old one.
The new API (org.apache.hadoop.mapreduce.lib.output.MultipleOutputs) does
not have a getCollector() method. This is intended to work with
org.apache.hadoop.mapreduce.Mapper and its associated Context
Aaron,
I am using 0.20.1 and I'm not finding org.apache.hadoop.mapreduce.
>
> lib.output.MultipleOutputs. I'm using the download page where the tar ball
> is dated from Sep.09.
> Sounds like I need to look at the code repository.
>
On Tue, Dec 8, 2009 at 1:39 PM, Aaron Kimball wrote:
> Geo
http://issues.apache.org/jira/browse/MAPREDUCE-370
You'll have to work around for now / try to apply patch.
Amogh
On 12/9/09 8:54 PM, "Geoffry Roberts" wrote:
Aaron,
I am using 0.20.1 and I'm not finding org.apache.hadoop.mapreduce.
lib.output.MultipleOutputs. I'm using the download page w
Amogh,
I don't have experience with patches for hadoop.
I take it that I apply this patch using the linux patch utility.
I further assume, I need only apply the latest patch, which is 5.
Am I correct.
On Wed, Dec 9, 2009 at 7:30 AM, Amogh Vasekar wrote:
> http://issues.apache.org/jira/brows
Yes. Also attached is an old thread I have kept handy with me. Hope this helps
you.
Thanks,
Amogh
On 12/11/09 10:07 PM, "Geoffry Roberts" wrote:
Amogh,
I don't have experience with patches for hadoop.
I take it that I apply this patch using the linux patch utility.
I further assume, I nee
Amogh,
Thanks for the attachment. I'll hold on to it.
If I may press you a bit further, I noticed that the directory tree is
different in the distribution I downloaded than the various paths I see in
the the patch. It is different still in the svn trunk.
What I want is to apply the patch to my
