Re: Newbie: multiple output files

2008-11-23 Thread tim robertson
Hi Jeremy, Thank you very much! Exactly what I was looking for Cheers, Tim On Sun, Nov 23, 2008 at 2:21 PM, Jeremy Chow <[EMAIL PROTECTED]> wrote: > Hi Tim, > > You can write a class inherit from org.apache.hadoop.mapred.lib. > MultipleOutputFormat. Override method generateFileNameForKeyValue

Re: Newbie: multiple output files

2008-11-23 Thread Jeremy Chow
Hi Tim, You can write a class inherit from org.apache.hadoop.mapred.lib. MultipleOutputFormat. Override method generateFileNameForKeyValue() like this 1. @Override 2. protected String generateFileNameForKeyValue(K key, V value, String name) { 3. return name + "_" + v

Newbie: multiple output files

2008-11-23 Thread tim robertson
Hi, Can someone please point me at the best way to create multiple output files based on the Key outputted from the Map? So I end up with no reduction, but a file per Key outputted in the Mapping phase, ideally with the Key as the file name. Many thanks, Tim