You can use MultipleOutputFormat or MultipleOutputs (it has been
committed to SVN a few days ago) for this.
Then you can use a filter on your input dir for the next jobs so only
files matching a given name/pattern are used.
A
On Fri, Jul 11, 2008 at 8:54 PM, Jason Venner <[EMAIL PROTECTED]> wrot
We open side effect files in our map and reduce jobs to 'tee' off
additional data streams.
We open them in the /configure/ method and close them in the /close/ method
The /configure/ method provides access to the /JobConf.
/We create our files relative to value of conf.get("mapred.output.dir"),
xt:
http://www.nabble.com/Outputting-to-different-paths-from-the-same-input-file-tp18395861p18395861.html
Sent from the Hadoop core-user mailing list archive at Nabble.com.
