[
https://issues.apache.org/jira/browse/HADOOP-1851?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Arun C Murthy updated HADOOP-1851:
----------------------------------
Attachment: HADOOP-1851_2_20070929.patch
Another go at this one...
With this, one can do:
{noformat}
$ hadoop jar build/hadoop-0.15.0-dev-examples.jar randomwriter
-Dmapred.output.compress=true -Dmapred.output.compression.type=BLOCK
-Dmapred.output.compression.codec=org.apache.hadoop.io.compress.LzoCodec /rw/in
hadoop jar build/hadoop-0.15.0-dev-examples.jar sort
-Dmapred.output.compress=true -Dmapred.output.compression.type=BLOCK
-Dmapred.output.compression.codec=org.apache.hadoop.io.compress.LzoCodec
-Dmapred.map.output.compress=true -Dmapred.map.output.compression.type=RECORD
-Dmapred.map.output.compression.codec=org.apache.hadoop.io.compress.DefaultCodec
/rw/in /rw/out
{noformat}
> Map output compression codec cannot be set independently of job output
> compression codec
> ----------------------------------------------------------------------------------------
>
> Key: HADOOP-1851
> URL: https://issues.apache.org/jira/browse/HADOOP-1851
> Project: Hadoop
> Issue Type: Bug
> Components: mapred
> Affects Versions: 0.14.1
> Reporter: Riccardo
> Assignee: Arun C Murthy
> Fix For: 0.15.0
>
> Attachments: HADOOP-1851_1_20070929.patch,
> HADOOP-1851_2_20070929.patch
>
>
> The property "mapred.output.compression.codec" is used when setting and
> getting the map output compression codec in JobConf, thus making it
> impossible to use a different codec for map outputs and overall job outputs.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
