[
https://issues.apache.org/jira/browse/HADOOP-1851?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel#action_12530641
]
Arun C Murthy commented on HADOOP-1851:
---------------------------------------
As Riccardo says we clearly need another configuration property... how about:
Map Outputs:
mapred.map.output.compression.{type|codec}
JobConf.{get|set}MapOutputCompression{Type|Codec}
Job Outputs:
mapred.output.compression.{type|codec}
JobConf.{get|set}OutputCompression{Type|Codec}
That's the easy bit, however I think that this will snow-ball into a large-ish
patch since this will entail hunting down all {{OutputFormat}} implementations
and ensuring that they use mapred.output.compression.{type|codec} properties...
clearly something we *have* to fix. Of course, I'll ensure this is clearly
documented for folks who write their own {{OutputFormat}}s.
> Map output compression codec cannot be set independently of job output
> compression codec
> ----------------------------------------------------------------------------------------
>
> Key: HADOOP-1851
> URL: https://issues.apache.org/jira/browse/HADOOP-1851
> Project: Hadoop
> Issue Type: Bug
> Components: mapred
> Affects Versions: 0.14.1
> Reporter: Riccardo
> Assignee: Arun C Murthy
>
> The property "mapred.output.compression.codec" is used when setting and
> getting the map output compression codec in JobConf, thus making it
> impossible to use a different codec for map outputs and overall job outputs.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
