mapred.output.compress in SET statement does not work
-----------------------------------------------------
Key: PIG-1814
URL: https://issues.apache.org/jira/browse/PIG-1814
Project: Pig
Issue Type: Bug
Affects Versions: 0.8.0
Reporter: Daniel Dai
Assignee: Daniel Dai
Fix For: 0.8.0
Setting output compression using "SET" in the script does not work:
SET mapred.output.compress true;
SET mapred.output.compression.codec org.apache.hadoop.io.compress.GzipCodec;
We did some trick to make individual compression setting for multistore work.
Instead of the above parameter, using the following works:
SET output.compression.enabled true;
SET output.compression.codec org.apache.hadoop.io.compress.GzipCodec;
However, this is against intuition. We should use
mapred.output.compress/mapred.output.compression.codec.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
