[
https://issues.apache.org/jira/browse/HCATALOG-499?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13453671#comment-13453671
]
Vandana Ayyalasomayajula commented on HCATALOG-499:
---------------------------------------------------
[~traviscrawford] The problem is due to the change in how jobcontext is being
constructed, as explained in the first comment. Basically, the property
"mapred.output.dir" needs to be set again in the FileOutputCommitterContainer
class. We have tested the patch internally and it fixes the issue. For the
outputs for the before and after the fix, I can post tomorrow.
> Multiple store commands does not work with Hadoop23
> ---------------------------------------------------
>
> Key: HCATALOG-499
> URL: https://issues.apache.org/jira/browse/HCATALOG-499
> Project: HCatalog
> Issue Type: Bug
> Affects Versions: 0.4.1
> Reporter: Rohini Palaniswamy
> Assignee: Rohini Palaniswamy
> Fix For: 0.5, 0.4.1
>
> Attachments: HCATALOG-499.patch
>
>
> There is change in the semantics of
> JobContext::JobContext(Configuration, JobID). While in .20, the Config was
> cloned, in .23 the Config is adopted (if it's a JobConf). That combined with
> the way mapred Task.java handles output committers that do not extend
> FileOutputCommitter has broken storing different partitions to the same table
> with multiple store statements in pig.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators
For more information on JIRA, see: http://www.atlassian.com/software/jira
