[
https://issues.apache.org/jira/browse/PIG-2642?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Thomas Weise updated PIG-2642:
------------------------------
Attachment: PIG-2642.patch
Reversing order of commitJob and storeCleanup calls in PigOutputCommitter to
maintain 0.20 behavior under 0.23.
> StoreMetadata.storeSchema can't access files in the output directory (Hadoop
> 0.23)
> ----------------------------------------------------------------------------------
>
> Key: PIG-2642
> URL: https://issues.apache.org/jira/browse/PIG-2642
> Project: Pig
> Issue Type: Bug
> Reporter: Thomas Weise
> Assignee: Thomas Weise
> Fix For: 0.10.0, 0.9.3, 0.11
>
> Attachments: PIG-2642.patch
>
>
> With Hadoop 0.20/1.0, storeSchema will be called after the temporary task
> files have been promoted to the output directory.
> In 0.23, the timing of temporary task file promotion has changed by design,
> now when storeSchema is called the files have not been promoted to the output
> directory.
> We have existing applications that depend on the temporary task files being
> promoted when storeSchema is called. This is a regression from 20.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
