Pig does not honor mapreduce.fileoutputcommitter.marksuccessfuljobs
-------------------------------------------------------------------
Key: PIG-1753
URL: https://issues.apache.org/jira/browse/PIG-1753
Project: Pig
Issue Type: Bug
Components: impl
Affects Versions: 0.7.0
Reporter: Alejandro Abdelnur
Hadoop FileOutputCommitter has a flag to write a _SUCCESS file in the output
directory on job completion:
mapreduce.fileoutputcommitter.marksuccessfuljobs = true
PigOutputCommitter does not extend FileOutputCommitter thus did not get this
feature when it was introduced to FileOutputCommitter.
The absence of this make Oozie coordinator jobs to work incorrectly when using
Pig jobs.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.