[
https://issues.apache.org/jira/browse/MAPREDUCE-2493?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13280251#comment-13280251
]
Robert Joseph Evans commented on MAPREDUCE-2493:
------------------------------------------------
Bh.V.S.Kamesh,
I am not an expert on the code, but I thought that this was by design. In the
older APIs the configs for output format and output committer were separate,
but the committer is tied quite closely to the output format. If I am
outputting to a DB using a DB Output Format I now have to set two configs
instead of just one to make this work. What is more I may need to play some
odd games to make it so that a DB output committer even works so that I can
commit/roll back the results, something that the current DB output format does
not implement. This comes at the expense of making it more difficult to
override the OutputCommitter, but my experience with the FileOutputCommitter,
it is not really designed so that it can be subclassed in a clean extensible
way.
That being said I am fine with adding in the ability to override the output
committer through a configuration on the newer API, I am just not sure that
this is the proper way to do it. I have not had time to really think through
it. At a minimum please upmerge the patch. It no longer applies.
> New Api FileOutputFormat does not honour user specified OutputCommitter
> -----------------------------------------------------------------------
>
> Key: MAPREDUCE-2493
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-2493
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Components: mrv2
> Affects Versions: 0.23.0, 0.24.0
> Reporter: Sharad Agarwal
> Assignee: Bhallamudi Venkata Siva Kamesh
> Attachments: MAPREDUCE-2493.patch
>
>
> o.a.h.mapreduce.lib.output.FileOutputFormat always uses the default
> FileOutputCommitter. It ignores the user specified OutputCommitter.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira
