[
https://issues.apache.org/jira/browse/MAPREDUCE-1447?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12828980#action_12828980
]
Daniel Dai commented on MAPREDUCE-1447:
---------------------------------------
Hi, Vinod,
I am a Pig developer and we are refactoring part of Pig code. We use a custom
OutputCommitter. We setup our OutputCommitter through custom OutputFormat. The
actually code is too big to post here, but we do not use anything fancy for job
submission. Here is some the client code look like:
job.setOutputFormatClass(PigOutputFormat.class);
......
jobCtrl.addJob(job);
......
Thread jcThread = new Thread(jobCtrl);
jcThread.start();
We see everything is ok in map-reduce mode. But in local mode, we didn't see
the above mentioned hooks get called. Is that because we are using 0.20.1, and
this is fixed in the newer version?
> job level hook in OutputCommitter is not working in local mode
> --------------------------------------------------------------
>
> Key: MAPREDUCE-1447
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-1447
> Project: Hadoop Map/Reduce
> Issue Type: Bug
> Affects Versions: 0.20.1
> Reporter: Daniel Dai
>
> OutputCommitter is not totally working in local mode. Only task level hooks
> are called, which are setupTask, needsTaskCommit, commitTask, abortTask. Job
> level hooks are not working, which are: setupJob, cleanupJob.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
