[
https://issues.apache.org/jira/browse/PIG-781?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Gunther Hagleitner updated PIG-781:
-----------------------------------
Attachment: partial_failure.patch
The latest patch is against the latest code base. It also includes the test
with the "done" file. Finally, I was wrong about the log files. It's already
the case that all the errors are logged into the same pig file.
> Error reporting for failed MR jobs
> ----------------------------------
>
> Key: PIG-781
> URL: https://issues.apache.org/jira/browse/PIG-781
> Project: Pig
> Issue Type: Improvement
> Reporter: Gunther Hagleitner
> Attachments: partial_failure.patch, partial_failure.patch,
> partial_failure.patch
>
>
> If we have multiple MR jobs to run and some of them fail the behavior of the
> system is to not stop on the first failure but to keep going. That way jobs
> that do not depend on the failed job might still succeed.
> The question is to how best report this scenario to a user. How do we tell
> which jobs failed and which didn't?
> One way could be to tie jobs to stores and report which store locations won't
> have data and which ones do.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.