[ https://issues.apache.org/jira/browse/PIG-781?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12705951#action_12705951 ]
Gunther Hagleitner edited comment on PIG-781 at 5/5/09 1:19 AM: ---------------------------------------------------------------- This fix associates stores with MR jobs. At the end of the execution it will print out which stores have passed and which ones have failed. Example: {noformat} 50% complete 100% complete 1 map reduce job(s) failed! Failed to produce result in: "/user/hagleitn/baz" Successfully stored result in: "/user/hagleitn/bar" Successfully stored result in: "/user/hagleitn/foo" Some jobs have failed! {noformat} was (Author: hagleitn): This fix associates stores with MR jobs. At the end of the execution it will print out which stores have passed and which ones have failed. Example: {noformat} 50% complete 100% complete 1 map reduce job(s) failed! Failed to produce result in: "hdfs://wilbur11.labs.corp.sp1.yahoo.com/user/hagleitn/baz" Successfully stored result in: "hdfs://wilbur11.labs.corp.sp1.yahoo.com/user/hagleitn/bar" Successfully stored result in: "hdfs://wilbur11.labs.corp.sp1.yahoo.com/user/hagleitn/foo" Some jobs have failed! {noformat} > Error reporting for failed MR jobs > ---------------------------------- > > Key: PIG-781 > URL: https://issues.apache.org/jira/browse/PIG-781 > Project: Pig > Issue Type: Improvement > Reporter: Gunther Hagleitner > Attachments: partial_failure.patch > > > If we have multiple MR jobs to run and some of them fail the behavior of the > system is to not stop on the first failure but to keep going. That way jobs > that do not depend on the failed job might still succeed. > The question is to how best report this scenario to a user. How do we tell > which jobs failed and which didn't? > One way could be to tie jobs to stores and report which store locations won't > have data and which ones do. -- This message is automatically generated by JIRA. - You can reply to this email to add a comment to the issue online.