[
https://issues.apache.org/jira/browse/MAHOUT-946?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13202917#comment-13202917
]
Dmitriy Lyubimov commented on MAHOUT-946:
-----------------------------------------
bq. Some of these classes are also not AbstractJobs (though in some cases they
should probably be converted - not sure it would make sense in all cases), some
return some non-status value from the method that fires of the MR job, etc.
Maybe a static util method would make more sense?
Static util method would probably make more sense.
My current view of AbstractJob is that it mixing two disparate concerns in one
implementation: a Tool (pipeline bootstrap) in a sense of handing off the
default Configuration, to which end it has a lot of helper methods, and a
distinct MR job. Due to this, it is hard (or at least inconsistent) to use it
as a base for a separate and highly specific step in a multistep pipelines.
Static method would not require AbstractJob as a base, so static drop-in is
probably a better approach at this point.
> Map-reduce job status often left unchecked
> ------------------------------------------
>
> Key: MAHOUT-946
> URL: https://issues.apache.org/jira/browse/MAHOUT-946
> Project: Mahout
> Issue Type: Bug
> Affects Versions: 0.6
> Reporter: tom pierce
> Attachments: MAHOUT-946.patch, MAHOUT-946.patch
>
>
> I've run into a few places in Mahout where mapreduce jobs can fail and their
> status won't be checked, so processing will continue on. This sometimes
> obscures the root problem. I've tracked down a bunch of places where this
> problem exists, and tried to fix the code to do something reasonable (return
> -1 status code, throw exception, etc.) when jobs fail.
--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators:
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira