[ 
https://issues.apache.org/jira/browse/MAPREDUCE-4346?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13402477#comment-13402477
 ] 

Arun C Murthy commented on MAPREDUCE-4346:
------------------------------------------

bq. As I highlighted in the ticket description above: The JobClient only 
exposes a getAllJobs() which returns all submitted jobs in any state, the 
result also includes all retired jobs. This list is long and represents an 
unneeded overhead especially in the case of clients only interested in jobs in 
specific states.

Ahmed I'm not convinced. Yes, it's bit more overhead, but I don't see how 
adding a new public api is going to make significant difference. IAC, if you 
set completed jobs to 0, you'll not get retired jobs. Unless I hear a more 
compelling argument I'm -1 on this. Also, please remember that this API is 
fairly hard to support with YARN, so that is another problem.
                
> Adding a refined version of JobTracker.getAllJobs() and exposing through the 
> JobClient
> --------------------------------------------------------------------------------------
>
>                 Key: MAPREDUCE-4346
>                 URL: https://issues.apache.org/jira/browse/MAPREDUCE-4346
>             Project: Hadoop Map/Reduce
>          Issue Type: Improvement
>          Components: mrv1
>            Reporter: Ahmed Radwan
>            Assignee: Ahmed Radwan
>         Attachments: MAPREDUCE-4346.patch, MAPREDUCE-4346_rev2.patch, 
> MAPREDUCE-4346_rev3.patch, MAPREDUCE-4346_rev4.patch
>
>
> The current implementation for JobTracker.getAllJobs() returns all submitted 
> jobs in any state, in addition to retired jobs. This list can be long and 
> represents an unneeded overhead especially in the case of clients only 
> interested in jobs in specific state(s). 
> It is beneficial to include a refined version where only jobs having specific 
> statuses are returned and retired jobs are optional to include. 
> I'll be uploading an initial patch momentarily.

--
This message is automatically generated by JIRA.
If you think it was sent incorrectly, please contact your JIRA administrators: 
https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa
For more information on JIRA, see: http://www.atlassian.com/software/jira

        

Reply via email to