[
https://issues.apache.org/jira/browse/MAPREDUCE-7127?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18047836#comment-18047836
]
ASF GitHub Bot commented on MAPREDUCE-7127:
-------------------------------------------
github-actions[bot] closed pull request #407: MAPREDUCE-7127. Add aggregated
webservice endpoints to fetch all tasks & their taskAttempts
URL: https://github.com/apache/hadoop/pull/407
> Add aggregated webservice endpoint to fetch all tasks including their attempts
> ------------------------------------------------------------------------------
>
> Key: MAPREDUCE-7127
> URL: https://issues.apache.org/jira/browse/MAPREDUCE-7127
> Project: Hadoop Map/Reduce
> Issue Type: New Feature
> Reporter: Brandon Scheller
> Priority: Major
> Labels: pull-request-available, webservices
>
> We have a usecase where we would like to poll Hadoop for various running
> Tasks and display info on each individual task attempt to the user.
> On large clusters with many tasks, this is an issue because using the current
> webservice APIs we would have to make many repeat calls to the same task
> attempts endpoints.
> To improve performance, we have added additional endpoints to HS and AM
> webservices that will fetch aggregated data on hadoop tasks including their
> task attempts for a job.
> This would look like
> - taskDescriptions webservice endpoint to AMWebServices
> @Path("/jobs/ \{jobid}/taskDescriptions")
>
> - describeTasks webservice endpoint to HSWebServices
> @Path("/mapreduce/jobs/\{jobid}/describeTasks")
> It would be similar to the current getJobTasks() in HS and AM webservices
> except it would include each of the task attempts for each task.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
