[
https://issues.apache.org/jira/browse/TEZ-4515?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
László Bodor updated TEZ-4515:
------------------------------
Description:
While suspecting resource problem in logs by lines like:
{code}
2023-09-27 05:31:16,862 [INFO] [AMRM Callback Handler Thread]
|rm.YarnTaskSchedulerService|: Allocated: <memory:0, vCores:0> Free: <memory:0,
vCores:0>
{code}
it would be useful to look around the scheduler service and check if we can
count how much time is spent (per dag) while waiting on resources
> Monitor blocked time due to unavailable resources
> -------------------------------------------------
>
> Key: TEZ-4515
> URL: https://issues.apache.org/jira/browse/TEZ-4515
> Project: Apache Tez
> Issue Type: Sub-task
> Reporter: László Bodor
> Priority: Major
>
> While suspecting resource problem in logs by lines like:
> {code}
> 2023-09-27 05:31:16,862 [INFO] [AMRM Callback Handler Thread]
> |rm.YarnTaskSchedulerService|: Allocated: <memory:0, vCores:0> Free:
> <memory:0, vCores:0>
> {code}
> it would be useful to look around the scheduler service and check if we can
> count how much time is spent (per dag) while waiting on resources
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
