Taraka Rama Rao Lethavadla created HIVE-27126:
-------------------------------------------------
Summary: Display Yarn resources availability in real time along
with Tez job progress
Key: HIVE-27126
URL: https://issues.apache.org/jira/browse/HIVE-27126
Project: Hive
Issue Type: Improvement
Components: HiveServer2
Reporter: Taraka Rama Rao Lethavadla
Right we don't know if the queue used in Hive query execution is having enough
resources or not. We are already displaying tez job details like number of task
per each vertex and how are they progressing.
If the resources available are not good enough to execute the query in parallel
or query that use to take shorter time is taking time, then we can use this new
detail to understand that queue is busy and resources are not enough
{noformat}
----------------------------------------------------------------------------------------------
VERTICES MODE STATUS TOTAL COMPLETED RUNNING PENDING
FAILED KILLED
----------------------------------------------------------------------------------------------
Map 1 container RUNNING 230 0 10 230
0 1
Reducer 2 container INITED 1 0 0 1
0 0
----------------------------------------------------------------------------------------------
VERTICES: 00/02 [>>--------------------------] 0% ELAPSED TIME: 58.33 s
----------------------------------------------------------------------------------------------
{noformat}
So it would be great to display current resource availability in that specific
queue along with above info in real time would help understand why a query can
be slow
--
This message was sent by Atlassian Jira
(v8.20.10#820010)