[
https://issues.apache.org/jira/browse/HIVE-17388?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Karen Coppage updated HIVE-17388:
---------------------------------
Description:
Click on a Spark stage in the WebUI/Drilldown/Query Plan graph, and Spark task
progress as well as the log file path will be displayed if
hive.server2.webui.show.stats=true. If the task is successful, SparkStatistics
will also be shown.
Screenshots attached are from a run on a CDH cluster.
Issues:
* SparkStatistics aren't shown if task fails or is running.
* Will need rebasing after HIVE-17300 is committed (current patch includes
HIVE-17300 changes)
* Will need testing upstream.
Suggestion
* It would be really easy to incorporate a progress bar to follow Spark
progress, with only a few tweaks to the JavaScript in:
service/src/resources/hive-webapps/static/js/query-plan-graph.js
was:
Click on a Spark stage in the WebUI/Drilldown/Query Plan graph, and Spark task
progress as well as the log file path will be displayed if
hive.server2.webui.show.stats=true.
If the task is successful, SparkStatistics will also be shown.
Issues:
* SparkStatistics aren't shown if task fails or is running.
* Will need rebasing after HIVE-17300 is committed (current patch includes
HIVE-17300 changes)
* Will need testing upstream.
Suggestion
* It would be really easy to incorporate a progress bar to follow Spark
progress, with only a few tweaks to the JavaScript in:
service/src/resources/hive-webapps/static/js/query-plan-graph.js
> Spark Stats for the WebUI Query Plan
> ------------------------------------
>
> Key: HIVE-17388
> URL: https://issues.apache.org/jira/browse/HIVE-17388
> Project: Hive
> Issue Type: Improvement
> Components: Web UI
> Reporter: Karen Coppage
> Priority: Minor
> Labels: features, patch
> Attachments: HIVE-17388.patch, running_1.png, running_2.png,
> success_1.png, success_2.png, success_3.png
>
>
> Click on a Spark stage in the WebUI/Drilldown/Query Plan graph, and Spark
> task progress as well as the log file path will be displayed if
> hive.server2.webui.show.stats=true. If the task is successful,
> SparkStatistics will also be shown.
> Screenshots attached are from a run on a CDH cluster.
> Issues:
> * SparkStatistics aren't shown if task fails or is running.
> * Will need rebasing after HIVE-17300 is committed (current patch includes
> HIVE-17300 changes)
> * Will need testing upstream.
> Suggestion
> * It would be really easy to incorporate a progress bar to follow Spark
> progress, with only a few tweaks to the JavaScript in:
> service/src/resources/hive-webapps/static/js/query-plan-graph.js
--
This message was sent by Atlassian JIRA
(v6.4.14#64029)
