Chao created HIVE-10060:
---------------------------
Summary: Provide more informative stage description in Spark Web
UI [Spark Branch]
Key: HIVE-10060
URL: https://issues.apache.org/jira/browse/HIVE-10060
Project: Hive
Issue Type: Sub-task
Components: spark-branch
Affects Versions: 1.2.0
Reporter: Chao
Priority: Minor
Currently, for HoS in Spark Web UI, it displays stage information like the
following:
Description:
foreachAsync at RemoteHiveSparkClient.java:254
org.apache.spark.api.java.JavaPairRDD.foreachAsync(JavaPairRDD.scala:45)
org.apache.hadoop.hive.ql.exec.spark.RemoteHiveSparkClient$JobStatusJob.call(RemoteHiveSparkClient.java:254)
org.apache.hive.spark.client.RemoteDriver$JobWrapper.call(RemoteDriver.java:366)
It would be better to provide more useful information, like what is the part of
the query that this stage is about. Looks like this is implemented in SparkSQL.
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)