Thomas Scott created HIVE-14124: ----------------------------------- Summary: Spark app name should be in line with MapReduce app name when using Hive On Spark Key: HIVE-14124 URL: https://issues.apache.org/jira/browse/HIVE-14124 Project: Hive Issue Type: Improvement Components: Spark Affects Versions: 1.1.0 Reporter: Thomas Scott Priority: Minor
When using the spark execution engine the jobs submitted to YARN are submitted with name "Hive On Spark" whereas in mr execution engine the name contains the query executed. This is overrideable via spark.app.name but it should automatically fill out the query executed in line with the mr engine. Example: set hive.execution.engine=spark; Select count(*) from sometable; -> Launched YARN Job description: Hive On Spark set hive.execution.engine=mr; Select count(*) from sometable; -> Launched YARN Job description: Select count(*) from sometable -- This message was sent by Atlassian JIRA (v6.3.4#6332)