[ https://issues.apache.org/jira/browse/HIVE-10476?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Wenping Zhan updated HIVE-10476: -------------------------------- Summary: Hive query should fail when it fails to initialize a session in SetSparkReducerParallelism [Spark Branch]1111 (was: Hive query should fail when it fails to initialize a session in SetSparkReducerParallelism [Spark Branch]) > Hive query should fail when it fails to initialize a session in > SetSparkReducerParallelism [Spark Branch]1111 > ------------------------------------------------------------------------------------------------------------- > > Key: HIVE-10476 > URL: https://issues.apache.org/jira/browse/HIVE-10476 > Project: Hive > Issue Type: Sub-task > Components: Spark > Affects Versions: spark-branch > Reporter: Chao Sun > Assignee: Chao Sun > Priority: Minor > Fix For: 1.3.0, 2.0.0 > > Attachments: HIVE-10476.1-spark.patch, HIVE-10476.2-spark.patch > > > Currently, for a Hive query HoS need to get a session > a session twice, once in SparkSetReducerParallelism, and another when > submitting the actual job. > The issue is that sometimes there's problem when launching a Yarn application > (e.g., don't have permission), then user will have to wait for two timeouts, > because both session initializations will fail. This turned out to happen > frequently. > This JIRA proposes to fail the query in SparkSetReducerParallelism, when it > cannot initialize the session. -- This message was sent by Atlassian Jira (v8.20.10#820010)