[ https://issues.apache.org/jira/browse/SPARK-20060?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Apache Spark reassigned SPARK-20060: ------------------------------------ Assignee: (was: Apache Spark) > Spark On Non-Yarn Mode with Kerberized HDFS ProxyUser Fails Talking to Hive > MetaStore > -------------------------------------------------------------------------------------- > > Key: SPARK-20060 > URL: https://issues.apache.org/jira/browse/SPARK-20060 > Project: Spark > Issue Type: Bug > Components: Deploy, Spark Submit > Affects Versions: 2.2.0 > Reporter: Kent Yao > > For **Spark on non-Yarn** mode on a kerberized hdfs, we don't obtain > credentials from hive metastore, hdfs, etc and just use the local kinited > user to connecting them. But if we specify the --proxy-user argument on > non-yarn mode, such as local, standalone, after we simply use > `UGI.createProxyUser` to get a proxy ugi as the effective user and wrap the > code in doAs, the proxy ugi fails to talk to hive metastore cause by no > crendentials. Thus, we need to obtain credentials via the real user and add > them to the proxy ugi. -- This message was sent by Atlassian JIRA (v6.3.15#6346) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org