[ https://issues.apache.org/jira/browse/SPARK-6918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15052737#comment-15052737 ]
Pierre Beauvois commented on SPARK-6918: ---------------------------------------- I found nothing about org.apache.spark.deploy.yarn.Client in the client code. The use case is reproducible at 100% and the error happens for any HBase tables. I opened a new ticket for Spark 1.5.2 (https://issues.apache.org/jira/browse/SPARK-12279). > Secure HBase with Kerberos does not work over YARN > -------------------------------------------------- > > Key: SPARK-6918 > URL: https://issues.apache.org/jira/browse/SPARK-6918 > Project: Spark > Issue Type: New Feature > Components: YARN > Affects Versions: 1.2.1, 1.3.0, 1.3.1 > Reporter: Dean Chen > Assignee: Dean Chen > Fix For: 1.4.0 > > > Attempts to access HBase from Spark executors will fail at the auth to the > metastore with: _GSSException: No valid credentials provided (Mechanism > level: Failed to find any Kerberos tgt)_ > This is because HBase Kerberos auth token is not send to the executor. Will > need to have something similar to obtainTokensForNamenodes(used for HDFS) in > yarn/Client.scala. Storm also needed something similar: > https://github.com/apache/storm/pull/226 > I've created a patch for this that required an HBase dependency in the YARN > module that we've been using successfully at eBay but am working on a version > that does not require the HBase dependency by calling the class loader. > Should be ready in a few days. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org