[ https://issues.apache.org/jira/browse/SPARK-6918?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15046606#comment-15046606 ]
mark vervuurt commented on SPARK-6918: -------------------------------------- I am also doubting wether this issue has been resolved we are getting a similar error when trying to read data from HBase from Spark using Spark 1.4.1. within a cluster secured with Kerberos. > Secure HBase with Kerberos does not work over YARN > -------------------------------------------------- > > Key: SPARK-6918 > URL: https://issues.apache.org/jira/browse/SPARK-6918 > Project: Spark > Issue Type: New Feature > Components: YARN > Affects Versions: 1.2.1, 1.3.0, 1.3.1 > Reporter: Dean Chen > Assignee: Dean Chen > Fix For: 1.4.0 > > > Attempts to access HBase from Spark executors will fail at the auth to the > metastore with: _GSSException: No valid credentials provided (Mechanism > level: Failed to find any Kerberos tgt)_ > This is because HBase Kerberos auth token is not send to the executor. Will > need to have something similar to obtainTokensForNamenodes(used for HDFS) in > yarn/Client.scala. Storm also needed something similar: > https://github.com/apache/storm/pull/226 > I've created a patch for this that required an HBase dependency in the YARN > module that we've been using successfully at eBay but am working on a version > that does not require the HBase dependency by calling the class loader. > Should be ready in a few days. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org