[ https://issues.apache.org/jira/browse/SPARK-13829?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15191372#comment-15191372 ]
Steve Loughran commented on SPARK-13829: ---------------------------------------- its a bit subtle here, as it's not clear you need a keytab+principal for long lived work on an non-HDFS cluster unless you need tokens to talk to Hive or HBase. No HDFS ==> no hdfs delegation tokens to renew, refresh and propagate. > Spark submit with keytab can't submit to a non-HDFS yarn cluster > ---------------------------------------------------------------- > > Key: SPARK-13829 > URL: https://issues.apache.org/jira/browse/SPARK-13829 > Project: Spark > Issue Type: Bug > Components: YARN > Affects Versions: 1.6.1 > Environment: Yarn cluster, spark submit launching with keytab& > principal, cluster filesystem is *not* HDFS. > Reporter: Steve Loughran > > If you try to submit work to a secure YARN cluster running on any FS other > than HDFS, using a keytab+principal over kinited user, you get to see a stack > trace from inside {{Client.getTokenRenewalInterval}} > root cause: there is no HDFS to get a delegation token, hence no delegation > token to examine for a renewal interval -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org