[
https://issues.apache.org/jira/browse/SPARK-15800?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15324053#comment-15324053
]
Morgan Jones commented on SPARK-15800:
--------------------------------------
Ah, sorry I wasn't clear.
I meant the Spark Standalone Resource Manager. The built in one. Kubernetes is
merely orchestrating the spark master and workers, the executors are being spun
up on each of the masters.
Do you know if there's any plans to implement native krk5 auth to Spark?
> Accessing kerberised hdfs from Spark running with Resource Manager
> ------------------------------------------------------------------
>
> Key: SPARK-15800
> URL: https://issues.apache.org/jira/browse/SPARK-15800
> Project: Spark
> Issue Type: Improvement
> Components: Spark Core
> Affects Versions: 1.6.1
> Reporter: Morgan Jones
> Priority: Minor
>
> Hi,
> I've been runing a Spark cluster in kubernetes and i'm trying to access data
> in HDFS in a kerberised instance of hadoop. It seems that the Spark cluster
> is unable to pass my tickets to the hadoop instance, is this by design?
> If so how much work would be involved to allow the cluster to communicate
> with kerberised hdfs and is this currently in the roadmap?
> Edit: Spark is currently running using the Resource Manager, not on YARN.
> Cheers,
> Morgan
--
This message was sent by Atlassian JIRA
(v6.3.4#6332)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
