Github user tgravescs commented on the issue:
https://github.com/apache/spark/pull/14789
I guess I forgot about this pr. I don't think we have any yarn specific
public apis. Also theoretically this isn't yarn specific if others decided to
support it as well. mesos/standalone could also use credentials and updates
its just no one has implemented it.
We do have api's that don't support all deploy modes though, like the
SparkLauncher.
This feels like we should have public api in common place and just have
backends handle if they support.
A little bit of a side note here, personally I would like to move away from
keytabs because its not as secure and at least my company doesn't allow it. To
get around keytabs, I was going to add an interface to push new credentials
from the gateway box. Have a spark-submit argument that talked to the driver to
push new credentials securely over rpc. The reason I bring that up is that if
we are adding an api to updateCredentials it would be nice to make it flexible
enough to handle that use case as well.
perhaps we should add an interface to get a Credentials like object that
then can have the updateCredentials routine and others as needed, that way
everything isn't directly in the SparkContext.
---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at [email protected] or file a JIRA ticket
with INFRA.
---
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
