[
https://issues.apache.org/jira/browse/SPARK-35160?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17331114#comment-17331114
]
Manu Zhang commented on SPARK-35160:
------------------------------------
[~hyukjin.kwon],
Thanks for reminder. I've added my proposal and I did ask about it on mailing
list. It will be great if you know the reasoning behind it or you may forward
to someone who knows.
> Spark application submitted despite failing to get Hive delegation token
> ------------------------------------------------------------------------
>
> Key: SPARK-35160
> URL: https://issues.apache.org/jira/browse/SPARK-35160
> Project: Spark
> Issue Type: Improvement
> Components: Security
> Affects Versions: 3.1.1
> Reporter: Manu Zhang
> Priority: Major
>
> Currently, when running on YARN and failing to get Hive delegation token, a
> Spark SQL application will still be submitted. Eventually, the application
> will fail on connecting to Hive metastore without a valid delegation token.
> Is there any reason for this design ?
> cc [~jerryshao] who originally implemented this in
> https://issues.apache.org/jira/browse/SPARK-14743
> I'd propose to fail immediately like HadoopFSDelegationTokenProvider.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
