[
https://issues.apache.org/jira/browse/SPARK-26432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16728014#comment-16728014
]
Sujith commented on SPARK-26432:
--------------------------------
This is mainly happening because in spark uses a deprecated hbase api
public static Token<AuthenticationTokenIdentifier> obtainToken(Configuration
conf)
for obtaining the kerberos security token and the API has been removed from
hbase 2.1 version , as i analyzed there is one more stable API in
public static Token<AuthenticationTokenIdentifier> obtainToken(Connection
conn) in TokenUtil class , i think spark shall use this stable api for getting
the delegation token.
To invoke this api first connection object has to be retrieved from
ConnectionFactory and the same connection can be passed to
obtainToken(Connection conn) for getting token.
I can rase a PR soon for handling this issue, please let me know for any
clarifications or suggestions.
> Getting NoSuchMethodException while trying to obtain token from Hbase 2.1
> service
> ---------------------------------------------------------------------------------
>
> Key: SPARK-26432
> URL: https://issues.apache.org/jira/browse/SPARK-26432
> Project: Spark
> Issue Type: Improvement
> Components: Spark Core
> Affects Versions: 2.3.2, 2.4.0
> Reporter: Sujith
> Priority: Major
> Attachments: hbase-dep-obtaintok.png
>
>
> Getting NoSuchMethodException :
> org.apache.hadoop.hbase.security.token.TokenUtil(org.apache.hadoop.conf.Configuration)
> while trying connect hbase 2.1 service from spark.
> This is mainly happening because in spark uses a deprecated hbase api
> public static Token<AuthenticationTokenIdentifier> obtainToken(Configuration
> conf)
> for obtaining the token and the same has been removed from hbase 2.1 version.
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
