[
https://issues.apache.org/jira/browse/SPARK-26432?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16728014#comment-16728014
]
Sujith edited comment on SPARK-26432 at 12/23/18 5:48 PM:
----------------------------------------------------------
This is mainly happening because spark uses a deprecated hbase api
public static Token<AuthenticationTokenIdentifier> obtainToken(Configuration
conf)
for obtaining the kerberos security token and the API has been removed from
hbase 2.1 version , as i analyzed there is one more stable API in
public static Token<AuthenticationTokenIdentifier> obtainToken(Connection conn)
in TokenUtil class , i think spark shall use this stable api for getting the
delegation token.
To invoke this api first connection object has to be retrieved from
ConnectionFactory and the same connection can be passed to
obtainToken(Connection conn) for getting token.
I can rase a PR soon for handling this issue, please let me know for any
clarifications or suggestions.
was (Author: s71955):
This is mainly happening because in spark uses a deprecated hbase api
public static Token<AuthenticationTokenIdentifier> obtainToken(Configuration
conf)
for obtaining the kerberos security token and the API has been removed from
hbase 2.1 version , as i analyzed there is one more stable API in
public static Token<AuthenticationTokenIdentifier> obtainToken(Connection
conn) in TokenUtil class , i think spark shall use this stable api for getting
the delegation token.
To invoke this api first connection object has to be retrieved from
ConnectionFactory and the same connection can be passed to
obtainToken(Connection conn) for getting token.
I can rase a PR soon for handling this issue, please let me know for any
clarifications or suggestions.
> Not able to connect Hbase 2.1 service Getting NoSuchMethodException while
> trying to obtain token from Hbase 2.1 service.
> ------------------------------------------------------------------------------------------------------------------------
>
> Key: SPARK-26432
> URL: https://issues.apache.org/jira/browse/SPARK-26432
> Project: Spark
> Issue Type: Improvement
> Components: Spark Core
> Affects Versions: 2.3.2, 2.4.0
> Reporter: Sujith
> Priority: Major
> Attachments: hbase-dep-obtaintok.png
>
>
> Getting NoSuchMethodException :
> org.apache.hadoop.hbase.security.token.TokenUtil(org.apache.hadoop.conf.Configuration)
> while trying connect hbase 2.1 service from spark.
> This is mainly happening because in spark uses a deprecated hbase api
> public static Token<AuthenticationTokenIdentifier> obtainToken(Configuration
> conf)
> for obtaining the token and the same has been removed from hbase 2.1 version.
>
> Attached the snapshot of error logs
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
