[
https://issues.apache.org/jira/browse/HIVE-27140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Denys Kuzmenko resolved HIVE-27140.
-----------------------------------
Fix Version/s: 4.0.0
Resolution: Fixed
> Set HADOOP_PROXY_USER cause hiveMetaStoreClient close everytime
> ----------------------------------------------------------------
>
> Key: HIVE-27140
> URL: https://issues.apache.org/jira/browse/HIVE-27140
> Project: Hive
> Issue Type: Bug
> Components: Metastore
> Affects Versions: 2.3.8, 3.1.2
> Reporter: chenruotao
> Assignee: chenruotao
> Priority: Major
> Labels: pull-request-available
> Fix For: 4.0.0
>
> Attachments: image-2023-03-14-20-51-32-317.png,
> image-2023-03-14-20-53-40-132.png, image-2023-03-14-20-56-00-757.png,
> image-2023-03-14-21-00-18-049.png, image-2023-03-14-21-03-52-764.png,
> image-2023-03-14-21-56-06-605.png, image-2023-03-14-21-56-27-408.png
>
> Time Spent: 1h 40m
> Remaining Estimate: 0h
>
> In order to use proxy user to access hive metastore server with kerberos, I
> set HADOOP_PROXY_USER = proxy user.
> this is the code of HiveMetaStoreClient
> !image-2023-03-14-20-51-32-317.png|width=606,height=393!
> but when I run a spark job with hive metatsore client, the connection to
> hive metatsore server always close
> !image-2023-03-14-20-53-40-132.png|width=687,height=375!
> and I notice that some log before close :
> {color:#ff0000}Mestastore configuration hive.metastore.token.signature
> changed from DelegationTokenForHiveMetaStoreServer to{color}
> so we can find why the connection close always, hive metatsore client will
> compare currentMetaVars with hiveconf
> !image-2023-03-14-20-56-00-757.png|width=903,height=463!
> but if we set HADOOP_PROXY_USER and init hive metatsore client, the
> ConfVars.METASTORE_TOKEN_SIGNATURE always is set
> !image-2023-03-14-21-00-18-049.png|width=905,height=592!
> so I think this solutions can fix the bug:
> ConfVars.METASTORE_TOKEN_SIGNATURE is no need to check in hive metatsore
> client
> !image-2023-03-14-21-03-52-764.png|width=905,height=606!
> obviously that is no more close
> !image-2023-03-14-21-56-27-408.png|width=903,height=452!
>
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
