[ 
https://issues.apache.org/jira/browse/HIVE-27140?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
 ]

Denys Kuzmenko resolved HIVE-27140.
-----------------------------------
    Fix Version/s: 4.0.0
       Resolution: Fixed

> Set HADOOP_PROXY_USER cause  hiveMetaStoreClient close everytime
> ----------------------------------------------------------------
>
>                 Key: HIVE-27140
>                 URL: https://issues.apache.org/jira/browse/HIVE-27140
>             Project: Hive
>          Issue Type: Bug
>          Components: Metastore
>    Affects Versions: 2.3.8, 3.1.2
>            Reporter: chenruotao
>            Assignee: chenruotao
>            Priority: Major
>              Labels: pull-request-available
>             Fix For: 4.0.0
>
>         Attachments: image-2023-03-14-20-51-32-317.png, 
> image-2023-03-14-20-53-40-132.png, image-2023-03-14-20-56-00-757.png, 
> image-2023-03-14-21-00-18-049.png, image-2023-03-14-21-03-52-764.png, 
> image-2023-03-14-21-56-06-605.png, image-2023-03-14-21-56-27-408.png
>
>          Time Spent: 1h 40m
>  Remaining Estimate: 0h
>
> In order to use proxy user to access hive metastore server with kerberos, I 
> set HADOOP_PROXY_USER = proxy user.
> this is the code of  HiveMetaStoreClient
> !image-2023-03-14-20-51-32-317.png|width=606,height=393!
> but when I run a spark job with hive metatsore client, the connection to  
> hive metatsore server always close 
> !image-2023-03-14-20-53-40-132.png|width=687,height=375!
> and I notice that some log before close :
> {color:#ff0000}Mestastore configuration hive.metastore.token.signature 
> changed from DelegationTokenForHiveMetaStoreServer to{color}
> so we can find why the connection close always,  hive metatsore client will 
> compare  currentMetaVars with hiveconf
> !image-2023-03-14-20-56-00-757.png|width=903,height=463!
> but if we set HADOOP_PROXY_USER and init  hive metatsore client, the  
> ConfVars.METASTORE_TOKEN_SIGNATURE always is set
> !image-2023-03-14-21-00-18-049.png|width=905,height=592!
> so I think this solutions can fix the bug:
> ConfVars.METASTORE_TOKEN_SIGNATURE  is no need to check in hive metatsore 
> client
> !image-2023-03-14-21-03-52-764.png|width=905,height=606!
> obviously that is no more close
> !image-2023-03-14-21-56-27-408.png|width=903,height=452!
>  



--
This message was sent by Atlassian Jira
(v8.20.10#820010)

Reply via email to