[
https://issues.apache.org/jira/browse/HIVE-25101?focusedWorklogId=608921&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-608921
]
ASF GitHub Bot logged work on HIVE-25101:
-----------------------------------------
Author: ASF GitHub Bot
Created on: 09/Jun/21 05:06
Start Date: 09/Jun/21 05:06
Worklog Time Spent: 10m
Work Description: stoty commented on pull request #2259:
URL: https://github.com/apache/hive/pull/2259#issuecomment-857376643
I have noticed one more thing while testing this change.
The hive script changes will always overwrite the hbase.aux.jar.path
configuration parameter.
Now a lot of other settings, like having and auxjars directory, or setting
the HIVE_AUX_JARS_PATH will do the same,
but this change will overwrite the hbase.aux.jar.path set in hbase-site.xml
pretty much every single time.
I'm not sure how much of a problem this is, but I wanted to give a heads-up.
I could explore reverting to using the HADOOP_CLASSPATH instead, though I
have doubts if that actually works for the distributed operations.
@kgyrtkirk
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
Issue Time Tracking
-------------------
Worklog Id: (was: 608921)
Time Spent: 1h (was: 50m)
> Remove HBase libraries from Hive distribution
> ---------------------------------------------
>
> Key: HIVE-25101
> URL: https://issues.apache.org/jira/browse/HIVE-25101
> Project: Hive
> Issue Type: Improvement
> Components: HBase Handler, Hive
> Affects Versions: 4.0.0
> Reporter: Istvan Toth
> Assignee: Istvan Toth
> Priority: Major
> Labels: pull-request-available
> Time Spent: 1h
> Remaining Estimate: 0h
>
> Hive currently packages HBase libraries into its lib directory.
> It also adds the HBase libraries separately to its classpath in the hive
> startup script.
> Having both mechanisms is redundant, and it also causes errors, as the
> standard HBase libraries packaged into Hive are unshaded, while the libraries
> added by _hbase mapredcp_
> are shaded, and the two are NOT compatible when custom coprocessors are used,
> and in some cases the classpaths during local execution and for MR/TEZ jobs
> are mutually incompatible.
> I propose removing all HBase libraries from the distribution, and pulling
> them via the hbase mapredcp mechanism.
> This also solves the old problem of including ancient HBase alpha versions
> Hive.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
