[
https://issues.apache.org/jira/browse/YARN-11881?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18032123#comment-18032123
]
ASF GitHub Bot commented on YARN-11881:
---------------------------------------
stoty commented on PR #8046:
URL: https://github.com/apache/hadoop/pull/8046#issuecomment-3432582860
Only hadoop-yarn-server-timelineservice-hbase-common,
hadoop-yarn-server-timelineservice-hbase-client are included in YARN classpath.
They are also only using the HBase client API, so we can use
hbase-shaded-client... with them without problems.
hadoop-yarn-server-timelineservice-hbase-server-2 only needs to be present
on the HBase classpath and it is packaged without dependencies, so using the
unshaded dependencies there is not a problem.
As discussed in YARN-11882,
hadoop-yarn-server-timelineservice-hbase-server-2 should not even be added to
the Yarn classpath. It can not work outside the HBase server environment, it is
dead code in the Yarn processes.
> Use hbase-shaded-client-byo-hadoop in hadoop-yarn-server-timelineservice-hbase
> ------------------------------------------------------------------------------
>
> Key: YARN-11881
> URL: https://issues.apache.org/jira/browse/YARN-11881
> Project: Hadoop YARN
> Issue Type: Bug
> Components: build, timelineservice
> Affects Versions: 3.4.2
> Reporter: Istvan Toth
> Assignee: Istvan Toth
> Priority: Major
> Labels: pull-request-available
>
> The HBase timelineservice backed is currently using the unshaded HBase client.
> This brings in a lot of HBase dependencies, most critically protobuf 2.5.
> Use hbase-shaded-client-byo-hadoop which shades protobuf-java 2.5 so that it
> won't conflict with other Protobuf versions on the classpath, and removes
> several other dependencies from the Yarn classpath.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
