Steve Loughran created HADOOP-19708:
---------------------------------------
Summary: volcaono tos: remove shading
Key: HADOOP-19708
URL: https://issues.apache.org/jira/browse/HADOOP-19708
Project: Hadoop Common
Issue Type: Improvement
Components: fs/volcano
Affects Versions: 3.5.0
Reporter: Steve Loughran
Assignee: Steve Loughran
hadoop-tos is shaded, includes things like httpclient5, which leads to a big 4M
artifact, with unknown content inside
{code}
92K share/hadoop/common/lib/hadoop-aliyun-3.5.0-20250916.124028-685.jar
912K share/hadoop/common/lib/hadoop-aws-3.5.0-20250916.124028-686.jar
808K share/hadoop/common/lib/hadoop-azure-3.5.0-20250916.124028-685.jar
36K
share/hadoop/common/lib/hadoop-azure-datalake-3.5.0-20250916.124028-685.jar
72K share/hadoop/common/lib/hadoop-cos-3.5.0-20250916.124028-683.jar
136K share/hadoop/common/lib/hadoop-gcp-3.5.0-SNAPSHOT.jar
140K share/hadoop/common/lib/hadoop-huaweicloud-3.5.0-SNAPSHOT.jar
3.8M share/hadoop/common/lib/hadoop-tos-3.5.0-20250916.124028-202.jar
{code}
One thing it includes is yet-another mozilla/public-suffix-list.txt. These are
a recurrent PITA and I don't want
to find them surfacing again.
{code}
15. Required Resources
======================
resource: mozilla/public-suffix-list.txt
jar:file:/Users/stevel/Projects/Releases/hadoop-3.5.0-SNAPSHOT/share/hadoop/common/lib/hadoop-tos-3.5.0-20250916.124028-202.jar!/mozilla/public-suffix-list.txt
{code}
Plan
* Move the shade stage behind a profile; off for ASF releases. Exclude
mozilla/public-suffix-list.txt
* Explicitly declare and manage httpclient5 dependency
* hadoop-cloud-storage pom to include hadoop-tos but not dependencies in build,
unless asked.
* LICENSE-binary to declare optional redist of ve-tos-java-sdk-hadoop and its
license.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]
