[ https://issues.apache.org/jira/browse/HADOOP-10115?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14352583#comment-14352583 ]
Vinayakumar B commented on HADOOP-10115: ---------------------------------------- Thanks [~aw] Updated the patch. {code}for childPath in "$src"/* ; do child=$(basename "$childPath");{code} Extracting the $child from the absolute path for comparing in both copy() and copyIfNotExists(). Hopefully remaining things works same. bq. // we need to copy httpfs and kms as is Thats a miss. Thanks for picking ;) > Exclude duplicate jars in hadoop package under different component's lib > ------------------------------------------------------------------------ > > Key: HADOOP-10115 > URL: https://issues.apache.org/jira/browse/HADOOP-10115 > Project: Hadoop Common > Issue Type: Bug > Affects Versions: 3.0.0, 2.2.0 > Reporter: Vinayakumar B > Assignee: Vinayakumar B > Attachments: HADOOP-10115-004.patch, HADOOP-10115-005.patch, > HADOOP-10115-006.patch, HADOOP-10115.patch, HADOOP-10115.patch, > HADOOP-10115.patch > > > In the hadoop package distribution there are more than 90% of the jars are > duplicated in multiple places. > For Ex: > almost all jars in share/hadoop/hdfs/lib are already there in > share/hadoop/common/lib > Same case for all other lib in share directory. > Anyway for all the daemon processes all directories are added to classpath. > So to reduce the package distribution size and the classpath overhead, remove > the duplicate jars from the distribution. -- This message was sent by Atlassian JIRA (v6.3.4#6332)