[ https://issues.apache.org/jira/browse/HADOOP-8037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13203728#comment-13203728 ]
Matt Foley commented on HADOOP-8037: ------------------------------------ Same issue with 'libhdfs': {code} $ rpm -qlp hadoop-1.0.1-1.i386.rpm|grep libhdfs /usr/c++/Linux-i386-32/lib/libhdfs.la /usr/c++/Linux-i386-32/lib/libhdfs.so /usr/c++/Linux-i386-32/lib/libhdfs.so.0 /usr/c++/Linux-i386-32/lib/libhdfs.so.0.0.0 /usr/lib/libhdfs.la /usr/lib/libhdfs.so /usr/lib/libhdfs.so.0 /usr/lib/libhdfs.so.0.0.0 $ rpm -qlp hadoop-1.0.1-1.amd64.rpm|grep libhdfs /usr/c++/Linux-amd64-64/lib/libhdfs.la /usr/c++/Linux-amd64-64/lib/libhdfs.so /usr/c++/Linux-amd64-64/lib/libhdfs.so.0 /usr/c++/Linux-amd64-64/lib/libhdfs.so.0.0.0 /usr/c++/Linux-i386-32/lib/libhdfs.la /usr/c++/Linux-i386-32/lib/libhdfs.so /usr/c++/Linux-i386-32/lib/libhdfs.so.0 /usr/c++/Linux-i386-32/lib/libhdfs.so.0.0.0 /usr/lib64/libhdfs.la /usr/lib64/libhdfs.so /usr/lib64/libhdfs.so.0 /usr/lib64/libhdfs.so.0.0.0 {code} The architecture-specific paths shouldn't be in the rpms or debs. And in the tarballs: {code} $ tar ztf hadoop-1.0.1.tar.gz|grep libhdfs|grep -v /src/ |grep -v /docs/ hadoop-1.0.1/c++/Linux-amd64-64/lib/libhdfs.la hadoop-1.0.1/c++/Linux-amd64-64/lib/libhdfs.so hadoop-1.0.1/c++/Linux-amd64-64/lib/libhdfs.so.0 hadoop-1.0.1/c++/Linux-amd64-64/lib/libhdfs.so.0.0.0 hadoop-1.0.1/c++/Linux-i386-32/lib/libhdfs.la hadoop-1.0.1/c++/Linux-i386-32/lib/libhdfs.so hadoop-1.0.1/c++/Linux-i386-32/lib/libhdfs.so.0 hadoop-1.0.1/c++/Linux-i386-32/lib/libhdfs.so.0.0.0 $ tar ztf hadoop-1.0.1-bin.tar.gz|grep libhdfs hadoop-1.0.1/c++/Linux-amd64-64/lib/libhdfs.la hadoop-1.0.1/c++/Linux-amd64-64/lib/libhdfs.so hadoop-1.0.1/c++/Linux-amd64-64/lib/libhdfs.so.0 hadoop-1.0.1/c++/Linux-amd64-64/lib/libhdfs.so.0.0.0 hadoop-1.0.1/c++/Linux-i386-32/lib/libhdfs.la hadoop-1.0.1/c++/Linux-i386-32/lib/libhdfs.so hadoop-1.0.1/c++/Linux-i386-32/lib/libhdfs.so.0 hadoop-1.0.1/c++/Linux-i386-32/lib/libhdfs.so.0.0.0 hadoop-1.0.1/lib/native/Linux-amd64-64/libhdfs.la hadoop-1.0.1/lib/native/Linux-amd64-64/libhdfs.so hadoop-1.0.1/lib/native/Linux-amd64-64/libhdfs.so.0 hadoop-1.0.1/lib/native/Linux-amd64-64/libhdfs.so.0.0.0 {code} To be consistent with the source tarball, the {{"hadoop-1.0.1/lib/native/Linux-amd64-64/libhdfs.*"}} files shouldn't be in the bin-tarball. The fact that the 32-bit equivalents aren't there might be a clue to the error. Thanks for the hard work, Giri! > Binary tarball does not preserve platform info for native builds, and fails > to provide needed symlinks for libhadoop.so > ----------------------------------------------------------------------------------------------------------------------- > > Key: HADOOP-8037 > URL: https://issues.apache.org/jira/browse/HADOOP-8037 > Project: Hadoop Common > Issue Type: Bug > Components: build > Affects Versions: 1.0.1 > Reporter: Matt Foley > Assignee: Giridharan Kesavan > Attachments: hadoop-8037.patch > > > The source tarball uses "package" ant target, which includes both sets of > native builds (32 and 64 bit libraries), under subdirectories that are named > for the supported platform, so you can tell what they are. > The binary tarball uses the "bin-package" ant target, which projects both > sets of native builds into a single directory, stripping out the platform > names from the directory paths. Since the native built libraries have > identical names, only one of each survives the process. Afterward, there is > no way to know whether they are intended for 32 or 64 bit environments. > It seems to be done this way as a step toward building the rpm and deb > artifacts. But the rpms and debs are self-identifying as to the platform > they were built for, and contain only one set of libs each, while the binary > tarball isn't. The binary tarball should have the same platform-specific > subdirectories that the full tarball does; but this means that the rpm and > deb builds have to be more careful about include/exclude specs for what goes > into those artifacts. -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira