[GitHub] [bigtop] JunHe77 opened a new pull request #781: BIGTOP-3548: Hive build failure caused by protoc-jar-maven-plugin mis…
JunHe77 opened a new pull request #781: URL: https://github.com/apache/bigtop/pull/781 …sing aarch64 support Hive uses protoc-jar to provide protoc executable to process *.proto files. The protoc-jar-maven-plugin-2.5.0 doesn't include non-x86 binaries which caused build failure on non-x86 platforms. Backport HIVE-21939 to 3.1.2 branch and added ppc64le support. Change-Id: I14f9ce54272a3eda1557710ab4276d999eed4a57 Signed-off-by: Jun He -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [bigtop] sekikn merged pull request #780: BIGTOP-3329. Bump ambari to v2.7.5.
sekikn merged pull request #780: URL: https://github.com/apache/bigtop/pull/780 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [bigtop] sekikn commented on pull request #780: BIGTOP-3329. Bump ambari to v2.7.5.
sekikn commented on pull request #780: URL: https://github.com/apache/bigtop/pull/780#issuecomment-852705462 +1, tested with all supported distros on the x86_64 platforms. I've not run the smoke test yet, but if there's any problem, we can address it as another issue. Thanks @iwasakims! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [bigtop] sekikn edited a comment on pull request #780: BIGTOP-3329. Bump ambari to v2.7.5.
sekikn edited a comment on pull request #780: URL: https://github.com/apache/bigtop/pull/780#issuecomment-852599429 Thanks for the advice @iwasakims, updating bigtop_toolchain/manifests/packages.pp just worked. Will try the latest commit. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [bigtop] sekikn commented on pull request #780: BIGTOP-3329. Bump ambari to v2.7.5.
sekikn commented on pull request #780: URL: https://github.com/apache/bigtop/pull/780#issuecomment-852599429 Thanks for the advice @iwasakims, updating bigtop_toolchain/manifests/packages.pp just worked. I didn't come across the error you mentioned above, but got another one at least on Debian 9, 10 and Ubuntu 20.04: ``` dh_install dh_install: warning: Cannot find (any matches for) "/usr/lib/python2.6/site-packages/ambari_server" (tried in ., debian/tmp) dh_install: warning: ambari-server missing files: /usr/lib/python2.6/site-packages/ambari_server install -d debian/ambari-server//etc cp --reflink=auto -a debian/tmp/etc/ambari-server debian/ambari-server//etc/ install -d debian/ambari-server//etc/init.d cp --reflink=auto -a debian/tmp/etc/init.d/ambari-server debian/ambari-server//etc/init.d/ install -d debian/ambari-server//usr/sbin cp --reflink=auto -a debian/tmp/usr/sbin/ambari-server.py debian/tmp/usr/sbin/ambari_server_main.py debian/ambari-server//usr/sbin/ install -d debian/ambari-server//var/lib cp --reflink=auto -a debian/tmp/var/lib/ambari-server/ debian/ambari-server//var/lib/ dh_install: warning: Cannot find (any matches for) "/usr/lib/python2.6/site-packages/ambari_agent" (tried in ., debian/tmp) dh_install: warning: ambari-agent missing files: /usr/lib/python2.6/site-packages/ambari_agent dh_install: error: missing files, aborting install -d debian/.debhelper/generated/ambari-server install -d debian/.debhelper/generated/ambari-agent make: *** [debian/rules:26: binary] Error 25 dpkg-buildpackage: error: fakeroot debian/rules binary subprocess returned exit status 2 debuild: fatal error at line 1182: dpkg-buildpackage -us -uc -ui -b failed > Task :ambari-deb FAILED FAILURE: Build failed with an exception. ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [bigtop] iwasakims edited a comment on pull request #780: BIGTOP-3329. Bump ambari to v2.7.5.
iwasakims edited a comment on pull request #780: URL: https://github.com/apache/bigtop/pull/780#issuecomment-852039391 I got another error on Ubuntu 18.04. ``` ... dh_strip_nondeterminism Using 1622541556 as canonical time Normalizing debian/ambari-server/usr/lib/ambari-server/ehcache-2.10.0.jar using File::StripNondeterminism::handlers::jar ... Normalizing debian/ambaridh_strip_nondeterminism: debian/ambari-server/usr/lib/ambari-server/ambari-server-2.7.5.0.0.jar: Reading ZIP archive failed: IO error: reading zipfile comment : -server/usr/lib/ambari-server/spring-security-kerberos-core-1.0.1.RELEASE.jar using File::StripNondeterminism::handlers::jar Normalizing debian/ambari-server/usr/lib/ambari-server/spring-webmvc-5.1.8.RELEASE.jar using File::StripNondeterminism::handlers::jar Normalizing debian/ambari-server/usr/lib/ambari-server/spring-jcl-5.1.8.RELEASE.jar using File::StripNondeterminism::handlers::jar Normalizing debian/ambari-server/usr/lib/ambari-server/HikariCP-java7-2.4.13.jar using File::StripNondeterminism::handlers::jar Normalizing debian/ambari-server/usr/lib/ambari-server/spring-aop-5.1.8.RELEASE.jar using File::StripNondeterminism::handlers::jar Normalizing debian/ambari-server/usr/lib/ambari-server/commons-logging-1.1.1.jar using File::StripNondeterminism::handlers::jar Normalizing debian/ambari-server/usr/lib/ambari-server/api-ldap-extras-aci-2.0.0.AM1.jar using File::StripNondeterminism::handlers::jar Normalizing debian/ambari-server/usr/lib/ambari-server/metrics-core-3.1.0.jar using File::StripNondeterminism::handlers::jar Normalizing debian/ambari-server/usr/lib/ambari-server/ant-1.7.1.jar using File::StripNondeterminism::handlers::jar Normalizing debian/ambari-server/usr/lib/ambari-server/slf4j-api-1.7.20.jar using File::StripNondeterminism::handlers::jar Normalizing debian/ambari-server/usr/lib/ambari-server/ambari-metrics-common-2.7.5.0.0.jar using File::StripNondeterminism::handlers::jar Normalizing debian/ambari-server/usr/lib/ambari-server/guice-4.1.0.jar using File::StripNondeterminism::handlers::jar Normalizing debian/ambari-server/usr/lib/ambari-server/jsr305-1.3.9.jar using File::StripNondeterminism::handlers::jar Normalizing debian/ambari-server/usr/lib/ambari-server/mina-core-2.0.18.jar using File::StripNondeterminism::handlers::jar Normalizing debian/ambari-server/usr/lib/ambari-server/error_prone_annotations-2.3.2.jar using File::StripNondeterminism::handlers::jar Normalizing debian/ambari-server/usr/lib/ambari-server/hadoop-auth-2.7.2.jar using File::StripNondeterminism::handlers::jar Normalizing debian/ambari-server/usr/lib/ambari-server/ambari-server-2.7.5.0.0.jar using File::StripNondeterminism::handlers::jar debian/rules:26: recipe for target 'binary' failed make: *** [binary] Error 255 dpkg-buildpackage: error: fakeroot debian/rules binary subprocess returned exit status 2 > Task :ambari-deb FAILED 6 actionable tasks: 6 executed ``` ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [bigtop] iwasakims commented on pull request #780: BIGTOP-3329. Bump ambari to v2.7.5.
iwasakims commented on pull request #780: URL: https://github.com/apache/bigtop/pull/780#issuecomment-852039391 I got another error on Ubuntu 18.04. ``` debian/rules:26: recipe for target 'binary' failed make: *** [binary] Error 255 dpkg-buildpackage: error: fakeroot debian/rules binary subprocess returned exit status 2 > Task :ambari-deb FAILED 6 actionable tasks: 6 executed dpkg-buildpackage: warning: debian/rules is not executable; fixing that dpkg-source --before-build ambari-2.7.5.0 fakeroot debian/rules clean pyversions: missing X(S)-Python-Version in control file, fall back to debian/pyversions pyversions: missing debian/pyversions file, fall back to supported versions 'build/lib.linux-x86_64-2.7' does not exist -- can't clean it 'build/bdist.linux-x86_64' does not exist -- can't clean it 'build/scripts-2.7' does not exist -- can't clean it dpkg-source -b ambari-2.7.5.0 dpkg-genbuildinfo --build=source dpkg-genchanges -sa --build=source >../ambari_2.7.5.0-1_source.changes dpkg-genchanges: info: including full source code in upload dpkg-source --after-build ambari-2.7.5.0 dpkg-source: warning: extracting unsigned source package (ambari_2.7.5.0-1.dsc) debuild: fatal error at line 1152: dpkg-buildpackage -rfakeroot -us -uc -ui -b failed FAILURE: Build failed with an exception. ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [bigtop] iwasakims commented on pull request #780: BIGTOP-3329. Bump ambari to v2.7.5.
iwasakims commented on pull request #780:
URL: https://github.com/apache/bigtop/pull/780#issuecomment-852031278
@sekikn I could not reproduce the `ImportError: No module named setuptools`.
Maybe because there is python-setuptools on my Ubuntu VM. Could you try
updating bigtop_toolchain/manifests/packages.pp like below on your env? If it
works, I will add the fix to this PR.
```
diff --git a/bigtop_toolchain/manifests/packages.pp
b/bigtop_toolchain/manifests/packages.pp
index f25e79f8..d97cc176 100644
--- a/bigtop_toolchain/manifests/packages.pp
+++ b/bigtop_toolchain/manifests/packages.pp
@@ -207,6 +207,7 @@ class bigtop_toolchain::packages {
"bison",
"flex",
"python-dev",
+"python-setuptools",
"libffi-dev"
]
file { '/etc/apt/apt.conf.d/01retries':
```
--
This is an automated message from the Apache Git Service.
To respond to the message, please log on to GitHub and use the
URL above to go to the specific comment.
For queries about this service, please contact Infrastructure at:
us...@infra.apache.org
[GitHub] [bigtop] sekikn commented on pull request #780: BIGTOP-3329. Bump ambari to v2.7.5.
sekikn commented on pull request #780: URL: https://github.com/apache/bigtop/pull/780#issuecomment-851983299 Thank you for taking this issue @iwasakims! `./gradlew ambari-pkg` seems to fail with the following error on Debian 10 and Ubuntu 18.04, 20.04: ``` > Task :ambari-sdeb ... dh clean dh_auto_clean dh_auto_clean: warning: Please use the third-party "pybuild" build system instead of python-distutils dh_auto_clean: warning: This feature will be removed in compat 12. pyversions: missing X(S)-Python-Version in control file, fall back to debian/pyversions pyversions: missing debian/pyversions file, fall back to supported versions python setup.py clean -a Traceback (most recent call last): File "setup.py", line 22, in from setuptools import find_packages, setup ImportError: No module named setuptools dh_auto_clean: error: python setup.py clean -a returned exit code 1 make: *** [debian/rules:26: clean] Error 25 dpkg-buildpackage: error: fakeroot debian/rules clean subprocess returned exit status 2 > Task :ambari-sdeb FAILED FAILURE: Build failed with an exception. ``` -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Created] (BIGTOP-3549) HBase build failure caused by protobuf in xolstice
Jun He created BIGTOP-3549:
--
Summary: HBase build failure caused by protobuf in xolstice
Key: BIGTOP-3549
URL: https://issues.apache.org/jira/browse/BIGTOP-3549
Project: Bigtop
Issue Type: Bug
Components: hbase
Reporter: Jun He
Assignee: Jun He
HBase build on Arm is failed with following output:
{code:java}
[INFO]
[INFO] BUILD FAILURE
[INFO]
[INFO] Total time: 01:35 min
[INFO] Finished at: 2021-06-01T07:40:05Z
[INFO]
[ERROR] Failed to execute goal
org.xolstice.maven.plugins:protobuf-maven-plugin:0.5.0:compile (compile-protoc)
on project hbase-protocol: Missing:
[ERROR] --
[ERROR] 1) com.google.protobuf:protoc:exe:linux-aarch_64:2.5.0
[ERROR]
[ERROR] Try downloading the file manually from the project website.
[ERROR]
[ERROR] Then, install it using the command:
[ERROR] mvn install:install-file -DgroupId=com.google.protobuf
-DartifactId=protoc -Dversion=2.5.0 -Dclassifier=linux-aarch_64 -Dpackaging=exe
-Dfile=/path/to/file
[ERROR]
[ERROR] Alternatively, if you host your own repository you can deploy the
file there:
[ERROR] mvn deploy:deploy-file -DgroupId=com.google.protobuf
-DartifactId=protoc -Dversion=2.5.0 -Dclassifier=linux-aarch_64 -Dpackaging=exe
-Dfile=/path/to/file -Durl=[url] -DrepositoryId=[id]
[ERROR]
[ERROR] Path to dependency:
[ERROR]1) org.apache.hbase:hbase-protocol:jar:2.2.6
[ERROR]2) com.google.protobuf:protoc:exe:linux-aarch_64:2.5.0
[ERROR]
[ERROR] --
[ERROR] 1 required artifact is missing.
[ERROR]
[ERROR] for artifact:
[ERROR] org.apache.hbase:hbase-protocol:jar:2.2.6
[ERROR]
[ERROR] from the specified remote repositories:
[ERROR] apache.snapshots (https://repository.apache.org/snapshots,
releases=false, snapshots=true),
[ERROR] central (https://repo.maven.apache.org/maven2, releases=true,
snapshots=false) {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
