Hi Jason,
./gradlew hadoop-pkg-ind -POS=centos-7 -Pprefix=trunk
I could not reproduce the issue by running the same command on my EC2 instance.
error: Unable to write payload to /var/tmp/rpm-tmp.LARP0s:
There should be strerror message showing the cause after the ":" (e.g. "No space left on device"). https://github.com/rpm-software-management/rpm/blob/rpm-4.11.3-release/build/pack.c#L193-L195 Empty strerror string implies that errno is not set. I think it could be the case if `write` can not write nb bytes in one pass while I can not suggest configuration to fix. Masatake Iwasaki On 2021/03/24 8:53, Jason Wen wrote:
Hi team, When we build Hadoop rpms on our bamboo agent, we got following error: error: Unable to write payload to /var/tmp/rpm-tmp.LARP0s: The build works fine on our local machine, but hit this issue when running on our Bamboo agent. The build command we use is: ./gradlew hadoop-pkg-ind -POS=centos-7 -Pprefix=trunk We use master branch of bigtop repo when running the build command. Can anyone shed light on the possible reason? /var/tmp/rpm-tmp.LARP0s looks like a file to be written to the build docker container. Here are more build logs with the error: build 23-Mar-2021 15:15:19 Provides: hadoop-libhdfs-devel = 3.2.2-1.el7 hadoop-libhdfs-devel(x86-64) = 3.2.2-1.el7 build 23-Mar-2021 15:15:19 Requires(rpmlib): rpmlib(FileDigests) <= 4.6.0-1 rpmlib(PayloadFilesHavePrefix) <= 4.0-1 rpmlib(CompressedFileNames) <= 3.0.4-1 build 23-Mar-2021 15:15:19 Processing files: hadoop-hdfs-fuse-3.2.2-1.el7.x86_64 build 23-Mar-2021 15:15:19 Finding Provides: /usr/lib/rpm/redhat/find-provides build 23-Mar-2021 15:15:20 Provides: hadoop-hdfs-fuse = 3.2.2-1.el7 hadoop-hdfs-fuse(x86-64) = 3.2.2-1.el7 build 23-Mar-2021 15:15:20 Requires(rpmlib): rpmlib(FileDigests) <= 4.6.0-1 rpmlib(PayloadFilesHavePrefix) <= 4.0-1 rpmlib(CompressedFileNames) <= 3.0.4-1 build 23-Mar-2021 15:15:20 Processing files: hadoop-debuginfo-3.2.2-1.el7.x86_64 build 23-Mar-2021 15:15:20 Provides: hadoop-debuginfo = 3.2.2-1.el7 hadoop-debuginfo(x86-64) = 3.2.2-1.el7 build 23-Mar-2021 15:15:20 Requires(rpmlib): rpmlib(FileDigests) <= 4.6.0-1 rpmlib(PayloadFilesHavePrefix) <= 4.0-1 rpmlib(CompressedFileNames) <= 3.0.4-1 build 23-Mar-2021 15:15:20 Checking for unpackaged file(s): /usr/lib/rpm/check-files /bigtop/build/hadoop/rpm/BUILDROOT/hadoop-3.2.2-1.el7.x86_64 error 23-Mar-2021 15:15:20 warning: Installed (but unpackaged) file(s) found: error 23-Mar-2021 15:15:20 /etc/hadoop/conf.empty/hadoop-user-functions.sh.example error 23-Mar-2021 15:15:20 /etc/hadoop/conf.empty/shellprofile.d/example.sh error 23-Mar-2021 15:15:20 /etc/hadoop/conf.empty/user_ec_policies.xml.template error 23-Mar-2021 15:15:20 /etc/hadoop/conf.empty/yarnservice-log4j.properties error 23-Mar-2021 15:15:20 /usr/lib/hadoop/libexec/hadoop-layout.sh.example build 23-Mar-2021 15:15:49 error 23-Mar-2021 15:15:49 error: Unable to write payload to /var/tmp/rpm-tmp.LARP0s: build 23-Mar-2021 15:15:49 error 23-Mar-2021 15:15:49 File listed twice: /usr/lib/hadoop/logs build 23-Mar-2021 15:15:49 RPM build errors: error 23-Mar-2021 15:15:49 File listed twice: /var/lib/hadoop-hdfs/cache error 23-Mar-2021 15:15:49 File listed twice: /usr/lib/hadoop-yarn/bin/container-executor error 23-Mar-2021 15:15:49 File listed twice: /var/lib/hadoop-yarn/cache error 23-Mar-2021 15:15:49 File listed twice: /var/lib/hadoop-mapreduce/cache error 23-Mar-2021 15:15:49 Installed (but unpackaged) file(s) found: error 23-Mar-2021 15:15:49 /etc/hadoop/conf.empty/hadoop-user-functions.sh.example error 23-Mar-2021 15:15:49 /etc/hadoop/conf.empty/shellprofile.d/example.sh error 23-Mar-2021 15:15:49 /etc/hadoop/conf.empty/user_ec_policies.xml.template error 23-Mar-2021 15:15:49 /etc/hadoop/conf.empty/yarnservice-log4j.properties error 23-Mar-2021 15:15:49 /usr/lib/hadoop/libexec/hadoop-layout.sh.example error 23-Mar-2021 15:15:49 Unable to write payload to /var/tmp/rpm-tmp.LARP0s: build 23-Mar-2021 15:15:49 error 23-Mar-2021 15:15:49 build 23-Mar-2021 15:15:49 > Task :hadoop-rpm FAILED error 23-Mar-2021 15:15:49 FAILURE: Build failed with an exception. build 23-Mar-2021 15:15:49 :hadoop-rpm (Thread[Execution worker for ':' Thread 5,5,main]) completed. Took 42 mins 10.972 secs. error 23-Mar-2021 15:15:49 build 23-Mar-2021 15:15:49 5 actionable tasks: 5 executed error 23-Mar-2021 15:15:49 * Where: error 23-Mar-2021 15:15:49 Script '/bigtop/packages.gradle' line: 507 error 23-Mar-2021 15:15:49 error 23-Mar-2021 15:15:49 * What went wrong: error 23-Mar-2021 15:15:49 Execution failed for task ':hadoop-rpm'. error 23-Mar-2021 15:15:49 > Process 'command 'rpmbuild'' finished with non-zero exit value 1 error 23-Mar-2021 15:15:49 error 23-Mar-2021 15:15:49 * Try: error 23-Mar-2021 15:15:49 Run with --stacktrace option to get the stack trace. Run with --debug option to get more log output. Run with --scan to get full insights. error 23-Mar-2021 15:15:49 error 23-Mar-2021 15:15:49 * Get more help at https://help.gradle.org error 23-Mar-2021 15:15:49 error 23-Mar-2021 15:15:49 BUILD FAILED in 42m 33s Thanks, Jason
