[GitHub] [bigtop] uscxiexing commented on pull request #1148: BIGTOP-3967: add support for spark
uscxiexing commented on PR #1148: URL: https://github.com/apache/bigtop/pull/1148#issuecomment-1690953043 @guyuqi we checked and verfiy again.Build spark successful ，and smoke test is also successful. **compile spark successful log**: the time zone is UTC .  **smoke test successful log:**  -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@bigtop.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Created] (BIGTOP-3996) Force a clean build of toolchain images
Yuqi Gu created BIGTOP-3996:
---
Summary: Force a clean build of toolchain images
Key: BIGTOP-3996
URL: https://issues.apache.org/jira/browse/BIGTOP-3996
Project: Bigtop
Issue Type: Improvement
Reporter: Yuqi Gu
Assignee: Yuqi Gu
When I build Bigtop toolchain images, some issues occurred:
{code:java}
++ sed -i -e 's|RUN bash /tmp/puppetize.sh|ENV PATH
/usr/lib/jvm/java-1.8.0/bin:$PATH\nRUN bash /tmp/puppetize.sh|' Dockerfile
sed: preserving permissions for ‘./sedNQcfyR’: Operation not permitted
++ sed -i -e 's|RUN bash /tmp/puppetize.sh|RUN bash /tmp/puppetize.sh\nRUN dnf
install -y initscripts|' Dockerfile
sed: preserving permissions for ‘./sedAbeaag’: Operation not permitted
{code}
After fixing the permisson issues above, I start to rebuild the image
(bigtop/puppet) in the same node.
The docker build process always adopt the cache one which was not built
properly in the last time. We should force Docker to rebuild a clean image
without the cache.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Created] (BIGTOP-3995) Bug fixes for Bigtop v3.3.0 release
Yuqi Gu created BIGTOP-3995: --- Summary: Bug fixes for Bigtop v3.3.0 release Key: BIGTOP-3995 URL: https://issues.apache.org/jira/browse/BIGTOP-3995 Project: Bigtop Issue Type: Bug Reporter: Yuqi Gu Assignee: Yuqi Gu Bug fixes for Bigtop v3.3.0 release. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[GitHub] [bigtop] smallyao commented on pull request #1159: BIGTOP-3977: Support appending suffix to phoenix rpm package name
smallyao commented on PR #1159: URL: https://github.com/apache/bigtop/pull/1159#issuecomment-1690886305 We can support this feature before bumping phoenix to 5.1.3 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@bigtop.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [bigtop] MacChen01 commented on pull request #1148: BIGTOP-3967: add support for spark
MacChen01 commented on PR #1148: URL: https://github.com/apache/bigtop/pull/1148#issuecomment-1690855763 > It failed to build Spark based on openEuler toolchain images: > > ``` > ... > > Error in loadVignetteBuilder(pkgdir, TRUE) : > vignette builder 'knitr' not found > Execution halted > error: Bad exit status from /var/tmp/rpm-tmp.6j91xO (%build) > ... > ``` > > Kengo had fixed the similar issue in https://issues.apache.org/jira/browse/BIGTOP-3540. It appears `R` was not installed in openEuler properly. Please refer to PR #776 . > > Thanks. @MacChen01 We didn't modify the code about this, as you see the bugfix has merged into master branch, please help to check it. And we will check and verfiy again. @guyuqi -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@bigtop.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Can we install Bigtop-3.2.0 on RHEL8
Hi Team, I am trying to setup Apache Hadoop Bigtop 3.2.0 on RHEL8 environment from official bigtop release website I do not see any repositories supporting either centos8 or RHEL8. Bigtop website do not mention anything about RHEL8 and Centos8 distributions.Does anyone tried installing Bigtop3.2.0 on RHEL8 or Centos8 environment ? Regards, Chandu
[GitHub] [bigtop] uscxiexing commented on pull request #1148: BIGTOP-3967: add support for spark
uscxiexing commented on PR #1148: URL: https://github.com/apache/bigtop/pull/1148#issuecomment-1689716004 > > I'd like to build toochain and Spark again in a new node and make double check. I will update the status here later. Thanks. @uscxiexing Thank you, I'm also re-running this pr and build spark. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@bigtop.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [bigtop] guyuqi commented on pull request #1148: BIGTOP-3967: add support for spark
guyuqi commented on PR #1148: URL: https://github.com/apache/bigtop/pull/1148#issuecomment-1689702861 I'd like to build toochain and Spark again in a new node and make double check. I will update the status here later. Thanks. @uscxiexing -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@bigtop.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [bigtop] guyuqi commented on pull request #1148: BIGTOP-3967: add support for spark
guyuqi commented on PR #1148: URL: https://github.com/apache/bigtop/pull/1148#issuecomment-1689485307 I also cherry-pick some patches from `master` to branch `openEuler-support` several days ago. Please keep your local branch updated. Thanks. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@bigtop.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [bigtop] guyuqi commented on pull request #1148: BIGTOP-3967: add support for spark
guyuqi commented on PR #1148: URL: https://github.com/apache/bigtop/pull/1148#issuecomment-1689467450 I applied the patches from PRs: #1148, #1147 and #1143 yesterday. Built toolchain images: `bigtop/puppet:est-openeuler-22.03-aarch64` and `bigtop/slaves:test-openeuler-22.03-aarch64`. Built Spark in `bigtop/slaves:test-openeuler-22.03-aarch64`. @uscxiexing -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@bigtop.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [bigtop] uscxiexing commented on pull request #1148: BIGTOP-3967: add support for spark
uscxiexing commented on PR #1148: URL: https://github.com/apache/bigtop/pull/1148#issuecomment-1689456779 > It appears `R` was not installed in openEuler properly. thanks. this spark pr we change multiple times. This moring ,I git clone the spark pr,and build slaves images again in x86 openeuler ,i successful to got slaves images.  the detail log ； https://gitee.com/macchen1/bigtop/blob/master/docker-images/bigtop-slaves-images/x86_64/openeuler-slaves.log And I got the similar issue.,found the R and knitr  Have you updated this pr locally?,and can i know how you operate? Thanks.and i will build spark in x86 again. @guyuqi -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@bigtop.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [bigtop] guyuqi commented on pull request #1148: BIGTOP-3967: add support for spark
guyuqi commented on PR #1148: URL: https://github.com/apache/bigtop/pull/1148#issuecomment-1689385694 It failed to build Spark based on openEuler toolchain images: ``` ... Error in loadVignetteBuilder(pkgdir, TRUE) : vignette builder 'knitr' not found Execution halted error: Bad exit status from /var/tmp/rpm-tmp.6j91xO (%build) ... ``` Kengo had fixed the similar issue in https://issues.apache.org/jira/browse/BIGTOP-3540. It appears `R` was not installed in openEuler properly. Please refer to PR #776 . Thanks. @MacChen01 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@bigtop.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
