Re: [DISCUSS] Move Ambari select packages to Bigtop

2022-07-04 Thread Viraj Jasani
Hi Masatake, Ambari needs rpms of select package just like we need rpms of the Bigdata packages. At my place, we follow the practice of keeping hdp-select and conf-select as separate scripts as part of a new github project and let bigtop generate rpms from this github source. For opensource

[GitHub] [bigtop] sekikn commented on pull request #326: Add Ranger

2022-07-04 Thread GitBox
sekikn commented on PR #326: URL: https://github.com/apache/bigtop/pull/326#issuecomment-1174516502 I've just submitted the updated version of this PR as #929, so I'll close this PR. Thank you so much for your contribution, @Xingwd! -- This is an automated message from the Apache Git

[GitHub] [bigtop] sekikn closed pull request #326: Add Ranger

2022-07-04 Thread GitBox
sekikn closed pull request #326: Add Ranger URL: https://github.com/apache/bigtop/pull/326 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail:

[GitHub] [bigtop] sekikn opened a new pull request, #929: BIGTOP-2971. RPM packaging for Ranger.

2022-07-04 Thread GitBox
sekikn opened a new pull request, #929: URL: https://github.com/apache/bigtop/pull/929 This PR is based on #326 submitted by @Xingwd (much appreciated!) and includes the following updates: * Upgrade Ranger version to 2.2.0 * Change the download site from ASF to GitHub,

Re: [DISCUSS] Move Ambari select packages to Bigtop

2022-07-04 Thread Masatake Iwasaki
Firstly we'll not multiple select's right..? We can have distro-select and conf-select which can be included as part of the bigtop code. User's can adopt it and even they can write their own. And user will not deploy with multiple selects right, as they can get the conflicts.. If it is the

Re: [DISCUSS] Move Ambari select packages to Bigtop

2022-07-04 Thread Battula, Brahma Reddy
> Could you elaborate the reason why we need the *-select if so? Firstly we'll not multiple select's right..? We can have distro-select and conf-select which can be included as part of the bigtop code. User's can adopt it and even they can write their own. And user will not deploy with

[jira] [Created] (BIGTOP-3720) Build failure for Hadoop to 2.10.2 in branch-1.5

2022-07-04 Thread Ben Tullis (Jira)
Ben Tullis created BIGTOP-3720: -- Summary: Build failure for Hadoop to 2.10.2 in branch-1.5 Key: BIGTOP-3720 URL: https://issues.apache.org/jira/browse/BIGTOP-3720 Project: Bigtop Issue Type:

Re: [DISCUSS] Move Ambari select packages to Bigtop

2022-07-04 Thread Masatake Iwasaki
> Multiple versions of the same package (deb/rpm) can not be installed at the same time. I dn't think, we'll required to install multiple versions same time. Even this can be handled. Could you elaborate the reason why we need the *-select if so? IMO, as components rpm's are build with

Re: [DISCUSS] Move Ambari select packages to Bigtop

2022-07-04 Thread Battula, Brahma Reddy
> Multiple versions of the same package (deb/rpm) can not be installed at the > same time. I dn't think, we'll required to install multiple versions same time. Even this can be handled. Anyway Bigtop will be used to create the RPM's not for deploying the cluster with ambari now. > I feel

[GitHub] [bigtop] sekikn merged pull request #928: BIGTOP-3715. Add TestWebHDFS to smoke-tests.

2022-07-04 Thread GitBox
sekikn merged PR #928: URL: https://github.com/apache/bigtop/pull/928 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@bigtop.apache.org

[GitHub] [bigtop] sekikn commented on pull request #928: BIGTOP-3715. Add TestWebHDFS to smoke-tests.

2022-07-04 Thread GitBox
sekikn commented on PR #928: URL: https://github.com/apache/bigtop/pull/928#issuecomment-1173603813 +1, will merge into master and branch-3.1. Thanks @iwasakims! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL

[GitHub] [bigtop] iwasakims commented on pull request #928: BIGTOP-3715. Add TestWebHDFS to smoke-tests.

2022-07-04 Thread GitBox
iwasakims commented on PR #928: URL: https://github.com/apache/bigtop/pull/928#issuecomment-1173585747 Thanks, @sekikn. I updated the patch. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [bigtop] sekikn commented on pull request #922: BIGTOP-3711: Add read/write smoke tests for Kafka

2022-07-04 Thread GitBox
sekikn commented on PR #922: URL: https://github.com/apache/bigtop/pull/922#issuecomment-1173554953 Merged into master. Thanks @yoda-mon! -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the

[GitHub] [bigtop] sekikn merged pull request #922: BIGTOP-3711: Add read/write smoke tests for Kafka

2022-07-04 Thread GitBox
sekikn merged PR #922: URL: https://github.com/apache/bigtop/pull/922 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: dev-unsubscr...@bigtop.apache.org

[GitHub] [bigtop] sekikn commented on pull request #922: BIGTOP-3711: Add read/write smoke tests for Kafka

2022-07-04 Thread GitBox
sekikn commented on PR #922: URL: https://github.com/apache/bigtop/pull/922#issuecomment-1173554254 +1, tested on Fedora 35, Debian 10 and Ubuntu 18.04. ``` $ ./docker-hadoop.sh -d -c 3 -F docker-compose-cgroupv2.yml -i bigtop/puppet:trunk-fedora-35 -r file:///bigtop-home/output

[GitHub] [bigtop] yoda-mon commented on a diff in pull request #922: BIGTOP-3711: Add read/write smoke tests for Kafka

2022-07-04 Thread GitBox
yoda-mon commented on code in PR #922: URL: https://github.com/apache/bigtop/pull/922#discussion_r912746636 ## bigtop-tests/smoke-tests/kafka/TestKafkaSmoke.groovy: ## @@ -44,9 +51,27 @@ class TestKafkaSmoke { } @Test - public void testCreateTopics() { + public void

[jira] [Created] (BIGTOP-3717) Update MapReduce service configuration in Mpack

2022-07-04 Thread Yuqi Gu (Jira)
Yuqi Gu created BIGTOP-3717: --- Summary: Update MapReduce service configuration in Mpack Key: BIGTOP-3717 URL: https://issues.apache.org/jira/browse/BIGTOP-3717 Project: Bigtop Issue Type: Sub-task

[jira] [Created] (BIGTOP-3716) [Mpack] Rename the Yarn/MapReduce historyserver PID file

2022-07-04 Thread Yuqi Gu (Jira)
Yuqi Gu created BIGTOP-3716: --- Summary: [Mpack] Rename the Yarn/MapReduce historyserver PID file Key: BIGTOP-3716 URL: https://issues.apache.org/jira/browse/BIGTOP-3716 Project: Bigtop Issue Type: