[ANNOUNCE] New Bigtop Committer: Jialiang Cai

2024-07-30 Thread Masatake Iwasaki
to go via the proxy patch submission process. This should enable better productivity. We're happy to have you on board and looking for many more contributions to come. Please join me in congratulating Jialiang Cai. Best regards, Masatake Iwasaki (on behalf of the Apache Bigtop PMC)

[jira] [Created] (BIGTOP-4171) fix the docker repo of openeuler

2024-07-25 Thread Masatake Iwasaki (Jira)
Masatake Iwasaki created BIGTOP-4171: Summary: fix the docker repo of openeuler Key: BIGTOP-4171 URL: https://issues.apache.org/jira/browse/BIGTOP-4171 Project: Bigtop Issue Type: Bug

[jira] [Created] (BIGTOP-4157) Drop CentOS 7

2024-07-10 Thread Masatake Iwasaki (Jira)
Masatake Iwasaki created BIGTOP-4157: Summary: Drop CentOS 7 Key: BIGTOP-4157 URL: https://issues.apache.org/jira/browse/BIGTOP-4157 Project: Bigtop Issue Type: Improvement

[jira] [Created] (BIGTOP-4156) Fix init script of Zeppelin to properly get status

2024-07-10 Thread Masatake Iwasaki (Jira)
Masatake Iwasaki created BIGTOP-4156: Summary: Fix init script of Zeppelin to properly get status Key: BIGTOP-4156 URL: https://issues.apache.org/jira/browse/BIGTOP-4156 Project: Bigtop

[ANNOUNCE] Apache Bigtop 3.3.0 released

2024-07-08 Thread Masatake Iwasaki
to devote time to make Bigtop a better software. Thank you all for making this release possible! Masatake Iwasaki

[RESULT][VOTE] Release Bigtop 3.3.0 RC0

2024-07-07 Thread Masatake Iwasaki
The vote for 3.3.0 RC0 PASSED with 3 binging +1s and 2 non-bingind +1. Binding +1s: Yuqi Gu Kengo Seki Masatake Iwasaki Non-binding +1s: Zhiguo Wu Qiang Chen Thank you all for supporting this release. Masatake Iwasaki

Re: [VOTE] Release Bigtop 3.3.0 RC0

2024-07-07 Thread Masatake Iwasaki
+1(binding) from myself. Masatake Iwasaki On Thu, Jun 20, 2024 at 9:09 PM Masatake Iwasaki wrote: > > This is the vote for release 3.3.0 of Apache Bigtop. (RC0) > > It fixes the following issues: > > https://issues.apache.org/jira/secure/ReleaseNote.jspa?version=1235

[VOTE] Release Bigtop 3.3.0 RC0

2024-06-20 Thread Masatake Iwasaki
of packaging, deployment and smoke tests on the CI environment are as follows: https://cwiki.apache.org/confluence/display/BIGTOP/Overview+of+Bigtop+3.3.0+Support+Matrix Masatake Iwasaki

[jira] [Created] (BIGTOP-4147) Fix test failure of Ranger due to timing issue

2024-06-20 Thread Masatake Iwasaki (Jira)
Masatake Iwasaki created BIGTOP-4147: Summary: Fix test failure of Ranger due to timing issue Key: BIGTOP-4147 URL: https://issues.apache.org/jira/browse/BIGTOP-4147 Project: Bigtop

[ANNOUNCE] New Bigtop Committer: Qiang Chen

2024-06-19 Thread Masatake Iwasaki
via the proxy patch submission process. This should enable better productivity. We're happy to have you on board and looking for many more contributions to come. Please join me in congratulating Qiang Chen. Best regards, Masatake Iwasaki (on behalf of the Apache Bigtop PMC)

[jira] [Created] (BIGTOP-4126) Remove obsolete test resources for Hue

2024-06-10 Thread Masatake Iwasaki (Jira)
Masatake Iwasaki created BIGTOP-4126: Summary: Remove obsolete test resources for Hue Key: BIGTOP-4126 URL: https://issues.apache.org/jira/browse/BIGTOP-4126 Project: Bigtop Issue Type

Re: [Discuss] Bigtop release 3.3

2024-06-07 Thread Masatake Iwasaki
We can start vote for the release after addressing test failures of Ranger and nits. https://ci.bigtop.apache.org/job/Bigtop-3.3.0-smoke-tests/ Masatake Iwasaki On 2024/04/25 14:43, Masatake Iwasaki wrote: I'm working on jobs for building 3.3.0. https://ci.bigtop.apache.org/job/Bigtop-3.3.0

[jira] [Created] (BIGTOP-4122) Fix test failure of SparkR on openEuler due to lack of R deployment

2024-06-05 Thread Masatake Iwasaki (Jira)
Masatake Iwasaki created BIGTOP-4122: Summary: Fix test failure of SparkR on openEuler due to lack of R deployment Key: BIGTOP-4122 URL: https://issues.apache.org/jira/browse/BIGTOP-4122 Project

[jira] [Created] (BIGTOP-4121) Fix test failure of Phoenix on rockylinux-8 due to deployment issue of python3

2024-06-04 Thread Masatake Iwasaki (Jira)
Masatake Iwasaki created BIGTOP-4121: Summary: Fix test failure of Phoenix on rockylinux-8 due to deployment issue of python3 Key: BIGTOP-4121 URL: https://issues.apache.org/jira/browse/BIGTOP-4121

[jira] [Created] (BIGTOP-4114) Fix build failure of Hadoop due to lack of python in the PATH on rockylinux-8 and fedora-38 aarch64

2024-05-30 Thread Masatake Iwasaki (Jira)
Masatake Iwasaki created BIGTOP-4114: Summary: Fix build failure of Hadoop due to lack of python in the PATH on rockylinux-8 and fedora-38 aarch64 Key: BIGTOP-4114 URL: https://issues.apache.org/jira/browse

[jira] [Created] (BIGTOP-4113) Drop GPDB

2024-05-29 Thread Masatake Iwasaki (Jira)
Masatake Iwasaki created BIGTOP-4113: Summary: Drop GPDB Key: BIGTOP-4113 URL: https://issues.apache.org/jira/browse/BIGTOP-4113 Project: Bigtop Issue Type: Improvement

[DISCUSS] Drop GPDB from Bigtop

2024-05-29 Thread Masatake Iwasaki
is in release process. We can release 3.3.0 even without patching current code base. We just need to declare that it is dropped and excluding the GPDB from CI build. Thanks, Masatake Iwasaki

[jira] [Created] (BIGTOP-4111) Fix compilation error of GPDB on CentOS 7 aarch64

2024-05-24 Thread Masatake Iwasaki (Jira)
Masatake Iwasaki created BIGTOP-4111: Summary: Fix compilation error of GPDB on CentOS 7 aarch64 Key: BIGTOP-4111 URL: https://issues.apache.org/jira/browse/BIGTOP-4111 Project: Bigtop

[jira] [Created] (BIGTOP-4109) Fix deployment failure of Spark on Fedora 38 due to manifest incompatible with Puppet 8

2024-05-22 Thread Masatake Iwasaki (Jira)
Masatake Iwasaki created BIGTOP-4109: Summary: Fix deployment failure of Spark on Fedora 38 due to manifest incompatible with Puppet 8 Key: BIGTOP-4109 URL: https://issues.apache.org/jira/browse/BIGTOP-4109

[jira] [Created] (BIGTOP-4108) Add support for openEuler to the manifest of bigtop-deploy to set up Bigtop Yum repository

2024-05-22 Thread Masatake Iwasaki (Jira)
Masatake Iwasaki created BIGTOP-4108: Summary: Add support for openEuler to the manifest of bigtop-deploy to set up Bigtop Yum repository Key: BIGTOP-4108 URL: https://issues.apache.org/jira/browse/BIGTOP

[jira] [Created] (BIGTOP-4106) Build GPDB against Python 3

2024-05-15 Thread Masatake Iwasaki (Jira)
Masatake Iwasaki created BIGTOP-4106: Summary: Build GPDB against Python 3 Key: BIGTOP-4106 URL: https://issues.apache.org/jira/browse/BIGTOP-4106 Project: Bigtop Issue Type: Bug

[jira] [Created] (BIGTOP-4103) Replace legacy facts in manifests

2024-04-30 Thread Masatake Iwasaki (Jira)
Masatake Iwasaki created BIGTOP-4103: Summary: Replace legacy facts in manifests Key: BIGTOP-4103 URL: https://issues.apache.org/jira/browse/BIGTOP-4103 Project: Bigtop Issue Type: Bug

[jira] [Created] (BIGTOP-4102) Fix failure of toolchain manifest on Fedora 38 due to undefined variable

2024-04-30 Thread Masatake Iwasaki (Jira)
Masatake Iwasaki created BIGTOP-4102: Summary: Fix failure of toolchain manifest on Fedora 38 due to undefined variable Key: BIGTOP-4102 URL: https://issues.apache.org/jira/browse/BIGTOP-4102

[jira] [Created] (BIGTOP-4101) Fix undefined variable in toolchain manifest for openEuler

2024-04-30 Thread Masatake Iwasaki (Jira)
Masatake Iwasaki created BIGTOP-4101: Summary: Fix undefined variable in toolchain manifest for openEuler Key: BIGTOP-4101 URL: https://issues.apache.org/jira/browse/BIGTOP-4101 Project: Bigtop

Re: [Discuss] Bigtop release 3.3

2024-04-24 Thread Masatake Iwasaki
is coming soon. Thanks, Masatake Iwasaki On 2024/04/22 19:29, Masatake Iwasaki wrote: Hi Bigtop developers, I created branch-3.3. Please set "3.4.0" to "Fix version/s" field of JIRA issue on merging PR and resolving the issue. I will change the value to "3.3.0"

[jira] [Created] (BIGTOP-4097) Fix missing R package resource in toolchain manifest

2024-04-23 Thread Masatake Iwasaki (Jira)
Masatake Iwasaki created BIGTOP-4097: Summary: Fix missing R package resource in toolchain manifest Key: BIGTOP-4097 URL: https://issues.apache.org/jira/browse/BIGTOP-4097 Project: Bigtop

Re: [Discuss] Bigtop release 3.3

2024-04-22 Thread Masatake Iwasaki
set only after merging PR and resolving the issue as "Fixed" in order to avoid mistakenly picking it in the release notes. Issues resolved as "Duplicate" or "Invalid" must not have "Fix version/s". Thanks, Masatake Iwasaki On 2024/04/22 11:47, Masatake Iwasaki wro

Notices on maintaining JIRA issues

2024-04-22 Thread Masatake Iwasaki
es. * The "Fix Version/s" may have multiple values if we commit the patch to multiple branches. For example, it should be "3.3.0, 3,2.1" if we commit the patch to master and branch-3.2 now. * The issue and PR title should be updated if it is not enough informative before merging. Thanks, Masatake Iwasaki

Re: [Discuss] Bigtop release 3.3

2024-04-21 Thread Masatake Iwasaki
of Flink on CentOS 7 aarch64 (and ppc64le) will be addressed by BIGTOP-4076 soon. * Removing dependency on python2 needs some cleanups. * Some smoke-tests failures must be fixed. Thanks, Masatake Iwasaki On 2024/03/25 19:25, Masatake Iwasaki wrote:    The issues we found are:    BIGTOP-4076

[jira] [Created] (BIGTOP-4095) Fix failure of starting service due to lack of initscripts on Rocky Linux 9

2024-04-18 Thread Masatake Iwasaki (Jira)
Masatake Iwasaki created BIGTOP-4095: Summary: Fix failure of starting service due to lack of initscripts on Rocky Linux 9 Key: BIGTOP-4095 URL: https://issues.apache.org/jira/browse/BIGTOP-4095

[jira] [Created] (BIGTOP-4094) Migrate /var/run to /run /var/run on Rocky Linux 9

2024-04-18 Thread Masatake Iwasaki (Jira)
Masatake Iwasaki created BIGTOP-4094: Summary: Migrate /var/run to /run /var/run on Rocky Linux 9 Key: BIGTOP-4094 URL: https://issues.apache.org/jira/browse/BIGTOP-4094 Project: Bigtop

[jira] [Created] (BIGTOP-4093) Avoid oepkgs for installing R on openEuler

2024-04-16 Thread Masatake Iwasaki (Jira)
Masatake Iwasaki created BIGTOP-4093: Summary: Avoid oepkgs for installing R on openEuler Key: BIGTOP-4093 URL: https://issues.apache.org/jira/browse/BIGTOP-4093 Project: Bigtop Issue

[jira] [Created] (BIGTOP-4092) Drop python2 from bigtop_toolchain and bigtop-deploy

2024-04-16 Thread Masatake Iwasaki (Jira)
Masatake Iwasaki created BIGTOP-4092: Summary: Drop python2 from bigtop_toolchain and bigtop-deploy Key: BIGTOP-4092 URL: https://issues.apache.org/jira/browse/BIGTOP-4092 Project: Bigtop

[jira] [Created] (BIGTOP-4091) Add python3 to CentOS 7

2024-04-16 Thread Masatake Iwasaki (Jira)
Masatake Iwasaki created BIGTOP-4091: Summary: Add python3 to CentOS 7 Key: BIGTOP-4091 URL: https://issues.apache.org/jira/browse/BIGTOP-4091 Project: Bigtop Issue Type: Improvement

[jira] [Created] (BIGTOP-4090) Move setups unrelated to Puppet to bigtop-deploy

2024-04-15 Thread Masatake Iwasaki (Jira)
Masatake Iwasaki created BIGTOP-4090: Summary: Move setups unrelated to Puppet to bigtop-deploy Key: BIGTOP-4090 URL: https://issues.apache.org/jira/browse/BIGTOP-4090 Project: Bigtop

[jira] [Created] (BIGTOP-4089) Fix build failure of Spark on openEuler 22.03 due to missing R

2024-04-10 Thread Masatake Iwasaki (Jira)
Masatake Iwasaki created BIGTOP-4089: Summary: Fix build failure of Spark on openEuler 22.03 due to missing R Key: BIGTOP-4089 URL: https://issues.apache.org/jira/browse/BIGTOP-4089 Project

[jira] [Created] (BIGTOP-4084) Upgrade Tez to 0.10.3

2024-04-04 Thread Masatake Iwasaki (Jira)
Masatake Iwasaki created BIGTOP-4084: Summary: Upgrade Tez to 0.10.3 Key: BIGTOP-4084 URL: https://issues.apache.org/jira/browse/BIGTOP-4084 Project: Bigtop Issue Type: Improvement

[jira] [Created] (BIGTOP-4083) Upgrade Hive to 4.0.0

2024-04-03 Thread Masatake Iwasaki (Jira)
Masatake Iwasaki created BIGTOP-4083: Summary: Upgrade Hive to 4.0.0 Key: BIGTOP-4083 URL: https://issues.apache.org/jira/browse/BIGTOP-4083 Project: Bigtop Issue Type: Bug

Re: [Discuss] Bigtop release 3.3

2024-04-02 Thread Masatake Iwasaki
. * https://ci.bigtop.apache.org/job/Bigtop-trunk-x86_64/DISTRO=centos-7,PLATFORM=amd64-slave,PRODUCT=hadoop/lastSuccessfulBuild/artifact/*zip*/archive.zip Thanks, Masatake Iwasaki On 2024/03/21 23:18, Luca Toscano wrote: Hi Masatake, Not sure if you saw https://issues.apache.org/jira/browse/BIGTOP

Re: [Discuss] Bigtop release 3.3

2024-03-25 Thread Masatake Iwasaki
The issues we found are: BIGTOP-4076/BIGTOP-4068/BIGTOP-4069/BIGTOP-4074/BIGTOP-4073/BIGTOP-4079/BIGTOP-4078/BIGTOP-4077 Thanks for helping to move the release forward. I'm going to look into the issues in the next week since I don't have enough cycle this month.. Masatake Iwasaki

Re: [Discuss] Bigtop release 3.3

2024-03-18 Thread Masatake Iwasaki
I'm updating CI jobs for master branch now. If the result of smoke-tests looks good, I will create branch-3.3 and set up CI jobs creating release. Masatake Iwasaki On 2024/03/01 10:40, chenqiang2080 wrote: Hi,all The tasks of next Bigtop release 3.3 version(BIGTOP-3909) are basically

[jira] [Created] (BIGTOP-4080) Enable devel repo on Rocky Linux 9

2024-03-18 Thread Masatake Iwasaki (Jira)
Masatake Iwasaki created BIGTOP-4080: Summary: Enable devel repo on Rocky Linux 9 Key: BIGTOP-4080 URL: https://issues.apache.org/jira/browse/BIGTOP-4080 Project: Bigtop Issue Type: Bug

Re: DISCUSSION: Proposal for Continuing Knox Support in Bigtop

2024-03-11 Thread Masatake Iwasaki
clusters. The manifests of bigtop-deploy for deploying cluster with Kerberos has limited coverage and may be outdated since we usually run smoke-tests without it. Additional effort should be needed for testing the Knox well. Thanks, Masatake Iwasaki On 2024/03/07 16:17, Jialiang Cai wrote

[jira] [Created] (BIGTOP-4067) Fix build failure of Python 2.7 on Rocky Linux 9

2024-02-25 Thread Masatake Iwasaki (Jira)
Masatake Iwasaki created BIGTOP-4067: Summary: Fix build failure of Python 2.7 on Rocky Linux 9 Key: BIGTOP-4067 URL: https://issues.apache.org/jira/browse/BIGTOP-4067 Project: Bigtop

[jira] [Created] (BIGTOP-4062) Upgrade Spark to 3.3.4

2024-02-07 Thread Masatake Iwasaki (Jira)
Masatake Iwasaki created BIGTOP-4062: Summary: Upgrade Spark to 3.3.4 Key: BIGTOP-4062 URL: https://issues.apache.org/jira/browse/BIGTOP-4062 Project: Bigtop Issue Type: Improvement

[DISCUSS]Drop bigtop-bigpetstore

2023-12-31 Thread Masatake Iwasaki
Hi developers, I filed BIGTOP-4057[1] to drop bigtop-bigpetstore which is no longer maintained. Please shout if someone is using this and willing to update the code. [1]https://issues.apache.org/jira/browse/BIGTOP-4057 Thanks, Masatake Iwasaki

[jira] [Created] (BIGTOP-4057) Drop bigtop-bigpetstore

2023-12-31 Thread Masatake Iwasaki (Jira)
Masatake Iwasaki created BIGTOP-4057: Summary: Drop bigtop-bigpetstore Key: BIGTOP-4057 URL: https://issues.apache.org/jira/browse/BIGTOP-4057 Project: Bigtop Issue Type: Improvement

Re: Discussion on Removing Python Dependency from Spark3 Installation Package

2023-12-23 Thread Masatake Iwasaki
It basically sounds good. We already know that package dependencies of Bigtop is not exhaustive. While many products depend on Java, there is no package dependency on Java. Users can choose JDK distribution based on their preferences. Maybe we can provide utilities like bigtop-detect-javahome of

Re: Discussion on Introducing Parallel Compilation Support for Bigtop Components

2023-12-14 Thread Masatake Iwasaki
ant as expected due to the part, FWIW. On 2023/12/15 11:33, Masatake Iwasaki wrote: Hi Jialiang, Thanks for bringing this up. It sounds good to improve developers' experience by reducing compilation time. I think we should apply it to the most time-consuming product first then evaluate how much time we

Re: Discussion on Introducing Parallel Compilation Support for Bigtop Components

2023-12-14 Thread Masatake Iwasaki
ion optimization. I look forward to your feedback and further discussions on this exciting endeavor to enhance the compilation process within our open-source community. Best regards, jiaLiang On Dec 15, 2023, at 10:33, Masatake Iwasaki wrote: Hi Jialiang, Thanks for bringing this up. It sounds g

Re: Discussion on Introducing Parallel Compilation Support for Bigtop Components

2023-12-14 Thread Masatake Iwasaki
rom the extension alone after that. I prefer one patch for doing one thing. Regards, Masatake Iwasaki On 2023/12/15 10:51, Jialiang Cai wrote: Subject: Discussion on Introducing Parallel Compilation Support for Bigtop Components Dear Bigtop Community Members, I hope this message finds you well

[jira] [Created] (BIGTOP-4022) Fix build failure of Hive against Tez 0.10.2

2023-10-15 Thread Masatake Iwasaki (Jira)
Masatake Iwasaki created BIGTOP-4022: Summary: Fix build failure of Hive against Tez 0.10.2 Key: BIGTOP-4022 URL: https://issues.apache.org/jira/browse/BIGTOP-4022 Project: Bigtop Issue

Re: [DISCUSS] Support for Iceberg in bigtop

2023-09-06 Thread Masatake Iwasaki
the iceberg in bigtop stack like upgrades..? Any idea, how others are adopted this..? On 10/08/23, 7:16 AM, "Masatake Iwasaki" mailto:iwasak...@oss.nttdata.com>> wrote: Looking at the packaging perspective the efforts should be minimal. At present, Hive and Spark are the only B

[jira] [Created] (BIGTOP-4002) Fix build failure of Zeppelin against Hadoop 3.3.6 due to dependency convergence error

2023-09-05 Thread Masatake Iwasaki (Jira)
Masatake Iwasaki created BIGTOP-4002: Summary: Fix build failure of Zeppelin against Hadoop 3.3.6 due to dependency convergence error Key: BIGTOP-4002 URL: https://issues.apache.org/jira/browse/BIGTOP-4002

[jira] [Created] (BIGTOP-4001) Bump HBase to 2.4.17

2023-09-04 Thread Masatake Iwasaki (Jira)
Masatake Iwasaki created BIGTOP-4001: Summary: Bump HBase to 2.4.17 Key: BIGTOP-4001 URL: https://issues.apache.org/jira/browse/BIGTOP-4001 Project: Bigtop Issue Type: Improvement

[jira] [Created] (BIGTOP-4000) Fix build failure of Tez against Hadoop 3.3.6

2023-09-04 Thread Masatake Iwasaki (Jira)
Masatake Iwasaki created BIGTOP-4000: Summary: Fix build failure of Tez against Hadoop 3.3.6 Key: BIGTOP-4000 URL: https://issues.apache.org/jira/browse/BIGTOP-4000 Project: Bigtop Issue

[jira] [Created] (BIGTOP-3999) Make docker provisioner of upstream aware of Bigtop 3.2.1

2023-09-03 Thread Masatake Iwasaki (Jira)
Masatake Iwasaki created BIGTOP-3999: Summary: Make docker provisioner of upstream aware of Bigtop 3.2.1 Key: BIGTOP-3999 URL: https://issues.apache.org/jira/browse/BIGTOP-3999 Project: Bigtop

Re: Can we install Bigtop-3.2.0 on RHEL8

2023-08-25 Thread Masatake Iwasaki
Bigtop 3.2 is built and tested on Rocky Linux 8. Usually it works on RHEL 8 too since packages does not depend on optional repositories as far as I know. If you find issues specific to RHEL 8, you can file JIRA issues. On 2023/08/23 20:50, Chandrasekhar A wrote: Hi Team, I am trying to setup

[jira] [Created] (BIGTOP-3994) Bump Hadoop to 3.3.6

2023-08-22 Thread Masatake Iwasaki (Jira)
Masatake Iwasaki created BIGTOP-3994: Summary: Bump Hadoop to 3.3.6 Key: BIGTOP-3994 URL: https://issues.apache.org/jira/browse/BIGTOP-3994 Project: Bigtop Issue Type: Improvement

[jira] [Created] (BIGTOP-3993) Bump ZooKeeper to 3.6.4

2023-08-22 Thread Masatake Iwasaki (Jira)
Masatake Iwasaki created BIGTOP-3993: Summary: Bump ZooKeeper to 3.6.4 Key: BIGTOP-3993 URL: https://issues.apache.org/jira/browse/BIGTOP-3993 Project: Bigtop Issue Type: Improvement

[ANNOUNCE] Apache Bigtop 3.2.1 released

2023-08-21 Thread Masatake Iwasaki
that this is a collaborative work done by project contributors and other communities, who continue to devote time to make Bigtop a better software. Thank you all for making this release possible! Masatake Iwasaki

[RESULT][VOTE] Release Bigtop version 3.2.1 RC0

2023-08-21 Thread Masatake Iwasaki
I'm concluding the vote with my own +1. The vote for 3.2.1 RC0 PASSED with 3 binging +1s and 1 non-bingind +1. Binding +1s: Kengo Seki Yuqi Gu Masatake Iwasaki Non-binding +1s: Jialiang Cai Thank you all for supporting this release. Masatake Iwasaki

Re: [VOTE] Release Bigtop version 3.2.1 RC0

2023-08-16 Thread Masatake Iwasaki
Hi developers, I'm still waiting for votes for RC0. Let me know if you find issues worth for cutting RC1. Thanks, Masatake Iwasaki On 2023/08/04 23:37, Masatake Iwasaki wrote: This is the vote for release 3.2.1 of Apache Bigtop. (RC0) It fixes the following issues:     https

Re: [DISCUSS] Support for Iceberg in bigtop

2023-08-09 Thread Masatake Iwasaki
Looking at the packaging perspective the efforts should be minimal. At present, Hive and Spark are the only Bigtop components that can support iceberg, and only a single jar is required to be packaged into the respective component lib directories. I guess the versions of Flink, Spark and Hive

[jira] [Created] (BIGTOP-3981) Get rid of building patched leveldbjni in Hadoop packaging on aarch64

2023-08-04 Thread Masatake Iwasaki (Jira)
Masatake Iwasaki created BIGTOP-3981: Summary: Get rid of building patched leveldbjni in Hadoop packaging on aarch64 Key: BIGTOP-3981 URL: https://issues.apache.org/jira/browse/BIGTOP-3981

Re: Adding trino as a new component in Bigtop stack

2023-08-04 Thread Masatake Iwasaki
. Is there any license/IP/trademark issue especially if we distribute pre-built binaries? Thanks, Masatake Iwasaki On 2023/08/04 20:58, Akanksha Kedia wrote: Hello Team, [DISCUSS] I have raised two jira id Bigtop-3959 and Bigtop-3971 and also raised Pull request involving the changes needed

[VOTE] Release Bigtop version 3.2.1 RC0

2023-08-04 Thread Masatake Iwasaki
of packaging, deployment and smoke tests on the CI environment are as follows: https://cwiki.apache.org/confluence/display/BIGTOP/Overview+of+Bigtop+3.2.1+Support+Matrix Masatake Iwasaki

[jira] [Created] (BIGTOP-3980) Fix timeout of smoke-test for Oozie

2023-08-04 Thread Masatake Iwasaki (Jira)
Masatake Iwasaki created BIGTOP-3980: Summary: Fix timeout of smoke-test for Oozie Key: BIGTOP-3980 URL: https://issues.apache.org/jira/browse/BIGTOP-3980 Project: Bigtop Issue Type: Bug

[jira] [Created] (BIGTOP-3979) Drop ubuntu-20.04 support

2023-08-03 Thread Masatake Iwasaki (Jira)
Masatake Iwasaki created BIGTOP-3979: Summary: Drop ubuntu-20.04 support Key: BIGTOP-3979 URL: https://issues.apache.org/jira/browse/BIGTOP-3979 Project: Bigtop Issue Type: Improvement

[jira] [Created] (BIGTOP-3978) Drop debian-10 support

2023-08-03 Thread Masatake Iwasaki (Jira)
Masatake Iwasaki created BIGTOP-3978: Summary: Drop debian-10 support Key: BIGTOP-3978 URL: https://issues.apache.org/jira/browse/BIGTOP-3978 Project: Bigtop Issue Type: Improvement

Re: [DISCUSS] Release Bigtop 3.2.1

2023-08-03 Thread Masatake Iwasaki
drop pre-built binaries available for users' convenience under http://repos.bigtop.apache.org/releases without touching the source. Users still can try to build packages on old distros on their own. Thanks, Masatake Iwasaki On 2023/08/04 13:18, Yuqi Gu wrote: Hi Masatake, To reduce the release

Re: [DISCUSS] Release Bigtop 3.2.1

2023-08-03 Thread Masatake Iwasaki
a long time to prepare the release due to my available cycle and time to understand CI environment. Thanks, Masatake Iwasaki On 2023/05/31 19:03, Evans Ye wrote: +1. Thanks Masatake! Yu Hou 於 2023年5月29日 週一 下午7:18寫道: +1 -- Best Regards, Yu Hou 在 2023-05-29 10:56:50,"Yuqi Gu

[jira] [Created] (BIGTOP-3976) Fix invalid conditional of exec resources in bigtop_toolchain

2023-08-02 Thread Masatake Iwasaki (Jira)
Masatake Iwasaki created BIGTOP-3976: Summary: Fix invalid conditional of exec resources in bigtop_toolchain Key: BIGTOP-3976 URL: https://issues.apache.org/jira/browse/BIGTOP-3976 Project

[jira] [Created] (BIGTOP-3974) Fix failure of loading OpenSSL by libhadoop.so on Ubuntu 22.04

2023-08-02 Thread Masatake Iwasaki (Jira)
Masatake Iwasaki created BIGTOP-3974: Summary: Fix failure of loading OpenSSL by libhadoop.so on Ubuntu 22.04 Key: BIGTOP-3974 URL: https://issues.apache.org/jira/browse/BIGTOP-3974 Project

[jira] [Created] (BIGTOP-3973) Fix the name of docker volume for Maven cache and make it configurable

2023-08-01 Thread Masatake Iwasaki (Jira)
Masatake Iwasaki created BIGTOP-3973: Summary: Fix the name of docker volume for Maven cache and make it configurable Key: BIGTOP-3973 URL: https://issues.apache.org/jira/browse/BIGTOP-3973

[jira] [Created] (BIGTOP-3972) Fix smoke-tests failure of Oozie due to permission error on reading ssl-client.xml

2023-07-31 Thread Masatake Iwasaki (Jira)
Masatake Iwasaki created BIGTOP-3972: Summary: Fix smoke-tests failure of Oozie due to permission error on reading ssl-client.xml Key: BIGTOP-3972 URL: https://issues.apache.org/jira/browse/BIGTOP-3972

[jira] [Created] (BIGTOP-3970) Fix build failure of Zeppelin due to missing grpc-java-1.26.0 on ppc64le

2023-07-30 Thread Masatake Iwasaki (Jira)
Masatake Iwasaki created BIGTOP-3970: Summary: Fix build failure of Zeppelin due to missing grpc-java-1.26.0 on ppc64le Key: BIGTOP-3970 URL: https://issues.apache.org/jira/browse/BIGTOP-3970

[jira] [Created] (BIGTOP-3962) Fix setup failure of Ant due to unresolved gpg public key

2023-07-22 Thread Masatake Iwasaki (Jira)
Masatake Iwasaki created BIGTOP-3962: Summary: Fix setup failure of Ant due to unresolved gpg public key Key: BIGTOP-3962 URL: https://issues.apache.org/jira/browse/BIGTOP-3962 Project: Bigtop

[jira] [Created] (BIGTOP-3960) Fix build failure of Hadoop due to version mismatch between triple-beam and node.js

2023-07-19 Thread Masatake Iwasaki (Jira)
Masatake Iwasaki created BIGTOP-3960: Summary: Fix build failure of Hadoop due to version mismatch between triple-beam and node.js Key: BIGTOP-3960 URL: https://issues.apache.org/jira/browse/BIGTOP-3960

[jira] [Created] (BIGTOP-3957) hbase-regionserver must be started after zookeer-server is ready

2023-07-12 Thread Masatake Iwasaki (Jira)
Masatake Iwasaki created BIGTOP-3957: Summary: hbase-regionserver must be started after zookeer-server is ready Key: BIGTOP-3957 URL: https://issues.apache.org/jira/browse/BIGTOP-3957 Project

[jira] [Created] (BIGTOP-3949) Fix dependency convergence error of Zeppelin

2023-06-13 Thread Masatake Iwasaki (Jira)
Masatake Iwasaki created BIGTOP-3949: Summary: Fix dependency convergence error of Zeppelin Key: BIGTOP-3949 URL: https://issues.apache.org/jira/browse/BIGTOP-3949 Project: Bigtop Issue

[jira] [Created] (BIGTOP-3948) Fix build failure of Tez due to expired certificate of bower repo

2023-06-13 Thread Masatake Iwasaki (Jira)
Masatake Iwasaki created BIGTOP-3948: Summary: Fix build failure of Tez due to expired certificate of bower repo Key: BIGTOP-3948 URL: https://issues.apache.org/jira/browse/BIGTOP-3948 Project

[jira] [Created] (BIGTOP-3947) Fix build failure of Oozie due to insufficient test scope dependency on hive-service

2023-06-13 Thread Masatake Iwasaki (Jira)
Masatake Iwasaki created BIGTOP-3947: Summary: Fix build failure of Oozie due to insufficient test scope dependency on hive-service Key: BIGTOP-3947 URL: https://issues.apache.org/jira/browse/BIGTOP-3947

[jira] [Created] (BIGTOP-3946) Fix build failure of Ambari due to expired certificate of bower repo

2023-06-12 Thread Masatake Iwasaki (Jira)
Masatake Iwasaki created BIGTOP-3946: Summary: Fix build failure of Ambari due to expired certificate of bower repo Key: BIGTOP-3946 URL: https://issues.apache.org/jira/browse/BIGTOP-3946 Project

[DISCUSS] Release Bigtop 3.2.1

2023-05-28 Thread Masatake Iwasaki
/issues/?jql=project%20IN%20(Bigtop)%20AND%20fixVersion%20%3D%203.2.1%20ORDER%20BY%20updated%20DESC I think we should limit the scope to just bumping Hadoop to 3.3.5 and critical fixes (if any) to release this quickly. Thanks, Masatake Iwasaki

Re: New Committer: Zhiguo Wu

2023-05-17 Thread Masatake Iwasaki
Congratulations! On 2023/05/17 16:49, chenqiang2080 wrote: Congratulations Zhiguo Wu! At 2023-05-17 15:03:24, "Yuqi Gu" wrote: The Project Management Committee (PMC) for Apache Bigtop has asked Zhiguo Wu to become a committer and we are pleased to announce that he has accepted!

[jira] [Created] (BIGTOP-3930) Fix deployment failure on Ubuntu 22.04 due to unavailable dependency on python

2023-04-19 Thread Masatake Iwasaki (Jira)
Masatake Iwasaki created BIGTOP-3930: Summary: Fix deployment failure on Ubuntu 22.04 due to unavailable dependency on python Key: BIGTOP-3930 URL: https://issues.apache.org/jira/browse/BIGTOP-3930

[jira] [Created] (BIGTOP-3929) Fix build failure of Flink due to transitive dependency on pentaho-aggdesigner-algorithm

2023-04-13 Thread Masatake Iwasaki (Jira)
Masatake Iwasaki created BIGTOP-3929: Summary: Fix build failure of Flink due to transitive dependency on pentaho-aggdesigner-algorithm Key: BIGTOP-3929 URL: https://issues.apache.org/jira/browse/BIGTOP-3929

[jira] [Created] (BIGTOP-3927) Fix build failure of HBase against Hadoop 3.3.5

2023-04-10 Thread Masatake Iwasaki (Jira)
Masatake Iwasaki created BIGTOP-3927: Summary: Fix build failure of HBase against Hadoop 3.3.5 Key: BIGTOP-3927 URL: https://issues.apache.org/jira/browse/BIGTOP-3927 Project: Bigtop

[jira] [Created] (BIGTOP-3926) Fix build failure of Hive against Hadoop 3.3.5

2023-04-10 Thread Masatake Iwasaki (Jira)
Masatake Iwasaki created BIGTOP-3926: Summary: Fix build failure of Hive against Hadoop 3.3.5 Key: BIGTOP-3926 URL: https://issues.apache.org/jira/browse/BIGTOP-3926 Project: Bigtop

Re: [DISCUSSION] Support OpenEuler OS for Bigtop

2023-02-14 Thread Masatake Iwasaki
not support it in the long term without getting continuous contributions from OpenEuler users and adding committers capable to help release process while we can try to add it now anyway. Thanks, Masatake Iwasaki On 2023/02/13 14:35, Yuqi Gu wrote: Hi chenqiang, Thank you to your team for all

Re: How to build against BigTop approved versions?

2023-02-06 Thread Masatake Iwasaki
If there are no BigTop-specific maven names or repositories, then: * Are we expected to build BigTop from source code? * Does building BigTop from source code deploy hadoop artifact to our local maven repository? Building HBase package by using Bigtop installs artifacts to your local

Re: [VOTE] Release Bigtop version 3.2.0

2023-01-14 Thread Masatake Iwasaki
in 3.2.1. Thanks, Masatake Iwasaki On 2023/01/14 20:08, Kengo Seki wrote: Thank you so much for driving the release, Yuqi! Sorry for my late response, but I have some comments and questions: * Regarding Masatake's comment, I think he meant we should add the missed issues to the release notes

[jira] [Created] (BIGTOP-3901) Fix failure of Kerberos deployment on Rocky Linux 8

2023-01-14 Thread Masatake Iwasaki (Jira)
Masatake Iwasaki created BIGTOP-3901: Summary: Fix failure of Kerberos deployment on Rocky Linux 8 Key: BIGTOP-3901 URL: https://issues.apache.org/jira/browse/BIGTOP-3901 Project: Bigtop

[jira] [Created] (BIGTOP-3900) Migrate secure DataNode settings from jsvc to SASL

2023-01-14 Thread Masatake Iwasaki (Jira)
Masatake Iwasaki created BIGTOP-3900: Summary: Migrate secure DataNode settings from jsvc to SASL Key: BIGTOP-3900 URL: https://issues.apache.org/jira/browse/BIGTOP-3900 Project: Bigtop

Re: [VOTE] Release Bigtop version 3.2.0

2023-01-05 Thread Masatake Iwasaki
on/s" if you find another missed issues. Regards, Masatake Iwasaki On 2023/01/02 18:53, Yuqi Gu wrote: Hi folks, Happy new year. Wishing you a joyous 2023! This is the vote for release 3.2.0 of Apache Bigtop. It fixes the following issues: https://issues.apache.org/jira/secure/ReleaseN

Re: Patch for Hive fixing HiveServer2 service discovery issue

2023-01-01 Thread Masatake Iwasaki
The patch of HIVE-19825 is not yet accepted since it does not add test case and QA build issues. We can cherry-pick the patch to Bigtop once after it is accepted by Hive community. On 2022/12/27 20:50, Szymon Orzechowski wrote: Hi, recently we've encountered a problem with HiveServer2 service

[jira] [Created] (BIGTOP-3885) Drop mpack from Bigtop

2022-11-25 Thread Masatake Iwasaki (Jira)
Masatake Iwasaki created BIGTOP-3885: Summary: Drop mpack from Bigtop Key: BIGTOP-3885 URL: https://issues.apache.org/jira/browse/BIGTOP-3885 Project: Bigtop Issue Type: Improvement

Re: [DISCUSS] Enable Github Issues for customer-facing questions.

2022-10-24 Thread Masatake Iwasaki
lists should be a viable option. Thanks, Masatake Iwasaki On 2022/10/25 12:39, 吴治国 wrote: Hello community, Since JIRA is going to disable public signups, we need to spend more time and effort to help create accounts for contributors and users, which makes it harder for users to do bug reports

[jira] [Created] (BIGTOP-3843) docker-hadoop.sh should not ignore --smoke-tests option

2022-10-12 Thread Masatake Iwasaki (Jira)
Masatake Iwasaki created BIGTOP-3843: Summary: docker-hadoop.sh should not ignore --smoke-tests option Key: BIGTOP-3843 URL: https://issues.apache.org/jira/browse/BIGTOP-3843 Project: Bigtop

  1   2   3   >