date:20240626

(hbase) 01/01: HBASE-28693 Change flaky tests to run with jdk17

2024-06-26 Thread zhangduo

This is an automated email from the ASF dual-hosted git repository.

zhangduo pushed a commit to branch HBASE-28693
in repository https://gitbox.apache.org/repos/asf/hbase.git

commit a4011c1ee79859fa6db2fd569643439b210a
Author: Duo Zhang 
AuthorDate: Thu Jun 27 12:09:42 2024 +0800

HBASE-28693 Change flaky tests to run with jdk17
---
 dev-support/docker/Dockerfile  | 34 ++
 .../flaky-tests/run-flaky-tests.Jenkinsfile| 21 ++---
 2 files changed, 27 insertions(+), 28 deletions(-)

diff --git a/dev-support/docker/Dockerfile b/dev-support/docker/Dockerfile
index 499397b6313..d40c8210afe 100644
--- a/dev-support/docker/Dockerfile
+++ b/dev-support/docker/Dockerfile
@@ -75,46 +75,46 @@ ENV LANG=en_US.UTF-8 LANGUAGE=en_US:en LC_ALL=en_US.UTF-8
 #
 
 FROM base_image AS spotbugs_download_image
-ENV SPOTBUGS_VERSION '4.7.3'
-ENV SPOTBUGS_URL 
"https://repo.maven.apache.org/maven2/com/github/spotbugs/spotbugs/${SPOTBUGS_VERSION}/spotbugs-${SPOTBUGS_VERSION}.tgz";
-ENV SPOTBUGS_SHA512 
'09a9fe0e5a6ec8e9d6d116c361b5c34c9d0560c0271241f02fadee911952adfcd69dc184f6de1cc4d4a8fe2c84c162689ea9a691dcae0779935eedf390fcc4ad'
+ENV SPOTBUGS_VERSION='4.7.3' \
+  
SPOTBUGS_URL="https://repo.maven.apache.org/maven2/com/github/spotbugs/spotbugs/${SPOTBUGS_VERSION}/spotbugs-${SPOTBUGS_VERSION}.tgz";
 \
+  SPOTBUGS_SHA512 
'09a9fe0e5a6ec8e9d6d116c361b5c34c9d0560c0271241f02fadee911952adfcd69dc184f6de1cc4d4a8fe2c84c162689ea9a691dcae0779935eedf390fcc4ad'
 SHELL ["/bin/bash", "-o", "pipefail", "-c"]
 RUN curl --location --fail --silent --show-error --output /tmp/spotbugs.tgz 
"${SPOTBUGS_URL}" && \
   echo "${SPOTBUGS_SHA512} */tmp/spotbugs.tgz" | sha512sum -c -
 
 FROM base_image AS hadolint_download_image
-ENV HADOLINT_VERSION '2.10.0'
-ENV HADOLINT_URL 
"https://github.com/hadolint/hadolint/releases/download/v${HADOLINT_VERSION}/hadolint-Linux-x86_64";
-ENV HADOLINT_SHA512 
'4816c95243bedf15476d2225f487fc17465495fb2031e1a4797d82a26db83a1edb63e4fed084b80cef17d5eb67eb45508caadaf7cd0252fb061187113991a338'
+ENV HADOLINT_VERSION='2.10.0' \
+  
HADOLINT_URL="https://github.com/hadolint/hadolint/releases/download/v${HADOLINT_VERSION}/hadolint-Linux-x86_64";
 \
+  
HADOLINT_SHA512='4816c95243bedf15476d2225f487fc17465495fb2031e1a4797d82a26db83a1edb63e4fed084b80cef17d5eb67eb45508caadaf7cd0252fb061187113991a338'
 SHELL ["/bin/bash", "-o", "pipefail", "-c"]
 RUN curl --location --fail --silent --show-error --output /tmp/hadolint 
"${HADOLINT_URL}" && \
   echo "${HADOLINT_SHA512} */tmp/hadolint" | sha512sum -c -
 
 FROM base_image AS maven_download_image
-ENV MAVEN_VERSION='3.8.6'
-ENV MAVEN_URL 
"https://archive.apache.org/dist/maven/maven-3/${MAVEN_VERSION}/binaries/apache-maven-${MAVEN_VERSION}-bin.tar.gz";
-ENV MAVEN_SHA512 
'f790857f3b1f90ae8d16281f902c689e4f136ebe584aba45e4b1fa66c80cba826d3e0e52fdd04ed44b4c66f6d3fe3584a057c26dfcac544a60b301e6d0f91c26'
+ENV MAVEN_VERSION='3.8.6' \
+  
MAVEN_URL="https://archive.apache.org/dist/maven/maven-3/${MAVEN_VERSION}/binaries/apache-maven-${MAVEN_VERSION}-bin.tar.gz";
 \
+  
MAVEN_SHA512='f790857f3b1f90ae8d16281f902c689e4f136ebe584aba45e4b1fa66c80cba826d3e0e52fdd04ed44b4c66f6d3fe3584a057c26dfcac544a60b301e6d0f91c26'
 SHELL ["/bin/bash", "-o", "pipefail", "-c"]
 RUN curl --location --fail --silent --show-error --output /tmp/maven.tar.gz 
"${MAVEN_URL}" && \
   echo "${MAVEN_SHA512} */tmp/maven.tar.gz" | sha512sum -c -
 
 FROM base_image AS openjdk8_download_image
-ENV OPENJDK8_URL 
'https://github.com/adoptium/temurin8-binaries/releases/download/jdk8u352-b08/OpenJDK8U-jdk_x64_linux_hotspot_8u352b08.tar.gz'
-ENV OPENJDK8_SHA256 
'1633bd7590cb1cd72f5a1378ae8294451028b274d798e2a4ac672059a2f00fee'
+ENV 
OPENJDK8_URL='https://github.com/adoptium/temurin8-binaries/releases/download/jdk8u352-b08/OpenJDK8U-jdk_x64_linux_hotspot_8u352b08.tar.gz'
 \
+  
OPENJDK8_SHA256='1633bd7590cb1cd72f5a1378ae8294451028b274d798e2a4ac672059a2f00fee'
 SHELL ["/bin/bash", "-o", "pipefail", "-c"]
 RUN curl --location --fail --silent --show-error --output 
/tmp/adoptopenjdk8.tar.gz "${OPENJDK8_URL}" && \
   echo "${OPENJDK8_SHA256} */tmp/adoptopenjdk8.tar.gz" | sha256sum -c -
 
 FROM base_image AS openjdk11_download_image
-ENV OPENJDK11_URL 
'https://github.com/adoptium/temurin11-binaries/releases/download/jdk-11.0.17%2B8/OpenJDK11U-jdk_x64_linux_hotspot_11.0.17_8.tar.gz'
-ENV OPENJDK11_SHA256 
'b8d46ed08ef4859476fe6421a7690d899ed83dce63f13fd894f994043177ef3c'
+ENV 
OPENJDK11_URL='https://github.com/adoptium/temurin11-binaries/releases/download/jdk-11.0.17%2B8/OpenJDK11U-jdk_x64_linux_hotspot_11.0.17_8.tar.gz'
 \
+  
OPENJDK11_SHA256='b8d46ed08ef4859476fe6421a7690d899ed83dce63f13fd894f994043177ef3c'
 SHELL ["/bin/bash", "-o", "pipefail", "-c"]
 RUN curl --location --fail --silent --show-error --output 
/tmp/adoptopenjdk11.tar.gz "${OPENJDK11_URL}" && \
   echo "${OPENJDK11_SHA256} */tmp/adoptopenjdk11.tar.gz" | sha256sum -c -
 
 FROM base_image AS openjdk17_download_ima

(hbase) branch HBASE-28693 updated (b0bd87ef0fb -> a4011c1ee79)

2024-06-26 Thread zhangduo

This is an automated email from the ASF dual-hosted git repository.

zhangduo pushed a change to branch HBASE-28693
in repository https://gitbox.apache.org/repos/asf/hbase.git


 discard b0bd87ef0fb mount passwd
 discard ab88efb5d5a remove MAVEN_OPTS in dockerfile
 discard 9b4fd9eb446 mvn
 discard 1c1be033e2a fix agent
 discard 1992a3bc5c2 HBASE-28693 Change flaky tests to run with jdk17
 new a4011c1ee79 HBASE-28693 Change flaky tests to run with jdk17

This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version.  This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:

 * -- * -- B -- O -- O -- O   (b0bd87ef0fb)
\
 N -- N -- N   refs/heads/HBASE-28693 (a4011c1ee79)

You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.

Any revisions marked "omit" are not gone; other references still
refer to them.  Any revisions marked "discard" are gone forever.

The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 dev-support/docker/Dockerfile | 33 -
 1 file changed, 16 insertions(+), 17 deletions(-)

(hbase) branch HBASE-28693 updated: mount passwd

2024-06-26 Thread zhangduo

This is an automated email from the ASF dual-hosted git repository.

zhangduo pushed a commit to branch HBASE-28693
in repository https://gitbox.apache.org/repos/asf/hbase.git


The following commit(s) were added to refs/heads/HBASE-28693 by this push:
 new b0bd87ef0fb mount passwd
b0bd87ef0fb is described below

commit b0bd87ef0fbdb1d43f6401b5a4873ac0818c42c8
Author: Duo Zhang 
AuthorDate: Thu Jun 27 14:51:51 2024 +0800

mount passwd
---
 dev-support/flaky-tests/run-flaky-tests.Jenkinsfile | 3 +++
 1 file changed, 3 insertions(+)

diff --git a/dev-support/flaky-tests/run-flaky-tests.Jenkinsfile 
b/dev-support/flaky-tests/run-flaky-tests.Jenkinsfile
index dc7669e7fbc..df7aa1f5243 100644
--- a/dev-support/flaky-tests/run-flaky-tests.Jenkinsfile
+++ b/dev-support/flaky-tests/run-flaky-tests.Jenkinsfile
@@ -19,6 +19,7 @@ pipeline {
 dockerfile {
   dir 'dev-support/docker'
   label 'hbase'
+  args '-v /etc/passwd:/etc/passwd:ro -v /etc/group:/etc/group:ro'
 }
   }
   triggers {
@@ -43,6 +44,8 @@ pipeline {
 sh '''#!/usr/bin/env bash
   set -e
   MVN="${MAVEN_HOME}/bin/mvn"
+  # print the maven version and java version
+  ${MVN} --version
   declare -a curl_args=(--fail)
   tmpdir=$(realpath target)
   declare -a mvn_args=(--batch-mode -fn -Dbuild.id="${BUILD_ID}" 
-Dmaven.repo.local="${WORKSPACE}/local-repository" -Djava.io.tmpdir=${tmpdir})

(hbase) branch HBASE-28693 updated: remove MAVEN_OPTS in dockerfile

2024-06-26 Thread zhangduo

This is an automated email from the ASF dual-hosted git repository.

zhangduo pushed a commit to branch HBASE-28693
in repository https://gitbox.apache.org/repos/asf/hbase.git


The following commit(s) were added to refs/heads/HBASE-28693 by this push:
 new ab88efb5d5a remove MAVEN_OPTS in dockerfile
ab88efb5d5a is described below

commit ab88efb5d5a2fd80c007eb3f2748a90181cec853
Author: Duo Zhang 
AuthorDate: Thu Jun 27 14:28:40 2024 +0800

remove MAVEN_OPTS in dockerfile
---
 dev-support/docker/Dockerfile | 5 ++---
 1 file changed, 2 insertions(+), 3 deletions(-)

diff --git a/dev-support/docker/Dockerfile b/dev-support/docker/Dockerfile
index 499397b6313..dcc2db45ed9 100644
--- a/dev-support/docker/Dockerfile
+++ b/dev-support/docker/Dockerfile
@@ -179,9 +179,8 @@ RUN mkdir -p /usr/lib/jvm && \
 # these values to be specified here; the various --foo-path flags do not
 # propigate as expected, while these are honored.
 # TODO (nd): is this really true? investigate and file a ticket.
-ENV SPOTBUGS_HOME '/opt/spotbugs'
-ENV MAVEN_HOME '/opt/maven'
-ENV MAVEN_OPTS '-Xmx3.6G'
+ENV SPOTBUGS_HOME='/opt/spotbugs' \
+  MAVEN_HOME='/opt/maven'
 
 CMD ["/bin/bash"]

(hbase) branch HBASE-28693 updated: mvn

2024-06-26 Thread zhangduo

This is an automated email from the ASF dual-hosted git repository.

zhangduo pushed a commit to branch HBASE-28693
in repository https://gitbox.apache.org/repos/asf/hbase.git


The following commit(s) were added to refs/heads/HBASE-28693 by this push:
 new 9b4fd9eb446 mvn
9b4fd9eb446 is described below

commit 9b4fd9eb446d1bae7f114ebe745b9f308592c415
Author: Duo Zhang 
AuthorDate: Thu Jun 27 12:20:21 2024 +0800

mvn
---
 dev-support/flaky-tests/run-flaky-tests.Jenkinsfile | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/dev-support/flaky-tests/run-flaky-tests.Jenkinsfile 
b/dev-support/flaky-tests/run-flaky-tests.Jenkinsfile
index b57771773c5..dc7669e7fbc 100644
--- a/dev-support/flaky-tests/run-flaky-tests.Jenkinsfile
+++ b/dev-support/flaky-tests/run-flaky-tests.Jenkinsfile
@@ -54,7 +54,7 @@ pipeline {
   curl "${curl_args[@]}" -o includes.txt 
"${JENKINS_URL}/job/HBase-Find-Flaky-Tests/job/master/lastSuccessfulBuild/artifact/output/includes"
   if [ -s includes.txt ]; then
 rm -rf local-repository/org/apache/hbase
-mvn clean "${mvn_args[@]}"
+${MVN} clean "${mvn_args[@]}"
 rm -rf "target/machine" && mkdir -p "target/machine"
 if [ -x dev-support/gather_machine_environment.sh ]; then
   "./dev-support/gather_machine_environment.sh" "target/machine"

(hbase) branch HBASE-28693 updated: fix agent

2024-06-26 Thread zhangduo

This is an automated email from the ASF dual-hosted git repository.

zhangduo pushed a commit to branch HBASE-28693
in repository https://gitbox.apache.org/repos/asf/hbase.git


The following commit(s) were added to refs/heads/HBASE-28693 by this push:
 new 1c1be033e2a fix agent
1c1be033e2a is described below

commit 1c1be033e2a7bace72d23c274cbb716f59fe38b3
Author: Duo Zhang 
AuthorDate: Thu Jun 27 12:14:30 2024 +0800

fix agent
---
 dev-support/flaky-tests/run-flaky-tests.Jenkinsfile | 4 +---
 1 file changed, 1 insertion(+), 3 deletions(-)

diff --git a/dev-support/flaky-tests/run-flaky-tests.Jenkinsfile 
b/dev-support/flaky-tests/run-flaky-tests.Jenkinsfile
index dbd79c26f2b..b57771773c5 100644
--- a/dev-support/flaky-tests/run-flaky-tests.Jenkinsfile
+++ b/dev-support/flaky-tests/run-flaky-tests.Jenkinsfile
@@ -16,11 +16,9 @@
 // under the License.
 pipeline {
   agent {
-node {
-  label 'hbase'
-}
 dockerfile {
   dir 'dev-support/docker'
+  label 'hbase'
 }
   }
   triggers {

(hbase) 01/01: HBASE-28693 Change flaky tests to run with jdk17

2024-06-26 Thread zhangduo

This is an automated email from the ASF dual-hosted git repository.

zhangduo pushed a commit to branch HBASE-28693
in repository https://gitbox.apache.org/repos/asf/hbase.git

commit 1992a3bc5c20cec86b4ff75b84035737cd1fb703
Author: Duo Zhang 
AuthorDate: Thu Jun 27 12:09:42 2024 +0800

HBASE-28693 Change flaky tests to run with jdk17
---
 dev-support/flaky-tests/run-flaky-tests.Jenkinsfile | 16 
 1 file changed, 8 insertions(+), 8 deletions(-)

diff --git a/dev-support/flaky-tests/run-flaky-tests.Jenkinsfile 
b/dev-support/flaky-tests/run-flaky-tests.Jenkinsfile
index bea139c548a..dbd79c26f2b 100644
--- a/dev-support/flaky-tests/run-flaky-tests.Jenkinsfile
+++ b/dev-support/flaky-tests/run-flaky-tests.Jenkinsfile
@@ -19,6 +19,9 @@ pipeline {
 node {
   label 'hbase'
 }
+dockerfile {
+  dir 'dev-support/docker'
+}
   }
   triggers {
 cron('@hourly') // See 
https://jenkins.io/doc/book/pipeline/syntax/#cron-syntax
@@ -31,20 +34,17 @@ pipeline {
   }
   environment {
 ASF_NIGHTLIES = 'https://nightlies.apache.org'
+JAVA_HOME = '/usr/lib/jvm/java-17'
   }
   parameters {
 booleanParam(name: 'DEBUG', defaultValue: false, description: 'Produce a 
lot more meta-information.')
   }
-  tools {
-// this should match what the yetus nightly job for the branch will use
-maven 'maven_latest'
-jdk "jdk_1.8_latest"
-  }
   stages {
 stage ('run flaky tests') {
   steps {
 sh '''#!/usr/bin/env bash
   set -e
+  MVN="${MAVEN_HOME}/bin/mvn"
   declare -a curl_args=(--fail)
   tmpdir=$(realpath target)
   declare -a mvn_args=(--batch-mode -fn -Dbuild.id="${BUILD_ID}" 
-Dmaven.repo.local="${WORKSPACE}/local-repository" -Djava.io.tmpdir=${tmpdir})
@@ -53,7 +53,7 @@ pipeline {
 mvn_args=("${mvn_args[@]}" -X)
 set -x
   fi
-  curl "${curl_args[@]}" -o includes.txt 
"${JENKINS_URL}/job/HBase-Find-Flaky-Tests/job/${BRANCH_NAME}/lastSuccessfulBuild/artifact/output/includes"
+  curl "${curl_args[@]}" -o includes.txt 
"${JENKINS_URL}/job/HBase-Find-Flaky-Tests/job/master/lastSuccessfulBuild/artifact/output/includes"
   if [ -s includes.txt ]; then
 rm -rf local-repository/org/apache/hbase
 mvn clean "${mvn_args[@]}"
@@ -65,11 +65,11 @@ pipeline {
 else
   echo "Skipped gathering machine environment because we couldn't 
read the script to do so."
 fi
-mvn -T0.25C package "${mvn_args[@]}" -Dtest="$(cat includes.txt)" 
-Dmaven.test.redirectTestOutputToFile=true -Dsurefire.firstPartForkCount=0.25C 
-Dsurefire.secondPartForkCount=0.25C
+${MVN} -T0.25C package "${mvn_args[@]}" -Dtest="$(cat 
includes.txt)" -Dmaven.test.redirectTestOutputToFile=true 
-Dsurefire.firstPartForkCount=0.25C -Dsurefire.secondPartForkCount=0.25C
   else
 echo "set of flaky tests is currently empty."
   fi
-'''
+'''
   }
 }
   }

(hbase) branch HBASE-28693 created (now 1992a3bc5c2)

2024-06-26 Thread zhangduo

This is an automated email from the ASF dual-hosted git repository.

zhangduo pushed a change to branch HBASE-28693
in repository https://gitbox.apache.org/repos/asf/hbase.git


  at 1992a3bc5c2 HBASE-28693 Change flaky tests to run with jdk17

This branch includes the following new commits:

 new 1992a3bc5c2 HBASE-28693 Change flaky tests to run with jdk17

The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.

(hbase) branch HBASE-28678-branch-2 updated: personality

2024-06-26 Thread zhangduo

This is an automated email from the ASF dual-hosted git repository.

zhangduo pushed a commit to branch HBASE-28678-branch-2
in repository https://gitbox.apache.org/repos/asf/hbase.git


The following commit(s) were added to refs/heads/HBASE-28678-branch-2 by this 
push:
 new bbb41626a6f personality
bbb41626a6f is described below

commit bbb41626a6f67ed6e960150c1cfb1db930c8ae85
Author: Duo Zhang 
AuthorDate: Wed Jun 26 23:49:48 2024 +0800

personality
---
 dev-support/Jenkinsfile | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

diff --git a/dev-support/Jenkinsfile b/dev-support/Jenkinsfile
index 5f88cb188d2..b22ff67663c 100644
--- a/dev-support/Jenkinsfile
+++ b/dev-support/Jenkinsfile
@@ -39,7 +39,7 @@ pipeline {
 OUTPUT_DIR_RELATIVE_JDK11_HADOOP3 = 'output-jdk11-hadoop3'
 
 PROJECT = 'hbase'
-PROJECT_PERSONALITY = 
'https://raw.githubusercontent.com/apache/hbase/master/dev-support/hbase-personality.sh'
+PROJECT_PERSONALITY = 
'https://raw.githubusercontent.com/apache/hbase/HBASE-28678/dev-support/hbase-personality.sh'
 PERSONALITY_FILE = 'tools/personality.sh'
 // This section of the docs tells folks not to use the javadoc tag. older 
branches have our old version of the check for said tag.
 AUTHOR_IGNORE_LIST = 'src/main/asciidoc/_chapters/developer.adoc'

(hbase) branch HBASE-28678-branch-2 updated (1221d452dde -> 1fd1c5e1203)

2024-06-26 Thread zhangduo

This is an automated email from the ASF dual-hosted git repository.

zhangduo pushed a change to branch HBASE-28678-branch-2
in repository https://gitbox.apache.org/repos/asf/hbase.git


 discard 1221d452dde HBASE-28678 Make nightly builds for 3.x java 17 only and 
add java 17 test for 2.x
 add d06604571e3 HBASE-28656 Optimize the verifyCopyResult logic in 
ExportSnapshot (#5996)
 add 8fd1ecab8e5 HBASE-28677 Add jdk 17 task for pre commit build for 2.x 
(#6002)
 add 5e2d66d2121 Revert "HBASE-28677 Add jdk 17 task for pre commit build 
for 2.x (#6002)"
 add 30013067216 HBASE-28677 Add jdk 17 task for pre commit build for 2.x 
(#6002)
 new 1fd1c5e1203 HBASE-28678 Make nightly builds for 3.x java 17 only and 
add java 17 test for 2.x

This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version.  This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:

 * -- * -- B -- O -- O -- O   (1221d452dde)
\
 N -- N -- N   refs/heads/HBASE-28678-branch-2 (1fd1c5e1203)

You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.

Any revisions marked "omit" are not gone; other references still
refer to them.  Any revisions marked "discard" are gone forever.

The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 dev-support/Jenkinsfile_GitHub | 138 +
 dev-support/docker/Dockerfile  |  15 +++
 .../hadoop/hbase/snapshot/ExportSnapshot.java  |  76 ++--
 .../hadoop/hbase/snapshot/TestExportSnapshot.java  |  26 +++-
 .../hbase/snapshot/TestExportSnapshotAdjunct.java  |   4 +-
 .../snapshot/TestExportSnapshotV1NoCluster.java|   2 +-
 6 files changed, 245 insertions(+), 16 deletions(-)

(hbase) 01/01: HBASE-28678 Make nightly builds for 3.x java 17 only and add java 17 test for 2.x

2024-06-26 Thread zhangduo

This is an automated email from the ASF dual-hosted git repository.

zhangduo pushed a commit to branch HBASE-28678-branch-2
in repository https://gitbox.apache.org/repos/asf/hbase.git

commit 1fd1c5e120371c3d4a6ca7d070b812d31278ed89
Author: Duo Zhang 
AuthorDate: Mon Jun 24 15:15:54 2024 +0800

HBASE-28678 Make nightly builds for 3.x java 17 only and add java 17 test 
for 2.x
---
 dev-support/Jenkinsfile  | 135 ++-
 dev-support/hbase-personality.sh |  24 ++-
 2 files changed, 137 insertions(+), 22 deletions(-)

diff --git a/dev-support/Jenkinsfile b/dev-support/Jenkinsfile
index 27c4721057d..5f88cb188d2 100644
--- a/dev-support/Jenkinsfile
+++ b/dev-support/Jenkinsfile
@@ -203,8 +203,8 @@ pipeline {
   environment {
 BASEDIR = "${env.WORKSPACE}/component"
 TESTS = "${env.SHALLOW_CHECKS}"
-SET_JAVA_HOME = "/usr/lib/jvm/java-11"
-JAVA8_HOME="/usr/lib/jvm/java-8"
+SET_JAVA_HOME = getJavaHomeForYetusGeneralCheck(env.BRANCH_NAME)
+JAVA8_HOME = "/usr/lib/jvm/java-8"
 // Activates hadoop 3.0 profile in maven runs.
 HADOOP_PROFILE = '3.0'
 OUTPUT_DIR_RELATIVE = "${env.OUTPUT_DIR_RELATIVE_GENERAL}"
@@ -305,7 +305,7 @@ pipeline {
 }
   }
   when {
-branch 'branch-2*'
+branch '*branch-2*'
   }
   environment {
 BASEDIR = "${env.WORKSPACE}/component"
@@ -415,6 +415,9 @@ pipeline {
   label 'hbase'
 }
   }
+  when {
+branch '*branch-2*'
+  }
   environment {
 BASEDIR = "${env.WORKSPACE}/component"
 TESTS = "${env.DEEP_CHECKS}"
@@ -525,6 +528,9 @@ pipeline {
   label 'hbase'
 }
   }
+  when {
+branch '*branch-2*'
+  }
   environment {
 BASEDIR = "${env.WORKSPACE}/component"
 TESTS = "${env.DEEP_CHECKS}"
@@ -629,6 +635,118 @@ pipeline {
 }
   }
 }
+
+stage ('yetus jdk17 hadoop3 checks') {
+  agent {
+node {
+  label 'hbase'
+}
+  }
+  environment {
+BASEDIR = "${env.WORKSPACE}/component"
+TESTS = "${env.DEEP_CHECKS}"
+OUTPUT_DIR_RELATIVE = "${env.OUTPUT_DIR_RELATIVE_JDK17_HADOOP3}"
+OUTPUT_DIR = 
"${env.WORKSPACE}/${env.OUTPUT_DIR_RELATIVE_JDK17_HADOOP3}"
+SET_JAVA_HOME = "/usr/lib/jvm/java-17"
+// Activates hadoop 3.0 profile in maven runs.
+HADOOP_PROFILE = '3.0'
+SKIP_ERRORPRONE = true
+  }
+  steps {
+// Must do prior to anything else, since if one of them timesout 
we'll stash the commentfile
+sh '''#!/usr/bin/env bash
+  set -e
+  rm -rf "${OUTPUT_DIR}" && mkdir "${OUTPUT_DIR}"
+  echo '(x) {color:red}-1 jdk17 hadoop3 checks{color}' 
>"${OUTPUT_DIR}/commentfile"
+  echo "-- Something went wrong running this stage, please [check 
relevant console output|${BUILD_URL}/console]." >> "${OUTPUT_DIR}/commentfile"
+'''
+unstash 'yetus'
+dir('component') {
+  checkout scm
+}
+sh '''#!/usr/bin/env bash
+  set -e
+  rm -rf "${OUTPUT_DIR}/machine" && mkdir "${OUTPUT_DIR}/machine"
+  "${BASEDIR}/dev-support/gather_machine_environment.sh" 
"${OUTPUT_DIR_RELATIVE}/machine"
+  echo "got the following saved stats in 
'${OUTPUT_DIR_RELATIVE}/machine'"
+  ls -lh "${OUTPUT_DIR_RELATIVE}/machine"
+'''
+script {
+  def ret = sh(
+returnStatus: true,
+script: '''#!/usr/bin/env bash
+  set -e
+  declare -i status=0
+  if "${BASEDIR}/dev-support/hbase_nightly_yetus.sh" ; then
+echo '(/) {color:green}+1 jdk17 hadoop3 checks{color}' > 
"${OUTPUT_DIR}/commentfile"
+  else
+echo '(x) {color:red}-1 jdk17 hadoop3 checks{color}' > 
"${OUTPUT_DIR}/commentfile"
+status=1
+  fi
+  echo "-- For more information [see jdk17 
report|${BUILD_URL}JDK17_20Nightly_20Build_20Report_20_28Hadoop3_29/]" >> 
"${OUTPUT_DIR}/commentfile"
+  exit "${status}"
+'''
+  )
+  if (ret != 0) {
+// mark the build as UNSTABLE instead of FAILURE, to avoid 
skipping the later publish of
+// test output. See HBASE-26339 for more details.
+currentBuild.result = 'UNSTABLE'
+  }
+}
+  }
+  post {
+always {
+  stash name: 'jdk17-hadoop3-result', includes: 
"${OUTPUT_D

(hbase) branch HBASE-28678 updated (2b7709b082b -> a669da9076a)

2024-06-26 Thread zhangduo

This is an automated email from the ASF dual-hosted git repository.

zhangduo pushed a change to branch HBASE-28678
in repository https://gitbox.apache.org/repos/asf/hbase.git


 discard 2b7709b082b HBASE-28678 Make nightly builds for 3.x java 17 only and 
add java 17 test for 2.x
 add 7e8fd072095 HBASE-28687 BackupSystemTable#checkSystemTable should 
ensure system tables are enabled (#6018)
 add 80516d71291 HBASE-28676 Make pre commit build for 3.x to only run jdk 
17 test (#6001)
 new a669da9076a HBASE-28678 Make nightly builds for 3.x java 17 only and 
add java 17 test for 2.x

This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version.  This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:

 * -- * -- B -- O -- O -- O   (2b7709b082b)
\
 N -- N -- N   refs/heads/HBASE-28678 (a669da9076a)

You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.

Any revisions marked "omit" are not gone; other references still
refer to them.  Any revisions marked "discard" are gone forever.

The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 dev-support/Jenkinsfile_GitHub | 277 +
 .../hbase/backup/impl/BackupSystemTable.java   |  13 +
 .../apache/hadoop/hbase/backup/TestBackupBase.java |  37 ++-
 hbase-build-configuration/pom.xml  |  11 +
 pom.xml|   2 +-
 5 files changed, 62 insertions(+), 278 deletions(-)

(hbase) 01/01: HBASE-28678 Make nightly builds for 3.x java 17 only and add java 17 test for 2.x

2024-06-26 Thread zhangduo

This is an automated email from the ASF dual-hosted git repository.

zhangduo pushed a commit to branch HBASE-28678
in repository https://gitbox.apache.org/repos/asf/hbase.git

commit a669da9076a98681499dd35880748a75dab6d988
Author: Duo Zhang 
AuthorDate: Mon Jun 24 15:15:54 2024 +0800

HBASE-28678 Make nightly builds for 3.x java 17 only and add java 17 test 
for 2.x
---
 dev-support/Jenkinsfile  | 28 
 dev-support/hbase-personality.sh | 24 +---
 2 files changed, 25 insertions(+), 27 deletions(-)

diff --git a/dev-support/Jenkinsfile b/dev-support/Jenkinsfile
index 3aadf7316b3..0a47726e53c 100644
--- a/dev-support/Jenkinsfile
+++ b/dev-support/Jenkinsfile
@@ -205,8 +205,8 @@ pipeline {
   environment {
 BASEDIR = "${env.WORKSPACE}/component"
 TESTS = "${env.SHALLOW_CHECKS}"
-SET_JAVA_HOME = "/usr/lib/jvm/java-11"
-JAVA8_HOME="/usr/lib/jvm/java-8"
+SET_JAVA_HOME = getJavaHomeForYetusGeneralCheck(env.BRANCH_NAME)
+JAVA8_HOME = "/usr/lib/jvm/java-8"
 // Activates hadoop 3.0 profile in maven runs.
 HADOOP_PROFILE = '3.0'
 OUTPUT_DIR_RELATIVE = "${env.OUTPUT_DIR_RELATIVE_GENERAL}"
@@ -307,7 +307,7 @@ pipeline {
 }
   }
   when {
-branch 'branch-2*'
+branch '*branch-2*'
   }
   environment {
 BASEDIR = "${env.WORKSPACE}/component"
@@ -417,6 +417,9 @@ pipeline {
   label 'hbase'
 }
   }
+  when {
+branch '*branch-2*'
+  }
   environment {
 BASEDIR = "${env.WORKSPACE}/component"
 TESTS = "${env.DEEP_CHECKS}"
@@ -527,6 +530,9 @@ pipeline {
   label 'hbase'
 }
   }
+  when {
+branch '*branch-2*'
+  }
   environment {
 BASEDIR = "${env.WORKSPACE}/component"
 TESTS = "${env.DEEP_CHECKS}"
@@ -633,11 +639,6 @@ pipeline {
 }
 
 stage ('yetus jdk17 hadoop3 checks') {
-  when {
-anyOf {
-  branch 'master';branch 'branch-3'
-}
-  }
   agent {
 node {
   label 'hbase'
@@ -943,12 +944,14 @@ pipeline {
unstash 'jdk8-hadoop2-result'
unstash 'jdk8-hadoop3-result'
unstash 'jdk11-hadoop3-result'
+   unstash 'jdk17-hadoop3-result'
unstash 'srctarball-result'
sh "printenv"
def results = ["${env.OUTPUT_DIR_RELATIVE_GENERAL}/commentfile",
   
"${env.OUTPUT_DIR_RELATIVE_JDK8_HADOOP2}/commentfile",
   
"${env.OUTPUT_DIR_RELATIVE_JDK8_HADOOP3}/commentfile",
   
"${env.OUTPUT_DIR_RELATIVE_JDK11_HADOOP3}/commentfile",
+  
"${env.OUTPUT_DIR_RELATIVE_JDK17_HADOOP3}/commentfile",
   'output-srctarball/commentfile',
   'output-integration/commentfile']
echo env.BRANCH_NAME
@@ -1018,3 +1021,12 @@ List getJirasToComment(CharSequence source, 
List seen) {
   }
   return seen
 }
+@NonCPS
+String getJavaHomeForYetusGeneralCheck(String branchName) {
+  // for 2.x, build with java 11, for 3.x, build with java 17
+  if (branchName.indexOf("branch-2") >=0) {
+return "/usr/lib/jvm/java-11";
+  } else {
+return "/usr/lib/jvm/java-17"
+  }
+}
diff --git a/dev-support/hbase-personality.sh b/dev-support/hbase-personality.sh
index c7131c45e2f..25eee1463c1 100755
--- a/dev-support/hbase-personality.sh
+++ b/dev-support/hbase-personality.sh
@@ -178,7 +178,7 @@ function personality_modules
   # If we have HADOOP_PROFILE specified and we're on branch-2.x, pass along
   # the hadoop.profile system property. Ensures that Hadoop2 and Hadoop3
   # logic is not both activated within Maven.
-  if [[ -n "${HADOOP_PROFILE}" ]] && [[ "${PATCH_BRANCH}" = branch-2* ]] ; then
+  if [[ -n "${HADOOP_PROFILE}" ]] && [[ "${PATCH_BRANCH}" == *"branch-2"* ]] ; 
then
 extra="${extra} -Dhadoop.profile=${HADOOP_PROFILE}"
   fi
 
@@ -490,7 +490,7 @@ function shadedjars_rebuild
   # If we have HADOOP_PROFILE specified and we're on branch-2.x, pass along
   # the hadoop.profile system property. Ensures that Hadoop2 and Hadoop3
   # logic is not both activated within Maven.
-  if [[ -n "${HADOOP_PROFILE}" ]] && [[ "${PATCH_BRANCH}" = branch-2* ]] ; then
+  if [[ -n "${HADOOP_PROFILE}" ]] && [[ "${PATCH_BRANCH}" = *"branch-2"* ]] ; 
then
 maven_args+=("-Dhadoop.profile=${HADOOP_PROFILE}")
   fi
 
@@ -580,14 +580,7 @@ function hadoopcheck_rebuild
 
   # All supported Hadoop versions that we want to test the compilation with
   # See the Hadoop section on prereqs in the HBase Reference Guide
-  if [[ "${PATCH_BRANCH}" = branch-2.4 ]]; then
-yetus_info "Setting Hadoop 2 versions to test based on branch-2.4 ru

(hbase-site) branch asf-site updated: INFRA-10751 Empty commit

2024-06-26 Thread git-site-role

This is an automated email from the ASF dual-hosted git repository.

git-site-role pushed a commit to branch asf-site
in repository https://gitbox.apache.org/repos/asf/hbase-site.git


The following commit(s) were added to refs/heads/asf-site by this push:
 new 17a072bc783 INFRA-10751 Empty commit
17a072bc783 is described below

commit 17a072bc7839202056f86a6d17ded0308252b151
Author: jenkins 
AuthorDate: Wed Jun 26 14:46:02 2024 +

INFRA-10751 Empty commit

(hbase) branch branch-2.6 updated: HBASE-28677 Add jdk 17 task for pre commit build for 2.x (#6002)

2024-06-26 Thread zhangduo

This is an automated email from the ASF dual-hosted git repository.

zhangduo pushed a commit to branch branch-2.6
in repository https://gitbox.apache.org/repos/asf/hbase.git


The following commit(s) were added to refs/heads/branch-2.6 by this push:
 new 3722dc9a180 HBASE-28677 Add jdk 17 task for pre commit build for 2.x 
(#6002)
3722dc9a180 is described below

commit 3722dc9a1808b6c05befbae8493c485f57bc9990
Author: Duo Zhang 
AuthorDate: Wed Jun 26 22:30:37 2024 +0800

HBASE-28677 Add jdk 17 task for pre commit build for 2.x (#6002)

Signed-off-by: Nick Dimiduk 
(cherry picked from commit 8fd1ecab8e56e7605667ab56d38a4296ee19151e)
(cherry picked from commit 300130672161cbcd36237f0c21f6be42cadc589b)
---
 dev-support/Jenkinsfile_GitHub | 138 +
 dev-support/docker/Dockerfile  |  15 +
 2 files changed, 153 insertions(+)

diff --git a/dev-support/Jenkinsfile_GitHub b/dev-support/Jenkinsfile_GitHub
index b9551196ee1..c61237dbb62 100644
--- a/dev-support/Jenkinsfile_GitHub
+++ b/dev-support/Jenkinsfile_GitHub
@@ -58,6 +58,7 @@ pipeline {
 WORKDIR_REL_GENERAL_CHECK = 'yetus-general-check'
 WORKDIR_REL_JDK8_HADOOP2_CHECK = 'yetus-jdk8-hadoop2-check'
 WORKDIR_REL_JDK11_HADOOP3_CHECK = 'yetus-jdk11-hadoop3-check'
+WORKDIR_REL_JDK17_HADOOP3_CHECK = 'yetus-jdk17-hadoop3-check'
 ASF_NIGHTLIES = 'https://nightlies.apache.org'
 ASF_NIGHTLIES_BASE_ORI = 
"${ASF_NIGHTLIES}/hbase/${JOB_NAME}/${BUILD_NUMBER}"
 ASF_NIGHTLIES_BASE = "${ASF_NIGHTLIES_BASE_ORI.replaceAll(' ', '%20')}"
@@ -474,6 +475,143 @@ pipeline {
 }
 }
 }
+stage ('yetus jdk17 hadoop3 checks') {
+agent {
+node {
+label 'hbase'
+}
+}
+environment {
+// customized per parallel stage
+PLUGINS = "${JDK_SPECIFIC_PLUGINS}"
+SET_JAVA_HOME = '/usr/lib/jvm/java-17'
+HADOOP_PROFILE = '3.0'
+WORKDIR_REL = "${WORKDIR_REL_JDK17_HADOOP3_CHECK}"
+// identical for all parallel stages
+WORKDIR = "${WORKSPACE}/${WORKDIR_REL}"
+YETUSDIR = "${WORKDIR}/${YETUS_REL}"
+SOURCEDIR = "${WORKDIR}/${SRC_REL}"
+PATCHDIR = "${WORKDIR}/${PATCH_REL}"
+BUILD_URL_ARTIFACTS = 
"artifact/${WORKDIR_REL}/${PATCH_REL}"
+DOCKERFILE = "${WORKDIR}/${DOCKERFILE_REL}"
+YETUS_DRIVER = "${WORKDIR}/${YETUS_DRIVER_REL}"
+SKIP_ERRORPRONE = true
+}
+when {
+// this will return true if the pipeline is building a 
change request, such as a GitHub pull request.
+changeRequest()
+}
+steps {
+dir("${SOURCEDIR}") {
+checkout scm
+}
+dir("${YETUSDIR}") {
+sh'''#!/usr/bin/env bash
+  wget 
https://dlcdn.apache.org/yetus/${YETUS_VERSION}/apache-yetus-${YETUS_VERSION}-bin.tar.gz
 && \
+  tar --strip-components=1 -xzf 
apache-yetus-${YETUS_VERSION}-bin.tar.gz && \
+  rm apache-yetus-${YETUS_VERSION}-bin.tar.gz
+'''
+}
+dir("${WORKDIR}") {
+withCredentials([
+  usernamePassword(
+credentialsId: 'apache-hbase-at-github.com',
+passwordVariable: 'GITHUB_PASSWORD',
+usernameVariable: 'GITHUB_USER'
+  )]) {
+script {
+  def ret = sh(
+label: 'test-patch',
+returnStatus: true,
+script: '''#!/bin/bash -e
+  hostname -a ; pwd ; ls -la
+  printenv 2>&1 | sort
+  echo "[INFO] Launching Yetus via 
${YETUS_DRIVER}"
+  "${YETUS_DRIVER}"
+'''
+  )
+  if (ret != 0) {
+// mark the build as UNSTABLE instead of 
FAILURE, to avoid skipping the later publish of
+// test output. See HBASE-26339 for more 
details.
+

(hbase) branch branch-2.5 updated: HBASE-28677 Add jdk 17 task for pre commit build for 2.x (#6002)

2024-06-26 Thread zhangduo

This is an automated email from the ASF dual-hosted git repository.

zhangduo pushed a commit to branch branch-2.5
in repository https://gitbox.apache.org/repos/asf/hbase.git


The following commit(s) were added to refs/heads/branch-2.5 by this push:
 new eba75a03176 HBASE-28677 Add jdk 17 task for pre commit build for 2.x 
(#6002)
eba75a03176 is described below

commit eba75a031767c616305e33cd702ea7bd4d63c327
Author: Duo Zhang 
AuthorDate: Wed Jun 26 22:30:37 2024 +0800

HBASE-28677 Add jdk 17 task for pre commit build for 2.x (#6002)

Signed-off-by: Nick Dimiduk 
(cherry picked from commit 8fd1ecab8e56e7605667ab56d38a4296ee19151e)
(cherry picked from commit 300130672161cbcd36237f0c21f6be42cadc589b)
---
 dev-support/Jenkinsfile_GitHub | 138 +
 dev-support/docker/Dockerfile  |  15 +
 2 files changed, 153 insertions(+)

diff --git a/dev-support/Jenkinsfile_GitHub b/dev-support/Jenkinsfile_GitHub
index b9551196ee1..c61237dbb62 100644
--- a/dev-support/Jenkinsfile_GitHub
+++ b/dev-support/Jenkinsfile_GitHub
@@ -58,6 +58,7 @@ pipeline {
 WORKDIR_REL_GENERAL_CHECK = 'yetus-general-check'
 WORKDIR_REL_JDK8_HADOOP2_CHECK = 'yetus-jdk8-hadoop2-check'
 WORKDIR_REL_JDK11_HADOOP3_CHECK = 'yetus-jdk11-hadoop3-check'
+WORKDIR_REL_JDK17_HADOOP3_CHECK = 'yetus-jdk17-hadoop3-check'
 ASF_NIGHTLIES = 'https://nightlies.apache.org'
 ASF_NIGHTLIES_BASE_ORI = 
"${ASF_NIGHTLIES}/hbase/${JOB_NAME}/${BUILD_NUMBER}"
 ASF_NIGHTLIES_BASE = "${ASF_NIGHTLIES_BASE_ORI.replaceAll(' ', '%20')}"
@@ -474,6 +475,143 @@ pipeline {
 }
 }
 }
+stage ('yetus jdk17 hadoop3 checks') {
+agent {
+node {
+label 'hbase'
+}
+}
+environment {
+// customized per parallel stage
+PLUGINS = "${JDK_SPECIFIC_PLUGINS}"
+SET_JAVA_HOME = '/usr/lib/jvm/java-17'
+HADOOP_PROFILE = '3.0'
+WORKDIR_REL = "${WORKDIR_REL_JDK17_HADOOP3_CHECK}"
+// identical for all parallel stages
+WORKDIR = "${WORKSPACE}/${WORKDIR_REL}"
+YETUSDIR = "${WORKDIR}/${YETUS_REL}"
+SOURCEDIR = "${WORKDIR}/${SRC_REL}"
+PATCHDIR = "${WORKDIR}/${PATCH_REL}"
+BUILD_URL_ARTIFACTS = 
"artifact/${WORKDIR_REL}/${PATCH_REL}"
+DOCKERFILE = "${WORKDIR}/${DOCKERFILE_REL}"
+YETUS_DRIVER = "${WORKDIR}/${YETUS_DRIVER_REL}"
+SKIP_ERRORPRONE = true
+}
+when {
+// this will return true if the pipeline is building a 
change request, such as a GitHub pull request.
+changeRequest()
+}
+steps {
+dir("${SOURCEDIR}") {
+checkout scm
+}
+dir("${YETUSDIR}") {
+sh'''#!/usr/bin/env bash
+  wget 
https://dlcdn.apache.org/yetus/${YETUS_VERSION}/apache-yetus-${YETUS_VERSION}-bin.tar.gz
 && \
+  tar --strip-components=1 -xzf 
apache-yetus-${YETUS_VERSION}-bin.tar.gz && \
+  rm apache-yetus-${YETUS_VERSION}-bin.tar.gz
+'''
+}
+dir("${WORKDIR}") {
+withCredentials([
+  usernamePassword(
+credentialsId: 'apache-hbase-at-github.com',
+passwordVariable: 'GITHUB_PASSWORD',
+usernameVariable: 'GITHUB_USER'
+  )]) {
+script {
+  def ret = sh(
+label: 'test-patch',
+returnStatus: true,
+script: '''#!/bin/bash -e
+  hostname -a ; pwd ; ls -la
+  printenv 2>&1 | sort
+  echo "[INFO] Launching Yetus via 
${YETUS_DRIVER}"
+  "${YETUS_DRIVER}"
+'''
+  )
+  if (ret != 0) {
+// mark the build as UNSTABLE instead of 
FAILURE, to avoid skipping the later publish of
+// test output. See HBASE-26339 for more 
details.
+

(hbase) 01/02: Revert "HBASE-28677 Add jdk 17 task for pre commit build for 2.x (#6002)"

2024-06-26 Thread zhangduo

This is an automated email from the ASF dual-hosted git repository.

zhangduo pushed a commit to branch branch-2
in repository https://gitbox.apache.org/repos/asf/hbase.git

commit 5e2d66d2121d17f587e59b78cab320cef5986d65
Author: Duo Zhang 
AuthorDate: Wed Jun 26 22:35:23 2024 +0800

Revert "HBASE-28677 Add jdk 17 task for pre commit build for 2.x (#6002)"

This reverts commit 8fd1ecab8e56e7605667ab56d38a4296ee19151e.
---
 dev-support/Jenkinsfile_GitHub | 138 -
 dev-support/docker/Dockerfile  |  15 -
 pom.xml|   2 +-
 3 files changed, 1 insertion(+), 154 deletions(-)

diff --git a/dev-support/Jenkinsfile_GitHub b/dev-support/Jenkinsfile_GitHub
index c61237dbb62..b9551196ee1 100644
--- a/dev-support/Jenkinsfile_GitHub
+++ b/dev-support/Jenkinsfile_GitHub
@@ -58,7 +58,6 @@ pipeline {
 WORKDIR_REL_GENERAL_CHECK = 'yetus-general-check'
 WORKDIR_REL_JDK8_HADOOP2_CHECK = 'yetus-jdk8-hadoop2-check'
 WORKDIR_REL_JDK11_HADOOP3_CHECK = 'yetus-jdk11-hadoop3-check'
-WORKDIR_REL_JDK17_HADOOP3_CHECK = 'yetus-jdk17-hadoop3-check'
 ASF_NIGHTLIES = 'https://nightlies.apache.org'
 ASF_NIGHTLIES_BASE_ORI = 
"${ASF_NIGHTLIES}/hbase/${JOB_NAME}/${BUILD_NUMBER}"
 ASF_NIGHTLIES_BASE = "${ASF_NIGHTLIES_BASE_ORI.replaceAll(' ', '%20')}"
@@ -475,143 +474,6 @@ pipeline {
 }
 }
 }
-stage ('yetus jdk17 hadoop3 checks') {
-agent {
-node {
-label 'hbase'
-}
-}
-environment {
-// customized per parallel stage
-PLUGINS = "${JDK_SPECIFIC_PLUGINS}"
-SET_JAVA_HOME = '/usr/lib/jvm/java-17'
-HADOOP_PROFILE = '3.0'
-WORKDIR_REL = "${WORKDIR_REL_JDK17_HADOOP3_CHECK}"
-// identical for all parallel stages
-WORKDIR = "${WORKSPACE}/${WORKDIR_REL}"
-YETUSDIR = "${WORKDIR}/${YETUS_REL}"
-SOURCEDIR = "${WORKDIR}/${SRC_REL}"
-PATCHDIR = "${WORKDIR}/${PATCH_REL}"
-BUILD_URL_ARTIFACTS = 
"artifact/${WORKDIR_REL}/${PATCH_REL}"
-DOCKERFILE = "${WORKDIR}/${DOCKERFILE_REL}"
-YETUS_DRIVER = "${WORKDIR}/${YETUS_DRIVER_REL}"
-SKIP_ERRORPRONE = true
-}
-when {
-// this will return true if the pipeline is building a 
change request, such as a GitHub pull request.
-changeRequest()
-}
-steps {
-dir("${SOURCEDIR}") {
-checkout scm
-}
-dir("${YETUSDIR}") {
-sh'''#!/usr/bin/env bash
-  wget 
https://dlcdn.apache.org/yetus/${YETUS_VERSION}/apache-yetus-${YETUS_VERSION}-bin.tar.gz
 && \
-  tar --strip-components=1 -xzf 
apache-yetus-${YETUS_VERSION}-bin.tar.gz && \
-  rm apache-yetus-${YETUS_VERSION}-bin.tar.gz
-'''
-}
-dir("${WORKDIR}") {
-withCredentials([
-  usernamePassword(
-credentialsId: 'apache-hbase-at-github.com',
-passwordVariable: 'GITHUB_PASSWORD',
-usernameVariable: 'GITHUB_USER'
-  )]) {
-script {
-  def ret = sh(
-label: 'test-patch',
-returnStatus: true,
-script: '''#!/bin/bash -e
-  hostname -a ; pwd ; ls -la
-  printenv 2>&1 | sort
-  echo "[INFO] Launching Yetus via 
${YETUS_DRIVER}"
-  "${YETUS_DRIVER}"
-'''
-  )
-  if (ret != 0) {
-// mark the build as UNSTABLE instead of 
FAILURE, to avoid skipping the later publish of
-// test output. See HBASE-26339 for more 
details.
-currentBuild.result = 'UNSTABLE'
-  }
-}
-}
-}
-}
-post

(hbase) branch branch-2 updated (8fd1ecab8e5 -> 30013067216)

2024-06-26 Thread zhangduo

This is an automated email from the ASF dual-hosted git repository.

zhangduo pushed a change to branch branch-2
in repository https://gitbox.apache.org/repos/asf/hbase.git


from 8fd1ecab8e5 HBASE-28677 Add jdk 17 task for pre commit build for 2.x 
(#6002)
 new 5e2d66d2121 Revert "HBASE-28677 Add jdk 17 task for pre commit build 
for 2.x (#6002)"
 new 30013067216 HBASE-28677 Add jdk 17 task for pre commit build for 2.x 
(#6002)

The 2 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 pom.xml | 2 +-
 1 file changed, 1 insertion(+), 1 deletion(-)

(hbase) 02/02: HBASE-28677 Add jdk 17 task for pre commit build for 2.x (#6002)

2024-06-26 Thread zhangduo

This is an automated email from the ASF dual-hosted git repository.

zhangduo pushed a commit to branch branch-2
in repository https://gitbox.apache.org/repos/asf/hbase.git

commit 300130672161cbcd36237f0c21f6be42cadc589b
Author: Duo Zhang 
AuthorDate: Wed Jun 26 22:30:37 2024 +0800

HBASE-28677 Add jdk 17 task for pre commit build for 2.x (#6002)

Signed-off-by: Nick Dimiduk 
(cherry picked from commit 8fd1ecab8e56e7605667ab56d38a4296ee19151e)
---
 dev-support/Jenkinsfile_GitHub | 138 +
 dev-support/docker/Dockerfile  |  15 +
 2 files changed, 153 insertions(+)

diff --git a/dev-support/Jenkinsfile_GitHub b/dev-support/Jenkinsfile_GitHub
index b9551196ee1..c61237dbb62 100644
--- a/dev-support/Jenkinsfile_GitHub
+++ b/dev-support/Jenkinsfile_GitHub
@@ -58,6 +58,7 @@ pipeline {
 WORKDIR_REL_GENERAL_CHECK = 'yetus-general-check'
 WORKDIR_REL_JDK8_HADOOP2_CHECK = 'yetus-jdk8-hadoop2-check'
 WORKDIR_REL_JDK11_HADOOP3_CHECK = 'yetus-jdk11-hadoop3-check'
+WORKDIR_REL_JDK17_HADOOP3_CHECK = 'yetus-jdk17-hadoop3-check'
 ASF_NIGHTLIES = 'https://nightlies.apache.org'
 ASF_NIGHTLIES_BASE_ORI = 
"${ASF_NIGHTLIES}/hbase/${JOB_NAME}/${BUILD_NUMBER}"
 ASF_NIGHTLIES_BASE = "${ASF_NIGHTLIES_BASE_ORI.replaceAll(' ', '%20')}"
@@ -474,6 +475,143 @@ pipeline {
 }
 }
 }
+stage ('yetus jdk17 hadoop3 checks') {
+agent {
+node {
+label 'hbase'
+}
+}
+environment {
+// customized per parallel stage
+PLUGINS = "${JDK_SPECIFIC_PLUGINS}"
+SET_JAVA_HOME = '/usr/lib/jvm/java-17'
+HADOOP_PROFILE = '3.0'
+WORKDIR_REL = "${WORKDIR_REL_JDK17_HADOOP3_CHECK}"
+// identical for all parallel stages
+WORKDIR = "${WORKSPACE}/${WORKDIR_REL}"
+YETUSDIR = "${WORKDIR}/${YETUS_REL}"
+SOURCEDIR = "${WORKDIR}/${SRC_REL}"
+PATCHDIR = "${WORKDIR}/${PATCH_REL}"
+BUILD_URL_ARTIFACTS = 
"artifact/${WORKDIR_REL}/${PATCH_REL}"
+DOCKERFILE = "${WORKDIR}/${DOCKERFILE_REL}"
+YETUS_DRIVER = "${WORKDIR}/${YETUS_DRIVER_REL}"
+SKIP_ERRORPRONE = true
+}
+when {
+// this will return true if the pipeline is building a 
change request, such as a GitHub pull request.
+changeRequest()
+}
+steps {
+dir("${SOURCEDIR}") {
+checkout scm
+}
+dir("${YETUSDIR}") {
+sh'''#!/usr/bin/env bash
+  wget 
https://dlcdn.apache.org/yetus/${YETUS_VERSION}/apache-yetus-${YETUS_VERSION}-bin.tar.gz
 && \
+  tar --strip-components=1 -xzf 
apache-yetus-${YETUS_VERSION}-bin.tar.gz && \
+  rm apache-yetus-${YETUS_VERSION}-bin.tar.gz
+'''
+}
+dir("${WORKDIR}") {
+withCredentials([
+  usernamePassword(
+credentialsId: 'apache-hbase-at-github.com',
+passwordVariable: 'GITHUB_PASSWORD',
+usernameVariable: 'GITHUB_USER'
+  )]) {
+script {
+  def ret = sh(
+label: 'test-patch',
+returnStatus: true,
+script: '''#!/bin/bash -e
+  hostname -a ; pwd ; ls -la
+  printenv 2>&1 | sort
+  echo "[INFO] Launching Yetus via 
${YETUS_DRIVER}"
+  "${YETUS_DRIVER}"
+'''
+  )
+  if (ret != 0) {
+// mark the build as UNSTABLE instead of 
FAILURE, to avoid skipping the later publish of
+// test output. See HBASE-26339 for more 
details.
+currentBuild.result = 'UNSTABLE'
+  }
+}
+}
+}
+}
+post {
+

(hbase) branch branch-3 updated: HBASE-28676 Make pre commit build for 3.x to only run jdk 17 test (#6001)

2024-06-26 Thread zhangduo

This is an automated email from the ASF dual-hosted git repository.

zhangduo pushed a commit to branch branch-3
in repository https://gitbox.apache.org/repos/asf/hbase.git


The following commit(s) were added to refs/heads/branch-3 by this push:
 new 552062045b6 HBASE-28676 Make pre commit build for 3.x to only run jdk 
17 test (#6001)
552062045b6 is described below

commit 552062045b660fb7810ac6a003092dd24f19b7bc
Author: Duo Zhang 
AuthorDate: Wed Jun 26 22:31:38 2024 +0800

HBASE-28676 Make pre commit build for 3.x to only run jdk 17 test (#6001)

Signed-off-by: Nick Dimiduk 
(cherry picked from commit 80516d712912234be9239435741642f4f724309d)
---
 dev-support/Jenkinsfile_GitHub| 277 +-
 hbase-build-configuration/pom.xml |  11 ++
 pom.xml   |   2 +-
 3 files changed, 13 insertions(+), 277 deletions(-)

diff --git a/dev-support/Jenkinsfile_GitHub b/dev-support/Jenkinsfile_GitHub
index b8d85ad5e13..0813168e7f6 100644
--- a/dev-support/Jenkinsfile_GitHub
+++ b/dev-support/Jenkinsfile_GitHub
@@ -56,8 +56,6 @@ pipeline {
 // stage works in its own subdirectory. there is an "output" under 
each of these
 // directories, which we retrieve after the build is complete.
 WORKDIR_REL_GENERAL_CHECK = 'yetus-general-check'
-WORKDIR_REL_JDK8_HADOOP3_CHECK = 'yetus-jdk8-hadoop3-check'
-WORKDIR_REL_JDK11_HADOOP3_CHECK = 'yetus-jdk11-hadoop3-check'
 WORKDIR_REL_JDK17_HADOOP3_CHECK = 'yetus-jdk17-hadoop3-check'
 ASF_NIGHTLIES = 'https://nightlies.apache.org'
 ASF_NIGHTLIES_BASE_ORI = 
"${ASF_NIGHTLIES}/hbase/${JOB_NAME}/${BUILD_NUMBER}"
@@ -82,8 +80,7 @@ pipeline {
 environment {
 // customized per parallel stage
 PLUGINS = "${GENERAL_CHECK_PLUGINS}"
-SET_JAVA_HOME = "/usr/lib/jvm/java-11"
-JAVA8_HOME = "/usr/lib/jvm/java-8"
+SET_JAVA_HOME = "/usr/lib/jvm/java-17"
 HADOOP_PROFILE = '3.0'
 WORKDIR_REL = "${WORKDIR_REL_GENERAL_CHECK}"
 // identical for all parallel stages
@@ -202,278 +199,6 @@ pipeline {
 }
 }
 }
-stage ('yetus jdk8 Hadoop3 checks') {
-agent {
-node {
-label 'hbase'
-}
-}
-environment {
-// customized per parallel stage
-PLUGINS = "${JDK_SPECIFIC_PLUGINS}"
-SET_JAVA_HOME = '/usr/lib/jvm/java-8'
-WORKDIR_REL = "${WORKDIR_REL_JDK8_HADOOP3_CHECK}"
-// identical for all parallel stages
-WORKDIR = "${WORKSPACE}/${WORKDIR_REL}"
-YETUSDIR = "${WORKDIR}/${YETUS_REL}"
-SOURCEDIR = "${WORKDIR}/${SRC_REL}"
-PATCHDIR = "${WORKDIR}/${PATCH_REL}"
-BUILD_URL_ARTIFACTS = 
"artifact/${WORKDIR_REL}/${PATCH_REL}"
-DOCKERFILE = "${WORKDIR}/${DOCKERFILE_REL}"
-YETUS_DRIVER = "${WORKDIR}/${YETUS_DRIVER_REL}"
-SKIP_ERRORPRONE = true
-}
-when {
-// this will return true if the pipeline is building a 
change request, such as a GitHub pull request.
-changeRequest()
-}
-steps {
-dir("${SOURCEDIR}") {
-checkout scm
-}
-dir("${YETUSDIR}") {
-sh'''#!/usr/bin/env bash
-  wget 
https://dlcdn.apache.org/yetus/${YETUS_VERSION}/apache-yetus-${YETUS_VERSION}-bin.tar.gz
 && \
-  tar --strip-components=1 -xzf 
apache-yetus-${YETUS_VERSION}-bin.tar.gz && \
-  rm apache-yetus-${YETUS_VERSION}-bin.tar.gz
-'''
-}
-dir("${WORKDIR}") {
-withCredentials([
-  usernamePassword(
-credentialsId: 'apache-hbase-at-github.com',
-passwordVariable: 'GITHUB_PASSWORD',
-usernameVariable: 'GITHUB_USER'
-  )]) {
-script {
-  def ret = sh(
-label: 'test-patch',
-returnStatus: true,
-script: '''#!/bin/bash -e
-

(hbase) branch master updated: HBASE-28676 Make pre commit build for 3.x to only run jdk 17 test (#6001)

2024-06-26 Thread zhangduo

This is an automated email from the ASF dual-hosted git repository.

zhangduo pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/hbase.git


The following commit(s) were added to refs/heads/master by this push:
 new 80516d71291 HBASE-28676 Make pre commit build for 3.x to only run jdk 
17 test (#6001)
80516d71291 is described below

commit 80516d712912234be9239435741642f4f724309d
Author: Duo Zhang 
AuthorDate: Wed Jun 26 22:31:38 2024 +0800

HBASE-28676 Make pre commit build for 3.x to only run jdk 17 test (#6001)

Signed-off-by: Nick Dimiduk 
---
 dev-support/Jenkinsfile_GitHub| 277 +-
 hbase-build-configuration/pom.xml |  11 ++
 pom.xml   |   2 +-
 3 files changed, 13 insertions(+), 277 deletions(-)

diff --git a/dev-support/Jenkinsfile_GitHub b/dev-support/Jenkinsfile_GitHub
index b8d85ad5e13..0813168e7f6 100644
--- a/dev-support/Jenkinsfile_GitHub
+++ b/dev-support/Jenkinsfile_GitHub
@@ -56,8 +56,6 @@ pipeline {
 // stage works in its own subdirectory. there is an "output" under 
each of these
 // directories, which we retrieve after the build is complete.
 WORKDIR_REL_GENERAL_CHECK = 'yetus-general-check'
-WORKDIR_REL_JDK8_HADOOP3_CHECK = 'yetus-jdk8-hadoop3-check'
-WORKDIR_REL_JDK11_HADOOP3_CHECK = 'yetus-jdk11-hadoop3-check'
 WORKDIR_REL_JDK17_HADOOP3_CHECK = 'yetus-jdk17-hadoop3-check'
 ASF_NIGHTLIES = 'https://nightlies.apache.org'
 ASF_NIGHTLIES_BASE_ORI = 
"${ASF_NIGHTLIES}/hbase/${JOB_NAME}/${BUILD_NUMBER}"
@@ -82,8 +80,7 @@ pipeline {
 environment {
 // customized per parallel stage
 PLUGINS = "${GENERAL_CHECK_PLUGINS}"
-SET_JAVA_HOME = "/usr/lib/jvm/java-11"
-JAVA8_HOME = "/usr/lib/jvm/java-8"
+SET_JAVA_HOME = "/usr/lib/jvm/java-17"
 HADOOP_PROFILE = '3.0'
 WORKDIR_REL = "${WORKDIR_REL_GENERAL_CHECK}"
 // identical for all parallel stages
@@ -202,278 +199,6 @@ pipeline {
 }
 }
 }
-stage ('yetus jdk8 Hadoop3 checks') {
-agent {
-node {
-label 'hbase'
-}
-}
-environment {
-// customized per parallel stage
-PLUGINS = "${JDK_SPECIFIC_PLUGINS}"
-SET_JAVA_HOME = '/usr/lib/jvm/java-8'
-WORKDIR_REL = "${WORKDIR_REL_JDK8_HADOOP3_CHECK}"
-// identical for all parallel stages
-WORKDIR = "${WORKSPACE}/${WORKDIR_REL}"
-YETUSDIR = "${WORKDIR}/${YETUS_REL}"
-SOURCEDIR = "${WORKDIR}/${SRC_REL}"
-PATCHDIR = "${WORKDIR}/${PATCH_REL}"
-BUILD_URL_ARTIFACTS = 
"artifact/${WORKDIR_REL}/${PATCH_REL}"
-DOCKERFILE = "${WORKDIR}/${DOCKERFILE_REL}"
-YETUS_DRIVER = "${WORKDIR}/${YETUS_DRIVER_REL}"
-SKIP_ERRORPRONE = true
-}
-when {
-// this will return true if the pipeline is building a 
change request, such as a GitHub pull request.
-changeRequest()
-}
-steps {
-dir("${SOURCEDIR}") {
-checkout scm
-}
-dir("${YETUSDIR}") {
-sh'''#!/usr/bin/env bash
-  wget 
https://dlcdn.apache.org/yetus/${YETUS_VERSION}/apache-yetus-${YETUS_VERSION}-bin.tar.gz
 && \
-  tar --strip-components=1 -xzf 
apache-yetus-${YETUS_VERSION}-bin.tar.gz && \
-  rm apache-yetus-${YETUS_VERSION}-bin.tar.gz
-'''
-}
-dir("${WORKDIR}") {
-withCredentials([
-  usernamePassword(
-credentialsId: 'apache-hbase-at-github.com',
-passwordVariable: 'GITHUB_PASSWORD',
-usernameVariable: 'GITHUB_USER'
-  )]) {
-script {
-  def ret = sh(
-label: 'test-patch',
-returnStatus: true,
-script: '''#!/bin/bash -e
-  hostname -a ; pwd ; ls -la
-  printenv

(hbase) branch branch-2 updated: HBASE-28677 Add jdk 17 task for pre commit build for 2.x (#6002)

2024-06-26 Thread zhangduo

This is an automated email from the ASF dual-hosted git repository.

zhangduo pushed a commit to branch branch-2
in repository https://gitbox.apache.org/repos/asf/hbase.git


The following commit(s) were added to refs/heads/branch-2 by this push:
 new 8fd1ecab8e5 HBASE-28677 Add jdk 17 task for pre commit build for 2.x 
(#6002)
8fd1ecab8e5 is described below

commit 8fd1ecab8e56e7605667ab56d38a4296ee19151e
Author: Duo Zhang 
AuthorDate: Wed Jun 26 22:30:37 2024 +0800

HBASE-28677 Add jdk 17 task for pre commit build for 2.x (#6002)

Signed-off-by: Nick Dimiduk 
---
 dev-support/Jenkinsfile_GitHub | 138 +
 dev-support/docker/Dockerfile  |  15 +
 pom.xml|   2 +-
 3 files changed, 154 insertions(+), 1 deletion(-)

diff --git a/dev-support/Jenkinsfile_GitHub b/dev-support/Jenkinsfile_GitHub
index b9551196ee1..c61237dbb62 100644
--- a/dev-support/Jenkinsfile_GitHub
+++ b/dev-support/Jenkinsfile_GitHub
@@ -58,6 +58,7 @@ pipeline {
 WORKDIR_REL_GENERAL_CHECK = 'yetus-general-check'
 WORKDIR_REL_JDK8_HADOOP2_CHECK = 'yetus-jdk8-hadoop2-check'
 WORKDIR_REL_JDK11_HADOOP3_CHECK = 'yetus-jdk11-hadoop3-check'
+WORKDIR_REL_JDK17_HADOOP3_CHECK = 'yetus-jdk17-hadoop3-check'
 ASF_NIGHTLIES = 'https://nightlies.apache.org'
 ASF_NIGHTLIES_BASE_ORI = 
"${ASF_NIGHTLIES}/hbase/${JOB_NAME}/${BUILD_NUMBER}"
 ASF_NIGHTLIES_BASE = "${ASF_NIGHTLIES_BASE_ORI.replaceAll(' ', '%20')}"
@@ -474,6 +475,143 @@ pipeline {
 }
 }
 }
+stage ('yetus jdk17 hadoop3 checks') {
+agent {
+node {
+label 'hbase'
+}
+}
+environment {
+// customized per parallel stage
+PLUGINS = "${JDK_SPECIFIC_PLUGINS}"
+SET_JAVA_HOME = '/usr/lib/jvm/java-17'
+HADOOP_PROFILE = '3.0'
+WORKDIR_REL = "${WORKDIR_REL_JDK17_HADOOP3_CHECK}"
+// identical for all parallel stages
+WORKDIR = "${WORKSPACE}/${WORKDIR_REL}"
+YETUSDIR = "${WORKDIR}/${YETUS_REL}"
+SOURCEDIR = "${WORKDIR}/${SRC_REL}"
+PATCHDIR = "${WORKDIR}/${PATCH_REL}"
+BUILD_URL_ARTIFACTS = 
"artifact/${WORKDIR_REL}/${PATCH_REL}"
+DOCKERFILE = "${WORKDIR}/${DOCKERFILE_REL}"
+YETUS_DRIVER = "${WORKDIR}/${YETUS_DRIVER_REL}"
+SKIP_ERRORPRONE = true
+}
+when {
+// this will return true if the pipeline is building a 
change request, such as a GitHub pull request.
+changeRequest()
+}
+steps {
+dir("${SOURCEDIR}") {
+checkout scm
+}
+dir("${YETUSDIR}") {
+sh'''#!/usr/bin/env bash
+  wget 
https://dlcdn.apache.org/yetus/${YETUS_VERSION}/apache-yetus-${YETUS_VERSION}-bin.tar.gz
 && \
+  tar --strip-components=1 -xzf 
apache-yetus-${YETUS_VERSION}-bin.tar.gz && \
+  rm apache-yetus-${YETUS_VERSION}-bin.tar.gz
+'''
+}
+dir("${WORKDIR}") {
+withCredentials([
+  usernamePassword(
+credentialsId: 'apache-hbase-at-github.com',
+passwordVariable: 'GITHUB_PASSWORD',
+usernameVariable: 'GITHUB_USER'
+  )]) {
+script {
+  def ret = sh(
+label: 'test-patch',
+returnStatus: true,
+script: '''#!/bin/bash -e
+  hostname -a ; pwd ; ls -la
+  printenv 2>&1 | sort
+  echo "[INFO] Launching Yetus via 
${YETUS_DRIVER}"
+  "${YETUS_DRIVER}"
+'''
+  )
+  if (ret != 0) {
+// mark the build as UNSTABLE instead of 
FAILURE, to avoid skipping the later publish of
+// test output. See HBASE-26339 for more 
details.
+currentBuild.result = 'UNSTABLE'
+

(hbase) branch HBASE-28678-branch-2 updated (3078c81ceee -> 1221d452dde)

2024-06-26 Thread zhangduo

This is an automated email from the ASF dual-hosted git repository.

zhangduo pushed a change to branch HBASE-28678-branch-2
in repository https://gitbox.apache.org/repos/asf/hbase.git


 discard 3078c81ceee HBASE-28678 Make nightly builds for 3.x java 17 only and 
add java 17 test for 2.x
 new 1221d452dde HBASE-28678 Make nightly builds for 3.x java 17 only and 
add java 17 test for 2.x

This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version.  This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:

 * -- * -- B -- O -- O -- O   (3078c81ceee)
\
 N -- N -- N   refs/heads/HBASE-28678-branch-2 (1221d452dde)

You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.

Any revisions marked "omit" are not gone; other references still
refer to them.  Any revisions marked "discard" are gone forever.

The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 dev-support/Jenkinsfile  | 14 --
 dev-support/hbase-personality.sh | 10 +-
 2 files changed, 17 insertions(+), 7 deletions(-)

(hbase) 01/01: HBASE-28678 Make nightly builds for 3.x java 17 only and add java 17 test for 2.x

2024-06-26 Thread zhangduo

This is an automated email from the ASF dual-hosted git repository.

zhangduo pushed a commit to branch HBASE-28678-branch-2
in repository https://gitbox.apache.org/repos/asf/hbase.git

commit 1221d452ddeac646876405598b7fbcbd568d
Author: Duo Zhang 
AuthorDate: Mon Jun 24 15:15:54 2024 +0800

HBASE-28678 Make nightly builds for 3.x java 17 only and add java 17 test 
for 2.x
---
 dev-support/Jenkinsfile  | 135 ++-
 dev-support/hbase-personality.sh |  24 ++-
 2 files changed, 137 insertions(+), 22 deletions(-)

diff --git a/dev-support/Jenkinsfile b/dev-support/Jenkinsfile
index 27c4721057d..5f88cb188d2 100644
--- a/dev-support/Jenkinsfile
+++ b/dev-support/Jenkinsfile
@@ -203,8 +203,8 @@ pipeline {
   environment {
 BASEDIR = "${env.WORKSPACE}/component"
 TESTS = "${env.SHALLOW_CHECKS}"
-SET_JAVA_HOME = "/usr/lib/jvm/java-11"
-JAVA8_HOME="/usr/lib/jvm/java-8"
+SET_JAVA_HOME = getJavaHomeForYetusGeneralCheck(env.BRANCH_NAME)
+JAVA8_HOME = "/usr/lib/jvm/java-8"
 // Activates hadoop 3.0 profile in maven runs.
 HADOOP_PROFILE = '3.0'
 OUTPUT_DIR_RELATIVE = "${env.OUTPUT_DIR_RELATIVE_GENERAL}"
@@ -305,7 +305,7 @@ pipeline {
 }
   }
   when {
-branch 'branch-2*'
+branch '*branch-2*'
   }
   environment {
 BASEDIR = "${env.WORKSPACE}/component"
@@ -415,6 +415,9 @@ pipeline {
   label 'hbase'
 }
   }
+  when {
+branch '*branch-2*'
+  }
   environment {
 BASEDIR = "${env.WORKSPACE}/component"
 TESTS = "${env.DEEP_CHECKS}"
@@ -525,6 +528,9 @@ pipeline {
   label 'hbase'
 }
   }
+  when {
+branch '*branch-2*'
+  }
   environment {
 BASEDIR = "${env.WORKSPACE}/component"
 TESTS = "${env.DEEP_CHECKS}"
@@ -629,6 +635,118 @@ pipeline {
 }
   }
 }
+
+stage ('yetus jdk17 hadoop3 checks') {
+  agent {
+node {
+  label 'hbase'
+}
+  }
+  environment {
+BASEDIR = "${env.WORKSPACE}/component"
+TESTS = "${env.DEEP_CHECKS}"
+OUTPUT_DIR_RELATIVE = "${env.OUTPUT_DIR_RELATIVE_JDK17_HADOOP3}"
+OUTPUT_DIR = 
"${env.WORKSPACE}/${env.OUTPUT_DIR_RELATIVE_JDK17_HADOOP3}"
+SET_JAVA_HOME = "/usr/lib/jvm/java-17"
+// Activates hadoop 3.0 profile in maven runs.
+HADOOP_PROFILE = '3.0'
+SKIP_ERRORPRONE = true
+  }
+  steps {
+// Must do prior to anything else, since if one of them timesout 
we'll stash the commentfile
+sh '''#!/usr/bin/env bash
+  set -e
+  rm -rf "${OUTPUT_DIR}" && mkdir "${OUTPUT_DIR}"
+  echo '(x) {color:red}-1 jdk17 hadoop3 checks{color}' 
>"${OUTPUT_DIR}/commentfile"
+  echo "-- Something went wrong running this stage, please [check 
relevant console output|${BUILD_URL}/console]." >> "${OUTPUT_DIR}/commentfile"
+'''
+unstash 'yetus'
+dir('component') {
+  checkout scm
+}
+sh '''#!/usr/bin/env bash
+  set -e
+  rm -rf "${OUTPUT_DIR}/machine" && mkdir "${OUTPUT_DIR}/machine"
+  "${BASEDIR}/dev-support/gather_machine_environment.sh" 
"${OUTPUT_DIR_RELATIVE}/machine"
+  echo "got the following saved stats in 
'${OUTPUT_DIR_RELATIVE}/machine'"
+  ls -lh "${OUTPUT_DIR_RELATIVE}/machine"
+'''
+script {
+  def ret = sh(
+returnStatus: true,
+script: '''#!/usr/bin/env bash
+  set -e
+  declare -i status=0
+  if "${BASEDIR}/dev-support/hbase_nightly_yetus.sh" ; then
+echo '(/) {color:green}+1 jdk17 hadoop3 checks{color}' > 
"${OUTPUT_DIR}/commentfile"
+  else
+echo '(x) {color:red}-1 jdk17 hadoop3 checks{color}' > 
"${OUTPUT_DIR}/commentfile"
+status=1
+  fi
+  echo "-- For more information [see jdk17 
report|${BUILD_URL}JDK17_20Nightly_20Build_20Report_20_28Hadoop3_29/]" >> 
"${OUTPUT_DIR}/commentfile"
+  exit "${status}"
+'''
+  )
+  if (ret != 0) {
+// mark the build as UNSTABLE instead of FAILURE, to avoid 
skipping the later publish of
+// test output. See HBASE-26339 for more details.
+currentBuild.result = 'UNSTABLE'
+  }
+}
+  }
+  post {
+always {
+  stash name: 'jdk17-hadoop3-result', includes: 
"${OUTPUT_D

(hbase) 01/01: HBASE-28678 Make nightly builds for 3.x java 17 only and add java 17 test for 2.x

2024-06-26 Thread zhangduo

This is an automated email from the ASF dual-hosted git repository.

zhangduo pushed a commit to branch HBASE-28678
in repository https://gitbox.apache.org/repos/asf/hbase.git

commit 2b7709b082bc6d99d04081870102d56bd94d9751
Author: Duo Zhang 
AuthorDate: Mon Jun 24 15:15:54 2024 +0800

HBASE-28678 Make nightly builds for 3.x java 17 only and add java 17 test 
for 2.x
---
 dev-support/Jenkinsfile  | 28 
 dev-support/hbase-personality.sh | 24 +---
 2 files changed, 25 insertions(+), 27 deletions(-)

diff --git a/dev-support/Jenkinsfile b/dev-support/Jenkinsfile
index 3aadf7316b3..0a47726e53c 100644
--- a/dev-support/Jenkinsfile
+++ b/dev-support/Jenkinsfile
@@ -205,8 +205,8 @@ pipeline {
   environment {
 BASEDIR = "${env.WORKSPACE}/component"
 TESTS = "${env.SHALLOW_CHECKS}"
-SET_JAVA_HOME = "/usr/lib/jvm/java-11"
-JAVA8_HOME="/usr/lib/jvm/java-8"
+SET_JAVA_HOME = getJavaHomeForYetusGeneralCheck(env.BRANCH_NAME)
+JAVA8_HOME = "/usr/lib/jvm/java-8"
 // Activates hadoop 3.0 profile in maven runs.
 HADOOP_PROFILE = '3.0'
 OUTPUT_DIR_RELATIVE = "${env.OUTPUT_DIR_RELATIVE_GENERAL}"
@@ -307,7 +307,7 @@ pipeline {
 }
   }
   when {
-branch 'branch-2*'
+branch '*branch-2*'
   }
   environment {
 BASEDIR = "${env.WORKSPACE}/component"
@@ -417,6 +417,9 @@ pipeline {
   label 'hbase'
 }
   }
+  when {
+branch '*branch-2*'
+  }
   environment {
 BASEDIR = "${env.WORKSPACE}/component"
 TESTS = "${env.DEEP_CHECKS}"
@@ -527,6 +530,9 @@ pipeline {
   label 'hbase'
 }
   }
+  when {
+branch '*branch-2*'
+  }
   environment {
 BASEDIR = "${env.WORKSPACE}/component"
 TESTS = "${env.DEEP_CHECKS}"
@@ -633,11 +639,6 @@ pipeline {
 }
 
 stage ('yetus jdk17 hadoop3 checks') {
-  when {
-anyOf {
-  branch 'master';branch 'branch-3'
-}
-  }
   agent {
 node {
   label 'hbase'
@@ -943,12 +944,14 @@ pipeline {
unstash 'jdk8-hadoop2-result'
unstash 'jdk8-hadoop3-result'
unstash 'jdk11-hadoop3-result'
+   unstash 'jdk17-hadoop3-result'
unstash 'srctarball-result'
sh "printenv"
def results = ["${env.OUTPUT_DIR_RELATIVE_GENERAL}/commentfile",
   
"${env.OUTPUT_DIR_RELATIVE_JDK8_HADOOP2}/commentfile",
   
"${env.OUTPUT_DIR_RELATIVE_JDK8_HADOOP3}/commentfile",
   
"${env.OUTPUT_DIR_RELATIVE_JDK11_HADOOP3}/commentfile",
+  
"${env.OUTPUT_DIR_RELATIVE_JDK17_HADOOP3}/commentfile",
   'output-srctarball/commentfile',
   'output-integration/commentfile']
echo env.BRANCH_NAME
@@ -1018,3 +1021,12 @@ List getJirasToComment(CharSequence source, 
List seen) {
   }
   return seen
 }
+@NonCPS
+String getJavaHomeForYetusGeneralCheck(String branchName) {
+  // for 2.x, build with java 11, for 3.x, build with java 17
+  if (branchName.indexOf("branch-2") >=0) {
+return "/usr/lib/jvm/java-11";
+  } else {
+return "/usr/lib/jvm/java-17"
+  }
+}
diff --git a/dev-support/hbase-personality.sh b/dev-support/hbase-personality.sh
index c7131c45e2f..25eee1463c1 100755
--- a/dev-support/hbase-personality.sh
+++ b/dev-support/hbase-personality.sh
@@ -178,7 +178,7 @@ function personality_modules
   # If we have HADOOP_PROFILE specified and we're on branch-2.x, pass along
   # the hadoop.profile system property. Ensures that Hadoop2 and Hadoop3
   # logic is not both activated within Maven.
-  if [[ -n "${HADOOP_PROFILE}" ]] && [[ "${PATCH_BRANCH}" = branch-2* ]] ; then
+  if [[ -n "${HADOOP_PROFILE}" ]] && [[ "${PATCH_BRANCH}" == *"branch-2"* ]] ; 
then
 extra="${extra} -Dhadoop.profile=${HADOOP_PROFILE}"
   fi
 
@@ -490,7 +490,7 @@ function shadedjars_rebuild
   # If we have HADOOP_PROFILE specified and we're on branch-2.x, pass along
   # the hadoop.profile system property. Ensures that Hadoop2 and Hadoop3
   # logic is not both activated within Maven.
-  if [[ -n "${HADOOP_PROFILE}" ]] && [[ "${PATCH_BRANCH}" = branch-2* ]] ; then
+  if [[ -n "${HADOOP_PROFILE}" ]] && [[ "${PATCH_BRANCH}" = *"branch-2"* ]] ; 
then
 maven_args+=("-Dhadoop.profile=${HADOOP_PROFILE}")
   fi
 
@@ -580,14 +580,7 @@ function hadoopcheck_rebuild
 
   # All supported Hadoop versions that we want to test the compilation with
   # See the Hadoop section on prereqs in the HBase Reference Guide
-  if [[ "${PATCH_BRANCH}" = branch-2.4 ]]; then
-yetus_info "Setting Hadoop 2 versions to test based on branch-2.4 ru

(hbase) branch HBASE-28678 updated (9a01c627daf -> 2b7709b082b)

2024-06-26 Thread zhangduo

This is an automated email from the ASF dual-hosted git repository.

zhangduo pushed a change to branch HBASE-28678
in repository https://gitbox.apache.org/repos/asf/hbase.git


 discard 9a01c627daf HBASE-28678 Make nightly builds for 3.x java 17 only and 
add java 17 test for 2.x
 new 2b7709b082b HBASE-28678 Make nightly builds for 3.x java 17 only and 
add java 17 test for 2.x

This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version.  This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:

 * -- * -- B -- O -- O -- O   (9a01c627daf)
\
 N -- N -- N   refs/heads/HBASE-28678 (2b7709b082b)

You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.

Any revisions marked "omit" are not gone; other references still
refer to them.  Any revisions marked "discard" are gone forever.

The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 dev-support/Jenkinsfile  | 12 ++--
 dev-support/hbase-personality.sh | 10 +-
 2 files changed, 15 insertions(+), 7 deletions(-)

(hbase) branch master updated: HBASE-28687 BackupSystemTable#checkSystemTable should ensure system tables are enabled (#6018)

2024-06-26 Thread ndimiduk

This is an automated email from the ASF dual-hosted git repository.

ndimiduk pushed a commit to branch master
in repository https://gitbox.apache.org/repos/asf/hbase.git


The following commit(s) were added to refs/heads/master by this push:
 new 7e8fd072095 HBASE-28687 BackupSystemTable#checkSystemTable should 
ensure system tables are enabled (#6018)
7e8fd072095 is described below

commit 7e8fd07209562cd3974387ed1b942e9b892273a8
Author: Ray Mattingly 
AuthorDate: Wed Jun 26 08:40:12 2024 -0400

HBASE-28687 BackupSystemTable#checkSystemTable should ensure system tables 
are enabled (#6018)

Co-authored-by: Ray Mattingly 
Signed-off-by: Bryan Beaudreault 
Signed-off-by: Nick Dimiduk 
---
 .../hbase/backup/impl/BackupSystemTable.java   | 13 
 .../apache/hadoop/hbase/backup/TestBackupBase.java | 37 +-
 2 files changed, 49 insertions(+), 1 deletion(-)

diff --git 
a/hbase-backup/src/main/java/org/apache/hadoop/hbase/backup/impl/BackupSystemTable.java
 
b/hbase-backup/src/main/java/org/apache/hadoop/hbase/backup/impl/BackupSystemTable.java
index c364316d54e..5a12b45a586 100644
--- 
a/hbase-backup/src/main/java/org/apache/hadoop/hbase/backup/impl/BackupSystemTable.java
+++ 
b/hbase-backup/src/main/java/org/apache/hadoop/hbase/backup/impl/BackupSystemTable.java
@@ -47,6 +47,7 @@ import org.apache.hadoop.hbase.NamespaceExistException;
 import org.apache.hadoop.hbase.ServerName;
 import org.apache.hadoop.hbase.TableExistsException;
 import org.apache.hadoop.hbase.TableName;
+import org.apache.hadoop.hbase.TableNotDisabledException;
 import org.apache.hadoop.hbase.backup.BackupInfo;
 import org.apache.hadoop.hbase.backup.BackupInfo.BackupState;
 import org.apache.hadoop.hbase.backup.BackupRestoreConstants;
@@ -207,10 +208,12 @@ public final class BackupSystemTable implements Closeable 
{
 TableDescriptor backupHTD = 
BackupSystemTable.getSystemTableDescriptor(conf);
 createSystemTable(admin, backupHTD);
   }
+  ensureTableEnabled(admin, tableName);
   if (!admin.tableExists(bulkLoadTableName)) {
 TableDescriptor blHTD = 
BackupSystemTable.getSystemTableForBulkLoadedDataDescriptor(conf);
 createSystemTable(admin, blHTD);
   }
+  ensureTableEnabled(admin, bulkLoadTableName);
   waitForSystemTable(admin, tableName);
   waitForSystemTable(admin, bulkLoadTableName);
 }
@@ -1889,4 +1892,14 @@ public final class BackupSystemTable implements 
Closeable {
 }
 return Bytes.toBytes(sb.toString());
   }
+
+  private static void ensureTableEnabled(Admin admin, TableName tableName) 
throws IOException {
+if (!admin.isTableEnabled(tableName)) {
+  try {
+admin.enableTable(tableName);
+  } catch (TableNotDisabledException ignored) {
+LOG.info("Table {} is not disabled, ignoring enable request", 
tableName);
+  }
+}
+  }
 }
diff --git 
a/hbase-backup/src/test/java/org/apache/hadoop/hbase/backup/TestBackupBase.java 
b/hbase-backup/src/test/java/org/apache/hadoop/hbase/backup/TestBackupBase.java
index e9c1cfd9c32..ed17ef8a117 100644
--- 
a/hbase-backup/src/test/java/org/apache/hadoop/hbase/backup/TestBackupBase.java
+++ 
b/hbase-backup/src/test/java/org/apache/hadoop/hbase/backup/TestBackupBase.java
@@ -19,6 +19,7 @@ package org.apache.hadoop.hbase.backup;
 
 import java.io.IOException;
 import java.util.ArrayList;
+import java.util.Arrays;
 import java.util.HashMap;
 import java.util.Iterator;
 import java.util.List;
@@ -57,6 +58,7 @@ import org.apache.hadoop.hbase.client.TableDescriptor;
 import org.apache.hadoop.hbase.client.TableDescriptorBuilder;
 import org.apache.hadoop.hbase.master.cleaner.LogCleaner;
 import org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner;
+import org.apache.hadoop.hbase.regionserver.LogRoller;
 import 
org.apache.hadoop.hbase.security.HadoopSecurityEnabledUserProviderForTesting;
 import org.apache.hadoop.hbase.security.UserProvider;
 import org.apache.hadoop.hbase.security.access.SecureTestUtil;
@@ -67,6 +69,7 @@ import org.apache.hadoop.hbase.util.EnvironmentEdgeManager;
 import org.apache.hadoop.hbase.wal.AbstractFSWALProvider;
 import org.apache.hadoop.hbase.wal.WALFactory;
 import org.junit.AfterClass;
+import org.junit.Before;
 import org.junit.BeforeClass;
 import org.slf4j.Logger;
 import org.slf4j.LoggerFactory;
@@ -115,6 +118,38 @@ public class TestBackupBase {
   super(conn, backupId, request);
 }
 
+@Before
+public void ensurePreviousBackupTestsAreCleanedUp() throws Exception {
+  // Every operation here may not be necessary for any given test,
+  // some often being no-ops. the goal is to help ensure atomicity
+  // of that tests that implement TestBackupBase
+  try (BackupAdmin backupAdmin = getBackupAdmin()) {
+backupManager.finishBackupSession();
+backupAdmin.listBackupSets().forEach(backupSet -> {
+  try {
+backupAdmin.deleteBackupSet(backupSet.getNam

(hbase) 01/01: HBASE-28678 Make nightly builds for 3.x java 17 only and add java 17 test for 2.x

2024-06-26 Thread zhangduo

This is an automated email from the ASF dual-hosted git repository.

zhangduo pushed a commit to branch HBASE-28678-branch-2
in repository https://gitbox.apache.org/repos/asf/hbase.git

commit 3078c81ceee4a9ebd8946d5a5ca40af8c7188562
Author: Duo Zhang 
AuthorDate: Mon Jun 24 15:15:54 2024 +0800

HBASE-28678 Make nightly builds for 3.x java 17 only and add java 17 test 
for 2.x
---
 dev-support/Jenkinsfile  | 125 ++-
 dev-support/hbase-personality.sh |  22 ++-
 2 files changed, 126 insertions(+), 21 deletions(-)

diff --git a/dev-support/Jenkinsfile b/dev-support/Jenkinsfile
index 27c4721057d..14b16981f6f 100644
--- a/dev-support/Jenkinsfile
+++ b/dev-support/Jenkinsfile
@@ -203,8 +203,9 @@ pipeline {
   environment {
 BASEDIR = "${env.WORKSPACE}/component"
 TESTS = "${env.SHALLOW_CHECKS}"
-SET_JAVA_HOME = "/usr/lib/jvm/java-11"
-JAVA8_HOME="/usr/lib/jvm/java-8"
+// use java 17 to build 3.x and java 11 to build 2.x
+SET_JAVA_HOME = "${env.BRANCH_NAME.contains("branch-2") ? 
"/usr/lib/jvm/java-11" : "/usr/lib/jvm/java-17"}"
+JAVA8_HOME = "/usr/lib/jvm/java-8"
 // Activates hadoop 3.0 profile in maven runs.
 HADOOP_PROFILE = '3.0'
 OUTPUT_DIR_RELATIVE = "${env.OUTPUT_DIR_RELATIVE_GENERAL}"
@@ -305,7 +306,7 @@ pipeline {
 }
   }
   when {
-branch 'branch-2*'
+branch '*branch-2*'
   }
   environment {
 BASEDIR = "${env.WORKSPACE}/component"
@@ -415,6 +416,9 @@ pipeline {
   label 'hbase'
 }
   }
+  when {
+branch '*branch-2*'
+  }
   environment {
 BASEDIR = "${env.WORKSPACE}/component"
 TESTS = "${env.DEEP_CHECKS}"
@@ -525,6 +529,9 @@ pipeline {
   label 'hbase'
 }
   }
+  when {
+branch '*branch-2*'
+  }
   environment {
 BASEDIR = "${env.WORKSPACE}/component"
 TESTS = "${env.DEEP_CHECKS}"
@@ -629,6 +636,116 @@ pipeline {
 }
   }
 }
+stage ('yetus jdk17 hadoop3 checks') {
+  agent {
+node {
+  label 'hbase'
+}
+  }
+  environment {
+BASEDIR = "${env.WORKSPACE}/component"
+TESTS = "${env.DEEP_CHECKS}"
+OUTPUT_DIR_RELATIVE = "${env.OUTPUT_DIR_RELATIVE_JDK17_HADOOP3}"
+OUTPUT_DIR = 
"${env.WORKSPACE}/${env.OUTPUT_DIR_RELATIVE_JDK17_HADOOP3}"
+SET_JAVA_HOME = "/usr/lib/jvm/java-17"
+// Activates hadoop 3.0 profile in maven runs.
+HADOOP_PROFILE = '3.0'
+SKIP_ERRORPRONE = true
+  }
+  steps {
+// Must do prior to anything else, since if one of them timesout 
we'll stash the commentfile
+sh '''#!/usr/bin/env bash
+  set -e
+  rm -rf "${OUTPUT_DIR}" && mkdir "${OUTPUT_DIR}"
+  echo '(x) {color:red}-1 jdk17 hadoop3 checks{color}' 
>"${OUTPUT_DIR}/commentfile"
+  echo "-- Something went wrong running this stage, please [check 
relevant console output|${BUILD_URL}/console]." >> "${OUTPUT_DIR}/commentfile"
+'''
+unstash 'yetus'
+dir('component') {
+  checkout scm
+}
+sh '''#!/usr/bin/env bash
+  set -e
+  rm -rf "${OUTPUT_DIR}/machine" && mkdir "${OUTPUT_DIR}/machine"
+  "${BASEDIR}/dev-support/gather_machine_environment.sh" 
"${OUTPUT_DIR_RELATIVE}/machine"
+  echo "got the following saved stats in 
'${OUTPUT_DIR_RELATIVE}/machine'"
+  ls -lh "${OUTPUT_DIR_RELATIVE}/machine"
+'''
+script {
+  def ret = sh(
+returnStatus: true,
+script: '''#!/usr/bin/env bash
+  set -e
+  declare -i status=0
+  if "${BASEDIR}/dev-support/hbase_nightly_yetus.sh" ; then
+echo '(/) {color:green}+1 jdk17 hadoop3 checks{color}' > 
"${OUTPUT_DIR}/commentfile"
+  else
+echo '(x) {color:red}-1 jdk17 hadoop3 checks{color}' > 
"${OUTPUT_DIR}/commentfile"
+status=1
+  fi
+  echo "-- For more information [see jdk17 
report|${BUILD_URL}JDK17_20Nightly_20Build_20Report_20_28Hadoop3_29/]" >> 
"${OUTPUT_DIR}/commentfile"
+  exit "${status}"
+'''
+  )
+  if (ret != 0) {
+// mark the build as UNSTABLE instead of FAILURE, to avoid 
skipping the later publish of
+// test output. See HBASE-26339 for more details.
+currentBuild.result = 'UNSTABLE'
+  }
+}
+  }
+

(hbase) branch HBASE-28678-branch-2 updated (2c0fc47dcaa -> 3078c81ceee)

2024-06-26 Thread zhangduo

This is an automated email from the ASF dual-hosted git repository.

zhangduo pushed a change to branch HBASE-28678-branch-2
in repository https://gitbox.apache.org/repos/asf/hbase.git


 discard 2c0fc47dcaa HBASE-28678 Make nightly builds for 3.x java 17 only and 
add java 17 test for 2.x
 new 3078c81ceee HBASE-28678 Make nightly builds for 3.x java 17 only and 
add java 17 test for 2.x

This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version.  This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:

 * -- * -- B -- O -- O -- O   (2c0fc47dcaa)
\
 N -- N -- N   refs/heads/HBASE-28678-branch-2 (3078c81ceee)

You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.

Any revisions marked "omit" are not gone; other references still
refer to them.  Any revisions marked "discard" are gone forever.

The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 dev-support/Jenkinsfile  |  8 
 dev-support/hbase-personality.sh | 22 --
 2 files changed, 8 insertions(+), 22 deletions(-)

(hbase) branch HBASE-28678 updated (242d3d114de -> 9a01c627daf)

2024-06-26 Thread zhangduo

This is an automated email from the ASF dual-hosted git repository.

zhangduo pushed a change to branch HBASE-28678
in repository https://gitbox.apache.org/repos/asf/hbase.git


 discard 242d3d114de HBASE-28678 Make nightly builds for 3.x java 17 only and 
add java 17 test for 2.x
 new 9a01c627daf HBASE-28678 Make nightly builds for 3.x java 17 only and 
add java 17 test for 2.x

This update added new revisions after undoing existing revisions.
That is to say, some revisions that were in the old version of the
branch are not in the new version.  This situation occurs
when a user --force pushes a change and generates a repository
containing something like this:

 * -- * -- B -- O -- O -- O   (242d3d114de)
\
 N -- N -- N   refs/heads/HBASE-28678 (9a01c627daf)

You should already have received notification emails for all of the O
revisions, and so the following emails describe only the N revisions
from the common base, B.

Any revisions marked "omit" are not gone; other references still
refer to them.  Any revisions marked "discard" are gone forever.

The 1 revisions listed above as "new" are entirely new to this
repository and will be described in separate emails.  The revisions
listed as "add" were already present in the repository and have only
been added to this reference.


Summary of changes:
 dev-support/Jenkinsfile  |  6 +++---
 dev-support/hbase-personality.sh | 22 --
 2 files changed, 7 insertions(+), 21 deletions(-)

(hbase) 01/01: HBASE-28678 Make nightly builds for 3.x java 17 only and add java 17 test for 2.x

2024-06-26 Thread zhangduo

This is an automated email from the ASF dual-hosted git repository.

zhangduo pushed a commit to branch HBASE-28678
in repository https://gitbox.apache.org/repos/asf/hbase.git

commit 9a01c627dafb099381f4990b18ac2ca54a30020e
Author: Duo Zhang 
AuthorDate: Mon Jun 24 15:15:54 2024 +0800

HBASE-28678 Make nightly builds for 3.x java 17 only and add java 17 test 
for 2.x
---
 dev-support/Jenkinsfile  | 20 
 dev-support/hbase-personality.sh | 22 --
 2 files changed, 16 insertions(+), 26 deletions(-)

diff --git a/dev-support/Jenkinsfile b/dev-support/Jenkinsfile
index 3aadf7316b3..b0d49993b96 100644
--- a/dev-support/Jenkinsfile
+++ b/dev-support/Jenkinsfile
@@ -205,8 +205,9 @@ pipeline {
   environment {
 BASEDIR = "${env.WORKSPACE}/component"
 TESTS = "${env.SHALLOW_CHECKS}"
-SET_JAVA_HOME = "/usr/lib/jvm/java-11"
-JAVA8_HOME="/usr/lib/jvm/java-8"
+// use java 17 to build 3.x and java 11 to build 2.x
+SET_JAVA_HOME = "${env.BRANCH_NAME.contains("branch-2") ? 
"/usr/lib/jvm/java-11" : "/usr/lib/jvm/java-17"}"
+JAVA8_HOME = "/usr/lib/jvm/java-8"
 // Activates hadoop 3.0 profile in maven runs.
 HADOOP_PROFILE = '3.0'
 OUTPUT_DIR_RELATIVE = "${env.OUTPUT_DIR_RELATIVE_GENERAL}"
@@ -307,7 +308,7 @@ pipeline {
 }
   }
   when {
-branch 'branch-2*'
+branch '*branch-2*'
   }
   environment {
 BASEDIR = "${env.WORKSPACE}/component"
@@ -417,6 +418,9 @@ pipeline {
   label 'hbase'
 }
   }
+  when {
+branch '*branch-2*'
+  }
   environment {
 BASEDIR = "${env.WORKSPACE}/component"
 TESTS = "${env.DEEP_CHECKS}"
@@ -527,6 +531,9 @@ pipeline {
   label 'hbase'
 }
   }
+  when {
+branch '*branch-2*'
+  }
   environment {
 BASEDIR = "${env.WORKSPACE}/component"
 TESTS = "${env.DEEP_CHECKS}"
@@ -633,11 +640,6 @@ pipeline {
 }
 
 stage ('yetus jdk17 hadoop3 checks') {
-  when {
-anyOf {
-  branch 'master';branch 'branch-3'
-}
-  }
   agent {
 node {
   label 'hbase'
@@ -943,12 +945,14 @@ pipeline {
unstash 'jdk8-hadoop2-result'
unstash 'jdk8-hadoop3-result'
unstash 'jdk11-hadoop3-result'
+   unstash 'jdk17-hadoop3-result'
unstash 'srctarball-result'
sh "printenv"
def results = ["${env.OUTPUT_DIR_RELATIVE_GENERAL}/commentfile",
   
"${env.OUTPUT_DIR_RELATIVE_JDK8_HADOOP2}/commentfile",
   
"${env.OUTPUT_DIR_RELATIVE_JDK8_HADOOP3}/commentfile",
   
"${env.OUTPUT_DIR_RELATIVE_JDK11_HADOOP3}/commentfile",
+  
"${env.OUTPUT_DIR_RELATIVE_JDK17_HADOOP3}/commentfile",
   'output-srctarball/commentfile',
   'output-integration/commentfile']
echo env.BRANCH_NAME
diff --git a/dev-support/hbase-personality.sh b/dev-support/hbase-personality.sh
index c7131c45e2f..3aa8accfc94 100755
--- a/dev-support/hbase-personality.sh
+++ b/dev-support/hbase-personality.sh
@@ -490,7 +490,7 @@ function shadedjars_rebuild
   # If we have HADOOP_PROFILE specified and we're on branch-2.x, pass along
   # the hadoop.profile system property. Ensures that Hadoop2 and Hadoop3
   # logic is not both activated within Maven.
-  if [[ -n "${HADOOP_PROFILE}" ]] && [[ "${PATCH_BRANCH}" = branch-2* ]] ; then
+  if [[ -n "${HADOOP_PROFILE}" ]] && [[ "${PATCH_BRANCH}" = *branch-2* ]] ; 
then
 maven_args+=("-Dhadoop.profile=${HADOOP_PROFILE}")
   fi
 
@@ -580,14 +580,7 @@ function hadoopcheck_rebuild
 
   # All supported Hadoop versions that we want to test the compilation with
   # See the Hadoop section on prereqs in the HBase Reference Guide
-  if [[ "${PATCH_BRANCH}" = branch-2.4 ]]; then
-yetus_info "Setting Hadoop 2 versions to test based on branch-2.4 rules."
-if [[ "${QUICK_HADOOPCHECK}" == "true" ]]; then
-  hbase_hadoop2_versions="2.10.2"
-else
-  hbase_hadoop2_versions="2.10.0 2.10.1 2.10.2"
-fi
-  elif [[ "${PATCH_BRANCH}" = branch-2* ]]; then
+  if [[ "${PATCH_BRANCH}" = *branch-2* ]]; then
 yetus_info "Setting Hadoop 2 versions to test based on branch-2.5+ rules."
 hbase_hadoop2_versions="2.10.2"
   else
@@ -595,14 +588,7 @@ function hadoopcheck_rebuild
 hbase_hadoop2_versions=""
   fi
 
-  if [[ "${PATCH_BRANCH}" = branch-2.4 ]]; then
-yetus_info "Setting Hadoop 3 versions to test based on branch-2.4 rules"
-if [[ "${QUICK_HADOOPCHECK}" == "true" ]]; then
-  hbase_hadoop3_versions="3.1.4 3.2.4 3.3.6"
-else
-  hbase_hadoop3_versions="3

(hbase) 01/01: HBASE-28693 Change flaky tests to run with jdk17

(hbase) branch HBASE-28693 updated (b0bd87ef0fb -> a4011c1ee79)

(hbase) branch HBASE-28693 updated: mount passwd

(hbase) branch HBASE-28693 updated: remove MAVEN_OPTS in dockerfile

(hbase) branch HBASE-28693 updated: mvn

(hbase) branch HBASE-28693 updated: fix agent

(hbase) 01/01: HBASE-28693 Change flaky tests to run with jdk17

(hbase) branch HBASE-28693 created (now 1992a3bc5c2)

(hbase) branch HBASE-28678-branch-2 updated: personality

(hbase) branch HBASE-28678-branch-2 updated (1221d452dde -> 1fd1c5e1203)

(hbase) 01/01: HBASE-28678 Make nightly builds for 3.x java 17 only and add java 17 test for 2.x

(hbase) branch HBASE-28678 updated (2b7709b082b -> a669da9076a)

(hbase) 01/01: HBASE-28678 Make nightly builds for 3.x java 17 only and add java 17 test for 2.x

(hbase-site) branch asf-site updated: INFRA-10751 Empty commit

(hbase) branch branch-2.6 updated: HBASE-28677 Add jdk 17 task for pre commit build for 2.x (#6002)

(hbase) branch branch-2.5 updated: HBASE-28677 Add jdk 17 task for pre commit build for 2.x (#6002)

(hbase) 01/02: Revert "HBASE-28677 Add jdk 17 task for pre commit build for 2.x (#6002)"

(hbase) branch branch-2 updated (8fd1ecab8e5 -> 30013067216)

(hbase) 02/02: HBASE-28677 Add jdk 17 task for pre commit build for 2.x (#6002)

(hbase) branch branch-3 updated: HBASE-28676 Make pre commit build for 3.x to only run jdk 17 test (#6001)

(hbase) branch master updated: HBASE-28676 Make pre commit build for 3.x to only run jdk 17 test (#6001)

(hbase) branch branch-2 updated: HBASE-28677 Add jdk 17 task for pre commit build for 2.x (#6002)

(hbase) branch HBASE-28678-branch-2 updated (3078c81ceee -> 1221d452dde)

(hbase) 01/01: HBASE-28678 Make nightly builds for 3.x java 17 only and add java 17 test for 2.x

(hbase) 01/01: HBASE-28678 Make nightly builds for 3.x java 17 only and add java 17 test for 2.x

(hbase) branch HBASE-28678 updated (9a01c627daf -> 2b7709b082b)

(hbase) branch master updated: HBASE-28687 BackupSystemTable#checkSystemTable should ensure system tables are enabled (#6018)

(hbase) 01/01: HBASE-28678 Make nightly builds for 3.x java 17 only and add java 17 test for 2.x

(hbase) branch HBASE-28678-branch-2 updated (2c0fc47dcaa -> 3078c81ceee)

(hbase) branch HBASE-28678 updated (242d3d114de -> 9a01c627daf)

(hbase) 01/01: HBASE-28678 Make nightly builds for 3.x java 17 only and add java 17 test for 2.x

31 matches

Site Navigation

Mail list logo

Footer information