Re: [PR] HBASE-28448 CompressionTest hangs when run over a Ozone ofs path (#5771) [hbase]
Apache-HBase commented on PR #5812: URL: https://github.com/apache/hbase/pull/5812#issuecomment-2089768123 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 3m 12s | Docker mode activated. | | -0 :warning: | yetus | 0m 3s | Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck | ||| _ Prechecks _ | ||| _ branch-3 Compile Tests _ | | +1 :green_heart: | mvninstall | 4m 3s | branch-3 passed | | +1 :green_heart: | compile | 1m 15s | branch-3 passed | | +1 :green_heart: | shadedjars | 7m 12s | branch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 0m 42s | branch-3 passed | ||| _ Patch Compile Tests _ | | +1 :green_heart: | mvninstall | 3m 51s | the patch passed | | +1 :green_heart: | compile | 1m 3s | the patch passed | | +1 :green_heart: | javac | 1m 3s | the patch passed | | +1 :green_heart: | shadedjars | 6m 26s | patch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 0m 31s | the patch passed | ||| _ Other Tests _ | | -1 :x: | unit | 259m 4s | hbase-server in the patch failed. | | | | 291m 50s | | | Subsystem | Report/Notes | |--:|:-| | Docker | ClientAPI=1.43 ServerAPI=1.43 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5812/2/artifact/yetus-jdk17-hadoop3-check/output/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/5812 | | Optional Tests | javac javadoc unit shadedjars compile | | uname | Linux 60c84812d617 5.4.0-1103-aws #111~18.04.1-Ubuntu SMP Tue May 23 20:04:10 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | dev-support/hbase-personality.sh | | git revision | branch-3 / 6ad7d9ea06 | | Default Java | Eclipse Adoptium-17.0.10+7 | | unit | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5812/2/artifact/yetus-jdk17-hadoop3-check/output/patch-unit-hbase-server.txt | | Test Results | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5812/2/testReport/ | | Max. process+thread count | 5019 (vs. ulimit of 3) | | modules | C: hbase-server U: hbase-server | | Console output | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5812/2/console | | versions | git=2.34.1 maven=3.8.6 | | Powered by | Apache Yetus 0.12.0 https://yetus.apache.org | This message was automatically generated. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Commented] (HBASE-28558) Fix constructors for sub classes of Connection
[ https://issues.apache.org/jira/browse/HBASE-28558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17842863#comment-17842863 ] Hudson commented on HBASE-28558: Results for branch branch-2 [build #1047 on builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/1047/]: (x) *{color:red}-1 overall{color}* details (if available): (/) {color:green}+1 general checks{color} -- For more information [see general report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/1047/General_20Nightly_20Build_20Report/] (/) {color:green}+1 jdk8 hadoop2 checks{color} -- For more information [see jdk8 (hadoop2) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/1047/JDK8_20Nightly_20Build_20Report_20_28Hadoop2_29/] (x) {color:red}-1 jdk8 hadoop3 checks{color} -- For more information [see jdk8 (hadoop3) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/1047/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/] (x) {color:red}-1 jdk11 hadoop3 checks{color} -- For more information [see jdk11 report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/1047/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 source release artifact{color} -- See build output for details. (/) {color:green}+1 client integration test{color} > Fix constructors for sub classes of Connection > -- > > Key: HBASE-28558 > URL: https://issues.apache.org/jira/browse/HBASE-28558 > Project: HBase > Issue Type: Bug > Components: Client, test >Reporter: Duo Zhang >Assignee: Duo Zhang >Priority: Major > Labels: pull-request-available > Fix For: 2.7.0, 3.0.0-beta-2 > > > We still have some testing classes which implement Connection but do not have > constructors with ConnectionRegistry as parameter. > This lead to some test failures on branch-2.x, but we'd better also fix them > on master as well. -- This message was sent by Atlassian Jira (v8.20.10#820010)
Re: [PR] HBASE-28448 CompressionTest hangs when run over a Ozone ofs path (#5771) [hbase]
Apache-HBase commented on PR #5813: URL: https://github.com/apache/hbase/pull/5813#issuecomment-2089815303 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 2m 48s | Docker mode activated. | | -0 :warning: | yetus | 0m 5s | Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck | ||| _ Prechecks _ | ||| _ branch-2 Compile Tests _ | | +1 :green_heart: | mvninstall | 5m 34s | branch-2 passed | | +1 :green_heart: | compile | 1m 4s | branch-2 passed | | +1 :green_heart: | shadedjars | 6m 44s | branch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 0m 37s | branch-2 passed | ||| _ Patch Compile Tests _ | | +1 :green_heart: | mvninstall | 3m 37s | the patch passed | | +1 :green_heart: | compile | 0m 55s | the patch passed | | +1 :green_heart: | javac | 0m 55s | the patch passed | | +1 :green_heart: | shadedjars | 6m 55s | patch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 0m 38s | the patch passed | ||| _ Other Tests _ | | +1 :green_heart: | unit | 288m 55s | hbase-server in the patch passed. | | | | 322m 42s | | | Subsystem | Report/Notes | |--:|:-| | Docker | ClientAPI=1.43 ServerAPI=1.43 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5813/2/artifact/yetus-jdk11-hadoop3-check/output/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/5813 | | Optional Tests | javac javadoc unit shadedjars compile | | uname | Linux 516062fecbd5 5.4.0-1103-aws #111~18.04.1-Ubuntu SMP Tue May 23 20:04:10 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | dev-support/hbase-personality.sh | | git revision | branch-2 / 72b5c8f503 | | Default Java | Eclipse Adoptium-11.0.17+8 | | Test Results | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5813/2/testReport/ | | Max. process+thread count | 4256 (vs. ulimit of 3) | | modules | C: hbase-server U: hbase-server | | Console output | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5813/2/console | | versions | git=2.34.1 maven=3.8.6 | | Powered by | Apache Yetus 0.12.0 https://yetus.apache.org | This message was automatically generated. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [PR] HBASE-28448 CompressionTest hangs when run over a Ozone ofs path (#5771) [hbase]
Apache-HBase commented on PR #5813: URL: https://github.com/apache/hbase/pull/5813#issuecomment-2089816261 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 2m 45s | Docker mode activated. | | -0 :warning: | yetus | 0m 4s | Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck | ||| _ Prechecks _ | ||| _ branch-2 Compile Tests _ | | +1 :green_heart: | mvninstall | 4m 51s | branch-2 passed | | +1 :green_heart: | compile | 0m 57s | branch-2 passed | | +1 :green_heart: | shadedjars | 6m 5s | branch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 0m 28s | branch-2 passed | ||| _ Patch Compile Tests _ | | +1 :green_heart: | mvninstall | 3m 1s | the patch passed | | +1 :green_heart: | compile | 0m 57s | the patch passed | | +1 :green_heart: | javac | 0m 56s | the patch passed | | +1 :green_heart: | shadedjars | 5m 58s | patch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 0m 27s | the patch passed | ||| _ Other Tests _ | | -1 :x: | unit | 292m 46s | hbase-server in the patch failed. | | | | 323m 19s | | | Subsystem | Report/Notes | |--:|:-| | Docker | ClientAPI=1.43 ServerAPI=1.43 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5813/2/artifact/yetus-jdk8-hadoop2-check/output/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/5813 | | Optional Tests | javac javadoc unit shadedjars compile | | uname | Linux a0b1179a0c77 5.4.0-1103-aws #111~18.04.1-Ubuntu SMP Tue May 23 20:04:10 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | dev-support/hbase-personality.sh | | git revision | branch-2 / 72b5c8f503 | | Default Java | Temurin-1.8.0_352-b08 | | unit | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5813/2/artifact/yetus-jdk8-hadoop2-check/output/patch-unit-hbase-server.txt | | Test Results | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5813/2/testReport/ | | Max. process+thread count | 4206 (vs. ulimit of 3) | | modules | C: hbase-server U: hbase-server | | Console output | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5813/2/console | | versions | git=2.34.1 maven=3.8.6 | | Powered by | Apache Yetus 0.12.0 https://yetus.apache.org | This message was automatically generated. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [PR] HBASE-28420 update the procedure's field to store for ServerRemoteProcedure [hbase]
Apache-HBase commented on PR #5816: URL: https://github.com/apache/hbase/pull/5816#issuecomment-2089840560 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m 53s | Docker mode activated. | ||| _ Prechecks _ | | +1 :green_heart: | dupname | 0m 1s | No case conflicting files found. | | +0 :ok: | prototool | 0m 1s | prototool was not available. | | +1 :green_heart: | hbaseanti | 0m 0s | Patch does not have any anti-patterns. | | +1 :green_heart: | @author | 0m 0s | The patch does not contain any @author tags. | ||| _ master Compile Tests _ | | +0 :ok: | mvndep | 0m 38s | Maven dependency ordering for branch | | +1 :green_heart: | mvninstall | 4m 11s | master passed | | +1 :green_heart: | compile | 4m 2s | master passed | | +1 :green_heart: | checkstyle | 0m 46s | master passed | | +1 :green_heart: | spotless | 0m 51s | branch has no errors when running spotless:check. | | +1 :green_heart: | spotbugs | 4m 32s | master passed | ||| _ Patch Compile Tests _ | | +0 :ok: | mvndep | 0m 10s | Maven dependency ordering for patch | | +1 :green_heart: | mvninstall | 3m 38s | the patch passed | | +1 :green_heart: | compile | 3m 49s | the patch passed | | +1 :green_heart: | cc | 3m 49s | the patch passed | | +1 :green_heart: | javac | 3m 49s | the patch passed | | -0 :warning: | checkstyle | 0m 39s | hbase-server: The patch generated 1 new + 0 unchanged - 0 fixed = 1 total (was 0) | | +1 :green_heart: | whitespace | 0m 0s | The patch has no whitespace issues. | | +1 :green_heart: | hadoopcheck | 6m 57s | Patch does not cause any errors with Hadoop 3.3.6. | | +1 :green_heart: | hbaseprotoc | 2m 0s | the patch passed | | +1 :green_heart: | spotless | 1m 9s | patch has no errors when running spotless:check. | | +1 :green_heart: | spotbugs | 5m 49s | the patch passed | ||| _ Other Tests _ | | +1 :green_heart: | asflicense | 0m 28s | The patch does not generate ASF License warnings. | | | | 50m 57s | | | Subsystem | Report/Notes | |--:|:-| | Docker | ClientAPI=1.43 ServerAPI=1.43 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5816/6/artifact/yetus-general-check/output/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/5816 | | Optional Tests | dupname asflicense cc hbaseprotoc spotless prototool javac spotbugs hadoopcheck hbaseanti checkstyle compile | | uname | Linux 378fbfe612b4 5.4.0-1103-aws #111~18.04.1-Ubuntu SMP Tue May 23 20:04:10 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | dev-support/hbase-personality.sh | | git revision | master / 3d66866f41 | | Default Java | Eclipse Adoptium-11.0.17+8 | | checkstyle | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5816/6/artifact/yetus-general-check/output/diff-checkstyle-hbase-server.txt | | Max. process+thread count | 81 (vs. ulimit of 3) | | modules | C: hbase-protocol-shaded hbase-server U: . | | Console output | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5816/6/console | | versions | git=2.34.1 maven=3.8.6 spotbugs=4.7.3 | | Powered by | Apache Yetus 0.12.0 https://yetus.apache.org | This message was automatically generated. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [PR] HBASE-28535: Add a region-server wide key to enable data-tiering. [hbase]
wchevreuil merged PR #5856: URL: https://github.com/apache/hbase/pull/5856 -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Resolved] (HBASE-28535) Implement a region server level configuration to enable/disable data-tiering
[ https://issues.apache.org/jira/browse/HBASE-28535?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Wellington Chevreuil resolved HBASE-28535. -- Resolution: Fixed Merged into the feature branch. Thanks for the contribution, [~janardhan.hungund] ! > Implement a region server level configuration to enable/disable data-tiering > > > Key: HBASE-28535 > URL: https://issues.apache.org/jira/browse/HBASE-28535 > Project: HBase > Issue Type: Task > Components: BucketCache >Reporter: Janardhan Hungund >Assignee: Janardhan Hungund >Priority: Major > Labels: pull-request-available > > Provide the user with the ability to enable and disable the data tiering > feature. The time-based data tiering is applicable to a specific set of use > cases which write date based records and access to recently written data. > The feature, in general, should be avoided for use cases which are not > dependent on the date-based reads and writes as the code flows which enable > data temperature checks can induce performance regressions. > This Jira is added to track the functionality to optionally enable > region-server wide configuration to disable or enable the feature. > Thanks, > Janardhan -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (HBASE-28539) Merge of incremental backups fails if backups are on a separate FileSystem
[ https://issues.apache.org/jira/browse/HBASE-28539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Ruben Van Wanzeele updated HBASE-28539: --- Component/s: backup&restore > Merge of incremental backups fails if backups are on a separate FileSystem > -- > > Key: HBASE-28539 > URL: https://issues.apache.org/jira/browse/HBASE-28539 > Project: HBase > Issue Type: Bug > Components: backup&restore >Affects Versions: 2.6.0, 4.0.0-alpha-1 >Reporter: Benny Colyn >Priority: Major > Attachments: > HBASE-28539_Fix_merging_of_incremental_backups_when_the_backup_filesystem_is_not_the_same_-1.patch > > > When the backups are stored on a location that is not the > DistributedFilesystem underpinning HBase itself merging of incremental > backups fails. Detected with backups stored on S3A, but can be reproduced > with any other (like LocalFilesystem). > Attached is a patch with a proposed fix and a unit test that reproduces the > issue. -- This message was sent by Atlassian Jira (v8.20.10#820010)
Re: [PR] HBASE-28420 update the procedure's field to store for ServerRemoteProcedure [hbase]
Apache-HBase commented on PR #5816: URL: https://github.com/apache/hbase/pull/5816#issuecomment-2090248908 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m 56s | Docker mode activated. | | -0 :warning: | yetus | 0m 2s | Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck | ||| _ Prechecks _ | ||| _ master Compile Tests _ | | +0 :ok: | mvndep | 0m 15s | Maven dependency ordering for branch | | +1 :green_heart: | mvninstall | 3m 59s | master passed | | +1 :green_heart: | compile | 1m 54s | master passed | | +1 :green_heart: | shadedjars | 6m 16s | branch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 0m 42s | master passed | ||| _ Patch Compile Tests _ | | +0 :ok: | mvndep | 0m 13s | Maven dependency ordering for patch | | +1 :green_heart: | mvninstall | 3m 48s | the patch passed | | +1 :green_heart: | compile | 1m 48s | the patch passed | | +1 :green_heart: | javac | 1m 48s | the patch passed | | +1 :green_heart: | shadedjars | 6m 16s | patch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 0m 41s | the patch passed | ||| _ Other Tests _ | | +1 :green_heart: | unit | 0m 34s | hbase-protocol-shaded in the patch passed. | | +1 :green_heart: | unit | 220m 34s | hbase-server in the patch passed. | | | | 252m 38s | | | Subsystem | Report/Notes | |--:|:-| | Docker | ClientAPI=1.43 ServerAPI=1.43 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5816/6/artifact/yetus-jdk17-hadoop3-check/output/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/5816 | | Optional Tests | unit javac javadoc shadedjars compile | | uname | Linux d205bff39c38 5.4.0-1103-aws #111~18.04.1-Ubuntu SMP Tue May 23 20:04:10 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | dev-support/hbase-personality.sh | | git revision | master / 3d66866f41 | | Default Java | Eclipse Adoptium-17.0.10+7 | | Test Results | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5816/6/testReport/ | | Max. process+thread count | 4788 (vs. ulimit of 3) | | modules | C: hbase-protocol-shaded hbase-server U: . | | Console output | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5816/6/console | | versions | git=2.34.1 maven=3.8.6 | | Powered by | Apache Yetus 0.12.0 https://yetus.apache.org | This message was automatically generated. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [PR] HBASE-28420 update the procedure's field to store for ServerRemoteProcedure [hbase]
Apache-HBase commented on PR #5816: URL: https://github.com/apache/hbase/pull/5816#issuecomment-2090324948 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 2m 35s | Docker mode activated. | | -0 :warning: | yetus | 0m 3s | Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck | ||| _ Prechecks _ | ||| _ master Compile Tests _ | | +0 :ok: | mvndep | 0m 31s | Maven dependency ordering for branch | | +1 :green_heart: | mvninstall | 2m 42s | master passed | | +1 :green_heart: | compile | 1m 4s | master passed | | +1 :green_heart: | shadedjars | 5m 42s | branch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 0m 31s | master passed | ||| _ Patch Compile Tests _ | | +0 :ok: | mvndep | 0m 12s | Maven dependency ordering for patch | | +1 :green_heart: | mvninstall | 2m 29s | the patch passed | | +1 :green_heart: | compile | 1m 5s | the patch passed | | +1 :green_heart: | javac | 1m 5s | the patch passed | | +1 :green_heart: | shadedjars | 5m 39s | patch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 0m 30s | the patch passed | ||| _ Other Tests _ | | +1 :green_heart: | unit | 0m 26s | hbase-protocol-shaded in the patch passed. | | -1 :x: | unit | 266m 22s | hbase-server in the patch failed. | | | | 294m 38s | | | Subsystem | Report/Notes | |--:|:-| | Docker | ClientAPI=1.43 ServerAPI=1.43 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5816/6/artifact/yetus-jdk8-hadoop3-check/output/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/5816 | | Optional Tests | unit javac javadoc shadedjars compile | | uname | Linux c67851023e55 5.4.0-1103-aws #111~18.04.1-Ubuntu SMP Tue May 23 20:04:10 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | dev-support/hbase-personality.sh | | git revision | master / 3d66866f41 | | Default Java | Temurin-1.8.0_352-b08 | | unit | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5816/6/artifact/yetus-jdk8-hadoop3-check/output/patch-unit-hbase-server.txt | | Test Results | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5816/6/testReport/ | | Max. process+thread count | 4633 (vs. ulimit of 3) | | modules | C: hbase-protocol-shaded hbase-server U: . | | Console output | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5816/6/console | | versions | git=2.34.1 maven=3.8.6 | | Powered by | Apache Yetus 0.12.0 https://yetus.apache.org | This message was automatically generated. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [PR] HBASE-28420 update the procedure's field to store for ServerRemoteProcedure [hbase]
Apache-HBase commented on PR #5816: URL: https://github.com/apache/hbase/pull/5816#issuecomment-2090334812 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 3m 27s | Docker mode activated. | | -0 :warning: | yetus | 0m 3s | Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck | ||| _ Prechecks _ | ||| _ master Compile Tests _ | | +0 :ok: | mvndep | 0m 11s | Maven dependency ordering for branch | | +1 :green_heart: | mvninstall | 2m 54s | master passed | | +1 :green_heart: | compile | 1m 28s | master passed | | +1 :green_heart: | shadedjars | 5m 15s | branch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 0m 38s | master passed | ||| _ Patch Compile Tests _ | | +0 :ok: | mvndep | 0m 14s | Maven dependency ordering for patch | | +1 :green_heart: | mvninstall | 2m 52s | the patch passed | | +1 :green_heart: | compile | 1m 27s | the patch passed | | +1 :green_heart: | javac | 1m 27s | the patch passed | | +1 :green_heart: | shadedjars | 5m 15s | patch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 0m 37s | the patch passed | ||| _ Other Tests _ | | +1 :green_heart: | unit | 0m 38s | hbase-protocol-shaded in the patch passed. | | +1 :green_heart: | unit | 270m 12s | hbase-server in the patch passed. | | | | 299m 51s | | | Subsystem | Report/Notes | |--:|:-| | Docker | ClientAPI=1.45 ServerAPI=1.45 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5816/6/artifact/yetus-jdk11-hadoop3-check/output/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/5816 | | Optional Tests | unit javac javadoc shadedjars compile | | uname | Linux 89ad2539b855 5.4.0-172-generic #190-Ubuntu SMP Fri Feb 2 23:24:22 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | dev-support/hbase-personality.sh | | git revision | master / 3d66866f41 | | Default Java | Eclipse Adoptium-11.0.17+8 | | Test Results | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5816/6/testReport/ | | Max. process+thread count | 5124 (vs. ulimit of 3) | | modules | C: hbase-protocol-shaded hbase-server U: . | | Console output | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5816/6/console | | versions | git=2.34.1 maven=3.8.6 | | Powered by | Apache Yetus 0.12.0 https://yetus.apache.org | This message was automatically generated. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Updated] (HBASE-28526) hbase-rest jar does not work with hbase-shaded-client with protobuf encoding
[ https://issues.apache.org/jira/browse/HBASE-28526?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Istvan Toth updated HBASE-28526: Affects Version/s: 2.5.8 2.4.17 2.6.0 2.7.0 > hbase-rest jar does not work with hbase-shaded-client with protobuf encoding > > > Key: HBASE-28526 > URL: https://issues.apache.org/jira/browse/HBASE-28526 > Project: HBase > Issue Type: Bug > Components: REST >Affects Versions: 2.6.0, 2.4.17, 2.7.0, 2.5.8 >Reporter: Istvan Toth >Priority: Major > > When trying to decode a protobuf encoded CellSet, I get > {noformat} > Exception in thread "main" java.lang.NoSuchMethodError: > org.apache.hadoop.hbase.protobuf.ProtobufUtil.mergeFrom(Lcom/google/protobuf/Message$Builder;[B)V > at > org.apache.hadoop.hbase.rest.model.CellSetModel.getObjectFromMessage(CellSetModel.java:129) > at RestClientExample.getMulti(RestClientExample.java:191) > at RestClientExample.start(RestClientExample.java:138) > at RestClientExample.main(RestClientExample.java:124) > {noformat} > Seems to be caused by relocating protobuf 2.5 in hbase-shaded-client. > It works fine with the unrelcoated client i.e. when using the > {noformat} > export CLASSPATH=`hbase --internal-classpath classpath`: > {noformat} > command to set up the classpath for the client. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (HBASE-28526) hbase-rest jar does not work with hbase-shaded-client with protobuf encoding
[ https://issues.apache.org/jira/browse/HBASE-28526?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17842948#comment-17842948 ] Istvan Toth commented on HBASE-28526: - This has already been done in branch-3+, which does not use vanilla protobuf anymore. I think it would be useful to backport this at least to branch-2. > hbase-rest jar does not work with hbase-shaded-client with protobuf encoding > > > Key: HBASE-28526 > URL: https://issues.apache.org/jira/browse/HBASE-28526 > Project: HBase > Issue Type: Bug > Components: REST >Reporter: Istvan Toth >Priority: Major > > When trying to decode a protobuf encoded CellSet, I get > {noformat} > Exception in thread "main" java.lang.NoSuchMethodError: > org.apache.hadoop.hbase.protobuf.ProtobufUtil.mergeFrom(Lcom/google/protobuf/Message$Builder;[B)V > at > org.apache.hadoop.hbase.rest.model.CellSetModel.getObjectFromMessage(CellSetModel.java:129) > at RestClientExample.getMulti(RestClientExample.java:191) > at RestClientExample.start(RestClientExample.java:138) > at RestClientExample.main(RestClientExample.java:124) > {noformat} > Seems to be caused by relocating protobuf 2.5 in hbase-shaded-client. > It works fine with the unrelcoated client i.e. when using the > {noformat} > export CLASSPATH=`hbase --internal-classpath classpath`: > {noformat} > command to set up the classpath for the client. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (HBASE-28556) Reduce memory copying in Rest server when serializing CellModel to Protobuf
[ https://issues.apache.org/jira/browse/HBASE-28556?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Istvan Toth updated HBASE-28556: Description: The REST server does a lot of unneccessary coping, which could be avoided at least for protobuf encoding. - -It uses ByteStringer to handle ByteBuffer backed Cells. However, it uses the client API, so it should never encounter ByteBuffer backed cells.- - It clones everything from the cells (sometimes multiple times) before serializing to protbuf. We could mimic the structure in Cell, with array, offset and length for each field, in CellModel and use the appropriate protobuf setters to avoid the extra copies. There may or may not be a way to do the same for JSON and XML via jax-rs, I don't know the frameworks well enough to tell, but if not, we could just do the copying in the getters for them, which would not make things worse. was: The REST server does a lot of unneccessary coping, which could be avoided at least for protobuf encoding. - It uses ByteStringer to handle ByteBuffer backed Cells. However, it uses the client API, so it should never encounter ByteBuffer backed cells. - It clones everything from the cells (sometimes multiple times) before serializing to protbuf. We could mimic the structure in Cell, with array, offset and length for each field, in CellModel and use the appropriate protobuf setters to avoid the extra copies. There may or may not be a way to do the same for JSON and XML via jax-rs, I don't know the frameworks well enough to tell, but if not, we could just do the copying in the getters for them, which would not make things worse. > Reduce memory copying in Rest server when serializing CellModel to Protobuf > --- > > Key: HBASE-28556 > URL: https://issues.apache.org/jira/browse/HBASE-28556 > Project: HBase > Issue Type: Improvement > Components: REST >Reporter: Istvan Toth >Assignee: Istvan Toth >Priority: Major > > The REST server does a lot of unneccessary coping, which could be avoided at > least for protobuf encoding. > - -It uses ByteStringer to handle ByteBuffer backed Cells. However, it uses > the client API, so it should never encounter ByteBuffer backed cells.- > - It clones everything from the cells (sometimes multiple times) before > serializing to protbuf. > We could mimic the structure in Cell, with array, offset and length for each > field, in CellModel and use the appropriate protobuf setters to avoid the > extra copies. > There may or may not be a way to do the same for JSON and XML via jax-rs, I > don't know the frameworks well enough to tell, but if not, we could just do > the copying in the getters for them, which would not make things worse. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (HBASE-27118) Add security headers to Thrift/HTTP server
[ https://issues.apache.org/jira/browse/HBASE-27118?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Andor Molnar updated HBASE-27118: - Description: In order to further improve HBase exposed service for vulnerability scanners, would be nice to implement additional security headers for the Thrift server when HTTP or HTTPS transport is enabled. Similarly to REST and Web UIs, related tickets are attached. was: In order to further improve HBase exposed service for vulnerability scanners, would be nice to implement additional security headers for the Thrift server when HTTP transport is enabled. Similarly to REST and Web UIs, related tickets are attached. > Add security headers to Thrift/HTTP server > --- > > Key: HBASE-27118 > URL: https://issues.apache.org/jira/browse/HBASE-27118 > Project: HBase > Issue Type: Improvement > Components: Thrift >Affects Versions: 2.0.6, 2.1.10, 2.2.7, 3.0.0-alpha-2 >Reporter: Andor Molnar >Assignee: Andor Molnar >Priority: Major > Labels: pull-request-available > > In order to further improve HBase exposed service for vulnerability scanners, > would be nice to implement additional security headers for the Thrift server > when HTTP or HTTPS transport is enabled. > Similarly to REST and Web UIs, related tickets are attached. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (HBASE-28556) Reduce memory copying in Rest server when serializing CellModel to Protobuf
[ https://issues.apache.org/jira/browse/HBASE-28556?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17842961#comment-17842961 ] Istvan Toth commented on HBASE-28556: - I mixed up ByteString and ByteBuffer. There is nothing with using ByteStringer/UnsafeByteOperations. > Reduce memory copying in Rest server when serializing CellModel to Protobuf > --- > > Key: HBASE-28556 > URL: https://issues.apache.org/jira/browse/HBASE-28556 > Project: HBase > Issue Type: Improvement > Components: REST >Reporter: Istvan Toth >Assignee: Istvan Toth >Priority: Major > > The REST server does a lot of unneccessary coping, which could be avoided at > least for protobuf encoding. > - -It uses ByteStringer to handle ByteBuffer backed Cells. However, it uses > the client API, so it should never encounter ByteBuffer backed cells.- > - It clones everything from the cells (sometimes multiple times) before > serializing to protbuf. > We could mimic the structure in Cell, with array, offset and length for each > field, in CellModel and use the appropriate protobuf setters to avoid the > extra copies. > There may or may not be a way to do the same for JSON and XML via jax-rs, I > don't know the frameworks well enough to tell, but if not, we could just do > the copying in the getters for them, which would not make things worse. -- This message was sent by Atlassian Jira (v8.20.10#820010)
Re: [PR] HBASE-27118 Add security headers to Thrift/HTTP server [hbase]
anmolnar commented on code in PR #5864: URL: https://github.com/apache/hbase/pull/5864#discussion_r1587596463 ## hbase-thrift/src/main/java/org/apache/hadoop/hbase/thrift/ThriftServer.java: ## @@ -387,9 +388,12 @@ protected void setupHTTPServer() throws IOException { httpServer = new Server(threadPool); // Context handler +boolean isSecure = conf.getBoolean(THRIFT_SSL_ENABLED_KEY, false); ServletContextHandler ctxHandler = new ServletContextHandler(httpServer, "/", ServletContextHandler.SESSIONS); -ctxHandler.addServlet(new ServletHolder(thriftHttpServlet), "/*"); +HttpServerUtil.addClickjackingPreventionFilter(ctxHandler, conf, PATH_SPEC_ANY); Review Comment: Thanks, I've updated the ticket. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Commented] (HBASE-28469) Integration of time-based priority caching into compaction paths.
[ https://issues.apache.org/jira/browse/HBASE-28469?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17842969#comment-17842969 ] Vinayak Hegde commented on HBASE-28469: --- We have a configuration called {{hbase.rs.cachecompactedblocksonwrite}} which adds blocks to cache while writing compacted files. This Jira aims to implement time-based priority caching for this feature. > Integration of time-based priority caching into compaction paths. > - > > Key: HBASE-28469 > URL: https://issues.apache.org/jira/browse/HBASE-28469 > Project: HBase > Issue Type: Task >Reporter: Janardhan Hungund >Assignee: Vinayak Hegde >Priority: Major > > The time-based priority caching is dependent on the date-tiered compaction > that structures store files in date-based tiered layout. This Jira tracks the > changes are needed for the integration of this compaction strategy with the > data-tiering to enable appropriate caching of hot data in the cache, while > the code data can remain the cloud storage. > Thanks, > Janardhan -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Updated] (HBASE-28469) Integration of time-based priority caching into compaction paths.
[ https://issues.apache.org/jira/browse/HBASE-28469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HBASE-28469: --- Labels: pull-request-available (was: ) > Integration of time-based priority caching into compaction paths. > - > > Key: HBASE-28469 > URL: https://issues.apache.org/jira/browse/HBASE-28469 > Project: HBase > Issue Type: Task >Reporter: Janardhan Hungund >Assignee: Vinayak Hegde >Priority: Major > Labels: pull-request-available > > The time-based priority caching is dependent on the date-tiered compaction > that structures store files in date-based tiered layout. This Jira tracks the > changes are needed for the integration of this compaction strategy with the > data-tiering to enable appropriate caching of hot data in the cache, while > the code data can remain the cloud storage. > Thanks, > Janardhan -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Work started] (HBASE-28469) Integration of time-based priority caching into compaction paths.
[ https://issues.apache.org/jira/browse/HBASE-28469?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HBASE-28469 started by Vinayak Hegde. - > Integration of time-based priority caching into compaction paths. > - > > Key: HBASE-28469 > URL: https://issues.apache.org/jira/browse/HBASE-28469 > Project: HBase > Issue Type: Task >Reporter: Janardhan Hungund >Assignee: Vinayak Hegde >Priority: Major > Labels: pull-request-available > > The time-based priority caching is dependent on the date-tiered compaction > that structures store files in date-based tiered layout. This Jira tracks the > changes are needed for the integration of this compaction strategy with the > data-tiering to enable appropriate caching of hot data in the cache, while > the code data can remain the cloud storage. > Thanks, > Janardhan -- This message was sent by Atlassian Jira (v8.20.10#820010)
[PR] HBASE-28539 Fix merging of incremental backups when the backup filesystem is not the same as the one underpinning HBase itself. [hbase]
bcolyn-ngdata opened a new pull request, #5867: URL: https://github.com/apache/hbase/pull/5867 HBASE-28539 Fix merging of incremental backups when the backup filesystem is not the same as the one underpinning HBase itself. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Updated] (HBASE-28539) Merge of incremental backups fails if backups are on a separate FileSystem
[ https://issues.apache.org/jira/browse/HBASE-28539?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HBASE-28539: --- Labels: pull-request-available (was: ) > Merge of incremental backups fails if backups are on a separate FileSystem > -- > > Key: HBASE-28539 > URL: https://issues.apache.org/jira/browse/HBASE-28539 > Project: HBase > Issue Type: Bug > Components: backup&restore >Affects Versions: 2.6.0, 4.0.0-alpha-1 >Reporter: Benny Colyn >Priority: Major > Labels: pull-request-available > Attachments: > HBASE-28539_Fix_merging_of_incremental_backups_when_the_backup_filesystem_is_not_the_same_-1.patch > > > When the backups are stored on a location that is not the > DistributedFilesystem underpinning HBase itself merging of incremental > backups fails. Detected with backups stored on S3A, but can be reproduced > with any other (like LocalFilesystem). > Attached is a patch with a proposed fix and a unit test that reproduces the > issue. -- This message was sent by Atlassian Jira (v8.20.10#820010)
Re: [PR] HBASE-28469: Integration of time-based priority caching into compaction paths [hbase]
Apache-HBase commented on PR #5866: URL: https://github.com/apache/hbase/pull/5866#issuecomment-2090620021 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m 28s | Docker mode activated. | ||| _ Prechecks _ | | +1 :green_heart: | dupname | 0m 0s | No case conflicting files found. | | +1 :green_heart: | hbaseanti | 0m 0s | Patch does not have any anti-patterns. | | +1 :green_heart: | @author | 0m 0s | The patch does not contain any @author tags. | ||| _ HBASE-28463 Compile Tests _ | | +1 :green_heart: | mvninstall | 3m 18s | HBASE-28463 passed | | +1 :green_heart: | compile | 2m 38s | HBASE-28463 passed | | +1 :green_heart: | checkstyle | 0m 37s | HBASE-28463 passed | | +1 :green_heart: | spotless | 0m 45s | branch has no errors when running spotless:check. | | +1 :green_heart: | spotbugs | 1m 34s | HBASE-28463 passed | ||| _ Patch Compile Tests _ | | +1 :green_heart: | mvninstall | 2m 54s | the patch passed | | +1 :green_heart: | compile | 2m 39s | the patch passed | | +1 :green_heart: | javac | 2m 39s | the patch passed | | +1 :green_heart: | checkstyle | 0m 36s | the patch passed | | +1 :green_heart: | whitespace | 0m 0s | The patch has no whitespace issues. | | +1 :green_heart: | hadoopcheck | 5m 35s | Patch does not cause any errors with Hadoop 3.3.6. | | +1 :green_heart: | spotless | 0m 43s | patch has no errors when running spotless:check. | | -1 :x: | spotbugs | 1m 41s | hbase-server generated 1 new + 0 unchanged - 0 fixed = 1 total (was 0) | ||| _ Other Tests _ | | +1 :green_heart: | asflicense | 0m 11s | The patch does not generate ASF License warnings. | | | | 30m 40s | | | Reason | Tests | |---:|:--| | FindBugs | module:hbase-server | | | Class org.apache.hadoop.hbase.io.hfile.BlockCacheKey defines non-transient non-serializable instance field maxTimestamp In BlockCacheKey.java:instance field maxTimestamp In BlockCacheKey.java | | Subsystem | Report/Notes | |--:|:-| | Docker | ClientAPI=1.43 ServerAPI=1.43 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5866/1/artifact/yetus-general-check/output/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/5866 | | JIRA Issue | HBASE-28469 | | Optional Tests | dupname asflicense javac spotbugs hadoopcheck hbaseanti spotless checkstyle compile | | uname | Linux c7266c11c7dc 5.4.0-1103-aws #111~18.04.1-Ubuntu SMP Tue May 23 20:04:10 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | dev-support/hbase-personality.sh | | git revision | HBASE-28463 / 4dee5324ae | | Default Java | Eclipse Adoptium-11.0.17+8 | | spotbugs | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5866/1/artifact/yetus-general-check/output/new-spotbugs-hbase-server.html | | Max. process+thread count | 85 (vs. ulimit of 3) | | modules | C: hbase-server U: hbase-server | | Console output | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5866/1/console | | versions | git=2.34.1 maven=3.8.6 spotbugs=4.7.3 | | Powered by | Apache Yetus 0.12.0 https://yetus.apache.org | This message was automatically generated. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Created] (HBASE-28562) Ancestor calculation of backups is wrong
Dieter De Paepe created HBASE-28562: --- Summary: Ancestor calculation of backups is wrong Key: HBASE-28562 URL: https://issues.apache.org/jira/browse/HBASE-28562 Project: HBase Issue Type: Bug Components: backup&restore Affects Versions: 2.6.0, 3.0.0 Reporter: Dieter De Paepe This is the same issue as HBASE-25870, but I think the fix there was wrong. This issue can prevent creation of (incremental) backups when data of unrelated backups was damaged on backup storage. Minimal example to reproduce from source: * Add following to `conf/hbase-site.xml` to enable backups: {code:java} hbase.backup.enable true hbase.master.logcleaner.plugins org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner,org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner,org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner,org.apache.hadoop.hbase.backup.master.BackupLogCleaner hbase.procedure.master.classes org.apache.hadoop.hbase.backup.master.LogRollMasterProcedureManager hbase.procedure.regionserver.classes org.apache.hadoop.hbase.backup.regionserver.LogRollRegionServerProcedureManager hbase.coprocessor.region.classes org.apache.hadoop.hbase.backup.BackupObserver hbase.fs.tmp.dir file:/tmp/hbase-tmp {code} * Start HBase and open a shell: {{{}bin/start-hbase.sh{}}}, {{bin/hbase shell}} * Execute following commands ("put" & "create" commands in hbase shell, other commands in commandline): * {code:java} create 'experiment', 'fam' put 'experiment', 'row1', 'fam:b', 'value1' bin/hbase backup create full file:/tmp/hbasebackup Backup session backup_1714649896776 finished. Status: SUCCESS put 'experiment', 'row2', 'fam:b', 'value2' bin/hbase backup create incremental file:/tmp/hbasebackup Backup session backup_1714649920488 finished. Status: SUCCESS put 'experiment', 'row3', 'fam:b', 'value3' bin/hbase backup create incremental file:/tmp/hbasebackup Backup session backup_1714650054960 finished. Status: SUCCESS (Delete the files corresponding to the first incremental backup - backup_1714649920488 in this example) put 'experiment', 'row4', 'fam:a', 'value4' bin/hbase backup create full file:/tmp/hbasebackup Backup session backup_1714650236911 finished. Status: SUCCESS put 'experiment', 'row5', 'fam:a', 'value5' bin/hbase backup create incremental file:/tmp/hbasebackup Backup session backup_1714650289957 finished. Status: SUCCESS put 'experiment', 'row6', 'fam:a', 'value6' bin/hbase backup create incremental file:/tmp/hbasebackup2024-05-02T13:45:27,534 ERROR [main {}] impl.BackupManifest: file:/tmp/hbasebackup/backup_1714649920488 does not exist 2024-05-02T13:45:27,534 ERROR [main {}] impl.TableBackupClient: Unexpected Exception : file:/tmp/hbasebackup/backup_1714649920488 does not exist org.apache.hadoop.hbase.backup.impl.BackupException: file:/tmp/hbasebackup/backup_1714649920488 does not exist   at org.apache.hadoop.hbase.backup.impl.BackupManifest.(BackupManifest.java:451) ~[hbase-backup-2.6.1-SNAPSHOT.jar:2.6.1-SNAPSHOT]   at org.apache.hadoop.hbase.backup.impl.BackupManifest.(BackupManifest.java:402) ~[hbase-backup-2.6.1-SNAPSHOT.jar:2.6.1-SNAPSHOT]   at org.apache.hadoop.hbase.backup.impl.BackupManager.getAncestors(BackupManager.java:331) ~[hbase-backup-2.6.1-SNAPSHOT.jar:2.6.1-SNAPSHOT]   at org.apache.hadoop.hbase.backup.impl.BackupManager.getAncestors(BackupManager.java:353) ~[hbase-backup-2.6.1-SNAPSHOT.jar:2.6.1-SNAPSHOT]   at org.apache.hadoop.hbase.backup.impl.TableBackupClient.addManifest(TableBackupClient.java:286) ~[hbase-backup-2.6.1-SNAPSHOT.jar:2.6.1-SNAPSHOT]   at org.apache.hadoop.hbase.backup.impl.TableBackupClient.completeBackup(TableBackupClient.java:351) ~[hbase-backup-2.6.1-SNAPSHOT.jar:2.6.1-SNAPSHOT]   at org.apache.hadoop.hbase.backup.impl.IncrementalTableBackupClient.execute(IncrementalTableBackupClient.java:314) ~[hbase-backup-2.6.1-SNAPSHOT.jar:2.6.1-SNAPSHOT]   at org.apache.hadoop.hbase.backup.impl.BackupAdminImpl.backupTables(BackupAdminImpl.java:603) ~[hbase-backup-2.6.1-SNAPSHOT.jar:2.6.1-SNAPSHOT]   at org.apache.hadoop.hbase.backup.impl.BackupCommands$CreateCommand.execute(BackupCommands.java:345) ~[hbase-backup-2.6.1-SNAPSHOT.jar:2.6.1-SNAPSHOT]   at org.apache.hadoop.hbase.backup.BackupDriver.parseAndRun(BackupDriver.java:134) ~[hbase-backup-2.6.1-SNAPSHOT.jar:2.6.1-SNAPSHOT]   at org.apache.hadoop.hbase.backup.BackupDriver.doWork(BackupDriver.java:169) ~[hbase-backup-2.6.1-SNAPSHOT.jar:2.6.1-SNAPSHOT]   at org.apache.hadoop.hbase.backup.BackupDriver.run(BackupDriver.java:199) ~[hbase-backup-2.6.1-SNAPSHOT.jar:2.6.1-SNAPSHOT]   at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:82) ~[hadoop-common-3.3.5.jar:?]   at org.apache.hadoop.hbase.backup.BackupDriver.main(BackupD
Re: [PR] HBASE-28539 Fix merging of incremental backups when the backup filesystem is not the same as the one underpinning HBase itself. [hbase]
Apache-HBase commented on PR #5867: URL: https://github.com/apache/hbase/pull/5867#issuecomment-2090694118 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m 19s | Docker mode activated. | ||| _ Prechecks _ | | +1 :green_heart: | dupname | 0m 0s | No case conflicting files found. | | +1 :green_heart: | hbaseanti | 0m 0s | Patch does not have any anti-patterns. | | +1 :green_heart: | @author | 0m 0s | The patch does not contain any @author tags. | ||| _ master Compile Tests _ | | +1 :green_heart: | mvninstall | 4m 18s | master passed | | +1 :green_heart: | compile | 0m 37s | master passed | | +1 :green_heart: | checkstyle | 0m 12s | master passed | | +1 :green_heart: | spotless | 0m 52s | branch has no errors when running spotless:check. | | +1 :green_heart: | spotbugs | 0m 38s | master passed | ||| _ Patch Compile Tests _ | | +1 :green_heart: | mvninstall | 3m 16s | the patch passed | | +1 :green_heart: | compile | 0m 27s | the patch passed | | +1 :green_heart: | javac | 0m 27s | the patch passed | | -0 :warning: | checkstyle | 0m 10s | hbase-backup: The patch generated 3 new + 0 unchanged - 0 fixed = 3 total (was 0) | | +1 :green_heart: | whitespace | 0m 0s | The patch has no whitespace issues. | | +1 :green_heart: | hadoopcheck | 5m 36s | Patch does not cause any errors with Hadoop 3.3.6. | | -1 :x: | spotless | 0m 48s | patch has 30 errors when running spotless:check, run spotless:apply to fix. | | +1 :green_heart: | spotbugs | 0m 39s | the patch passed | ||| _ Other Tests _ | | +1 :green_heart: | asflicense | 0m 11s | The patch does not generate ASF License warnings. | | | | 25m 21s | | | Subsystem | Report/Notes | |--:|:-| | Docker | ClientAPI=1.45 ServerAPI=1.45 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5867/1/artifact/yetus-general-check/output/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/5867 | | Optional Tests | dupname asflicense javac spotbugs hadoopcheck hbaseanti spotless checkstyle compile | | uname | Linux f912c44df62c 5.4.0-172-generic #190-Ubuntu SMP Fri Feb 2 23:24:22 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | dev-support/hbase-personality.sh | | git revision | master / 3d66866f41 | | Default Java | Eclipse Adoptium-11.0.17+8 | | checkstyle | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5867/1/artifact/yetus-general-check/output/diff-checkstyle-hbase-backup.txt | | spotless | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5867/1/artifact/yetus-general-check/output/patch-spotless.txt | | Max. process+thread count | 80 (vs. ulimit of 3) | | modules | C: hbase-backup U: hbase-backup | | Console output | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5867/1/console | | versions | git=2.34.1 maven=3.8.6 spotbugs=4.7.3 | | Powered by | Apache Yetus 0.12.0 https://yetus.apache.org | This message was automatically generated. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [PR] HBASE-28469: Integration of time-based priority caching into compaction paths [hbase]
Apache-HBase commented on PR #5866: URL: https://github.com/apache/hbase/pull/5866#issuecomment-2090694192 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m 56s | Docker mode activated. | | -0 :warning: | yetus | 0m 3s | Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck | ||| _ Prechecks _ | ||| _ HBASE-28463 Compile Tests _ | | +1 :green_heart: | mvninstall | 4m 26s | HBASE-28463 passed | | +1 :green_heart: | compile | 1m 5s | HBASE-28463 passed | | +1 :green_heart: | shadedjars | 6m 21s | branch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 0m 32s | HBASE-28463 passed | ||| _ Patch Compile Tests _ | | +1 :green_heart: | mvninstall | 3m 48s | the patch passed | | +1 :green_heart: | compile | 1m 0s | the patch passed | | +1 :green_heart: | javac | 1m 0s | the patch passed | | +1 :green_heart: | shadedjars | 6m 15s | patch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 0m 34s | the patch passed | ||| _ Other Tests _ | | -1 :x: | unit | 28m 19s | hbase-server in the patch failed. | | | | 55m 13s | | | Subsystem | Report/Notes | |--:|:-| | Docker | ClientAPI=1.43 ServerAPI=1.43 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5866/1/artifact/yetus-jdk11-hadoop3-check/output/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/5866 | | JIRA Issue | HBASE-28469 | | Optional Tests | javac javadoc unit shadedjars compile | | uname | Linux 5bc64b698b8b 5.4.0-1103-aws #111~18.04.1-Ubuntu SMP Tue May 23 20:04:10 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | dev-support/hbase-personality.sh | | git revision | HBASE-28463 / 4dee5324ae | | Default Java | Eclipse Adoptium-11.0.17+8 | | unit | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5866/1/artifact/yetus-jdk11-hadoop3-check/output/patch-unit-hbase-server.txt | | Test Results | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5866/1/testReport/ | | Max. process+thread count | 2162 (vs. ulimit of 3) | | modules | C: hbase-server U: hbase-server | | Console output | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5866/1/console | | versions | git=2.34.1 maven=3.8.6 | | Powered by | Apache Yetus 0.12.0 https://yetus.apache.org | This message was automatically generated. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [PR] HBASE-28539 Fix merging of incremental backups when the backup filesystem is not the same as the one underpinning HBase itself. [hbase]
Apache-HBase commented on PR #5867: URL: https://github.com/apache/hbase/pull/5867#issuecomment-2090723137 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m 33s | Docker mode activated. | | -0 :warning: | yetus | 0m 3s | Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck | ||| _ Prechecks _ | ||| _ master Compile Tests _ | | +1 :green_heart: | mvninstall | 3m 38s | master passed | | +1 :green_heart: | compile | 0m 18s | master passed | | +1 :green_heart: | shadedjars | 6m 11s | branch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 0m 16s | master passed | ||| _ Patch Compile Tests _ | | +1 :green_heart: | mvninstall | 3m 14s | the patch passed | | +1 :green_heart: | compile | 0m 18s | the patch passed | | +1 :green_heart: | javac | 0m 18s | the patch passed | | +1 :green_heart: | shadedjars | 5m 54s | patch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 0m 12s | the patch passed | ||| _ Other Tests _ | | -1 :x: | unit | 10m 56s | hbase-backup in the patch failed. | | | | 32m 32s | | | Subsystem | Report/Notes | |--:|:-| | Docker | ClientAPI=1.43 ServerAPI=1.43 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5867/1/artifact/yetus-jdk17-hadoop3-check/output/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/5867 | | Optional Tests | javac javadoc unit shadedjars compile | | uname | Linux ffb436938dca 5.4.0-1103-aws #111~18.04.1-Ubuntu SMP Tue May 23 20:04:10 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | dev-support/hbase-personality.sh | | git revision | master / 3d66866f41 | | Default Java | Eclipse Adoptium-17.0.10+7 | | unit | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5867/1/artifact/yetus-jdk17-hadoop3-check/output/patch-unit-hbase-backup.txt | | Test Results | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5867/1/testReport/ | | Max. process+thread count | 3897 (vs. ulimit of 3) | | modules | C: hbase-backup U: hbase-backup | | Console output | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5867/1/console | | versions | git=2.34.1 maven=3.8.6 | | Powered by | Apache Yetus 0.12.0 https://yetus.apache.org | This message was automatically generated. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [PR] HBASE-28539 Fix merging of incremental backups when the backup filesystem is not the same as the one underpinning HBase itself. [hbase]
Apache-HBase commented on PR #5867: URL: https://github.com/apache/hbase/pull/5867#issuecomment-2090730655 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m 31s | Docker mode activated. | | -0 :warning: | yetus | 0m 3s | Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck | ||| _ Prechecks _ | ||| _ master Compile Tests _ | | +1 :green_heart: | mvninstall | 3m 18s | master passed | | +1 :green_heart: | compile | 0m 20s | master passed | | +1 :green_heart: | shadedjars | 6m 8s | branch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 0m 16s | master passed | ||| _ Patch Compile Tests _ | | +1 :green_heart: | mvninstall | 2m 58s | the patch passed | | +1 :green_heart: | compile | 0m 19s | the patch passed | | +1 :green_heart: | javac | 0m 19s | the patch passed | | +1 :green_heart: | shadedjars | 6m 20s | patch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 0m 14s | the patch passed | ||| _ Other Tests _ | | +1 :green_heart: | unit | 12m 53s | hbase-backup in the patch passed. | | | | 34m 23s | | | Subsystem | Report/Notes | |--:|:-| | Docker | ClientAPI=1.43 ServerAPI=1.43 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5867/1/artifact/yetus-jdk8-hadoop3-check/output/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/5867 | | Optional Tests | javac javadoc unit shadedjars compile | | uname | Linux 7065b0fe3ffb 5.4.0-1103-aws #111~18.04.1-Ubuntu SMP Tue May 23 20:04:10 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | dev-support/hbase-personality.sh | | git revision | master / 3d66866f41 | | Default Java | Temurin-1.8.0_352-b08 | | Test Results | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5867/1/testReport/ | | Max. process+thread count | 3346 (vs. ulimit of 3) | | modules | C: hbase-backup U: hbase-backup | | Console output | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5867/1/console | | versions | git=2.34.1 maven=3.8.6 | | Powered by | Apache Yetus 0.12.0 https://yetus.apache.org | This message was automatically generated. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [PR] HBASE-28539 Fix merging of incremental backups when the backup filesystem is not the same as the one underpinning HBase itself. [hbase]
Apache-HBase commented on PR #5867: URL: https://github.com/apache/hbase/pull/5867#issuecomment-2090747514 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m 31s | Docker mode activated. | | -0 :warning: | yetus | 0m 2s | Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck | ||| _ Prechecks _ | ||| _ master Compile Tests _ | | +1 :green_heart: | mvninstall | 4m 14s | master passed | | +1 :green_heart: | compile | 0m 28s | master passed | | +1 :green_heart: | shadedjars | 7m 53s | branch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 0m 20s | master passed | ||| _ Patch Compile Tests _ | | +1 :green_heart: | mvninstall | 4m 5s | the patch passed | | +1 :green_heart: | compile | 0m 21s | the patch passed | | +1 :green_heart: | javac | 0m 21s | the patch passed | | +1 :green_heart: | shadedjars | 6m 58s | patch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 0m 14s | the patch passed | ||| _ Other Tests _ | | +1 :green_heart: | unit | 12m 29s | hbase-backup in the patch passed. | | | | 38m 38s | | | Subsystem | Report/Notes | |--:|:-| | Docker | ClientAPI=1.43 ServerAPI=1.43 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5867/1/artifact/yetus-jdk11-hadoop3-check/output/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/5867 | | Optional Tests | javac javadoc unit shadedjars compile | | uname | Linux 8c6e17b93751 5.4.0-1103-aws #111~18.04.1-Ubuntu SMP Tue May 23 20:04:10 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | dev-support/hbase-personality.sh | | git revision | master / 3d66866f41 | | Default Java | Eclipse Adoptium-11.0.17+8 | | Test Results | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5867/1/testReport/ | | Max. process+thread count | 3341 (vs. ulimit of 3) | | modules | C: hbase-backup U: hbase-backup | | Console output | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5867/1/console | | versions | git=2.34.1 maven=3.8.6 | | Powered by | Apache Yetus 0.12.0 https://yetus.apache.org | This message was automatically generated. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Commented] (HBASE-28562) Ancestor calculation of backups is wrong
[ https://issues.apache.org/jira/browse/HBASE-28562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17843004#comment-17843004 ] Bryan Beaudreault commented on HBASE-28562: --- We have not seen this issue, but we have seen that the backup manifest can grow very large for incremental backups (we've seen 1-2gb, when it should be bytes or kb). We've also suspected the getAncestors call. cc [~rmdmattingly]Â > Ancestor calculation of backups is wrong > > > Key: HBASE-28562 > URL: https://issues.apache.org/jira/browse/HBASE-28562 > Project: HBase > Issue Type: Bug > Components: backup&restore >Affects Versions: 2.6.0, 3.0.0 >Reporter: Dieter De Paepe >Priority: Major > > This is the same issue as HBASE-25870, but I think the fix there was wrong. > This issue can prevent creation of (incremental) backups when data of > unrelated backups was damaged on backup storage. > Minimal example to reproduce from source: > * Add following to `conf/hbase-site.xml` to enable backups: > {code:java} > > hbase.backup.enable > true > > > hbase.master.logcleaner.plugins > > org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner,org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner,org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner,org.apache.hadoop.hbase.backup.master.BackupLogCleaner > > > hbase.procedure.master.classes > > org.apache.hadoop.hbase.backup.master.LogRollMasterProcedureManager > > > hbase.procedure.regionserver.classes > > org.apache.hadoop.hbase.backup.regionserver.LogRollRegionServerProcedureManager > > > hbase.coprocessor.region.classes > org.apache.hadoop.hbase.backup.BackupObserver > > > hbase.fs.tmp.dir > file:/tmp/hbase-tmp >{code} > * Start HBase and open a shell: {{{}bin/start-hbase.sh{}}}, {{bin/hbase > shell}} > * Execute following commands ("put" & "create" commands in hbase shell, > other commands in commandline): > * > {code:java} > create 'experiment', 'fam' > put 'experiment', 'row1', 'fam:b', 'value1' > bin/hbase backup create full file:/tmp/hbasebackup > Backup session backup_1714649896776 finished. Status: SUCCESS > put 'experiment', 'row2', 'fam:b', 'value2' > bin/hbase backup create incremental file:/tmp/hbasebackup > Backup session backup_1714649920488 finished. Status: SUCCESS > put 'experiment', 'row3', 'fam:b', 'value3' > bin/hbase backup create incremental file:/tmp/hbasebackup > Backup session backup_1714650054960 finished. Status: SUCCESS > (Delete the files corresponding to the first incremental backup - > backup_1714649920488 in this example) > put 'experiment', 'row4', 'fam:a', 'value4' > bin/hbase backup create full file:/tmp/hbasebackup > Backup session backup_1714650236911 finished. Status: SUCCESS > put 'experiment', 'row5', 'fam:a', 'value5' > bin/hbase backup create incremental file:/tmp/hbasebackup > Backup session backup_1714650289957 finished. Status: SUCCESS > put 'experiment', 'row6', 'fam:a', 'value6' > bin/hbase backup create incremental > file:/tmp/hbasebackup2024-05-02T13:45:27,534 ERROR [main {}] > impl.BackupManifest: file:/tmp/hbasebackup/backup_1714649920488 does not exist > 2024-05-02T13:45:27,534 ERROR [main {}] impl.TableBackupClient: Unexpected > Exception : file:/tmp/hbasebackup/backup_1714649920488 does not exist > org.apache.hadoop.hbase.backup.impl.BackupException: > file:/tmp/hbasebackup/backup_1714649920488 does not exist > Â Â at > org.apache.hadoop.hbase.backup.impl.BackupManifest.(BackupManifest.java:451) > ~[hbase-backup-2.6.1-SNAPSHOT.jar:2.6.1-SNAPSHOT] > Â Â at > org.apache.hadoop.hbase.backup.impl.BackupManifest.(BackupManifest.java:402) > ~[hbase-backup-2.6.1-SNAPSHOT.jar:2.6.1-SNAPSHOT] > Â Â at > org.apache.hadoop.hbase.backup.impl.BackupManager.getAncestors(BackupManager.java:331) > ~[hbase-backup-2.6.1-SNAPSHOT.jar:2.6.1-SNAPSHOT] > Â Â at > org.apache.hadoop.hbase.backup.impl.BackupManager.getAncestors(BackupManager.java:353) > ~[hbase-backup-2.6.1-SNAPSHOT.jar:2.6.1-SNAPSHOT] > Â Â at > org.apache.hadoop.hbase.backup.impl.TableBackupClient.addManifest(TableBackupClient.java:286) > ~[hbase-backup-2.6.1-SNAPSHOT.jar:2.6.1-SNAPSHOT] > Â Â at > org.apache.hadoop.hbase.backup.impl.TableBackupClient.completeBackup(TableBackupClient.java:351) > ~[hbase-backup-2.6.1-SNAPSHOT.jar:2.6.1-SNAPSHOT] > Â Â at > org.apache.hadoop.hbase.backup.impl.IncrementalTableBackupClient.execute(IncrementalTableBackupClient.java:314) > ~[hbase-backup-2.6.1-SNAPSHOT.jar:2.6.1-SNAPSHOT] > Â Â at > org.apache.hadoop.hbase.backup.impl.BackupAdminImpl.backupTables(BackupAdminImpl.java:603) > ~[hbase-backup-2.6.1-SNAPSHOT.jar:2.6.1-SNAPSHOT] > Â Â at > org.apache.hadoop.hbase.backup.impl.BackupCommands$
[PR] HBASE-28562 Correct backup ancestor calculation [hbase]
DieterDP-ng opened a new pull request, #5868: URL: https://github.com/apache/hbase/pull/5868 The ancestor calculation was wrong for incremental backups: when requesting the ancestors for an incremental backup X, the ancestors could include both full and incremental backups that predate the full backup on which X is built. This caused a crash in incremental backup creation when data of old incremental backups was deleted through other means than the HBase API (i.e. without the HBase backup system table being updated). -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Updated] (HBASE-28562) Ancestor calculation of backups is wrong
[ https://issues.apache.org/jira/browse/HBASE-28562?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HBASE-28562: --- Labels: pull-request-available (was: ) > Ancestor calculation of backups is wrong > > > Key: HBASE-28562 > URL: https://issues.apache.org/jira/browse/HBASE-28562 > Project: HBase > Issue Type: Bug > Components: backup&restore >Affects Versions: 2.6.0, 3.0.0 >Reporter: Dieter De Paepe >Priority: Major > Labels: pull-request-available > > This is the same issue as HBASE-25870, but I think the fix there was wrong. > This issue can prevent creation of (incremental) backups when data of > unrelated backups was damaged on backup storage. > Minimal example to reproduce from source: > * Add following to `conf/hbase-site.xml` to enable backups: > {code:java} > > hbase.backup.enable > true > > > hbase.master.logcleaner.plugins > > org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner,org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner,org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner,org.apache.hadoop.hbase.backup.master.BackupLogCleaner > > > hbase.procedure.master.classes > > org.apache.hadoop.hbase.backup.master.LogRollMasterProcedureManager > > > hbase.procedure.regionserver.classes > > org.apache.hadoop.hbase.backup.regionserver.LogRollRegionServerProcedureManager > > > hbase.coprocessor.region.classes > org.apache.hadoop.hbase.backup.BackupObserver > > > hbase.fs.tmp.dir > file:/tmp/hbase-tmp >{code} > * Start HBase and open a shell: {{{}bin/start-hbase.sh{}}}, {{bin/hbase > shell}} > * Execute following commands ("put" & "create" commands in hbase shell, > other commands in commandline): > * > {code:java} > create 'experiment', 'fam' > put 'experiment', 'row1', 'fam:b', 'value1' > bin/hbase backup create full file:/tmp/hbasebackup > Backup session backup_1714649896776 finished. Status: SUCCESS > put 'experiment', 'row2', 'fam:b', 'value2' > bin/hbase backup create incremental file:/tmp/hbasebackup > Backup session backup_1714649920488 finished. Status: SUCCESS > put 'experiment', 'row3', 'fam:b', 'value3' > bin/hbase backup create incremental file:/tmp/hbasebackup > Backup session backup_1714650054960 finished. Status: SUCCESS > (Delete the files corresponding to the first incremental backup - > backup_1714649920488 in this example) > put 'experiment', 'row4', 'fam:a', 'value4' > bin/hbase backup create full file:/tmp/hbasebackup > Backup session backup_1714650236911 finished. Status: SUCCESS > put 'experiment', 'row5', 'fam:a', 'value5' > bin/hbase backup create incremental file:/tmp/hbasebackup > Backup session backup_1714650289957 finished. Status: SUCCESS > put 'experiment', 'row6', 'fam:a', 'value6' > bin/hbase backup create incremental > file:/tmp/hbasebackup2024-05-02T13:45:27,534 ERROR [main {}] > impl.BackupManifest: file:/tmp/hbasebackup/backup_1714649920488 does not exist > 2024-05-02T13:45:27,534 ERROR [main {}] impl.TableBackupClient: Unexpected > Exception : file:/tmp/hbasebackup/backup_1714649920488 does not exist > org.apache.hadoop.hbase.backup.impl.BackupException: > file:/tmp/hbasebackup/backup_1714649920488 does not exist > Â Â at > org.apache.hadoop.hbase.backup.impl.BackupManifest.(BackupManifest.java:451) > ~[hbase-backup-2.6.1-SNAPSHOT.jar:2.6.1-SNAPSHOT] > Â Â at > org.apache.hadoop.hbase.backup.impl.BackupManifest.(BackupManifest.java:402) > ~[hbase-backup-2.6.1-SNAPSHOT.jar:2.6.1-SNAPSHOT] > Â Â at > org.apache.hadoop.hbase.backup.impl.BackupManager.getAncestors(BackupManager.java:331) > ~[hbase-backup-2.6.1-SNAPSHOT.jar:2.6.1-SNAPSHOT] > Â Â at > org.apache.hadoop.hbase.backup.impl.BackupManager.getAncestors(BackupManager.java:353) > ~[hbase-backup-2.6.1-SNAPSHOT.jar:2.6.1-SNAPSHOT] > Â Â at > org.apache.hadoop.hbase.backup.impl.TableBackupClient.addManifest(TableBackupClient.java:286) > ~[hbase-backup-2.6.1-SNAPSHOT.jar:2.6.1-SNAPSHOT] > Â Â at > org.apache.hadoop.hbase.backup.impl.TableBackupClient.completeBackup(TableBackupClient.java:351) > ~[hbase-backup-2.6.1-SNAPSHOT.jar:2.6.1-SNAPSHOT] > Â Â at > org.apache.hadoop.hbase.backup.impl.IncrementalTableBackupClient.execute(IncrementalTableBackupClient.java:314) > ~[hbase-backup-2.6.1-SNAPSHOT.jar:2.6.1-SNAPSHOT] > Â Â at > org.apache.hadoop.hbase.backup.impl.BackupAdminImpl.backupTables(BackupAdminImpl.java:603) > ~[hbase-backup-2.6.1-SNAPSHOT.jar:2.6.1-SNAPSHOT] > Â Â at > org.apache.hadoop.hbase.backup.impl.BackupCommands$CreateCommand.execute(BackupCommands.java:345) > ~[hbase-backup-2.6.1-SNAPSHOT.jar:2.6.1-SNAPSHOT] > Â Â at > org.apache.hadoop.hbase.backup.BackupDriver.parseAndRun(BackupDriver.java:134) > ~[hbase-back
[jira] [Commented] (HBASE-28562) Ancestor calculation of backups is wrong
[ https://issues.apache.org/jira/browse/HBASE-28562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17843008#comment-17843008 ] Ray Mattingly commented on HBASE-28562: --- Yes, we've experience huge backup manifests due to some bugs in the getAncestors call, and its underlying BackupManifest#canCoverImage method. The BackupManifest#canCoverImage method specifies that its fullImages parameter is intended to only be full backup images, not incremental. Its name implies this, and [a comment makes that clear|https://github.com/apache/hbase/blob/2c3abae18aa35e2693b64b143316817d4569d0c3/hbase-backup/src/main/java/org/apache/hadoop/hbase/backup/impl/BackupManifest.java#L614]: "each image of fullImages must not be an incremental image" But we pass in all ancestors, including incremental images, to this method. For example: [https://github.com/apache/hbase/blob/6b672cc0717e762ecaad203714099b962c035ef0/hbase-backup/src/main/java/org/apache/hadoop/hbase/backup/impl/BackupManager.java#L320] And the BackupManifest#canCoverImage does not assert the precondition well — instead of throwing an IllegalArgumentException, it proceeds and will just return false [if any of the given ancestors are incremental backups|https://github.com/apache/hbase/blob/2c3abae18aa35e2693b64b143316817d4569d0c3/hbase-backup/src/main/java/org/apache/hadoop/hbase/backup/impl/BackupManifest.java#L619]! This means that, once an incremental backup ancestor has been found, all subsequent backup images will also be considered ancestors and this will balloon the backup manifest size. This could also be a factor in why checking the entirety of backup history is problematic for you. We probably need to largely refactor getAncestors and/or canCoverImage > Ancestor calculation of backups is wrong > > > Key: HBASE-28562 > URL: https://issues.apache.org/jira/browse/HBASE-28562 > Project: HBase > Issue Type: Bug > Components: backup&restore >Affects Versions: 2.6.0, 3.0.0 >Reporter: Dieter De Paepe >Priority: Major > Labels: pull-request-available > > This is the same issue as HBASE-25870, but I think the fix there was wrong. > This issue can prevent creation of (incremental) backups when data of > unrelated backups was damaged on backup storage. > Minimal example to reproduce from source: > * Add following to `conf/hbase-site.xml` to enable backups: > {code:java} > > hbase.backup.enable > true > > > hbase.master.logcleaner.plugins > > org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner,org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner,org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner,org.apache.hadoop.hbase.backup.master.BackupLogCleaner > > > hbase.procedure.master.classes > > org.apache.hadoop.hbase.backup.master.LogRollMasterProcedureManager > > > hbase.procedure.regionserver.classes > > org.apache.hadoop.hbase.backup.regionserver.LogRollRegionServerProcedureManager > > > hbase.coprocessor.region.classes > org.apache.hadoop.hbase.backup.BackupObserver > > > hbase.fs.tmp.dir > file:/tmp/hbase-tmp >{code} > * Start HBase and open a shell: {{{}bin/start-hbase.sh{}}}, {{bin/hbase > shell}} > * Execute following commands ("put" & "create" commands in hbase shell, > other commands in commandline): > * > {code:java} > create 'experiment', 'fam' > put 'experiment', 'row1', 'fam:b', 'value1' > bin/hbase backup create full file:/tmp/hbasebackup > Backup session backup_1714649896776 finished. Status: SUCCESS > put 'experiment', 'row2', 'fam:b', 'value2' > bin/hbase backup create incremental file:/tmp/hbasebackup > Backup session backup_1714649920488 finished. Status: SUCCESS > put 'experiment', 'row3', 'fam:b', 'value3' > bin/hbase backup create incremental file:/tmp/hbasebackup > Backup session backup_1714650054960 finished. Status: SUCCESS > (Delete the files corresponding to the first incremental backup - > backup_1714649920488 in this example) > put 'experiment', 'row4', 'fam:a', 'value4' > bin/hbase backup create full file:/tmp/hbasebackup > Backup session backup_1714650236911 finished. Status: SUCCESS > put 'experiment', 'row5', 'fam:a', 'value5' > bin/hbase backup create incremental file:/tmp/hbasebackup > Backup session backup_1714650289957 finished. Status: SUCCESS > put 'experiment', 'row6', 'fam:a', 'value6' > bin/hbase backup create incremental > file:/tmp/hbasebackup2024-05-02T13:45:27,534 ERROR [main {}] > impl.BackupManifest: file:/tmp/hbasebackup/backup_1714649920488 does not exist > 2024-05-02T13:45:27,534 ERROR [main {}] impl.TableBackupClient: Unexpected > Exception : file:/tmp/hbasebackup/backup_1714649920488 does not exist > org.apache.hadoop.hbase.backup.impl
[jira] [Commented] (HBASE-28562) Ancestor calculation of backups is wrong
[ https://issues.apache.org/jira/browse/HBASE-28562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17843009#comment-17843009 ] Dieter De Paepe commented on HBASE-28562: - Created a PR with a test to demonstrate the issue. > Ancestor calculation of backups is wrong > > > Key: HBASE-28562 > URL: https://issues.apache.org/jira/browse/HBASE-28562 > Project: HBase > Issue Type: Bug > Components: backup&restore >Affects Versions: 2.6.0, 3.0.0 >Reporter: Dieter De Paepe >Priority: Major > Labels: pull-request-available > > This is the same issue as HBASE-25870, but I think the fix there was wrong. > This issue can prevent creation of (incremental) backups when data of > unrelated backups was damaged on backup storage. > Minimal example to reproduce from source: > * Add following to `conf/hbase-site.xml` to enable backups: > {code:java} > > hbase.backup.enable > true > > > hbase.master.logcleaner.plugins > > org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner,org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner,org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner,org.apache.hadoop.hbase.backup.master.BackupLogCleaner > > > hbase.procedure.master.classes > > org.apache.hadoop.hbase.backup.master.LogRollMasterProcedureManager > > > hbase.procedure.regionserver.classes > > org.apache.hadoop.hbase.backup.regionserver.LogRollRegionServerProcedureManager > > > hbase.coprocessor.region.classes > org.apache.hadoop.hbase.backup.BackupObserver > > > hbase.fs.tmp.dir > file:/tmp/hbase-tmp >{code} > * Start HBase and open a shell: {{{}bin/start-hbase.sh{}}}, {{bin/hbase > shell}} > * Execute following commands ("put" & "create" commands in hbase shell, > other commands in commandline): > * > {code:java} > create 'experiment', 'fam' > put 'experiment', 'row1', 'fam:b', 'value1' > bin/hbase backup create full file:/tmp/hbasebackup > Backup session backup_1714649896776 finished. Status: SUCCESS > put 'experiment', 'row2', 'fam:b', 'value2' > bin/hbase backup create incremental file:/tmp/hbasebackup > Backup session backup_1714649920488 finished. Status: SUCCESS > put 'experiment', 'row3', 'fam:b', 'value3' > bin/hbase backup create incremental file:/tmp/hbasebackup > Backup session backup_1714650054960 finished. Status: SUCCESS > (Delete the files corresponding to the first incremental backup - > backup_1714649920488 in this example) > put 'experiment', 'row4', 'fam:a', 'value4' > bin/hbase backup create full file:/tmp/hbasebackup > Backup session backup_1714650236911 finished. Status: SUCCESS > put 'experiment', 'row5', 'fam:a', 'value5' > bin/hbase backup create incremental file:/tmp/hbasebackup > Backup session backup_1714650289957 finished. Status: SUCCESS > put 'experiment', 'row6', 'fam:a', 'value6' > bin/hbase backup create incremental > file:/tmp/hbasebackup2024-05-02T13:45:27,534 ERROR [main {}] > impl.BackupManifest: file:/tmp/hbasebackup/backup_1714649920488 does not exist > 2024-05-02T13:45:27,534 ERROR [main {}] impl.TableBackupClient: Unexpected > Exception : file:/tmp/hbasebackup/backup_1714649920488 does not exist > org.apache.hadoop.hbase.backup.impl.BackupException: > file:/tmp/hbasebackup/backup_1714649920488 does not exist > Â Â at > org.apache.hadoop.hbase.backup.impl.BackupManifest.(BackupManifest.java:451) > ~[hbase-backup-2.6.1-SNAPSHOT.jar:2.6.1-SNAPSHOT] > Â Â at > org.apache.hadoop.hbase.backup.impl.BackupManifest.(BackupManifest.java:402) > ~[hbase-backup-2.6.1-SNAPSHOT.jar:2.6.1-SNAPSHOT] > Â Â at > org.apache.hadoop.hbase.backup.impl.BackupManager.getAncestors(BackupManager.java:331) > ~[hbase-backup-2.6.1-SNAPSHOT.jar:2.6.1-SNAPSHOT] > Â Â at > org.apache.hadoop.hbase.backup.impl.BackupManager.getAncestors(BackupManager.java:353) > ~[hbase-backup-2.6.1-SNAPSHOT.jar:2.6.1-SNAPSHOT] > Â Â at > org.apache.hadoop.hbase.backup.impl.TableBackupClient.addManifest(TableBackupClient.java:286) > ~[hbase-backup-2.6.1-SNAPSHOT.jar:2.6.1-SNAPSHOT] > Â Â at > org.apache.hadoop.hbase.backup.impl.TableBackupClient.completeBackup(TableBackupClient.java:351) > ~[hbase-backup-2.6.1-SNAPSHOT.jar:2.6.1-SNAPSHOT] > Â Â at > org.apache.hadoop.hbase.backup.impl.IncrementalTableBackupClient.execute(IncrementalTableBackupClient.java:314) > ~[hbase-backup-2.6.1-SNAPSHOT.jar:2.6.1-SNAPSHOT] > Â Â at > org.apache.hadoop.hbase.backup.impl.BackupAdminImpl.backupTables(BackupAdminImpl.java:603) > ~[hbase-backup-2.6.1-SNAPSHOT.jar:2.6.1-SNAPSHOT] > Â Â at > org.apache.hadoop.hbase.backup.impl.BackupCommands$CreateCommand.execute(BackupCommands.java:345) > ~[hbase-backup-2.6.1-SNAPSHOT.jar:2.6.1-SNAPSHOT] > Â Â at > org.apache.hadoop.hbase.bac
[jira] [Commented] (HBASE-28562) Ancestor calculation of backups is wrong
[ https://issues.apache.org/jira/browse/HBASE-28562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17843010#comment-17843010 ] Dieter De Paepe commented on HBASE-28562: - The refactored code is quite simple compared to the original. I couldn't think of a reason why the canCoverImage is needed there, as far as I understand there's always a full backup followed by incremental backups, and a new full backup breaks that chain. The canCoverImage usage seemed to imply that structure can be tree-like? Anyway, the testcases seem to agree with the former. > Ancestor calculation of backups is wrong > > > Key: HBASE-28562 > URL: https://issues.apache.org/jira/browse/HBASE-28562 > Project: HBase > Issue Type: Bug > Components: backup&restore >Affects Versions: 2.6.0, 3.0.0 >Reporter: Dieter De Paepe >Priority: Major > Labels: pull-request-available > > This is the same issue as HBASE-25870, but I think the fix there was wrong. > This issue can prevent creation of (incremental) backups when data of > unrelated backups was damaged on backup storage. > Minimal example to reproduce from source: > * Add following to `conf/hbase-site.xml` to enable backups: > {code:java} > > hbase.backup.enable > true > > > hbase.master.logcleaner.plugins > > org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner,org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner,org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner,org.apache.hadoop.hbase.backup.master.BackupLogCleaner > > > hbase.procedure.master.classes > > org.apache.hadoop.hbase.backup.master.LogRollMasterProcedureManager > > > hbase.procedure.regionserver.classes > > org.apache.hadoop.hbase.backup.regionserver.LogRollRegionServerProcedureManager > > > hbase.coprocessor.region.classes > org.apache.hadoop.hbase.backup.BackupObserver > > > hbase.fs.tmp.dir > file:/tmp/hbase-tmp >{code} > * Start HBase and open a shell: {{{}bin/start-hbase.sh{}}}, {{bin/hbase > shell}} > * Execute following commands ("put" & "create" commands in hbase shell, > other commands in commandline): > * > {code:java} > create 'experiment', 'fam' > put 'experiment', 'row1', 'fam:b', 'value1' > bin/hbase backup create full file:/tmp/hbasebackup > Backup session backup_1714649896776 finished. Status: SUCCESS > put 'experiment', 'row2', 'fam:b', 'value2' > bin/hbase backup create incremental file:/tmp/hbasebackup > Backup session backup_1714649920488 finished. Status: SUCCESS > put 'experiment', 'row3', 'fam:b', 'value3' > bin/hbase backup create incremental file:/tmp/hbasebackup > Backup session backup_1714650054960 finished. Status: SUCCESS > (Delete the files corresponding to the first incremental backup - > backup_1714649920488 in this example) > put 'experiment', 'row4', 'fam:a', 'value4' > bin/hbase backup create full file:/tmp/hbasebackup > Backup session backup_1714650236911 finished. Status: SUCCESS > put 'experiment', 'row5', 'fam:a', 'value5' > bin/hbase backup create incremental file:/tmp/hbasebackup > Backup session backup_1714650289957 finished. Status: SUCCESS > put 'experiment', 'row6', 'fam:a', 'value6' > bin/hbase backup create incremental > file:/tmp/hbasebackup2024-05-02T13:45:27,534 ERROR [main {}] > impl.BackupManifest: file:/tmp/hbasebackup/backup_1714649920488 does not exist > 2024-05-02T13:45:27,534 ERROR [main {}] impl.TableBackupClient: Unexpected > Exception : file:/tmp/hbasebackup/backup_1714649920488 does not exist > org.apache.hadoop.hbase.backup.impl.BackupException: > file:/tmp/hbasebackup/backup_1714649920488 does not exist > Â Â at > org.apache.hadoop.hbase.backup.impl.BackupManifest.(BackupManifest.java:451) > ~[hbase-backup-2.6.1-SNAPSHOT.jar:2.6.1-SNAPSHOT] > Â Â at > org.apache.hadoop.hbase.backup.impl.BackupManifest.(BackupManifest.java:402) > ~[hbase-backup-2.6.1-SNAPSHOT.jar:2.6.1-SNAPSHOT] > Â Â at > org.apache.hadoop.hbase.backup.impl.BackupManager.getAncestors(BackupManager.java:331) > ~[hbase-backup-2.6.1-SNAPSHOT.jar:2.6.1-SNAPSHOT] > Â Â at > org.apache.hadoop.hbase.backup.impl.BackupManager.getAncestors(BackupManager.java:353) > ~[hbase-backup-2.6.1-SNAPSHOT.jar:2.6.1-SNAPSHOT] > Â Â at > org.apache.hadoop.hbase.backup.impl.TableBackupClient.addManifest(TableBackupClient.java:286) > ~[hbase-backup-2.6.1-SNAPSHOT.jar:2.6.1-SNAPSHOT] > Â Â at > org.apache.hadoop.hbase.backup.impl.TableBackupClient.completeBackup(TableBackupClient.java:351) > ~[hbase-backup-2.6.1-SNAPSHOT.jar:2.6.1-SNAPSHOT] > Â Â at > org.apache.hadoop.hbase.backup.impl.IncrementalTableBackupClient.execute(IncrementalTableBackupClient.java:314) > ~[hbase-backup-2.6.1-SNAPSHOT.jar:2.6.1-SNAPSHOT] > Â Â at > org.apache.
Re: [PR] HBASE-28562 Correct backup ancestor calculation [hbase]
rmdmattingly commented on code in PR #5868: URL: https://github.com/apache/hbase/pull/5868#discussion_r1587901054 ## hbase-backup/src/main/java/org/apache/hadoop/hbase/backup/impl/BackupManager.java: ## @@ -295,47 +295,10 @@ public ArrayList getAncestors(BackupInfo backupInfo) throws IOExcep .withRootDir(backup.getBackupRootDir()).withTableList(backup.getTableNames()) .withStartTime(backup.getStartTs()).withCompleteTime(backup.getCompleteTs()).build(); - // Only direct ancestors for a backup are required and not entire history of backup for this - // table resulting in verifying all of the previous backups which is unnecessary and backup - // paths need not be valid beyond the lifetime of a backup. - // - // RootDir is way of grouping a single backup including one full and many incremental backups - if (!image.getRootDir().equals(backupInfo.getBackupRootDir())) { -continue; - } - - // add the full backup image as an ancestor until the last incremental backup + LOG.debug("Dependent incremental backup image: {BackupID={}}", image.getBackupId()); + ancestors.add(image); if (backup.getType().equals(BackupType.FULL)) { -// check the backup image coverage, if previous image could be covered by the newer ones, -// then no need to add -if (!BackupManifest.canCoverImage(ancestors, image)) { - ancestors.add(image); -} - } else { -// found last incremental backup, if previously added full backup ancestor images can cover -// it, then this incremental ancestor is not the dependent of the current incremental -// backup, that is to say, this is the backup scope boundary of current table set. -// Otherwise, this incremental backup ancestor is the dependent ancestor of the ongoing -// incremental backup -if (BackupManifest.canCoverImage(ancestors, image)) { - LOG.debug("Met the backup boundary of the current table set:"); - for (BackupImage image1 : ancestors) { -LOG.debug(" BackupID={}, BackupDir={}", image1.getBackupId(), image1.getRootDir()); - } -} else { - Path logBackupPath = -HBackupFileSystem.getBackupPath(backup.getBackupRootDir(), backup.getBackupId()); - LOG.debug( -"Current backup has an incremental backup ancestor, " - + "touching its image manifest in {}" + " to construct the dependency.", -logBackupPath.toString()); - BackupManifest lastIncrImgManifest = new BackupManifest(conf, logBackupPath); - BackupImage lastIncrImage = lastIncrImgManifest.getBackupImage(); - ancestors.add(lastIncrImage); - - LOG.debug("Last dependent incremental backup image: {BackupID={}" + "BackupDir={}}", -lastIncrImage.getBackupId(), lastIncrImage.getRootDir()); -} +break; Review Comment: This break implies that we will only ever check for one ancestor? And what if the given image applies to a totally different table than our given backupInfo? -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Commented] (HBASE-28562) Ancestor calculation of backups is wrong
[ https://issues.apache.org/jira/browse/HBASE-28562?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17843012#comment-17843012 ] Ray Mattingly commented on HBASE-28562: --- I like the simplicity, but I think we're missing some necessary complexity. Backups may apply to some tables, but not others, and we need to fetch every ancestor, rather than just one. > Ancestor calculation of backups is wrong > > > Key: HBASE-28562 > URL: https://issues.apache.org/jira/browse/HBASE-28562 > Project: HBase > Issue Type: Bug > Components: backup&restore >Affects Versions: 2.6.0, 3.0.0 >Reporter: Dieter De Paepe >Priority: Major > Labels: pull-request-available > > This is the same issue as HBASE-25870, but I think the fix there was wrong. > This issue can prevent creation of (incremental) backups when data of > unrelated backups was damaged on backup storage. > Minimal example to reproduce from source: > * Add following to `conf/hbase-site.xml` to enable backups: > {code:java} > > hbase.backup.enable > true > > > hbase.master.logcleaner.plugins > > org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner,org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner,org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner,org.apache.hadoop.hbase.backup.master.BackupLogCleaner > > > hbase.procedure.master.classes > > org.apache.hadoop.hbase.backup.master.LogRollMasterProcedureManager > > > hbase.procedure.regionserver.classes > > org.apache.hadoop.hbase.backup.regionserver.LogRollRegionServerProcedureManager > > > hbase.coprocessor.region.classes > org.apache.hadoop.hbase.backup.BackupObserver > > > hbase.fs.tmp.dir > file:/tmp/hbase-tmp >{code} > * Start HBase and open a shell: {{{}bin/start-hbase.sh{}}}, {{bin/hbase > shell}} > * Execute following commands ("put" & "create" commands in hbase shell, > other commands in commandline): > * > {code:java} > create 'experiment', 'fam' > put 'experiment', 'row1', 'fam:b', 'value1' > bin/hbase backup create full file:/tmp/hbasebackup > Backup session backup_1714649896776 finished. Status: SUCCESS > put 'experiment', 'row2', 'fam:b', 'value2' > bin/hbase backup create incremental file:/tmp/hbasebackup > Backup session backup_1714649920488 finished. Status: SUCCESS > put 'experiment', 'row3', 'fam:b', 'value3' > bin/hbase backup create incremental file:/tmp/hbasebackup > Backup session backup_1714650054960 finished. Status: SUCCESS > (Delete the files corresponding to the first incremental backup - > backup_1714649920488 in this example) > put 'experiment', 'row4', 'fam:a', 'value4' > bin/hbase backup create full file:/tmp/hbasebackup > Backup session backup_1714650236911 finished. Status: SUCCESS > put 'experiment', 'row5', 'fam:a', 'value5' > bin/hbase backup create incremental file:/tmp/hbasebackup > Backup session backup_1714650289957 finished. Status: SUCCESS > put 'experiment', 'row6', 'fam:a', 'value6' > bin/hbase backup create incremental > file:/tmp/hbasebackup2024-05-02T13:45:27,534 ERROR [main {}] > impl.BackupManifest: file:/tmp/hbasebackup/backup_1714649920488 does not exist > 2024-05-02T13:45:27,534 ERROR [main {}] impl.TableBackupClient: Unexpected > Exception : file:/tmp/hbasebackup/backup_1714649920488 does not exist > org.apache.hadoop.hbase.backup.impl.BackupException: > file:/tmp/hbasebackup/backup_1714649920488 does not exist > Â Â at > org.apache.hadoop.hbase.backup.impl.BackupManifest.(BackupManifest.java:451) > ~[hbase-backup-2.6.1-SNAPSHOT.jar:2.6.1-SNAPSHOT] > Â Â at > org.apache.hadoop.hbase.backup.impl.BackupManifest.(BackupManifest.java:402) > ~[hbase-backup-2.6.1-SNAPSHOT.jar:2.6.1-SNAPSHOT] > Â Â at > org.apache.hadoop.hbase.backup.impl.BackupManager.getAncestors(BackupManager.java:331) > ~[hbase-backup-2.6.1-SNAPSHOT.jar:2.6.1-SNAPSHOT] > Â Â at > org.apache.hadoop.hbase.backup.impl.BackupManager.getAncestors(BackupManager.java:353) > ~[hbase-backup-2.6.1-SNAPSHOT.jar:2.6.1-SNAPSHOT] > Â Â at > org.apache.hadoop.hbase.backup.impl.TableBackupClient.addManifest(TableBackupClient.java:286) > ~[hbase-backup-2.6.1-SNAPSHOT.jar:2.6.1-SNAPSHOT] > Â Â at > org.apache.hadoop.hbase.backup.impl.TableBackupClient.completeBackup(TableBackupClient.java:351) > ~[hbase-backup-2.6.1-SNAPSHOT.jar:2.6.1-SNAPSHOT] > Â Â at > org.apache.hadoop.hbase.backup.impl.IncrementalTableBackupClient.execute(IncrementalTableBackupClient.java:314) > ~[hbase-backup-2.6.1-SNAPSHOT.jar:2.6.1-SNAPSHOT] > Â Â at > org.apache.hadoop.hbase.backup.impl.BackupAdminImpl.backupTables(BackupAdminImpl.java:603) > ~[hbase-backup-2.6.1-SNAPSHOT.jar:2.6.1-SNAPSHOT] > Â Â at > org.apache.hadoop.hbase.backup.impl.BackupCommands$CreateC
Re: [PR] HBASE-28562 Correct backup ancestor calculation [hbase]
Apache-HBase commented on PR #5868: URL: https://github.com/apache/hbase/pull/5868#issuecomment-2091004633 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m 36s | Docker mode activated. | ||| _ Prechecks _ | | +1 :green_heart: | dupname | 0m 0s | No case conflicting files found. | | +1 :green_heart: | hbaseanti | 0m 0s | Patch does not have any anti-patterns. | | +1 :green_heart: | @author | 0m 0s | The patch does not contain any @author tags. | ||| _ master Compile Tests _ | | +1 :green_heart: | mvninstall | 4m 2s | master passed | | +1 :green_heart: | compile | 0m 33s | master passed | | +1 :green_heart: | checkstyle | 0m 12s | master passed | | +1 :green_heart: | spotless | 1m 3s | branch has no errors when running spotless:check. | | +1 :green_heart: | spotbugs | 0m 41s | master passed | ||| _ Patch Compile Tests _ | | +1 :green_heart: | mvninstall | 3m 53s | the patch passed | | +1 :green_heart: | compile | 0m 31s | the patch passed | | +1 :green_heart: | javac | 0m 31s | the patch passed | | -0 :warning: | checkstyle | 0m 11s | hbase-backup: The patch generated 11 new + 0 unchanged - 0 fixed = 11 total (was 0) | | +1 :green_heart: | whitespace | 0m 0s | The patch has no whitespace issues. | | +1 :green_heart: | hadoopcheck | 7m 6s | Patch does not cause any errors with Hadoop 3.3.6. | | -1 :x: | spotless | 0m 42s | patch has 65 errors when running spotless:check, run spotless:apply to fix. | | +1 :green_heart: | spotbugs | 0m 39s | the patch passed | ||| _ Other Tests _ | | +1 :green_heart: | asflicense | 0m 12s | The patch does not generate ASF License warnings. | | | | 28m 23s | | | Subsystem | Report/Notes | |--:|:-| | Docker | ClientAPI=1.43 ServerAPI=1.43 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5868/1/artifact/yetus-general-check/output/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/5868 | | Optional Tests | dupname asflicense javac spotbugs hadoopcheck hbaseanti spotless checkstyle compile | | uname | Linux a3279aec1998 5.4.0-1103-aws #111~18.04.1-Ubuntu SMP Tue May 23 20:04:10 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | dev-support/hbase-personality.sh | | git revision | master / 3d66866f41 | | Default Java | Eclipse Adoptium-11.0.17+8 | | checkstyle | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5868/1/artifact/yetus-general-check/output/diff-checkstyle-hbase-backup.txt | | spotless | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5868/1/artifact/yetus-general-check/output/patch-spotless.txt | | Max. process+thread count | 78 (vs. ulimit of 3) | | modules | C: hbase-backup U: hbase-backup | | Console output | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5868/1/console | | versions | git=2.34.1 maven=3.8.6 spotbugs=4.7.3 | | Powered by | Apache Yetus 0.12.0 https://yetus.apache.org | This message was automatically generated. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [PR] HBASE-28562 Correct backup ancestor calculation [hbase]
Apache-HBase commented on PR #5868: URL: https://github.com/apache/hbase/pull/5868#issuecomment-2091034175 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 1m 38s | Docker mode activated. | | -0 :warning: | yetus | 0m 2s | Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck | ||| _ Prechecks _ | ||| _ master Compile Tests _ | | +1 :green_heart: | mvninstall | 3m 41s | master passed | | +1 :green_heart: | compile | 0m 23s | master passed | | +1 :green_heart: | shadedjars | 5m 35s | branch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 0m 16s | master passed | ||| _ Patch Compile Tests _ | | +1 :green_heart: | mvninstall | 3m 51s | the patch passed | | +1 :green_heart: | compile | 0m 27s | the patch passed | | +1 :green_heart: | javac | 0m 27s | the patch passed | | +1 :green_heart: | shadedjars | 7m 17s | patch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 0m 20s | the patch passed | ||| _ Other Tests _ | | +1 :green_heart: | unit | 11m 58s | hbase-backup in the patch passed. | | | | 36m 33s | | | Subsystem | Report/Notes | |--:|:-| | Docker | ClientAPI=1.45 ServerAPI=1.45 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5868/1/artifact/yetus-jdk17-hadoop3-check/output/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/5868 | | Optional Tests | javac javadoc unit shadedjars compile | | uname | Linux fbef03bc50b1 5.4.0-174-generic #193-Ubuntu SMP Thu Mar 7 14:29:28 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | dev-support/hbase-personality.sh | | git revision | master / 3d66866f41 | | Default Java | Eclipse Adoptium-17.0.10+7 | | Test Results | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5868/1/testReport/ | | Max. process+thread count | 3310 (vs. ulimit of 3) | | modules | C: hbase-backup U: hbase-backup | | Console output | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5868/1/console | | versions | git=2.34.1 maven=3.8.6 | | Powered by | Apache Yetus 0.12.0 https://yetus.apache.org | This message was automatically generated. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [PR] HBASE-28562 Correct backup ancestor calculation [hbase]
Apache-HBase commented on PR #5868: URL: https://github.com/apache/hbase/pull/5868#issuecomment-2091038972 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m 53s | Docker mode activated. | | -0 :warning: | yetus | 0m 3s | Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck | ||| _ Prechecks _ | ||| _ master Compile Tests _ | | +1 :green_heart: | mvninstall | 4m 19s | master passed | | +1 :green_heart: | compile | 0m 22s | master passed | | +1 :green_heart: | shadedjars | 6m 21s | branch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 0m 19s | master passed | ||| _ Patch Compile Tests _ | | +1 :green_heart: | mvninstall | 4m 4s | the patch passed | | +1 :green_heart: | compile | 0m 24s | the patch passed | | +1 :green_heart: | javac | 0m 24s | the patch passed | | +1 :green_heart: | shadedjars | 6m 17s | patch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 0m 20s | the patch passed | ||| _ Other Tests _ | | +1 :green_heart: | unit | 14m 44s | hbase-backup in the patch passed. | | | | 39m 8s | | | Subsystem | Report/Notes | |--:|:-| | Docker | ClientAPI=1.43 ServerAPI=1.43 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5868/1/artifact/yetus-jdk11-hadoop3-check/output/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/5868 | | Optional Tests | javac javadoc unit shadedjars compile | | uname | Linux 439028c9d952 5.4.0-1103-aws #111~18.04.1-Ubuntu SMP Tue May 23 20:04:10 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | dev-support/hbase-personality.sh | | git revision | master / 3d66866f41 | | Default Java | Eclipse Adoptium-11.0.17+8 | | Test Results | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5868/1/testReport/ | | Max. process+thread count | 3561 (vs. ulimit of 3) | | modules | C: hbase-backup U: hbase-backup | | Console output | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5868/1/console | | versions | git=2.34.1 maven=3.8.6 | | Powered by | Apache Yetus 0.12.0 https://yetus.apache.org | This message was automatically generated. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [PR] HBASE-28562 Correct backup ancestor calculation [hbase]
Apache-HBase commented on PR #5868: URL: https://github.com/apache/hbase/pull/5868#issuecomment-2091039497 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m 28s | Docker mode activated. | | -0 :warning: | yetus | 0m 3s | Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck | ||| _ Prechecks _ | ||| _ master Compile Tests _ | | +1 :green_heart: | mvninstall | 4m 10s | master passed | | +1 :green_heart: | compile | 0m 20s | master passed | | +1 :green_heart: | shadedjars | 6m 25s | branch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 0m 17s | master passed | ||| _ Patch Compile Tests _ | | +1 :green_heart: | mvninstall | 3m 45s | the patch passed | | +1 :green_heart: | compile | 0m 15s | the patch passed | | +1 :green_heart: | javac | 0m 15s | the patch passed | | +1 :green_heart: | shadedjars | 6m 17s | patch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 0m 13s | the patch passed | ||| _ Other Tests _ | | +1 :green_heart: | unit | 15m 40s | hbase-backup in the patch passed. | | | | 38m 55s | | | Subsystem | Report/Notes | |--:|:-| | Docker | ClientAPI=1.43 ServerAPI=1.43 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5868/1/artifact/yetus-jdk8-hadoop3-check/output/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/5868 | | Optional Tests | javac javadoc unit shadedjars compile | | uname | Linux 1952946232eb 5.4.0-1103-aws #111~18.04.1-Ubuntu SMP Tue May 23 20:04:10 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | dev-support/hbase-personality.sh | | git revision | master / 3d66866f41 | | Default Java | Temurin-1.8.0_352-b08 | | Test Results | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5868/1/testReport/ | | Max. process+thread count | 3122 (vs. ulimit of 3) | | modules | C: hbase-backup U: hbase-backup | | Console output | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5868/1/console | | versions | git=2.34.1 maven=3.8.6 | | Powered by | Apache Yetus 0.12.0 https://yetus.apache.org | This message was automatically generated. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [PR] HBASE-28469: Integration of time-based priority caching into compaction paths [hbase]
Apache-HBase commented on PR #5866: URL: https://github.com/apache/hbase/pull/5866#issuecomment-2091260654 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m 54s | Docker mode activated. | | -0 :warning: | yetus | 0m 3s | Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck | ||| _ Prechecks _ | ||| _ HBASE-28463 Compile Tests _ | | +1 :green_heart: | mvninstall | 4m 9s | HBASE-28463 passed | | +1 :green_heart: | compile | 0m 57s | HBASE-28463 passed | | +1 :green_heart: | shadedjars | 6m 26s | branch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 0m 31s | HBASE-28463 passed | ||| _ Patch Compile Tests _ | | +1 :green_heart: | mvninstall | 3m 27s | the patch passed | | +1 :green_heart: | compile | 0m 45s | the patch passed | | +1 :green_heart: | javac | 0m 45s | the patch passed | | +1 :green_heart: | shadedjars | 6m 24s | patch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 0m 26s | the patch passed | ||| _ Other Tests _ | | -1 :x: | unit | 263m 11s | hbase-server in the patch failed. | | | | 293m 23s | | | Subsystem | Report/Notes | |--:|:-| | Docker | ClientAPI=1.43 ServerAPI=1.43 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5866/1/artifact/yetus-jdk8-hadoop3-check/output/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/5866 | | JIRA Issue | HBASE-28469 | | Optional Tests | javac javadoc unit shadedjars compile | | uname | Linux 88bb009b42fd 5.4.0-1103-aws #111~18.04.1-Ubuntu SMP Tue May 23 20:04:10 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | dev-support/hbase-personality.sh | | git revision | HBASE-28463 / 4dee5324ae | | Default Java | Temurin-1.8.0_352-b08 | | unit | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5866/1/artifact/yetus-jdk8-hadoop3-check/output/patch-unit-hbase-server.txt | | Test Results | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5866/1/testReport/ | | Max. process+thread count | 5341 (vs. ulimit of 3) | | modules | C: hbase-server U: hbase-server | | Console output | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5866/1/console | | versions | git=2.34.1 maven=3.8.6 | | Powered by | Apache Yetus 0.12.0 https://yetus.apache.org | This message was automatically generated. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [PR] HBASE-28469: Integration of time-based priority caching into compaction paths [hbase]
Apache-HBase commented on PR #5866: URL: https://github.com/apache/hbase/pull/5866#issuecomment-2091350449 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m 27s | Docker mode activated. | ||| _ Prechecks _ | | +1 :green_heart: | dupname | 0m 0s | No case conflicting files found. | | +1 :green_heart: | hbaseanti | 0m 0s | Patch does not have any anti-patterns. | | +1 :green_heart: | @author | 0m 0s | The patch does not contain any @author tags. | ||| _ HBASE-28463 Compile Tests _ | | +1 :green_heart: | mvninstall | 3m 4s | HBASE-28463 passed | | +1 :green_heart: | compile | 2m 37s | HBASE-28463 passed | | +1 :green_heart: | checkstyle | 0m 37s | HBASE-28463 passed | | +1 :green_heart: | spotless | 0m 42s | branch has no errors when running spotless:check. | | +1 :green_heart: | spotbugs | 1m 30s | HBASE-28463 passed | ||| _ Patch Compile Tests _ | | +1 :green_heart: | mvninstall | 2m 56s | the patch passed | | +1 :green_heart: | compile | 2m 36s | the patch passed | | +1 :green_heart: | javac | 2m 36s | the patch passed | | +1 :green_heart: | checkstyle | 0m 36s | the patch passed | | +1 :green_heart: | whitespace | 0m 0s | The patch has no whitespace issues. | | +1 :green_heart: | hadoopcheck | 5m 33s | Patch does not cause any errors with Hadoop 3.3.6. | | +1 :green_heart: | spotless | 0m 42s | patch has no errors when running spotless:check. | | +1 :green_heart: | spotbugs | 1m 39s | the patch passed | ||| _ Other Tests _ | | +1 :green_heart: | asflicense | 0m 9s | The patch does not generate ASF License warnings. | | | | 29m 56s | | | Subsystem | Report/Notes | |--:|:-| | Docker | ClientAPI=1.43 ServerAPI=1.43 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5866/2/artifact/yetus-general-check/output/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/5866 | | JIRA Issue | HBASE-28469 | | Optional Tests | dupname asflicense javac spotbugs hadoopcheck hbaseanti spotless checkstyle compile | | uname | Linux f117fcdea789 5.4.0-1103-aws #111~18.04.1-Ubuntu SMP Tue May 23 20:04:10 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | dev-support/hbase-personality.sh | | git revision | HBASE-28463 / 4dee5324ae | | Default Java | Eclipse Adoptium-11.0.17+8 | | Max. process+thread count | 81 (vs. ulimit of 3) | | modules | C: hbase-server U: hbase-server | | Console output | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5866/2/console | | versions | git=2.34.1 maven=3.8.6 spotbugs=4.7.3 | | Powered by | Apache Yetus 0.12.0 https://yetus.apache.org | This message was automatically generated. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Commented] (HBASE-28558) Fix constructors for sub classes of Connection
[ https://issues.apache.org/jira/browse/HBASE-28558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17843062#comment-17843062 ] Hudson commented on HBASE-28558: Results for branch branch-3 [build #198 on builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-3/198/]: (x) *{color:red}-1 overall{color}* details (if available): (/) {color:green}+1 general checks{color} -- For more information [see general report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-3/198/General_20Nightly_20Build_20Report/] (x) {color:red}-1 jdk8 hadoop3 checks{color} -- For more information [see jdk8 (hadoop3) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-3/198/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 jdk11 hadoop3 checks{color} -- For more information [see jdk11 report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-3/198/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 source release artifact{color} -- See build output for details. (/) {color:green}+1 client integration test{color} > Fix constructors for sub classes of Connection > -- > > Key: HBASE-28558 > URL: https://issues.apache.org/jira/browse/HBASE-28558 > Project: HBase > Issue Type: Bug > Components: Client, test >Reporter: Duo Zhang >Assignee: Duo Zhang >Priority: Major > Labels: pull-request-available > Fix For: 2.7.0, 3.0.0-beta-2 > > > We still have some testing classes which implement Connection but do not have > constructors with ConnectionRegistry as parameter. > This lead to some test failures on branch-2.x, but we'd better also fix them > on master as well. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (HBASE-28521) Use standard ConnectionRegistry and Client API to get region server list in in replication
[ https://issues.apache.org/jira/browse/HBASE-28521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17843063#comment-17843063 ] Hudson commented on HBASE-28521: Results for branch branch-3 [build #198 on builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-3/198/]: (x) *{color:red}-1 overall{color}* details (if available): (/) {color:green}+1 general checks{color} -- For more information [see general report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-3/198/General_20Nightly_20Build_20Report/] (x) {color:red}-1 jdk8 hadoop3 checks{color} -- For more information [see jdk8 (hadoop3) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-3/198/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 jdk11 hadoop3 checks{color} -- For more information [see jdk11 report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-3/198/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 source release artifact{color} -- See build output for details. (/) {color:green}+1 client integration test{color} > Use standard ConnectionRegistry and Client API to get region server list in > in replication > -- > > Key: HBASE-28521 > URL: https://issues.apache.org/jira/browse/HBASE-28521 > Project: HBase > Issue Type: Improvement > Components: Replication >Reporter: Duo Zhang >Assignee: Duo Zhang >Priority: Major > Labels: pull-request-available > Fix For: 3.0.0-beta-2 > > > This is for allowing specify cluster key without zookeeper in replication > peer config. > For now, we will set a watcher on zookeeper for fetching the region server > list for the remote cluster, this means we must know the zookeeper address of > the remote cluster. This should be fixed as we do not want to leak the > zookeeper outside the cluster itself. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (HBASE-28558) Fix constructors for sub classes of Connection
[ https://issues.apache.org/jira/browse/HBASE-28558?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17843065#comment-17843065 ] Hudson commented on HBASE-28558: Results for branch master [build #1066 on builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/1066/]: (/) *{color:green}+1 overall{color}* details (if available): (/) {color:green}+1 general checks{color} -- For more information [see general report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/1066/General_20Nightly_20Build_20Report/] (/) {color:green}+1 jdk8 hadoop3 checks{color} -- For more information [see jdk8 (hadoop3) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/1066/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 jdk11 hadoop3 checks{color} -- For more information [see jdk11 report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/1066/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 source release artifact{color} -- See build output for details. (/) {color:green}+1 client integration test{color} > Fix constructors for sub classes of Connection > -- > > Key: HBASE-28558 > URL: https://issues.apache.org/jira/browse/HBASE-28558 > Project: HBase > Issue Type: Bug > Components: Client, test >Reporter: Duo Zhang >Assignee: Duo Zhang >Priority: Major > Labels: pull-request-available > Fix For: 2.7.0, 3.0.0-beta-2 > > > We still have some testing classes which implement Connection but do not have > constructors with ConnectionRegistry as parameter. > This lead to some test failures on branch-2.x, but we'd better also fix them > on master as well. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Commented] (HBASE-28521) Use standard ConnectionRegistry and Client API to get region server list in in replication
[ https://issues.apache.org/jira/browse/HBASE-28521?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17843066#comment-17843066 ] Hudson commented on HBASE-28521: Results for branch master [build #1066 on builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/1066/]: (/) *{color:green}+1 overall{color}* details (if available): (/) {color:green}+1 general checks{color} -- For more information [see general report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/1066/General_20Nightly_20Build_20Report/] (/) {color:green}+1 jdk8 hadoop3 checks{color} -- For more information [see jdk8 (hadoop3) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/1066/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 jdk11 hadoop3 checks{color} -- For more information [see jdk11 report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/master/1066/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 source release artifact{color} -- See build output for details. (/) {color:green}+1 client integration test{color} > Use standard ConnectionRegistry and Client API to get region server list in > in replication > -- > > Key: HBASE-28521 > URL: https://issues.apache.org/jira/browse/HBASE-28521 > Project: HBase > Issue Type: Improvement > Components: Replication >Reporter: Duo Zhang >Assignee: Duo Zhang >Priority: Major > Labels: pull-request-available > Fix For: 3.0.0-beta-2 > > > This is for allowing specify cluster key without zookeeper in replication > peer config. > For now, we will set a watcher on zookeeper for fetching the region server > list for the remote cluster, this means we must know the zookeeper address of > the remote cluster. This should be fixed as we do not want to leak the > zookeeper outside the cluster itself. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (HBASE-28563) Closing ZooKeeper in ZKMainServer
Minwoo Kang created HBASE-28563: --- Summary: Closing ZooKeeper in ZKMainServer Key: HBASE-28563 URL: https://issues.apache.org/jira/browse/HBASE-28563 Project: HBase Issue Type: Improvement Reporter: Minwoo Kang Users can switch the Zookeeper client/server communication framework to Netty. ZKMainServer process fails to terminate due to when users utilize Netty for ZooKeeper connections. Netty threads identified as non-Daemon threads. Enforce the calling of close() on ZooKeeper before ZKMainServer termination. -- This message was sent by Atlassian Jira (v8.20.10#820010)
Re: [PR] HBASE-27315 Add timeout to JavaRegexEngine [hbase]
Apache-HBase commented on PR #4720: URL: https://github.com/apache/hbase/pull/4720#issuecomment-2091959531 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m 32s | Docker mode activated. | | -0 :warning: | yetus | 0m 2s | Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck | ||| _ Prechecks _ | ||| _ master Compile Tests _ | | +0 :ok: | mvndep | 0m 13s | Maven dependency ordering for branch | | +1 :green_heart: | mvninstall | 2m 42s | master passed | | +1 :green_heart: | compile | 1m 10s | master passed | | +1 :green_heart: | shadedjars | 5m 39s | branch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 0m 50s | master passed | ||| _ Patch Compile Tests _ | | +0 :ok: | mvndep | 0m 11s | Maven dependency ordering for patch | | -1 :x: | mvninstall | 0m 33s | root in the patch failed. | | -1 :x: | compile | 0m 15s | hbase-client in the patch failed. | | -1 :x: | compile | 0m 24s | hbase-server in the patch failed. | | -0 :warning: | javac | 0m 15s | hbase-client in the patch failed. | | -0 :warning: | javac | 0m 24s | hbase-server in the patch failed. | | -1 :x: | shadedjars | 0m 46s | patch has 11 errors when building our shaded downstream artifacts. | | -0 :warning: | javadoc | 0m 13s | hbase-client generated 1 new + 30 unchanged - 0 fixed = 31 total (was 30) | | -0 :warning: | javadoc | 0m 22s | hbase-server generated 4 new + 22 unchanged - 0 fixed = 26 total (was 22) | ||| _ Other Tests _ | | -1 :x: | unit | 0m 15s | hbase-common in the patch failed. | | -1 :x: | unit | 0m 15s | hbase-client in the patch failed. | | -1 :x: | unit | 0m 25s | hbase-server in the patch failed. | | | | 16m 25s | | | Subsystem | Report/Notes | |--:|:-| | Docker | ClientAPI=1.43 ServerAPI=1.43 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4720/7/artifact/yetus-jdk8-hadoop3-check/output/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/4720 | | Optional Tests | javac javadoc unit shadedjars compile | | uname | Linux 561d297f9d82 5.4.0-1103-aws #111~18.04.1-Ubuntu SMP Tue May 23 20:04:10 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | dev-support/hbase-personality.sh | | git revision | master / 3d66866f41 | | Default Java | Temurin-1.8.0_352-b08 | | mvninstall | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4720/7/artifact/yetus-jdk8-hadoop3-check/output/patch-mvninstall-root.txt | | compile | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4720/7/artifact/yetus-jdk8-hadoop3-check/output/patch-compile-hbase-client.txt | | compile | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4720/7/artifact/yetus-jdk8-hadoop3-check/output/patch-compile-hbase-server.txt | | javac | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4720/7/artifact/yetus-jdk8-hadoop3-check/output/patch-compile-hbase-client.txt | | javac | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4720/7/artifact/yetus-jdk8-hadoop3-check/output/patch-compile-hbase-server.txt | | shadedjars | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4720/7/artifact/yetus-jdk8-hadoop3-check/output/patch-shadedjars.txt | | javadoc | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4720/7/artifact/yetus-jdk8-hadoop3-check/output/diff-javadoc-javadoc-hbase-client.txt | | javadoc | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4720/7/artifact/yetus-jdk8-hadoop3-check/output/diff-javadoc-javadoc-hbase-server.txt | | unit | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4720/7/artifact/yetus-jdk8-hadoop3-check/output/patch-unit-hbase-common.txt | | unit | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4720/7/artifact/yetus-jdk8-hadoop3-check/output/patch-unit-hbase-client.txt | | unit | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4720/7/artifact/yetus-jdk8-hadoop3-check/output/patch-unit-hbase-server.txt | | Test Results | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4720/7/testReport/ | | Max. process+thread count | 67 (vs. ulimit of 3) | | modules | C: hbase-common hbase-client hbase-server U: . | | Console output | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4720/7/console | | versions | git=2.34.1 maven=3.8.6 | | Powered by | Apache Yetus 0.12.0 https://yetus.apache.org | This message
Re: [PR] HBASE-27315 Add timeout to JavaRegexEngine [hbase]
Apache-HBase commented on PR #4720: URL: https://github.com/apache/hbase/pull/4720#issuecomment-2091960288 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m 12s | Docker mode activated. | | -0 :warning: | yetus | 0m 3s | Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck | ||| _ Prechecks _ | ||| _ master Compile Tests _ | | +0 :ok: | mvndep | 0m 11s | Maven dependency ordering for branch | | +1 :green_heart: | mvninstall | 2m 57s | master passed | | +1 :green_heart: | compile | 1m 36s | master passed | | +1 :green_heart: | shadedjars | 5m 15s | branch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 1m 4s | master passed | ||| _ Patch Compile Tests _ | | +0 :ok: | mvndep | 0m 11s | Maven dependency ordering for patch | | -1 :x: | mvninstall | 0m 45s | root in the patch failed. | | -1 :x: | compile | 0m 19s | hbase-client in the patch failed. | | -1 :x: | compile | 0m 34s | hbase-server in the patch failed. | | -0 :warning: | javac | 0m 19s | hbase-client in the patch failed. | | -0 :warning: | javac | 0m 34s | hbase-server in the patch failed. | | -1 :x: | shadedjars | 0m 57s | patch has 11 errors when building our shaded downstream artifacts. | | -0 :warning: | javadoc | 0m 18s | hbase-client generated 1 new + 26 unchanged - 0 fixed = 27 total (was 26) | | -0 :warning: | javadoc | 0m 28s | hbase-server generated 4 new + 48 unchanged - 0 fixed = 52 total (was 48) | ||| _ Other Tests _ | | -1 :x: | unit | 0m 20s | hbase-common in the patch failed. | | -1 :x: | unit | 0m 19s | hbase-client in the patch failed. | | -1 :x: | unit | 0m 34s | hbase-server in the patch failed. | | | | 17m 48s | | | Subsystem | Report/Notes | |--:|:-| | Docker | ClientAPI=1.45 ServerAPI=1.45 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4720/7/artifact/yetus-jdk17-hadoop3-check/output/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/4720 | | Optional Tests | javac javadoc unit shadedjars compile | | uname | Linux e873d37be03e 5.4.0-172-generic #190-Ubuntu SMP Fri Feb 2 23:24:22 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | dev-support/hbase-personality.sh | | git revision | master / 3d66866f41 | | Default Java | Eclipse Adoptium-17.0.10+7 | | mvninstall | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4720/7/artifact/yetus-jdk17-hadoop3-check/output/patch-mvninstall-root.txt | | compile | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4720/7/artifact/yetus-jdk17-hadoop3-check/output/patch-compile-hbase-client.txt | | compile | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4720/7/artifact/yetus-jdk17-hadoop3-check/output/patch-compile-hbase-server.txt | | javac | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4720/7/artifact/yetus-jdk17-hadoop3-check/output/patch-compile-hbase-client.txt | | javac | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4720/7/artifact/yetus-jdk17-hadoop3-check/output/patch-compile-hbase-server.txt | | shadedjars | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4720/7/artifact/yetus-jdk17-hadoop3-check/output/patch-shadedjars.txt | | javadoc | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4720/7/artifact/yetus-jdk17-hadoop3-check/output/diff-javadoc-javadoc-hbase-client.txt | | javadoc | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4720/7/artifact/yetus-jdk17-hadoop3-check/output/diff-javadoc-javadoc-hbase-server.txt | | unit | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4720/7/artifact/yetus-jdk17-hadoop3-check/output/patch-unit-hbase-common.txt | | unit | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4720/7/artifact/yetus-jdk17-hadoop3-check/output/patch-unit-hbase-client.txt | | unit | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4720/7/artifact/yetus-jdk17-hadoop3-check/output/patch-unit-hbase-server.txt | | Test Results | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4720/7/testReport/ | | Max. process+thread count | 76 (vs. ulimit of 3) | | modules | C: hbase-common hbase-client hbase-server U: . | | Console output | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4720/7/console | | versions | git=2.34.1 maven=3.8.6 | | Powered by | Apache Yetus 0.12.0 https://yetus.apache.org | Th
Re: [PR] HBASE-27315 Add timeout to JavaRegexEngine [hbase]
Apache-HBase commented on PR #4720: URL: https://github.com/apache/hbase/pull/4720#issuecomment-2091960324 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m 31s | Docker mode activated. | | -0 :warning: | yetus | 0m 3s | Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck | ||| _ Prechecks _ | ||| _ master Compile Tests _ | | +0 :ok: | mvndep | 0m 11s | Maven dependency ordering for branch | | +1 :green_heart: | mvninstall | 2m 57s | master passed | | +1 :green_heart: | compile | 1m 29s | master passed | | +1 :green_heart: | shadedjars | 5m 15s | branch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 1m 1s | master passed | ||| _ Patch Compile Tests _ | | +0 :ok: | mvndep | 0m 14s | Maven dependency ordering for patch | | -1 :x: | mvninstall | 0m 45s | root in the patch failed. | | -1 :x: | compile | 0m 17s | hbase-client in the patch failed. | | -1 :x: | compile | 0m 31s | hbase-server in the patch failed. | | -0 :warning: | javac | 0m 17s | hbase-client in the patch failed. | | -0 :warning: | javac | 0m 31s | hbase-server in the patch failed. | | -1 :x: | shadedjars | 0m 57s | patch has 11 errors when building our shaded downstream artifacts. | | -0 :warning: | javadoc | 0m 17s | hbase-client generated 1 new + 44 unchanged - 0 fixed = 45 total (was 44) | | -0 :warning: | javadoc | 0m 26s | hbase-server generated 4 new + 93 unchanged - 3 fixed = 97 total (was 96) | ||| _ Other Tests _ | | -1 :x: | unit | 0m 19s | hbase-common in the patch failed. | | -1 :x: | unit | 0m 18s | hbase-client in the patch failed. | | -1 :x: | unit | 0m 30s | hbase-server in the patch failed. | | | | 17m 51s | | | Subsystem | Report/Notes | |--:|:-| | Docker | ClientAPI=1.45 ServerAPI=1.45 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4720/7/artifact/yetus-jdk11-hadoop3-check/output/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/4720 | | Optional Tests | javac javadoc unit shadedjars compile | | uname | Linux 585d10662f5c 5.4.0-172-generic #190-Ubuntu SMP Fri Feb 2 23:24:22 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | dev-support/hbase-personality.sh | | git revision | master / 3d66866f41 | | Default Java | Eclipse Adoptium-11.0.17+8 | | mvninstall | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4720/7/artifact/yetus-jdk11-hadoop3-check/output/patch-mvninstall-root.txt | | compile | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4720/7/artifact/yetus-jdk11-hadoop3-check/output/patch-compile-hbase-client.txt | | compile | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4720/7/artifact/yetus-jdk11-hadoop3-check/output/patch-compile-hbase-server.txt | | javac | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4720/7/artifact/yetus-jdk11-hadoop3-check/output/patch-compile-hbase-client.txt | | javac | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4720/7/artifact/yetus-jdk11-hadoop3-check/output/patch-compile-hbase-server.txt | | shadedjars | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4720/7/artifact/yetus-jdk11-hadoop3-check/output/patch-shadedjars.txt | | javadoc | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4720/7/artifact/yetus-jdk11-hadoop3-check/output/diff-javadoc-javadoc-hbase-client.txt | | javadoc | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4720/7/artifact/yetus-jdk11-hadoop3-check/output/diff-javadoc-javadoc-hbase-server.txt | | unit | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4720/7/artifact/yetus-jdk11-hadoop3-check/output/patch-unit-hbase-common.txt | | unit | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4720/7/artifact/yetus-jdk11-hadoop3-check/output/patch-unit-hbase-client.txt | | unit | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4720/7/artifact/yetus-jdk11-hadoop3-check/output/patch-unit-hbase-server.txt | | Test Results | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4720/7/testReport/ | | Max. process+thread count | 81 (vs. ulimit of 3) | | modules | C: hbase-common hbase-client hbase-server U: . | | Console output | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4720/7/console | | versions | git=2.34.1 maven=3.8.6 | | Powered by | Apache Yetus 0.12.0 https://yetus.apache.org | Th
Re: [PR] HBASE-27315 Add timeout to JavaRegexEngine [hbase]
Apache-HBase commented on PR #4720: URL: https://github.com/apache/hbase/pull/4720#issuecomment-2091962281 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m 57s | Docker mode activated. | ||| _ Prechecks _ | | +1 :green_heart: | dupname | 0m 0s | No case conflicting files found. | | +1 :green_heart: | hbaseanti | 0m 1s | Patch does not have any anti-patterns. | | +1 :green_heart: | @author | 0m 0s | The patch does not contain any @author tags. | ||| _ master Compile Tests _ | | +0 :ok: | mvndep | 0m 13s | Maven dependency ordering for branch | | +1 :green_heart: | mvninstall | 3m 13s | master passed | | +1 :green_heart: | compile | 4m 39s | master passed | | +1 :green_heart: | checkstyle | 1m 12s | master passed | | +1 :green_heart: | spotless | 0m 44s | branch has no errors when running spotless:check. | | +1 :green_heart: | spotbugs | 2m 47s | master passed | ||| _ Patch Compile Tests _ | | +0 :ok: | mvndep | 0m 12s | Maven dependency ordering for patch | | -1 :x: | mvninstall | 0m 44s | root in the patch failed. | | -1 :x: | compile | 0m 17s | hbase-client in the patch failed. | | -1 :x: | compile | 0m 28s | hbase-server in the patch failed. | | -0 :warning: | javac | 0m 17s | hbase-client in the patch failed. | | -0 :warning: | javac | 0m 28s | hbase-server in the patch failed. | | -0 :warning: | checkstyle | 0m 13s | hbase-common: The patch generated 1 new + 0 unchanged - 0 fixed = 1 total (was 0) | | +1 :green_heart: | whitespace | 0m 0s | The patch has no whitespace issues. | | -1 :x: | hadoopcheck | 0m 49s | The patch causes 11 errors with Hadoop v3.3.6. | | -1 :x: | spotless | 0m 12s | patch has 33 errors when running spotless:check, run spotless:apply to fix. | | -1 :x: | spotbugs | 0m 16s | hbase-client in the patch failed. | | -1 :x: | spotbugs | 0m 27s | hbase-server in the patch failed. | ||| _ Other Tests _ | | +1 :green_heart: | asflicense | 0m 23s | The patch does not generate ASF License warnings. | | | | 21m 23s | | | Subsystem | Report/Notes | |--:|:-| | Docker | ClientAPI=1.45 ServerAPI=1.45 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4720/7/artifact/yetus-general-check/output/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/4720 | | Optional Tests | dupname asflicense javac spotbugs hadoopcheck hbaseanti spotless checkstyle compile | | uname | Linux 6d8c352a1292 5.4.0-174-generic #193-Ubuntu SMP Thu Mar 7 14:29:28 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | dev-support/hbase-personality.sh | | git revision | master / 3d66866f41 | | Default Java | Eclipse Adoptium-11.0.17+8 | | mvninstall | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4720/7/artifact/yetus-general-check/output/patch-mvninstall-root.txt | | compile | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4720/7/artifact/yetus-general-check/output/patch-compile-hbase-client.txt | | compile | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4720/7/artifact/yetus-general-check/output/patch-compile-hbase-server.txt | | javac | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4720/7/artifact/yetus-general-check/output/patch-compile-hbase-client.txt | | javac | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4720/7/artifact/yetus-general-check/output/patch-compile-hbase-server.txt | | checkstyle | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4720/7/artifact/yetus-general-check/output/diff-checkstyle-hbase-common.txt | | hadoopcheck | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4720/7/artifact/yetus-general-check/output/patch-javac-3.3.6.txt | | spotless | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4720/7/artifact/yetus-general-check/output/patch-spotless.txt | | spotbugs | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4720/7/artifact/yetus-general-check/output/patch-spotbugs-hbase-client.txt | | spotbugs | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4720/7/artifact/yetus-general-check/output/patch-spotbugs-hbase-server.txt | | Max. process+thread count | 80 (vs. ulimit of 3) | | modules | C: hbase-common hbase-client hbase-server U: . | | Console output | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4720/7/console | | versions | git=2.34.1 maven=3.8.6 spotbugs=4.7.3 | | Powered by | Apache Yetus 0.12.0 https://yetus.apache.org | This message was automat
[PR] HBASE-28563 Closing ZooKeeper in ZKMainServer [hbase]
mwkang opened a new pull request, #5869: URL: https://github.com/apache/hbase/pull/5869 [HBASE-28563](https://issues.apache.org/jira/browse/HBASE-28563) - Add `close` to HACK_UNTIL_ZOOKEEPER_1897_ZooKeeperMain - Close the ZooKeeper when a timeout occurs -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Updated] (HBASE-28563) Closing ZooKeeper in ZKMainServer
[ https://issues.apache.org/jira/browse/HBASE-28563?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] ASF GitHub Bot updated HBASE-28563: --- Labels: pull-request-available (was: ) > Closing ZooKeeper in ZKMainServer > - > > Key: HBASE-28563 > URL: https://issues.apache.org/jira/browse/HBASE-28563 > Project: HBase > Issue Type: Improvement >Reporter: Minwoo Kang >Priority: Minor > Labels: pull-request-available > > Users can switch the Zookeeper client/server communication framework to Netty. > ZKMainServer process fails to terminate due to when users utilize Netty for > ZooKeeper connections. > Netty threads identified as non-Daemon threads. > Enforce the calling of close() on ZooKeeper before ZKMainServer termination. -- This message was sent by Atlassian Jira (v8.20.10#820010)
Re: [PR] HBASE-28563 Closing ZooKeeper in ZKMainServer [hbase]
Apache-HBase commented on PR #5869: URL: https://github.com/apache/hbase/pull/5869#issuecomment-2092001084 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m 31s | Docker mode activated. | | -0 :warning: | yetus | 0m 3s | Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck | ||| _ Prechecks _ | ||| _ master Compile Tests _ | | +0 :ok: | mvndep | 0m 11s | Maven dependency ordering for branch | | +1 :green_heart: | mvninstall | 2m 54s | master passed | | +1 :green_heart: | compile | 0m 35s | master passed | | +1 :green_heart: | shadedjars | 5m 17s | branch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 0m 32s | master passed | ||| _ Patch Compile Tests _ | | +0 :ok: | mvndep | 0m 14s | Maven dependency ordering for patch | | +1 :green_heart: | mvninstall | 2m 44s | the patch passed | | +1 :green_heart: | compile | 0m 35s | the patch passed | | +1 :green_heart: | javac | 0m 35s | the patch passed | | +1 :green_heart: | shadedjars | 5m 16s | patch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 0m 30s | the patch passed | ||| _ Other Tests _ | | +1 :green_heart: | unit | 1m 36s | hbase-client in the patch passed. | | +1 :green_heart: | unit | 0m 42s | hbase-zookeeper in the patch passed. | | | | 22m 54s | | | Subsystem | Report/Notes | |--:|:-| | Docker | ClientAPI=1.45 ServerAPI=1.45 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5869/1/artifact/yetus-jdk11-hadoop3-check/output/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/5869 | | Optional Tests | javac javadoc unit shadedjars compile | | uname | Linux c128173d4163 5.4.0-172-generic #190-Ubuntu SMP Fri Feb 2 23:24:22 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | dev-support/hbase-personality.sh | | git revision | master / 3d66866f41 | | Default Java | Eclipse Adoptium-11.0.17+8 | | Test Results | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5869/1/testReport/ | | Max. process+thread count | 308 (vs. ulimit of 3) | | modules | C: hbase-client hbase-zookeeper U: . | | Console output | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5869/1/console | | versions | git=2.34.1 maven=3.8.6 | | Powered by | Apache Yetus 0.12.0 https://yetus.apache.org | This message was automatically generated. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [PR] HBASE-28563 Closing ZooKeeper in ZKMainServer [hbase]
Apache-HBase commented on PR #5869: URL: https://github.com/apache/hbase/pull/5869#issuecomment-2092001331 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m 27s | Docker mode activated. | | -0 :warning: | yetus | 0m 2s | Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck | ||| _ Prechecks _ | ||| _ master Compile Tests _ | | +0 :ok: | mvndep | 0m 12s | Maven dependency ordering for branch | | +1 :green_heart: | mvninstall | 2m 38s | master passed | | +1 :green_heart: | compile | 0m 28s | master passed | | +1 :green_heart: | shadedjars | 5m 41s | branch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 0m 24s | master passed | ||| _ Patch Compile Tests _ | | +0 :ok: | mvndep | 0m 12s | Maven dependency ordering for patch | | +1 :green_heart: | mvninstall | 2m 25s | the patch passed | | +1 :green_heart: | compile | 0m 28s | the patch passed | | +1 :green_heart: | javac | 0m 28s | the patch passed | | +1 :green_heart: | shadedjars | 5m 59s | patch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 0m 32s | the patch passed | ||| _ Other Tests _ | | +1 :green_heart: | unit | 1m 43s | hbase-client in the patch passed. | | +1 :green_heart: | unit | 0m 45s | hbase-zookeeper in the patch passed. | | | | 23m 11s | | | Subsystem | Report/Notes | |--:|:-| | Docker | ClientAPI=1.43 ServerAPI=1.43 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5869/1/artifact/yetus-jdk8-hadoop3-check/output/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/5869 | | Optional Tests | javac javadoc unit shadedjars compile | | uname | Linux ed1f1e66ad70 5.4.0-1103-aws #111~18.04.1-Ubuntu SMP Tue May 23 20:04:10 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | dev-support/hbase-personality.sh | | git revision | master / 3d66866f41 | | Default Java | Temurin-1.8.0_352-b08 | | Test Results | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5869/1/testReport/ | | Max. process+thread count | 286 (vs. ulimit of 3) | | modules | C: hbase-client hbase-zookeeper U: . | | Console output | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5869/1/console | | versions | git=2.34.1 maven=3.8.6 | | Powered by | Apache Yetus 0.12.0 https://yetus.apache.org | This message was automatically generated. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [PR] HBASE-28563 Closing ZooKeeper in ZKMainServer [hbase]
Apache-HBase commented on PR #5869: URL: https://github.com/apache/hbase/pull/5869#issuecomment-2092001814 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m 26s | Docker mode activated. | | -0 :warning: | yetus | 0m 2s | Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck | ||| _ Prechecks _ | ||| _ master Compile Tests _ | | +0 :ok: | mvndep | 0m 16s | Maven dependency ordering for branch | | +1 :green_heart: | mvninstall | 3m 16s | master passed | | +1 :green_heart: | compile | 0m 34s | master passed | | +1 :green_heart: | shadedjars | 5m 46s | branch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 0m 28s | master passed | ||| _ Patch Compile Tests _ | | +0 :ok: | mvndep | 0m 11s | Maven dependency ordering for patch | | +1 :green_heart: | mvninstall | 2m 59s | the patch passed | | +1 :green_heart: | compile | 0m 34s | the patch passed | | +1 :green_heart: | javac | 0m 34s | the patch passed | | +1 :green_heart: | shadedjars | 5m 44s | patch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 0m 26s | the patch passed | ||| _ Other Tests _ | | +1 :green_heart: | unit | 1m 34s | hbase-client in the patch passed. | | +1 :green_heart: | unit | 0m 39s | hbase-zookeeper in the patch passed. | | | | 24m 7s | | | Subsystem | Report/Notes | |--:|:-| | Docker | ClientAPI=1.43 ServerAPI=1.43 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5869/1/artifact/yetus-jdk17-hadoop3-check/output/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/5869 | | Optional Tests | javac javadoc unit shadedjars compile | | uname | Linux 4b3b157d5dab 5.4.0-1103-aws #111~18.04.1-Ubuntu SMP Tue May 23 20:04:10 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | dev-support/hbase-personality.sh | | git revision | master / 3d66866f41 | | Default Java | Eclipse Adoptium-17.0.10+7 | | Test Results | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5869/1/testReport/ | | Max. process+thread count | 327 (vs. ulimit of 3) | | modules | C: hbase-client hbase-zookeeper U: . | | Console output | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5869/1/console | | versions | git=2.34.1 maven=3.8.6 | | Powered by | Apache Yetus 0.12.0 https://yetus.apache.org | This message was automatically generated. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [PR] HBASE-28563 Closing ZooKeeper in ZKMainServer [hbase]
Apache-HBase commented on PR #5869: URL: https://github.com/apache/hbase/pull/5869#issuecomment-2092002400 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m 55s | Docker mode activated. | ||| _ Prechecks _ | | +1 :green_heart: | dupname | 0m 0s | No case conflicting files found. | | +1 :green_heart: | hbaseanti | 0m 0s | Patch does not have any anti-patterns. | | +1 :green_heart: | @author | 0m 0s | The patch does not contain any @author tags. | ||| _ master Compile Tests _ | | +0 :ok: | mvndep | 0m 10s | Maven dependency ordering for branch | | +1 :green_heart: | mvninstall | 2m 57s | master passed | | +1 :green_heart: | compile | 1m 4s | master passed | | +1 :green_heart: | checkstyle | 0m 27s | master passed | | +1 :green_heart: | spotless | 0m 44s | branch has no errors when running spotless:check. | | +1 :green_heart: | spotbugs | 1m 9s | master passed | ||| _ Patch Compile Tests _ | | +0 :ok: | mvndep | 0m 11s | Maven dependency ordering for patch | | +1 :green_heart: | mvninstall | 2m 45s | the patch passed | | +1 :green_heart: | compile | 1m 2s | the patch passed | | +1 :green_heart: | javac | 1m 2s | the patch passed | | +1 :green_heart: | checkstyle | 0m 25s | the patch passed | | +1 :green_heart: | whitespace | 0m 0s | The patch has no whitespace issues. | | +1 :green_heart: | hadoopcheck | 4m 57s | Patch does not cause any errors with Hadoop 3.3.6. | | -1 :x: | spotless | 0m 20s | patch has 31 errors when running spotless:check, run spotless:apply to fix. | | +1 :green_heart: | spotbugs | 1m 22s | the patch passed | ||| _ Other Tests _ | | +1 :green_heart: | asflicense | 0m 20s | The patch does not generate ASF License warnings. | | | | 25m 11s | | | Subsystem | Report/Notes | |--:|:-| | Docker | ClientAPI=1.45 ServerAPI=1.45 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5869/1/artifact/yetus-general-check/output/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/5869 | | Optional Tests | dupname asflicense javac spotbugs hadoopcheck hbaseanti spotless checkstyle compile | | uname | Linux a22ffb18a0df 5.4.0-174-generic #193-Ubuntu SMP Thu Mar 7 14:29:28 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | dev-support/hbase-personality.sh | | git revision | master / 3d66866f41 | | Default Java | Eclipse Adoptium-11.0.17+8 | | spotless | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5869/1/artifact/yetus-general-check/output/patch-spotless.txt | | Max. process+thread count | 77 (vs. ulimit of 3) | | modules | C: hbase-client hbase-zookeeper U: . | | Console output | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5869/1/console | | versions | git=2.34.1 maven=3.8.6 spotbugs=4.7.3 | | Powered by | Apache Yetus 0.12.0 https://yetus.apache.org | This message was automatically generated. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [PR] HBASE-27315 Add timeout to JavaRegexEngine [hbase]
Apache-HBase commented on PR #4720: URL: https://github.com/apache/hbase/pull/4720#issuecomment-2092018361 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m 50s | Docker mode activated. | ||| _ Prechecks _ | | +1 :green_heart: | dupname | 0m 0s | No case conflicting files found. | | +1 :green_heart: | hbaseanti | 0m 0s | Patch does not have any anti-patterns. | | +1 :green_heart: | @author | 0m 0s | The patch does not contain any @author tags. | ||| _ master Compile Tests _ | | +0 :ok: | mvndep | 0m 11s | Maven dependency ordering for branch | | +1 :green_heart: | mvninstall | 3m 2s | master passed | | +1 :green_heart: | compile | 4m 39s | master passed | | +1 :green_heart: | checkstyle | 1m 11s | master passed | | +1 :green_heart: | spotless | 0m 44s | branch has no errors when running spotless:check. | | +1 :green_heart: | spotbugs | 2m 46s | master passed | ||| _ Patch Compile Tests _ | | +0 :ok: | mvndep | 0m 12s | Maven dependency ordering for patch | | +1 :green_heart: | mvninstall | 2m 46s | the patch passed | | +1 :green_heart: | compile | 3m 56s | the patch passed | | +1 :green_heart: | javac | 3m 56s | the patch passed | | -0 :warning: | checkstyle | 0m 15s | hbase-common: The patch generated 1 new + 0 unchanged - 0 fixed = 1 total (was 0) | | +1 :green_heart: | whitespace | 0m 0s | The patch has no whitespace issues. | | +1 :green_heart: | hadoopcheck | 4m 55s | Patch does not cause any errors with Hadoop 3.3.6. | | -1 :x: | spotless | 0m 15s | patch has 29 errors when running spotless:check, run spotless:apply to fix. | | +1 :green_heart: | spotbugs | 3m 10s | the patch passed | ||| _ Other Tests _ | | +1 :green_heart: | asflicense | 0m 30s | The patch does not generate ASF License warnings. | | | | 37m 5s | | | Subsystem | Report/Notes | |--:|:-| | Docker | ClientAPI=1.45 ServerAPI=1.45 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4720/8/artifact/yetus-general-check/output/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/4720 | | Optional Tests | dupname asflicense javac spotbugs hadoopcheck hbaseanti spotless checkstyle compile | | uname | Linux 067827925dc4 5.4.0-174-generic #193-Ubuntu SMP Thu Mar 7 14:29:28 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | dev-support/hbase-personality.sh | | git revision | master / 3d66866f41 | | Default Java | Eclipse Adoptium-11.0.17+8 | | checkstyle | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4720/8/artifact/yetus-general-check/output/diff-checkstyle-hbase-common.txt | | spotless | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4720/8/artifact/yetus-general-check/output/patch-spotless.txt | | Max. process+thread count | 82 (vs. ulimit of 3) | | modules | C: hbase-common hbase-client hbase-server U: . | | Console output | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4720/8/console | | versions | git=2.34.1 maven=3.8.6 spotbugs=4.7.3 | | Powered by | Apache Yetus 0.12.0 https://yetus.apache.org | This message was automatically generated. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [PR] HBASE-28469: Integration of time-based priority caching into compaction paths [hbase]
Apache-HBase commented on PR #5866: URL: https://github.com/apache/hbase/pull/5866#issuecomment-2092275992 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m 53s | Docker mode activated. | ||| _ Prechecks _ | | +1 :green_heart: | dupname | 0m 0s | No case conflicting files found. | | +1 :green_heart: | hbaseanti | 0m 0s | Patch does not have any anti-patterns. | | +1 :green_heart: | @author | 0m 0s | The patch does not contain any @author tags. | ||| _ HBASE-28463 Compile Tests _ | | +1 :green_heart: | mvninstall | 3m 17s | HBASE-28463 passed | | +1 :green_heart: | compile | 2m 35s | HBASE-28463 passed | | +1 :green_heart: | checkstyle | 0m 38s | HBASE-28463 passed | | +1 :green_heart: | spotless | 0m 44s | branch has no errors when running spotless:check. | | +1 :green_heart: | spotbugs | 1m 32s | HBASE-28463 passed | ||| _ Patch Compile Tests _ | | +1 :green_heart: | mvninstall | 2m 49s | the patch passed | | +1 :green_heart: | compile | 2m 35s | the patch passed | | +1 :green_heart: | javac | 2m 35s | the patch passed | | +1 :green_heart: | checkstyle | 0m 35s | the patch passed | | +1 :green_heart: | whitespace | 0m 0s | The patch has no whitespace issues. | | +1 :green_heart: | hadoopcheck | 5m 26s | Patch does not cause any errors with Hadoop 3.3.6. | | +1 :green_heart: | spotless | 0m 41s | patch has no errors when running spotless:check. | | +1 :green_heart: | spotbugs | 1m 35s | the patch passed | ||| _ Other Tests _ | | +1 :green_heart: | asflicense | 0m 10s | The patch does not generate ASF License warnings. | | | | 30m 13s | | | Subsystem | Report/Notes | |--:|:-| | Docker | ClientAPI=1.43 ServerAPI=1.43 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5866/3/artifact/yetus-general-check/output/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/5866 | | JIRA Issue | HBASE-28469 | | Optional Tests | dupname asflicense javac spotbugs hadoopcheck hbaseanti spotless checkstyle compile | | uname | Linux a23664a3be12 5.4.0-1103-aws #111~18.04.1-Ubuntu SMP Tue May 23 20:04:10 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | dev-support/hbase-personality.sh | | git revision | HBASE-28463 / 4dee5324ae | | Default Java | Eclipse Adoptium-11.0.17+8 | | Max. process+thread count | 79 (vs. ulimit of 3) | | modules | C: hbase-server U: hbase-server | | Console output | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-5866/3/console | | versions | git=2.34.1 maven=3.8.6 spotbugs=4.7.3 | | Powered by | Apache Yetus 0.12.0 https://yetus.apache.org | This message was automatically generated. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [PR] HBASE-27315 Add timeout to JavaRegexEngine [hbase]
Apache-HBase commented on PR #4720: URL: https://github.com/apache/hbase/pull/4720#issuecomment-2092319459 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m 11s | Docker mode activated. | | -0 :warning: | yetus | 0m 3s | Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck | ||| _ Prechecks _ | ||| _ master Compile Tests _ | | +0 :ok: | mvndep | 0m 9s | Maven dependency ordering for branch | | +1 :green_heart: | mvninstall | 2m 46s | master passed | | +1 :green_heart: | compile | 1m 37s | master passed | | +1 :green_heart: | shadedjars | 5m 13s | branch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 1m 3s | master passed | ||| _ Patch Compile Tests _ | | +0 :ok: | mvndep | 0m 12s | Maven dependency ordering for patch | | +1 :green_heart: | mvninstall | 2m 47s | the patch passed | | +1 :green_heart: | compile | 1m 36s | the patch passed | | +1 :green_heart: | javac | 1m 36s | the patch passed | | +1 :green_heart: | shadedjars | 5m 11s | patch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 1m 3s | the patch passed | ||| _ Other Tests _ | | +1 :green_heart: | unit | 2m 16s | hbase-common in the patch passed. | | -1 :x: | unit | 1m 22s | hbase-client in the patch failed. | | +1 :green_heart: | unit | 215m 21s | hbase-server in the patch passed. | | | | 246m 15s | | | Subsystem | Report/Notes | |--:|:-| | Docker | ClientAPI=1.45 ServerAPI=1.45 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4720/8/artifact/yetus-jdk17-hadoop3-check/output/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/4720 | | Optional Tests | javac javadoc unit shadedjars compile | | uname | Linux 236049d97a32 5.4.0-172-generic #190-Ubuntu SMP Fri Feb 2 23:24:22 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | dev-support/hbase-personality.sh | | git revision | master / 3d66866f41 | | Default Java | Eclipse Adoptium-17.0.10+7 | | unit | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4720/8/artifact/yetus-jdk17-hadoop3-check/output/patch-unit-hbase-client.txt | | Test Results | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4720/8/testReport/ | | Max. process+thread count | 5741 (vs. ulimit of 3) | | modules | C: hbase-common hbase-client hbase-server U: . | | Console output | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4720/8/console | | versions | git=2.34.1 maven=3.8.6 | | Powered by | Apache Yetus 0.12.0 https://yetus.apache.org | This message was automatically generated. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [PR] HBASE-27315 Add timeout to JavaRegexEngine [hbase]
Apache-HBase commented on PR #4720: URL: https://github.com/apache/hbase/pull/4720#issuecomment-2092343060 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m 42s | Docker mode activated. | | -0 :warning: | yetus | 0m 2s | Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck | ||| _ Prechecks _ | ||| _ master Compile Tests _ | | +0 :ok: | mvndep | 0m 14s | Maven dependency ordering for branch | | +1 :green_heart: | mvninstall | 3m 27s | master passed | | +1 :green_heart: | compile | 1m 20s | master passed | | +1 :green_heart: | shadedjars | 5m 41s | branch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 0m 49s | master passed | ||| _ Patch Compile Tests _ | | +0 :ok: | mvndep | 0m 12s | Maven dependency ordering for patch | | +1 :green_heart: | mvninstall | 2m 22s | the patch passed | | +1 :green_heart: | compile | 1m 10s | the patch passed | | +1 :green_heart: | javac | 1m 10s | the patch passed | | +1 :green_heart: | shadedjars | 5m 38s | patch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 0m 47s | the patch passed | ||| _ Other Tests _ | | +1 :green_heart: | unit | 2m 17s | hbase-common in the patch passed. | | +1 :green_heart: | unit | 1m 19s | hbase-client in the patch passed. | | +1 :green_heart: | unit | 227m 57s | hbase-server in the patch passed. | | | | 259m 3s | | | Subsystem | Report/Notes | |--:|:-| | Docker | ClientAPI=1.43 ServerAPI=1.43 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4720/8/artifact/yetus-jdk8-hadoop3-check/output/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/4720 | | Optional Tests | javac javadoc unit shadedjars compile | | uname | Linux 3638c39f67fa 5.4.0-1103-aws #111~18.04.1-Ubuntu SMP Tue May 23 20:04:10 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | dev-support/hbase-personality.sh | | git revision | master / 3d66866f41 | | Default Java | Temurin-1.8.0_352-b08 | | Test Results | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4720/8/testReport/ | | Max. process+thread count | 4747 (vs. ulimit of 3) | | modules | C: hbase-common hbase-client hbase-server U: . | | Console output | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4720/8/console | | versions | git=2.34.1 maven=3.8.6 | | Powered by | Apache Yetus 0.12.0 https://yetus.apache.org | This message was automatically generated. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
Re: [PR] HBASE-27315 Add timeout to JavaRegexEngine [hbase]
Apache-HBase commented on PR #4720: URL: https://github.com/apache/hbase/pull/4720#issuecomment-2092346025 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m 30s | Docker mode activated. | | -0 :warning: | yetus | 0m 3s | Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck | ||| _ Prechecks _ | ||| _ master Compile Tests _ | | +0 :ok: | mvndep | 0m 10s | Maven dependency ordering for branch | | +1 :green_heart: | mvninstall | 2m 58s | master passed | | +1 :green_heart: | compile | 1m 28s | master passed | | +1 :green_heart: | shadedjars | 5m 15s | branch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 1m 1s | master passed | ||| _ Patch Compile Tests _ | | +0 :ok: | mvndep | 0m 14s | Maven dependency ordering for patch | | +1 :green_heart: | mvninstall | 2m 47s | the patch passed | | +1 :green_heart: | compile | 1m 28s | the patch passed | | +1 :green_heart: | javac | 1m 28s | the patch passed | | +1 :green_heart: | shadedjars | 5m 14s | patch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 1m 0s | the patch passed | ||| _ Other Tests _ | | +1 :green_heart: | unit | 2m 22s | hbase-common in the patch passed. | | -1 :x: | unit | 1m 16s | hbase-client in the patch failed. | | +1 :green_heart: | unit | 231m 39s | hbase-server in the patch passed. | | | | 262m 49s | | | Subsystem | Report/Notes | |--:|:-| | Docker | ClientAPI=1.45 ServerAPI=1.45 base: https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4720/8/artifact/yetus-jdk11-hadoop3-check/output/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/4720 | | Optional Tests | javac javadoc unit shadedjars compile | | uname | Linux a9e3a7ea0aa1 5.4.0-172-generic #190-Ubuntu SMP Fri Feb 2 23:24:22 UTC 2024 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | dev-support/hbase-personality.sh | | git revision | master / 3d66866f41 | | Default Java | Eclipse Adoptium-11.0.17+8 | | unit | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4720/8/artifact/yetus-jdk11-hadoop3-check/output/patch-unit-hbase-client.txt | | Test Results | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4720/8/testReport/ | | Max. process+thread count | 5752 (vs. ulimit of 3) | | modules | C: hbase-common hbase-client hbase-server U: . | | Console output | https://ci-hbase.apache.org/job/HBase-PreCommit-GitHub-PR/job/PR-4720/8/console | | versions | git=2.34.1 maven=3.8.6 | | Powered by | Apache Yetus 0.12.0 https://yetus.apache.org | This message was automatically generated. -- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. To unsubscribe, e-mail: issues-unsubscr...@hbase.apache.org For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Created] (HBASE-28564) Refactor direct interactions of Reference file creations to SFT interface
Prathyusha created HBASE-28564: -- Summary: Refactor direct interactions of Reference file creations to SFT interface Key: HBASE-28564 URL: https://issues.apache.org/jira/browse/HBASE-28564 Project: HBase Issue Type: Improvement Reporter: Prathyusha -- This message was sent by Atlassian Jira (v8.20.10#820010)