[GitHub] [hbase] Apache-HBase commented on pull request #2397: HBASE-24999 Master manages ReplicationServers
Apache-HBase commented on pull request #2397: URL: https://github.com/apache/hbase/pull/2397#issuecomment-693225151 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m 33s | Docker mode activated. | ||| _ Prechecks _ | | +1 :green_heart: | dupname | 0m 0s | No case conflicting files found. | | +0 :ok: | prototool | 0m 0s | prototool was not available. | | +1 :green_heart: | hbaseanti | 0m 0s | Patch does not have any anti-patterns. | | +1 :green_heart: | @author | 0m 0s | The patch does not contain any @author tags. | ||| _ HBASE-24666 Compile Tests _ | | +0 :ok: | mvndep | 0m 31s | Maven dependency ordering for branch | | +1 :green_heart: | mvninstall | 3m 57s | HBASE-24666 passed | | +1 :green_heart: | checkstyle | 1m 38s | HBASE-24666 passed | | +1 :green_heart: | spotbugs | 8m 8s | HBASE-24666 passed | ||| _ Patch Compile Tests _ | | +0 :ok: | mvndep | 0m 16s | Maven dependency ordering for patch | | +1 :green_heart: | mvninstall | 5m 6s | the patch passed | | +1 :green_heart: | checkstyle | 1m 49s | the patch passed | | +1 :green_heart: | whitespace | 0m 0s | The patch has no whitespace issues. | | +1 :green_heart: | hadoopcheck | 15m 49s | Patch does not cause any errors with Hadoop 3.1.2 3.2.1. | | +1 :green_heart: | hbaseprotoc | 2m 11s | the patch passed | | +1 :green_heart: | spotbugs | 8m 29s | the patch passed | ||| _ Other Tests _ | | +1 :green_heart: | asflicense | 0m 27s | The patch does not generate ASF License warnings. | | | | 58m 48s | | | Subsystem | Report/Notes | |--:|:-| | Docker | Client=19.03.12 Server=19.03.12 base: https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2397/4/artifact/yetus-general-check/output/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/2397 | | Optional Tests | dupname asflicense cc hbaseprotoc prototool spotbugs hadoopcheck hbaseanti checkstyle | | uname | Linux 2a89a464b64b 4.15.0-60-generic #67-Ubuntu SMP Thu Aug 22 16:55:30 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | dev-support/hbase-personality.sh | | git revision | HBASE-24666 / c302a9e600 | | Max. process+thread count | 94 (vs. ulimit of 12500) | | modules | C: hbase-protocol-shaded hbase-server U: . | | Console output | https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2397/4/console | | versions | git=2.17.1 maven=(cecedd343002696d0abb50b32b541b8a6ba2883f) spotbugs=3.1.12 | | Powered by | Apache Yetus 0.11.1 https://yetus.apache.org | This message was automatically generated. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Created] (HBASE-25035) Add 2.2.6 to download page
Guanghao Zhang created HBASE-25035: -- Summary: Add 2.2.6 to download page Key: HBASE-25035 URL: https://issues.apache.org/jira/browse/HBASE-25035 Project: HBase Issue Type: Sub-task Reporter: Guanghao Zhang -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Assigned] (HBASE-25035) Add 2.2.6 to download page
[ https://issues.apache.org/jira/browse/HBASE-25035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guanghao Zhang reassigned HBASE-25035: -- Assignee: Guanghao Zhang > Add 2.2.6 to download page > -- > > Key: HBASE-25035 > URL: https://issues.apache.org/jira/browse/HBASE-25035 > Project: HBase > Issue Type: Sub-task >Reporter: Guanghao Zhang >Assignee: Guanghao Zhang >Priority: Major > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HBASE-25036) Set version as 2.2.7-SNAPSHOT in branch-2.2
Guanghao Zhang created HBASE-25036: -- Summary: Set version as 2.2.7-SNAPSHOT in branch-2.2 Key: HBASE-25036 URL: https://issues.apache.org/jira/browse/HBASE-25036 Project: HBase Issue Type: Sub-task Reporter: Guanghao Zhang -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Assigned] (HBASE-25036) Set version as 2.2.7-SNAPSHOT in branch-2.2
[ https://issues.apache.org/jira/browse/HBASE-25036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guanghao Zhang reassigned HBASE-25036: -- Assignee: Guanghao Zhang > Set version as 2.2.7-SNAPSHOT in branch-2.2 > --- > > Key: HBASE-25036 > URL: https://issues.apache.org/jira/browse/HBASE-25036 > Project: HBase > Issue Type: Sub-task >Reporter: Guanghao Zhang >Assignee: Guanghao Zhang >Priority: Major > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[GitHub] [hbase] infraio opened a new pull request #2405: HBASE-25035 Add 2.2.6 to download page
infraio opened a new pull request #2405: URL: https://github.com/apache/hbase/pull/2405 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hbase] Apache-HBase commented on pull request #2405: HBASE-25035 Add 2.2.6 to download page
Apache-HBase commented on pull request #2405: URL: https://github.com/apache/hbase/pull/2405#issuecomment-693238803 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m 24s | Docker mode activated. | | -0 :warning: | yetus | 0m 3s | Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck | ||| _ Prechecks _ | ||| _ master Compile Tests _ | ||| _ Patch Compile Tests _ | ||| _ Other Tests _ | | | | 1m 20s | | | Subsystem | Report/Notes | |--:|:-| | Docker | Client=19.03.12 Server=19.03.12 base: https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2405/1/artifact/yetus-jdk8-hadoop3-check/output/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/2405 | | Optional Tests | | | uname | Linux 00422a4142c3 4.15.0-112-generic #113-Ubuntu SMP Thu Jul 9 23:41:39 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | dev-support/hbase-personality.sh | | git revision | master / c5ca191921 | | Max. process+thread count | 42 (vs. ulimit of 12500) | | modules | C: . U: . | | Console output | https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2405/1/console | | versions | git=2.17.1 maven=(cecedd343002696d0abb50b32b541b8a6ba2883f) | | Powered by | Apache Yetus 0.11.1 https://yetus.apache.org | This message was automatically generated. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hbase] Apache-HBase commented on pull request #2405: HBASE-25035 Add 2.2.6 to download page
Apache-HBase commented on pull request #2405: URL: https://github.com/apache/hbase/pull/2405#issuecomment-693239109 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 1m 3s | Docker mode activated. | | -0 :warning: | yetus | 0m 3s | Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck | ||| _ Prechecks _ | ||| _ master Compile Tests _ | ||| _ Patch Compile Tests _ | ||| _ Other Tests _ | | | | 2m 12s | | | Subsystem | Report/Notes | |--:|:-| | Docker | Client=19.03.12 Server=19.03.12 base: https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2405/1/artifact/yetus-jdk11-hadoop3-check/output/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/2405 | | Optional Tests | | | uname | Linux 9ac812f05ac2 4.15.0-112-generic #113-Ubuntu SMP Thu Jul 9 23:41:39 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | dev-support/hbase-personality.sh | | git revision | master / c5ca191921 | | Max. process+thread count | 46 (vs. ulimit of 12500) | | modules | C: . U: . | | Console output | https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2405/1/console | | versions | git=2.17.1 maven=(cecedd343002696d0abb50b32b541b8a6ba2883f) | | Powered by | Apache Yetus 0.11.1 https://yetus.apache.org | This message was automatically generated. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hbase] infraio opened a new pull request #2406: HBASE-25036 Set version as 2.2.7-SNAPSHOT in branch-2.2
infraio opened a new pull request #2406: URL: https://github.com/apache/hbase/pull/2406 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hbase] Apache-HBase commented on pull request #2405: HBASE-25035 Add 2.2.6 to download page
Apache-HBase commented on pull request #2405: URL: https://github.com/apache/hbase/pull/2405#issuecomment-693253322 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m 27s | Docker mode activated. | ||| _ Prechecks _ | | +1 :green_heart: | dupname | 0m 0s | No case conflicting files found. | | +1 :green_heart: | @author | 0m 0s | The patch does not contain any @author tags. | ||| _ master Compile Tests _ | | +1 :green_heart: | mvninstall | 3m 48s | master passed | | +1 :green_heart: | mvnsite | 10m 6s | master passed | ||| _ Patch Compile Tests _ | | +1 :green_heart: | mvninstall | 3m 29s | the patch passed | | +1 :green_heart: | mvnsite | 10m 20s | the patch passed | | +1 :green_heart: | whitespace | 0m 0s | The patch has no whitespace issues. | | +1 :green_heart: | xml | 0m 1s | The patch has no ill-formed XML file. | ||| _ Other Tests _ | | +1 :green_heart: | asflicense | 0m 19s | The patch does not generate ASF License warnings. | | | | 30m 15s | | | Subsystem | Report/Notes | |--:|:-| | Docker | Client=19.03.12 Server=19.03.12 base: https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2405/1/artifact/yetus-general-check/output/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/2405 | | Optional Tests | dupname asflicense mvnsite xml | | uname | Linux 30ad47946173 4.15.0-58-generic #64-Ubuntu SMP Tue Aug 6 11:12:41 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | dev-support/hbase-personality.sh | | git revision | master / c5ca191921 | | Max. process+thread count | 89 (vs. ulimit of 12500) | | modules | C: . U: . | | Console output | https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2405/1/console | | versions | git=2.17.1 maven=(cecedd343002696d0abb50b32b541b8a6ba2883f) | | Powered by | Apache Yetus 0.11.1 https://yetus.apache.org | This message was automatically generated. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Commented] (HBASE-24584) Release 2.2.6
[ https://issues.apache.org/jira/browse/HBASE-24584?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17196781#comment-17196781 ] Guanghao Zhang commented on HBASE-24584: Pushed tag rel/2.2.6. > Release 2.2.6 > - > > Key: HBASE-24584 > URL: https://issues.apache.org/jira/browse/HBASE-24584 > Project: HBase > Issue Type: Umbrella >Reporter: Guanghao Zhang >Assignee: Guanghao Zhang >Priority: Major > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HBASE-25037) Lots of thread pool are changed to non daemon after HBASE-24750 which causes trouble when shutting down
Duo Zhang created HBASE-25037: - Summary: Lots of thread pool are changed to non daemon after HBASE-24750 which causes trouble when shutting down Key: HBASE-25037 URL: https://issues.apache.org/jira/browse/HBASE-25037 Project: HBase Issue Type: Improvement Reporter: Duo Zhang Assignee: Duo Zhang Fix For: 3.0.0-alpha-1, 2.4.0 We replace Threads.newDaemonThreadFactory with guava ThreadFactoryBuilder but miss the setDaemon call, which causes our client integration test to fail because of hbase shell can never quit cleanly. We should add the setDaemon back for those thread factories. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Work started] (HBASE-25037) Lots of thread pool are changed to non daemon after HBASE-24750 which causes trouble when shutting down
[ https://issues.apache.org/jira/browse/HBASE-25037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HBASE-25037 started by Duo Zhang. - > Lots of thread pool are changed to non daemon after HBASE-24750 which causes > trouble when shutting down > --- > > Key: HBASE-25037 > URL: https://issues.apache.org/jira/browse/HBASE-25037 > Project: HBase > Issue Type: Improvement >Reporter: Duo Zhang >Assignee: Duo Zhang >Priority: Major > Fix For: 3.0.0-alpha-1, 2.4.0 > > > We replace Threads.newDaemonThreadFactory with guava ThreadFactoryBuilder but > miss the setDaemon call, which causes our client integration test to fail > because of hbase shell can never quit cleanly. > We should add the setDaemon back for those thread factories. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Work started] (HBASE-25038) Release 2.3.2
[ https://issues.apache.org/jira/browse/HBASE-25038?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HBASE-25038 started by Viraj Jasani. > Release 2.3.2 > - > > Key: HBASE-25038 > URL: https://issues.apache.org/jira/browse/HBASE-25038 > Project: HBase > Issue Type: Task > Components: community >Reporter: Viraj Jasani >Assignee: Viraj Jasani >Priority: Major > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HBASE-25038) Release 2.3.2
Viraj Jasani created HBASE-25038: Summary: Release 2.3.2 Key: HBASE-25038 URL: https://issues.apache.org/jira/browse/HBASE-25038 Project: HBase Issue Type: Task Components: community Reporter: Viraj Jasani Assignee: Viraj Jasani -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Assigned] (HBASE-25039) Spin RCs
[ https://issues.apache.org/jira/browse/HBASE-25039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Viraj Jasani reassigned HBASE-25039: Assignee: Viraj Jasani > Spin RCs > > > Key: HBASE-25039 > URL: https://issues.apache.org/jira/browse/HBASE-25039 > Project: HBase > Issue Type: Sub-task >Reporter: Viraj Jasani >Assignee: Viraj Jasani >Priority: Major > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HBASE-25039) Spin RCs
Viraj Jasani created HBASE-25039: Summary: Spin RCs Key: HBASE-25039 URL: https://issues.apache.org/jira/browse/HBASE-25039 Project: HBase Issue Type: Sub-task Reporter: Viraj Jasani -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Work started] (HBASE-25039) Spin RCs
[ https://issues.apache.org/jira/browse/HBASE-25039?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HBASE-25039 started by Viraj Jasani. > Spin RCs > > > Key: HBASE-25039 > URL: https://issues.apache.org/jira/browse/HBASE-25039 > Project: HBase > Issue Type: Sub-task >Reporter: Viraj Jasani >Assignee: Viraj Jasani >Priority: Major > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HBASE-25040) "Release" staged nexus repository
Viraj Jasani created HBASE-25040: Summary: "Release" staged nexus repository Key: HBASE-25040 URL: https://issues.apache.org/jira/browse/HBASE-25040 Project: HBase Issue Type: Sub-task Reporter: Viraj Jasani -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HBASE-25040) "Release" staged nexus repository
[ https://issues.apache.org/jira/browse/HBASE-25040?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17196801#comment-17196801 ] Viraj Jasani commented on HBASE-25040: -- Staged repository for RC1: https://repository.apache.org/content/repositories/orgapachehbase-1408/ > "Release" staged nexus repository > - > > Key: HBASE-25040 > URL: https://issues.apache.org/jira/browse/HBASE-25040 > Project: HBase > Issue Type: Sub-task >Reporter: Viraj Jasani >Priority: Major > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HBASE-25041) Release version 2.3.2 in Jira
Viraj Jasani created HBASE-25041: Summary: Release version 2.3.2 in Jira Key: HBASE-25041 URL: https://issues.apache.org/jira/browse/HBASE-25041 Project: HBase Issue Type: Sub-task Reporter: Viraj Jasani Assignee: Viraj Jasani -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HBASE-25042) Promote 2.3.2 RC artifacts in svn
Viraj Jasani created HBASE-25042: Summary: Promote 2.3.2 RC artifacts in svn Key: HBASE-25042 URL: https://issues.apache.org/jira/browse/HBASE-25042 Project: HBase Issue Type: Sub-task Reporter: Viraj Jasani -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HBASE-25043) Update reporter tool with new release
Viraj Jasani created HBASE-25043: Summary: Update reporter tool with new release Key: HBASE-25043 URL: https://issues.apache.org/jira/browse/HBASE-25043 Project: HBase Issue Type: Sub-task Reporter: Viraj Jasani -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HBASE-25044) Push signed release tag
Viraj Jasani created HBASE-25044: Summary: Push signed release tag Key: HBASE-25044 URL: https://issues.apache.org/jira/browse/HBASE-25044 Project: HBase Issue Type: Sub-task Reporter: Viraj Jasani Assignee: Viraj Jasani -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HBASE-25045) Add 2.3.2 to the downloads page
Viraj Jasani created HBASE-25045: Summary: Add 2.3.2 to the downloads page Key: HBASE-25045 URL: https://issues.apache.org/jira/browse/HBASE-25045 Project: HBase Issue Type: Sub-task Reporter: Viraj Jasani Assignee: Viraj Jasani -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Created] (HBASE-25046) Send announce email
Viraj Jasani created HBASE-25046: Summary: Send announce email Key: HBASE-25046 URL: https://issues.apache.org/jira/browse/HBASE-25046 Project: HBase Issue Type: Sub-task Reporter: Viraj Jasani -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Assigned] (HBASE-25046) Send announce email
[ https://issues.apache.org/jira/browse/HBASE-25046?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Viraj Jasani reassigned HBASE-25046: Assignee: Viraj Jasani > Send announce email > --- > > Key: HBASE-25046 > URL: https://issues.apache.org/jira/browse/HBASE-25046 > Project: HBase > Issue Type: Sub-task >Reporter: Viraj Jasani >Assignee: Viraj Jasani >Priority: Major > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[GitHub] [hbase] Apache-HBase commented on pull request #2397: HBASE-24999 Master manages ReplicationServers
Apache-HBase commented on pull request #2397: URL: https://github.com/apache/hbase/pull/2397#issuecomment-693282724 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m 27s | Docker mode activated. | | -0 :warning: | yetus | 0m 4s | Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck | ||| _ Prechecks _ | ||| _ HBASE-24666 Compile Tests _ | | +0 :ok: | mvndep | 0m 22s | Maven dependency ordering for branch | | +1 :green_heart: | mvninstall | 3m 39s | HBASE-24666 passed | | +1 :green_heart: | compile | 1m 41s | HBASE-24666 passed | | +1 :green_heart: | shadedjars | 6m 32s | branch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 0m 52s | HBASE-24666 passed | ||| _ Patch Compile Tests _ | | +0 :ok: | mvndep | 0m 15s | Maven dependency ordering for patch | | +1 :green_heart: | mvninstall | 3m 23s | the patch passed | | +1 :green_heart: | compile | 1m 40s | the patch passed | | +1 :green_heart: | javac | 1m 40s | the patch passed | | +1 :green_heart: | shadedjars | 6m 28s | patch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 0m 50s | the patch passed | ||| _ Other Tests _ | | +1 :green_heart: | unit | 0m 46s | hbase-protocol-shaded in the patch passed. | | +1 :green_heart: | unit | 143m 43s | hbase-server in the patch passed. | | | | 173m 6s | | | Subsystem | Report/Notes | |--:|:-| | Docker | Client=19.03.12 Server=19.03.12 base: https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2397/4/artifact/yetus-jdk8-hadoop3-check/output/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/2397 | | Optional Tests | unit javac javadoc shadedjars compile | | uname | Linux 2db0f0a7df39 4.15.0-58-generic #64-Ubuntu SMP Tue Aug 6 11:12:41 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | dev-support/hbase-personality.sh | | git revision | HBASE-24666 / c302a9e600 | | Default Java | 1.8.0_232 | | Test Results | https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2397/4/testReport/ | | Max. process+thread count | 4303 (vs. ulimit of 12500) | | modules | C: hbase-protocol-shaded hbase-server U: . | | Console output | https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2397/4/console | | versions | git=2.17.1 maven=(cecedd343002696d0abb50b32b541b8a6ba2883f) | | Powered by | Apache Yetus 0.11.1 https://yetus.apache.org | This message was automatically generated. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Commented] (HBASE-25037) Lots of thread pool are changed to non daemon after HBASE-24750 which causes trouble when shutting down
[
https://issues.apache.org/jira/browse/HBASE-25037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17196814#comment-17196814
]
Viraj Jasani commented on HBASE-25037:
--
{code:java}
if (!t.isDaemon()) {
t.setDaemon(true);
}{code}
Everyone using previous utility always used to have daemon mode on. To maintain
the same behaviour, I agree that we will have to update all thread factories to
use daemon threads.
> Lots of thread pool are changed to non daemon after HBASE-24750 which causes
> trouble when shutting down
> ---
>
> Key: HBASE-25037
> URL: https://issues.apache.org/jira/browse/HBASE-25037
> Project: HBase
> Issue Type: Improvement
>Reporter: Duo Zhang
>Assignee: Duo Zhang
>Priority: Major
> Fix For: 3.0.0-alpha-1, 2.4.0
>
>
> We replace Threads.newDaemonThreadFactory with guava ThreadFactoryBuilder but
> miss the setDaemon call, which causes our client integration test to fail
> because of hbase shell can never quit cleanly.
> We should add the setDaemon back for those thread factories.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[GitHub] [hbase] Apache-HBase commented on pull request #2397: HBASE-24999 Master manages ReplicationServers
Apache-HBase commented on pull request #2397: URL: https://github.com/apache/hbase/pull/2397#issuecomment-693284612 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 1m 50s | Docker mode activated. | | -0 :warning: | yetus | 0m 3s | Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck | ||| _ Prechecks _ | ||| _ HBASE-24666 Compile Tests _ | | +0 :ok: | mvndep | 0m 25s | Maven dependency ordering for branch | | +1 :green_heart: | mvninstall | 5m 44s | HBASE-24666 passed | | +1 :green_heart: | compile | 2m 46s | HBASE-24666 passed | | +1 :green_heart: | shadedjars | 9m 9s | branch has no errors when building our shaded downstream artifacts. | | -0 :warning: | javadoc | 0m 41s | hbase-server in HBASE-24666 failed. | ||| _ Patch Compile Tests _ | | +0 :ok: | mvndep | 0m 16s | Maven dependency ordering for patch | | +1 :green_heart: | mvninstall | 4m 7s | the patch passed | | +1 :green_heart: | compile | 2m 2s | the patch passed | | +1 :green_heart: | javac | 2m 2s | the patch passed | | +1 :green_heart: | shadedjars | 6m 38s | patch has no errors when building our shaded downstream artifacts. | | -0 :warning: | javadoc | 0m 43s | hbase-server in the patch failed. | ||| _ Other Tests _ | | +1 :green_heart: | unit | 0m 56s | hbase-protocol-shaded in the patch passed. | | +1 :green_heart: | unit | 138m 15s | hbase-server in the patch passed. | | | | 176m 34s | | | Subsystem | Report/Notes | |--:|:-| | Docker | Client=19.03.12 Server=19.03.12 base: https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2397/4/artifact/yetus-jdk11-hadoop3-check/output/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/2397 | | Optional Tests | unit javac javadoc shadedjars compile | | uname | Linux 7bade809e7ab 4.15.0-65-generic #74-Ubuntu SMP Tue Sep 17 17:06:04 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | dev-support/hbase-personality.sh | | git revision | HBASE-24666 / c302a9e600 | | Default Java | 2020-01-14 | | javadoc | https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2397/4/artifact/yetus-jdk11-hadoop3-check/output/branch-javadoc-hbase-server.txt | | javadoc | https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2397/4/artifact/yetus-jdk11-hadoop3-check/output/patch-javadoc-hbase-server.txt | | Test Results | https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2397/4/testReport/ | | Max. process+thread count | 4057 (vs. ulimit of 12500) | | modules | C: hbase-protocol-shaded hbase-server U: . | | Console output | https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2397/4/console | | versions | git=2.17.1 maven=(cecedd343002696d0abb50b32b541b8a6ba2883f) | | Powered by | Apache Yetus 0.11.1 https://yetus.apache.org | This message was automatically generated. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Comment Edited] (HBASE-25037) Lots of thread pool are changed to non daemon after HBASE-24750 which causes trouble when shutting down
[
https://issues.apache.org/jira/browse/HBASE-25037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17196814#comment-17196814
]
Viraj Jasani edited comment on HBASE-25037 at 9/16/20, 9:23 AM:
{code:java}
public static ThreadFactory newDaemonThreadFactory(final String prefix,
final UncaughtExceptionHandler handler) {
final ThreadFactory namedFactory = getNamedThreadFactory(prefix);
return new ThreadFactory() {
@Override
public Thread newThread(Runnable r) {
Thread t = namedFactory.newThread(r);
if (handler != null) {
t.setUncaughtExceptionHandler(handler);
} else {
t.setUncaughtExceptionHandler(LOGGING_EXCEPTION_HANDLER);
}
if (!t.isDaemon()) {
t.setDaemon(true);
}
if (t.getPriority() != Thread.NORM_PRIORITY) {
t.setPriority(Thread.NORM_PRIORITY);
}
return t;
}
};
}
{code}
Everyone using previous utility always used to have daemon mode on. To maintain
the same behaviour, I agree that we will have to update all thread factories to
use daemon threads.
Ideally, even for this previous utility, daemon mode as boolean flag should
have been part of the method signature though so that client can make better
decision while using this utility.
was (Author: vjasani):
{code:java}
if (!t.isDaemon()) {
t.setDaemon(true);
}{code}
Everyone using previous utility always used to have daemon mode on. To maintain
the same behaviour, I agree that we will have to update all thread factories to
use daemon threads.
> Lots of thread pool are changed to non daemon after HBASE-24750 which causes
> trouble when shutting down
> ---
>
> Key: HBASE-25037
> URL: https://issues.apache.org/jira/browse/HBASE-25037
> Project: HBase
> Issue Type: Improvement
>Reporter: Duo Zhang
>Assignee: Duo Zhang
>Priority: Major
> Fix For: 3.0.0-alpha-1, 2.4.0
>
>
> We replace Threads.newDaemonThreadFactory with guava ThreadFactoryBuilder but
> miss the setDaemon call, which causes our client integration test to fail
> because of hbase shell can never quit cleanly.
> We should add the setDaemon back for those thread factories.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HBASE-25034) Table regions details on master GUI display slowly.
[ https://issues.apache.org/jira/browse/HBASE-25034?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17196822#comment-17196822 ] Yue Li commented on HBASE-25034: we have the same problem . > Table regions details on master GUI display slowly. > --- > > Key: HBASE-25034 > URL: https://issues.apache.org/jira/browse/HBASE-25034 > Project: HBase > Issue Type: Improvement >Reporter: DingSheng Li >Priority: Major > Labels: newbie > > When a table has a large number of regions (e.g.,a single table contains more > than 100,000 regions), it takes about 20 to 30 minutes to display the table > regions on the master GUI, which is unacceptable to users. After testing, we > find that web page rendering takes up the most time,and this can be solved by > pagination query. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Comment Edited] (HBASE-25037) Lots of thread pool are changed to non daemon after HBASE-24750 which causes trouble when shutting down
[
https://issues.apache.org/jira/browse/HBASE-25037?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17196814#comment-17196814
]
Viraj Jasani edited comment on HBASE-25037 at 9/16/20, 9:28 AM:
Thanks [~zhangduo] for finding this issue.
{code:java}
public static ThreadFactory newDaemonThreadFactory(final String prefix,
final UncaughtExceptionHandler handler) {
final ThreadFactory namedFactory = getNamedThreadFactory(prefix);
return new ThreadFactory() {
@Override
public Thread newThread(Runnable r) {
Thread t = namedFactory.newThread(r);
if (handler != null) {
t.setUncaughtExceptionHandler(handler);
} else {
t.setUncaughtExceptionHandler(LOGGING_EXCEPTION_HANDLER);
}
if (!t.isDaemon()) {
t.setDaemon(true);
}
if (t.getPriority() != Thread.NORM_PRIORITY) {
t.setPriority(Thread.NORM_PRIORITY);
}
return t;
}
};
}
{code}
Everyone using previous utility always used to have daemon mode on. To maintain
the same behaviour, I agree that we will have to update all thread factories to
use daemon threads.
Ideally, even for this previous utility, daemon mode as boolean flag should
have been part of the method signature though so that client can make better
decision while using this utility.
was (Author: vjasani):
{code:java}
public static ThreadFactory newDaemonThreadFactory(final String prefix,
final UncaughtExceptionHandler handler) {
final ThreadFactory namedFactory = getNamedThreadFactory(prefix);
return new ThreadFactory() {
@Override
public Thread newThread(Runnable r) {
Thread t = namedFactory.newThread(r);
if (handler != null) {
t.setUncaughtExceptionHandler(handler);
} else {
t.setUncaughtExceptionHandler(LOGGING_EXCEPTION_HANDLER);
}
if (!t.isDaemon()) {
t.setDaemon(true);
}
if (t.getPriority() != Thread.NORM_PRIORITY) {
t.setPriority(Thread.NORM_PRIORITY);
}
return t;
}
};
}
{code}
Everyone using previous utility always used to have daemon mode on. To maintain
the same behaviour, I agree that we will have to update all thread factories to
use daemon threads.
Ideally, even for this previous utility, daemon mode as boolean flag should
have been part of the method signature though so that client can make better
decision while using this utility.
> Lots of thread pool are changed to non daemon after HBASE-24750 which causes
> trouble when shutting down
> ---
>
> Key: HBASE-25037
> URL: https://issues.apache.org/jira/browse/HBASE-25037
> Project: HBase
> Issue Type: Improvement
>Reporter: Duo Zhang
>Assignee: Duo Zhang
>Priority: Major
> Fix For: 3.0.0-alpha-1, 2.4.0
>
>
> We replace Threads.newDaemonThreadFactory with guava ThreadFactoryBuilder but
> miss the setDaemon call, which causes our client integration test to fail
> because of hbase shell can never quit cleanly.
> We should add the setDaemon back for those thread factories.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Created] (HBASE-25047) WAL split edits number is negative in RegionServerUI
Yi Mei created HBASE-25047: -- Summary: WAL split edits number is negative in RegionServerUI Key: HBASE-25047 URL: https://issues.apache.org/jira/browse/HBASE-25047 Project: HBase Issue Type: Bug Reporter: Yi Mei Attachments: 2020-09-16 11-38-13屏幕截图.png !2020-09-16 11-38-13屏幕截图.png! -- This message was sent by Atlassian Jira (v8.3.4#803005)
[GitHub] [hbase] Apache9 opened a new pull request #2407: HBASE-25037 Lots of thread pool are changed to non daemon after HBASE…
Apache9 opened a new pull request #2407: URL: https://github.com/apache/hbase/pull/2407 …-24750 which causes trouble when shutting down This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Created] (HBASE-25048) [HBCK2] Bypassed parent procedures are not updated in store
Yi Mei created HBASE-25048:
--
Summary: [HBCK2] Bypassed parent procedures are not updated in
store
Key: HBASE-25048
URL: https://issues.apache.org/jira/browse/HBASE-25048
Project: HBase
Issue Type: Bug
Reporter: Yi Mei
See code in
[ProcedureExecutor|https://github.com/apache/hbase/blob/master/hbase-procedure/src/main/java/org/apache/hadoop/hbase/procedure2/ProcedureExecutor.java#L980]:
{code:java}
Procedure current = procedure;
while (current != null) {
LOG.debug("Bypassing {}", current);
current.bypass(getEnvironment());
store.update(procedure); // update current procedure
long parentID = current.getParentProcId();
current = getProcedure(parentID);
}
{code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Assigned] (HBASE-25047) WAL split edits number is negative in RegionServerUI
[ https://issues.apache.org/jira/browse/HBASE-25047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Junhong Xu reassigned HBASE-25047: -- Assignee: Junhong Xu > WAL split edits number is negative in RegionServerUI > > > Key: HBASE-25047 > URL: https://issues.apache.org/jira/browse/HBASE-25047 > Project: HBase > Issue Type: Bug >Reporter: Yi Mei >Assignee: Junhong Xu >Priority: Minor > Attachments: 2020-09-16 11-38-13屏幕截图.png > > > !2020-09-16 11-38-13屏幕截图.png! -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Assigned] (HBASE-25048) [HBCK2] Bypassed parent procedures are not updated in store
[
https://issues.apache.org/jira/browse/HBASE-25048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Junhong Xu reassigned HBASE-25048:
--
Assignee: Junhong Xu
> [HBCK2] Bypassed parent procedures are not updated in store
> ---
>
> Key: HBASE-25048
> URL: https://issues.apache.org/jira/browse/HBASE-25048
> Project: HBase
> Issue Type: Bug
>Reporter: Yi Mei
>Assignee: Junhong Xu
>Priority: Major
>
> See code in
> [ProcedureExecutor|https://github.com/apache/hbase/blob/master/hbase-procedure/src/main/java/org/apache/hadoop/hbase/procedure2/ProcedureExecutor.java#L980]:
> {code:java}
> Procedure current = procedure;
> while (current != null) {
> LOG.debug("Bypassing {}", current);
> current.bypass(getEnvironment());
> store.update(procedure); // update current procedure
> long parentID = current.getParentProcId();
> current = getProcedure(parentID);
> }
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HBASE-25021) Nightly job should skip hadoop-2 integration test for master
[
https://issues.apache.org/jira/browse/HBASE-25021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17196841#comment-17196841
]
Hudson commented on HBASE-25021:
Results for branch HBASE-25021
[build #10 on
builds.a.o|https://ci-hadoop.apache.org/job/HBase/job/HBase%20Nightly/job/HBASE-25021/10/]:
(x) *{color:red}-1 overall{color}*
details (if available):
(/) {color:green}+1 general checks{color}
-- For more information [see general
report|https://ci-hadoop.apache.org/job/HBase/job/HBase%20Nightly/job/HBASE-25021/2/General_20Nightly_20Build_20Report/]
(x) {color:red}-1 jdk8 hadoop3 checks{color}
-- For more information [see jdk8 (hadoop3)
report|https://ci-hadoop.apache.org/job/HBase/job/HBase%20Nightly/job/HBASE-25021/2/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/]
(/) {color:green}+1 jdk11 hadoop3 checks{color}
-- For more information [see jdk11
report|https://ci-hadoop.apache.org/job/HBase/job/HBase%20Nightly/job/HBASE-25021/2/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/]
(/) {color:green}+1 source release artifact{color}
-- See build output for details.
(x) {color:red}-1 client integration test{color}
--Failed when running client tests on top of Hadoop 3. [see log for
details|https://ci-hadoop.apache.org/job/HBase/job/HBase%20Nightly/job/HBASE-25021/10//artifact/output-integration/hadoop-3.log].
(note that this means we didn't check the Hadoop 3 shaded client)
> Nightly job should skip hadoop-2 integration test for master
>
>
> Key: HBASE-25021
> URL: https://issues.apache.org/jira/browse/HBASE-25021
> Project: HBase
> Issue Type: Bug
> Components: build, scripts
>Reporter: Duo Zhang
>Priority: Major
>
> Since master does not support hadoop 2.x any more.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[GitHub] [hbase] infraio merged pull request #2383: HBASE-25012 HBASE-24359 causes replication missed log of some RemoteE…
infraio merged pull request #2383: URL: https://github.com/apache/hbase/pull/2383 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hbase] infraio merged pull request #2384: HBASE-25012 HBASE-24359 causes replication missed log of some RemoteE…
infraio merged pull request #2384: URL: https://github.com/apache/hbase/pull/2384 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Resolved] (HBASE-25014) ScheduledChore is never triggered when initalDelay > 1.5*period
[ https://issues.apache.org/jira/browse/HBASE-25014?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guanghao Zhang resolved HBASE-25014. Fix Version/s: 2.2.7 2.4.0 2.3.3 Resolution: Fixed > ScheduledChore is never triggered when initalDelay > 1.5*period > --- > > Key: HBASE-25014 > URL: https://issues.apache.org/jira/browse/HBASE-25014 > Project: HBase > Issue Type: Bug >Affects Versions: 3.0.0-alpha-1, 2.2.3, 2.2.4, 2.2.5 >Reporter: Sun Xin >Assignee: Sun Xin >Priority: Major > Fix For: 3.0.0-alpha-1, 2.3.3, 2.4.0, 2.2.7 > > > In our recent tests, ScheduledChore is never triggered when initalDelay > > 1.5*period. > The cause of the bug is the following: > The trigger time for a ScheduleChore must be within an acceptable time window > that is 1.5 * period. see > [here|https://github.com/apache/hbase/blob/e5ca9adc54f9f580f85d21d38217afa97aa79d68/hbase-common/src/main/java/org/apache/hadoop/hbase/ScheduledChore.java#L234] > timeOfLastRun and timeOfThisRun are two variables that record two adjacent > trigger time. [The first initialization of > timeOfThisRun|https://github.com/apache/hbase/blob/e5ca9adc54f9f580f85d21d38217afa97aa79d68/hbase-common/src/main/java/org/apache/hadoop/hbase/ScheduledChore.java#L273] > is when the ScheduleChore is created, it's not a real trigger time. > If we set initialDelay > 1.5 period , after initialDelay, the first time when > chore is triggered has exceeded the allowed window. Then [cancel the chore > and schedule it > again|https://github.com/apache/hbase/blob/e5ca9adc54f9f580f85d21d38217afa97aa79d68/hbase-common/src/main/java/org/apache/hadoop/hbase/ChoreService.java#L176]. > So it's stuck in loop when initialDelay > 1.5 period : > 1. init timeOfThisRun at a wrong time. > 2. wait initalDelay > 3. chore trigger, but exceeded the allowed window. > 4. cancel chore and schedule it again > 5. go step 1. > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HBASE-25014) ScheduledChore is never triggered when initalDelay > 1.5*period
[ https://issues.apache.org/jira/browse/HBASE-25014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17196843#comment-17196843 ] Guanghao Zhang commented on HBASE-25014: Pushed to branch-2.2+. Thanks [~Ddupg] for contributing. > ScheduledChore is never triggered when initalDelay > 1.5*period > --- > > Key: HBASE-25014 > URL: https://issues.apache.org/jira/browse/HBASE-25014 > Project: HBase > Issue Type: Bug >Affects Versions: 3.0.0-alpha-1, 2.2.3, 2.2.4, 2.2.5 >Reporter: Sun Xin >Assignee: Sun Xin >Priority: Major > Fix For: 3.0.0-alpha-1, 2.3.3, 2.4.0, 2.2.7 > > > In our recent tests, ScheduledChore is never triggered when initalDelay > > 1.5*period. > The cause of the bug is the following: > The trigger time for a ScheduleChore must be within an acceptable time window > that is 1.5 * period. see > [here|https://github.com/apache/hbase/blob/e5ca9adc54f9f580f85d21d38217afa97aa79d68/hbase-common/src/main/java/org/apache/hadoop/hbase/ScheduledChore.java#L234] > timeOfLastRun and timeOfThisRun are two variables that record two adjacent > trigger time. [The first initialization of > timeOfThisRun|https://github.com/apache/hbase/blob/e5ca9adc54f9f580f85d21d38217afa97aa79d68/hbase-common/src/main/java/org/apache/hadoop/hbase/ScheduledChore.java#L273] > is when the ScheduleChore is created, it's not a real trigger time. > If we set initialDelay > 1.5 period , after initialDelay, the first time when > chore is triggered has exceeded the allowed window. Then [cancel the chore > and schedule it > again|https://github.com/apache/hbase/blob/e5ca9adc54f9f580f85d21d38217afa97aa79d68/hbase-common/src/main/java/org/apache/hadoop/hbase/ChoreService.java#L176]. > So it's stuck in loop when initialDelay > 1.5 period : > 1. init timeOfThisRun at a wrong time. > 2. wait initalDelay > 3. chore trigger, but exceeded the allowed window. > 4. cancel chore and schedule it again > 5. go step 1. > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Resolved] (HBASE-25009) Hbck chore logs wrong message when loading regions from RS report
[
https://issues.apache.org/jira/browse/HBASE-25009?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Guanghao Zhang resolved HBASE-25009.
Fix Version/s: 2.2.7
2.4.0
2.3.3
3.0.0-alpha-1
Resolution: Fixed
Pushed to branch-2.2+. Thanks [~arshad.mohammad] for contributing.
> Hbck chore logs wrong message when loading regions from RS report
> -
>
> Key: HBASE-25009
> URL: https://issues.apache.org/jira/browse/HBASE-25009
> Project: HBase
> Issue Type: Bug
>Affects Versions: 3.0.0-alpha-1, 2.3.1
>Reporter: Mohammad Arshad
>Assignee: Mohammad Arshad
>Priority: Minor
> Fix For: 3.0.0-alpha-1, 2.3.3, 2.4.0, 2.2.7
>
>
> {code:java}
> LOG.info("Loaded {} regions from {} regionservers' reports and found {}
> orphan regions",
> numRegions, rsReports.size(), orphanRegionsOnFS.size());
> {code}
> In above log message orphanRegionsOnFS.size() should be replaced with
> orphanRegionsOnRS.size() as the regions are loaded from RS not form FS
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Resolved] (HBASE-25012) HBASE-24359 causes replication missed log of some RemoteException
[ https://issues.apache.org/jira/browse/HBASE-25012?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guanghao Zhang resolved HBASE-25012. Fix Version/s: 2.4.0 2.3.3 Resolution: Fixed Pushed to branch-2.3+. Thanks [~Ddupg] for contributing. > HBASE-24359 causes replication missed log of some RemoteException > - > > Key: HBASE-25012 > URL: https://issues.apache.org/jira/browse/HBASE-25012 > Project: HBase > Issue Type: Bug > Components: Replication >Affects Versions: 3.0.0-alpha-1, 2.3.0, 2.3.1 >Reporter: Sun Xin >Assignee: Sun Xin >Priority: Major > Fix For: 3.0.0-alpha-1, 2.3.3, 2.4.0 > > Attachments: image-2020-09-11-14-30-27-898.png > > > HBASE-24359 broken the logic of handling exception. In branch2, it even > causes some RemoteException log missed. > [File > changed|[https://github.com/apache/hbase/pull/1855/files#diff-1e3f171b19474698601a0752b618af0eL435]] > in branch2. > !image-2020-09-11-14-30-27-898.png! -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HBASE-25021) Nightly job should skip hadoop-2 integration test for master
[
https://issues.apache.org/jira/browse/HBASE-25021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17196851#comment-17196851
]
Duo Zhang commented on HBASE-25021:
---
https://ci-hadoop.apache.org/job/HBase/job/HBase%20Nightly/job/HBASE-25021/10/artifact/output-integration/hadoop-3/mr-importtsv.err/*view*/
{noformat}
/home/jenkins/jenkins-home/workspace/HBase_HBase_Nightly_HBASE-25021/hadoop-3/bin/hadoop
--config
/home/jenkins/jenkins-home/workspace/HBase_HBase_Nightly_HBASE-25021/output-integration/hadoop-3/hbase-conf/
jar
/home/jenkins/jenkins-home/workspace/HBase_HBase_Nightly_HBASE-25021/hbase-client/lib/shaded-clients/hbase-shaded-mapreduce-3.0.0-SNAPSHOT.jar
importtsv
-Dimporttsv.columns=HBASE_ROW_KEY,family1:column1,family1:column4,family1:column3
test:example example/ -libjars
/home/jenkins/jenkins-home/workspace/HBase_HBase_Nightly_HBASE-25021/hbase-client/bin/../lib/shaded-clients/hbase-shaded-mapreduce-3.0.0-SNAPSHOT.jar:/home/jenkins/jenkins-home/workspace/HBase_HBase_Nightly_HBASE-25021/hbase-client/bin/../lib/client-facing-thirdparty/audience-annotations-0.5.0.jar:/home/jenkins/jenkins-home/workspace/HBase_HBase_Nightly_HBASE-25021/hbase-client/bin/../lib/client-facing-thirdparty/commons-logging-1.2.jar:/home/jenkins/jenkins-home/workspace/HBase_HBase_Nightly_HBASE-25021/hbase-client/bin/../lib/client-facing-thirdparty/htrace-core4-4.2.0-incubating.jar:/home/jenkins/jenkins-home/workspace/HBase_HBase_Nightly_HBASE-25021/hbase-client/bin/../lib/client-facing-thirdparty/jcl-over-slf4j-1.7.30.jar:/home/jenkins/jenkins-home/workspace/HBase_HBase_Nightly_HBASE-25021/hbase-client/bin/../lib/client-facing-thirdparty/jul-to-slf4j-1.7.30.jar:/home/jenkins/jenkins-home/workspace/HBase_HBase_Nightly_HBASE-25021/hbase-client/bin/../lib/client-facing-thirdparty/log4j-1.2.17.jar:/home/jenkins/jenkins-home/workspace/HBase_HBase_Nightly_HBASE-25021/hbase-client/bin/../lib/client-facing-thirdparty/slf4j-api-1.7.30.jar
2020-09-16 09:37:44,565 INFO [main] client.AsyncConnectionImpl: Connection has
been closed by main.
2020-09-16 09:37:44,573 INFO [master-registry-refresh-end-points]
client.MasterAddressRefresher: Master end point refresher loop exited.
Exception in thread "main" java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.hadoop.hbase.mapreduce.Driver.main(Driver.java:63)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.hadoop.util.RunJar.run(RunJar.java:318)
at org.apache.hadoop.util.RunJar.main(RunJar.java:232)
Caused by: java.lang.NoClassDefFoundError:
org/apache/hadoop/hbase/shaded/com/google/protobuf/Message
at
org.apache.hadoop.hbase.mapreduce.TableMapReduceUtil.addHBaseDependencyJars(TableMapReduceUtil.java:802)
at
org.apache.hadoop.hbase.mapreduce.TableMapReduceUtil.addDependencyJars(TableMapReduceUtil.java:857)
at
org.apache.hadoop.hbase.mapreduce.TableMapReduceUtil.initTableReducerJob(TableMapReduceUtil.java:743)
at
org.apache.hadoop.hbase.mapreduce.TableMapReduceUtil.initTableReducerJob(TableMapReduceUtil.java:678)
at
org.apache.hadoop.hbase.mapreduce.TableMapReduceUtil.initTableReducerJob(TableMapReduceUtil.java:647)
at
org.apache.hadoop.hbase.mapreduce.TableMapReduceUtil.initTableReducerJob(TableMapReduceUtil.java:630)
at
org.apache.hadoop.hbase.mapreduce.ImportTsv.createSubmittableJob(ImportTsv.java:577)
at org.apache.hadoop.hbase.mapreduce.ImportTsv.run(ImportTsv.java:776)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76)
at org.apache.hadoop.hbase.mapreduce.ImportTsv.main(ImportTsv.java:789)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at
org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:71)
at org.apache.hadoop.util.ProgramDriver.run(ProgramDriver.java:144)
at org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:152)
... 11 more
Caused by: java.lang.ClassNotFoundException:
org.apache.hadoop.hbase.shaded.com.google.protobuf.Message
[jira] [Created] (HBASE-25049) HBase nightly client integration test is failing
Duo Zhang created HBASE-25049: - Summary: HBase nightly client integration test is failing Key: HBASE-25049 URL: https://issues.apache.org/jira/browse/HBASE-25049 Project: HBase Issue Type: Bug Components: test Reporter: Duo Zhang There are bunch of problems which leads to the failure. Plan to fix it in HBASE-25021 but finally I think we'd better have a separated issue for fixing the problem other than skipping hadoop 2 for master. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Reopened] (HBASE-25004) Log RegionTooBusyException details
[ https://issues.apache.org/jira/browse/HBASE-25004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Viraj Jasani reopened HBASE-25004: -- For branch-2.2 backport. > Log RegionTooBusyException details > -- > > Key: HBASE-25004 > URL: https://issues.apache.org/jira/browse/HBASE-25004 > Project: HBase > Issue Type: Task >Affects Versions: 1.6.0, 1.3.6 >Reporter: Viraj Jasani >Assignee: Viraj Jasani >Priority: Major > Fix For: 3.0.0-alpha-1, 1.7.0, 2.4.0, 2.3.2 > > Attachments: Screenshot 2020-09-09 at 2.32.02 PM.png > > > When we throw RegionTooBusyException, it gets wrapped in > RetriesExhaustedWithDetailsException at times and the original source doing > batch mutation might not be able to log region name and root cause that comes > with RegionTooBusyException as it is wrapped with outer > RetriesExhaustedWithDetailsException and outer Exception has it's own way of > logging only necessary info, which is quite acceptable. Attaching a sample > screenshot. > We should at least log details of RegionTooBusyException at server side > before we throw it. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[GitHub] [hbase] Joseph295 opened a new pull request #2408: HBASE-25047 WAL split edits number is negative in RegionServerUI
Joseph295 opened a new pull request #2408: URL: https://github.com/apache/hbase/pull/2408 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Resolved] (HBASE-25004) Log RegionTooBusyException details
[ https://issues.apache.org/jira/browse/HBASE-25004?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Viraj Jasani resolved HBASE-25004. -- Fix Version/s: 2.2.7 Resolution: Fixed > Log RegionTooBusyException details > -- > > Key: HBASE-25004 > URL: https://issues.apache.org/jira/browse/HBASE-25004 > Project: HBase > Issue Type: Task >Affects Versions: 1.6.0, 1.3.6 >Reporter: Viraj Jasani >Assignee: Viraj Jasani >Priority: Major > Fix For: 3.0.0-alpha-1, 1.7.0, 2.4.0, 2.2.7, 2.3.2 > > Attachments: Screenshot 2020-09-09 at 2.32.02 PM.png > > > When we throw RegionTooBusyException, it gets wrapped in > RetriesExhaustedWithDetailsException at times and the original source doing > batch mutation might not be able to log region name and root cause that comes > with RegionTooBusyException as it is wrapped with outer > RetriesExhaustedWithDetailsException and outer Exception has it's own way of > logging only necessary info, which is quite acceptable. Attaching a sample > screenshot. > We should at least log details of RegionTooBusyException at server side > before we throw it. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Reopened] (HBASE-24979) Include batch mutatations in client operation timeout tests
[ https://issues.apache.org/jira/browse/HBASE-24979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Viraj Jasani reopened HBASE-24979: -- Reopening for branch-2.2 backport. > Include batch mutatations in client operation timeout tests > --- > > Key: HBASE-24979 > URL: https://issues.apache.org/jira/browse/HBASE-24979 > Project: HBase > Issue Type: Test >Affects Versions: 1.7.0, 2.4.0 >Reporter: Viraj Jasani >Assignee: Viraj Jasani >Priority: Major > Fix For: 3.0.0-alpha-1, 2.4.0, 2.3.2 > > > While put, get and scan operations are included in client operation timeout > test, we should also include batch requests. batch() has different way of > handling operation timeout by passing it to AsyncProcessTask and then waiting > on async future response. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[GitHub] [hbase] Apache-HBase commented on pull request #2396: [Flaky Test][branch-1] TestFromClientSide#testCheckAndDeleteWithCompareOp
Apache-HBase commented on pull request #2396: URL: https://github.com/apache/hbase/pull/2396#issuecomment-693318229 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m 47s | Docker mode activated. | ||| _ Prechecks _ | | +1 :green_heart: | dupname | 0m 0s | No case conflicting files found. | | +1 :green_heart: | hbaseanti | 0m 0s | Patch does not have any anti-patterns. | | +1 :green_heart: | @author | 0m 0s | The patch does not contain any @author tags. | | +1 :green_heart: | test4tests | 0m 0s | The patch appears to include 1 new or modified test files. | ||| _ branch-1 Compile Tests _ | | +1 :green_heart: | mvninstall | 10m 40s | branch-1 passed | | +1 :green_heart: | compile | 0m 55s | branch-1 passed with JDK v1.8.0_262 | | +1 :green_heart: | compile | 1m 1s | branch-1 passed with JDK v1.7.0_272 | | +1 :green_heart: | checkstyle | 2m 0s | branch-1 passed | | +1 :green_heart: | shadedjars | 3m 9s | branch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 0m 49s | branch-1 passed with JDK v1.8.0_262 | | +1 :green_heart: | javadoc | 0m 45s | branch-1 passed with JDK v1.7.0_272 | | +0 :ok: | spotbugs | 3m 5s | Used deprecated FindBugs config; considering switching to SpotBugs. | | +1 :green_heart: | findbugs | 3m 0s | branch-1 passed | ||| _ Patch Compile Tests _ | | +1 :green_heart: | mvninstall | 1m 55s | the patch passed | | +1 :green_heart: | compile | 0m 39s | the patch passed with JDK v1.8.0_262 | | +1 :green_heart: | javac | 0m 39s | the patch passed | | +1 :green_heart: | compile | 0m 44s | the patch passed with JDK v1.7.0_272 | | +1 :green_heart: | javac | 0m 44s | the patch passed | | +1 :green_heart: | checkstyle | 1m 37s | the patch passed | | +1 :green_heart: | whitespace | 0m 0s | The patch has no whitespace issues. | | +1 :green_heart: | shadedjars | 2m 49s | patch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | hadoopcheck | 4m 39s | Patch does not cause any errors with Hadoop 2.8.5 2.9.2. | | +1 :green_heart: | javadoc | 0m 30s | the patch passed with JDK v1.8.0_262 | | +1 :green_heart: | javadoc | 0m 39s | the patch passed with JDK v1.7.0_272 | | +1 :green_heart: | findbugs | 2m 52s | the patch passed | ||| _ Other Tests _ | | -1 :x: | unit | 152m 14s | hbase-server in the patch failed. | | +1 :green_heart: | asflicense | 0m 44s | The patch does not generate ASF License warnings. | | | | 196m 22s | | | Reason | Tests | |---:|:--| | Failed junit tests | hadoop.hbase.mapreduce.TestImportExport | | | hadoop.hbase.replication.TestMasterReplication | | | hadoop.hbase.replication.TestReplicationStatus | | | hadoop.hbase.replication.regionserver.TestWALEntryStream | | | hadoop.hbase.util.TestHBaseFsck | | | hadoop.hbase.mapreduce.TestImportTsv | | | hadoop.hbase.replication.regionserver.TestRegionReplicaReplicationEndpointNoMaster | | | hadoop.hbase.mapreduce.TestMultiTableInputFormat | | Subsystem | Report/Notes | |--:|:-| | Docker | Client=19.03.12 Server=19.03.12 base: https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2396/2/artifact/out/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/2396 | | Optional Tests | dupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile | | uname | Linux f17d911748d6 4.15.0-60-generic #67-Ubuntu SMP Thu Aug 22 16:55:30 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | /home/jenkins/jenkins-home/workspace/Base-PreCommit-GitHub-PR_PR-2396/out/precommit/personality/provided.sh | | git revision | branch-1 / 7801b45 | | Default Java | 1.7.0_272 | | Multi-JDK versions | /usr/lib/jvm/zulu-8-amd64:1.8.0_262 /usr/lib/jvm/zulu-7-amd64:1.7.0_272 | | unit | https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2396/2/artifact/out/patch-unit-hbase-server.txt | | Test Results | https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2396/2/testReport/ | | Max. process+thread count | 4370 (vs. ulimit of 1) | | modules | C: hbase-server U: hbase-server | | Console output | https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2396/2/console | | versions | git=1.9.1 maven=3.0.5 findbugs=3.0.1 | | Powered by | Apache Yetus 0.11.1 https://yetus.apache.org | This message was automatically generated. --
[GitHub] [hbase] Apache9 opened a new pull request #2409: HBASE-25021 Nightly job should skip hadoop-2 integration test for master
Apache9 opened a new pull request #2409: URL: https://github.com/apache/hbase/pull/2409 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hbase] Apache9 commented on pull request #2409: HBASE-25021 Nightly job should skip hadoop-2 integration test for master
Apache9 commented on pull request #2409: URL: https://github.com/apache/hbase/pull/2409#issuecomment-693320347 Also fixed a problem for parsing version number when DEBUG is true This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Resolved] (HBASE-24979) Include batch mutatations in client operation timeout tests
[ https://issues.apache.org/jira/browse/HBASE-24979?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Viraj Jasani resolved HBASE-24979. -- Fix Version/s: 2.2.7 Resolution: Fixed > Include batch mutatations in client operation timeout tests > --- > > Key: HBASE-24979 > URL: https://issues.apache.org/jira/browse/HBASE-24979 > Project: HBase > Issue Type: Test >Affects Versions: 1.7.0, 2.4.0 >Reporter: Viraj Jasani >Assignee: Viraj Jasani >Priority: Major > Fix For: 3.0.0-alpha-1, 2.4.0, 2.2.7, 2.3.2 > > > While put, get and scan operations are included in client operation timeout > test, we should also include batch requests. batch() has different way of > handling operation timeout by passing it to AsyncProcessTask and then waiting > on async future response. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[GitHub] [hbase] Apache-HBase commented on pull request #2409: HBASE-25021 Nightly job should skip hadoop-2 integration test for master
Apache-HBase commented on pull request #2409: URL: https://github.com/apache/hbase/pull/2409#issuecomment-693323608 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 1m 16s | Docker mode activated. | ||| _ Prechecks _ | | +1 :green_heart: | dupname | 0m 0s | No case conflicting files found. | | +0 :ok: | shelldocs | 0m 1s | Shelldocs was not available. | | +1 :green_heart: | @author | 0m 0s | The patch does not contain any @author tags. | ||| _ master Compile Tests _ | | +0 :ok: | mvndep | 0m 21s | Maven dependency ordering for branch | ||| _ Patch Compile Tests _ | | +0 :ok: | mvndep | 0m 6s | Maven dependency ordering for patch | | +1 :green_heart: | shellcheck | 0m 1s | There were no new shellcheck issues. | | +1 :green_heart: | whitespace | 0m 0s | The patch has no whitespace issues. | ||| _ Other Tests _ | | +0 :ok: | asflicense | 0m 0s | ASF License check generated no output? | | | | 2m 53s | | | Subsystem | Report/Notes | |--:|:-| | Docker | Client=19.03.12 Server=19.03.12 base: https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2409/1/artifact/yetus-general-check/output/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/2409 | | Optional Tests | dupname asflicense shellcheck shelldocs | | uname | Linux 6f2b901dbe53 4.15.0-112-generic #113-Ubuntu SMP Thu Jul 9 23:41:39 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | dev-support/hbase-personality.sh | | git revision | master / a918bf0d7b | | Max. process+thread count | 45 (vs. ulimit of 12500) | | modules | C: U: | | Console output | https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2409/1/console | | versions | git=2.17.1 maven=(cecedd343002696d0abb50b32b541b8a6ba2883f) shellcheck=0.4.6 | | Powered by | Apache Yetus 0.11.1 https://yetus.apache.org | This message was automatically generated. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hbase] Apache-HBase commented on pull request #2409: HBASE-25021 Nightly job should skip hadoop-2 integration test for master
Apache-HBase commented on pull request #2409: URL: https://github.com/apache/hbase/pull/2409#issuecomment-693324530 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m 28s | Docker mode activated. | | -0 :warning: | yetus | 0m 3s | Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck | ||| _ Prechecks _ | ||| _ master Compile Tests _ | | +0 :ok: | mvndep | 0m 22s | Maven dependency ordering for branch | ||| _ Patch Compile Tests _ | | +0 :ok: | mvndep | 0m 7s | Maven dependency ordering for patch | ||| _ Other Tests _ | | | | 1m 53s | | | Subsystem | Report/Notes | |--:|:-| | Docker | Client=19.03.12 Server=19.03.12 base: https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2409/1/artifact/yetus-jdk8-hadoop3-check/output/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/2409 | | Optional Tests | | | uname | Linux 2df08e22194b 4.15.0-58-generic #64-Ubuntu SMP Tue Aug 6 11:12:41 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | dev-support/hbase-personality.sh | | git revision | master / a918bf0d7b | | Max. process+thread count | 52 (vs. ulimit of 12500) | | modules | C: U: | | Console output | https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2409/1/console | | versions | git=2.17.1 maven=(cecedd343002696d0abb50b32b541b8a6ba2883f) | | Powered by | Apache Yetus 0.11.1 https://yetus.apache.org | This message was automatically generated. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hbase] Apache-HBase commented on pull request #2407: HBASE-25037 Lots of thread pool are changed to non daemon after HBASE…
Apache-HBase commented on pull request #2407: URL: https://github.com/apache/hbase/pull/2407#issuecomment-693324856 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m 33s | Docker mode activated. | ||| _ Prechecks _ | | +1 :green_heart: | dupname | 0m 1s | No case conflicting files found. | | +1 :green_heart: | hbaseanti | 0m 0s | Patch does not have any anti-patterns. | | +1 :green_heart: | @author | 0m 0s | The patch does not contain any @author tags. | ||| _ master Compile Tests _ | | +0 :ok: | mvndep | 0m 22s | Maven dependency ordering for branch | | +1 :green_heart: | mvninstall | 3m 47s | master passed | | +1 :green_heart: | checkstyle | 3m 27s | master passed | | +1 :green_heart: | spotbugs | 6m 14s | master passed | ||| _ Patch Compile Tests _ | | +0 :ok: | mvndep | 0m 13s | Maven dependency ordering for patch | | +1 :green_heart: | mvninstall | 3m 37s | the patch passed | | +1 :green_heart: | checkstyle | 3m 10s | the patch passed | | +1 :green_heart: | whitespace | 0m 0s | The patch has no whitespace issues. | | +1 :green_heart: | hadoopcheck | 11m 22s | Patch does not cause any errors with Hadoop 3.1.2 3.2.1. | | +1 :green_heart: | spotbugs | 9m 7s | the patch passed | ||| _ Other Tests _ | | +1 :green_heart: | asflicense | 1m 32s | The patch does not generate ASF License warnings. | | | | 53m 11s | | | Subsystem | Report/Notes | |--:|:-| | Docker | Client=19.03.12 Server=19.03.12 base: https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2407/1/artifact/yetus-general-check/output/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/2407 | | Optional Tests | dupname asflicense spotbugs hadoopcheck hbaseanti checkstyle | | uname | Linux eb16d87b5b7f 4.15.0-58-generic #64-Ubuntu SMP Tue Aug 6 11:12:41 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | dev-support/hbase-personality.sh | | git revision | master / c5ca191921 | | Max. process+thread count | 94 (vs. ulimit of 12500) | | modules | C: hbase-client hbase-procedure hbase-server hbase-thrift hbase-backup hbase-it hbase-examples U: . | | Console output | https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2407/1/console | | versions | git=2.17.1 maven=(cecedd343002696d0abb50b32b541b8a6ba2883f) spotbugs=3.1.12 | | Powered by | Apache Yetus 0.11.1 https://yetus.apache.org | This message was automatically generated. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hbase] Apache-HBase commented on pull request #2409: HBASE-25021 Nightly job should skip hadoop-2 integration test for master
Apache-HBase commented on pull request #2409: URL: https://github.com/apache/hbase/pull/2409#issuecomment-693325049 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 1m 15s | Docker mode activated. | | -0 :warning: | yetus | 0m 3s | Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck | ||| _ Prechecks _ | ||| _ master Compile Tests _ | | +0 :ok: | mvndep | 0m 8s | Maven dependency ordering for branch | ||| _ Patch Compile Tests _ | | +0 :ok: | mvndep | 0m 7s | Maven dependency ordering for patch | ||| _ Other Tests _ | | | | 2m 25s | | | Subsystem | Report/Notes | |--:|:-| | Docker | Client=19.03.12 Server=19.03.12 base: https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2409/1/artifact/yetus-jdk11-hadoop3-check/output/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/2409 | | Optional Tests | | | uname | Linux cee25e0ffa89 4.15.0-112-generic #113-Ubuntu SMP Thu Jul 9 23:41:39 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | dev-support/hbase-personality.sh | | git revision | master / a918bf0d7b | | Max. process+thread count | 45 (vs. ulimit of 12500) | | modules | C: U: | | Console output | https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2409/1/console | | versions | git=2.17.1 maven=(cecedd343002696d0abb50b32b541b8a6ba2883f) | | Powered by | Apache Yetus 0.11.1 https://yetus.apache.org | This message was automatically generated. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Commented] (HBASE-25049) HBase nightly client integration test is failing
[
https://issues.apache.org/jira/browse/HBASE-25049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17196868#comment-17196868
]
Duo Zhang commented on HBASE-25049:
---
Copy the comment from HBASE-25021 here
https://ci-hadoop.apache.org/job/HBase/job/HBase%20Nightly/job/HBASE-25021/10/artifact/output-integration/hadoop-3/mr-importtsv.err/*view*/
{noformat}
/home/jenkins/jenkins-home/workspace/HBase_HBase_Nightly_HBASE-25021/hadoop-3/bin/hadoop
--config
/home/jenkins/jenkins-home/workspace/HBase_HBase_Nightly_HBASE-25021/output-integration/hadoop-3/hbase-conf/
jar
/home/jenkins/jenkins-home/workspace/HBase_HBase_Nightly_HBASE-25021/hbase-client/lib/shaded-clients/hbase-shaded-mapreduce-3.0.0-SNAPSHOT.jar
importtsv
-Dimporttsv.columns=HBASE_ROW_KEY,family1:column1,family1:column4,family1:column3
test:example example/ -libjars
/home/jenkins/jenkins-home/workspace/HBase_HBase_Nightly_HBASE-25021/hbase-client/bin/../lib/shaded-clients/hbase-shaded-mapreduce-3.0.0-SNAPSHOT.jar:/home/jenkins/jenkins-home/workspace/HBase_HBase_Nightly_HBASE-25021/hbase-client/bin/../lib/client-facing-thirdparty/audience-annotations-0.5.0.jar:/home/jenkins/jenkins-home/workspace/HBase_HBase_Nightly_HBASE-25021/hbase-client/bin/../lib/client-facing-thirdparty/commons-logging-1.2.jar:/home/jenkins/jenkins-home/workspace/HBase_HBase_Nightly_HBASE-25021/hbase-client/bin/../lib/client-facing-thirdparty/htrace-core4-4.2.0-incubating.jar:/home/jenkins/jenkins-home/workspace/HBase_HBase_Nightly_HBASE-25021/hbase-client/bin/../lib/client-facing-thirdparty/jcl-over-slf4j-1.7.30.jar:/home/jenkins/jenkins-home/workspace/HBase_HBase_Nightly_HBASE-25021/hbase-client/bin/../lib/client-facing-thirdparty/jul-to-slf4j-1.7.30.jar:/home/jenkins/jenkins-home/workspace/HBase_HBase_Nightly_HBASE-25021/hbase-client/bin/../lib/client-facing-thirdparty/log4j-1.2.17.jar:/home/jenkins/jenkins-home/workspace/HBase_HBase_Nightly_HBASE-25021/hbase-client/bin/../lib/client-facing-thirdparty/slf4j-api-1.7.30.jar
2020-09-16 09:37:44,565 INFO [main] client.AsyncConnectionImpl: Connection has
been closed by main.
2020-09-16 09:37:44,573 INFO [master-registry-refresh-end-points]
client.MasterAddressRefresher: Master end point refresher loop exited.
Exception in thread "main" java.lang.reflect.InvocationTargetException
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.hadoop.hbase.mapreduce.Driver.main(Driver.java:63)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.hadoop.util.RunJar.run(RunJar.java:318)
at org.apache.hadoop.util.RunJar.main(RunJar.java:232)
Caused by: java.lang.NoClassDefFoundError:
org/apache/hadoop/hbase/shaded/com/google/protobuf/Message
at
org.apache.hadoop.hbase.mapreduce.TableMapReduceUtil.addHBaseDependencyJars(TableMapReduceUtil.java:802)
at
org.apache.hadoop.hbase.mapreduce.TableMapReduceUtil.addDependencyJars(TableMapReduceUtil.java:857)
at
org.apache.hadoop.hbase.mapreduce.TableMapReduceUtil.initTableReducerJob(TableMapReduceUtil.java:743)
at
org.apache.hadoop.hbase.mapreduce.TableMapReduceUtil.initTableReducerJob(TableMapReduceUtil.java:678)
at
org.apache.hadoop.hbase.mapreduce.TableMapReduceUtil.initTableReducerJob(TableMapReduceUtil.java:647)
at
org.apache.hadoop.hbase.mapreduce.TableMapReduceUtil.initTableReducerJob(TableMapReduceUtil.java:630)
at
org.apache.hadoop.hbase.mapreduce.ImportTsv.createSubmittableJob(ImportTsv.java:577)
at org.apache.hadoop.hbase.mapreduce.ImportTsv.run(ImportTsv.java:776)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76)
at org.apache.hadoop.hbase.mapreduce.ImportTsv.main(ImportTsv.java:789)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at
org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:71)
at org.apache.hadoop.util.ProgramDriver.run(ProgramDriver.java:144)
at org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:152)
... 11 more
Caused by: java.lang.ClassNotFoundException:
org.apache.hadoop.hb
[jira] [Work started] (HBASE-25021) Nightly job should skip hadoop-2 integration test for master
[ https://issues.apache.org/jira/browse/HBASE-25021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Work on HBASE-25021 started by Duo Zhang. - > Nightly job should skip hadoop-2 integration test for master > > > Key: HBASE-25021 > URL: https://issues.apache.org/jira/browse/HBASE-25021 > Project: HBase > Issue Type: Bug > Components: build, scripts >Reporter: Duo Zhang >Assignee: Duo Zhang >Priority: Major > > Since master does not support hadoop 2.x any more. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Assigned] (HBASE-25021) Nightly job should skip hadoop-2 integration test for master
[ https://issues.apache.org/jira/browse/HBASE-25021?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang reassigned HBASE-25021: - Assignee: Duo Zhang > Nightly job should skip hadoop-2 integration test for master > > > Key: HBASE-25021 > URL: https://issues.apache.org/jira/browse/HBASE-25021 > Project: HBase > Issue Type: Bug > Components: build, scripts >Reporter: Duo Zhang >Assignee: Duo Zhang >Priority: Major > > Since master does not support hadoop 2.x any more. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Commented] (HBASE-25021) Nightly job should skip hadoop-2 integration test for master
[
https://issues.apache.org/jira/browse/HBASE-25021?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17196870#comment-17196870
]
Duo Zhang commented on HBASE-25021:
---
This is the related code
{code}
public static void addHBaseDependencyJars(Configuration conf) throws
IOException {
addDependencyJarsForClasses(conf,
// explicitly pull a class from each module
org.apache.hadoop.hbase.HConstants.class, //
hbase-common
org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos.class, //
hbase-protocol-shaded
org.apache.hadoop.hbase.client.Put.class, //
hbase-client
org.apache.hadoop.hbase.ipc.RpcServer.class, //
hbase-server
org.apache.hadoop.hbase.CompatibilityFactory.class,//
hbase-hadoop-compat
org.apache.hadoop.hbase.mapreduce.JobUtil.class, //
hbase-hadoop2-compat
org.apache.hadoop.hbase.mapreduce.TableMapper.class, //
hbase-mapreduce
org.apache.hadoop.hbase.metrics.impl.FastLongHistogram.class, //
hbase-metrics
org.apache.hadoop.hbase.metrics.Snapshot.class,//
hbase-metrics-api
org.apache.hadoop.hbase.replication.ReplicationUtils.class,//
hbase-replication
org.apache.hadoop.hbase.http.HttpServer.class, //
hbase-http
org.apache.hadoop.hbase.procedure2.Procedure.class,//
hbase-procedure
org.apache.hadoop.hbase.zookeeper.ZKWatcher.class, //
hbase-zookeeper
org.apache.hbase.thirdparty.com.google.common.collect.Lists.class, //
hb-shaded-miscellaneous
org.apache.hbase.thirdparty.com.google.gson.GsonBuilder.class, //
hbase-shaded-gson
org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations.class, //
hb-sh-protobuf
org.apache.hbase.thirdparty.io.netty.channel.Channel.class,//
hbase-shaded-netty
org.apache.zookeeper.ZooKeeper.class, //
zookeeper
com.google.protobuf.Message.class, // protobuf
org.apache.htrace.core.Tracer.class, // htrace
com.codahale.metrics.MetricRegistry.class, //
metrics-core
org.apache.commons.lang3.ArrayUtils.class);//
commons-lang
}
{code}
I guess the problem is that, after upgrading the maven shade plugin(IIRC I
upgrade it for addressing the problems when shading jetty), it also relocates
the com.google.protobuf.Message.class...
I think for master, we could just remove this line of code, since on master, we
do not have hbase-protocol any more which means we do not depend on non-shaded
protobuf any more. It is hadoop's duty to add the protobuf dependency for its
own.
> Nightly job should skip hadoop-2 integration test for master
>
>
> Key: HBASE-25021
> URL: https://issues.apache.org/jira/browse/HBASE-25021
> Project: HBase
> Issue Type: Bug
> Components: build, scripts
>Reporter: Duo Zhang
>Assignee: Duo Zhang
>Priority: Major
>
> Since master does not support hadoop 2.x any more.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HBASE-25049) HBase nightly client integration test is failing
[
https://issues.apache.org/jira/browse/HBASE-25049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17196873#comment-17196873
]
Duo Zhang commented on HBASE-25049:
---
This is the related code
{code}
public static void addHBaseDependencyJars(Configuration conf) throws
IOException {
addDependencyJarsForClasses(conf,
// explicitly pull a class from each module
org.apache.hadoop.hbase.HConstants.class, //
hbase-common
org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos.class, //
hbase-protocol-shaded
org.apache.hadoop.hbase.client.Put.class, //
hbase-client
org.apache.hadoop.hbase.ipc.RpcServer.class, //
hbase-server
org.apache.hadoop.hbase.CompatibilityFactory.class,//
hbase-hadoop-compat
org.apache.hadoop.hbase.mapreduce.JobUtil.class, //
hbase-hadoop2-compat
org.apache.hadoop.hbase.mapreduce.TableMapper.class, //
hbase-mapreduce
org.apache.hadoop.hbase.metrics.impl.FastLongHistogram.class, //
hbase-metrics
org.apache.hadoop.hbase.metrics.Snapshot.class,//
hbase-metrics-api
org.apache.hadoop.hbase.replication.ReplicationUtils.class,//
hbase-replication
org.apache.hadoop.hbase.http.HttpServer.class, //
hbase-http
org.apache.hadoop.hbase.procedure2.Procedure.class,//
hbase-procedure
org.apache.hadoop.hbase.zookeeper.ZKWatcher.class, //
hbase-zookeeper
org.apache.hbase.thirdparty.com.google.common.collect.Lists.class, //
hb-shaded-miscellaneous
org.apache.hbase.thirdparty.com.google.gson.GsonBuilder.class, //
hbase-shaded-gson
org.apache.hbase.thirdparty.com.google.protobuf.UnsafeByteOperations.class, //
hb-sh-protobuf
org.apache.hbase.thirdparty.io.netty.channel.Channel.class,//
hbase-shaded-netty
org.apache.zookeeper.ZooKeeper.class, //
zookeeper
com.google.protobuf.Message.class, // protobuf
org.apache.htrace.core.Tracer.class, // htrace
com.codahale.metrics.MetricRegistry.class, //
metrics-core
org.apache.commons.lang3.ArrayUtils.class);//
commons-lang
}
{code}
I guess the problem is that, after upgrading the maven shade plugin(IIRC I
upgrade it for addressing the problems when shading jetty), it also relocates
the com.google.protobuf.Message.class...
I think for master, we could just remove this line of code, since on master, we
do not have hbase-protocol any more which means we do not depend on non-shaded
protobuf any more. It is hadoop's duty to add the protobuf dependency for its
own.
> HBase nightly client integration test is failing
>
>
> Key: HBASE-25049
> URL: https://issues.apache.org/jira/browse/HBASE-25049
> Project: HBase
> Issue Type: Bug
> Components: test
>Reporter: Duo Zhang
>Priority: Major
>
> There are bunch of problems which leads to the failure. Plan to fix it in
> HBASE-25021 but finally I think we'd better have a separated issue for fixing
> the problem other than skipping hadoop 2 for master.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[GitHub] [hbase] wchevreuil commented on pull request #2400: HBASE-24877 addendum: additional checks to avoid one extra possible race control in the initialize loop
wchevreuil commented on pull request #2400: URL: https://github.com/apache/hbase/pull/2400#issuecomment-693335474 Ping @Apache9 , new commit addressing comments from PR 2399, together with additional test ensuring we don't block the main thread if initialization keeps failing. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hbase] Apache-HBase commented on pull request #2408: HBASE-25047 WAL split edits number is negative in RegionServerUI
Apache-HBase commented on pull request #2408: URL: https://github.com/apache/hbase/pull/2408#issuecomment-693337377 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 3m 5s | Docker mode activated. | ||| _ Prechecks _ | | +1 :green_heart: | dupname | 0m 0s | No case conflicting files found. | | +1 :green_heart: | hbaseanti | 0m 0s | Patch does not have any anti-patterns. | | +1 :green_heart: | @author | 0m 0s | The patch does not contain any @author tags. | ||| _ master Compile Tests _ | | +1 :green_heart: | mvninstall | 5m 1s | master passed | | +1 :green_heart: | checkstyle | 1m 24s | master passed | | +1 :green_heart: | spotbugs | 2m 45s | master passed | ||| _ Patch Compile Tests _ | | +1 :green_heart: | mvninstall | 4m 39s | the patch passed | | +1 :green_heart: | checkstyle | 1m 23s | the patch passed | | +1 :green_heart: | whitespace | 0m 0s | The patch has no whitespace issues. | | +1 :green_heart: | hadoopcheck | 14m 54s | Patch does not cause any errors with Hadoop 3.1.2 3.2.1. | | +1 :green_heart: | spotbugs | 3m 1s | the patch passed | ||| _ Other Tests _ | | +1 :green_heart: | asflicense | 0m 16s | The patch does not generate ASF License warnings. | | | | 45m 43s | | | Subsystem | Report/Notes | |--:|:-| | Docker | Client=19.03.12 Server=19.03.12 base: https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2408/1/artifact/yetus-general-check/output/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/2408 | | Optional Tests | dupname asflicense spotbugs hadoopcheck hbaseanti checkstyle | | uname | Linux dc5ee2c45f0b 4.15.0-112-generic #113-Ubuntu SMP Thu Jul 9 23:41:39 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | dev-support/hbase-personality.sh | | git revision | master / a918bf0d7b | | Max. process+thread count | 84 (vs. ulimit of 12500) | | modules | C: hbase-server U: hbase-server | | Console output | https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2408/1/console | | versions | git=2.17.1 maven=(cecedd343002696d0abb50b32b541b8a6ba2883f) spotbugs=3.1.12 | | Powered by | Apache Yetus 0.11.1 https://yetus.apache.org | This message was automatically generated. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Commented] (HBASE-25009) Hbck chore logs wrong message when loading regions from RS report
[
https://issues.apache.org/jira/browse/HBASE-25009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17196901#comment-17196901
]
Mohammad Arshad commented on HBASE-25009:
-
Thanks [~wchevreuil] for reviewing
Thanks [~zghao] for reviewing and merging it.
> Hbck chore logs wrong message when loading regions from RS report
> -
>
> Key: HBASE-25009
> URL: https://issues.apache.org/jira/browse/HBASE-25009
> Project: HBase
> Issue Type: Bug
>Affects Versions: 3.0.0-alpha-1, 2.3.1
>Reporter: Mohammad Arshad
>Assignee: Mohammad Arshad
>Priority: Minor
> Fix For: 3.0.0-alpha-1, 2.3.3, 2.4.0, 2.2.7
>
>
> {code:java}
> LOG.info("Loaded {} regions from {} regionservers' reports and found {}
> orphan regions",
> numRegions, rsReports.size(), orphanRegionsOnFS.size());
> {code}
> In above log message orphanRegionsOnFS.size() should be replaced with
> orphanRegionsOnRS.size() as the regions are loaded from RS not form FS
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[GitHub] [hbase] Apache-HBase commented on pull request #2404: HBASE-25023 NPE while shutdown master node
Apache-HBase commented on pull request #2404: URL: https://github.com/apache/hbase/pull/2404#issuecomment-693351434 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 3m 39s | Docker mode activated. | ||| _ Prechecks _ | | +1 :green_heart: | dupname | 0m 0s | No case conflicting files found. | | +1 :green_heart: | hbaseanti | 0m 0s | Patch does not have any anti-patterns. | | +1 :green_heart: | @author | 0m 0s | The patch does not contain any @author tags. | | -0 :warning: | test4tests | 0m 0s | The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. | ||| _ branch-2.2 Compile Tests _ | | +1 :green_heart: | mvninstall | 3m 32s | branch-2.2 passed | | +1 :green_heart: | compile | 0m 57s | branch-2.2 passed | | +1 :green_heart: | checkstyle | 1m 29s | branch-2.2 passed | | +1 :green_heart: | shadedjars | 4m 34s | branch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 0m 38s | branch-2.2 passed | | +0 :ok: | spotbugs | 3m 56s | Used deprecated FindBugs config; considering switching to SpotBugs. | | +1 :green_heart: | findbugs | 3m 52s | branch-2.2 passed | ||| _ Patch Compile Tests _ | | +1 :green_heart: | mvninstall | 3m 14s | the patch passed | | +1 :green_heart: | compile | 1m 13s | the patch passed | | +1 :green_heart: | javac | 1m 13s | the patch passed | | +1 :green_heart: | checkstyle | 1m 52s | the patch passed | | +1 :green_heart: | whitespace | 0m 0s | The patch has no whitespace issues. | | +1 :green_heart: | shadedjars | 4m 56s | patch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | hadoopcheck | 37m 46s | Patch does not cause any errors with Hadoop 2.8.5 2.9.2 2.10.0 or 3.1.2 3.2.1. | | +1 :green_heart: | javadoc | 0m 48s | the patch passed | | +1 :green_heart: | findbugs | 4m 42s | the patch passed | ||| _ Other Tests _ | | +1 :green_heart: | unit | 287m 5s | hbase-server in the patch passed. | | +1 :green_heart: | asflicense | 0m 32s | The patch does not generate ASF License warnings. | | | | 369m 37s | | | Subsystem | Report/Notes | |--:|:-| | Docker | Client=19.03.12 Server=19.03.12 base: https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2404/2/artifact/out/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/2404 | | Optional Tests | dupname asflicense javac javadoc unit spotbugs findbugs shadedjars hadoopcheck hbaseanti checkstyle compile | | uname | Linux 01a0e33f38a8 4.15.0-112-generic #113-Ubuntu SMP Thu Jul 9 23:41:39 UTC 2020 x86_64 GNU/Linux | | Build tool | maven | | Personality | /home/jenkins/jenkins-home/workspace/Base-PreCommit-GitHub-PR_PR-2404/out/precommit/personality/provided.sh | | git revision | branch-2.2 / 124fe190fd | | Default Java | 1.8.0_181 | | Test Results | https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2404/2/testReport/ | | Max. process+thread count | 2474 (vs. ulimit of 12500) | | modules | C: hbase-server U: hbase-server | | Console output | https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2404/2/console | | versions | git=2.11.0 maven=2018-06-17T18:33:14Z) findbugs=3.1.11 | | Powered by | Apache Yetus 0.11.1 https://yetus.apache.org | This message was automatically generated. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hbase] Apache-HBase commented on pull request #2400: HBASE-24877 addendum: additional checks to avoid one extra possible race control in the initialize loop
Apache-HBase commented on pull request #2400: URL: https://github.com/apache/hbase/pull/2400#issuecomment-693351724 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m 31s | Docker mode activated. | ||| _ Prechecks _ | | +1 :green_heart: | dupname | 0m 0s | No case conflicting files found. | | +1 :green_heart: | hbaseanti | 0m 0s | Patch does not have any anti-patterns. | | +1 :green_heart: | @author | 0m 0s | The patch does not contain any @author tags. | ||| _ master Compile Tests _ | | +1 :green_heart: | mvninstall | 3m 59s | master passed | | +1 :green_heart: | checkstyle | 1m 7s | master passed | | +1 :green_heart: | spotbugs | 2m 7s | master passed | ||| _ Patch Compile Tests _ | | +1 :green_heart: | mvninstall | 3m 33s | the patch passed | | -0 :warning: | checkstyle | 1m 4s | hbase-server: The patch generated 19 new + 2 unchanged - 0 fixed = 21 total (was 2) | | +1 :green_heart: | whitespace | 0m 0s | The patch has no whitespace issues. | | +1 :green_heart: | hadoopcheck | 13m 17s | Patch does not cause any errors with Hadoop 3.1.2 3.2.1. | | +1 :green_heart: | spotbugs | 2m 34s | the patch passed | ||| _ Other Tests _ | | +1 :green_heart: | asflicense | 0m 15s | The patch does not generate ASF License warnings. | | | | 37m 26s | | | Subsystem | Report/Notes | |--:|:-| | Docker | Client=19.03.12 Server=19.03.12 base: https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2400/2/artifact/yetus-general-check/output/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/2400 | | Optional Tests | dupname asflicense spotbugs hadoopcheck hbaseanti checkstyle | | uname | Linux 9ae9b20695fb 4.15.0-60-generic #67-Ubuntu SMP Thu Aug 22 16:55:30 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | dev-support/hbase-personality.sh | | git revision | master / a918bf0d7b | | checkstyle | https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2400/2/artifact/yetus-general-check/output/diff-checkstyle-hbase-server.txt | | Max. process+thread count | 94 (vs. ulimit of 12500) | | modules | C: hbase-server U: hbase-server | | Console output | https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2400/2/console | | versions | git=2.17.1 maven=(cecedd343002696d0abb50b32b541b8a6ba2883f) spotbugs=3.1.12 | | Powered by | Apache Yetus 0.11.1 https://yetus.apache.org | This message was automatically generated. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hbase] infraio merged pull request #2405: HBASE-25035 Add 2.2.6 to download page
infraio merged pull request #2405: URL: https://github.com/apache/hbase/pull/2405 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hbase] infraio commented on pull request #2405: HBASE-25035 Add 2.2.6 to download page
infraio commented on pull request #2405: URL: https://github.com/apache/hbase/pull/2405#issuecomment-693362803 @HorizonNet Thanks. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Resolved] (HBASE-25035) Add 2.2.6 to download page
[ https://issues.apache.org/jira/browse/HBASE-25035?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guanghao Zhang resolved HBASE-25035. Resolution: Fixed Merged. Thanks all for reviewing. > Add 2.2.6 to download page > -- > > Key: HBASE-25035 > URL: https://issues.apache.org/jira/browse/HBASE-25035 > Project: HBase > Issue Type: Sub-task >Reporter: Guanghao Zhang >Assignee: Guanghao Zhang >Priority: Major > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[GitHub] [hbase] infraio merged pull request #2406: HBASE-25036 Set version as 2.2.7-SNAPSHOT in branch-2.2
infraio merged pull request #2406: URL: https://github.com/apache/hbase/pull/2406 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Resolved] (HBASE-25036) Set version as 2.2.7-SNAPSHOT in branch-2.2
[ https://issues.apache.org/jira/browse/HBASE-25036?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guanghao Zhang resolved HBASE-25036. Fix Version/s: 2.2.7 Resolution: Fixed Merged. Thanks all for reviewing. > Set version as 2.2.7-SNAPSHOT in branch-2.2 > --- > > Key: HBASE-25036 > URL: https://issues.apache.org/jira/browse/HBASE-25036 > Project: HBase > Issue Type: Sub-task >Reporter: Guanghao Zhang >Assignee: Guanghao Zhang >Priority: Major > Fix For: 2.2.7 > > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[jira] [Resolved] (HBASE-24584) Release 2.2.6
[ https://issues.apache.org/jira/browse/HBASE-24584?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Guanghao Zhang resolved HBASE-24584. Resolution: Fixed > Release 2.2.6 > - > > Key: HBASE-24584 > URL: https://issues.apache.org/jira/browse/HBASE-24584 > Project: HBase > Issue Type: Umbrella >Reporter: Guanghao Zhang >Assignee: Guanghao Zhang >Priority: Major > -- This message was sent by Atlassian Jira (v8.3.4#803005)
[GitHub] [hbase] Apache-HBase commented on pull request #2077: HBASE-24684 Fetch ReplicationSink servers list from HMaster instead o…
Apache-HBase commented on pull request #2077: URL: https://github.com/apache/hbase/pull/2077#issuecomment-693374772 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 2m 14s | Docker mode activated. | ||| _ Prechecks _ | | +1 :green_heart: | dupname | 0m 0s | No case conflicting files found. | | +0 :ok: | prototool | 0m 0s | prototool was not available. | | +1 :green_heart: | hbaseanti | 0m 0s | Patch does not have any anti-patterns. | | +1 :green_heart: | @author | 0m 0s | The patch does not contain any @author tags. | ||| _ HBASE-24666 Compile Tests _ | | +0 :ok: | mvndep | 0m 45s | Maven dependency ordering for branch | | +1 :green_heart: | mvninstall | 4m 55s | HBASE-24666 passed | | +1 :green_heart: | checkstyle | 2m 10s | HBASE-24666 passed | | +1 :green_heart: | spotbugs | 7m 29s | HBASE-24666 passed | ||| _ Patch Compile Tests _ | | +0 :ok: | mvndep | 0m 14s | Maven dependency ordering for patch | | +1 :green_heart: | mvninstall | 4m 57s | the patch passed | | +1 :green_heart: | checkstyle | 0m 10s | The patch passed checkstyle in hbase-protocol-shaded | | +1 :green_heart: | checkstyle | 1m 21s | hbase-server: The patch generated 0 new + 186 unchanged - 2 fixed = 186 total (was 188) | | +1 :green_heart: | whitespace | 0m 0s | The patch has no whitespace issues. | | +1 :green_heart: | hadoopcheck | 13m 39s | Patch does not cause any errors with Hadoop 3.1.2 3.2.1. | | +1 :green_heart: | hbaseprotoc | 2m 2s | the patch passed | | +1 :green_heart: | spotbugs | 6m 49s | the patch passed | ||| _ Other Tests _ | | +1 :green_heart: | asflicense | 0m 21s | The patch does not generate ASF License warnings. | | | | 56m 56s | | | Subsystem | Report/Notes | |--:|:-| | Docker | Client=19.03.12 Server=19.03.12 base: https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2077/13/artifact/yetus-general-check/output/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/2077 | | Optional Tests | dupname asflicense cc hbaseprotoc prototool spotbugs hadoopcheck hbaseanti checkstyle | | uname | Linux 48799ccc4780 4.15.0-112-generic #113-Ubuntu SMP Thu Jul 9 23:41:39 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | dev-support/hbase-personality.sh | | git revision | HBASE-24666 / c302a9e600 | | Max. process+thread count | 84 (vs. ulimit of 12500) | | modules | C: hbase-protocol-shaded hbase-server U: . | | Console output | https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2077/13/console | | versions | git=2.17.1 maven=(cecedd343002696d0abb50b32b541b8a6ba2883f) spotbugs=3.1.12 | | Powered by | Apache Yetus 0.11.1 https://yetus.apache.org | This message was automatically generated. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Updated] (HBASE-25048) [HBCK2] Bypassed parent procedures are not updated in store
[
https://issues.apache.org/jira/browse/HBASE-25048?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Duo Zhang updated HBASE-25048:
--
Component/s: proc-v2
hbck2
> [HBCK2] Bypassed parent procedures are not updated in store
> ---
>
> Key: HBASE-25048
> URL: https://issues.apache.org/jira/browse/HBASE-25048
> Project: HBase
> Issue Type: Bug
> Components: hbck2, proc-v2
>Reporter: Yi Mei
>Assignee: Junhong Xu
>Priority: Major
>
> See code in
> [ProcedureExecutor|https://github.com/apache/hbase/blob/master/hbase-procedure/src/main/java/org/apache/hadoop/hbase/procedure2/ProcedureExecutor.java#L980]:
> {code:java}
> Procedure current = procedure;
> while (current != null) {
> LOG.debug("Bypassing {}", current);
> current.bypass(getEnvironment());
> store.update(procedure); // update current procedure
> long parentID = current.getParentProcId();
> current = getProcedure(parentID);
> }
> {code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[GitHub] [hbase] Apache9 commented on pull request #2408: HBASE-25047 WAL split edits number is negative in RegionServerUI
Apache9 commented on pull request #2408: URL: https://github.com/apache/hbase/pull/2408#issuecomment-693379374 Mind explaining a bit what is the problem here? This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Updated] (HBASE-25047) WAL split edits number is negative in RegionServerUI
[ https://issues.apache.org/jira/browse/HBASE-25047?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang updated HBASE-25047: -- Component/s: wal UI > WAL split edits number is negative in RegionServerUI > > > Key: HBASE-25047 > URL: https://issues.apache.org/jira/browse/HBASE-25047 > Project: HBase > Issue Type: Bug > Components: UI, wal >Reporter: Yi Mei >Assignee: Junhong Xu >Priority: Minor > Attachments: 2020-09-16 11-38-13屏幕截图.png > > > !2020-09-16 11-38-13屏幕截图.png! -- This message was sent by Atlassian Jira (v8.3.4#803005)
[GitHub] [hbase] Joseph295 commented on pull request #2408: HBASE-25047 WAL split edits number is negative in RegionServerUI
Joseph295 commented on pull request #2408: URL: https://github.com/apache/hbase/pull/2408#issuecomment-693382319 > Mind explaining a bit what is the problem here? The two continue in for-loop miss incrementing the editCount, which makes the negative count happen. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hbase] Apache9 commented on pull request #2408: HBASE-25047 WAL split edits number is negative in RegionServerUI
Apache9 commented on pull request #2408: URL: https://github.com/apache/hbase/pull/2408#issuecomment-693384087 Why missing incrementing could lead to negative count? How do we calculate the number on web UI? This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Commented] (HBASE-25014) ScheduledChore is never triggered when initalDelay > 1.5*period
[
https://issues.apache.org/jira/browse/HBASE-25014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17196949#comment-17196949
]
Hudson commented on HBASE-25014:
Results for branch master
[build #49 on
builds.a.o|https://ci-hadoop.apache.org/job/HBase/job/HBase%20Nightly/job/master/49/]:
(x) *{color:red}-1 overall{color}*
details (if available):
(/) {color:green}+1 general checks{color}
-- For more information [see general
report|https://ci-hadoop.apache.org/job/HBase/job/HBase%20Nightly/job/master/49/General_20Nightly_20Build_20Report/]
(x) {color:red}-1 jdk8 hadoop3 checks{color}
-- For more information [see jdk8 (hadoop3)
report|https://ci-hadoop.apache.org/job/HBase/job/HBase%20Nightly/job/master/49/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/]
(x) {color:red}-1 jdk11 hadoop3 checks{color}
-- For more information [see jdk11
report|https://ci-hadoop.apache.org/job/HBase/job/HBase%20Nightly/job/master/49/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/]
(/) {color:green}+1 source release artifact{color}
-- See build output for details.
(x) {color:red}-1 client integration test{color}
--Failed when running client tests on top of Hadoop 2. [see log for
details|https://ci-hadoop.apache.org/job/HBase/job/HBase%20Nightly/job/master/49//artifact/output-integration/hadoop-2.log].
(note that this means we didn't run on Hadoop 3)
> ScheduledChore is never triggered when initalDelay > 1.5*period
> ---
>
> Key: HBASE-25014
> URL: https://issues.apache.org/jira/browse/HBASE-25014
> Project: HBase
> Issue Type: Bug
>Affects Versions: 3.0.0-alpha-1, 2.2.3, 2.2.4, 2.2.5
>Reporter: Sun Xin
>Assignee: Sun Xin
>Priority: Major
> Fix For: 3.0.0-alpha-1, 2.3.3, 2.4.0, 2.2.7
>
>
> In our recent tests, ScheduledChore is never triggered when initalDelay >
> 1.5*period.
> The cause of the bug is the following:
> The trigger time for a ScheduleChore must be within an acceptable time window
> that is 1.5 * period. see
> [here|https://github.com/apache/hbase/blob/e5ca9adc54f9f580f85d21d38217afa97aa79d68/hbase-common/src/main/java/org/apache/hadoop/hbase/ScheduledChore.java#L234]
> timeOfLastRun and timeOfThisRun are two variables that record two adjacent
> trigger time. [The first initialization of
> timeOfThisRun|https://github.com/apache/hbase/blob/e5ca9adc54f9f580f85d21d38217afa97aa79d68/hbase-common/src/main/java/org/apache/hadoop/hbase/ScheduledChore.java#L273]
> is when the ScheduleChore is created, it's not a real trigger time.
> If we set initialDelay > 1.5 period , after initialDelay, the first time when
> chore is triggered has exceeded the allowed window. Then [cancel the chore
> and schedule it
> again|https://github.com/apache/hbase/blob/e5ca9adc54f9f580f85d21d38217afa97aa79d68/hbase-common/src/main/java/org/apache/hadoop/hbase/ChoreService.java#L176].
> So it's stuck in loop when initialDelay > 1.5 period :
> 1. init timeOfThisRun at a wrong time.
> 2. wait initalDelay
> 3. chore trigger, but exceeded the allowed window.
> 4. cancel chore and schedule it again
> 5. go step 1.
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HBASE-24875) Remove the force param for unassign since it dose not take effect any more
[
https://issues.apache.org/jira/browse/HBASE-24875?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17196951#comment-17196951
]
Hudson commented on HBASE-24875:
Results for branch master
[build #49 on
builds.a.o|https://ci-hadoop.apache.org/job/HBase/job/HBase%20Nightly/job/master/49/]:
(x) *{color:red}-1 overall{color}*
details (if available):
(/) {color:green}+1 general checks{color}
-- For more information [see general
report|https://ci-hadoop.apache.org/job/HBase/job/HBase%20Nightly/job/master/49/General_20Nightly_20Build_20Report/]
(x) {color:red}-1 jdk8 hadoop3 checks{color}
-- For more information [see jdk8 (hadoop3)
report|https://ci-hadoop.apache.org/job/HBase/job/HBase%20Nightly/job/master/49/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/]
(x) {color:red}-1 jdk11 hadoop3 checks{color}
-- For more information [see jdk11
report|https://ci-hadoop.apache.org/job/HBase/job/HBase%20Nightly/job/master/49/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/]
(/) {color:green}+1 source release artifact{color}
-- See build output for details.
(x) {color:red}-1 client integration test{color}
--Failed when running client tests on top of Hadoop 2. [see log for
details|https://ci-hadoop.apache.org/job/HBase/job/HBase%20Nightly/job/master/49//artifact/output-integration/hadoop-2.log].
(note that this means we didn't run on Hadoop 3)
> Remove the force param for unassign since it dose not take effect any more
> --
>
> Key: HBASE-24875
> URL: https://issues.apache.org/jira/browse/HBASE-24875
> Project: HBase
> Issue Type: Improvement
> Components: Client
>Reporter: Zheng Wang
>Assignee: Zheng Wang
>Priority: Major
> Fix For: 3.0.0-alpha-1
>
>
> Currently unassign region in fact only close it, so not need force param any
> more.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[jira] [Commented] (HBASE-25009) Hbck chore logs wrong message when loading regions from RS report
[
https://issues.apache.org/jira/browse/HBASE-25009?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17196950#comment-17196950
]
Hudson commented on HBASE-25009:
Results for branch master
[build #49 on
builds.a.o|https://ci-hadoop.apache.org/job/HBase/job/HBase%20Nightly/job/master/49/]:
(x) *{color:red}-1 overall{color}*
details (if available):
(/) {color:green}+1 general checks{color}
-- For more information [see general
report|https://ci-hadoop.apache.org/job/HBase/job/HBase%20Nightly/job/master/49/General_20Nightly_20Build_20Report/]
(x) {color:red}-1 jdk8 hadoop3 checks{color}
-- For more information [see jdk8 (hadoop3)
report|https://ci-hadoop.apache.org/job/HBase/job/HBase%20Nightly/job/master/49/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/]
(x) {color:red}-1 jdk11 hadoop3 checks{color}
-- For more information [see jdk11
report|https://ci-hadoop.apache.org/job/HBase/job/HBase%20Nightly/job/master/49/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/]
(/) {color:green}+1 source release artifact{color}
-- See build output for details.
(x) {color:red}-1 client integration test{color}
--Failed when running client tests on top of Hadoop 2. [see log for
details|https://ci-hadoop.apache.org/job/HBase/job/HBase%20Nightly/job/master/49//artifact/output-integration/hadoop-2.log].
(note that this means we didn't run on Hadoop 3)
> Hbck chore logs wrong message when loading regions from RS report
> -
>
> Key: HBASE-25009
> URL: https://issues.apache.org/jira/browse/HBASE-25009
> Project: HBase
> Issue Type: Bug
>Affects Versions: 3.0.0-alpha-1, 2.3.1
>Reporter: Mohammad Arshad
>Assignee: Mohammad Arshad
>Priority: Minor
> Fix For: 3.0.0-alpha-1, 2.3.3, 2.4.0, 2.2.7
>
>
> {code:java}
> LOG.info("Loaded {} regions from {} regionservers' reports and found {}
> orphan regions",
> numRegions, rsReports.size(), orphanRegionsOnFS.size());
> {code}
> In above log message orphanRegionsOnFS.size() should be replaced with
> orphanRegionsOnRS.size() as the regions are loaded from RS not form FS
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[GitHub] [hbase] Apache-HBase commented on pull request #2407: HBASE-25037 Lots of thread pool are changed to non daemon after HBASE…
Apache-HBase commented on pull request #2407: URL: https://github.com/apache/hbase/pull/2407#issuecomment-693392736 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 1m 8s | Docker mode activated. | | -0 :warning: | yetus | 0m 3s | Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck | ||| _ Prechecks _ | ||| _ master Compile Tests _ | | +0 :ok: | mvndep | 0m 22s | Maven dependency ordering for branch | | +1 :green_heart: | mvninstall | 4m 9s | master passed | | +1 :green_heart: | compile | 3m 55s | master passed | | +1 :green_heart: | shadedjars | 6m 37s | branch has no errors when building our shaded downstream artifacts. | | -0 :warning: | javadoc | 0m 22s | hbase-backup in master failed. | | -0 :warning: | javadoc | 0m 26s | hbase-client in master failed. | | -0 :warning: | javadoc | 0m 23s | hbase-examples in master failed. | | -0 :warning: | javadoc | 0m 18s | hbase-procedure in master failed. | | -0 :warning: | javadoc | 0m 40s | hbase-server in master failed. | | -0 :warning: | javadoc | 0m 50s | hbase-thrift in master failed. | ||| _ Patch Compile Tests _ | | +0 :ok: | mvndep | 0m 15s | Maven dependency ordering for patch | | +1 :green_heart: | mvninstall | 4m 0s | the patch passed | | +1 :green_heart: | compile | 3m 55s | the patch passed | | +1 :green_heart: | javac | 3m 55s | the patch passed | | +1 :green_heart: | shadedjars | 6m 33s | patch has no errors when building our shaded downstream artifacts. | | -0 :warning: | javadoc | 0m 27s | hbase-client in the patch failed. | | -0 :warning: | javadoc | 0m 18s | hbase-procedure in the patch failed. | | -0 :warning: | javadoc | 0m 40s | hbase-server in the patch failed. | | -0 :warning: | javadoc | 0m 52s | hbase-thrift in the patch failed. | | -0 :warning: | javadoc | 0m 20s | hbase-backup in the patch failed. | | -0 :warning: | javadoc | 0m 24s | hbase-examples in the patch failed. | ||| _ Other Tests _ | | +1 :green_heart: | unit | 1m 8s | hbase-client in the patch passed. | | +1 :green_heart: | unit | 1m 37s | hbase-procedure in the patch passed. | | +1 :green_heart: | unit | 134m 45s | hbase-server in the patch passed. | | +1 :green_heart: | unit | 4m 40s | hbase-thrift in the patch passed. | | +1 :green_heart: | unit | 11m 23s | hbase-backup in the patch passed. | | +1 :green_heart: | unit | 1m 14s | hbase-it in the patch passed. | | +1 :green_heart: | unit | 1m 45s | hbase-examples in the patch passed. | | | | 197m 27s | | | Subsystem | Report/Notes | |--:|:-| | Docker | Client=19.03.12 Server=19.03.12 base: https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2407/1/artifact/yetus-jdk11-hadoop3-check/output/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/2407 | | Optional Tests | javac javadoc unit shadedjars compile | | uname | Linux 350fc860f0c5 4.15.0-65-generic #74-Ubuntu SMP Tue Sep 17 17:06:04 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | dev-support/hbase-personality.sh | | git revision | master / c5ca191921 | | Default Java | 2020-01-14 | | javadoc | https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2407/1/artifact/yetus-jdk11-hadoop3-check/output/branch-javadoc-hbase-backup.txt | | javadoc | https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2407/1/artifact/yetus-jdk11-hadoop3-check/output/branch-javadoc-hbase-client.txt | | javadoc | https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2407/1/artifact/yetus-jdk11-hadoop3-check/output/branch-javadoc-hbase-examples.txt | | javadoc | https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2407/1/artifact/yetus-jdk11-hadoop3-check/output/branch-javadoc-hbase-procedure.txt | | javadoc | https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2407/1/artifact/yetus-jdk11-hadoop3-check/output/branch-javadoc-hbase-server.txt | | javadoc | https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2407/1/artifact/yetus-jdk11-hadoop3-check/output/branch-javadoc-hbase-thrift.txt | | javadoc | https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2407/1/artifact/yetus-jdk11-hadoop3-check/output/patch-javadoc-hbase-client.txt | | javadoc | https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2407/1/artifact/yetus-jdk11-hadoop3-check/output/p
[GitHub] [hbase] Apache-HBase commented on pull request #2407: HBASE-25037 Lots of thread pool are changed to non daemon after HBASE…
Apache-HBase commented on pull request #2407: URL: https://github.com/apache/hbase/pull/2407#issuecomment-693393892 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m 33s | Docker mode activated. | | -0 :warning: | yetus | 0m 3s | Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck | ||| _ Prechecks _ | ||| _ master Compile Tests _ | | +0 :ok: | mvndep | 0m 22s | Maven dependency ordering for branch | | +1 :green_heart: | mvninstall | 3m 46s | master passed | | +1 :green_heart: | compile | 3m 39s | master passed | | +1 :green_heart: | shadedjars | 6m 46s | branch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 2m 43s | master passed | ||| _ Patch Compile Tests _ | | +0 :ok: | mvndep | 0m 15s | Maven dependency ordering for patch | | +1 :green_heart: | mvninstall | 3m 35s | the patch passed | | +1 :green_heart: | compile | 3m 32s | the patch passed | | +1 :green_heart: | javac | 3m 32s | the patch passed | | +1 :green_heart: | shadedjars | 6m 31s | patch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 2m 38s | the patch passed | ||| _ Other Tests _ | | +1 :green_heart: | unit | 1m 5s | hbase-client in the patch passed. | | +1 :green_heart: | unit | 1m 44s | hbase-procedure in the patch passed. | | -1 :x: | unit | 140m 48s | hbase-server in the patch failed. | | +1 :green_heart: | unit | 4m 13s | hbase-thrift in the patch passed. | | +1 :green_heart: | unit | 10m 36s | hbase-backup in the patch passed. | | +1 :green_heart: | unit | 1m 12s | hbase-it in the patch passed. | | +1 :green_heart: | unit | 1m 58s | hbase-examples in the patch passed. | | | | 199m 24s | | | Subsystem | Report/Notes | |--:|:-| | Docker | Client=19.03.12 Server=19.03.12 base: https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2407/1/artifact/yetus-jdk8-hadoop3-check/output/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/2407 | | Optional Tests | javac javadoc unit shadedjars compile | | uname | Linux 4d26deb3b18d 4.15.0-58-generic #64-Ubuntu SMP Tue Aug 6 11:12:41 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | dev-support/hbase-personality.sh | | git revision | master / c5ca191921 | | Default Java | 1.8.0_232 | | unit | https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2407/1/artifact/yetus-jdk8-hadoop3-check/output/patch-unit-hbase-server.txt | | Test Results | https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2407/1/testReport/ | | Max. process+thread count | 4811 (vs. ulimit of 12500) | | modules | C: hbase-client hbase-procedure hbase-server hbase-thrift hbase-backup hbase-it hbase-examples U: . | | Console output | https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2407/1/console | | versions | git=2.17.1 maven=(cecedd343002696d0abb50b32b541b8a6ba2883f) | | Powered by | Apache Yetus 0.11.1 https://yetus.apache.org | This message was automatically generated. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hbase] Apache9 merged pull request #2407: HBASE-25037 Lots of thread pool are changed to non daemon after HBASE…
Apache9 merged pull request #2407: URL: https://github.com/apache/hbase/pull/2407 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hbase] Apache-HBase commented on pull request #2408: HBASE-25047 WAL split edits number is negative in RegionServerUI
Apache-HBase commented on pull request #2408: URL: https://github.com/apache/hbase/pull/2408#issuecomment-693403081 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m 52s | Docker mode activated. | | -0 :warning: | yetus | 0m 3s | Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck | ||| _ Prechecks _ | ||| _ master Compile Tests _ | | +1 :green_heart: | mvninstall | 4m 10s | master passed | | +1 :green_heart: | compile | 1m 4s | master passed | | +1 :green_heart: | shadedjars | 7m 52s | branch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 0m 41s | master passed | ||| _ Patch Compile Tests _ | | +1 :green_heart: | mvninstall | 3m 50s | the patch passed | | +1 :green_heart: | compile | 1m 4s | the patch passed | | +1 :green_heart: | javac | 1m 4s | the patch passed | | +1 :green_heart: | shadedjars | 7m 40s | patch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 0m 42s | the patch passed | ||| _ Other Tests _ | | +1 :green_heart: | unit | 149m 31s | hbase-server in the patch passed. | | | | 179m 30s | | | Subsystem | Report/Notes | |--:|:-| | Docker | Client=19.03.12 Server=19.03.12 base: https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2408/1/artifact/yetus-jdk8-hadoop3-check/output/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/2408 | | Optional Tests | javac javadoc unit shadedjars compile | | uname | Linux e6427e849d44 4.15.0-60-generic #67-Ubuntu SMP Thu Aug 22 16:55:30 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | dev-support/hbase-personality.sh | | git revision | master / a918bf0d7b | | Default Java | 1.8.0_232 | | Test Results | https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2408/1/testReport/ | | Max. process+thread count | 3781 (vs. ulimit of 12500) | | modules | C: hbase-server U: hbase-server | | Console output | https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2408/1/console | | versions | git=2.17.1 maven=(cecedd343002696d0abb50b32b541b8a6ba2883f) | | Powered by | Apache Yetus 0.11.1 https://yetus.apache.org | This message was automatically generated. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Created] (HBASE-25050) We initialize Filesystems more than once.
ramkrishna.s.vasudevan created HBASE-25050:
--
Summary: We initialize Filesystems more than once.
Key: HBASE-25050
URL: https://issues.apache.org/jira/browse/HBASE-25050
Project: HBase
Issue Type: Bug
Affects Versions: 2.2.6, 2.3.1, 3.0.0-alpha-1, 2.4.0
Reporter: ramkrishna.s.vasudevan
Assignee: ramkrishna.s.vasudevan
In HFileSystem
{code}
// Create the default filesystem with checksum verification switched on.
// By default, any operation to this FilterFileSystem occurs on
// the underlying filesystem that has checksums switched on.
this.fs = FileSystem.get(conf);
this.useHBaseChecksum = useHBaseChecksum;
fs.initialize(getDefaultUri(conf), conf);
{code}
We call fs.initialize(). Generally the FS would have been created and inited
either in the FileSystem.get() call above or even when we try to check
{code}
FileSystem fs = p.getFileSystem(c);
{code}
The FS that gets cached in the hadoop-common layer does the init for us. So we
doing it again is redundant.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[GitHub] [hbase] Apache-HBase commented on pull request #2400: HBASE-24877 addendum: additional checks to avoid one extra possible race control in the initialize loop
Apache-HBase commented on pull request #2400: URL: https://github.com/apache/hbase/pull/2400#issuecomment-693414753 :confetti_ball: **+1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 0m 27s | Docker mode activated. | | -0 :warning: | yetus | 0m 3s | Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck | ||| _ Prechecks _ | ||| _ master Compile Tests _ | | +1 :green_heart: | mvninstall | 4m 17s | master passed | | +1 :green_heart: | compile | 1m 7s | master passed | | +1 :green_heart: | shadedjars | 6m 35s | branch has no errors when building our shaded downstream artifacts. | | -0 :warning: | javadoc | 0m 42s | hbase-server in master failed. | ||| _ Patch Compile Tests _ | | +1 :green_heart: | mvninstall | 3m 59s | the patch passed | | +1 :green_heart: | compile | 1m 6s | the patch passed | | +1 :green_heart: | javac | 1m 6s | the patch passed | | +1 :green_heart: | shadedjars | 6m 37s | patch has no errors when building our shaded downstream artifacts. | | -0 :warning: | javadoc | 0m 41s | hbase-server in the patch failed. | ||| _ Other Tests _ | | +1 :green_heart: | unit | 129m 14s | hbase-server in the patch passed. | | | | 156m 55s | | | Subsystem | Report/Notes | |--:|:-| | Docker | Client=19.03.12 Server=19.03.12 base: https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2400/2/artifact/yetus-jdk11-hadoop3-check/output/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/2400 | | Optional Tests | javac javadoc unit shadedjars compile | | uname | Linux 33b52c393b75 4.15.0-58-generic #64-Ubuntu SMP Tue Aug 6 11:12:41 UTC 2019 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | dev-support/hbase-personality.sh | | git revision | master / a918bf0d7b | | Default Java | 2020-01-14 | | javadoc | https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2400/2/artifact/yetus-jdk11-hadoop3-check/output/branch-javadoc-hbase-server.txt | | javadoc | https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2400/2/artifact/yetus-jdk11-hadoop3-check/output/patch-javadoc-hbase-server.txt | | Test Results | https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2400/2/testReport/ | | Max. process+thread count | 4045 (vs. ulimit of 12500) | | modules | C: hbase-server U: hbase-server | | Console output | https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2400/2/console | | versions | git=2.17.1 maven=(cecedd343002696d0abb50b32b541b8a6ba2883f) | | Powered by | Apache Yetus 0.11.1 https://yetus.apache.org | This message was automatically generated. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hbase] Joseph295 commented on pull request #2408: HBASE-25047 WAL split edits number is negative in RegionServerUI
Joseph295 commented on pull request #2408: URL: https://github.com/apache/hbase/pull/2408#issuecomment-693419914 > Why missing incrementing could lead to negative count? How do we calculate the number on web UI? The wrong info is from the following: ` String countsStr = (editsCount - (editsSkipped + outputSink.getTotalSkippedEdits())) + " edits, skipped " + editsSkipped + " edits.";` Here is my understanding, correct me if I am wrong: The editsCount is the count of all edits, editsSkipped is the count of skipped edits before sinking, outputSink.getTotalSkippedEdits() is the skipped edits when sinking. So the later two: editsSkipped and outputSink.getTotalSkippedEdits() are parts of editsCount.But in our current repo, we will miss incrementing editsCount when skipping edits condition fits , as we continue and run the next loop and the increment is not executed yet. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hbase] Apache9 commented on pull request #2408: HBASE-25047 WAL split edits number is negative in RegionServerUI
Apache9 commented on pull request #2408: URL: https://github.com/apache/hbase/pull/2408#issuecomment-693427109 OK, got it. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Resolved] (HBASE-25037) Lots of thread pool are changed to non daemon after HBASE-24750 which causes trouble when shutting down
[ https://issues.apache.org/jira/browse/HBASE-25037?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang resolved HBASE-25037. --- Hadoop Flags: Reviewed Resolution: Fixed Pushed to master and branch-2. Thanks [~vjasani] for reviewing. > Lots of thread pool are changed to non daemon after HBASE-24750 which causes > trouble when shutting down > --- > > Key: HBASE-25037 > URL: https://issues.apache.org/jira/browse/HBASE-25037 > Project: HBase > Issue Type: Improvement >Reporter: Duo Zhang >Assignee: Duo Zhang >Priority: Major > Fix For: 3.0.0-alpha-1, 2.4.0 > > > We replace Threads.newDaemonThreadFactory with guava ThreadFactoryBuilder but > miss the setDaemon call, which causes our client integration test to fail > because of hbase shell can never quit cleanly. > We should add the setDaemon back for those thread factories. -- This message was sent by Atlassian Jira (v8.3.4#803005)
[GitHub] [hbase] Apache-HBase commented on pull request #2409: HBASE-25021 Nightly job should skip hadoop-2 integration test for master
Apache-HBase commented on pull request #2409: URL: https://github.com/apache/hbase/pull/2409#issuecomment-693437320 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hbase] Apache-HBase commented on pull request #2408: HBASE-25047 WAL split edits number is negative in RegionServerUI
Apache-HBase commented on pull request #2408: URL: https://github.com/apache/hbase/pull/2408#issuecomment-693450240 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 2m 24s | Docker mode activated. | | -0 :warning: | yetus | 0m 3s | Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck | ||| _ Prechecks _ | ||| _ master Compile Tests _ | | +1 :green_heart: | mvninstall | 6m 19s | master passed | | +1 :green_heart: | compile | 1m 36s | master passed | | +1 :green_heart: | shadedjars | 9m 0s | branch has no errors when building our shaded downstream artifacts. | | -0 :warning: | javadoc | 0m 58s | hbase-server in master failed. | ||| _ Patch Compile Tests _ | | +1 :green_heart: | mvninstall | 6m 16s | the patch passed | | +1 :green_heart: | compile | 1m 37s | the patch passed | | +1 :green_heart: | javac | 1m 37s | the patch passed | | +1 :green_heart: | shadedjars | 9m 14s | patch has no errors when building our shaded downstream artifacts. | | -0 :warning: | javadoc | 0m 53s | hbase-server in the patch failed. | ||| _ Other Tests _ | | -1 :x: | unit | 212m 44s | hbase-server in the patch failed. | | | | 253m 19s | | | Subsystem | Report/Notes | |--:|:-| | Docker | Client=19.03.12 Server=19.03.12 base: https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2408/1/artifact/yetus-jdk11-hadoop3-check/output/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/2408 | | Optional Tests | javac javadoc unit shadedjars compile | | uname | Linux 0293133b98bf 4.15.0-112-generic #113-Ubuntu SMP Thu Jul 9 23:41:39 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | dev-support/hbase-personality.sh | | git revision | master / a918bf0d7b | | Default Java | 2020-01-14 | | javadoc | https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2408/1/artifact/yetus-jdk11-hadoop3-check/output/branch-javadoc-hbase-server.txt | | javadoc | https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2408/1/artifact/yetus-jdk11-hadoop3-check/output/patch-javadoc-hbase-server.txt | | unit | https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2408/1/artifact/yetus-jdk11-hadoop3-check/output/patch-unit-hbase-server.txt | | Test Results | https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2408/1/testReport/ | | Max. process+thread count | 3358 (vs. ulimit of 12500) | | modules | C: hbase-server U: hbase-server | | Console output | https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2408/1/console | | versions | git=2.17.1 maven=(cecedd343002696d0abb50b32b541b8a6ba2883f) | | Powered by | Apache Yetus 0.11.1 https://yetus.apache.org | This message was automatically generated. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[GitHub] [hbase] Apache-HBase commented on pull request #2406: HBASE-25036 Set version as 2.2.7-SNAPSHOT in branch-2.2
Apache-HBase commented on pull request #2406: URL: https://github.com/apache/hbase/pull/2406#issuecomment-693456379 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 3m 57s | Docker mode activated. | ||| _ Prechecks _ | | +1 :green_heart: | dupname | 0m 1s | No case conflicting files found. | | +1 :green_heart: | @author | 0m 0s | The patch does not contain any @author tags. | | -0 :warning: | test4tests | 0m 0s | The patch doesn't appear to include any new or modified tests. Please justify why no new tests are needed for this patch. Also please list what manual steps were performed to verify this patch. | ||| _ branch-2.2 Compile Tests _ | | +0 :ok: | mvndep | 1m 5s | Maven dependency ordering for branch | | +1 :green_heart: | mvninstall | 3m 6s | branch-2.2 passed | | +1 :green_heart: | compile | 2m 1s | branch-2.2 passed | | +1 :green_heart: | checkstyle | 2m 17s | branch-2.2 passed | | +1 :green_heart: | shadedjars | 4m 5s | branch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 12m 38s | branch-2.2 passed | ||| _ Patch Compile Tests _ | | +1 :green_heart: | mvninstall | 2m 52s | branch-2.2 passed | | +0 :ok: | mvndep | 3m 17s | Maven dependency ordering for patch | | +1 :green_heart: | mvninstall | 3m 0s | the patch passed | | +1 :green_heart: | compile | 1m 55s | the patch passed | | +1 :green_heart: | javac | 1m 55s | the patch passed | | +1 :green_heart: | checkstyle | 2m 11s | the patch passed | | +1 :green_heart: | whitespace | 0m 0s | The patch has no whitespace issues. | | +1 :green_heart: | xml | 0m 56s | The patch has no ill-formed XML file. | | +1 :green_heart: | shadedjars | 4m 0s | patch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | hadoopcheck | 25m 10s | Patch does not cause any errors with Hadoop 2.8.5 2.9.2 2.10.0 or 3.1.2 3.2.1. | | +1 :green_heart: | javadoc | 13m 7s | the patch passed | ||| _ Other Tests _ | | -1 :x: | unit | 292m 43s | root in the patch failed. | | +1 :green_heart: | asflicense | 22m 9s | The patch does not generate ASF License warnings. | | | | 409m 15s | | | Reason | Tests | |---:|:--| | Failed junit tests | hadoop.hbase.client.TestAdmin | | Subsystem | Report/Notes | |--:|:-| | Docker | Client=19.03.12 Server=19.03.12 base: https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2406/1/artifact/out/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/2406 | | Optional Tests | dupname asflicense javac javadoc unit shadedjars hadoopcheck xml compile checkstyle | | uname | Linux f8f3b9a20f1a 4.15.0-112-generic #113-Ubuntu SMP Thu Jul 9 23:41:39 UTC 2020 x86_64 GNU/Linux | | Build tool | maven | | Personality | /home/jenkins/jenkins-home/workspace/Base-PreCommit-GitHub-PR_PR-2406/out/precommit/personality/provided.sh | | git revision | branch-2.2 / 124fe190fd | | Default Java | 1.8.0_181 | | unit | https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2406/1/artifact/out/patch-unit-root.txt | | Test Results | https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2406/1/testReport/ | | Max. process+thread count | 2891 (vs. ulimit of 12500) | | modules | C: hbase-checkstyle hbase-annotations hbase-build-configuration hbase-protocol-shaded hbase-common hbase-metrics-api hbase-hadoop-compat hbase-metrics hbase-hadoop2-compat hbase-protocol hbase-client hbase-zookeeper hbase-replication hbase-resource-bundle hbase-http hbase-procedure hbase-server hbase-mapreduce hbase-testing-util hbase-thrift hbase-rsgroup hbase-shell hbase-endpoint hbase-it hbase-rest hbase-examples hbase-shaded hbase-shaded/hbase-shaded-client hbase-shaded/hbase-shaded-client-byo-hadoop hbase-shaded/hbase-shaded-mapreduce hbase-external-blockcache hbase-hbtop hbase-assembly hbase-shaded/hbase-shaded-testing-util hbase-shaded/hbase-shaded-testing-util-tester hbase-shaded/hbase-shaded-check-invariants hbase-shaded/hbase-shaded-with-hadoop-check-invariants hbase-archetypes hbase-archetypes/hbase-client-project hbase-archetypes/hbase-shaded-client-project hbase-archetypes/hbase-archetype-builder . U: . | | Console output | https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2406/1/console | | versions | git=2.11.0 maven=2018-06-17T18:33:14Z) | | Powered by | Apache Yetus 0.11.1 https://yetus.apache.org | This message was automatically generated. This is a
[GitHub] [hbase] Joseph295 opened a new pull request #2410: HBASE-25048 [HBCK2] Bypassed parent procedures are not updated in store
Joseph295 opened a new pull request #2410: URL: https://github.com/apache/hbase/pull/2410 This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Commented] (HBASE-25049) HBase nightly client integration test is failing
[
https://issues.apache.org/jira/browse/HBASE-25049?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17197033#comment-17197033
]
Hudson commented on HBASE-25049:
Results for branch HBASE-25049
[build #1 on
builds.a.o|https://ci-hadoop.apache.org/job/HBase/job/HBase%20Nightly/job/HBASE-25049/1/]:
(x) *{color:red}-1 overall{color}*
details (if available):
(/) {color:green}+1 source release artifact{color}
-- See build output for details.
(x) {color:red}-1 client integration test{color}
--Failed when running client tests on top of Hadoop 3. [see log for
details|https://ci-hadoop.apache.org/job/HBase/job/HBase%20Nightly/job/HBASE-25049/1//artifact/output-integration/hadoop-3.log].
(note that this means we didn't check the Hadoop 3 shaded client)
> HBase nightly client integration test is failing
>
>
> Key: HBASE-25049
> URL: https://issues.apache.org/jira/browse/HBASE-25049
> Project: HBase
> Issue Type: Bug
> Components: test
>Reporter: Duo Zhang
>Priority: Major
>
> There are bunch of problems which leads to the failure. Plan to fix it in
> HBASE-25021 but finally I think we'd better have a separated issue for fixing
> the problem other than skipping hadoop 2 for master.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
[GitHub] [hbase] Apache-HBase commented on pull request #2400: HBASE-24877 addendum: additional checks to avoid one extra possible race control in the initialize loop
Apache-HBase commented on pull request #2400: URL: https://github.com/apache/hbase/pull/2400#issuecomment-693466890 :broken_heart: **-1 overall** | Vote | Subsystem | Runtime | Comment | |::|--:|:|:| | +0 :ok: | reexec | 1m 17s | Docker mode activated. | | -0 :warning: | yetus | 0m 3s | Unprocessed flag(s): --brief-report-file --spotbugs-strict-precheck --whitespace-eol-ignore-list --whitespace-tabs-ignore-list --quick-hadoopcheck | ||| _ Prechecks _ | ||| _ master Compile Tests _ | | +1 :green_heart: | mvninstall | 4m 15s | master passed | | +1 :green_heart: | compile | 1m 0s | master passed | | +1 :green_heart: | shadedjars | 7m 11s | branch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 0m 38s | master passed | ||| _ Patch Compile Tests _ | | +1 :green_heart: | mvninstall | 3m 52s | the patch passed | | +1 :green_heart: | compile | 1m 0s | the patch passed | | +1 :green_heart: | javac | 1m 0s | the patch passed | | +1 :green_heart: | shadedjars | 7m 17s | patch has no errors when building our shaded downstream artifacts. | | +1 :green_heart: | javadoc | 0m 35s | the patch passed | ||| _ Other Tests _ | | -1 :x: | unit | 207m 40s | hbase-server in the patch failed. | | | | 236m 40s | | | Subsystem | Report/Notes | |--:|:-| | Docker | Client=19.03.12 Server=19.03.12 base: https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2400/2/artifact/yetus-jdk8-hadoop3-check/output/Dockerfile | | GITHUB PR | https://github.com/apache/hbase/pull/2400 | | Optional Tests | javac javadoc unit shadedjars compile | | uname | Linux b22443796fa7 4.15.0-112-generic #113-Ubuntu SMP Thu Jul 9 23:41:39 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux | | Build tool | maven | | Personality | dev-support/hbase-personality.sh | | git revision | master / a918bf0d7b | | Default Java | 1.8.0_232 | | unit | https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2400/2/artifact/yetus-jdk8-hadoop3-check/output/patch-unit-hbase-server.txt | | Test Results | https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2400/2/testReport/ | | Max. process+thread count | 3703 (vs. ulimit of 12500) | | modules | C: hbase-server U: hbase-server | | Console output | https://ci-hadoop.apache.org/job/HBase/job/HBase-PreCommit-GitHub-PR/job/PR-2400/2/console | | versions | git=2.17.1 maven=(cecedd343002696d0abb50b32b541b8a6ba2883f) | | Powered by | Apache Yetus 0.11.1 https://yetus.apache.org | This message was automatically generated. This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
[jira] [Commented] (HBASE-25014) ScheduledChore is never triggered when initalDelay > 1.5*period
[
https://issues.apache.org/jira/browse/HBASE-25014?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17197041#comment-17197041
]
Hudson commented on HBASE-25014:
Results for branch branch-2.2
[build #60 on
builds.a.o|https://ci-hadoop.apache.org/job/HBase/job/HBase%20Nightly/job/branch-2.2/60/]:
(/) *{color:green}+1 overall{color}*
details (if available):
(/) {color:green}+1 general checks{color}
-- For more information [see general
report|https://ci-hadoop.apache.org/job/HBase/job/HBase%20Nightly/job/branch-2.2/60//General_Nightly_Build_Report/]
(/) {color:green}+1 jdk8 hadoop2 checks{color}
-- For more information [see jdk8 (hadoop2)
report|https://ci-hadoop.apache.org/job/HBase/job/HBase%20Nightly/job/branch-2.2/60//JDK8_Nightly_Build_Report_(Hadoop2)/]
(/) {color:green}+1 jdk8 hadoop3 checks{color}
-- For more information [see jdk8 (hadoop3)
report|https://ci-hadoop.apache.org/job/HBase/job/HBase%20Nightly/job/branch-2.2/60//JDK8_Nightly_Build_Report_(Hadoop3)/]
(/) {color:green}+1 source release artifact{color}
-- See build output for details.
(/) {color:green}+1 client integration test{color}
> ScheduledChore is never triggered when initalDelay > 1.5*period
> ---
>
> Key: HBASE-25014
> URL: https://issues.apache.org/jira/browse/HBASE-25014
> Project: HBase
> Issue Type: Bug
>Affects Versions: 3.0.0-alpha-1, 2.2.3, 2.2.4, 2.2.5
>Reporter: Sun Xin
>Assignee: Sun Xin
>Priority: Major
> Fix For: 3.0.0-alpha-1, 2.3.3, 2.4.0, 2.2.7
>
>
> In our recent tests, ScheduledChore is never triggered when initalDelay >
> 1.5*period.
> The cause of the bug is the following:
> The trigger time for a ScheduleChore must be within an acceptable time window
> that is 1.5 * period. see
> [here|https://github.com/apache/hbase/blob/e5ca9adc54f9f580f85d21d38217afa97aa79d68/hbase-common/src/main/java/org/apache/hadoop/hbase/ScheduledChore.java#L234]
> timeOfLastRun and timeOfThisRun are two variables that record two adjacent
> trigger time. [The first initialization of
> timeOfThisRun|https://github.com/apache/hbase/blob/e5ca9adc54f9f580f85d21d38217afa97aa79d68/hbase-common/src/main/java/org/apache/hadoop/hbase/ScheduledChore.java#L273]
> is when the ScheduleChore is created, it's not a real trigger time.
> If we set initialDelay > 1.5 period , after initialDelay, the first time when
> chore is triggered has exceeded the allowed window. Then [cancel the chore
> and schedule it
> again|https://github.com/apache/hbase/blob/e5ca9adc54f9f580f85d21d38217afa97aa79d68/hbase-common/src/main/java/org/apache/hadoop/hbase/ChoreService.java#L176].
> So it's stuck in loop when initialDelay > 1.5 period :
> 1. init timeOfThisRun at a wrong time.
> 2. wait initalDelay
> 3. chore trigger, but exceeded the allowed window.
> 4. cancel chore and schedule it again
> 5. go step 1.
>
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
