[ https://issues.apache.org/jira/browse/HBASE-26784?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17503304#comment-17503304 ]
Hudson commented on HBASE-26784: -------------------------------- Results for branch branch-2 [build #478 on builds.a.o|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/478/]: (x) *{color:red}-1 overall{color}* ---- details (if available): (/) {color:green}+1 general checks{color} -- For more information [see general report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/478/General_20Nightly_20Build_20Report/] (/) {color:green}+1 jdk8 hadoop2 checks{color} -- For more information [see jdk8 (hadoop2) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/478/JDK8_20Nightly_20Build_20Report_20_28Hadoop2_29/] (/) {color:green}+1 jdk8 hadoop3 checks{color} -- For more information [see jdk8 (hadoop3) report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/478/JDK8_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 jdk11 hadoop3 checks{color} -- For more information [see jdk11 report|https://ci-hbase.apache.org/job/HBase%20Nightly/job/branch-2/478/JDK11_20Nightly_20Build_20Report_20_28Hadoop3_29/] (/) {color:green}+1 source release artifact{color} -- See build output for details. (/) {color:green}+1 client integration test{color} > Use HIGH_QOS for ResultScanner.close requests > --------------------------------------------- > > Key: HBASE-26784 > URL: https://issues.apache.org/jira/browse/HBASE-26784 > Project: HBase > Issue Type: Improvement > Reporter: Bryan Beaudreault > Assignee: Bryan Beaudreault > Priority: Major > Fix For: 2.5.0, 2.6.0, 3.0.0-alpha-3 > > > Active scanners take resources on the RegionServer, and scanner leaks can > have a big impact on GC. Under high load, ResultScanner.close() calls might > get rejected or timed out before executing. Exceptions thrown by close() are > currently swallowed, so clients will not retry. This leads to a leak of > active scanners on the server side. > These calls should be relatively free to execute, and executing them will > free up the resources which can have an impact on overall RegionServer > performance. As such it can be beneficial to execute all > ResultScanner.close() requests with HIGH_QOS regardless of the priority of > the underlying Scan. > In a scan-heavy stress test I ran, after a couple minutes the Full GC time > (using G1GC) starts increasing and we start seeing 1s pauses, due to > increasing number of active scanners (into the 10s of thousands). Re-running > the stress test with HIGH_QOS for ResultScanner.close() eliminates the leak > and GC time remains stable. -- This message was sent by Atlassian Jira (v8.20.1#820001)