[jira] [Resolved] (HBASE-27676) Scan handlers in the RPC executor should match at least one scan queues
[
https://issues.apache.org/jira/browse/HBASE-27676?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Xiaolin Ha resolved HBASE-27676.
Resolution: Fixed
Merged to branch-2+ and master, thanks [~bbeaudreault] for reviewing.
> Scan handlers in the RPC executor should match at least one scan queues
> ---
>
> Key: HBASE-27676
> URL: https://issues.apache.org/jira/browse/HBASE-27676
> Project: HBase
> Issue Type: Improvement
>Affects Versions: 2.5.3
>Reporter: Xiaolin Ha
>Assignee: Xiaolin Ha
>Priority: Major
> Fix For: 2.6.0, 3.0.0-alpha-4, 2.4.17, 2.5.4
>
>
> This issue is try to avoid NO scan queues for some scan handlers.
> For example, if we set hbase.regionserver.handler.count=150,
> hbase.ipc.server.callqueue.scan.ratio=0.1,
> hbase.ipc.server.callqueue.read.ratio=0.5,
> hbase.ipc.server.callqueue.handler.factor=0.1, then there will be 150 * 0.5 *
> 0.1 = 7 scan handlers, but there are 150 * 0.1 * 0.5 * 0.1 = 0 scan RPC
> queues.
> When there are no scan rpc queues, all the scan and get requests will be
> dispatched to the read rpc queues, while we we thought they had been dealt
> with separately, since the scan handler count is not 0. When there are not
> enough handlers for large scan requests under this circumstance, the small
> get requests will be blocked in the rpc queues.
> We can see from the codes,
> {code:java}
> int scanQueues = Math.max(0, (int) Math.floor(readQueues * callqScanShare));
> int scanHandlers = Math.max(0, (int) Math.floor(readHandlers *
> callqScanShare));
> if ((readQueues - scanQueues) > 0) {
> readQueues -= scanQueues;
> readHandlers -= scanHandlers;
> } else {
> scanQueues = 0;
> scanHandlers = 0;
> } {code}
> when readQueues * callqScanShare < 1 but readHandlers * callqScanShare > 1,
> there will be some iddle scan handlers with NO scan queues.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Resolved] (HBASE-27684) Client metrics for user region lock related behaviors.
[ https://issues.apache.org/jira/browse/HBASE-27684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Viraj Jasani resolved HBASE-27684. -- Fix Version/s: 2.4.17 Resolution: Fixed > Client metrics for user region lock related behaviors. > -- > > Key: HBASE-27684 > URL: https://issues.apache.org/jira/browse/HBASE-27684 > Project: HBase > Issue Type: Bug > Components: Client >Affects Versions: 2.0.0 >Reporter: Victor Li >Assignee: Victor Li >Priority: Major > Fix For: 2.6.0, 2.4.17, 2.5.4 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Reopened] (HBASE-27684) Client metrics for user region lock related behaviors.
[ https://issues.apache.org/jira/browse/HBASE-27684?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Viraj Jasani reopened HBASE-27684: -- Reopening for branch-2.4 backport. > Client metrics for user region lock related behaviors. > -- > > Key: HBASE-27684 > URL: https://issues.apache.org/jira/browse/HBASE-27684 > Project: HBase > Issue Type: Bug > Components: Client >Affects Versions: 2.0.0 >Reporter: Victor Li >Assignee: Victor Li >Priority: Major > Fix For: 2.6.0, 2.5.4 > > -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Resolved] (HBASE-27723) Fix brotli4j licence issue on native-osx-aarch64
[
https://issues.apache.org/jira/browse/HBASE-27723?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Frens Jan Rumph resolved HBASE-27723.
-
Resolution: Duplicate
> Fix brotli4j licence issue on native-osx-aarch64
>
>
> Key: HBASE-27723
> URL: https://issues.apache.org/jira/browse/HBASE-27723
> Project: HBase
> Issue Type: Improvement
>Reporter: Frens Jan Rumph
>Assignee: Frens Jan Rumph
>Priority: Major
>
> Apparently the licence of {{brotli4j}} is malformed and fixed in
> {{{}supplemental-models.xml{}}}. It didn't however cover
> {{native-osx-aarch64}} yet.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
[jira] [Resolved] (HBASE-27731) Upgrade commons-validator to version 1.7
[ https://issues.apache.org/jira/browse/HBASE-27731?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang resolved HBASE-27731. --- Hadoop Flags: Reviewed Resolution: Fixed Pushed to master. Thanks [~wesiq] for contributing! > Upgrade commons-validator to version 1.7 > > > Key: HBASE-27731 > URL: https://issues.apache.org/jira/browse/HBASE-27731 > Project: HBase > Issue Type: Task >Reporter: Wes Schuitema >Assignee: Wes Schuitema >Priority: Minor > > The current version of commons-validator (1.6) has a dependency on > commons-beanutils-1.9.2.jar, this dependency comes with two CVEs: > - [CVE-2014-0114|https://nvd.nist.gov/vuln/detail/cve-2014-0114] > - [CVE-2019-10086|https://nvd.nist.gov/vuln/detail/cve-2019-10086] > With commons-validator version 1.7 these CVEs are no longer present. > I've also checked the master branch for usages. The only location where > commons-validator is used is in org.apache.hadoop.hbase.zookeeper.ZKConfig > for validating ipv6 addresses. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Resolved] (HBASE-27736) HFileSystem.getLocalFs is not used
[ https://issues.apache.org/jira/browse/HBASE-27736?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Duo Zhang resolved HBASE-27736. --- Hadoop Flags: Reviewed Resolution: Fixed Pushed to branch-2.4+. Thanks [~xuzifu] for contributing! > HFileSystem.getLocalFs is not used > -- > > Key: HBASE-27736 > URL: https://issues.apache.org/jira/browse/HBASE-27736 > Project: HBase > Issue Type: Wish > Components: HFile >Affects Versions: 2.4.15, 2.5.3 >Reporter: xy >Assignee: xy >Priority: Major > > HFileSystem::getLocalFs not be used by any method in source code，so make a > hotfix by removing it. -- This message was sent by Atlassian Jira (v8.20.10#820010)
[jira] [Created] (HBASE-27741) Fall back to protoc osx-x86_64 on Apple Silicon
Nick Dimiduk created HBASE-27741: Summary: Fall back to protoc osx-x86_64 on Apple Silicon Key: HBASE-27741 URL: https://issues.apache.org/jira/browse/HBASE-27741 Project: HBase Issue Type: Task Components: build Affects Versions: 2.5.0, 2.6.0 Reporter: Nick Dimiduk Assignee: Nick Dimiduk Building non-master branches on an Apple Silicon machine fails because there's no protoc binary available. Use a profile to fall back to the x86 version of the binary, as per https://cwiki.apache.org/confluence/display/HADOOP/Develop+on+Apple+Silicon+%28M1%29+macOS -- This message was sent by Atlassian Jira (v8.20.10#820010)
