Re: [Discuss] Mapreduce based major compactions to minimise compactions overhead in HBase cluster

2023-03-05 Thread Duo Zhang
Maybe a related work, offload compaction to compaction server. https://issues.apache.org/jira/browse/HBASE-25714 The guys from Xiaomi have implemented this based on their own code base and have some numbers. You can see the design doc first to see if it could help here.

[jira] [Created] (HBASE-27689) Update README.md about how to request a jira account

2023-03-05 Thread Duo Zhang (Jira)
Duo Zhang created HBASE-27689: - Summary: Update README.md about how to request a jira account Key: HBASE-27689 URL: https://issues.apache.org/jira/browse/HBASE-27689 Project: HBase Issue Type:

Re: [Discuss] Mapreduce based major compactions to minimise compactions overhead in HBase cluster

2023-03-05 Thread rajeshb...@apache.org
Hi Andrew and Nick, thanks for your valuable feedback and information. *Problem statement: * By default the compactions enabled with pressure aware throughput controller to reduce the burden of compactions in the clusters even under heavy workloads but because of this sometimes the compaction

[jira] [Resolved] (HBASE-25709) Close region may stuck when region is compacting and skipped most cells read

2023-03-05 Thread Xiaolin Ha (Jira)
[ https://issues.apache.org/jira/browse/HBASE-25709?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaolin Ha resolved HBASE-25709. Release Note: (was: Both compacting scanners and user scanners should return promptly, when

[jira] [Resolved] (HBASE-27672) Read RPC threads may BLOCKED at the Configuration.get when using java compression

2023-03-05 Thread Xiaolin Ha (Jira)
[ https://issues.apache.org/jira/browse/HBASE-27672?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ] Xiaolin Ha resolved HBASE-27672. Resolution: Fixed Merged to branch-2.5+, thanks [~bbeaudreault] for reviewing! > Read RPC

[jira] [Created] (HBASE-27688) HFile splitting occurs during bulkload, the CREATE_TIME_TS of hfileinfo is 0

2023-03-05 Thread alan.zhao (Jira)
alan.zhao created HBASE-27688: - Summary: HFile splitting occurs during bulkload, the CREATE_TIME_TS of hfileinfo is 0 Key: HBASE-27688 URL: https://issues.apache.org/jira/browse/HBASE-27688 Project: