Re: Question regards sudden drop of compactionQueueLength metric
By the description, it seems compaction of a specific subset of regions is taking a long time to complete, filling all the compaction threads whilst all other compaction requests are queued waiting for these long ones to complete. Once these long compassions are finished, the queued ones are processed very quickly. I'm not sure about hbase 1.1.3 (this is quite old, btw), but newer versions do log the total time and size of compacted data at the end of each compaction. The only other way compaction queues would be cleaned out is if RSes got restarted. Em dom., 19 de mai. de 2024 às 22:30, Rural Hunter escreveu: > Hi, > > We are experiencing periodic slow response issue. We investigated the issue > and found it's related to hfile compaction. The slow down happens when > there are many compaction activities in log. So we tuned some compaction > parameters and also started to monitor the metric: compactionQueueLength. > When the slow response happens, we can see the compactionQueueLength keeps > increasing. In the log there is one item of major compaction completion > every several minutes. One interesting finding is that > compactionQueueLength > keeps increasing to more than 1000 or even 3000 on some servers until at > some point it drops to 0 suddenly, like it is it cleared by someone. There > is nothing special in the log at the time and after that there is not much > compaction activity. I searched the doc and web but couldn't find any > explanation for that. Can anyone explain what happened? Thanks in advance. > btw, our hbase version is 1.1.3 >
[ANNOUNCE] Apache HBase 2.6.0 is now available for download
The HBase team is happy to announce the immediate availability of HBase _version_. Apache HBase™ is an open-source, distributed, versioned, non-relational database. Apache HBase gives you low latency random access to billions of rows with millions of columns atop non-specialized hardware. To learn more about HBase, see https://hbase.apache.org/. HBase 2.6.0 is the 1st release in the HBase 2.6.x line, which aims to improve the stability and reliability of HBase. This release includes roughly 560 resolved issues not covered by previous 2.x releases. Notable new features include: - Built-in support for full and incremental backups - Built-in support for TLS encryption and authentication - Erasure Coding support - Various improvements to Quotas The full list of issues can be found here: CHANGELOG: https://downloads.apache.org/hbase/2.6.0/CHANGES.md RELEASENOTES: https://downloads.apache.org/hbase/2.6.0/RELEASENOTES.md or via our issue tracker: https://issues.apache.org/jira/projects/HBASE/versions/12350930 To download please follow the links and instructions on our website: https://hbase.apache.org/downloads.html Question, comments, and problems are always welcome at: d...@hbase.apache.org user@hbase.apache.org user...@hbase.apache.org Thanks to all who contributed and made this release possible. Cheers, The HBase Dev Team
Re: [ANNOUNCE] Apache HBase 2.6.0 is now available for download
Congratulations! But it seems you missed the replacement for the first '_version_' placeholder... Bryan Beaudreault 于2024年5月21日周二 00:44写道： > > The HBase team is happy to announce the immediate availability of HBase > _version_. > > Apache HBase™ is an open-source, distributed, versioned, non-relational > database. > Apache HBase gives you low latency random access to billions of rows with > millions of columns atop non-specialized hardware. To learn more about > HBase, > see https://hbase.apache.org/. > > HBase 2.6.0 is the 1st release in the HBase 2.6.x line, which aims to > improve the stability and reliability of HBase. This release includes > roughly > 560 resolved issues not covered by previous 2.x releases. > > Notable new features include: > - Built-in support for full and incremental backups > - Built-in support for TLS encryption and authentication > - Erasure Coding support > - Various improvements to Quotas > > The full list of issues can be found here: > > CHANGELOG: https://downloads.apache.org/hbase/2.6.0/CHANGES.md > RELEASENOTES: https://downloads.apache.org/hbase/2.6.0/RELEASENOTES.md > > or via our issue tracker: > https://issues.apache.org/jira/projects/HBASE/versions/12350930 > > To download please follow the links and instructions on our website: > > https://hbase.apache.org/downloads.html > > Question, comments, and problems are always welcome at: > d...@hbase.apache.org > user@hbase.apache.org > user...@hbase.apache.org > > Thanks to all who contributed and made this release possible. > > Cheers, > The HBase Dev Team
Re: Question regards sudden drop of compactionQueueLength metric
"Once these long compassions are finished, the queued ones are processed very quickly." I don't think that's the case as I described there was no additional compaction completion log at that time. There was one item of compaction completion log every several minutes, the same as when the queue was increasing. Besides, there was no restart of the region server. Wellington Chevreuil 于2024年5月20日周一 22:30写道： > By the description, it seems compaction of a specific subset of regions is > taking a long time to complete, filling all the compaction threads whilst > all other compaction requests are queued waiting for these long ones to > complete. Once these long compassions are finished, the queued ones are > processed very quickly. I'm not sure about hbase 1.1.3 (this is quite old, > btw), but newer versions do log the total time and size of compacted data > at the end of each compaction. The only other way compaction queues would > be cleaned out is if RSes got restarted. > > Em dom., 19 de mai. de 2024 às 22:30, Rural Hunter > escreveu: > > > Hi, > > > > We are experiencing periodic slow response issue. We investigated the > issue > > and found it's related to hfile compaction. The slow down happens when > > there are many compaction activities in log. So we tuned some compaction > > parameters and also started to monitor the metric: compactionQueueLength. > > When the slow response happens, we can see the compactionQueueLength > keeps > > increasing. In the log there is one item of major compaction completion > > every several minutes. One interesting finding is that > > compactionQueueLength > > keeps increasing to more than 1000 or even 3000 on some servers until at > > some point it drops to 0 suddenly, like it is it cleared by someone. > There > > is nothing special in the log at the time and after that there is not > much > > compaction activity. I searched the doc and web but couldn't find any > > explanation for that. Can anyone explain what happened? Thanks in > advance. > > btw, our hbase version is 1.1.3 > > >
Re: [ANNOUNCE] Apache HBase 2.6.0 is now available for download
Haha yes, I noticed that…after sending. Hopefully the title and various other mentions of 2.6.0 can suffice this time :) On Mon, May 20, 2024 at 10:08 PM 张铎(Duo Zhang) wrote: > Congratulations! > > But it seems you missed the replacement for the first '_version_' > placeholder... > > Bryan Beaudreault 于2024年5月21日周二 00:44写道： > > > > The HBase team is happy to announce the immediate availability of HBase > > _version_. > > > > Apache HBase™ is an open-source, distributed, versioned, non-relational > > database. > > Apache HBase gives you low latency random access to billions of rows with > > millions of columns atop non-specialized hardware. To learn more about > > HBase, > > see https://hbase.apache.org/. > > > > HBase 2.6.0 is the 1st release in the HBase 2.6.x line, which aims to > > improve the stability and reliability of HBase. This release includes > > roughly > > 560 resolved issues not covered by previous 2.x releases. > > > > Notable new features include: > > - Built-in support for full and incremental backups > > - Built-in support for TLS encryption and authentication > > - Erasure Coding support > > - Various improvements to Quotas > > > > The full list of issues can be found here: > > > > CHANGELOG: https://downloads.apache.org/hbase/2.6.0/CHANGES.md > > RELEASENOTES: https://downloads.apache.org/hbase/2.6.0/RELEASENOTES.md > > > > or via our issue tracker: > > https://issues.apache.org/jira/projects/HBASE/versions/12350930 > > > > To download please follow the links and instructions on our website: > > > > https://hbase.apache.org/downloads.html > > > > Question, comments, and problems are always welcome at: > > d...@hbase.apache.org > > user@hbase.apache.org > > user...@hbase.apache.org > > > > Thanks to all who contributed and made this release possible. > > > > Cheers, > > The HBase Dev Team >
