Hi Srinidhi,
We are also facing a similar problem in HBase-1.4.8. We're curious to know
what you did after this to resolve the issue. Did you revert back to a
previous version?
I've seen a Jira regarding this issue. (
https://issues.apache.org/jira/browse/HBASE-21620)
@Ted Yu any update on this?
It is during a period when the number of client operations was relatively low.
It wasn’t zero, but it was definitely off peak hours.
On 9/10/18, 12:16 PM, "Ted Yu" wrote:
In the previous stack trace you sent, shortCompactions and longCompactions
threads were not active.
Was
In the previous stack trace you sent, shortCompactions and longCompactions
threads were not active.
Was the stack trace captured during period when the number of client
operations was low ?
If not, can you capture stack trace during off peak hours ?
Cheers
On Mon, Sep 10, 2018 at 12:08 PM
Hi Ted,
The highest number of filters used is 10, but the average is generally close to
1. Is it possible the CPU usage spike has to do with Hbase internal maintenance
operations? It looks like post-upgrade the spike isn’t correlated with the
frequency of reads/writes we are making, because
Srinidhi :
Do you know the average / highest number of ColumnPrefixFilter's in the
FilterList ?
Thanks
On Fri, Sep 7, 2018 at 10:00 PM Ted Yu wrote:
> Thanks for detailed background information.
>
> I assume your code has done de-dup for the filters contained in
> FilterListWithOR.
>
> I took
The createFirstOnRow() is used by ColumnXXFilter's getNextCellHint() method.
I am thinking about adding a variant to getNextCellHint() which returns a
tuple, representing first on row, consisting of:
Cell - the passed in Cell instance
byte[] - qualifier array
int - qualifier offset
int -
Thanks for detailed background information.
I assume your code has done de-dup for the filters contained in
FilterListWithOR.
I took a look at JIRAs which
touched hbase-client/src/main/java/org/apache/hadoop/hbase/filter in
branch-1.4
There were a few patches (some were very big) since the
Sure thing. For our table schema, each row represents one user and the row key
is that user’s unique id in our system. We currently only use one column family
in the table. The column qualifiers represent an item that has been surfaced to
that user as well as additional information to
>From the stack trace, ColumnPrefixFilter is used during scan.
Can you illustrate how various filters are formed thru FilterListWithOR ?
It would be easier for other people to reproduce the problem given your
query pattern.
Cheers
On Thu, Sep 6, 2018 at 11:43 AM Srinidhi Muppalla
wrote:
> Hi
Hi Vlad,
Thank you for the suggestion. I recreated the issue and attached the stack
traces I took. Let me know if there’s any other info I can provide. We narrowed
the issue down to occurring when upgrading from 1.3.0 to any 1.4.x version.
Thanks,
Srinidhi
On 9/4/18, 8:19 PM, "Vladimir
Hi, Srinidhi
Next time you will see this issue, take jstack of a RS several times in a
row. W/o stack traces it is hard
to tell what was going on with your cluster after upgrade.
-Vlad
On Tue, Sep 4, 2018 at 3:50 PM Srinidhi Muppalla
wrote:
> Hello all,
>
> We are currently running Hbase
Hello all,
We are currently running Hbase 1.3.0 on an EMR cluster running EMR 5.5.0.
Recently, we attempted to upgrade our cluster to using Hbase 1.4.4 (along with
upgrading our EMR cluster to 5.16). After upgrading, the CPU usage for all of
our region servers spiked up to 90%. The load_one
12 matches
Mail list logo
