[jira] [Commented] (HBASE-27947) RegionServer OOM under load when TLS is enabled

2023-06-22 Thread Bryan Beaudreault (Jira)
[ https://issues.apache.org/jira/browse/HBASE-27947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17736251#comment-17736251 ] Bryan Beaudreault commented on HBASE-27947: --- The cluster in question has a bun

[jira] [Commented] (HBASE-27947) RegionServer OOM under load when TLS is enabled

2023-06-22 Thread Duo Zhang (Jira)
[ https://issues.apache.org/jira/browse/HBASE-27947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17736340#comment-17736340 ] Duo Zhang commented on HBASE-27947: --- Netty has a way to guess the input message size s

[jira] [Commented] (HBASE-27947) RegionServer OOM under load when TLS is enabled

2023-06-23 Thread Duo Zhang (Jira)
[ https://issues.apache.org/jira/browse/HBASE-27947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17736413#comment-17736413 ] Duo Zhang commented on HBASE-27947: --- And for max result size, IIRC we have our own mem

[jira] [Commented] (HBASE-27947) RegionServer OOM under load when TLS is enabled

2023-06-23 Thread Duo Zhang (Jira)
[ https://issues.apache.org/jira/browse/HBASE-27947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17736419#comment-17736419 ] Duo Zhang commented on HBASE-27947: --- So what is ssl engine you guys use? The jdk one o

[jira] [Commented] (HBASE-27947) RegionServer OOM under load when TLS is enabled

2023-06-23 Thread Duo Zhang (Jira)
[ https://issues.apache.org/jira/browse/HBASE-27947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17736435#comment-17736435 ] Duo Zhang commented on HBASE-27947: --- Oh, seems I misunderstood the description. I thou

[jira] [Commented] (HBASE-27947) RegionServer OOM under load when TLS is enabled

2023-06-23 Thread Bryan Beaudreault (Jira)
[ https://issues.apache.org/jira/browse/HBASE-27947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17736456#comment-17736456 ] Bryan Beaudreault commented on HBASE-27947: --- Thanks for all of those useful in

[jira] [Commented] (HBASE-27947) RegionServer OOM under load when TLS is enabled

2023-06-23 Thread Bryan Beaudreault (Jira)
[ https://issues.apache.org/jira/browse/HBASE-27947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17736481#comment-17736481 ] Bryan Beaudreault commented on HBASE-27947: --- Here's an example stacktrace: {co

[jira] [Commented] (HBASE-27947) RegionServer OOM under load when TLS is enabled

2023-06-23 Thread Duo Zhang (Jira)
[ https://issues.apache.org/jira/browse/HBASE-27947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17736535#comment-17736535 ] Duo Zhang commented on HBASE-27947: --- Oh, this is for receiving message... > RegionSer

[jira] [Commented] (HBASE-27947) RegionServer OOM under load when TLS is enabled

2023-06-23 Thread Bryan Beaudreault (Jira)
[ https://issues.apache.org/jira/browse/HBASE-27947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17736542#comment-17736542 ] Bryan Beaudreault commented on HBASE-27947: --- Yea, to be honest I'm having a ha

[jira] [Commented] (HBASE-27947) RegionServer OOM under load when TLS is enabled

2023-06-24 Thread Bryan Beaudreault (Jira)
[ https://issues.apache.org/jira/browse/HBASE-27947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17736785#comment-17736785 ] Bryan Beaudreault commented on HBASE-27947: --- I'm wondering if the reason the O

[jira] [Commented] (HBASE-27947) RegionServer OOM under load when TLS is enabled

2023-06-24 Thread Bryan Beaudreault (Jira)
[ https://issues.apache.org/jira/browse/HBASE-27947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17736796#comment-17736796 ] Bryan Beaudreault commented on HBASE-27947: --- Can we use WRITE_BUFFER_WATER_MAR

[jira] [Commented] (HBASE-27947) RegionServer OOM under load when TLS is enabled

2023-06-25 Thread Duo Zhang (Jira)
[ https://issues.apache.org/jira/browse/HBASE-27947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17736889#comment-17736889 ] Duo Zhang commented on HBASE-27947: --- First, tt is a bit strange that why we need to al

[jira] [Commented] (HBASE-27947) RegionServer OOM under load when TLS is enabled

2023-06-25 Thread Duo Zhang (Jira)
[ https://issues.apache.org/jira/browse/HBASE-27947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17736890#comment-17736890 ] Duo Zhang commented on HBASE-27947: --- OK, 2GB / 150k, average message size is about 13-

[jira] [Commented] (HBASE-27947) RegionServer OOM under load when TLS is enabled

2023-06-25 Thread Bryan Beaudreault (Jira)
[ https://issues.apache.org/jira/browse/HBASE-27947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17736922#comment-17736922 ] Bryan Beaudreault commented on HBASE-27947: --- Yes at this point I feel pretty c

[jira] [Commented] (HBASE-27947) RegionServer OOM under load when TLS is enabled

2023-06-26 Thread Duo Zhang (Jira)
[ https://issues.apache.org/jira/browse/HBASE-27947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17737036#comment-17737036 ] Duo Zhang commented on HBASE-27947: --- If a local haproxy can perform better, I think th

[jira] [Commented] (HBASE-27947) RegionServer OOM under load when TLS is enabled

2023-06-26 Thread Bryan Beaudreault (Jira)
[ https://issues.apache.org/jira/browse/HBASE-27947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17737348#comment-17737348 ] Bryan Beaudreault commented on HBASE-27947: --- FYI I swapped to using netty-tcna

[jira] [Commented] (HBASE-27947) RegionServer OOM under load when TLS is enabled

2023-06-27 Thread Bryan Beaudreault (Jira)
[ https://issues.apache.org/jira/browse/HBASE-27947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17737717#comment-17737717 ] Bryan Beaudreault commented on HBASE-27947: --- You probably already expected thi

[jira] [Commented] (HBASE-27947) RegionServer OOM under load when TLS is enabled

2023-06-28 Thread Bryan Beaudreault (Jira)
[ https://issues.apache.org/jira/browse/HBASE-27947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17738150#comment-17738150 ] Bryan Beaudreault commented on HBASE-27947: --- I implemented a pretty rudimentar

[jira] [Commented] (HBASE-27947) RegionServer OOM under load when TLS is enabled

2023-06-28 Thread Duo Zhang (Jira)
[ https://issues.apache.org/jira/browse/HBASE-27947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17738165#comment-17738165 ] Duo Zhang commented on HBASE-27947: --- Good. Please open a PR and I will help polishing

[jira] [Commented] (HBASE-27947) RegionServer OOM under load when TLS is enabled

2023-06-28 Thread Bryan Beaudreault (Jira)
[ https://issues.apache.org/jira/browse/HBASE-27947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17738186#comment-17738186 ] Bryan Beaudreault commented on HBASE-27947: --- Thanks, will do. Can you elaborat

[jira] [Commented] (HBASE-27947) RegionServer OOM under load when TLS is enabled

2023-06-28 Thread Bryan Beaudreault (Jira)
[ https://issues.apache.org/jira/browse/HBASE-27947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17738235#comment-17738235 ] Bryan Beaudreault commented on HBASE-27947: --- I suppose one problem with blocki

[jira] [Commented] (HBASE-27947) RegionServer OOM under load when TLS is enabled

2023-06-28 Thread Bryan Beaudreault (Jira)
[ https://issues.apache.org/jira/browse/HBASE-27947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17738303#comment-17738303 ] Bryan Beaudreault commented on HBASE-27947: --- {quote}If it does not work, pleas

[jira] [Commented] (HBASE-27947) RegionServer OOM under load when TLS is enabled

2023-06-29 Thread Bryan Beaudreault (Jira)
[ https://issues.apache.org/jira/browse/HBASE-27947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17738710#comment-17738710 ] Bryan Beaudreault commented on HBASE-27947: --- I have been trying to think about

[jira] [Commented] (HBASE-27947) RegionServer OOM under load when TLS is enabled

2023-06-29 Thread Lijin Bin (Jira)
[ https://issues.apache.org/jira/browse/HBASE-27947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17738847#comment-17738847 ] Lijin Bin commented on HBASE-27947: --- We encounter a similar problem, there is too much

[jira] [Commented] (HBASE-27947) RegionServer OOM under load when TLS is enabled

2023-06-29 Thread Bryan Beaudreault (Jira)
[ https://issues.apache.org/jira/browse/HBASE-27947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17738849#comment-17738849 ] Bryan Beaudreault commented on HBASE-27947: --- Sorry for all the updates, but I’

[jira] [Commented] (HBASE-27947) RegionServer OOM under load when TLS is enabled

2023-06-30 Thread Bryan Beaudreault (Jira)
[ https://issues.apache.org/jira/browse/HBASE-27947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17739130#comment-17739130 ] Bryan Beaudreault commented on HBASE-27947: --- Thanks for the input [~binlijin]!

[jira] [Commented] (HBASE-27947) RegionServer OOM under load when TLS is enabled

2023-07-29 Thread Duo Zhang (Jira)
[ https://issues.apache.org/jira/browse/HBASE-27947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17748889#comment-17748889 ] Duo Zhang commented on HBASE-27947: --- Any updates here? I think this is the last blocke

[jira] [Commented] (HBASE-27947) RegionServer OOM under load when TLS is enabled

2023-07-30 Thread Bryan Beaudreault (Jira)
[ https://issues.apache.org/jira/browse/HBASE-27947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17748925#comment-17748925 ] Bryan Beaudreault commented on HBASE-27947: --- Sorry for the delay. I am still d

[jira] [Commented] (HBASE-27947) RegionServer OOM under load when TLS is enabled

2023-07-30 Thread Duo Zhang (Jira)
[ https://issues.apache.org/jira/browse/HBASE-27947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17748928#comment-17748928 ] Duo Zhang commented on HBASE-27947: --- If we have 100 bad clients, I guess we will be OO

[jira] [Commented] (HBASE-27947) RegionServer OOM under load when TLS is enabled

2023-07-30 Thread Duo Zhang (Jira)
[ https://issues.apache.org/jira/browse/HBASE-27947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17748929#comment-17748929 ] Duo Zhang commented on HBASE-27947: --- {quote} I’ve been thinking of adopting an approac

[jira] [Commented] (HBASE-27947) RegionServer OOM under load when TLS is enabled

2023-07-30 Thread Bryan Beaudreault (Jira)
[ https://issues.apache.org/jira/browse/HBASE-27947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17748937#comment-17748937 ] Bryan Beaudreault commented on HBASE-27947: --- {quote}WDYT? {quote} Yes, that's

[jira] [Commented] (HBASE-27947) RegionServer OOM under load when TLS is enabled

2023-07-31 Thread Duo Zhang (Jira)
[ https://issues.apache.org/jira/browse/HBASE-27947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17749230#comment-17749230 ] Duo Zhang commented on HBASE-27947: --- {quote} Yes, that's true. I can try to wrap up th

[jira] [Commented] (HBASE-27947) RegionServer OOM under load when TLS is enabled

2023-08-13 Thread Duo Zhang (Jira)
[ https://issues.apache.org/jira/browse/HBASE-27947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17753671#comment-17753671 ] Duo Zhang commented on HBASE-27947: --- Just come back from vacation. Let me take a look

[jira] [Commented] (HBASE-27947) RegionServer OOM under load when TLS is enabled

2023-08-13 Thread Bryan Beaudreault (Jira)
[ https://issues.apache.org/jira/browse/HBASE-27947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17753680#comment-17753680 ] Bryan Beaudreault commented on HBASE-27947: --- Thanks and welcome back! i was p

[jira] [Commented] (HBASE-27947) RegionServer OOM under load when TLS is enabled

2023-08-13 Thread Bryan Beaudreault (Jira)
[ https://issues.apache.org/jira/browse/HBASE-27947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17753784#comment-17753784 ] Bryan Beaudreault commented on HBASE-27947: --- [~zhangduo] Sorry, I need to do a

[jira] [Commented] (HBASE-27947) RegionServer OOM under load when TLS is enabled

2023-08-13 Thread Duo Zhang (Jira)
[ https://issues.apache.org/jira/browse/HBASE-27947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17753786#comment-17753786 ] Duo Zhang commented on HBASE-27947: --- What does the flame graph look like? > RegionSer

[jira] [Commented] (HBASE-27947) RegionServer OOM under load when TLS is enabled

2023-08-13 Thread Bryan Beaudreault (Jira)
[ https://issues.apache.org/jira/browse/HBASE-27947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17753787#comment-17753787 ] Bryan Beaudreault commented on HBASE-27947: --- I just uploaded the flamegraphs –

[jira] [Commented] (HBASE-27947) RegionServer OOM under load when TLS is enabled

2023-08-13 Thread Bryan Beaudreault (Jira)
[ https://issues.apache.org/jira/browse/HBASE-27947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17753817#comment-17753817 ] Bryan Beaudreault commented on HBASE-27947: --- I had some time this afternoon an

[jira] [Commented] (HBASE-27947) RegionServer OOM under load when TLS is enabled

2023-08-15 Thread Bryan Beaudreault (Jira)
[ https://issues.apache.org/jira/browse/HBASE-27947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17754721#comment-17754721 ] Bryan Beaudreault commented on HBASE-27947: --- I have not started on an official

[jira] [Commented] (HBASE-27947) RegionServer OOM under load when TLS is enabled

2023-08-18 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/HBASE-27947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17756236#comment-17756236 ] Hudson commented on HBASE-27947: Results for branch branch-2 [build #866 on bui

[jira] [Commented] (HBASE-27947) RegionServer OOM under load when TLS is enabled

2023-08-19 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/HBASE-27947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17756359#comment-17756359 ] Hudson commented on HBASE-27947: Results for branch master [build #891 on build

[jira] [Commented] (HBASE-27947) RegionServer OOM under load when TLS is enabled

2023-08-19 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/HBASE-27947?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17756361#comment-17756361 ] Hudson commented on HBASE-27947: Results for branch branch-3 [build #33 on buil