[jira] [Commented] (HBASE-24436) The store file open and close thread pool should be shared at the region level

2021-03-05 Thread Duo Zhang (Jira)
[ https://issues.apache.org/jira/browse/HBASE-24436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17296399#comment-17296399 ] Duo Zhang commented on HBASE-24436: --- Any updates here? > The store file open and close thread pool

[jira] [Commented] (HBASE-24436) The store file open and close thread pool should be shared at the region level

2020-06-17 Thread Junhong Xu (Jira)
[ https://issues.apache.org/jira/browse/HBASE-24436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17138553#comment-17138553 ] Junhong Xu commented on HBASE-24436: Ping [~apurtell] please take a look sir. What do you think

[jira] [Commented] (HBASE-24436) The store file open and close thread pool should be shared at the region level

2020-06-16 Thread Junhong Xu (Jira)
[ https://issues.apache.org/jira/browse/HBASE-24436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17136687#comment-17136687 ] Junhong Xu commented on HBASE-24436: I test about 4 or 5 times, and the result is similar, here is

[jira] [Commented] (HBASE-24436) The store file open and close thread pool should be shared at the region level

2020-06-01 Thread Junhong Xu (Jira)
[ https://issues.apache.org/jira/browse/HBASE-24436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17120776#comment-17120776 ] Junhong Xu commented on HBASE-24436: Ping [~anoop.hbase][~apurtell] the patch has been updated,

[jira] [Commented] (HBASE-24436) The store file open and close thread pool should be shared at the region level

2020-05-30 Thread Zheng Wang (Jira)
[ https://issues.apache.org/jira/browse/HBASE-24436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17120397#comment-17120397 ] Zheng Wang commented on HBASE-24436: {quote}What do you think about the solution Andrew provide

[jira] [Commented] (HBASE-24436) The store file open and close thread pool should be shared at the region level

2020-05-30 Thread Anoop Sam John (Jira)
[ https://issues.apache.org/jira/browse/HBASE-24436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17120394#comment-17120394 ] Anoop Sam John commented on HBASE-24436: bq.which is creating the thread pool based on store

[jira] [Commented] (HBASE-24436) The store file open and close thread pool should be shared at the region level

2020-05-30 Thread Junhong Xu (Jira)
[ https://issues.apache.org/jira/browse/HBASE-24436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17120315#comment-17120315 ] Junhong Xu commented on HBASE-24436: I think we have reached an agreement on creating the thread

[jira] [Commented] (HBASE-24436) The store file open and close thread pool should be shared at the region level

2020-05-29 Thread Zheng Wang (Jira)
[ https://issues.apache.org/jira/browse/HBASE-24436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17120083#comment-17120083 ] Zheng Wang commented on HBASE-24436: bq. IMO, the goal should be load all stores as fast as

[jira] [Commented] (HBASE-24436) The store file open and close thread pool should be shared at the region level

2020-05-29 Thread Andrew Kyle Purtell (Jira)
[ https://issues.apache.org/jira/browse/HBASE-24436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17119762#comment-17119762 ] Andrew Kyle Purtell commented on HBASE-24436: - If you allocate one pool at region level with

[jira] [Commented] (HBASE-24436) The store file open and close thread pool should be shared at the region level

2020-05-29 Thread Junhong Xu (Jira)
[ https://issues.apache.org/jira/browse/HBASE-24436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17119749#comment-17119749 ] Junhong Xu commented on HBASE-24436: {quote}so they will at least be proportional to the number of

[jira] [Commented] (HBASE-24436) The store file open and close thread pool should be shared at the region level

2020-05-28 Thread Junhong Xu (Jira)
[ https://issues.apache.org/jira/browse/HBASE-24436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17119205#comment-17119205 ] Junhong Xu commented on HBASE-24436: bq. And how much slower open a store which has 20 storefiles VS

[jira] [Commented] (HBASE-24436) The store file open and close thread pool should be shared at the region level

2020-05-28 Thread Guanghao Zhang (Jira)
[ https://issues.apache.org/jira/browse/HBASE-24436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17119183#comment-17119183 ] Guanghao Zhang commented on HBASE-24436: {quote}How long open or close only one storefile take?

[jira] [Commented] (HBASE-24436) The store file open and close thread pool should be shared at the region level

2020-05-27 Thread Junhong Xu (Jira)
[ https://issues.apache.org/jira/browse/HBASE-24436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17117894#comment-17117894 ] Junhong Xu commented on HBASE-24436: Fork join pool is another solution too, although it may cause

[jira] [Commented] (HBASE-24436) The store file open and close thread pool should be shared at the region level

2020-05-27 Thread Andrew Kyle Purtell (Jira)
[ https://issues.apache.org/jira/browse/HBASE-24436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17117891#comment-17117891 ] Andrew Kyle Purtell commented on HBASE-24436: - By above stated goal of opening as quickly as

[jira] [Commented] (HBASE-24436) The store file open and close thread pool should be shared at the region level

2020-05-27 Thread Andrew Kyle Purtell (Jira)
[ https://issues.apache.org/jira/browse/HBASE-24436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17117881#comment-17117881 ] Andrew Kyle Purtell commented on HBASE-24436: - In another brainstorming we had where I work

[jira] [Commented] (HBASE-24436) The store file open and close thread pool should be shared at the region level

2020-05-27 Thread Andrew Kyle Purtell (Jira)
[ https://issues.apache.org/jira/browse/HBASE-24436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17117877#comment-17117877 ] Andrew Kyle Purtell commented on HBASE-24436: - I was going to propose a change that

[jira] [Commented] (HBASE-24436) The store file open and close thread pool should be shared at the region level

2020-05-27 Thread Anoop Sam John (Jira)
[ https://issues.apache.org/jira/browse/HBASE-24436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17117435#comment-17117435 ] Anoop Sam John commented on HBASE-24436: Just moving the discussion from PR comments to here.

[jira] [Commented] (HBASE-24436) The store file open and close thread pool should be shared at the region level

2020-05-27 Thread Zheng Wang (Jira)
[ https://issues.apache.org/jira/browse/HBASE-24436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17117423#comment-17117423 ] Zheng Wang commented on HBASE-24436: {quote}The goal as o understand it is to stop a large store

[jira] [Commented] (HBASE-24436) The store file open and close thread pool should be shared at the region level

2020-05-26 Thread Andrew Kyle Purtell (Jira)
[ https://issues.apache.org/jira/browse/HBASE-24436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17117263#comment-17117263 ] Andrew Kyle Purtell commented on HBASE-24436: - Repeating my question from the PR: How is it

[jira] [Commented] (HBASE-24436) The store file open and close thread pool should be shared at the region level

2020-05-26 Thread Zheng Wang (Jira)
[ https://issues.apache.org/jira/browse/HBASE-24436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17117257#comment-17117257 ] Zheng Wang commented on HBASE-24436: IMO, shared in region level sounds reasonable, especially the

[jira] [Commented] (HBASE-24436) The store file open and close thread pool should be shared at the region level

2020-05-26 Thread Guanghao Zhang (Jira)
[ https://issues.apache.org/jira/browse/HBASE-24436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17117213#comment-17117213 ] Guanghao Zhang commented on HBASE-24436: How long open or close only one storefile take? > The

[jira] [Commented] (HBASE-24436) The store file open and close thread pool should be shared at the region level

2020-05-26 Thread Junhong Xu (Jira)
[ https://issues.apache.org/jira/browse/HBASE-24436?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17116885#comment-17116885 ] Junhong Xu commented on HBASE-24436: https://github.com/apache/hbase/pull/1783/files > The store