[jira] [Commented] (HBASE-23286) Improve MTTR: Split WAL to HFile

2020-06-15 Thread Michael Stack (Jira)
[ https://issues.apache.org/jira/browse/HBASE-23286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17136254#comment-17136254 ] Michael Stack commented on HBASE-23286: --- Thanks [~zghao] That helps. > Improve MT

[jira] [Commented] (HBASE-23286) Improve MTTR: Split WAL to HFile

2020-06-15 Thread Guanghao Zhang (Jira)
[ https://issues.apache.org/jira/browse/HBASE-23286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17136240#comment-17136240 ] Guanghao Zhang commented on HBASE-23286: [~stack] I thought this was resolved by

[jira] [Commented] (HBASE-23286) Improve MTTR: Split WAL to HFile

2020-06-15 Thread Michael Stack (Jira)
[ https://issues.apache.org/jira/browse/HBASE-23286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17136181#comment-17136181 ] Michael Stack commented on HBASE-23286: --- [~zghao] Any progress on the [~pankaj2461

[jira] [Commented] (HBASE-23286) Improve MTTR: Split WAL to HFile

2020-01-26 Thread Guanghao Zhang (Jira)
[ https://issues.apache.org/jira/browse/HBASE-23286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17024056#comment-17024056 ] Guanghao Zhang commented on HBASE-23286: {quote}how BoundedRecoveredHFilesOutput

[jira] [Commented] (HBASE-23286) Improve MTTR: Split WAL to HFile

2020-01-22 Thread Pankaj Kumar (Jira)
[ https://issues.apache.org/jira/browse/HBASE-23286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17020974#comment-17020974 ] Pankaj Kumar commented on HBASE-23286: -- [~zghao] > Improve MTTR: Split WAL to HFil

[jira] [Commented] (HBASE-23286) Improve MTTR: Split WAL to HFile

2020-01-11 Thread Duo Zhang (Jira)
[ https://issues.apache.org/jira/browse/HBASE-23286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17013642#comment-17013642 ] Duo Zhang commented on HBASE-23286: --- So there is no problem then? Let's resolve this?

[jira] [Commented] (HBASE-23286) Improve MTTR: Split WAL to HFile

2020-01-11 Thread Michael Stack (Jira)
[ https://issues.apache.org/jira/browse/HBASE-23286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17013581#comment-17013581 ] Michael Stack commented on HBASE-23286: --- Ugh. It was my "kill" script. It was doin

[jira] [Commented] (HBASE-23286) Improve MTTR: Split WAL to HFile

2020-01-11 Thread Michael Stack (Jira)
[ https://issues.apache.org/jira/browse/HBASE-23286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17013580#comment-17013580 ] Michael Stack commented on HBASE-23286: --- [~zghao] Something else is going on. SCP

[jira] [Commented] (HBASE-23286) Improve MTTR: Split WAL to HFile

2020-01-10 Thread Guanghao Zhang (Jira)
[ https://issues.apache.org/jira/browse/HBASE-23286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17012543#comment-17012543 ] Guanghao Zhang commented on HBASE-23286: {quote}bq.  I think [~zghao] has alread

[jira] [Commented] (HBASE-23286) Improve MTTR: Split WAL to HFile

2020-01-09 Thread Michael Stack (Jira)
[ https://issues.apache.org/jira/browse/HBASE-23286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17012500#comment-17012500 ] Michael Stack commented on HBASE-23286: --- I checked server WAL dir before and after

[jira] [Commented] (HBASE-23286) Improve MTTR: Split WAL to HFile

2020-01-09 Thread Duo Zhang (Jira)
[ https://issues.apache.org/jira/browse/HBASE-23286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17012493#comment-17012493 ] Duo Zhang commented on HBASE-23286: --- On the pasted snippet, I do not think it relates

[jira] [Commented] (HBASE-23286) Improve MTTR: Split WAL to HFile

2020-01-09 Thread Michael Stack (Jira)
[ https://issues.apache.org/jira/browse/HBASE-23286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17012480#comment-17012480 ] Michael Stack commented on HBASE-23286: --- [~zghao] Thanks. Shout if you want me to

[jira] [Commented] (HBASE-23286) Improve MTTR: Split WAL to HFile

2020-01-09 Thread Guanghao Zhang (Jira)
[ https://issues.apache.org/jira/browse/HBASE-23286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17012401#comment-17012401 ] Guanghao Zhang commented on HBASE-23286: [~stack]  Let me take a look about this

[jira] [Commented] (HBASE-23286) Improve MTTR: Split WAL to HFile

2020-01-09 Thread Michael Stack (Jira)
[ https://issues.apache.org/jira/browse/HBASE-23286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17012272#comment-17012272 ] Michael Stack commented on HBASE-23286: --- [~zghao] does this work for you? I enabl

[jira] [Commented] (HBASE-23286) Improve MTTR: Split WAL to HFile

2020-01-09 Thread Andrew Kyle Purtell (Jira)
[ https://issues.apache.org/jira/browse/HBASE-23286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17012200#comment-17012200 ] Andrew Kyle Purtell commented on HBASE-23286: - This looks like a risky backp

[jira] [Commented] (HBASE-23286) Improve MTTR: Split WAL to HFile

2020-01-03 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/HBASE-23286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17007869#comment-17007869 ] Hudson commented on HBASE-23286: Results for branch branch-2 [build #2405 on bu

[jira] [Commented] (HBASE-23286) Improve MTTR: Split WAL to HFile

2020-01-03 Thread Pankaj Kumar (Jira)
[ https://issues.apache.org/jira/browse/HBASE-23286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17007338#comment-17007338 ] Pankaj Kumar commented on HBASE-23286: -- Ping [~andrew.purt...@gmail.com], it would

[jira] [Commented] (HBASE-23286) Improve MTTR: Split WAL to HFile

2019-12-27 Thread Hudson (Jira)
[ https://issues.apache.org/jira/browse/HBASE-23286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17004199#comment-17004199 ] Hudson commented on HBASE-23286: Results for branch master [build #1580 on buil

[jira] [Commented] (HBASE-23286) Improve MTTR: Split WAL to HFile

2019-12-17 Thread Guanghao Zhang (Jira)
[ https://issues.apache.org/jira/browse/HBASE-23286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16998720#comment-16998720 ] Guanghao Zhang commented on HBASE-23286: Ping [~anoop.hbase] [~zhangduo] [~stack

[jira] [Commented] (HBASE-23286) Improve MTTR: Split WAL to HFile

2019-12-17 Thread Guanghao Zhang (Jira)
[ https://issues.apache.org/jira/browse/HBASE-23286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16998721#comment-16998721 ] Guanghao Zhang commented on HBASE-23286: Ping [~anoop.hbase] [~zhangduo] [~stack

[jira] [Commented] (HBASE-23286) Improve MTTR: Split WAL to HFile

2019-12-13 Thread Guanghao Zhang (Jira)
[ https://issues.apache.org/jira/browse/HBASE-23286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16995517#comment-16995517 ] Guanghao Zhang commented on HBASE-23286: In big cluster, the split WAL task was

[jira] [Commented] (HBASE-23286) Improve MTTR: Split WAL to HFile

2019-12-13 Thread Guanghao Zhang (Jira)
[ https://issues.apache.org/jira/browse/HBASE-23286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16995515#comment-16995515 ] Guanghao Zhang commented on HBASE-23286: {quote}Why the split time for hfile=fal

[jira] [Commented] (HBASE-23286) Improve MTTR: Split WAL to HFile

2019-12-13 Thread Duo Zhang (Jira)
[ https://issues.apache.org/jira/browse/HBASE-23286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16995501#comment-16995501 ] Duo Zhang commented on HBASE-23286: --- Why the split time for hfile=false reduces a lot

[jira] [Commented] (HBASE-23286) Improve MTTR: Split WAL to HFile

2019-12-13 Thread Guanghao Zhang (Jira)
[ https://issues.apache.org/jira/browse/HBASE-23286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16995492#comment-16995492 ] Guanghao Zhang commented on HBASE-23286: Test the patch in a cluster which has 5

[jira] [Commented] (HBASE-23286) Improve MTTR: Split WAL to HFile

2019-12-13 Thread Guanghao Zhang (Jira)
[ https://issues.apache.org/jira/browse/HBASE-23286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16995486#comment-16995486 ] Guanghao Zhang commented on HBASE-23286: {quote}how/whether that affects?  {quot

[jira] [Commented] (HBASE-23286) Improve MTTR: Split WAL to HFile

2019-12-12 Thread Anoop Sam John (Jira)
[ https://issues.apache.org/jira/browse/HBASE-23286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16995353#comment-16995353 ] Anoop Sam John commented on HBASE-23286: Nice numbers [~zghao].. So here per ea

[jira] [Commented] (HBASE-23286) Improve MTTR: Split WAL to HFile

2019-12-12 Thread chenxu (Jira)
[ https://issues.apache.org/jira/browse/HBASE-23286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16995352#comment-16995352 ] chenxu commented on HBASE-23286: Nice number > Improve MTTR: Split WAL to HFile > -

[jira] [Commented] (HBASE-23286) Improve MTTR: Split WAL to HFile

2019-12-12 Thread Guanghao Zhang (Jira)
[ https://issues.apache.org/jira/browse/HBASE-23286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16995343#comment-16995343 ] Guanghao Zhang commented on HBASE-23286: Bulkload log example: {code:java} 2019-

[jira] [Commented] (HBASE-23286) Improve MTTR: Split WAL to HFile

2019-12-12 Thread Guanghao Zhang (Jira)
[ https://issues.apache.org/jira/browse/HBASE-23286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16995332#comment-16995332 ] Guanghao Zhang commented on HBASE-23286: Test the patch in a small cluster which

[jira] [Commented] (HBASE-23286) Improve MTTR: Split WAL to HFile

2019-11-14 Thread Guangxu Cheng (Jira)
[ https://issues.apache.org/jira/browse/HBASE-23286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16974267#comment-16974267 ] Guangxu Cheng commented on HBASE-23286: --- I think it's better to write HFile to rec

[jira] [Commented] (HBASE-23286) Improve MTTR: Split WAL to HFile

2019-11-13 Thread Guanghao Zhang (Jira)
[ https://issues.apache.org/jira/browse/HBASE-23286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16973941#comment-16973941 ] Guanghao Zhang commented on HBASE-23286: {quote}Can we write HFile to target CF

[jira] [Commented] (HBASE-23286) Improve MTTR: Split WAL to HFile

2019-11-13 Thread Michael Stack (Jira)
[ https://issues.apache.org/jira/browse/HBASE-23286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16973936#comment-16973936 ] Michael Stack commented on HBASE-23286: --- bq. I think Michael Stack wanted to ask w

[jira] [Commented] (HBASE-23286) Improve MTTR: Split WAL to HFile

2019-11-13 Thread chenxu (Jira)
[ https://issues.apache.org/jira/browse/HBASE-23286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16973896#comment-16973896 ] chenxu commented on HBASE-23286: Can we write HFile to target CF dir directly instead of

[jira] [Commented] (HBASE-23286) Improve MTTR: Split WAL to HFile

2019-11-13 Thread Duo Zhang (Jira)
[ https://issues.apache.org/jira/browse/HBASE-23286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16973866#comment-16973866 ] Duo Zhang commented on HBASE-23286: --- I think [~stack] wanted to ask why the compaction

[jira] [Commented] (HBASE-23286) Improve MTTR: Split WAL to HFile

2019-11-13 Thread Guanghao Zhang (Jira)
[ https://issues.apache.org/jira/browse/HBASE-23286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16973864#comment-16973864 ] Guanghao Zhang commented on HBASE-23286: {quote}How does this relate to improvin

[jira] [Commented] (HBASE-23286) Improve MTTR: Split WAL to HFile

2019-11-13 Thread Michael Stack (Jira)
[ https://issues.apache.org/jira/browse/HBASE-23286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16973667#comment-16973667 ] Michael Stack commented on HBASE-23286: --- bq. After HBASE-20724, the compaction eve

[jira] [Commented] (HBASE-23286) Improve MTTR: Split WAL to HFile

2019-11-13 Thread Guanghao Zhang (Jira)
[ https://issues.apache.org/jira/browse/HBASE-23286?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16973278#comment-16973278 ] Guanghao Zhang commented on HBASE-23286: A initial patch was attathed. > Improv