[jira] [Commented] (HBASE-22620) When a cluster open replication,regionserver will not clean up the walLog references on zk due to no wal entry need to be replicated

[ https://issues.apache.org/jira/browse/HBASE-22620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17463618#comment-17463618 ] wenhao commented on HBASE-22620: So, is there a good solution?  I encounter the same problem with

[jira] [Commented] (HBASE-22620) When a cluster open replication,regionserver will not clean up the walLog references on zk due to no wal entry need to be replicated

[ https://issues.apache.org/jira/browse/HBASE-22620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17166100#comment-17166100 ] leizhang commented on HBASE-22620: -- I think this problem still exist in Hbase2.x , when i use

[jira] [Commented] (HBASE-22620) When a cluster open replication,regionserver will not clean up the walLog references on zk due to no wal entry need to be replicated

[ https://issues.apache.org/jira/browse/HBASE-22620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=17126583#comment-17126583 ] li yang commented on HBASE-22620: - Have you noticed that if the shipper thread still existed? > When a

[jira] [Commented] (HBASE-22620) When a cluster open replication,regionserver will not clean up the walLog references on zk due to no wal entry need to be replicated

[ https://issues.apache.org/jira/browse/HBASE-22620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16876588#comment-16876588 ] leizhang commented on HBASE-22620: -- {code:java} //代码占位符 WALEntryBatch entryBatch =

[jira] [Commented] (HBASE-22620) When a cluster open replication,regionserver will not clean up the walLog references on zk due to no wal entry need to be replicated

[ https://issues.apache.org/jira/browse/HBASE-22620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16876233#comment-16876233 ] yaojingyi commented on HBASE-22620: --- We also encountered this problem in hbase-1.4.8. And I have a

[jira] [Commented] (HBASE-22620) When a cluster open replication,regionserver will not clean up the walLog references on zk due to no wal entry need to be replicated

[ https://issues.apache.org/jira/browse/HBASE-22620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16874710#comment-16874710 ] leizhang commented on HBASE-22620: -- not only the pressure on zk.consider when there is a large amount

[jira] [Commented] (HBASE-22620) When a cluster open replication,regionserver will not clean up the walLog references on zk due to no wal entry need to be replicated

[ https://issues.apache.org/jira/browse/HBASE-22620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16874063#comment-16874063 ] leizhang commented on HBASE-22620: -- thank you very much !  I check the  source code of Hbase2.1.0 ，and

[jira] [Commented] (HBASE-22620) When a cluster open replication,regionserver will not clean up the walLog references on zk due to no wal entry need to be replicated

[ https://issues.apache.org/jira/browse/HBASE-22620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16873782#comment-16873782 ] Allan Yang commented on HBASE-22620: Yes, it is a valid problem, which is already fixed by

[jira] [Commented] (HBASE-22620) When a cluster open replication,regionserver will not clean up the walLog references on zk due to no wal entry need to be replicated

[ https://issues.apache.org/jira/browse/HBASE-22620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16873771#comment-16873771 ] leizhang commented on HBASE-22620: -- Yesterday， I found the Hbase 1.2.4 also exists the same problem >

[jira] [Commented] (HBASE-22620) When a cluster open replication,regionserver will not clean up the walLog references on zk due to no wal entry need to be replicated

[ https://issues.apache.org/jira/browse/HBASE-22620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16873770#comment-16873770 ] leizhang commented on HBASE-22620: -- Sorry ， I only check the code in Hbase 2.x， I find it is same as

[jira] [Commented] (HBASE-22620) When a cluster open replication,regionserver will not clean up the walLog references on zk due to no wal entry need to be replicated

[ https://issues.apache.org/jira/browse/HBASE-22620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16873766#comment-16873766 ] Zheng Hu commented on HBASE-22620: -- So the problem is actually happened in HBase1.4.9 , not in HBase2.x

[jira] [Commented] (HBASE-22620) When a cluster open replication,regionserver will not clean up the walLog references on zk due to no wal entry need to be replicated

[ https://issues.apache.org/jira/browse/HBASE-22620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16873305#comment-16873305 ] leizhang commented on HBASE-22620: --   did you expect one just like this ?  Hbase version 1.4.9

[jira] [Commented] (HBASE-22620) When a cluster open replication,regionserver will not clean up the walLog references on zk due to no wal entry need to be replicated

[ https://issues.apache.org/jira/browse/HBASE-22620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16873199#comment-16873199 ] Zheng Hu commented on HBASE-22620: -- Could you please provide a full jstack file ? I think we should

[jira] [Commented] (HBASE-22620) When a cluster open replication,regionserver will not clean up the walLog references on zk due to no wal entry need to be replicated

[ https://issues.apache.org/jira/browse/HBASE-22620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16871929#comment-16871929 ] leizhang commented on HBASE-22620: -- I print the stack info of my regionserver, and find the thread

[jira] [Commented] (HBASE-22620) When a cluster open replication,regionserver will not clean up the walLog references on zk due to no wal entry need to be replicated

[ https://issues.apache.org/jira/browse/HBASE-22620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16871918#comment-16871918 ] leizhang commented on HBASE-22620: -- "regionserver/x:16020.replicationSource,1-EventThread" #421

[jira] [Commented] (HBASE-22620) When a cluster open replication,regionserver will not clean up the walLog references on zk due to no wal entry need to be replicated

[ https://issues.apache.org/jira/browse/HBASE-22620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16871917#comment-16871917 ] leizhang commented on HBASE-22620: -- I print the stack info of my regionserver，and find the thread

[jira] [Commented] (HBASE-22620) When a cluster open replication,regionserver will not clean up the walLog references on zk due to no wal entry need to be replicated

[ https://issues.apache.org/jira/browse/HBASE-22620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16870983#comment-16870983 ] leizhang commented on HBASE-22620: -- sorry , i mean logPositionAndCleanOldLogs() > When a cluster open

[jira] [Commented] (HBASE-22620) When a cluster open replication,regionserver will not clean up the walLog references on zk due to no wal entry need to be replicated

[ https://issues.apache.org/jira/browse/HBASE-22620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16870981#comment-16870981 ] Duo Zhang commented on HBASE-22620: --- {quote} but the zk refs cleaning up job may be blocked due to the

[jira] [Commented] (HBASE-22620) When a cluster open replication,regionserver will not clean up the walLog references on zk due to no wal entry need to be replicated

[ https://issues.apache.org/jira/browse/HBASE-22620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16870944#comment-16870944 ] leizhang commented on HBASE-22620: --   I view the code that create the entryBatch,just as follows :

[jira] [Commented] (HBASE-22620) When a cluster open replication,regionserver will not clean up the walLog references on zk due to no wal entry need to be replicated

[ https://issues.apache.org/jira/browse/HBASE-22620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16870875#comment-16870875 ] leizhang commented on HBASE-22620: -- Thank you, you can just  keep a replication cluster with no data

[jira] [Commented] (HBASE-22620) When a cluster open replication,regionserver will not clean up the walLog references on zk due to no wal entry need to be replicated

[ https://issues.apache.org/jira/browse/HBASE-22620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16870861#comment-16870861 ] Duo Zhang commented on HBASE-22620: --- I think we will always have an empty entry batch when reaching

[jira] [Commented] (HBASE-22620) When a cluster open replication,regionserver will not clean up the walLog references on zk due to no wal entry need to be replicated

[ https://issues.apache.org/jira/browse/HBASE-22620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16870854#comment-16870854 ] leizhang commented on HBASE-22620: -- {code:java} WALEntryBatch entryBatch = entryReader.take();

[jira] [Commented] (HBASE-22620) When a cluster open replication,regionserver will not clean up the walLog references on zk due to no wal entry need to be replicated

[ https://issues.apache.org/jira/browse/HBASE-22620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16870842#comment-16870842 ] Duo Zhang commented on HBASE-22620: --- I think there may be other problems, for example, the shipper

[jira] [Commented] (HBASE-22620) When a cluster open replication,regionserver will not clean up the walLog references on zk due to no wal entry need to be replicated

[ https://issues.apache.org/jira/browse/HBASE-22620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16870838#comment-16870838 ] Duo Zhang commented on HBASE-22620: --- {code} /** * Do the shipping logic */ private void

[jira] [Commented] (HBASE-22620) When a cluster open replication,regionserver will not clean up the walLog references on zk due to no wal entry need to be replicated

[ https://issues.apache.org/jira/browse/HBASE-22620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16870837#comment-16870837 ] leizhang commented on HBASE-22620: -- No, we don't modify the logic in ReplicationSource Endpoint > When

[jira] [Commented] (HBASE-22620) When a cluster open replication,regionserver will not clean up the walLog references on zk due to no wal entry need to be replicated

[ https://issues.apache.org/jira/browse/HBASE-22620?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16870834#comment-16870834 ] Duo Zhang commented on HBASE-22620: --- Do you have a customized ReplicationEndpoint? > When a cluster