[jira] [Commented] (HBASE-22005) Use ByteBuff's refcnt to track the life cycle of data block

[ https://issues.apache.org/jira/browse/HBASE-22005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16874096#comment-16874096 ] Hudson commented on HBASE-22005: Results for branch branch-2 [build #2029 on

[jira] [Commented] (HBASE-22005) Use ByteBuff's refcnt to track the life cycle of data block

[ https://issues.apache.org/jira/browse/HBASE-22005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16870923#comment-16870923 ] Hudson commented on HBASE-22005: Results for branch master [build #1168 on

[jira] [Commented] (HBASE-22005) Use ByteBuff's refcnt to track the life cycle of data block

[ https://issues.apache.org/jira/browse/HBASE-22005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16806518#comment-16806518 ] Zheng Hu commented on HBASE-22005: -- Pushed to branch HBASE-21879, Thanks [~anoop.hbase], [~Apache9],

[jira] [Commented] (HBASE-22005) Use ByteBuff's refcnt to track the life cycle of data block

[ https://issues.apache.org/jira/browse/HBASE-22005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16806478#comment-16806478 ] Anoop Sam John commented on HBASE-22005: We have another sub task to handle the bigger problem

[jira] [Commented] (HBASE-22005) Use ByteBuff's refcnt to track the life cycle of data block

[ https://issues.apache.org/jira/browse/HBASE-22005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16806467#comment-16806467 ] Zheng Hu commented on HBASE-22005: -- Seems all of the failed UT were introduced from the master branch

[jira] [Commented] (HBASE-22005) Use ByteBuff's refcnt to track the life cycle of data block

[ https://issues.apache.org/jira/browse/HBASE-22005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16805599#comment-16805599 ] Zheng Hu commented on HBASE-22005: -- bq. Can we change mob hfile to work like normal hfile? Yeah, Let

[jira] [Commented] (HBASE-22005) Use ByteBuff's refcnt to track the life cycle of data block

[ https://issues.apache.org/jira/browse/HBASE-22005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16804931#comment-16804931 ] Hadoop QA commented on HBASE-22005: --- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HBASE-22005) Use ByteBuff's refcnt to track the life cycle of data block

[ https://issues.apache.org/jira/browse/HBASE-22005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16804792#comment-16804792 ] Hadoop QA commented on HBASE-22005: --- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HBASE-22005) Use ByteBuff's refcnt to track the life cycle of data block

[ https://issues.apache.org/jira/browse/HBASE-22005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16804053#comment-16804053 ] stack commented on HBASE-22005: --- Good one [~openinx]. Can we change mob hfile to work like normal hfile?

[jira] [Commented] (HBASE-22005) Use ByteBuff's refcnt to track the life cycle of data block

[ https://issues.apache.org/jira/browse/HBASE-22005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16803734#comment-16803734 ] Zheng Hu commented on HBASE-22005: -- Got the root cause now,when reading mob hfile, we do the

[jira] [Commented] (HBASE-22005) Use ByteBuff's refcnt to track the life cycle of data block

[ https://issues.apache.org/jira/browse/HBASE-22005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16803550#comment-16803550 ] Zheng Hu commented on HBASE-22005: -- I wrote an method to dump the bytes in cellBlockStream at server

[jira] [Commented] (HBASE-22005) Use ByteBuff's refcnt to track the life cycle of data block

[ https://issues.apache.org/jira/browse/HBASE-22005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16803548#comment-16803548 ] Hadoop QA commented on HBASE-22005: --- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HBASE-22005) Use ByteBuff's refcnt to track the life cycle of data block

[ https://issues.apache.org/jira/browse/HBASE-22005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16802759#comment-16802759 ] Zheng Hu commented on HBASE-22005: -- The keyvalue looks like the following : {code} ,\x00\x00\x18

[jira] [Commented] (HBASE-22005) Use ByteBuff's refcnt to track the life cycle of data block

[ https://issues.apache.org/jira/browse/HBASE-22005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16802604#comment-16802604 ] Zheng Hu commented on HBASE-22005: -- I think I got the exception finally, but seems our hbase client

[jira] [Commented] (HBASE-22005) Use ByteBuff's refcnt to track the life cycle of data block

[ https://issues.apache.org/jira/browse/HBASE-22005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16801634#comment-16801634 ] Zheng Hu commented on HBASE-22005: -- When I set the hbase.mob.scan.raw as true, then all cells returned.

[jira] [Commented] (HBASE-22005) Use ByteBuff's refcnt to track the life cycle of data block

[ https://issues.apache.org/jira/browse/HBASE-22005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16801479#comment-16801479 ] Zheng Hu commented on HBASE-22005: -- OK, I found the failed Mob*Snapshot UT can by reproduced by

[jira] [Commented] (HBASE-22005) Use ByteBuff's refcnt to track the life cycle of data block

[ https://issues.apache.org/jira/browse/HBASE-22005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16801450#comment-16801450 ] Zheng Hu commented on HBASE-22005: -- The TestLoadAndSwitchEncodeOnDisk is related to HBASE-21937, so I

[jira] [Commented] (HBASE-22005) Use ByteBuff's refcnt to track the life cycle of data block

[ https://issues.apache.org/jira/browse/HBASE-22005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16799608#comment-16799608 ] Hadoop QA commented on HBASE-22005: --- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HBASE-22005) Use ByteBuff's refcnt to track the life cycle of data block

[ https://issues.apache.org/jira/browse/HBASE-22005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16799571#comment-16799571 ] Zheng Hu commented on HBASE-22005: -- Fixed the failed TestCacheOnWrite in patch.v8 , still not sure why

[jira] [Commented] (HBASE-22005) Use ByteBuff's refcnt to track the life cycle of data block

[ https://issues.apache.org/jira/browse/HBASE-22005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16799310#comment-16799310 ] Hadoop QA commented on HBASE-22005: --- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HBASE-22005) Use ByteBuff's refcnt to track the life cycle of data block

[ https://issues.apache.org/jira/browse/HBASE-22005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16799246#comment-16799246 ] Hadoop QA commented on HBASE-22005: --- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HBASE-22005) Use ByteBuff's refcnt to track the life cycle of data block

[ https://issues.apache.org/jira/browse/HBASE-22005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16798995#comment-16798995 ] Hadoop QA commented on HBASE-22005: --- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HBASE-22005) Use ByteBuff's refcnt to track the life cycle of data block

[ https://issues.apache.org/jira/browse/HBASE-22005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16798179#comment-16798179 ] Hadoop QA commented on HBASE-22005: --- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HBASE-22005) Use ByteBuff's refcnt to track the life cycle of data block

[ https://issues.apache.org/jira/browse/HBASE-22005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16791442#comment-16791442 ] Zheng Hu commented on HBASE-22005: -- Seems memory leak happen in my patch, because it easy to throw :

[jira] [Commented] (HBASE-22005) Use ByteBuff's refcnt to track the life cycle of data block

[ https://issues.apache.org/jira/browse/HBASE-22005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16790584#comment-16790584 ] Hadoop QA commented on HBASE-22005: --- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HBASE-22005) Use ByteBuff's refcnt to track the life cycle of data block

[ https://issues.apache.org/jira/browse/HBASE-22005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16789558#comment-16789558 ] Steve Loughran commented on HBASE-22005: bq. I think 2.7.x is a stable release line, and lots of

[jira] [Commented] (HBASE-22005) Use ByteBuff's refcnt to track the life cycle of data block

[ https://issues.apache.org/jira/browse/HBASE-22005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16787780#comment-16787780 ] Duo Zhang commented on HBASE-22005: --- I think 2.7.x is a stable release line, and lots of users are

[jira] [Commented] (HBASE-22005) Use ByteBuff's refcnt to track the life cycle of data block

[ https://issues.apache.org/jira/browse/HBASE-22005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16787773#comment-16787773 ] Steve Loughran commented on HBASE-22005: bq. And for high latency object storage, such as S3, I

[jira] [Commented] (HBASE-22005) Use ByteBuff's refcnt to track the life cycle of data block

[ https://issues.apache.org/jira/browse/HBASE-22005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16787683#comment-16787683 ] Hadoop QA commented on HBASE-22005: --- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HBASE-22005) Use ByteBuff's refcnt to track the life cycle of data block

[ https://issues.apache.org/jira/browse/HBASE-22005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16787636#comment-16787636 ] Zheng Hu commented on HBASE-22005: -- Seems it will be better for others reviewing , if I divide this big

[jira] [Commented] (HBASE-22005) Use ByteBuff's refcnt to track the life cycle of data block

[ https://issues.apache.org/jira/browse/HBASE-22005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16787628#comment-16787628 ] Zheng Hu commented on HBASE-22005: -- Uploaded patch.v2: add an check for FSDataInputStream, if no

[jira] [Commented] (HBASE-22005) Use ByteBuff's refcnt to track the life cycle of data block

[ https://issues.apache.org/jira/browse/HBASE-22005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16787473#comment-16787473 ] Duo Zhang commented on HBASE-22005: --- And [~ste...@apache.org], the point here is not about streaming

[jira] [Commented] (HBASE-22005) Use ByteBuff's refcnt to track the life cycle of data block

[ https://issues.apache.org/jira/browse/HBASE-22005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16787457#comment-16787457 ] Duo Zhang commented on HBASE-22005: --- [~openinx] I think we could introduce the method in HBase, in the

[jira] [Commented] (HBASE-22005) Use ByteBuff's refcnt to track the life cycle of data block

[ https://issues.apache.org/jira/browse/HBASE-22005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16787452#comment-16787452 ] Zheng Hu commented on HBASE-22005: -- OK, [~ste...@apache.org], Got your mind. Then I think we need an

[jira] [Commented] (HBASE-22005) Use ByteBuff's refcnt to track the life cycle of data block

[ https://issues.apache.org/jira/browse/HBASE-22005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16787053#comment-16787053 ] Steve Loughran commented on HBASE-22005: I think you'll need a plan to continue to work with

[jira] [Commented] (HBASE-22005) Use ByteBuff's refcnt to track the life cycle of data block

[ https://issues.apache.org/jira/browse/HBASE-22005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16786915#comment-16786915 ] Zheng Hu commented on HBASE-22005: -- bq. Limitation of the Hadoop version we use in test? Or limitation

[jira] [Commented] (HBASE-22005) Use ByteBuff's refcnt to track the life cycle of data block

[ https://issues.apache.org/jira/browse/HBASE-22005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16786813#comment-16786813 ] Steve Loughran commented on HBASE-22005: A lot of filesystems don't implement the byte buffer

[jira] [Commented] (HBASE-22005) Use ByteBuff's refcnt to track the life cycle of data block

[ https://issues.apache.org/jira/browse/HBASE-22005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16786690#comment-16786690 ] Sean Busbey commented on HBASE-22005: - Limitation of the Hadoop version we use in test? Or

[jira] [Commented] (HBASE-22005) Use ByteBuff's refcnt to track the life cycle of data block

[ https://issues.apache.org/jira/browse/HBASE-22005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16786530#comment-16786530 ] Zheng Hu commented on HBASE-22005: -- Well, the LocalFileSystem did not support the ByteBuffer read

[jira] [Commented] (HBASE-22005) Use ByteBuff's refcnt to track the life cycle of data block

[ https://issues.apache.org/jira/browse/HBASE-22005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16786474#comment-16786474 ] Zheng Hu commented on HBASE-22005: -- Let me fix those hadoop QA issues. > Use ByteBuff's refcnt to

[jira] [Commented] (HBASE-22005) Use ByteBuff's refcnt to track the life cycle of data block

[ https://issues.apache.org/jira/browse/HBASE-22005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16786442#comment-16786442 ] Hadoop QA commented on HBASE-22005: --- | (x) *{color:red}-1 overall{color}* | \\ \\ || Vote || Subsystem

[jira] [Commented] (HBASE-22005) Use ByteBuff's refcnt to track the life cycle of data block

[ https://issues.apache.org/jira/browse/HBASE-22005?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel=16786363#comment-16786363 ] Zheng Hu commented on HBASE-22005: -- Upload an initial patch in RB now, still need more consideration I