[ 
https://issues.apache.org/jira/browse/HBASE-11544?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14370182#comment-14370182
 ] 

Lars Hofhansl commented on HBASE-11544:
---------------------------------------

[~stack], Have a look at HBASE-12976 and HBASE-13262. It's pretty messed up.
HBASE-12976 needed to be reverted due to what we found in HBASE-12362, this one 
relies on it (otherwise most scans will now OOM).

I can leave this one in, since we do not have a release for 1.1 or 2.0, but I 
assume many tests will now fail with OOMs. Or I can put HBASE-12976 for 1.1 and 
2.0 for the same reason. (maybe I was a bit hasty with the revert in those 
branches).

I don't think a dev-list discussion will help. The revert for HBASE-12976 is a 
blocker for 0.98.


> [Ergonomics] hbase.client.scanner.caching is dogged and will try to return 
> batch even if it means OOME
> ------------------------------------------------------------------------------------------------------
>
>                 Key: HBASE-11544
>                 URL: https://issues.apache.org/jira/browse/HBASE-11544
>             Project: HBase
>          Issue Type: Bug
>            Reporter: stack
>            Assignee: Lars Hofhansl
>            Priority: Critical
>              Labels: beginner
>             Fix For: 2.0.0, 1.1.0
>
>         Attachments: HBASE-11544-branch_1_0-v1.patch, 
> HBASE-11544-branch_1_0-v2.patch, HBASE-11544-v1.patch, HBASE-11544-v2.patch, 
> HBASE-11544-v3.patch, HBASE-11544-v4.patch, HBASE-11544-v5.patch, 
> HBASE-11544-v6.patch, HBASE-11544-v6.patch, HBASE-11544-v6.patch, 
> HBASE-11544-v7.patch, HBASE-11544-v8-branch-1.patch, HBASE-11544-v8.patch, 
> gc.j.png, hits.j.png, mean.png, net.j.png
>
>
> Running some tests, I set hbase.client.scanner.caching=1000.  Dataset has 
> large cells.  I kept OOME'ing.
> Serverside, we should measure how much we've accumulated and return to the 
> client whatever we've gathered once we pass out a certain size threshold 
> rather than keep accumulating till we OOME.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to