[
https://issues.apache.org/jira/browse/PHOENIX-34?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13918575#comment-13918575
]
Mujtaba Chohan commented on PHOENIX-34:
---------------------------------------
[~maryannxue] I'm still getting the following expception:
ERROR org.apache.hadoop.hbase.regionserver.HRegionServer:
java.io.IOException: org.apache.phoenix.memory.InsufficientMemoryException:
Requested memory of 22886552 bytes is larger than global pool of 22111027 bytes.
at
org.apache.phoenix.memory.GlobalMemoryManager.allocateBytes(GlobalMemoryManager.java:72)
at
org.apache.phoenix.memory.GlobalMemoryManager.access$300(GlobalMemoryManager.java:32)
at
org.apache.phoenix.memory.GlobalMemoryManager$GlobalMemoryChunk.resize(GlobalMemoryManager.java:142)
at
org.apache.phoenix.join.HashCacheFactory$HashCacheImpl.<init>(HashCacheFactory.java:91)
at
org.apache.phoenix.join.HashCacheFactory$HashCacheImpl.<init>(HashCacheFactory.java:68)
at
org.apache.phoenix.join.HashCacheFactory.newCache(HashCacheFactory.java:61)
at
org.apache.phoenix.cache.TenantCacheImpl.addServerCache(TenantCacheImpl.java:87)
at
org.apache.phoenix.coprocessor.ServerCachingEndpointImpl.addServerCache(ServerCachingEndpointImpl.java:45)
Query: select count(*) from LHS20M JOIN RHS100K on RHS100K.mypk =
LHS20M.column1; via Sqlline with restarted distributed cluster (2 node x 4GB
heap) running HBase 0.94.14.
> Insufficient memory exception on join when RHS rows count > 250K
> -----------------------------------------------------------------
>
> Key: PHOENIX-34
> URL: https://issues.apache.org/jira/browse/PHOENIX-34
> Project: Phoenix
> Issue Type: Bug
> Affects Versions: 3.0.0
> Environment: HBase 0.94.14, r1543222, Hadoop 1.0.4, r1393290, 2 RS +
> 1 Master, Heap 4GB per RS
> Reporter: Mujtaba Chohan
> Fix For: 3.0.0
>
>
> Join fails when rows count of RHS table is >250K. Detail on table schema is
> and performance numbers with different LHS/RHS row count is on
> http://phoenix-bin.github.io/client/performance/phoenix-20140210023154.htm.
> James comment:
> So that's with a 4GB heap allowing Phoenix to use 50% of it. With a pretty
> narrow table: 3 KV columns of 30bytes. Topping out at 250K is a bit low. I
> wonder if our memory estimation matches reality.
> What do you think Maryann?
> How about filing a JIRA, Mujtaba. This is a good conversation to have on the
> dev list. Can we move it there, please?
--
This message was sent by Atlassian JIRA
(v6.2#6252)
