[ https://issues.apache.org/jira/browse/HBASE-13097?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14341310#comment-14341310 ]
zhangduo commented on HBASE-13097: ---------------------------------- https://builds.apache.org/job/HBase-trunk/6181/artifact/hbase-server/target/surefire-reports/org.apache.hadoop.hbase.client.TestClientScannerRPCTimeout-output.txt {noformat} 2015-02-28 03:32:26,444 INFO [MASTER_TABLE_OPERATIONS-asf900:37322-0] hbase.MetaTableAccessor(1306): Added 2 2015-02-28 03:32:26,445 WARN [MASTER_TABLE_OPERATIONS-asf900:37322-0] balancer.BaseLoadBalancer(1039): Wanted to do round robin assignment but no servers to assign to 2015-02-28 03:32:26,445 ERROR [MASTER_TABLE_OPERATIONS-asf900:37322-0] handler.CreateTableHandler(168): Error trying to create the table testScannerNextRPCTimesout java.io.IOException: Unable to determine a plan to assign region(s) at org.apache.hadoop.hbase.master.AssignmentManager.assign(AssignmentManager.java:1446) at org.apache.hadoop.hbase.util.ModifyRegionUtils.assignRegions(ModifyRegionUtils.java:241) at org.apache.hadoop.hbase.master.handler.CreateTableHandler.handleCreateTable(CreateTableHandler.java:247) at org.apache.hadoop.hbase.master.handler.CreateTableHandler.process(CreateTableHandler.java:156) at org.apache.hadoop.hbase.executor.EventHandler.run(EventHandler.java:103) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:744) {noformat} Seems failed to create table? > Use same EventLoopGroup for different AsyncRpcClients if possible > ----------------------------------------------------------------- > > Key: HBASE-13097 > URL: https://issues.apache.org/jira/browse/HBASE-13097 > Project: HBase > Issue Type: Bug > Components: IPC/RPC, test > Affects Versions: 2.0.0, 1.1.0 > Reporter: zhangduo > Assignee: zhangduo > Fix For: 2.0.0, 1.1.0 > > Attachments: HBASE-13097-addendum.patch, HBASE-13097.patch, > HBASE-13097_1.patch, HBASE-13097_2.patch > > > In some unit tests(such as TestAcidGuarantees) we create multiple Connection > instance. If we use AsyncRpcClient, then there will be multiple netty > Bootstrap and every Bootstrap has its own PooledByteBufAllocator. > I haven't read the code clearly but it uses some threadlocal technics and > jmap shows io.netty.buffer.PoolThreadCache$MemoryRegionCache$Entry is the > biggest things on Heap. > See > https://builds.apache.org/job/HBase-TRUNK/6168/artifact/hbase-server/target/surefire-reports/org.apache.hadoop.hbase.TestAcidGuarantees-output.txt > {noformat} > 2015-02-24 23:50:29,704 WARN [JvmPauseMonitor] > util.JvmPauseMonitor$Monitor(167): Detected pause in JVM or host machine (eg > GC): pause of approximately 20133ms > GC pool 'PS MarkSweep' had collection(s): count=15 time=55525ms > {noformat} > Update: We use a singleton PooledByteBufAllocator so the reason should be too > many threads. So we will work on reduce the connections and rpclients in unit > tests. -- This message was sent by Atlassian JIRA (v6.3.4#6332)