[ https://issues.apache.org/jira/browse/AMBARI-11552?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Nick Dimiduk updated AMBARI-11552: ---------------------------------- Description: Launching a HDP-2.3 RS with the HDP-2.2 stack_advisor's output on a machine with lots of ram results in {noformat} regionserver.HRegionServer: Failed init java.lang.OutOfMemoryError: Direct buffer memory at java.nio.Bits.reserveMemory(Bits.java:658) at java.nio.DirectByteBuffer.<init>(DirectByteBuffer.java:123) at java.nio.ByteBuffer.allocateDirect(ByteBuffer.java:311) at org.apache.hadoop.hbase.util.ByteBufferArray.<init>(ByteBufferArray.java:65) at org.apache.hadoop.hbase.io.hfile.bucket.ByteBufferIOEngine.<init>(ByteBufferIOEngine.java:47) at org.apache.hadoop.hbase.io.hfile.bucket.BucketCache.getIOEngineFromName(BucketCache.java:309) at org.apache.hadoop.hbase.io.hfile.bucket.BucketCache.<init>(BucketCache.java:219) at org.apache.hadoop.hbase.io.hfile.CacheConfig.getBucketCache(CacheConfig.java:568) at org.apache.hadoop.hbase.io.hfile.CacheConfig.getL2(CacheConfig.java:511) at org.apache.hadoop.hbase.io.hfile.CacheConfig.instantiateBlockCache(CacheConfig.java:591) at org.apache.hadoop.hbase.io.hfile.CacheConfig.<init>(CacheConfig.java:231) at org.apache.hadoop.hbase.regionserver.HRegionServer.handleReportForDutyResponse(HRegionServer.java:1349) at org.apache.hadoop.hbase.regionserver.HRegionServer.run(HRegionServer.java:896) at java.lang.Thread.run(Thread.java:745) {noformat} HBASE-11520 introduced a subtle change in the configuration, it's release note says bq. Remove "hbase.bucketcache.percentage.in.combinedcache". Simplifies config of block cache. If you are using this config., after this patch goes in, it will be ignored. The L1 LruBlockCache will be whatever hfile.block.cache.size is set to and the L2 BucketCache will be whatever hbase.bucketcache.size is set to. was: Launching a RS with the HDP-2.2 stack_advisor's output on a machine with lots of ram results in {noformat} regionserver.HRegionServer: Failed init java.lang.OutOfMemoryError: Direct buffer memory at java.nio.Bits.reserveMemory(Bits.java:658) at java.nio.DirectByteBuffer.<init>(DirectByteBuffer.java:123) at java.nio.ByteBuffer.allocateDirect(ByteBuffer.java:311) at org.apache.hadoop.hbase.util.ByteBufferArray.<init>(ByteBufferArray.java:65) at org.apache.hadoop.hbase.io.hfile.bucket.ByteBufferIOEngine.<init>(ByteBufferIOEngine.java:47) at org.apache.hadoop.hbase.io.hfile.bucket.BucketCache.getIOEngineFromName(BucketCache.java:309) at org.apache.hadoop.hbase.io.hfile.bucket.BucketCache.<init>(BucketCache.java:219) at org.apache.hadoop.hbase.io.hfile.CacheConfig.getBucketCache(CacheConfig.java:568) at org.apache.hadoop.hbase.io.hfile.CacheConfig.getL2(CacheConfig.java:511) at org.apache.hadoop.hbase.io.hfile.CacheConfig.instantiateBlockCache(CacheConfig.java:591) at org.apache.hadoop.hbase.io.hfile.CacheConfig.<init>(CacheConfig.java:231) at org.apache.hadoop.hbase.regionserver.HRegionServer.handleReportForDutyResponse(HRegionServer.java:1349) at org.apache.hadoop.hbase.regionserver.HRegionServer.run(HRegionServer.java:896) at java.lang.Thread.run(Thread.java:745) {noformat} HBASE-11520 introduced a subtle change in the configuration, it's release note says bq. Remove "hbase.bucketcache.percentage.in.combinedcache". Simplifies config of block cache. If you are using this config., after this patch goes in, it will be ignored. The L1 LruBlockCache will be whatever hfile.block.cache.size is set to and the L2 BucketCache will be whatever hbase.bucketcache.size is set to. > 2.3 stack advisor doesn't take into account HBASE-11520 > ------------------------------------------------------- > > Key: AMBARI-11552 > URL: https://issues.apache.org/jira/browse/AMBARI-11552 > Project: Ambari > Issue Type: Bug > Reporter: Nick Dimiduk > Fix For: 2.1.0 > > Attachments: AMBARI-11552.00.patch > > > Launching a HDP-2.3 RS with the HDP-2.2 stack_advisor's output on a machine > with lots of ram results in > {noformat} > regionserver.HRegionServer: Failed init > java.lang.OutOfMemoryError: Direct buffer memory > at java.nio.Bits.reserveMemory(Bits.java:658) > at java.nio.DirectByteBuffer.<init>(DirectByteBuffer.java:123) > at java.nio.ByteBuffer.allocateDirect(ByteBuffer.java:311) > at > org.apache.hadoop.hbase.util.ByteBufferArray.<init>(ByteBufferArray.java:65) > at > org.apache.hadoop.hbase.io.hfile.bucket.ByteBufferIOEngine.<init>(ByteBufferIOEngine.java:47) > at > org.apache.hadoop.hbase.io.hfile.bucket.BucketCache.getIOEngineFromName(BucketCache.java:309) > at > org.apache.hadoop.hbase.io.hfile.bucket.BucketCache.<init>(BucketCache.java:219) > at > org.apache.hadoop.hbase.io.hfile.CacheConfig.getBucketCache(CacheConfig.java:568) > at org.apache.hadoop.hbase.io.hfile.CacheConfig.getL2(CacheConfig.java:511) > at > org.apache.hadoop.hbase.io.hfile.CacheConfig.instantiateBlockCache(CacheConfig.java:591) > at org.apache.hadoop.hbase.io.hfile.CacheConfig.<init>(CacheConfig.java:231) > at > org.apache.hadoop.hbase.regionserver.HRegionServer.handleReportForDutyResponse(HRegionServer.java:1349) > at > org.apache.hadoop.hbase.regionserver.HRegionServer.run(HRegionServer.java:896) > at java.lang.Thread.run(Thread.java:745) > {noformat} > HBASE-11520 introduced a subtle change in the configuration, it's release > note says > bq. Remove "hbase.bucketcache.percentage.in.combinedcache". Simplifies config > of block cache. If you are using this config., after this patch goes in, it > will be ignored. The L1 LruBlockCache will be whatever hfile.block.cache.size > is set to and the L2 BucketCache will be whatever hbase.bucketcache.size is > set to. -- This message was sent by Atlassian JIRA (v6.3.4#6332)