There is one table has 1.4T*3(replication) data . On Tue, Apr 12, 2011 at 8:38 AM, Doug Meil <doug.m...@explorysmedical.com>wrote:
> > Re: " maxHeap=3991" > > Seems like an awful lot of data to put in a 4gb heap. > > -----Original Message----- > From: 陈加俊 [mailto:cjjvict...@gmail.com] > Sent: Monday, April 11, 2011 8:35 PM > To: hbase-u...@hadoop.apache.org > Subject: too many regions cause OME ? > > Is it too many regions ? Is the memory enough ? > HBase-0.20.6 > > 2011-04-12 00:16:31,844 FATAL > org.apache.hadoop.hbase.regionserver.HRegionServer: OutOfMemoryError, > aborting. > java.lang.OutOfMemoryError: Java heap space > at java.io.BufferedInputStream.<init>(BufferedInputStream.java:178) > at > > org.apache.hadoop.hdfs.DFSClient$BlockReader.newBlockReader(DFSClient.java:1380) > at > > org.apache.hadoop.hdfs.DFSClient$DFSInputStream.blockSeekTo(DFSClient.java:1648) > at > org.apache.hadoop.hdfs.DFSClient$DFSInputStream.read(DFSClient.java:1767) > at java.io.DataInputStream.readFully(DataInputStream.java:178) > at java.io.DataInputStream.readFully(DataInputStream.java:152) > at > > org.apache.hadoop.hbase.io.hfile.HFile$FixedFileTrailer.deserialize(HFile.java:1368) > at > org.apache.hadoop.hbase.io.hfile.HFile$Reader.readTrailer(HFile.java:848) > at > org.apache.hadoop.hbase.io.hfile.HFile$Reader.loadFileInfo(HFile.java:793) > at > org.apache.hadoop.hbase.regionserver.StoreFile.open(StoreFile.java:273) > at > org.apache.hadoop.hbase.regionserver.StoreFile.<init>(StoreFile.java:129) > at > org.apache.hadoop.hbase.regionserver.Store.loadStoreFiles(Store.java:410) > at org.apache.hadoop.hbase.regionserver.Store.<init>(Store.java:221) > at > > org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:1636) > at > org.apache.hadoop.hbase.regionserver.HRegion.initialize(HRegion.java:321) > at > > org.apache.hadoop.hbase.regionserver.HRegionServer.instantiateRegion(HRegionServer.java:1566) > at > > org.apache.hadoop.hbase.regionserver.HRegionServer.openRegion(HRegionServer.java:1533) > at > > org.apache.hadoop.hbase.regionserver.HRegionServer$Worker.run(HRegionServer.java:1453) > at java.lang.Thread.run(Thread.java:619) > 2011-04-12 00:16:31,847 INFO > org.apache.hadoop.hbase.regionserver.HRegionServer: Dump of metrics: > request=0.0, regions=1624, stores=3075, storefiles=2526, > storefileIndexSize=374, memstoreSize=339, compactionQueueSize=0, > usedHeap=3990, maxHeap=3991, blockCacheSize=706107016, > blockCacheFree=131010552, blockCacheCount=10631, blockCacheHitRatio=58, > fsReadLatency=0, fsWriteLatency=0, fsSyncLatency=0 > 2011-04-12 00:16:31,848 INFO > org.apache.hadoop.hbase.regionserver.HRegionServer: worker thread exiting > > > -- > Thanks & Best regards > jiajun > -- Thanks & Best regards jiajun
