Says: "Processing MSG_REPORT_CLOSE: -ROOT-,,0: java.lang.IllegalArgumentException: hfile.block.cache.size must be between 0.0 and 1.0, not > 1.0"
What do you have for this setting? If what you have is sensible -- 1.0 > X > 0.0 -- then maybe its a corrupt hfile. Look at the server195 log. Should say which file it was loading at the time. Try moving it aside. St.Ack On Fri, Aug 7, 2009 at 10:52 AM, llpind <[email protected]> wrote: > > Still stuck on this issue. > > here is logs of master with logging turned on: > > 2009-08-07 10:48:39,915 INFO org.apache.hadoop.hbase.master.RegionManager: > -ROOT- region unset (but not set to be reassigned) > 2009-08-07 10:48:39,916 DEBUG org.apache.hadoop.hbase.master.HMaster: > Processing todo: ProcessRegionClose of -ROOT-,,0, false, reassign: true > 2009-08-07 10:48:39,916 INFO > org.apache.hadoop.hbase.master.RegionServerOperation: region set as > unassigned: -ROOT-,,0 > 2009-08-07 10:48:40,021 DEBUG org.apache.hadoop.hbase.master.RegionManager: > Assigning for address: 192.168.0.195:60020, startcode: 1249667269182, > load: > (requests=0, regions=0, usedHeap=25, maxHeap=2999): total nregions to > assign=1, nregions to reach balance=0, isMetaAssign=true > 2009-08-07 10:48:40,021 DEBUG org.apache.hadoop.hbase.master.RegionManager: > Doing for address: 192.168.0.195:60020, startcode: 1249667269182, load: > (requests=0, regions=0, usedHeap=25, maxHeap=2999) nregions: 1 and > nRegionsToAssign: 1 > 2009-08-07 10:48:40,021 INFO org.apache.hadoop.hbase.master.RegionManager: > Assigning region -ROOT-,,0 to server195,60020,1249667269182 > 2009-08-07 10:48:40,021 DEBUG org.apache.hadoop.hbase.master.HMaster: > Processing todo: RegionAssignmentHistorian from > server195,60020,1249667269182 > 2009-08-07 10:48:43,025 INFO org.apache.hadoop.hbase.master.ServerManager: > Processing MSG_REPORT_PROCESS_OPEN: -ROOT-,,0 from > server195,60020,1249667269182; 1 of 2 > 2009-08-07 10:48:43,025 INFO org.apache.hadoop.hbase.master.ServerManager: > Processing MSG_REPORT_CLOSE: -ROOT-,,0: java.lang.IllegalArgumentException: > hfile.block.cache.size must be between 0.0 and 1.0, not > 1.0 > at > > org.apache.hadoop.hbase.regionserver.StoreFile.getBlockCache(StoreFile.java:234) > at > > org.apache.hadoop.hbase.regionserver.StoreFile.getBlockCache(StoreFile.java:251) > at > org.apache.hadoop.hbase.regionserver.StoreFile.open(StoreFile.java:269) > at > org.apache.hadoop.hbase.regionserver.StoreFile.<init>(StoreFile.java:129) > at > org.apache.hadoop.hbase.regionserver.Store.loadStoreFiles(Store.java:381) > at org.apache.hadoop.hbase.regionserver.Store.<init>(Store.java:217) > at > > org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:1511) > at > org.apache.hadoop.hbase.regionserver.HRegion.initialize(HRegion.java:308) > at > > org.apache.hadoop.hbase.regionserver.HRegionServer.instantiateRegion(HRegionServer.java:1595) > at > > org.apache.hadoop.hbase.regionserver.HRegionServer.openRegion(HRegionServer.java:1564) > at > > org.apache.hadoop.hbase.regionserver.HRegionServer$Worker.run(HRegionServer.java:1479) > at java.lang.Thread.run(Thread.java:619) > from server195,60020,1249667269182; 2 of 2 > 2009-08-07 10:48:43,025 INFO org.apache.hadoop.hbase.master.RegionManager: > -ROOT- region unset (but not set to be reassigned) > 2009-08-07 10:48:43,026 DEBUG org.apache.hadoop.hbase.master.HMaster: > Processing todo: ProcessRegionClose of -ROOT-,,0, false, reassign: true > 2009-08-07 10:48:43,026 INFO > org.apache.hadoop.hbase.master.RegionServerOperation: region set as > unassigned: -ROOT-,,0 > > > any ideas? > > llpind wrote: > > > > Does anyone know what could be causing this? > > > > I've tried changing various properties etc. everything seems to give me > > the same error. I don't even need to migrate my data, I just want to get > > a clean version going. > > > > Could my old HDFS causing problems? I even changed the data directories, > > and reformatted. > > > > I also noticed this in the master log: > > > > > > > > 2009-08-05 14:01:46,532 INFO > org.apache.hadoop.hbase.master.ServerManager: > > Processing MSG_REPORT_CLOSE: -ROOT-,,0: > > java.lang.IllegalArgumentException: hfile.block.cache.size must be > between > > 0.0 and 1.0, not > 1.0 > > at > > > org.apache.hadoop.hbase.regionserver.StoreFile.getBlockCache(StoreFile.java:234) > > at > > > org.apache.hadoop.hbase.regionserver.StoreFile.getBlockCache(StoreFile.java:251) > > at > > org.apache.hadoop.hbase.regionserver.StoreFile.open(StoreFile.java:269) > > at > > org.apache.hadoop.hbase.regionserver.StoreFile.<init>(StoreFile.java:129) > > at > > org.apache.hadoop.hbase.regionserver.Store.loadStoreFiles(Store.java:381) > > at > > org.apache.hadoop.hbase.regionserver.Store.<init>(Store.java:217) > > at > > > org.apache.hadoop.hbase.regionserver.HRegion.instantiateHStore(HRegion.java:1511) > > at > > org.apache.hadoop.hbase.regionserver.HRegion.initialize(HRegion.java:308) > > at > > > org.apache.hadoop.hbase.regionserver.HRegionServer.instantiateRegion(HRegionServer.java:1595) > > at > > > org.apache.hadoop.hbase.regionserver.HRegionServer.openRegion(HRegionServer.java:1564) > > at > > > org.apache.hadoop.hbase.regionserver.HRegionServer$Worker.run(HRegionServer.java:1479) > > at java.lang.Thread.run(Thread.java:619) > > from box19,60020,1249506081048; 2 of 2 > > 2009-08-05 14:01:46,532 INFO > org.apache.hadoop.hbase.master.RegionManager: > > -ROOT- region unset (but not set to be reassigned) > > 2009-08-05 14:01:46,532 INFO > > org.apache.hadoop.hbase.master.RegionServerOperation: region set as > > unassigned: -ROOT-,,0 > > > > > > > > > > onur.aktas wrote: > >> > >> > >> You also use it with Hadoop 0.20, right? > >> > >>> Date: Wed, 5 Aug 2009 12:01:35 -0700 > >>> From: [email protected] > >>> To: [email protected] > >>> Subject: RE: hbase 0.20.0 Release Candidate 1 available for download > >>> > >>> > >>> Hey onur, > >>> > >>> yeah i already had that set to a location. i tried changing it, and > >>> restarting...but still see the same problem. > >>> > >>> > >>> onur.aktas wrote: > >>> > > >>> > > >>> > Hi, > >>> > > >>> > Can you please add the following to your conf/core-site.xml in Hadoop > >>> > directory and try if it solves your problem? > >>> > Change "/tmp/hadoop-onur" for yourself. > >>> > <property> > >>> > <name>hadoop.tmp.dir</name> > >>> > <value>/tmp/hadoop-onur</value> > >>> > <description>A base for other temporary > directories.</description> > >>> > </property> > >>> > > >>> > > >>> >> Date: Wed, 5 Aug 2009 11:41:54 -0700 > >>> >> From: [email protected] > >>> >> To: [email protected] > >>> >> Subject: Re: hbase 0.20.0 Release Candidate 1 available for download > >>> >> > >>> >> > >>> >> hey, > >>> >> > >>> >> I'm having problems starting up this version at all. > >>> >> > >>> >> Here is what i've done so far: > >>> >> > >>> >> 1. changed data dir to a new location, and port for HDFS. > >>> >> 2. formatted namenode > >>> >> 3. started dfs > >>> >> 4. setup zookeeper properties in hbase-site.xml > >>> >> 5. started hbase > >>> >> > >>> >> it prints out normal output (starting master... starting zookeeper > >>> etc.). > >>> >> Any when i do a jps on master box i see this: > >>> >> > >>> >> 19581 HMaster > >>> >> 18114 SecondaryNameNode > >>> >> 19511 HQuorumPeer > >>> >> 17837 NameNode > >>> >> 19798 Jps > >>> >> 17974 DataNode > >>> >> > >>> >> which is all correct as well. the regionservers look good as well > >>> using > >>> >> jps. But when i try to access the master HBase UI... i get the > >>> >> following > >>> >> the broswer: > >>> >> > >>> >> HTTP ERROR: 500 > >>> >> Trying to contact region server null for region , row '', but failed > >>> >> after 3 > >>> >> attempts. > >>> >> Exceptions: > >>> >> org.apache.hadoop.hbase.client.NoServerForRegionException: Timed out > >>> >> trying > >>> >> to locate root region > >>> >> org.apache.hadoop.hbase.client.NoServerForRegionException: Timed out > >>> >> trying > >>> >> to locate root region > >>> >> org.apache.hadoop.hbase.client.NoServerForRegionException: Timed out > >>> >> trying > >>> >> to locate root region > >>> >> > >>> >> RequestURI=/master.jsp > >>> >> > >>> >> Caused by: > >>> >> org.apache.hadoop.hbase.client.RetriesExhaustedException: Trying to > >>> >> contact > >>> >> region server null for region , row '', but failed after 3 attempts. > >>> >> Exceptions: > >>> >> org.apache.hadoop.hbase.client.NoServerForRegionException: Timed out > >>> >> trying > >>> >> to locate root region > >>> >> org.apache.hadoop.hbase.client.NoServerForRegionException: Timed out > >>> >> trying > >>> >> to locate root region > >>> >> org.apache.hadoop.hbase.client.NoServerForRegionException: Timed out > >>> >> trying > >>> >> to locate root region > >>> >> > >>> >> at > >>> >> > >>> > org.apache.hadoop.hbase.client.HConnectionManager$TableServers.getRegionServerWithRetries(HConnectionManager.java:937) > >>> >> at > >>> >> > >>> > org.apache.hadoop.hbase.client.MetaScanner.metaScan(MetaScanner.java:54) > >>> >> at > >>> >> > >>> > org.apache.hadoop.hbase.client.MetaScanner.metaScan(MetaScanner.java:28) > >>> >> at > >>> >> > >>> > org.apache.hadoop.hbase.client.HConnectionManager$TableServers.listTables(HConnectionManager.java:369) > >>> >> at > >>> >> > >>> > org.apache.hadoop.hbase.client.HBaseAdmin.listTables(HBaseAdmin.java:127) > >>> >> at > >>> >> > >>> > org.apache.hadoop.hbase.generated.master.master_jsp._jspService(master_jsp.java:125) > >>> >> at > >>> org.apache.jasper.runtime.HttpJspBase.service(HttpJspBase.java:97) > >>> >> at javax.servlet.http.HttpServlet.service(HttpServlet.java:820) > >>> >> at > >>> >> > >>> org.mortbay.jetty.servlet.ServletHolder.handle(ServletHolder.java:502) > >>> >> at > >>> >> > >>> > org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:363) > >>> >> at > >>> >> > >>> > org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216) > >>> >> at > >>> >> > >>> > org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:181) > >>> >> at > >>> >> > >>> > org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:766) > >>> >> at > >>> org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:417) > >>> >> at > >>> >> > >>> > org.mortbay.jetty.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:230) > >>> >> at > >>> >> > >>> > org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152) > >>> >> at org.mortbay.jetty.Server.handle(Server.java:324) > >>> >> at > >>> >> > >>> org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:534) > >>> >> at > >>> >> > >>> > org.mortbay.jetty.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:864) > >>> >> at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:533) > >>> >> at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:207) > >>> >> at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:403) > >>> >> at > >>> >> > >>> > org.mortbay.io.nio.SelectChannelEndPoint.run(SelectChannelEndPoint.java:409) > >>> >> at > >>> >> > >>> > org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:522) > >>> >> > >>> >> Powered by Jetty:// > >>> >> > >>> >> > >>> >> > >>> >> > >>> >> ============= in the master logs I see the following INFO messages > >>> over > >>> >> & > >>> >> over: > >>> >> > >>> >> Processing MSG_REPORT_CLOSE: -ROOT-,,0: > >>> >> java.lang.IllegalArgumentException: > >>> >> hfile.block.cache.size must be between 0.0 and 1.0, not > 1.0 > >>> >> > >>> >> ================= > >>> >> i don't have hfile.block.cache.size set. > >>> >> > >>> >> what am I doing wrong? > >>> >> -- > >>> >> View this message in context: > >>> >> > >>> > http://www.nabble.com/ANN%3A-hbase-0.20.0-Release-Candidate-1-available-for-download-tp24730418p24833995.html > >>> >> Sent from the HBase User mailing list archive at Nabble.com. > >>> >> > >>> > > >>> > _________________________________________________________________ > >>> > Anılarınızı istediğiniz herkesle çevrimiçi paylaşın. > >>> > > >>> > http://www.microsoft.com/turkiye/windows/windowslive/products/photos-share.aspx?tab=1 > >>> > > >>> > >>> -- > >>> View this message in context: > >>> > http://www.nabble.com/ANN%3A-hbase-0.20.0-Release-Candidate-1-available-for-download-tp24730418p24834270.html > >>> Sent from the HBase User mailing list archive at Nabble.com. > >>> > >> > >> _________________________________________________________________ > >> Windows Live ile fotoğraflarınızı organize edebilir, düzenleyebilir ve > >> paylaşabilirsiniz. > >> > http://www.microsoft.com/turkiye/windows/windowslive/products/photo-gallery-edit.aspx > >> > > > > > > -- > View this message in context: > http://www.nabble.com/ANN%3A-hbase-0.20.0-Release-Candidate-1-available-for-download-tp24730418p24869311.html > Sent from the HBase User mailing list archive at Nabble.com. > >
