One of the servers that acts as a hadoop and hbase node in our cluster
went down. After the machine was brought back up I restarted hbase but
could not interact with it. After checking the logs on all 3 of our
machines I found a ton of stack traces like the following:
2008-06-26 23:07:56,683 ERROR org.apache.hadoop.hbase.HRegionServer:
error opening region -ROOT-,,0
java.io.EOFException
at java.io.DataInputStream.readFully(DataInputStream.java:178)
at java.io.DataInputStream.readFully(DataInputStream.java:152)
at org.apache.hadoop.io.SequenceFile
$Reader.init(SequenceFile.java:1434)
at org.apache.hadoop.io.SequenceFile
$Reader.<init>(SequenceFile.java:1411)
at org.apache.hadoop.io.SequenceFile
$Reader.<init>(SequenceFile.java:1400)
at org.apache.hadoop.io.SequenceFile
$Reader.<init>(SequenceFile.java:1395)
at org.apache.hadoop.io.MapFile$Reader.<init>(MapFile.java:254)
at org.apache.hadoop.io.MapFile$Reader.<init>(MapFile.java:242)
at org.apache.hadoop.hbase.HStoreFile$HbaseMapFile
$HbaseReader.<init>(HStoreFile.java:554)
at org.apache.hadoop.hbase.HStoreFile$BloomFilterMapFile
$Reader.<init>(HStoreFile.java:609)
at
org.apache.hadoop.hbase.HStoreFile.getReader(HStoreFile.java:382)
at org.apache.hadoop.hbase.HStore.<init>(HStore.java:849)
at org.apache.hadoop.hbase.HRegion.<init>(HRegion.java:431)
at
org.apache.hadoop.hbase.HRegionServer.openRegion(HRegionServer.java:
1258)
at org.apache.hadoop.hbase.HRegionServer
$Worker.run(HRegionServer.java:1204)
at java.lang.Thread.run(Thread.java:595)
The machine logging all these errors is not the machine that went down
and I'm not sure what the recovery procedure is for this error.
I appreciate any assistance.
Thanks in advance
Preston Price
[EMAIL PROTECTED]