version? https://issues.apache.org/jira/browse/HBASE-4222
Is this helpful? Thanks, Jahangir. On Mon, Nov 28, 2011 at 2:56 PM, arun sirimalla <arunsi...@gmail.com> wrote: > Hi, > > I have three region servers running on datanodes, one of the region server > crashes when try to insert with below error and the other two region > servers are running without any errors > > > WARN org.apache.hadoop.hdfs.DFSClient: Error Recovery for block > blk_-2411272549088965456_2503 bad datanode[0] 10.177.78.15:50010 > 2011-11-28 11:49:29,951 WARN org.apache.hadoop.hdfs.DFSClient: Error while > syncing > java.io.IOException: All datanodes 10.177.78.15:50010 are bad. Aborting... > at > > org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.processDatanodeError(DFSClient.java:2766) > at > > org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.access$1600(DFSClient.java:2305) > at > > org.apache.hadoop.hdfs.DFSClient$DFSOutputStream$DataStreamer.run(DFSClient.java:2477) > 2011-11-28 11:49:29,953 FATAL > org.apache.hadoop.hbase.regionserver.wal.HLog: Could not append. Requesting > close of hlog > java.io.IOException: Reflection > at > > org.apache.hadoop.hbase.regionserver.wal.SequenceFileLogWriter.sync(SequenceFileLogWriter.java:147) > at org.apache.hadoop.hbase.regionserver.wal.HLog.sync(HLog.java:986) > at > org.apache.hadoop.hbase.regionserver.wal.HLog$LogSyncer.run(HLog.java:963) > Caused by: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor2.invoke(Unknown Source) > at > > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) > at java.lang.reflect.Method.invoke(Method.java:597) > at > > org.apache.hadoop.hbase.regionserver.wal.SequenceFileLogWriter.sync(SequenceFileLogWriter.java:145) > ... 2 more > Caused by: java.io.IOException: All datanodes 10.177.78.15:50010 are bad. > Aborting... > at > > org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.processDatanodeError(DFSClient.java:2766) > at > > org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.access$1600(DFSClient.java:2305) > at > > org.apache.hadoop.hdfs.DFSClient$DFSOutputStream$DataStreamer.run(DFSClient.java:2477) > 2011-11-28 11:49:29,954 ERROR > org.apache.hadoop.hbase.regionserver.wal.HLog: Error while syncing, > requesting close of hlog > java.io.IOException: Reflection > at > > org.apache.hadoop.hbase.regionserver.wal.SequenceFileLogWriter.sync(SequenceFileLogWriter.java:147) > at org.apache.hadoop.hbase.regionserver.wal.HLog.sync(HLog.java:986) > at > org.apache.hadoop.hbase.regionserver.wal.HLog$LogSyncer.run(HLog.java:963) > Caused by: java.lang.reflect.InvocationTargetException > at sun.reflect.GeneratedMethodAccessor2.invoke(Unknown Source) > at > > sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) > at java.lang.reflect.Method.invoke(Method.java:597) > at > > org.apache.hadoop.hbase.regionserver.wal.SequenceFileLogWriter.sync(SequenceFileLogWriter.java:145) > ... 2 more > Caused by: java.io.IOException: All datanodes 10.177.78.15:50010 are bad. > Aborting... > at > > org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.processDatanodeError(DFSClient.java:2766) > at > > org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.access$1600(DFSClient.java:2305) > at > > org.apache.hadoop.hdfs.DFSClient$DFSOutputStream$DataStreamer.run(DFSClient.java:2477) > 2011-11-28 11:49:29,954 INFO org.apache.hadoop.hbase.regionserver.wal.HLog: > regionserver60020.logSyncer exiting > 2011-11-28 11:50:37,573 WARN org.apache.hadoop.hdfs.DFSClient: Error while > syncing > java.io.IOException: All datanodes 10.177.78.15:50010 are bad. Aborting... > at > > org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.processDatanodeError(DFSClient.java:2766) > at > > org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.access$1600(DFSClient.java:2305) > at > > org.apache.hadoop.hdfs.DFSClient$DFSOutputStream$DataStreamer.run(DFSClient.java:2477) > 2011-11-28 11:50:37,574 FATAL > org.apache.hadoop.hbase.regionserver.wal.HLog: Could not append. Requesting > close of hlog > > Thanks > Arun >
