Here goes the exception details.. I again encountered...
11/01/16 20:22:59 DEBUG mortbay.log: Skipping entry: org/apache/hadoop/hbase/thrift/generated/Hbase$mutateRowsTs_result$1.class 11/01/16 20:22:59 INFO wal.HLogSplitter: Split writers finished 11/01/16 20:22:59 ERROR master.MasterFileSystem: Failed splitting file:/tmp/hbase-karan/hbase/.logs/abinash,3620,1295188307109 java.io.IOException: Unable to delete src dir: file:/tmp/hbase-karan/hbase/.logs/abinash,3620,1295188307109 at org.apache.hadoop.hbase.regionserver.wal.HLogSplitter.archiveLogs(HLogSplitt er.java:341) at org.apache.hadoop.hbase.regionserver.wal.HLogSplitter.splitLog(HLogSplitter. java:290) at org.apache.hadoop.hbase.regionserver.wal.HLogSplitter.splitLog(HLogSplitter. java:187) at org.apache.hadoop.hbase.master.MasterFileSystem.splitLog(MasterFileSystem.ja va:196) at org.apache.hadoop.hbase.master.MasterFileSystem.splitLogAfterStartup(MasterF ileSystem.java:180) at org.apache.hadoop.hbase.master.HMaster.finishInitialization(HMaster.java:378 ) at org.apache.hadoop.hbase.master.HMaster.run(HMaster.java:277) at org.apache.hadoop.hbase.master.HMasterCommandLine$LocalHMaster.run(HMasterCo mmandLine.java:193) at java.lang.Thread.run(Unknown Source) 11/01/16 20:22:59 DEBUG mortbay.log: Skipping entry: org/apache/hadoop/hbase/thrift/generated/Hbase$Iface.class 11/01/16 20:22:59 INFO master.MasterFileSystem: Log folder file:/tmp/hbase-karan/hbase/.logs/abinash,4030,1295189497984 doesn't belong to a known regi on server, splitting 11/01/16 20:22:59 DEBUG mortbay.log: Skipping entry: org/apache/hadoop/hbase/thrift/generated/Hbase$deleteAllTs_args.class 11/01/16 20:22:59 INFO wal.HLogSplitter: Splitting 1 hlog(s) in file:/tmp/hbase-karan/hbase/.logs/abinash,4030,1295189497984 11/01/16 20:22:59 DEBUG mortbay.log: Skipping entry: org/apache/hadoop/hbase/thrift/generated/Hbase$Processor$atomicIncrement.cla ss 11/01/16 20:22:59 DEBUG wal.HLogSplitter: Splitting hlog 1 of 1: file:/tmp/hbase-karan/hbase/.logs/abinash,4030,1295189497984/abinash%3A4030. 129518950 2031, length=8192 11/01/16 20:22:59 WARN util.FSUtils: Running on HDFS without append enabled may result in data loss 11/01/16 20:22:59 DEBUG wal.HLogSplitter: Writer thread Thread[WriterThread-0,6,main]: starting 11/01/16 20:22:59 DEBUG mortbay.log: Skipping entry: org/apache/hadoop/hbase/thrift/generated/Hbase$mutateRow_args$_Fields.class 11/01/16 20:22:59 WARN fs.FSInputChecker: Problem opening checksum file: file:/tmp/hbase-karan/hbase/.logs/abinash,4030,1295189497984/abinash%3A4030. 1 295189502031. Ignoring exception: java.io.EOFException at java.io.DataInputStream.readFully(Unknown Source) at java.io.DataInputStream.readFully(Unknown Source) at org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.<init>(Checks umFileSystem.java:134) at org.apache.hadoop.fs.ChecksumFileSystem.open(ChecksumFileSystem.java:283) at org.apache.hadoop.io.SequenceFile$Reader.openFile(SequenceFile.java:1444) at org.apache.hadoop.hbase.regionserver.wal.SequenceFileLogReader$WALReader.ope nFile(SequenceFileLogReader.java:65) at org.apache.hadoop.io.SequenceFile$Reader.<init>(SequenceFile.java:1431) at org.apache.hadoop.io.SequenceFile$Reader.<init>(SequenceFile.java:1424) at org.apache.hadoop.io.SequenceFile$Reader.<init>(SequenceFile.java:1419) at org.apache.hadoop.hbase.regionserver.wal.SequenceFileLogReader$WALReader.<in it>(SequenceFileLogReader.java:57) at org.apache.hadoop.hbase.regionserver.wal.SequenceFileLogReader.init(Sequence FileLogReader.java:158) at org.apache.hadoop.hbase.regionserver.wal.HLog.getReader(HLog.java:576) at org.apache.hadoop.hbase.regionserver.wal.HLogSplitter.getReader(HLogSplitter .java:469) at org.apache.hadoop.hbase.regionserver.wal.HLogSplitter.parseHLog(HLogSplitter .java:406) at org.apache.hadoop.hbase.regionserver.wal.HLogSplitter.splitLog(HLogSplitter. java:261) at org.apache.hadoop.hbase.regionserver.wal.HLogSplitter.splitLog(HLogSplitter. java:187) at org.apache.hadoop.hbase.master.MasterFileSystem.splitLog(MasterFileSystem.ja va:196) at org.apache.hadoop.hbase.master.MasterFileSystem.splitLogAfterStartup(MasterF ileSystem.java:180) at org.apache.hadoop.hbase.master.HMaster.finishInitialization(HMaster.java:378 ) at org.apache.hadoop.hbase.master.HMaster.run(HMaster.java:277) at org.apache.hadoop.hbase.master.HMasterCommandLine$LocalHMaster.run(HMasterCo mmandLine.java:193) at java.lang.Thread.run(Unknown Source) 11/01/16 20:22:59 DEBUG wal.HLogSplitter: Writer thread Thread[WriterThread-2,6,main]: starting 11/01/16 20:22:59 DEBUG wal.HLogSplitter: Writer thread Thread[WriterThread-1,6,main]: starting 11/01/16 20:22:59 WARN wal.SequenceFileLogReader: Error while trying to get accurate file length. Truncation / data loss may occur if RegionServers d ie. java.lang.NoSuchMethodException: org.apache.hadoop.fs.ChecksumFileSystem$ChecksumFSInputChecker.getFileLength () at java.lang.Class.getMethod(Unknown Source) at org.apache.hadoop.hbase.regionserver.wal.SequenceFileLogReader$WALReader$WAL ReaderFSDataInputStream.getPos(SequenceFileLogReader.java:107) at org.apache.hadoop.io.SequenceFile$Reader.<init>(SequenceFile.java:1434) at org.apache.hadoop.io.SequenceFile$Reader.<init>(SequenceFile.java:1424) at org.apache.hadoop.io.SequenceFile$Reader.<init>(SequenceFile.java:1419) at org.apache.hadoop.hbase.regionserver.wal.SequenceFileLogReader$WALReader.<in it>(SequenceFileLogReader.java:57) at org.apache.hadoop.hbase.regionserver.wal.SequenceFileLogReader.init(Sequence FileLogReader.java:158) at org.apache.hadoop.hbase.regionserver.wal.HLog.getReader(HLog.java:576) at org.apache.hadoop.hbase.regionserver.wal.HLogSplitter.getReader(HLogSplitter .java:469) at org.apache.hadoop.hbase.regionserver.wal.HLogSplitter.parseHLog(HLogSplitter .java:406) at org.apache.hadoop.hbase.regionserver.wal.HLogSplitter.splitLog(HLogSplitter. java:261) at org.apache.hadoop.hbase.regionserver.wal.HLogSplitter.splitLog(HLogSplitter. java:187) at org.apache.hadoop.hbase.master.MasterFileSystem.splitLog(MasterFileSystem.ja va:196) at org.apache.hadoop.hbase.master.MasterFileSystem.splitLogAfterStartup(MasterF ileSystem.java:180) at org.apache.hadoop.hbase.master.HMaster.finishInitialization(HMaster.java:378 ) at org.apache.hadoop.hbase.master.HMaster.run(HMaster.java:277) at org.apache.hadoop.hbase.master.HMasterCommandLine$LocalHMaster.run(HMasterCo mmandLine.java:193) at java.lang.Thread.run(Unknown Source) 11/01/16 20:22:59 DEBUG mortbay.log: Skipping entry: org/apache/hadoop/hbase/thrift/generated/Hbase$getColumnDescriptors_result$1 .class 11/01/16 20:22:59 DEBUG mortbay.log: Skipping entry: org/apache/hadoop/hbase/thrift/generated/Hbase$scannerOpenWithPrefix_result$ _Fields.class 11/01/16 20:22:59 DEBUG mortbay.log: Skipping entry: org/apache/hadoop/hbase/thrift/ThriftServer$HBaseHandler$1.class 11/01/16 20:22:59 DEBUG mortbay.log: Skipping entry: org/apache/hadoop/hbase/thrift/ThriftServer$HBaseHandler.class 11/01/16 20:22:59 DEBUG mortbay.log: Skipping entry: org/apache/hadoop/hbase/thrift/ThriftUtilities.class 11/01/16 20:22:59 DEBUG mortbay.log: Skipping entry: org/apache/hadoop/hbase/thrift/ThriftServer.class 11/01/16 20:22:59 DEBUG mortbay.log: Skipping entry: org/apache/hadoop/hbase/HColumnDescriptor$CompressionType.class 11/01/16 20:22:59 DEBUG wal.HLogSplitter: Pushed=31 entries from file:/tmp/hbase-karan/hbase/.logs/abinash,4030,1295189497984/abinash%3A4030. 129518950 2031 11/01/16 20:22:59 DEBUG mortbay.log: Skipping entry: META-INF/LICENSE 11/01/16 20:22:59 INFO wal.HLogSplitter: EOF from hlog file:/tmp/hbase-karan/hbase/.logs/abinash,4030,1295189497984/abinash%3A4030. 1295189502031. con tinuing 11/01/16 20:22:59 DEBUG mortbay.log: Skipping entry: META-INF/NOTICE 11/01/16 20:22:59 DEBUG mortbay.log: Skipping entry: META-INF/DEPENDENCIES 11/01/16 20:22:59 DEBUG mortbay.log: Skipping entry: hbase-webapps/master/index.html 11/01/16 20:22:59 DEBUG mortbay.log: Skipping entry: hbase-webapps/master/WEB-INF/web.xml 11/01/16 20:22:59 INFO wal.SequenceFileLogWriter: syncFs -- HDFS-200 -- not available, dfs.support.append=false 11/01/16 20:22:59 DEBUG wal.HLogSplitter: Creating writer path=file:/tmp/hbase-karan/hbase/-ROOT-/70236052/recovered.edits/00000000000 00002697 region= 70236052 11/01/16 20:22:59 INFO wal.HLogSplitter: Archived processed log file:/tmp/hbase-karan/hbase/.logs/abinash,4030,1295189497984/abinash%3A4030. 1295189502 031 to file:/tmp/hbase-karan/hbase/.oldlogs/abinash%3A4030.1295189502031 11/01/16 20:22:59 DEBUG mortbay.log: Skipping entry: hbase-webapps/static/hbase_logo_med.gif -----Original Message----- From: Ted Dunning [mailto:tdunn...@maprtech.com] Sent: Saturday, January 08, 2011 2:28 AM To: dev@hbase.apache.org Subject: Re: java.lang.NoSuchMethodException: hbase-0.90 Great. I will file a patch to move the check to the constructor and fail back to old process if the method is missing. For our case, I just implemented getFileLength and all is happy (on that front) On Fri, Jan 7, 2011 at 12:38 PM, Stack <st...@duboce.net> wrote: > Let me open an issue to add more checks around the reflection; e.g. > check type as you fellas suggest. If anything is not as expected, > then we'd fallback on old getPos behavior. It should not fail for > 'pure' HDFS. 'Alternative' HDFS's probably don't have this 2G > problem. >