John, Is entry log 23 the latest entry log? What is the file length of entry log 23?
I am doubting the entry at the offset 1534204438 @ entry log 23 would be last entry of entry log 23. And there is something wrong happened on flushing entry log 23 when you shutdown that bookie server. BTW, what is your gcWaitTime setting? is it 1000ms? On Tue, Jul 10, 2012 at 1:07 AM, John Nagro <[email protected]> wrote: > Hello - > > I just upgraded my 4.1-SNAPSHOT servers to 4.1.1-SNAPSHOT today and > noticed this error message repeating in the logs of a single server. I have > 5 servers total, the other 4 appear to be working normally. > > Thanks! > > -John Nagro > > ERRORS: > > 2012-07-09 13:03:12,779 - INFO > [GarbageCollectorThread:GarbageCollectorThread@477] - Extracting entry > log meta from entryLogId: 23 > 2012-07-09 13:03:33,797 - WARN > [GarbageCollectorThread:GarbageCollectorThread@485] - Premature > exception when processing 23recovery will take care of the problem > java.io.IOException: Short read for ledger entry from entryLog > 23@1534204438(169!=338) > at > org.apache.bookkeeper.bookie.EntryLogger.scanEntryLog(EntryLogger.java:444) > at > org.apache.bookkeeper.bookie.GarbageCollectorThread.extractMetaFromEntryLog(GarbageCollectorThread.java:504) > at > org.apache.bookkeeper.bookie.GarbageCollectorThread.extractMetaFromEntryLogs(GarbageCollectorThread.java:481) > at > org.apache.bookkeeper.bookie.GarbageCollectorThread.run(GarbageCollectorThread.java:192) > 2012-07-09 13:03:35,059 - INFO > [GarbageCollectorThread:GarbageCollectorThread@477] - Extracting entry > log meta from entryLogId: 23 > 2012-07-09 13:03:54,874 - WARN > [GarbageCollectorThread:GarbageCollectorThread@485] - Premature > exception when processing 23recovery will take care of the problem > java.io.IOException: Short read for ledger entry from entryLog > 23@1534204438(169!=338) > at > org.apache.bookkeeper.bookie.EntryLogger.scanEntryLog(EntryLogger.java:444) > at > org.apache.bookkeeper.bookie.GarbageCollectorThread.extractMetaFromEntryLog(GarbageCollectorThread.java:504) > at > org.apache.bookkeeper.bookie.GarbageCollectorThread.extractMetaFromEntryLogs(GarbageCollectorThread.java:481) > at > org.apache.bookkeeper.bookie.GarbageCollectorThread.run(GarbageCollectorThread.java:192) > 2012-07-09 13:03:56,146 - INFO > [GarbageCollectorThread:GarbageCollectorThread@477] - Extracting entry > log meta from entryLogId: 23 > 2012-07-09 13:04:15,583 - WARN > [GarbageCollectorThread:GarbageCollectorThread@485] - Premature > exception when processing 23recovery will take care of the problem > java.io.IOException: Short read for ledger entry from entryLog > 23@1534204438(169!=338) > at > org.apache.bookkeeper.bookie.EntryLogger.scanEntryLog(EntryLogger.java:444) > at > org.apache.bookkeeper.bookie.GarbageCollectorThread.extractMetaFromEntryLog(GarbageCollectorThread.java:504) > at > org.apache.bookkeeper.bookie.GarbageCollectorThread.extractMetaFromEntryLogs(GarbageCollectorThread.java:481) > at > org.apache.bookkeeper.bookie.GarbageCollectorThread.run(GarbageCollectorThread.java:192) > 2012-07-09 13:04:16,842 - INFO > [GarbageCollectorThread:GarbageCollectorThread@477] - Extracting entry > log meta from entryLogId: 23 > 2012-07-09 13:04:38,692 - WARN > [GarbageCollectorThread:GarbageCollectorThread@485] - Premature > exception when processing 23recovery will take care of the problem > java.io.IOException: Short read for ledger entry from entryLog > 23@1534204438(169!=338) > at > org.apache.bookkeeper.bookie.EntryLogger.scanEntryLog(EntryLogger.java:444) > at > org.apache.bookkeeper.bookie.GarbageCollectorThread.extractMetaFromEntryLog(GarbageCollectorThread.java:504) > at > org.apache.bookkeeper.bookie.GarbageCollectorThread.extractMetaFromEntryLogs(GarbageCollectorThread.java:481) > at > org.apache.bookkeeper.bookie.GarbageCollectorThread.run(GarbageCollectorThread.java:192) > 2012-07-09 13:04:39,957 - INFO > [GarbageCollectorThread:GarbageCollectorThread@477] - Extracting entry > log meta from entryLogId: 23 > 2012-07-09 13:05:01,227 - WARN > [GarbageCollectorThread:GarbageCollectorThread@485] - Premature > exception when processing 23recovery will take care of the problem > java.io.IOException: Short read for ledger entry from entryLog > 23@1534204438(169!=338) > at > org.apache.bookkeeper.bookie.EntryLogger.scanEntryLog(EntryLogger.java:444) > at > org.apache.bookkeeper.bookie.GarbageCollectorThread.extractMetaFromEntryLog(GarbageCollectorThread.java:504) > at > org.apache.bookkeeper.bookie.GarbageCollectorThread.extractMetaFromEntryLogs(GarbageCollectorThread.java:481) > at > org.apache.bookkeeper.bookie.GarbageCollectorThread.run(GarbageCollectorThread.java:192) > 2012-07-09 13:05:02,541 - INFO > [GarbageCollectorThread:GarbageCollectorThread@477] - Extracting entry > log meta from entryLogId: 23 > 2012-07-09 13:05:24,777 - WARN > [GarbageCollectorThread:GarbageCollectorThread@485] - Premature > exception when processing 23recovery will take care of the problem > java.io.IOException: Short read for ledger entry from entryLog > 23@1534204438(169!=338) > at > org.apache.bookkeeper.bookie.EntryLogger.scanEntryLog(EntryLogger.java:444) > at > org.apache.bookkeeper.bookie.GarbageCollectorThread.extractMetaFromEntryLog(GarbageCollectorThread.java:504) > at > org.apache.bookkeeper.bookie.GarbageCollectorThread.extractMetaFromEntryLogs(GarbageCollectorThread.java:481) > at > org.apache.bookkeeper.bookie.GarbageCollectorThread.run(GarbageCollectorThread.java:192) > 2012-07-09 13:05:26,036 - INFO > [GarbageCollectorThread:GarbageCollectorThread@477] - Extracting entry > log meta from entryLogId: 23 > 2012-07-09 13:05:48,835 - WARN > [GarbageCollectorThread:GarbageCollectorThread@485] - Premature > exception when processing 23recovery will take care of the problem > java.io.IOException: Short read for ledger entry from entryLog > 23@1534204438(169!=338) > at > org.apache.bookkeeper.bookie.EntryLogger.scanEntryLog(EntryLogger.java:444) > at > org.apache.bookkeeper.bookie.GarbageCollectorThread.extractMetaFromEntryLog(GarbageCollectorThread.java:504) > at > org.apache.bookkeeper.bookie.GarbageCollectorThread.extractMetaFromEntryLogs(GarbageCollectorThread.java:481) > at > org.apache.bookkeeper.bookie.GarbageCollectorThread.run(GarbageCollectorThread.java:192) >
