Is that Bookie met any sudden crash? As Sijie pointed some thing wrong in flushing. Anyway on scan failure, it will reconsider for scan again I think. That might be the reason, you are getting this message again and again.
But we have to address the root for that short read. Regards, Uma ________________________________ From: Sijie Guo [[email protected]] Sent: Tuesday, July 10, 2012 11:39 AM To: [email protected] Subject: Re: Bk Server Log Error John, Is entry log 23 the latest entry log? What is the file length of entry log 23? I am doubting the entry at the offset 1534204438 @ entry log 23 would be last entry of entry log 23. And there is something wrong happened on flushing entry log 23 when you shutdown that bookie server. BTW, what is your gcWaitTime setting? is it 1000ms? On Tue, Jul 10, 2012 at 1:07 AM, John Nagro <[email protected]<mailto:[email protected]>> wrote: Hello - I just upgraded my 4.1-SNAPSHOT servers to 4.1.1-SNAPSHOT today and noticed this error message repeating in the logs of a single server. I have 5 servers total, the other 4 appear to be working normally. Thanks! -John Nagro ERRORS: 2012-07-09 13:03:12,779 - INFO [GarbageCollectorThread:GarbageCollectorThread@477] - Extracting entry log meta from entryLogId: 23 2012-07-09 13:03:33,797 - WARN [GarbageCollectorThread:GarbageCollectorThread@485] - Premature exception when processing 23recovery will take care of the problem java.io.IOException: Short read for ledger entry from entryLog 23@1534204438(169!=338) at org.apache.bookkeeper.bookie.EntryLogger.scanEntryLog(EntryLogger.java:444) at org.apache.bookkeeper.bookie.GarbageCollectorThread.extractMetaFromEntryLog(GarbageCollectorThread.java:504) at org.apache.bookkeeper.bookie.GarbageCollectorThread.extractMetaFromEntryLogs(GarbageCollectorThread.java:481) at org.apache.bookkeeper.bookie.GarbageCollectorThread.run(GarbageCollectorThread.java:192) 2012-07-09 13:03:35,059 - INFO [GarbageCollectorThread:GarbageCollectorThread@477] - Extracting entry log meta from entryLogId: 23 2012-07-09 13:03:54,874 - WARN [GarbageCollectorThread:GarbageCollectorThread@485] - Premature exception when processing 23recovery will take care of the problem java.io.IOException: Short read for ledger entry from entryLog 23@1534204438(169!=338) at org.apache.bookkeeper.bookie.EntryLogger.scanEntryLog(EntryLogger.java:444) at org.apache.bookkeeper.bookie.GarbageCollectorThread.extractMetaFromEntryLog(GarbageCollectorThread.java:504) at org.apache.bookkeeper.bookie.GarbageCollectorThread.extractMetaFromEntryLogs(GarbageCollectorThread.java:481) at org.apache.bookkeeper.bookie.GarbageCollectorThread.run(GarbageCollectorThread.java:192) 2012-07-09 13:03:56,146 - INFO [GarbageCollectorThread:GarbageCollectorThread@477] - Extracting entry log meta from entryLogId: 23 2012-07-09 13:04:15,583 - WARN [GarbageCollectorThread:GarbageCollectorThread@485] - Premature exception when processing 23recovery will take care of the problem java.io.IOException: Short read for ledger entry from entryLog 23@1534204438(169!=338) at org.apache.bookkeeper.bookie.EntryLogger.scanEntryLog(EntryLogger.java:444) at org.apache.bookkeeper.bookie.GarbageCollectorThread.extractMetaFromEntryLog(GarbageCollectorThread.java:504) at org.apache.bookkeeper.bookie.GarbageCollectorThread.extractMetaFromEntryLogs(GarbageCollectorThread.java:481) at org.apache.bookkeeper.bookie.GarbageCollectorThread.run(GarbageCollectorThread.java:192) 2012-07-09 13:04:16,842 - INFO [GarbageCollectorThread:GarbageCollectorThread@477] - Extracting entry log meta from entryLogId: 23 2012-07-09 13:04:38,692 - WARN [GarbageCollectorThread:GarbageCollectorThread@485] - Premature exception when processing 23recovery will take care of the problem java.io.IOException: Short read for ledger entry from entryLog 23@1534204438(169!=338) at org.apache.bookkeeper.bookie.EntryLogger.scanEntryLog(EntryLogger.java:444) at org.apache.bookkeeper.bookie.GarbageCollectorThread.extractMetaFromEntryLog(GarbageCollectorThread.java:504) at org.apache.bookkeeper.bookie.GarbageCollectorThread.extractMetaFromEntryLogs(GarbageCollectorThread.java:481) at org.apache.bookkeeper.bookie.GarbageCollectorThread.run(GarbageCollectorThread.java:192) 2012-07-09 13:04:39,957 - INFO [GarbageCollectorThread:GarbageCollectorThread@477] - Extracting entry log meta from entryLogId: 23 2012-07-09 13:05:01,227 - WARN [GarbageCollectorThread:GarbageCollectorThread@485] - Premature exception when processing 23recovery will take care of the problem java.io.IOException: Short read for ledger entry from entryLog 23@1534204438(169!=338) at org.apache.bookkeeper.bookie.EntryLogger.scanEntryLog(EntryLogger.java:444) at org.apache.bookkeeper.bookie.GarbageCollectorThread.extractMetaFromEntryLog(GarbageCollectorThread.java:504) at org.apache.bookkeeper.bookie.GarbageCollectorThread.extractMetaFromEntryLogs(GarbageCollectorThread.java:481) at org.apache.bookkeeper.bookie.GarbageCollectorThread.run(GarbageCollectorThread.java:192) 2012-07-09 13:05:02,541 - INFO [GarbageCollectorThread:GarbageCollectorThread@477] - Extracting entry log meta from entryLogId: 23 2012-07-09 13:05:24,777 - WARN [GarbageCollectorThread:GarbageCollectorThread@485] - Premature exception when processing 23recovery will take care of the problem java.io.IOException: Short read for ledger entry from entryLog 23@1534204438(169!=338) at org.apache.bookkeeper.bookie.EntryLogger.scanEntryLog(EntryLogger.java:444) at org.apache.bookkeeper.bookie.GarbageCollectorThread.extractMetaFromEntryLog(GarbageCollectorThread.java:504) at org.apache.bookkeeper.bookie.GarbageCollectorThread.extractMetaFromEntryLogs(GarbageCollectorThread.java:481) at org.apache.bookkeeper.bookie.GarbageCollectorThread.run(GarbageCollectorThread.java:192) 2012-07-09 13:05:26,036 - INFO [GarbageCollectorThread:GarbageCollectorThread@477] - Extracting entry log meta from entryLogId: 23 2012-07-09 13:05:48,835 - WARN [GarbageCollectorThread:GarbageCollectorThread@485] - Premature exception when processing 23recovery will take care of the problem java.io.IOException: Short read for ledger entry from entryLog 23@1534204438(169!=338) at org.apache.bookkeeper.bookie.EntryLogger.scanEntryLog(EntryLogger.java:444) at org.apache.bookkeeper.bookie.GarbageCollectorThread.extractMetaFromEntryLog(GarbageCollectorThread.java:504) at org.apache.bookkeeper.bookie.GarbageCollectorThread.extractMetaFromEntryLogs(GarbageCollectorThread.java:481) at org.apache.bookkeeper.bookie.GarbageCollectorThread.run(GarbageCollectorThread.java:192)
