[ https://issues.apache.org/jira/browse/CASSANDRA-5252?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Drew Kutcharian updated CASSANDRA-5252: --------------------------------------- Fix Version/s: (was: 1.2.1) Description: I just saw this exception happen on Cassandra 1.2.1. I thought this was fixed by CASSANDRA-4916. Was this part of the 1.2.1 release? I'm on Mac OS X 10.8.2, Oracle JDK 1.7.0_11, using snappy-java 1.0.5-M3 from Maven (not sure if that's the cause). I'm attaching my data and log directory as data.zip. {code} WARN [main] 2013-02-12 17:50:11,714 AutoSavingCache.java (line 160) error reading saved cache /Users/services/cassandra/data/saved_caches/system-schema _columnfamilies-KeyCache-b.db java.io.EOFException at java.io.DataInputStream.readInt(DataInputStream.java:392) at org.apache.cassandra.utils.ByteBufferUtil.readWithLength(ByteBufferUtil.java:349) at org.apache.cassandra.service.CacheService$KeyCacheSerializer.deserialize(CacheService.java:378) at org.apache.cassandra.cache.AutoSavingCache.loadSaved(AutoSavingCache.java:144) at org.apache.cassandra.db.ColumnFamilyStore.<init>(ColumnFamilyStore.java:277) at org.apache.cassandra.db.ColumnFamilyStore.createColumnFamilyStore(ColumnFamilyStore.java:392) at org.apache.cassandra.db.ColumnFamilyStore.createColumnFamilyStore(ColumnFamilyStore.java:364) at org.apache.cassandra.db.Table.initCf(Table.java:337) at org.apache.cassandra.db.Table.<init>(Table.java:280) at org.apache.cassandra.db.Table.open(Table.java:110) at org.apache.cassandra.db.Table.open(Table.java:88) at org.apache.cassandra.db.SystemTable.checkHealth(SystemTable.java:421) at org.apache.cassandra.service.CassandraDaemon.setup(CassandraDaemon.java:177) at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:370) at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:413) INFO [SSTableBatchOpen:1] 2013-02-12 17:50:11,722 SSTableReader.java (line 164) Opening /Users/services/cassandra/data/data/system/schema_columns/syste m-schema_columns-ib-6 (193 bytes) INFO [SSTableBatchOpen:2] 2013-02-12 17:50:11,722 SSTableReader.java (line 164) Opening /Users/services/cassandra/data/data/system/schema_columns/syste m-schema_columns-ib-5 (3840 bytes) INFO [main] 2013-02-12 17:50:11,725 AutoSavingCache.java (line 139) reading saved cache /Users/services/cassandra/data/saved_caches/system-schema_colum ns-KeyCache-b.db WARN [main] 2013-02-12 17:50:11,725 AutoSavingCache.java (line 160) error reading saved cache /Users/services/cassandra/data/saved_caches/system-schema _columns-KeyCache-b.db java.io.EOFException at java.io.DataInputStream.readInt(DataInputStream.java:392) at org.apache.cassandra.utils.ByteBufferUtil.readWithLength(ByteBufferUtil.java:349) at org.apache.cassandra.service.CacheService$KeyCacheSerializer.deserialize(CacheService.java:378) at org.apache.cassandra.cache.AutoSavingCache.loadSaved(AutoSavingCache.java:144) at org.apache.cassandra.db.ColumnFamilyStore.<init>(ColumnFamilyStore.java:277) at org.apache.cassandra.db.ColumnFamilyStore.createColumnFamilyStore(ColumnFamilyStore.java:392) at org.apache.cassandra.db.ColumnFamilyStore.createColumnFamilyStore(ColumnFamilyStore.java:364) at org.apache.cassandra.db.Table.initCf(Table.java:337) at org.apache.cassandra.db.Table.<init>(Table.java:280) at org.apache.cassandra.db.Table.open(Table.java:110) at org.apache.cassandra.db.Table.open(Table.java:88) at org.apache.cassandra.db.SystemTable.checkHealth(SystemTable.java:421) at org.apache.cassandra.service.CassandraDaemon.setup(CassandraDaemon.java:177) at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:370) at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:413) INFO [SSTableBatchOpen:1] 2013-02-12 17:50:11,736 SSTableReader.java (line 164) Opening /Users/services/cassandra/data/data/system/local/system-local-i b-14 (458 bytes) INFO [main] 2013-02-12 17:50:11,738 AutoSavingCache.java (line 139) reading saved cache /Users/services/cassandra/data/saved_caches/system-local-KeyCac he-b.db WARN [main] 2013-02-12 17:50:11,739 AutoSavingCache.java (line 160) error reading saved cache /Users/services/cassandra/data/saved_caches/system-local- KeyCache-b.db java.io.EOFException at java.io.DataInputStream.readInt(DataInputStream.java:392) at org.apache.cassandra.utils.ByteBufferUtil.readWithLength(ByteBufferUtil.java:349) at org.apache.cassandra.service.CacheService$KeyCacheSerializer.deserialize(CacheService.java:378) at org.apache.cassandra.cache.AutoSavingCache.loadSaved(AutoSavingCache.java:144) at org.apache.cassandra.db.ColumnFamilyStore.<init>(ColumnFamilyStore.java:277) at org.apache.cassandra.db.ColumnFamilyStore.createColumnFamilyStore(ColumnFamilyStore.java:392) at org.apache.cassandra.db.ColumnFamilyStore.createColumnFamilyStore(ColumnFamilyStore.java:364) at org.apache.cassandra.db.Table.initCf(Table.java:337) at org.apache.cassandra.db.Table.<init>(Table.java:280) at org.apache.cassandra.db.Table.open(Table.java:110) at org.apache.cassandra.db.Table.open(Table.java:88) at org.apache.cassandra.db.SystemTable.checkHealth(SystemTable.java:421) at org.apache.cassandra.service.CassandraDaemon.setup(CassandraDaemon.java:177) at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:370) at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:413) {code} was: Currently seeing nodes throw an EOF while reading a saved cache on the system schema when starting cassandra WARN 14:25:54,896 error reading saved cache /ssd/saved_caches/system-schema_columns-KeyCache-b.db java.io.EOFException at java.io.DataInputStream.readInt(DataInputStream.java:392) at org.apache.cassandra.utils.ByteBufferUtil.readWithLength(ByteBufferUtil.java:349) at org.apache.cassandra.service.CacheService$KeyCacheSerializer.deserialize(CacheService.java:378) at org.apache.cassandra.cache.AutoSavingCache.loadSaved(AutoSavingCache.java:144) at org.apache.cassandra.db.ColumnFamilyStore.<init>(ColumnFamilyStore.java:278) at org.apache.cassandra.db.ColumnFamilyStore.createColumnFamilyStore(ColumnFamilyStore.java:393) at org.apache.cassandra.db.ColumnFamilyStore.createColumnFamilyStore(ColumnFamilyStore.java:365) at org.apache.cassandra.db.Table.initCf(Table.java:334) at org.apache.cassandra.db.Table.<init>(Table.java:272) at org.apache.cassandra.db.Table.open(Table.java:102) at org.apache.cassandra.db.Table.open(Table.java:80) at org.apache.cassandra.db.SystemTable.checkHealth(SystemTable.java:320) at org.apache.cassandra.service.CassandraDaemon.setup(CassandraDaemon.java:203) at org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:395) at org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:438) to reproduce delete all data files, start a cluster, leave cluster up long enough to build a cache. nodetool drain, kill cassandra process. start cassandra process in foreground and note EOF thrown (see above for stack trace) Affects Version/s: 1.2.1 > Starting Cassandra throws EOF while reading saved cache > ------------------------------------------------------- > > Key: CASSANDRA-5252 > URL: https://issues.apache.org/jira/browse/CASSANDRA-5252 > Project: Cassandra > Issue Type: Bug > Components: Core > Affects Versions: 1.2.1 > Reporter: Drew Kutcharian > Assignee: Dave Brosius > Priority: Minor > Attachments: data.zip > > > I just saw this exception happen on Cassandra 1.2.1. I thought this was fixed > by CASSANDRA-4916. Was this part of the 1.2.1 release? > I'm on Mac OS X 10.8.2, Oracle JDK 1.7.0_11, using snappy-java 1.0.5-M3 from > Maven (not sure if that's the cause). > I'm attaching my data and log directory as data.zip. > {code} > WARN [main] 2013-02-12 17:50:11,714 AutoSavingCache.java (line 160) error > reading saved cache /Users/services/cassandra/data/saved_caches/system-schema > _columnfamilies-KeyCache-b.db > java.io.EOFException > at java.io.DataInputStream.readInt(DataInputStream.java:392) > at > org.apache.cassandra.utils.ByteBufferUtil.readWithLength(ByteBufferUtil.java:349) > at > org.apache.cassandra.service.CacheService$KeyCacheSerializer.deserialize(CacheService.java:378) > at > org.apache.cassandra.cache.AutoSavingCache.loadSaved(AutoSavingCache.java:144) > at > org.apache.cassandra.db.ColumnFamilyStore.<init>(ColumnFamilyStore.java:277) > at > org.apache.cassandra.db.ColumnFamilyStore.createColumnFamilyStore(ColumnFamilyStore.java:392) > at > org.apache.cassandra.db.ColumnFamilyStore.createColumnFamilyStore(ColumnFamilyStore.java:364) > at org.apache.cassandra.db.Table.initCf(Table.java:337) > at org.apache.cassandra.db.Table.<init>(Table.java:280) > at org.apache.cassandra.db.Table.open(Table.java:110) > at org.apache.cassandra.db.Table.open(Table.java:88) > at > org.apache.cassandra.db.SystemTable.checkHealth(SystemTable.java:421) > at > org.apache.cassandra.service.CassandraDaemon.setup(CassandraDaemon.java:177) > at > org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:370) > at > org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:413) > INFO [SSTableBatchOpen:1] 2013-02-12 17:50:11,722 SSTableReader.java (line > 164) Opening /Users/services/cassandra/data/data/system/schema_columns/syste > m-schema_columns-ib-6 (193 bytes) > INFO [SSTableBatchOpen:2] 2013-02-12 17:50:11,722 SSTableReader.java (line > 164) Opening /Users/services/cassandra/data/data/system/schema_columns/syste > m-schema_columns-ib-5 (3840 bytes) > INFO [main] 2013-02-12 17:50:11,725 AutoSavingCache.java (line 139) reading > saved cache /Users/services/cassandra/data/saved_caches/system-schema_colum > ns-KeyCache-b.db > WARN [main] 2013-02-12 17:50:11,725 AutoSavingCache.java (line 160) error > reading saved cache /Users/services/cassandra/data/saved_caches/system-schema > _columns-KeyCache-b.db > java.io.EOFException > at java.io.DataInputStream.readInt(DataInputStream.java:392) > at > org.apache.cassandra.utils.ByteBufferUtil.readWithLength(ByteBufferUtil.java:349) > at > org.apache.cassandra.service.CacheService$KeyCacheSerializer.deserialize(CacheService.java:378) > at > org.apache.cassandra.cache.AutoSavingCache.loadSaved(AutoSavingCache.java:144) > at > org.apache.cassandra.db.ColumnFamilyStore.<init>(ColumnFamilyStore.java:277) > at > org.apache.cassandra.db.ColumnFamilyStore.createColumnFamilyStore(ColumnFamilyStore.java:392) > at > org.apache.cassandra.db.ColumnFamilyStore.createColumnFamilyStore(ColumnFamilyStore.java:364) > at org.apache.cassandra.db.Table.initCf(Table.java:337) > at org.apache.cassandra.db.Table.<init>(Table.java:280) > at org.apache.cassandra.db.Table.open(Table.java:110) > at org.apache.cassandra.db.Table.open(Table.java:88) > at > org.apache.cassandra.db.SystemTable.checkHealth(SystemTable.java:421) > at > org.apache.cassandra.service.CassandraDaemon.setup(CassandraDaemon.java:177) > at > org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:370) > at > org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:413) > INFO [SSTableBatchOpen:1] 2013-02-12 17:50:11,736 SSTableReader.java (line > 164) Opening /Users/services/cassandra/data/data/system/local/system-local-i > b-14 (458 bytes) > INFO [main] 2013-02-12 17:50:11,738 AutoSavingCache.java (line 139) reading > saved cache /Users/services/cassandra/data/saved_caches/system-local-KeyCac > he-b.db > WARN [main] 2013-02-12 17:50:11,739 AutoSavingCache.java (line 160) error > reading saved cache /Users/services/cassandra/data/saved_caches/system-local- > KeyCache-b.db > java.io.EOFException > at java.io.DataInputStream.readInt(DataInputStream.java:392) > at > org.apache.cassandra.utils.ByteBufferUtil.readWithLength(ByteBufferUtil.java:349) > at > org.apache.cassandra.service.CacheService$KeyCacheSerializer.deserialize(CacheService.java:378) > at > org.apache.cassandra.cache.AutoSavingCache.loadSaved(AutoSavingCache.java:144) > at > org.apache.cassandra.db.ColumnFamilyStore.<init>(ColumnFamilyStore.java:277) > at > org.apache.cassandra.db.ColumnFamilyStore.createColumnFamilyStore(ColumnFamilyStore.java:392) > at > org.apache.cassandra.db.ColumnFamilyStore.createColumnFamilyStore(ColumnFamilyStore.java:364) > at org.apache.cassandra.db.Table.initCf(Table.java:337) > at org.apache.cassandra.db.Table.<init>(Table.java:280) > at org.apache.cassandra.db.Table.open(Table.java:110) > at org.apache.cassandra.db.Table.open(Table.java:88) > at > org.apache.cassandra.db.SystemTable.checkHealth(SystemTable.java:421) > at > org.apache.cassandra.service.CassandraDaemon.setup(CassandraDaemon.java:177) > at > org.apache.cassandra.service.CassandraDaemon.activate(CassandraDaemon.java:370) > at > org.apache.cassandra.service.CassandraDaemon.main(CassandraDaemon.java:413) > {code} -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira