[ https://issues.apache.org/jira/browse/CASSANDRA-6411?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14212225#comment-14212225 ]
Roni Balthazar commented on CASSANDRA-6411: ------------------------------------------- Getting this in a 2.1.2 production cluster. 2 DCs. ERROR [SSTableBatchOpen:1] 2014-11-14 01:32:03,333 CassandraDaemon.java:153 - Exception in thread Thread[SSTableBatchOpen:1,5,main] org.apache.cassandra.io.sstable.CorruptSSTableException: java.io.EOFException at org.apache.cassandra.io.compress.CompressionMetadata.<init>(CompressionMetadata.java:129) ~[apache-cassandra-2.1.2.jar:2.1.2] at org.apache.cassandra.io.compress.CompressionMetadata.create(CompressionMetadata.java:83) ~[apache-cassandra-2.1.2.jar:2.1.2] at org.apache.cassandra.io.util.CompressedSegmentedFile$Builder.metadata(CompressedSegmentedFile.java:50) ~[apache-cassandra-2.1.2.jar:2.1.2] at org.apache.cassandra.io.util.CompressedPoolingSegmentedFile$Builder.complete(CompressedPoolingSegmentedFile.java:48) ~[apache-cassandra-2.1.2.jar:2.1.2] at org.apache.cassandra.io.sstable.SSTableReader.load(SSTableReader.java:767) ~[apache-cassandra-2.1.2.jar:2.1.2] at org.apache.cassandra.io.sstable.SSTableReader.load(SSTableReader.java:726) ~[apache-cassandra-2.1.2.jar:2.1.2] at org.apache.cassandra.io.sstable.SSTableReader.open(SSTableReader.java:403) ~[apache-cassandra-2.1.2.jar:2.1.2] at org.apache.cassandra.io.sstable.SSTableReader.open(SSTableReader.java:303) ~[apache-cassandra-2.1.2.jar:2.1.2] at org.apache.cassandra.io.sstable.SSTableReader$4.run(SSTableReader.java:439) ~[apache-cassandra-2.1.2.jar:2.1.2] at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511) ~[na:1.8.0_25] at java.util.concurrent.FutureTask.run(FutureTask.java:266) ~[na:1.8.0_25] at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142) ~[na:1.8.0_25] at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617) [na:1.8.0_25] at java.lang.Thread.run(Thread.java:745) [na:1.8.0_25] Caused by: java.io.EOFException: null at java.io.DataInputStream.readUnsignedShort(DataInputStream.java:340) ~[na:1.8.0_25] at java.io.DataInputStream.readUTF(DataInputStream.java:589) ~[na:1.8.0_25] at java.io.DataInputStream.readUTF(DataInputStream.java:564) ~[na:1.8.0_25] at org.apache.cassandra.io.compress.CompressionMetadata.<init>(CompressionMetadata.java:104) ~[apache-cassandra-2.1.2.jar:2.1.2] ... 13 common frames omitted > Issue with reading from sstable > ------------------------------- > > Key: CASSANDRA-6411 > URL: https://issues.apache.org/jira/browse/CASSANDRA-6411 > Project: Cassandra > Issue Type: Bug > Components: API > Reporter: Mike Konobeevskiy > Assignee: Yuki Morishita > Attachments: 6411-log.zip, 6411-sstables.zip > > > With Cassandra 1.2.5 this happens almost every week. > {noformat} > java.lang.RuntimeException: > org.apache.cassandra.io.sstable.CorruptSSTableException: > java.io.EOFException: EOF after 5105 bytes out of 19815 > at > org.apache.cassandra.service.StorageProxy$DroppableRunnable.run(StorageProxy.java:1582) > at > java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) > at java.lang.Thread.run(Thread.java:724) > Caused by: org.apache.cassandra.io.sstable.CorruptSSTableException: > java.io.EOFException: EOF after 5105 bytes out of 19815 > at > org.apache.cassandra.db.columniterator.SimpleSliceReader.<init>(SimpleSliceReader.java:91) > at > org.apache.cassandra.db.columniterator.SSTableSliceIterator.createReader(SSTableSliceIterator.java:68) > at > org.apache.cassandra.db.columniterator.SSTableSliceIterator.<init>(SSTableSliceIterator.java:44) > at > org.apache.cassandra.db.filter.SliceQueryFilter.getSSTableColumnIterator(SliceQueryFilter.java:101) > at > org.apache.cassandra.db.filter.QueryFilter.getSSTableColumnIterator(QueryFilter.java:68) > at > org.apache.cassandra.db.CollationController.collectAllData(CollationController.java:274) > at > org.apache.cassandra.db.CollationController.getTopLevelColumns(CollationController.java:65) > at > org.apache.cassandra.db.ColumnFamilyStore.getTopLevelColumns(ColumnFamilyStore.java:1357) > at > org.apache.cassandra.db.ColumnFamilyStore.getColumnFamily(ColumnFamilyStore.java:1214) > at > org.apache.cassandra.db.ColumnFamilyStore.getColumnFamily(ColumnFamilyStore.java:1126) > at org.apache.cassandra.db.Table.getRow(Table.java:347) > at > org.apache.cassandra.db.SliceFromReadCommand.getRow(SliceFromReadCommand.java:70) > at > org.apache.cassandra.service.StorageProxy$LocalReadRunnable.runMayThrow(StorageProxy.java:1052) > at > org.apache.cassandra.service.StorageProxy$DroppableRunnable.run(StorageProxy.java:1578) > ... 3 more > Caused by: java.io.EOFException: EOF after 5105 bytes out of 19815 > at > org.apache.cassandra.io.util.FileUtils.skipBytesFully(FileUtils.java:350) > at > org.apache.cassandra.utils.ByteBufferUtil.skipShortLength(ByteBufferUtil.java:382) > at > org.apache.cassandra.db.columniterator.SimpleSliceReader.<init>(SimpleSliceReader.java:72) > ... 16 more > {noformat} > This is occurring roughly weekly with quite minimal usage. > Recreation of CF does not help. -- This message was sent by Atlassian JIRA (v6.3.4#6332)