[
https://issues.apache.org/jira/browse/CASSANDRA-2973?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13085698#comment-13085698
]
Wojciech Meler commented on CASSANDRA-2973:
-------------------------------------------
I'm back. As Michał said cluster history was: 0.7.0 -> 0.7.2 -> 0.7.3 -> 0.7.4
-> 0.8.0 -> 0.8.1.
It started with 6 nodes. After migrating to 0.8.0 cluster grew to 12, and after
0.8.1 to 18 nodes.
It's hard to say which CF got read errors, but exceptions from scrub suggests
that it was mta_logs which is plain CF.
> fatal errrors after nodetool cleanup
> ------------------------------------
>
> Key: CASSANDRA-2973
> URL: https://issues.apache.org/jira/browse/CASSANDRA-2973
> Project: Cassandra
> Issue Type: Bug
> Affects Versions: 0.8.1
> Reporter: Wojciech Meler
> Assignee: Sylvain Lebresne
>
> after adding nodes to cluster & running cleanup I get scaring exceptions in
> log:
> 2011-07-30 00:00:05:506 CEST ERROR
> [ReadStage:2335][org.apache.cassandra.service.AbstractCassandraDaemon] Fatal
> exception in thread Thread[ReadStage:2335,5,main]
> java.io.IOError: java.io.IOException: mmap segment underflow; remaining is
> 4394 but 60165 requested
> at
> org.apache.cassandra.db.columniterator.IndexedSliceReader.<init>(IndexedSliceReader.java:80)
> at
> org.apache.cassandra.db.columniterator.SSTableSliceIterator.createReader(SSTableSliceIterator.java:91)
> at
> org.apache.cassandra.db.columniterator.SSTableSliceIterator.<init>(SSTableSliceIterator.java:67)
> at
> org.apache.cassandra.db.filter.SliceQueryFilter.getSSTableColumnIterator(SliceQueryFilter.java:66)
> at
> org.apache.cassandra.db.filter.QueryFilter.getSSTableColumnIterator(QueryFilter.java:80)
> at
> org.apache.cassandra.db.ColumnFamilyStore.getTopLevelColumns(ColumnFamilyStore.java:1292)
> at
> org.apache.cassandra.db.ColumnFamilyStore.getColumnFamily(ColumnFamilyStore.java:1189)
> at
> org.apache.cassandra.db.ColumnFamilyStore.getColumnFamily(ColumnFamilyStore.java:1146)
> at org.apache.cassandra.db.Table.getRow(Table.java:385)
> at
> org.apache.cassandra.db.SliceFromReadCommand.getRow(SliceFromReadCommand.java:61)
> at
> org.apache.cassandra.db.ReadVerbHandler.doVerb(ReadVerbHandler.java:69)
> at
> org.apache.cassandra.net.MessageDeliveryTask.run(MessageDeliveryTask.java:72)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
> at java.lang.Thread.run(Thread.java:662)
> Caused by: java.io.IOException: mmap segment underflow; remaining is 4394
> but 60165 requested
> at
> org.apache.cassandra.io.util.MappedFileDataInput.readBytes(MappedFileDataInput.java:117)
> at
> org.apache.cassandra.utils.ByteBufferUtil.read(ByteBufferUtil.java:389)
> at
> org.apache.cassandra.utils.ByteBufferUtil.readWithShortLength(ByteBufferUtil.java:368)
> at
> org.apache.cassandra.io.sstable.IndexHelper$IndexInfo.deserialize(IndexHelper.java:194)
> at
> org.apache.cassandra.io.sstable.IndexHelper.deserializeIndex(IndexHelper.java:83)
> at
> org.apache.cassandra.db.columniterator.IndexedSliceReader.<init>(IndexedSliceReader.java:73)
> ... 14 more
> exceptions disappeared after running scrub
--
This message is automatically generated by JIRA.
For more information on JIRA, see: http://www.atlassian.com/software/jira
