[ https://issues.apache.org/jira/browse/CASSANDRA-3402?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Andy Stec updated CASSANDRA-3402: --------------------------------- Attachment: system.log.gz Hi Sylvain, Looks like assertions are enabled: # enable assertions. disabling this in production will give a modest # performance benefit (around 5%). JVM_OPTS="$JVM_OPTS -ea" The exception always says "error reading 5 of 5". We don't have a way of reproducing the problem on a blank database. The exception is thrown after load runs for several hours. I attached the full system.log. Thanks, Andy On Wed, Oct 26, 2011 at 4:47 AM, Sylvain Lebresne (Commented) (JIRA) < > Runtime exception thrown periodically under load > ------------------------------------------------ > > Key: CASSANDRA-3402 > URL: https://issues.apache.org/jira/browse/CASSANDRA-3402 > Project: Cassandra > Issue Type: Bug > Components: Core > Affects Versions: 1.0.0 > Environment: Cassandra 1.0 > Red Hat Enterprise Linux Server 6.0 > Reporter: Andy Stec > Assignee: Sylvain Lebresne > Fix For: 1.0.1 > > Attachments: system.log.gz > > > The exception listed below is thrown periodically. We're using thrift > interface for C++. Jonathan Ellis requested that we open a bug for this. > ERROR [ReadStage:1761] 2011-10-25 12:17:16,088 AbstractCassandraDaemon.java > (line 133) Fatal exception in thread Thread[ReadStage:1761,5,main] > java.lang.RuntimeException: error reading 5 of 5 > at > org.apache.cassandra.db.columniterator.SimpleSliceReader.computeNext(SimpleSliceReader.java:83) > at > org.apache.cassandra.db.columniterator.SimpleSliceReader.computeNext(SimpleSliceReader.java:40) > at > com.google.common.collect.AbstractIterator.tryToComputeNext(AbstractIterator.java:140) > at > com.google.common.collect.AbstractIterator.hasNext(AbstractIterator.java:135) > at > org.apache.cassandra.db.columniterator.SSTableSliceIterator.hasNext(SSTableSliceIterator.java:107) > at > org.apache.cassandra.utils.MergeIterator$Candidate.advance(MergeIterator.java:145) > at > org.apache.cassandra.utils.MergeIterator$ManyToOne.advance(MergeIterator.java:124) > at > org.apache.cassandra.utils.MergeIterator$ManyToOne.computeNext(MergeIterator.java:98) > at > com.google.common.collect.AbstractIterator.tryToComputeNext(AbstractIterator.java:140) > at > com.google.common.collect.AbstractIterator.hasNext(AbstractIterator.java:135) > at > org.apache.cassandra.db.filter.SliceQueryFilter.collectReducedColumns(SliceQueryFilter.java:116) > at > org.apache.cassandra.db.filter.QueryFilter.collateColumns(QueryFilter.java:144) > at > org.apache.cassandra.db.CollationController.collectAllData(CollationController.java:225) > at > org.apache.cassandra.db.CollationController.getTopLevelColumns(CollationController.java:61) > at > org.apache.cassandra.db.ColumnFamilyStore.getTopLevelColumns(ColumnFamilyStore.java:1297) > at > org.apache.cassandra.db.ColumnFamilyStore.cacheRow(ColumnFamilyStore.java:1128) > at > org.apache.cassandra.db.ColumnFamilyStore.getColumnFamily(ColumnFamilyStore.java:1157) > at > org.apache.cassandra.db.ColumnFamilyStore.getColumnFamily(ColumnFamilyStore.java:1114) > at org.apache.cassandra.db.Table.getRow(Table.java:388) > at > org.apache.cassandra.db.SliceByNamesReadCommand.getRow(SliceByNamesReadCommand.java:58) > at > org.apache.cassandra.db.ReadVerbHandler.doVerb(ReadVerbHandler.java:62) > at > org.apache.cassandra.net.MessageDeliveryTask.run(MessageDeliveryTask.java:59) > at > java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908) > at java.lang.Thread.run(Thread.java:662) > Caused by: org.apache.cassandra.db.ColumnSerializer$CorruptColumnException: > invalid column name length 0 > at > org.apache.cassandra.db.ColumnSerializer.deserialize(ColumnSerializer.java:89) > at > org.apache.cassandra.db.ColumnSerializer.deserialize(ColumnSerializer.java:82) > at > org.apache.cassandra.db.ColumnSerializer.deserialize(ColumnSerializer.java:72) > at > org.apache.cassandra.db.ColumnSerializer.deserialize(ColumnSerializer.java:36) > at > org.apache.cassandra.db.columniterator.SimpleSliceReader.computeNext(SimpleSliceReader.java:79) > ... 24 more -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators: https://issues.apache.org/jira/secure/ContactAdministrators!default.jspa For more information on JIRA, see: http://www.atlassian.com/software/jira