[ https://issues.apache.org/jira/browse/CASSANDRA-4687?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13737539#comment-13737539 ]
Balázs Póka commented on CASSANDRA-4687: ---------------------------------------- Yes, compaction_preheat_key_cache is set to true. The migration program is a custom, multithreaded Java program which only inserts CQL3 "records" (using Datastax' Java core driver, see https://github.com/datastax/java-driver) into column families with this schema: create table data (key int, partitiontime bigint, begintime bigint, event varchar, data blob, primary key((key, partitiontime), event, begintime)) cfstats: SSTable count: 5 Space used (live): 1703574891 Space used (total): 1703575005 Number of Keys (estimate): 11776 Memtable Columns Count: 24 Memtable Data Size: 6572 Memtable Switch Count: 3 Read Count: 814 Read Latency: 2.128 ms. Write Count: 274 Write Latency: 0.046 ms. Pending Tasks: 0 Bloom Filter False Positives: 0 Bloom Filter False Ratio: 0.00000 Bloom Filter Space Used: 16456 Compacted row minimum size: 180 Compacted row maximum size: 2346799 Compacted row mean size: 121112 > Exception: DecoratedKey(xxx, yyy) != DecoratedKey(zzz, kkk) > ----------------------------------------------------------- > > Key: CASSANDRA-4687 > URL: https://issues.apache.org/jira/browse/CASSANDRA-4687 > Project: Cassandra > Issue Type: Bug > Components: Core > Environment: CentOS 6.3 64-bit, Oracle JRE 1.6.0.33 64-bit, single > node cluster > Reporter: Leonid Shalupov > Priority: Minor > Attachments: 4687-debugging.txt > > > Under heavy write load sometimes cassandra fails with assertion error. > git bisect leads to commit 295aedb278e7a495213241b66bc46d763fd4ce66. > works fine if global key/row caches disabled in code. > {quote} > java.lang.AssertionError: DecoratedKey(xxx, yyy) != DecoratedKey(zzz, kkk) in > /var/lib/cassandra/data/...-he-1-Data.db > at > org.apache.cassandra.db.columniterator.SSTableSliceIterator.<init>(SSTableSliceIterator.java:60) > at > org.apache.cassandra.db.filter.SliceQueryFilter.getSSTableColumnIterator(SliceQueryFilter.java:67) > at > org.apache.cassandra.db.filter.QueryFilter.getSSTableColumnIterator(QueryFilter.java:79) > at > org.apache.cassandra.db.CollationController.collectAllData(CollationController.java:256) > at > org.apache.cassandra.db.CollationController.getTopLevelColumns(CollationController.java:64) > at > org.apache.cassandra.db.ColumnFamilyStore.getTopLevelColumns(ColumnFamilyStore.java:1345) > at > org.apache.cassandra.db.ColumnFamilyStore.getColumnFamily(ColumnFamilyStore.java:1207) > at > org.apache.cassandra.db.ColumnFamilyStore.getColumnFamily(ColumnFamilyStore.java:1142) > at org.apache.cassandra.db.Table.getRow(Table.java:378) > at > org.apache.cassandra.db.SliceFromReadCommand.getRow(SliceFromReadCommand.java:69) > at > org.apache.cassandra.service.StorageProxy$LocalReadRunnable.runMayThrow(StorageProxy.java:819) > at > org.apache.cassandra.service.StorageProxy$DroppableRunnable.run(StorageProxy.java:1253) > at > java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908) > at java.lang.Thread.run(Thread.java:662) > {quote} -- This message is automatically generated by JIRA. If you think it was sent incorrectly, please contact your JIRA administrators For more information on JIRA, see: http://www.atlassian.com/software/jira