[jira] [Updated] (CASSANDRA-15594) Uncaught exception on thread Thread[MutationStage-1,5,main]
[
https://issues.apache.org/jira/browse/CASSANDRA-15594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Aleksandr updated CASSANDRA-15594:
--
Summary: Uncaught exception on thread Thread[MutationStage-1,5,main] (was:
Cassandra AssertionError, AbstractLocalAwareExecutorService.java:167)
> Uncaught exception on thread Thread[MutationStage-1,5,main]
> ---
>
> Key: CASSANDRA-15594
> URL: https://issues.apache.org/jira/browse/CASSANDRA-15594
> Project: Cassandra
> Issue Type: Bug
>Reporter: Aleksandr
>Priority: Normal
> Labels: 3.11.4
>
> Hi.
> We have a cluster of 3 machines running Cassandra 3.11.4 for several months,
> cpp-driver 2.12.0 is used to communicate with Cassandra.
> We have 13 tables in total.
> Recently we've noticed that one particular INSERT operation fails with the
> error "Write failure: Operation failed - received 0 responses and 2 failures"
> - we retry twice the same query with timeouts 1 and 5.1 seconds. The query is:
> {code:java}
> INSERT INTO keyspace1.table1 (column1, column2, column3, column4, column5)
> VALUES (?, ?, ?, ?, ?) IF NOT EXISTS{code}
> Every time this particular INSERT happens we see the error in the log:
> {code:java}
> WARN [MutationStage-1] 2020-02-21 12:13:46,435
> AbstractLocalAwareExecutorService.java:167 - Uncaught exception on thread
> Thread[MutationStage-1,5,main]: {}
> java.lang.AssertionError: null
> at org.apache.cassandra.db.NativeClustering.(NativeClustering.java:45)
> ~[apache-cassandra-3.11.4.jar:3.11.4]
> at
> org.apache.cassandra.utils.memory.NativeAllocator$CloningBTreeRowBuilder.newRow(NativeAllocator.java:80)
> ~[apache-cassandra-3.11.4.jar:3.11.4]
> at org.apache.cassandra.db.rows.Rows.copy(Rows.java:43)
> ~[apache-cassandra-3.11.4.jar:3.11.4]
> at
> org.apache.cassandra.db.partitions.AtomicBTreePartition$RowUpdater.apply(AtomicBTreePartition.java:332)
> ~[apache-cassandra-3.11.4.jar:3.11.4]
> at
> org.apache.cassandra.db.partitions.AtomicBTreePartition$RowUpdater.apply(AtomicBTreePartition.java:295)
> ~[apache-cassandra-3.11.4.jar:3.11.4]
> at
> org.apache.cassandra.utils.btree.NodeBuilder.addNewKey(NodeBuilder.java:323)
> ~[apache-cassandra-3.11.4.jar:3.11.4]
> at org.apache.cassandra.utils.btree.NodeBuilder.update(NodeBuilder.java:184)
> ~[apache-cassandra-3.11.4.jar:3.11.4]
> at org.apache.cassandra.utils.btree.TreeBuilder.update(TreeBuilder.java:95)
> ~[apache-cassandra-3.11.4.jar:3.11.4]
> at org.apache.cassandra.utils.btree.BTree.update(BTree.java:182)
> ~[apache-cassandra-3.11.4.jar:3.11.4]
> at
> org.apache.cassandra.db.partitions.AtomicBTreePartition.addAllWithSizeDelta(AtomicBTreePartition.java:156)
> ~[apache-cassandra-3.11.4.jar:3.11.4]
> at org.apache.cassandra.db.Memtable.put(Memtable.java:282)
> ~[apache-cassandra-3.11.4.jar:3.11.4]
> at
> org.apache.cassandra.db.ColumnFamilyStore.apply(ColumnFamilyStore.java:1352)
> ~[apache-cassandra-3.11.4.jar:3.11.4]
> at org.apache.cassandra.db.Keyspace.applyInternal(Keyspace.java:626)
> ~[apache-cassandra-3.11.4.jar:3.11.4]
> at org.apache.cassandra.db.Keyspace.apply(Keyspace.java:470)
> ~[apache-cassandra-3.11.4.jar:3.11.4]
> at org.apache.cassandra.db.Keyspace.apply(Keyspace.java:450)
> ~[apache-cassandra-3.11.4.jar:3.11.4]
> at org.apache.cassandra.service.paxos.PaxosState.commit(PaxosState.java:150)
> ~[apache-cassandra-3.11.4.jar:3.11.4]
> at
> org.apache.cassandra.service.StorageProxy$6.runMayThrow(StorageProxy.java:571)
> ~[apache-cassandra-3.11.4.jar:3.11.4]
> at
> org.apache.cassandra.service.StorageProxy$LocalMutationRunnable.run(StorageProxy.java:2637)
> ~[apache-cassandra-3.11.4.jar:3.11.4]
> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
> ~[na:1.8.0_232]
> at
> org.apache.cassandra.concurrent.AbstractLocalAwareExecutorService$FutureTask.run(AbstractLocalAwareExecutorService.java:162)
> ~[apache-cassandra-3.11.4.jar:3.11.4]
> at
> org.apache.cassandra.concurrent.AbstractLocalAwareExecutorService$LocalSessionFutureTask.run(AbstractLocalAwareExecutorService.java:134)
> [apache-cassandra-3.11.4.jar:3.11.4]
> at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:114)
> [apache-cassandra-3.11.4.jar:3.11.4]
> at java.lang.Thread.run(Thread.java:748) [na:1.8.0_232]
> WARN [MutationStage-4] 2020-02-21 12:13:46,449
> AbstractLocalAwareExecutorService.java:167 - Uncaught exception on thread
> Thread[MutationStage-4,5,main]: {}
> java.lang.AssertionError: null
> at org.apache.cassandra.db.NativeClustering.(NativeClustering.java:45)
> ~[apache-cassandra-3.11.4.jar:3.11.4]
> at
> org.apache.cassandra.utils.memory.NativeAllocator$CloningBTreeRowBuilder.newRow(NativeAllocator.java:80)
> ~[apache-cassandra-3.11.4.jar:3.11.4]
> at org.apache.cassandra.db.rows.Rows.copy(Rows.java:43
[jira] [Updated] (CASSANDRA-15594) Cassandra AssertionError, AbstractLocalAwareExecutorService.java:167
[
https://issues.apache.org/jira/browse/CASSANDRA-15594?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Aleksandr updated CASSANDRA-15594:
--
Labels: 3.11.4 (was: )
> Cassandra AssertionError, AbstractLocalAwareExecutorService.java:167
>
>
> Key: CASSANDRA-15594
> URL: https://issues.apache.org/jira/browse/CASSANDRA-15594
> Project: Cassandra
> Issue Type: Bug
>Reporter: Aleksandr
>Priority: Normal
> Labels: 3.11.4
>
> Hi.
> We have a cluster of 3 machines running Cassandra 3.11.4 for several months,
> cpp-driver 2.12.0 is used to communicate with Cassandra.
> We have 13 tables in total.
> Recently we've noticed that one particular INSERT operation fails with the
> error "Write failure: Operation failed - received 0 responses and 2 failures"
> - we retry twice the same query with timeouts 1 and 5.1 seconds. The query is:
> {code:java}
> INSERT INTO keyspace1.table1 (column1, column2, column3, column4, column5)
> VALUES (?, ?, ?, ?, ?) IF NOT EXISTS{code}
> Every time this particular INSERT happens we see the error in the log:
> {code:java}
> WARN [MutationStage-1] 2020-02-21 12:13:46,435
> AbstractLocalAwareExecutorService.java:167 - Uncaught exception on thread
> Thread[MutationStage-1,5,main]: {}
> java.lang.AssertionError: null
> at org.apache.cassandra.db.NativeClustering.(NativeClustering.java:45)
> ~[apache-cassandra-3.11.4.jar:3.11.4]
> at
> org.apache.cassandra.utils.memory.NativeAllocator$CloningBTreeRowBuilder.newRow(NativeAllocator.java:80)
> ~[apache-cassandra-3.11.4.jar:3.11.4]
> at org.apache.cassandra.db.rows.Rows.copy(Rows.java:43)
> ~[apache-cassandra-3.11.4.jar:3.11.4]
> at
> org.apache.cassandra.db.partitions.AtomicBTreePartition$RowUpdater.apply(AtomicBTreePartition.java:332)
> ~[apache-cassandra-3.11.4.jar:3.11.4]
> at
> org.apache.cassandra.db.partitions.AtomicBTreePartition$RowUpdater.apply(AtomicBTreePartition.java:295)
> ~[apache-cassandra-3.11.4.jar:3.11.4]
> at
> org.apache.cassandra.utils.btree.NodeBuilder.addNewKey(NodeBuilder.java:323)
> ~[apache-cassandra-3.11.4.jar:3.11.4]
> at org.apache.cassandra.utils.btree.NodeBuilder.update(NodeBuilder.java:184)
> ~[apache-cassandra-3.11.4.jar:3.11.4]
> at org.apache.cassandra.utils.btree.TreeBuilder.update(TreeBuilder.java:95)
> ~[apache-cassandra-3.11.4.jar:3.11.4]
> at org.apache.cassandra.utils.btree.BTree.update(BTree.java:182)
> ~[apache-cassandra-3.11.4.jar:3.11.4]
> at
> org.apache.cassandra.db.partitions.AtomicBTreePartition.addAllWithSizeDelta(AtomicBTreePartition.java:156)
> ~[apache-cassandra-3.11.4.jar:3.11.4]
> at org.apache.cassandra.db.Memtable.put(Memtable.java:282)
> ~[apache-cassandra-3.11.4.jar:3.11.4]
> at
> org.apache.cassandra.db.ColumnFamilyStore.apply(ColumnFamilyStore.java:1352)
> ~[apache-cassandra-3.11.4.jar:3.11.4]
> at org.apache.cassandra.db.Keyspace.applyInternal(Keyspace.java:626)
> ~[apache-cassandra-3.11.4.jar:3.11.4]
> at org.apache.cassandra.db.Keyspace.apply(Keyspace.java:470)
> ~[apache-cassandra-3.11.4.jar:3.11.4]
> at org.apache.cassandra.db.Keyspace.apply(Keyspace.java:450)
> ~[apache-cassandra-3.11.4.jar:3.11.4]
> at org.apache.cassandra.service.paxos.PaxosState.commit(PaxosState.java:150)
> ~[apache-cassandra-3.11.4.jar:3.11.4]
> at
> org.apache.cassandra.service.StorageProxy$6.runMayThrow(StorageProxy.java:571)
> ~[apache-cassandra-3.11.4.jar:3.11.4]
> at
> org.apache.cassandra.service.StorageProxy$LocalMutationRunnable.run(StorageProxy.java:2637)
> ~[apache-cassandra-3.11.4.jar:3.11.4]
> at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
> ~[na:1.8.0_232]
> at
> org.apache.cassandra.concurrent.AbstractLocalAwareExecutorService$FutureTask.run(AbstractLocalAwareExecutorService.java:162)
> ~[apache-cassandra-3.11.4.jar:3.11.4]
> at
> org.apache.cassandra.concurrent.AbstractLocalAwareExecutorService$LocalSessionFutureTask.run(AbstractLocalAwareExecutorService.java:134)
> [apache-cassandra-3.11.4.jar:3.11.4]
> at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:114)
> [apache-cassandra-3.11.4.jar:3.11.4]
> at java.lang.Thread.run(Thread.java:748) [na:1.8.0_232]
> WARN [MutationStage-4] 2020-02-21 12:13:46,449
> AbstractLocalAwareExecutorService.java:167 - Uncaught exception on thread
> Thread[MutationStage-4,5,main]: {}
> java.lang.AssertionError: null
> at org.apache.cassandra.db.NativeClustering.(NativeClustering.java:45)
> ~[apache-cassandra-3.11.4.jar:3.11.4]
> at
> org.apache.cassandra.utils.memory.NativeAllocator$CloningBTreeRowBuilder.newRow(NativeAllocator.java:80)
> ~[apache-cassandra-3.11.4.jar:3.11.4]
> at org.apache.cassandra.db.rows.Rows.copy(Rows.java:43)
> ~[apache-cassandra-3.11.4.jar:3.11.4]
> at
> org.apache.cassandra.db.partitions.AtomicBTreePartiti
[jira] [Created] (CASSANDRA-15594) Cassandra AssertionError, AbstractLocalAwareExecutorService.java:167
Aleksandr created CASSANDRA-15594:
-
Summary: Cassandra AssertionError,
AbstractLocalAwareExecutorService.java:167
Key: CASSANDRA-15594
URL: https://issues.apache.org/jira/browse/CASSANDRA-15594
Project: Cassandra
Issue Type: Bug
Reporter: Aleksandr
Hi.
We have a cluster of 3 machines running Cassandra 3.11.4 for several months,
cpp-driver 2.12.0 is used to communicate with Cassandra.
We have 13 tables in total.
Recently we've noticed that one particular INSERT operation fails with the
error "Write failure: Operation failed - received 0 responses and 2 failures" -
we retry twice the same query with timeouts 1 and 5.1 seconds. The query is:
{code:java}
INSERT INTO keyspace1.table1 (column1, column2, column3, column4, column5)
VALUES (?, ?, ?, ?, ?) IF NOT EXISTS{code}
Every time this particular INSERT happens we see the error in the log:
{code:java}
WARN [MutationStage-1] 2020-02-21 12:13:46,435
AbstractLocalAwareExecutorService.java:167 - Uncaught exception on thread
Thread[MutationStage-1,5,main]: {}
java.lang.AssertionError: null
at org.apache.cassandra.db.NativeClustering.(NativeClustering.java:45)
~[apache-cassandra-3.11.4.jar:3.11.4]
at
org.apache.cassandra.utils.memory.NativeAllocator$CloningBTreeRowBuilder.newRow(NativeAllocator.java:80)
~[apache-cassandra-3.11.4.jar:3.11.4]
at org.apache.cassandra.db.rows.Rows.copy(Rows.java:43)
~[apache-cassandra-3.11.4.jar:3.11.4]
at
org.apache.cassandra.db.partitions.AtomicBTreePartition$RowUpdater.apply(AtomicBTreePartition.java:332)
~[apache-cassandra-3.11.4.jar:3.11.4]
at
org.apache.cassandra.db.partitions.AtomicBTreePartition$RowUpdater.apply(AtomicBTreePartition.java:295)
~[apache-cassandra-3.11.4.jar:3.11.4]
at
org.apache.cassandra.utils.btree.NodeBuilder.addNewKey(NodeBuilder.java:323)
~[apache-cassandra-3.11.4.jar:3.11.4]
at org.apache.cassandra.utils.btree.NodeBuilder.update(NodeBuilder.java:184)
~[apache-cassandra-3.11.4.jar:3.11.4]
at org.apache.cassandra.utils.btree.TreeBuilder.update(TreeBuilder.java:95)
~[apache-cassandra-3.11.4.jar:3.11.4]
at org.apache.cassandra.utils.btree.BTree.update(BTree.java:182)
~[apache-cassandra-3.11.4.jar:3.11.4]
at
org.apache.cassandra.db.partitions.AtomicBTreePartition.addAllWithSizeDelta(AtomicBTreePartition.java:156)
~[apache-cassandra-3.11.4.jar:3.11.4]
at org.apache.cassandra.db.Memtable.put(Memtable.java:282)
~[apache-cassandra-3.11.4.jar:3.11.4]
at
org.apache.cassandra.db.ColumnFamilyStore.apply(ColumnFamilyStore.java:1352)
~[apache-cassandra-3.11.4.jar:3.11.4]
at org.apache.cassandra.db.Keyspace.applyInternal(Keyspace.java:626)
~[apache-cassandra-3.11.4.jar:3.11.4]
at org.apache.cassandra.db.Keyspace.apply(Keyspace.java:470)
~[apache-cassandra-3.11.4.jar:3.11.4]
at org.apache.cassandra.db.Keyspace.apply(Keyspace.java:450)
~[apache-cassandra-3.11.4.jar:3.11.4]
at org.apache.cassandra.service.paxos.PaxosState.commit(PaxosState.java:150)
~[apache-cassandra-3.11.4.jar:3.11.4]
at
org.apache.cassandra.service.StorageProxy$6.runMayThrow(StorageProxy.java:571)
~[apache-cassandra-3.11.4.jar:3.11.4]
at
org.apache.cassandra.service.StorageProxy$LocalMutationRunnable.run(StorageProxy.java:2637)
~[apache-cassandra-3.11.4.jar:3.11.4]
at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
~[na:1.8.0_232]
at
org.apache.cassandra.concurrent.AbstractLocalAwareExecutorService$FutureTask.run(AbstractLocalAwareExecutorService.java:162)
~[apache-cassandra-3.11.4.jar:3.11.4]
at
org.apache.cassandra.concurrent.AbstractLocalAwareExecutorService$LocalSessionFutureTask.run(AbstractLocalAwareExecutorService.java:134)
[apache-cassandra-3.11.4.jar:3.11.4]
at org.apache.cassandra.concurrent.SEPWorker.run(SEPWorker.java:114)
[apache-cassandra-3.11.4.jar:3.11.4]
at java.lang.Thread.run(Thread.java:748) [na:1.8.0_232]
WARN [MutationStage-4] 2020-02-21 12:13:46,449
AbstractLocalAwareExecutorService.java:167 - Uncaught exception on thread
Thread[MutationStage-4,5,main]: {}
java.lang.AssertionError: null
at org.apache.cassandra.db.NativeClustering.(NativeClustering.java:45)
~[apache-cassandra-3.11.4.jar:3.11.4]
at
org.apache.cassandra.utils.memory.NativeAllocator$CloningBTreeRowBuilder.newRow(NativeAllocator.java:80)
~[apache-cassandra-3.11.4.jar:3.11.4]
at org.apache.cassandra.db.rows.Rows.copy(Rows.java:43)
~[apache-cassandra-3.11.4.jar:3.11.4]
at
org.apache.cassandra.db.partitions.AtomicBTreePartition$RowUpdater.apply(AtomicBTreePartition.java:332)
~[apache-cassandra-3.11.4.jar:3.11.4]
at
org.apache.cassandra.db.partitions.AtomicBTreePartition$RowUpdater.apply(AtomicBTreePartition.java:295)
~[apache-cassandra-3.11.4.jar:3.11.4]
at
org.apache.cassandra.utils.btree.NodeBuilder.addNewKey(NodeBuilder.java:323)
~[apache-cassandra-3.11.4.jar:3.11.4]
at org.apache.cassandra.utils.btree.NodeBuilder.update(NodeBuilder.java:184)
~[apac
[jira] [Commented] (CASSANDRA-13471) [PerDiskMemtableFlushWriter_0:1312] 2017-04-25 09:48:14,818 CassandraDaemon.java:226 - Exception in thread Thread[PerDiskMemtableFlushWriter_0:1312,5,main]
[
https://issues.apache.org/jira/browse/CASSANDRA-13471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15982727#comment-15982727
]
Chernishev Aleksandr commented on CASSANDRA-13471:
--
rebuilt index via cqlsh helps. But commitlog files truncates only after restart
cassandra
> [PerDiskMemtableFlushWriter_0:1312] 2017-04-25 09:48:14,818
> CassandraDaemon.java:226 - Exception in thread
> Thread[PerDiskMemtableFlushWriter_0:1312,5,main]
> ---
>
> Key: CASSANDRA-13471
> URL: https://issues.apache.org/jira/browse/CASSANDRA-13471
> Project: Cassandra
> Issue Type: Bug
> Components: sasi
> Environment: Centos7.3 x86_64, cassandra 3.9
>Reporter: Chernishev Aleksandr
> Fix For: 3.9
>
>
> with sasi index in table test.object:
> {code}
> CREATE TABLE test.object (
> bname text,
> name text,
> acl text,
> checksum text,
> chunksize bigint,
> contenttype text,
> creationdate timestamp,
> inode uuid,
> lastmodified timestamp,
> metadata map,
> parts map,
> size bigint,
> storageclass text,
> version uuid,
> PRIMARY KEY (bname, name)
> ) WITH CLUSTERING ORDER BY (name ASC)
> AND bloom_filter_fp_chance = 0.01
> AND caching = {'keys': 'ALL', 'rows_per_partition': 'NONE'}
> AND comment = ''
> AND compaction = {'class':
> 'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy',
> 'max_threshold': '32', 'min_threshold': '4'}
> AND compression = {'chunk_length_in_kb': '128', 'class':
> 'org.apache.cassandra.io.compress.LZ4Compressor'}
> AND crc_check_chance = 0.5
> AND dclocal_read_repair_chance = 0.1
> AND default_time_to_live = 0
> AND gc_grace_seconds = 864000
> AND max_index_interval = 2048
> AND memtable_flush_period_in_ms = 0
> AND min_index_interval = 128
> AND read_repair_chance = 0.0
> AND speculative_retry = '99PERCENTILE';
> CREATE INDEX inode_index ON test.object (inode);
> {code}
> im get error(on random servers in cluster in random times) :
> {code}
> ERROR [PerDiskMemtableFlushWriter_0:1312] 2017-04-25 09:48:14,818
> CassandraDaemon.java:226 - Exception in thread
> Thread[PerDiskMemtableFlushWriter_0:1312,5,main]
> java.lang.RuntimeException: Last written key
> DecoratedKey(d3f60675-e56e-4551-b468-d4e31c8ee82b,
> d3f60675e56e4551b468d4e31c8ee82b) >= current key
> DecoratedKey(6a473364-2f43-3876-574d-693461546d73,
> d3f6355a5bd8415290668f987a15594c) writing into
> /data3/test/object-f40120c028d111e78e26c57aefc93bac/.inode_index/mc-26-big-Data.db
> at
> org.apache.cassandra.io.sstable.format.big.BigTableWriter.beforeAppend(BigTableWriter.java:122)
> ~[apache-cassandra-3.9.0.jar:3.9.0]
> at
> org.apache.cassandra.io.sstable.format.big.BigTableWriter.append(BigTableWriter.java:161)
> ~[apache-cassandra-3.9.0.jar:3.9.0]
> at
> org.apache.cassandra.io.sstable.SimpleSSTableMultiWriter.append(SimpleSSTableMultiWriter.java:48)
> ~[apache-cassandra-3.9.0.jar:3.9.0]
> at
> org.apache.cassandra.db.Memtable$FlushRunnable.writeSortedContents(Memtable.java:458)
> ~[apache-cassandra-3.9.0.jar:3.9.0]
> at
> org.apache.cassandra.db.Memtable$FlushRunnable.call(Memtable.java:493)
> ~[apache-cassandra-3.9.0.jar:3.9.0]
> at
> org.apache.cassandra.db.Memtable$FlushRunnable.call(Memtable.java:380)
> ~[apache-cassandra-3.9.0.jar:3.9.0]
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> ~[na:1.8.0_121]
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> ~[na:1.8.0_121]
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> [na:1.8.0_121]
> at java.lang.Thread.run(Thread.java:745) [na:1.8.0_121]
> {code}
> After that in debug log repeated messages:
> DEBUG [MemtablePostFlush:405] 2017-04-25 09:48:15,944
> ColumnFamilyStore.java:936 - forceFlush requested but everything is clean in
> object
> Commitlog not truncate and grows.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Commented] (CASSANDRA-13471) [PerDiskMemtableFlushWriter_0:1312] 2017-04-25 09:48:14,818 CassandraDaemon.java:226 - Exception in thread Thread[PerDiskMemtableFlushWriter_0:1312,5,main]
[
https://issues.apache.org/jira/browse/CASSANDRA-13471?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15982685#comment-15982685
]
Chernishev Aleksandr commented on CASSANDRA-13471:
--
this is similar on https://issues.apache.org/jira/browse/CASSANDRA-12386
> [PerDiskMemtableFlushWriter_0:1312] 2017-04-25 09:48:14,818
> CassandraDaemon.java:226 - Exception in thread
> Thread[PerDiskMemtableFlushWriter_0:1312,5,main]
> ---
>
> Key: CASSANDRA-13471
> URL: https://issues.apache.org/jira/browse/CASSANDRA-13471
> Project: Cassandra
> Issue Type: Bug
> Components: sasi
> Environment: Centos7.3 x86_64, cassandra 3.9
>Reporter: Chernishev Aleksandr
> Fix For: 3.9
>
>
> with sasi index in table test.object:
> {code}
> CREATE TABLE test.object (
> bname text,
> name text,
> acl text,
> checksum text,
> chunksize bigint,
> contenttype text,
> creationdate timestamp,
> inode uuid,
> lastmodified timestamp,
> metadata map,
> parts map,
> size bigint,
> storageclass text,
> version uuid,
> PRIMARY KEY (bname, name)
> ) WITH CLUSTERING ORDER BY (name ASC)
> AND bloom_filter_fp_chance = 0.01
> AND caching = {'keys': 'ALL', 'rows_per_partition': 'NONE'}
> AND comment = ''
> AND compaction = {'class':
> 'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy',
> 'max_threshold': '32', 'min_threshold': '4'}
> AND compression = {'chunk_length_in_kb': '128', 'class':
> 'org.apache.cassandra.io.compress.LZ4Compressor'}
> AND crc_check_chance = 0.5
> AND dclocal_read_repair_chance = 0.1
> AND default_time_to_live = 0
> AND gc_grace_seconds = 864000
> AND max_index_interval = 2048
> AND memtable_flush_period_in_ms = 0
> AND min_index_interval = 128
> AND read_repair_chance = 0.0
> AND speculative_retry = '99PERCENTILE';
> CREATE INDEX inode_index ON test.object (inode);
> {code}
> im get error(on random servers in cluster in random times) :
> {code}
> ERROR [PerDiskMemtableFlushWriter_0:1312] 2017-04-25 09:48:14,818
> CassandraDaemon.java:226 - Exception in thread
> Thread[PerDiskMemtableFlushWriter_0:1312,5,main]
> java.lang.RuntimeException: Last written key
> DecoratedKey(d3f60675-e56e-4551-b468-d4e31c8ee82b,
> d3f60675e56e4551b468d4e31c8ee82b) >= current key
> DecoratedKey(6a473364-2f43-3876-574d-693461546d73,
> d3f6355a5bd8415290668f987a15594c) writing into
> /data3/test/object-f40120c028d111e78e26c57aefc93bac/.inode_index/mc-26-big-Data.db
> at
> org.apache.cassandra.io.sstable.format.big.BigTableWriter.beforeAppend(BigTableWriter.java:122)
> ~[apache-cassandra-3.9.0.jar:3.9.0]
> at
> org.apache.cassandra.io.sstable.format.big.BigTableWriter.append(BigTableWriter.java:161)
> ~[apache-cassandra-3.9.0.jar:3.9.0]
> at
> org.apache.cassandra.io.sstable.SimpleSSTableMultiWriter.append(SimpleSSTableMultiWriter.java:48)
> ~[apache-cassandra-3.9.0.jar:3.9.0]
> at
> org.apache.cassandra.db.Memtable$FlushRunnable.writeSortedContents(Memtable.java:458)
> ~[apache-cassandra-3.9.0.jar:3.9.0]
> at
> org.apache.cassandra.db.Memtable$FlushRunnable.call(Memtable.java:493)
> ~[apache-cassandra-3.9.0.jar:3.9.0]
> at
> org.apache.cassandra.db.Memtable$FlushRunnable.call(Memtable.java:380)
> ~[apache-cassandra-3.9.0.jar:3.9.0]
> at java.util.concurrent.FutureTask.run(FutureTask.java:266)
> ~[na:1.8.0_121]
> at
> java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
> ~[na:1.8.0_121]
> at
> java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
> [na:1.8.0_121]
> at java.lang.Thread.run(Thread.java:745) [na:1.8.0_121]
> {code}
> After that in debug log repeated messages:
> DEBUG [MemtablePostFlush:405] 2017-04-25 09:48:15,944
> ColumnFamilyStore.java:936 - forceFlush requested but everything is clean in
> object
> Commitlog not truncate and grows.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
[jira] [Updated] (CASSANDRA-13471) [PerDiskMemtableFlushWriter_0:1312] 2017-04-25 09:48:14,818 CassandraDaemon.java:226 - Exception in thread Thread[PerDiskMemtableFlushWriter_0:1312,5,main]
[
https://issues.apache.org/jira/browse/CASSANDRA-13471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chernishev Aleksandr updated CASSANDRA-13471:
-
Description:
with sasi index in table test.object:
{code}
CREATE TABLE test.object (
bname text,
name text,
acl text,
checksum text,
chunksize bigint,
contenttype text,
creationdate timestamp,
inode uuid,
lastmodified timestamp,
metadata map,
parts map,
size bigint,
storageclass text,
version uuid,
PRIMARY KEY (bname, name)
) WITH CLUSTERING ORDER BY (name ASC)
AND bloom_filter_fp_chance = 0.01
AND caching = {'keys': 'ALL', 'rows_per_partition': 'NONE'}
AND comment = ''
AND compaction = {'class':
'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy',
'max_threshold': '32', 'min_threshold': '4'}
AND compression = {'chunk_length_in_kb': '128', 'class':
'org.apache.cassandra.io.compress.LZ4Compressor'}
AND crc_check_chance = 0.5
AND dclocal_read_repair_chance = 0.1
AND default_time_to_live = 0
AND gc_grace_seconds = 864000
AND max_index_interval = 2048
AND memtable_flush_period_in_ms = 0
AND min_index_interval = 128
AND read_repair_chance = 0.0
AND speculative_retry = '99PERCENTILE';
CREATE INDEX inode_index ON test.object (inode);
{code}
im get error(on random servers in cluster in random times) :
{code}
ERROR [PerDiskMemtableFlushWriter_0:1312] 2017-04-25 09:48:14,818
CassandraDaemon.java:226 - Exception in thread
Thread[PerDiskMemtableFlushWriter_0:1312,5,main]
java.lang.RuntimeException: Last written key
DecoratedKey(d3f60675-e56e-4551-b468-d4e31c8ee82b,
d3f60675e56e4551b468d4e31c8ee82b) >= current key
DecoratedKey(6a473364-2f43-3876-574d-693461546d73,
d3f6355a5bd8415290668f987a15594c) writing into
/data3/test/object-f40120c028d111e78e26c57aefc93bac/.inode_index/mc-26-big-Data.db
at
org.apache.cassandra.io.sstable.format.big.BigTableWriter.beforeAppend(BigTableWriter.java:122)
~[apache-cassandra-3.9.0.jar:3.9.0]
at
org.apache.cassandra.io.sstable.format.big.BigTableWriter.append(BigTableWriter.java:161)
~[apache-cassandra-3.9.0.jar:3.9.0]
at
org.apache.cassandra.io.sstable.SimpleSSTableMultiWriter.append(SimpleSSTableMultiWriter.java:48)
~[apache-cassandra-3.9.0.jar:3.9.0]
at
org.apache.cassandra.db.Memtable$FlushRunnable.writeSortedContents(Memtable.java:458)
~[apache-cassandra-3.9.0.jar:3.9.0]
at
org.apache.cassandra.db.Memtable$FlushRunnable.call(Memtable.java:493)
~[apache-cassandra-3.9.0.jar:3.9.0]
at
org.apache.cassandra.db.Memtable$FlushRunnable.call(Memtable.java:380)
~[apache-cassandra-3.9.0.jar:3.9.0]
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
~[na:1.8.0_121]
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
~[na:1.8.0_121]
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[na:1.8.0_121]
at java.lang.Thread.run(Thread.java:745) [na:1.8.0_121]
{code}
After that in debug log repeated messages:
DEBUG [MemtablePostFlush:405] 2017-04-25 09:48:15,944
ColumnFamilyStore.java:936 - forceFlush requested but everything is clean in
object
Commitlog not truncate and grows.
was:
with sasi index in table test.object:
{code}
CREATE TABLE test.object (
bname text,
name text,
acl text,
checksum text,
chunksize bigint,
contenttype text,
creationdate timestamp,
inode uuid,
lastmodified timestamp,
metadata map,
parts map,
size bigint,
storageclass text,
version uuid,
PRIMARY KEY (bname, name)
) WITH CLUSTERING ORDER BY (name ASC)
AND bloom_filter_fp_chance = 0.01
AND caching = {'keys': 'ALL', 'rows_per_partition': 'NONE'}
AND comment = ''
AND compaction = {'class':
'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy',
'max_threshold': '32', 'min_threshold': '4'}
AND compression = {'chunk_length_in_kb': '128', 'class':
'org.apache.cassandra.io.compress.LZ4Compressor'}
AND crc_check_chance = 0.5
AND dclocal_read_repair_chance = 0.1
AND default_time_to_live = 0
AND gc_grace_seconds = 864000
AND max_index_interval = 2048
AND memtable_flush_period_in_ms = 0
AND min_index_interval = 128
AND read_repair_chance = 0.0
AND speculative_retry = '99PERCENTILE';
CREATE INDEX inode_index ON test.object (inode);
{code}
im get error(on random servers in cluster in random times) :
ERROR [PerDiskMemtableFlushWriter_0:1312] 2017-04-25 09:48:14,818
CassandraDaemon.java:226 - Exception in thread
Thread[PerDiskMemtableFlushWriter_0:1312,5,main]
java.lang.RuntimeException: Last written key
DecoratedKey(d3f60675-e56e-4551-b468-d4e31c8ee82b,
d3f60675e56e4551b468d4e31c8ee82b) >= current key
DecoratedKey(6a473364-2f43-3876-574d-693461546d73,
d3f6355a5bd8415290
[jira] [Updated] (CASSANDRA-13471) [PerDiskMemtableFlushWriter_0:1312] 2017-04-25 09:48:14,818 CassandraDaemon.java:226 - Exception in thread Thread[PerDiskMemtableFlushWriter_0:1312,5,main]
[
https://issues.apache.org/jira/browse/CASSANDRA-13471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chernishev Aleksandr updated CASSANDRA-13471:
-
Description:
with sasi index in table test.object:
{code}
CREATE TABLE test.object (
bname text,
name text,
acl text,
checksum text,
chunksize bigint,
contenttype text,
creationdate timestamp,
inode uuid,
lastmodified timestamp,
metadata map,
parts map,
size bigint,
storageclass text,
version uuid,
PRIMARY KEY (bname, name)
) WITH CLUSTERING ORDER BY (name ASC)
AND bloom_filter_fp_chance = 0.01
AND caching = {'keys': 'ALL', 'rows_per_partition': 'NONE'}
AND comment = ''
AND compaction = {'class':
'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy',
'max_threshold': '32', 'min_threshold': '4'}
AND compression = {'chunk_length_in_kb': '128', 'class':
'org.apache.cassandra.io.compress.LZ4Compressor'}
AND crc_check_chance = 0.5
AND dclocal_read_repair_chance = 0.1
AND default_time_to_live = 0
AND gc_grace_seconds = 864000
AND max_index_interval = 2048
AND memtable_flush_period_in_ms = 0
AND min_index_interval = 128
AND read_repair_chance = 0.0
AND speculative_retry = '99PERCENTILE';
CREATE INDEX inode_index ON test.object (inode);
{code}
im get error(on random servers in cluster in random times) :
ERROR [PerDiskMemtableFlushWriter_0:1312] 2017-04-25 09:48:14,818
CassandraDaemon.java:226 - Exception in thread
Thread[PerDiskMemtableFlushWriter_0:1312,5,main]
java.lang.RuntimeException: Last written key
DecoratedKey(d3f60675-e56e-4551-b468-d4e31c8ee82b,
d3f60675e56e4551b468d4e31c8ee82b) >= current key
DecoratedKey(6a473364-2f43-3876-574d-693461546d73,
d3f6355a5bd8415290668f987a15594c) writing into
/data3/test/object-f40120c028d111e78e26c57aefc93bac/.inode_index/mc-26-big-Data.db
at
org.apache.cassandra.io.sstable.format.big.BigTableWriter.beforeAppend(BigTableWriter.java:122)
~[apache-cassandra-3.9.0.jar:3.9.0]
at
org.apache.cassandra.io.sstable.format.big.BigTableWriter.append(BigTableWriter.java:161)
~[apache-cassandra-3.9.0.jar:3.9.0]
at
org.apache.cassandra.io.sstable.SimpleSSTableMultiWriter.append(SimpleSSTableMultiWriter.java:48)
~[apache-cassandra-3.9.0.jar:3.9.0]
at
org.apache.cassandra.db.Memtable$FlushRunnable.writeSortedContents(Memtable.java:458)
~[apache-cassandra-3.9.0.jar:3.9.0]
at
org.apache.cassandra.db.Memtable$FlushRunnable.call(Memtable.java:493)
~[apache-cassandra-3.9.0.jar:3.9.0]
at
org.apache.cassandra.db.Memtable$FlushRunnable.call(Memtable.java:380)
~[apache-cassandra-3.9.0.jar:3.9.0]
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
~[na:1.8.0_121]
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
~[na:1.8.0_121]
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[na:1.8.0_121]
at java.lang.Thread.run(Thread.java:745) [na:1.8.0_121]
After that in debug log repeated messages:
DEBUG [MemtablePostFlush:405] 2017-04-25 09:48:15,944
ColumnFamilyStore.java:936 - forceFlush requested but everything is clean in
object
Commitlog not truncate and grows.
was:
with sasi index in table test.object:
CREATE TABLE test.object (
bname text,
name text,
acl text,
checksum text,
chunksize bigint,
contenttype text,
creationdate timestamp,
inode uuid,
lastmodified timestamp,
metadata map,
parts map,
size bigint,
storageclass text,
version uuid,
PRIMARY KEY (bname, name)
) WITH CLUSTERING ORDER BY (name ASC)
AND bloom_filter_fp_chance = 0.01
AND caching = {'keys': 'ALL', 'rows_per_partition': 'NONE'}
AND comment = ''
AND compaction = {'class':
'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy',
'max_threshold': '32', 'min_threshold': '4'}
AND compression = {'chunk_length_in_kb': '128', 'class':
'org.apache.cassandra.io.compress.LZ4Compressor'}
AND crc_check_chance = 0.5
AND dclocal_read_repair_chance = 0.1
AND default_time_to_live = 0
AND gc_grace_seconds = 864000
AND max_index_interval = 2048
AND memtable_flush_period_in_ms = 0
AND min_index_interval = 128
AND read_repair_chance = 0.0
AND speculative_retry = '99PERCENTILE';
CREATE INDEX inode_index ON test.object (inode);
im get error(on random servers in cluster in random times) :
ERROR [PerDiskMemtableFlushWriter_0:1312] 2017-04-25 09:48:14,818
CassandraDaemon.java:226 - Exception in thread
Thread[PerDiskMemtableFlushWriter_0:1312,5,main]
java.lang.RuntimeException: Last written key
DecoratedKey(d3f60675-e56e-4551-b468-d4e31c8ee82b,
d3f60675e56e4551b468d4e31c8ee82b) >= current key
DecoratedKey(6a473364-2f43-3876-574d-693461546d73,
d3f6355a5bd8415290668f987a15594c) writing i
[jira] [Updated] (CASSANDRA-13471) [PerDiskMemtableFlushWriter_0:1312] 2017-04-25 09:48:14,818 CassandraDaemon.java:226 - Exception in thread Thread[PerDiskMemtableFlushWriter_0:1312,5,main]
[
https://issues.apache.org/jira/browse/CASSANDRA-13471?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Chernishev Aleksandr updated CASSANDRA-13471:
-
Description:
with sasi index in table test.object:
CREATE TABLE test.object (
bname text,
name text,
acl text,
checksum text,
chunksize bigint,
contenttype text,
creationdate timestamp,
inode uuid,
lastmodified timestamp,
metadata map,
parts map,
size bigint,
storageclass text,
version uuid,
PRIMARY KEY (bname, name)
) WITH CLUSTERING ORDER BY (name ASC)
AND bloom_filter_fp_chance = 0.01
AND caching = {'keys': 'ALL', 'rows_per_partition': 'NONE'}
AND comment = ''
AND compaction = {'class':
'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy',
'max_threshold': '32', 'min_threshold': '4'}
AND compression = {'chunk_length_in_kb': '128', 'class':
'org.apache.cassandra.io.compress.LZ4Compressor'}
AND crc_check_chance = 0.5
AND dclocal_read_repair_chance = 0.1
AND default_time_to_live = 0
AND gc_grace_seconds = 864000
AND max_index_interval = 2048
AND memtable_flush_period_in_ms = 0
AND min_index_interval = 128
AND read_repair_chance = 0.0
AND speculative_retry = '99PERCENTILE';
CREATE INDEX inode_index ON test.object (inode);
im get error(on random servers in cluster in random times) :
ERROR [PerDiskMemtableFlushWriter_0:1312] 2017-04-25 09:48:14,818
CassandraDaemon.java:226 - Exception in thread
Thread[PerDiskMemtableFlushWriter_0:1312,5,main]
java.lang.RuntimeException: Last written key
DecoratedKey(d3f60675-e56e-4551-b468-d4e31c8ee82b,
d3f60675e56e4551b468d4e31c8ee82b) >= current key
DecoratedKey(6a473364-2f43-3876-574d-693461546d73,
d3f6355a5bd8415290668f987a15594c) writing into
/data3/test/object-f40120c028d111e78e26c57aefc93bac/.inode_index/mc-26-big-Data.db
at
org.apache.cassandra.io.sstable.format.big.BigTableWriter.beforeAppend(BigTableWriter.java:122)
~[apache-cassandra-3.9.0.jar:3.9.0]
at
org.apache.cassandra.io.sstable.format.big.BigTableWriter.append(BigTableWriter.java:161)
~[apache-cassandra-3.9.0.jar:3.9.0]
at
org.apache.cassandra.io.sstable.SimpleSSTableMultiWriter.append(SimpleSSTableMultiWriter.java:48)
~[apache-cassandra-3.9.0.jar:3.9.0]
at
org.apache.cassandra.db.Memtable$FlushRunnable.writeSortedContents(Memtable.java:458)
~[apache-cassandra-3.9.0.jar:3.9.0]
at
org.apache.cassandra.db.Memtable$FlushRunnable.call(Memtable.java:493)
~[apache-cassandra-3.9.0.jar:3.9.0]
at
org.apache.cassandra.db.Memtable$FlushRunnable.call(Memtable.java:380)
~[apache-cassandra-3.9.0.jar:3.9.0]
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
~[na:1.8.0_121]
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
~[na:1.8.0_121]
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[na:1.8.0_121]
at java.lang.Thread.run(Thread.java:745) [na:1.8.0_121]
After that in debug log repeated messages:
DEBUG [MemtablePostFlush:405] 2017-04-25 09:48:15,944
ColumnFamilyStore.java:936 - forceFlush requested but everything is clean in
object
Commitlog not truncate and grows.
was:
with sasi index in table test.object:
CREATE TABLE test.object (
bname text,
name text,
acl text,
checksum text,
chunksize bigint,
contenttype text,
creationdate timestamp,
inode uuid,
lastmodified timestamp,
metadata map,
parts map,
size bigint,
storageclass text,
version uuid,
PRIMARY KEY (bname, name)
) WITH CLUSTERING ORDER BY (name ASC)
AND bloom_filter_fp_chance = 0.01
AND caching = {'keys': 'ALL', 'rows_per_partition': 'NONE'}
AND comment = ''
AND compaction = {'class':
'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy',
'max_threshold': '32', 'min_threshold': '4'}
AND compression = {'chunk_length_in_kb': '128', 'class':
'org.apache.cassandra.io.compress.LZ4Compressor'}
AND crc_check_chance = 0.5
AND dclocal_read_repair_chance = 0.1
AND default_time_to_live = 0
AND gc_grace_seconds = 864000
AND max_index_interval = 2048
AND memtable_flush_period_in_ms = 0
AND min_index_interval = 128
AND read_repair_chance = 0.0
AND speculative_retry = '99PERCENTILE';
CREATE INDEX inode_index ON test.object (inode);
im get error(on random servers in cluster in random times) :
ERROR [PerDiskMemtableFlushWriter_0:1312] 2017-04-25 09:48:14,818
CassandraDaemon.java:226 - Exception in thread
Thread[PerDiskMemtableFlushWriter_0:1312,5,main]
java.lang.RuntimeException: Last written key
DecoratedKey(d3f60675-e56e-4551-b468-d4e31c8ee82b,
d3f60675e56e4551b468d4e31c8ee82b) >= current key
DecoratedKey(6a473364-2f43-3876-574d-693461546d73,
d3f6355a5bd8415290668f987a15594c) writing into
/data3/tes
[jira] [Created] (CASSANDRA-13471) [PerDiskMemtableFlushWriter_0:1312] 2017-04-25 09:48:14,818 CassandraDaemon.java:226 - Exception in thread Thread[PerDiskMemtableFlushWriter_0:1312,5,main]
Chernishev Aleksandr created CASSANDRA-13471:
Summary: [PerDiskMemtableFlushWriter_0:1312] 2017-04-25
09:48:14,818 CassandraDaemon.java:226 - Exception in thread
Thread[PerDiskMemtableFlushWriter_0:1312,5,main]
Key: CASSANDRA-13471
URL: https://issues.apache.org/jira/browse/CASSANDRA-13471
Project: Cassandra
Issue Type: Bug
Components: sasi
Environment: Centos7.3 x86_64, cassandra 3.9
Reporter: Chernishev Aleksandr
Fix For: 3.9
with sasi index in table test.object:
CREATE TABLE test.object (
bname text,
name text,
acl text,
checksum text,
chunksize bigint,
contenttype text,
creationdate timestamp,
inode uuid,
lastmodified timestamp,
metadata map,
parts map,
size bigint,
storageclass text,
version uuid,
PRIMARY KEY (bname, name)
) WITH CLUSTERING ORDER BY (name ASC)
AND bloom_filter_fp_chance = 0.01
AND caching = {'keys': 'ALL', 'rows_per_partition': 'NONE'}
AND comment = ''
AND compaction = {'class':
'org.apache.cassandra.db.compaction.SizeTieredCompactionStrategy',
'max_threshold': '32', 'min_threshold': '4'}
AND compression = {'chunk_length_in_kb': '128', 'class':
'org.apache.cassandra.io.compress.LZ4Compressor'}
AND crc_check_chance = 0.5
AND dclocal_read_repair_chance = 0.1
AND default_time_to_live = 0
AND gc_grace_seconds = 864000
AND max_index_interval = 2048
AND memtable_flush_period_in_ms = 0
AND min_index_interval = 128
AND read_repair_chance = 0.0
AND speculative_retry = '99PERCENTILE';
CREATE INDEX inode_index ON test.object (inode);
im get error(on random servers in cluster in random times) :
ERROR [PerDiskMemtableFlushWriter_0:1312] 2017-04-25 09:48:14,818
CassandraDaemon.java:226 - Exception in thread
Thread[PerDiskMemtableFlushWriter_0:1312,5,main]
java.lang.RuntimeException: Last written key
DecoratedKey(d3f60675-e56e-4551-b468-d4e31c8ee82b,
d3f60675e56e4551b468d4e31c8ee82b) >= current key
DecoratedKey(6a473364-2f43-3876-574d-693461546d73,
d3f6355a5bd8415290668f987a15594c) writing into
/data3/test/object-f40120c028d111e78e26c57aefc93bac/.inode_index/mc-26-big-Data.db
at
org.apache.cassandra.io.sstable.format.big.BigTableWriter.beforeAppend(BigTableWriter.java:122)
~[apache-cassandra-3.9.0.jar:3.9.0]
at
org.apache.cassandra.io.sstable.format.big.BigTableWriter.append(BigTableWriter.java:161)
~[apache-cassandra-3.9.0.jar:3.9.0]
at
org.apache.cassandra.io.sstable.SimpleSSTableMultiWriter.append(SimpleSSTableMultiWriter.java:48)
~[apache-cassandra-3.9.0.jar:3.9.0]
at
org.apache.cassandra.db.Memtable$FlushRunnable.writeSortedContents(Memtable.java:458)
~[apache-cassandra-3.9.0.jar:3.9.0]
at
org.apache.cassandra.db.Memtable$FlushRunnable.call(Memtable.java:493)
~[apache-cassandra-3.9.0.jar:3.9.0]
at
org.apache.cassandra.db.Memtable$FlushRunnable.call(Memtable.java:380)
~[apache-cassandra-3.9.0.jar:3.9.0]
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
~[na:1.8.0_121]
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
~[na:1.8.0_121]
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
[na:1.8.0_121]
at java.lang.Thread.run(Thread.java:745) [na:1.8.0_121]
After that in debug log repeated messages:
DEBUG [MemtablePostFlush:405] 2017-04-25 09:48:15,944
ColumnFamilyStore.java:936 - forceFlush requested but everything is clean in
object
Commitlog not truncate and grows.
--
This message was sent by Atlassian JIRA
(v6.3.15#6346)
