[jira] [Comment Edited] (CASSANDRA-4733) Last written key = current key exception when streaming
[
https://issues.apache.org/jira/browse/CASSANDRA-4733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13922300#comment-13922300
]
Serj Veras edited comment on CASSANDRA-4733 at 3/6/14 10:57 AM:
I have the same error using Cassandra 2.0.5.22 (DataStax package).
I use 3 DC with 3 nodes in each of them. Error is occurred during massive
insert workload in one of the DCs. Target CF has replication factor 2 in each
of the DCs.
{code}
ERROR [CompactionExecutor:26] 2014-03-06 10:18:45,760 CassandraDaemon.java
(line 196) Exception in thread Thread[CompactionExecutor:26,1,main]
java.lang.RuntimeException: Last written key DecoratedKey(-3718191715883699976,
36633732653439302d303730632d343139352d386461342d333736383265393965316335) =
current key DecoratedKey(-7629226534008815744,
62306334323161342d663662362d346364632d383965382d306563343832376639316536)
writing into /data/db/cassandra/data/Sync/sy/Sync-sy-tmp-jb-41-Data.db
at
org.apache.cassandra.io.sstable.SSTableWriter.beforeAppend(SSTableWriter.java:142)
at
org.apache.cassandra.io.sstable.SSTableWriter.append(SSTableWriter.java:165)
at
org.apache.cassandra.db.compaction.CompactionTask.runWith(CompactionTask.java:160)
at
org.apache.cassandra.io.util.DiskAwareRunnable.runMayThrow(DiskAwareRunnable.java:48)
at
org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:28)
at
org.apache.cassandra.db.compaction.CompactionTask.executeInternal(CompactionTask.java:60)
at
org.apache.cassandra.db.compaction.AbstractCompactionTask.execute(AbstractCompactionTask.java:59)
at
org.apache.cassandra.db.compaction.CompactionManager$BackgroundCompactionTask.run(CompactionManager.java:197)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:744)
{code}
Here is the state of my cluster after error has occurred. DC3 is the
destination of workload writes.
{code}
Datacenter: DC1
==
Address RackStatus State LoadOwns
Token
3074457345618258602
10.0.0.163 RAC1Up Normal 14.43 GB33.33%
-9223372036854775808
10.0.0.166 RAC0Up Normal 14.41 GB33.33%
-3074457345618258603
10.0.0.167 RAC2Up Normal 14.33 GB33.33%
3074457345618258602
Datacenter: DC2
==
Address RackStatus State LoadOwns
Token
3074457345618258603
10.0.1.145 RAC0Up Normal 14.46 GB0.00%
-9223372036854775807
10.0.1.147 RAC1Up Normal 14.39 GB0.00%
-3074457345618258602
10.0.1.149 RAC2Up Normal 14.43 GB0.00%
3074457345618258603
Datacenter: DC3
==
Address Rack Status State LoadOwns
Token
3074457345618258604
10.0.2.47 RAC0Down Normal 12.84 GB0.00%
-9223372036854775806
10.0.2.49 RAC1Down Normal 13.69 GB0.00%
-3074457345618258601
10.0.2.51 RAC2Down Normal 12.34 GB0.00%
3074457345618258604
{code}
was (Author: sivikt):
I have the same error using Cassandra 2.0.5.22 (DataStax package).
I use 3 DC with 3 nodes in each of them. Error is occurred during massive
insert workload in one of the DCs. Target CF has replication factor 2 in each
of the DCs.
{code}
ERROR [CompactionExecutor:26] 2014-03-06 10:18:45,760 CassandraDaemon.java
(line 196) Exception in thread Thread[CompactionExecutor:26,1,main]
java.lang.RuntimeException: Last written key DecoratedKey(-3718191715883699976,
36633732653439302d303730632d343139352d386461342d333736383265393965316335) =
current key DecoratedKey(-7629226534008815744,
62306334323161342d663662362d346364632d383965382d306563343832376639316536)
writing into /data/db/cassandra/data/Sync/sy/Sync-sy-tmp-jb-41-Data.db
at
[jira] [Comment Edited] (CASSANDRA-4733) Last written key = current key exception when streaming
[
https://issues.apache.org/jira/browse/CASSANDRA-4733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13922300#comment-13922300
]
Serj Veras edited comment on CASSANDRA-4733 at 3/6/14 11:10 AM:
I have the same error using Cassandra 2.0.5.22 (DataStax package).
I use 3 DC with 3 nodes in each of them. Error is occurred during massive
insert workload in one of the DCs. Target CF has replication factor 2 in each
of the DCs.
Attached Cassandra settings as Serj_Veras_cassandra.yaml.
{code}
ERROR [CompactionExecutor:26] 2014-03-06 10:18:45,760 CassandraDaemon.java
(line 196) Exception in thread Thread[CompactionExecutor:26,1,main]
java.lang.RuntimeException: Last written key DecoratedKey(-3718191715883699976,
36633732653439302d303730632d343139352d386461342d333736383265393965316335) =
current key DecoratedKey(-7629226534008815744,
62306334323161342d663662362d346364632d383965382d306563343832376639316536)
writing into /data/db/cassandra/data/Sync/sy/Sync-sy-tmp-jb-41-Data.db
at
org.apache.cassandra.io.sstable.SSTableWriter.beforeAppend(SSTableWriter.java:142)
at
org.apache.cassandra.io.sstable.SSTableWriter.append(SSTableWriter.java:165)
at
org.apache.cassandra.db.compaction.CompactionTask.runWith(CompactionTask.java:160)
at
org.apache.cassandra.io.util.DiskAwareRunnable.runMayThrow(DiskAwareRunnable.java:48)
at
org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:28)
at
org.apache.cassandra.db.compaction.CompactionTask.executeInternal(CompactionTask.java:60)
at
org.apache.cassandra.db.compaction.AbstractCompactionTask.execute(AbstractCompactionTask.java:59)
at
org.apache.cassandra.db.compaction.CompactionManager$BackgroundCompactionTask.run(CompactionManager.java:197)
at
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471)
at java.util.concurrent.FutureTask.run(FutureTask.java:262)
at
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:744)
{code}
Here is the state of my cluster after error has occurred. DC3 is the
destination of workload writes.
{code}
Datacenter: DC1
==
Address RackStatus State LoadOwns
Token
3074457345618258602
10.0.0.163 RAC1Up Normal 14.43 GB33.33%
-9223372036854775808
10.0.0.166 RAC0Up Normal 14.41 GB33.33%
-3074457345618258603
10.0.0.167 RAC2Up Normal 14.33 GB33.33%
3074457345618258602
Datacenter: DC2
==
Address RackStatus State LoadOwns
Token
3074457345618258603
10.0.1.145 RAC0Up Normal 14.46 GB0.00%
-9223372036854775807
10.0.1.147 RAC1Up Normal 14.39 GB0.00%
-3074457345618258602
10.0.1.149 RAC2Up Normal 14.43 GB0.00%
3074457345618258603
Datacenter: DC3
==
Address Rack Status State LoadOwns
Token
3074457345618258604
10.0.2.47 RAC0Down Normal 12.84 GB0.00%
-9223372036854775806
10.0.2.49 RAC1Down Normal 13.69 GB0.00%
-3074457345618258601
10.0.2.51 RAC2Down Normal 12.34 GB0.00%
3074457345618258604
{code}
was (Author: sivikt):
I have the same error using Cassandra 2.0.5.22 (DataStax package).
I use 3 DC with 3 nodes in each of them. Error is occurred during massive
insert workload in one of the DCs. Target CF has replication factor 2 in each
of the DCs.
{code}
ERROR [CompactionExecutor:26] 2014-03-06 10:18:45,760 CassandraDaemon.java
(line 196) Exception in thread Thread[CompactionExecutor:26,1,main]
java.lang.RuntimeException: Last written key DecoratedKey(-3718191715883699976,
36633732653439302d303730632d343139352d386461342d333736383265393965316335) =
current key DecoratedKey(-7629226534008815744,
62306334323161342d663662362d346364632d383965382d306563343832376639316536)
writing into /data/db/cassandra/data/Sync/sy/Sync-sy-tmp-jb-41-Data.db
at
