[ https://issues.apache.org/jira/browse/CASSANDRA-4733?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13912950#comment-13912950 ]
Viktor Kuzmin commented on CASSANDRA-4733: ------------------------------------------ We were using 1.2.15 version and upgraded to 2.0.5. We were not using -ea java option on 1.2.15, but we enabled it on 2.0.5. And now we have error and immediate cassandra crash after: at org.apache.cassandra.io.sstable.SSTableWriter.beforeAppend(SSTableWriter.java:142) at org.apache.cassandra.io.sstable.SSTableWriter.append(SSTableWriter.java:165) at org.apache.cassandra.db.compaction.CompactionTask.runWith(CompactionTask.java:160) at org.apache.cassandra.io.util.DiskAwareRunnable.runMayThrow(DiskAwareRunnable.java:48) at org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:28) at org.apache.cassandra.db.compaction.CompactionTask.executeInternal(CompactionTask.java:60) at org.apache.cassandra.db.compaction.AbstractCompactionTask.execute(AbstractCompactionTask.java:59) at org.apache.cassandra.db.compaction.CompactionManager$BackgroundCompactionTask.run(CompactionManager.java:197) at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:471) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:744) > Last written key >= current key exception when streaming > -------------------------------------------------------- > > Key: CASSANDRA-4733 > URL: https://issues.apache.org/jira/browse/CASSANDRA-4733 > Project: Cassandra > Issue Type: Bug > Components: Core > Affects Versions: 1.2.0 beta 1 > Reporter: Brandon Williams > Assignee: Yuki Morishita > Fix For: 1.2.0 beta 2 > > > {noformat} > ERROR 16:52:56,260 Exception in thread Thread[Streaming to > /10.179.111.137:1,5,main] > java.lang.RuntimeException: java.io.IOException: Connection reset by peer > at com.google.common.base.Throwables.propagate(Throwables.java:160) > at > org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:32) > at > java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886) > at > java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908) > at java.lang.Thread.run(Thread.java:662) > Caused by: java.io.IOException: Connection reset by peer > at sun.nio.ch.FileDispatcher.write0(Native Method) > at sun.nio.ch.SocketDispatcher.write(SocketDispatcher.java:29) > at sun.nio.ch.IOUtil.writeFromNativeBuffer(IOUtil.java:72) > at sun.nio.ch.IOUtil.write(IOUtil.java:43) > at sun.nio.ch.SocketChannelImpl.write(SocketChannelImpl.java:334) > at java.nio.channels.Channels.writeFullyImpl(Channels.java:59) > at java.nio.channels.Channels.writeFully(Channels.java:81) > at java.nio.channels.Channels.access$000(Channels.java:47) > at java.nio.channels.Channels$1.write(Channels.java:155) > at > com.ning.compress.lzf.ChunkEncoder.encodeAndWriteChunk(ChunkEncoder.java:133) > at > com.ning.compress.lzf.LZFOutputStream.writeCompressedBlock(LZFOutputStream.java:203) > at > com.ning.compress.lzf.LZFOutputStream.write(LZFOutputStream.java:97) > at > org.apache.cassandra.streaming.FileStreamTask.write(FileStreamTask.java:218) > at > org.apache.cassandra.streaming.FileStreamTask.stream(FileStreamTask.java:164) > at > org.apache.cassandra.streaming.FileStreamTask.runMayThrow(FileStreamTask.java:91) > at > org.apache.cassandra.utils.WrappedRunnable.run(WrappedRunnable.java:28) > ... 3 more > ERROR 16:53:03,951 Exception in thread Thread[Thread-11,5,main] > java.lang.RuntimeException: Last written key > DecoratedKey(113424593524874987650593774422007331058, 3036303936343535) >= > current key DecoratedKey(59229538317742990547810678738983628664, > 3036313133373139) writing into > /var/lib/cassandra/data/Keyspace1-Standard1-tmp-ia-95-Data.db > at > org.apache.cassandra.io.sstable.SSTableWriter.beforeAppend(SSTableWriter.java:132) > at > org.apache.cassandra.io.sstable.SSTableWriter.appendFromStream(SSTableWriter.java:208) > at > org.apache.cassandra.streaming.IncomingStreamReader.streamIn(IncomingStreamReader.java:164) > at > org.apache.cassandra.streaming.IncomingStreamReader.read(IncomingStreamReader.java:107) > at > org.apache.cassandra.net.IncomingTcpConnection.stream(IncomingTcpConnection.java:220) > at > org.apache.cassandra.net.IncomingTcpConnection.handleStream(IncomingTcpConnection.java:165) > at > org.apache.cassandra.net.IncomingTcpConnection.run(IncomingTcpConnection.java:65) > {noformat} > I didn't do anything fancy here, just inserted about 6M keys at rf=2, then > ran repair and got this. -- This message was sent by Atlassian JIRA (v6.1.5#6160)