[ https://issues.apache.org/jira/browse/IGNITE-15680?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Mirza Aliev updated IGNITE-15680: --------------------------------- Description: testChangePeersChaosWithSnapshot is started to fall with a timeout, in logs we can see: {noformat} [19:51:41]W: [org.apache.ignite:ignite-raft] 2021-10-04 19:51:41:503 +0300 [ERROR][%172.17.0.7:5010%JRaft-Common-Executor-0][LocalSnapshotCopier] Fail to start copy job [19:51:41]W: [org.apache.ignite:ignite-raft] java.nio.channels.ClosedByInterruptException [19:51:41]W: [org.apache.ignite:ignite-raft] at java.base/java.nio.channels.spi.AbstractInterruptibleChannel.end(AbstractInterruptibleChannel.java:199) [19:51:41]W: [org.apache.ignite:ignite-raft] at java.base/sun.nio.ch.FileChannelImpl.endBlocking(FileChannelImpl.java:162) [19:51:41]W: [org.apache.ignite:ignite-raft] at java.base/sun.nio.ch.FileChannelImpl.force(FileChannelImpl.java:465) [19:51:41]W: [org.apache.ignite:ignite-raft] at org.apache.ignite.raft.jraft.util.Utils.fsync(Utils.java:408) [19:51:41]W: [org.apache.ignite:ignite-raft] at org.apache.ignite.raft.jraft.storage.io.MessageFile.save(MessageFile.java:94) [19:51:41]W: [org.apache.ignite:ignite-raft] at org.apache.ignite.raft.jraft.storage.snapshot.local.LocalSnapshotMetaTable.saveToFile(LocalSnapshotMetaTable.java:133) [19:51:41]W: [org.apache.ignite:ignite-raft] at org.apache.ignite.raft.jraft.storage.snapshot.local.LocalSnapshotWriter.sync(LocalSnapshotWriter.java:103) [19:51:41]W: [org.apache.ignite:ignite-raft] at org.apache.ignite.raft.jraft.storage.snapshot.local.LocalSnapshotCopier.copyFile(LocalSnapshotCopier.java:197) [19:51:41]W: [org.apache.ignite:ignite-raft] at org.apache.ignite.raft.jraft.storage.snapshot.local.LocalSnapshotCopier.internalCopy(LocalSnapshotCopier.java:123) [19:51:41]W: [org.apache.ignite:ignite-raft] at org.apache.ignite.raft.jraft.storage.snapshot.local.LocalSnapshotCopier.startCopy(LocalSnapshotCopier.java:100) [19:51:41]W: [org.apache.ignite:ignite-raft] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) [19:51:41]W: [org.apache.ignite:ignite-raft] at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264) [19:51:41]W: [org.apache.ignite:ignite-raft] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) [19:51:41]W: [org.apache.ignite:ignite-raft] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) [19:51:41]W: [org.apache.ignite:ignite-raft] at java.base/java.lang.Thread.run(Thread.java:834) {noformat} Seems, that jraft snapshotting mechanism couldn't start to copy for some reason. After that There is a chance that the problem has appeared after this temporary solution https://issues.apache.org/jira/browse/IGNITE-15663 was: testChangePeersChaosWithSnapshot is started to fall with a timeout, in logs we can see: {noformat} [19:51:41]W: [org.apache.ignite:ignite-raft] 2021-10-04 19:51:41:503 +0300 [ERROR][%172.17.0.7:5010%JRaft-Common-Executor-0][LocalSnapshotCopier] Fail to start copy job [19:51:41]W: [org.apache.ignite:ignite-raft] java.nio.channels.ClosedByInterruptException [19:51:41]W: [org.apache.ignite:ignite-raft] at java.base/java.nio.channels.spi.AbstractInterruptibleChannel.end(AbstractInterruptibleChannel.java:199) [19:51:41]W: [org.apache.ignite:ignite-raft] at java.base/sun.nio.ch.FileChannelImpl.endBlocking(FileChannelImpl.java:162) [19:51:41]W: [org.apache.ignite:ignite-raft] at java.base/sun.nio.ch.FileChannelImpl.force(FileChannelImpl.java:465) [19:51:41]W: [org.apache.ignite:ignite-raft] at org.apache.ignite.raft.jraft.util.Utils.fsync(Utils.java:408) [19:51:41]W: [org.apache.ignite:ignite-raft] at org.apache.ignite.raft.jraft.storage.io.MessageFile.save(MessageFile.java:94) [19:51:41]W: [org.apache.ignite:ignite-raft] at org.apache.ignite.raft.jraft.storage.snapshot.local.LocalSnapshotMetaTable.saveToFile(LocalSnapshotMetaTable.java:133) [19:51:41]W: [org.apache.ignite:ignite-raft] at org.apache.ignite.raft.jraft.storage.snapshot.local.LocalSnapshotWriter.sync(LocalSnapshotWriter.java:103) [19:51:41]W: [org.apache.ignite:ignite-raft] at org.apache.ignite.raft.jraft.storage.snapshot.local.LocalSnapshotCopier.copyFile(LocalSnapshotCopier.java:197) [19:51:41]W: [org.apache.ignite:ignite-raft] at org.apache.ignite.raft.jraft.storage.snapshot.local.LocalSnapshotCopier.internalCopy(LocalSnapshotCopier.java:123) [19:51:41]W: [org.apache.ignite:ignite-raft] at org.apache.ignite.raft.jraft.storage.snapshot.local.LocalSnapshotCopier.startCopy(LocalSnapshotCopier.java:100) [19:51:41]W: [org.apache.ignite:ignite-raft] at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) [19:51:41]W: [org.apache.ignite:ignite-raft] at java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264) [19:51:41]W: [org.apache.ignite:ignite-raft] at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) [19:51:41]W: [org.apache.ignite:ignite-raft] at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) [19:51:41]W: [org.apache.ignite:ignite-raft] at java.base/java.lang.Thread.run(Thread.java:834) {noformat} Seems, that raft snapshotting mechanism couldn't start to copy for some reason. After that There is a chance that the problem has appeared after this temporary solution https://issues.apache.org/jira/browse/IGNITE-15663 > testChangePeersChaosWithSnapshot is flaky > ----------------------------------------- > > Key: IGNITE-15680 > URL: https://issues.apache.org/jira/browse/IGNITE-15680 > Project: Ignite > Issue Type: Improvement > Reporter: Mirza Aliev > Priority: Major > Labels: ignite-3 > Attachments: _Integration_Tests_Integration_Tests_3419.log.zip > > > testChangePeersChaosWithSnapshot is started to fall with a timeout, in logs > we can see: > {noformat} > [19:51:41]W: [org.apache.ignite:ignite-raft] 2021-10-04 > 19:51:41:503 +0300 > [ERROR][%172.17.0.7:5010%JRaft-Common-Executor-0][LocalSnapshotCopier] Fail > to start copy job > [19:51:41]W: [org.apache.ignite:ignite-raft] > java.nio.channels.ClosedByInterruptException > [19:51:41]W: [org.apache.ignite:ignite-raft] at > java.base/java.nio.channels.spi.AbstractInterruptibleChannel.end(AbstractInterruptibleChannel.java:199) > [19:51:41]W: [org.apache.ignite:ignite-raft] at > java.base/sun.nio.ch.FileChannelImpl.endBlocking(FileChannelImpl.java:162) > [19:51:41]W: [org.apache.ignite:ignite-raft] at > java.base/sun.nio.ch.FileChannelImpl.force(FileChannelImpl.java:465) > [19:51:41]W: [org.apache.ignite:ignite-raft] at > org.apache.ignite.raft.jraft.util.Utils.fsync(Utils.java:408) > [19:51:41]W: [org.apache.ignite:ignite-raft] at > org.apache.ignite.raft.jraft.storage.io.MessageFile.save(MessageFile.java:94) > [19:51:41]W: [org.apache.ignite:ignite-raft] at > org.apache.ignite.raft.jraft.storage.snapshot.local.LocalSnapshotMetaTable.saveToFile(LocalSnapshotMetaTable.java:133) > [19:51:41]W: [org.apache.ignite:ignite-raft] at > org.apache.ignite.raft.jraft.storage.snapshot.local.LocalSnapshotWriter.sync(LocalSnapshotWriter.java:103) > [19:51:41]W: [org.apache.ignite:ignite-raft] at > org.apache.ignite.raft.jraft.storage.snapshot.local.LocalSnapshotCopier.copyFile(LocalSnapshotCopier.java:197) > [19:51:41]W: [org.apache.ignite:ignite-raft] at > org.apache.ignite.raft.jraft.storage.snapshot.local.LocalSnapshotCopier.internalCopy(LocalSnapshotCopier.java:123) > [19:51:41]W: [org.apache.ignite:ignite-raft] at > org.apache.ignite.raft.jraft.storage.snapshot.local.LocalSnapshotCopier.startCopy(LocalSnapshotCopier.java:100) > [19:51:41]W: [org.apache.ignite:ignite-raft] at > java.base/java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:515) > [19:51:41]W: [org.apache.ignite:ignite-raft] at > java.base/java.util.concurrent.FutureTask.run(FutureTask.java:264) > [19:51:41]W: [org.apache.ignite:ignite-raft] at > java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1128) > [19:51:41]W: [org.apache.ignite:ignite-raft] at > java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:628) > [19:51:41]W: [org.apache.ignite:ignite-raft] at > java.base/java.lang.Thread.run(Thread.java:834) > {noformat} > Seems, that jraft snapshotting mechanism couldn't start to copy for some > reason. After that > > There is a chance that the problem has appeared after this temporary solution > https://issues.apache.org/jira/browse/IGNITE-15663 -- This message was sent by Atlassian Jira (v8.3.4#803005)