Hi - I am bumping into the following error frequently and causing the data loss whenever we shutdown the ignite node during data rebalance. I am shutting down the ignite in a safe mode i.e. Ignition.stop(false);
Here is the stack trace : Caused by: class org.apache.ignite.IgniteCheckedException: WAL tail reached in archive directory, WAL segment file is corrupted. at org.apache.ignite.internal.processors.cache.persistence.wal.AbstractWalRecordsIterator.validateTailReachedException(AbstractWalRecordsIterator.java:195) at org.apache.ignite.internal.processors.cache.persistence.wal.AbstractWalRecordsIterator.advance(AbstractWalRecordsIterator.java:172) at org.apache.ignite.internal.processors.cache.persistence.wal.AbstractWalRecordsIterator.onNext(AbstractWalRecordsIterator.java:123) at org.apache.ignite.internal.processors.cache.persistence.wal.AbstractWalRecordsIterator.onNext(AbstractWalRecordsIterator.java:52) at org.apache.ignite.internal.util.GridCloseableIteratorAdapter.nextX(GridCloseableIteratorAdapter.java:41) at org.apache.ignite.internal.processors.cache.persistence.GridCacheDatabaseSharedManager$RestoreStateContext.next(GridCacheDatabaseSharedManager.java:4900) at org.apache.ignite.internal.processors.cache.persistence.GridCacheDatabaseSharedManager$RestoreBinaryState.next(GridCacheDatabaseSharedManager.java:4977) at org.apache.ignite.internal.processors.cache.persistence.GridCacheDatabaseSharedManager.restoreMemory(GridCacheDatabaseSharedManager.java:2032) at org.apache.ignite.internal.processors.cache.persistence.GridCacheDatabaseSharedManager.readMetastore(GridCacheDatabaseSharedManager.java:665) at org.apache.ignite.internal.processors.cache.persistence.GridCacheDatabaseSharedManager.notifyMetaStorageSubscribersOnReadyForRead(GridCacheDatabaseSharedManager.java:4730) at org.apache.ignite.internal.IgniteKernal.start(IgniteKernal.java:1048) at org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance.start0(IgnitionEx.java:2038) at org.apache.ignite.internal.IgnitionEx$IgniteNamedInstance.start(IgnitionEx.java:1730) at org.apache.ignite.internal.IgnitionEx.start0(IgnitionEx.java:1158) at org.apache.ignite.internal.IgnitionEx.start(IgnitionEx.java:656) at org.apache.ignite.IgniteSpring.start(IgniteSpring.java:66) at org.apache.ignite.IgniteSpringBean.afterSingletonsInstantiated(IgniteSpringBean.java:172) Caused by: class org.apache.ignite.internal.processors.cache.persistence.wal.WalSegmentTailReachedException: WAL segment tail reached. [idx=39758, isWorkDir=false, serVer=org.apache.ignite.internal.processors.cache.persistence.wal.serializer.RecordV2Serializer@4525e9e8] at org.apache.ignite.internal.processors.cache.persistence.wal.AbstractWalRecordsIterator.advanceRecord(AbstractWalRecordsIterator.java:254) at org.apache.ignite.internal.processors.cache.persistence.wal.AbstractWalRecordsIterator.advance(AbstractWalRecordsIterator.java:154) ... 22 more Caused by: class org.apache.ignite.internal.processors.cache.persistence.wal.WalSegmentTailReachedException: WAL segment tail reached. [ Expected next state: {Index=39758,Offset=33460408}, Actual state : {Index=0,Offset=0} ] recordType=PAGE_RECORD at org.apache.ignite.internal.processors.cache.persistence.wal.serializer.RecordV2Serializer.readPositionAndCheckPoint(RecordV2Serializer.java:260) at org.apache.ignite.internal.processors.cache.persistence.wal.serializer.RecordV2Serializer.access$200(RecordV2Serializer.java:56) at org.apache.ignite.internal.processors.cache.persistence.wal.serializer.RecordV2Serializer$2.readWithHeaders(RecordV2Serializer.java:116) at org.apache.ignite.internal.processors.cache.persistence.wal.serializer.RecordV1Serializer.readWithCrc(RecordV1Serializer.java:372) at org.apache.ignite.internal.processors.cache.persistence.wal.serializer.RecordV2Serializer.readRecord(RecordV2Serializer.java:235) at org.apache.ignite.internal.processors.cache.persistence.wal.AbstractWalRecordsIterator.advanceRecord(AbstractWalRecordsIterator.java:243) Suppressed: class org.apache.ignite.internal.processors.cache.persistence.wal.crc.IgniteDataIntegrityViolationException: val: -500392315 writtenCrc: 0 at org.apache.ignite.internal.processors.cache.persistence.wal.io.FileInput$Crc32CheckingFileInput.close(FileInput.java:104) at org.apache.ignite.internal.processors.cache.persistence.wal.serializer.RecordV1Serializer.readWithCrc(RecordV1Serializer.java:379) ... 25 more Thanx and Regards, KR Kumar -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/