Hi team,
I am using using PersistentStore configuration for Apache Ignite. I started
2 servers 1 on PC1(local) and other one on a PC2(local) connected to the
same network. Both the servers got started and the topology also stated that
GridDiscoveryManager - Topology snapshot [ver=2, servers=2, clients=0,
CPUs=12, heap=0.25GB]
In came the client, which tried to activate the cluster by doing
ignite.active(true);
*Logs of PC2*
2017-08-29 15:19:43,191 INFO
[exchange-worker-#34%8b989fba-96d8-456f-9dac-8e3d1cb9b453%] {}
org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager
- Resolved write ahead log archive directory:
C:\garbage\ignite\0_0_0_0_0_0_0_1_127_0_0_1_144_203_209_28_47500
2017-08-29 15:19:43,196 INFO
[exchange-worker-#34%8b989fba-96d8-456f-9dac-8e3d1cb9b453%] {}
org.apache.ignite.internal.processors.cache.persistence.GridCacheDatabaseSharedManager
- Default checkpoint page buffer size is too small, setting to an adjusted
value: 2.0 GiB
2017-08-29 15:19:43,204 WARN
[exchange-worker-#34%8b989fba-96d8-456f-9dac-8e3d1cb9b453%] {}
org.apache.ignite.internal.processors.cache.persistence.GridCacheDatabaseSharedManager
- No user-defined default MemoryPolicy found; system default of 1GB size
will be used.
2017-08-29 15:19:43,209 INFO
[exchange-worker-#34%8b989fba-96d8-456f-9dac-8e3d1cb9b453%] {}
org.apache.ignite.internal.processors.cache.persistence.pagemem.PageMemoryImpl
- Started page memory [memoryAllocated=100.0 MiB, pages=48592, tableSize=2.9
MiB, checkpointBuffer=2.0 GiB]
2017-08-29 15:19:43,218 INFO
[exchange-worker-#34%8b989fba-96d8-456f-9dac-8e3d1cb9b453%] {}
org.apache.ignite.internal.processors.cache.persistence.pagemem.PageMemoryImpl
- Started page memory [memoryAllocated=1.0 GiB, pages=497616, tableSize=29.3
MiB, checkpointBuffer=2.0 GiB]
2017-08-29 15:19:43,240 INFO
[exchange-worker-#34%8b989fba-96d8-456f-9dac-8e3d1cb9b453%] {}
org.apache.ignite.internal.processors.cache.persistence.GridCacheDatabaseSharedManager
- Read checkpoint status: start marker = null, end marker = null
2017-08-29 15:19:43,241 INFO
[exchange-worker-#34%8b989fba-96d8-456f-9dac-8e3d1cb9b453%] {}
org.apache.ignite.internal.processors.cache.persistence.GridCacheDatabaseSharedManager
- Checking memory state [lastValidPos=FileWALPointer [idx=0, fileOffset=0,
len=0, forceFlush=false], lastMarked=FileWALPointer [idx=0, fileOffset=0,
len=0, forceFlush=false],
lastCheckpointId=00000000-0000-0000-0000-000000000000]
2017-08-29 15:19:43,314 ERROR
[exchange-worker-#34%8b989fba-96d8-456f-9dac-8e3d1cb9b453%] {}
org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionsExchangeFuture
- Failed to activate node components
[nodeId=77dbb8f3-076a-467a-bb4c-55b7269b029c, client=false,
topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1]]
java.lang.NullPointerException
at
org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager$FileArchiver.releaseWorkSegment(FileWriteAheadLogManager.java:1313)
at
org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager$FileArchiver.access$6300(FileWriteAheadLogManager.java:1070)
at
org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager$RecordsIterator.releaseWorkSegment(FileWriteAheadLogManager.java:2484)
at
org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager$RecordsIterator.advanceSegment(FileWriteAheadLogManager.java:2464)
at
org.apache.ignite.internal.processors.cache.persistence.wal.AbstractWalRecordsIterator.advance(AbstractWalRecordsIterator.java:149)
at
org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager$RecordsIterator.<init>(FileWriteAheadLogManager.java:2352)
at
org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager$RecordsIterator.<init>(FileWriteAheadLogManager.java:2290)
at
org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.replay(FileWriteAheadLogManager.java:553)
at
org.apache.ignite.internal.processors.cache.persistence.GridCacheDatabaseSharedManager.restoreMemory(GridCacheDatabaseSharedManager.java:1314)
at
org.apache.ignite.internal.processors.cache.persistence.GridCacheDatabaseSharedManager.readCheckpointAndRestoreMemory(GridCacheDatabaseSharedManager.java:530)
at
org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionsExchangeFuture.onClusterStateChangeRequest(GridDhtPartitionsExchangeFuture.java:770)
at
org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionsExchangeFuture.init(GridDhtPartitionsExchangeFuture.java:574)
at
org.apache.ignite.internal.processors.cache.GridCachePartitionExchangeManager$ExchangeWorker.body(GridCachePartitionExchangeManager.java:1901)
at
org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
at java.lang.Thread.run(Thread.java:745)
2017-08-29 15:19:43,336 INFO
[exchange-worker-#34%8b989fba-96d8-456f-9dac-8e3d1cb9b453%] {}
org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionsExchangeFuture
- Finished waiting for partition release future
[topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], waitTime=0ms]
2017-08-29 15:19:43,338 INFO
[exchange-worker-#34%8b989fba-96d8-456f-9dac-8e3d1cb9b453%] {}
org.apache.ignite.internal.processors.cache.persistence.GridCacheDatabaseSharedManager
- Read checkpoint status: start marker = null, end marker = null
2017-08-29 15:19:43,338 INFO
[exchange-worker-#34%8b989fba-96d8-456f-9dac-8e3d1cb9b453%] {}
org.apache.ignite.internal.processors.cache.persistence.GridCacheDatabaseSharedManager
- Applying lost cache updates since last checkpoint record
[lastMarked=FileWALPointer [idx=0, fileOffset=0, len=0, forceFlush=false],
lastCheckpointId=00000000-0000-0000-0000-000000000000]
2017-08-29 15:19:43,408 ERROR
[exchange-worker-#34%8b989fba-96d8-456f-9dac-8e3d1cb9b453%] {}
org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionsExchangeFuture
- Failed to reinitialize local partitions (preloading will be stopped):
GridDhtPartitionExchangeId [topVer=AffinityTopologyVersion [topVer=3,
minorTopVer=1], nodeId=fb4451e4, evt=DISCOVERY_CUSTOM_EVT]
java.lang.NullPointerException
at
org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager$FileArchiver.releaseWorkSegment(FileWriteAheadLogManager.java:1313)
at
org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager$FileArchiver.access$6300(FileWriteAheadLogManager.java:1070)
at
org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager$RecordsIterator.releaseWorkSegment(FileWriteAheadLogManager.java:2484)
at
org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager$RecordsIterator.advanceSegment(FileWriteAheadLogManager.java:2464)
at
org.apache.ignite.internal.processors.cache.persistence.wal.AbstractWalRecordsIterator.advance(AbstractWalRecordsIterator.java:149)
at
org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager$RecordsIterator.<init>(FileWriteAheadLogManager.java:2352)
at
org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager$RecordsIterator.<init>(FileWriteAheadLogManager.java:2290)
at
org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.replay(FileWriteAheadLogManager.java:553)
at
org.apache.ignite.internal.processors.cache.persistence.GridCacheDatabaseSharedManager.applyLastUpdates(GridCacheDatabaseSharedManager.java:1475)
at
org.apache.ignite.internal.processors.cache.persistence.GridCacheDatabaseSharedManager.restoreState(GridCacheDatabaseSharedManager.java:929)
at
org.apache.ignite.internal.processors.cache.persistence.GridCacheDatabaseSharedManager.beforeExchange(GridCacheDatabaseSharedManager.java:733)
at
org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionsExchangeFuture.distributedExchange(GridDhtPartitionsExchangeFuture.java:994)
at
org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionsExchangeFuture.init(GridDhtPartitionsExchangeFuture.java:632)
at
org.apache.ignite.internal.processors.cache.GridCachePartitionExchangeManager$ExchangeWorker.body(GridCachePartitionExchangeManager.java:1901)
at
org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
at java.lang.Thread.run(Thread.java:745)
2017-08-29 15:19:43,411 INFO
[exchange-worker-#34%8b989fba-96d8-456f-9dac-8e3d1cb9b453%] {}
org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionsExchangeFuture
- Snapshot initialization completed [topVer=AffinityTopologyVersion
[topVer=3, minorTopVer=1], time=0ms]
2017-08-29 15:19:43,414 ERROR
[exchange-worker-#34%8b989fba-96d8-456f-9dac-8e3d1cb9b453%] {}
org.apache.ignite.internal.processors.cache.GridCachePartitionExchangeManager
- Failed to wait for completion of partition map exchange (preloading will
not start): GridDhtPartitionsExchangeFuture [dummy=false,
forcePreload=false, reassign=false, discoEvt=DiscoveryCustomEvent
[customMsg=null, affTopVer=AffinityTopologyVersion [topVer=3,
minorTopVer=1], super=DiscoveryEvent [evtNode=TcpDiscoveryNode
[id=fb4451e4-6e56-424d-968f-639e01a7c40b, addrs=[0:0:0:0:0:0:0:1, 127.0.0.1,
144.203.209.80], sockAddrs=[MUUWDP481.int.msci.com/144.203.209.80:47500,
/0:0:0:0:0:0:0:1:47500, /127.0.0.1:47500], discPort=47500, order=1,
intOrder=1, lastExchangeTime=1503999848115, loc=false,
ver=2.1.0#20170720-sha1:a6ca5c8a, isClient=false], topVer=3,
nodeId8=77dbb8f3, msg=null, type=DISCOVERY_CUSTOM_EVT,
tstamp=1504000183177]], crd=TcpDiscoveryNode
[id=fb4451e4-6e56-424d-968f-639e01a7c40b, addrs=[0:0:0:0:0:0:0:1, 127.0.0.1,
144.203.209.80], sockAddrs=[MUUWDP481.int.msci.com/144.203.209.80:47500,
/0:0:0:0:0:0:0:1:47500, /127.0.0.1:47500], discPort=47500, order=1,
intOrder=1, lastExchangeTime=1503999848115, loc=false,
ver=2.1.0#20170720-sha1:a6ca5c8a, isClient=false],
exchId=GridDhtPartitionExchangeId [topVer=AffinityTopologyVersion [topVer=3,
minorTopVer=1], nodeId=fb4451e4, evt=DISCOVERY_CUSTOM_EVT], added=true,
initFut=GridFutureAdapter [ignoreInterrupts=false, state=DONE, res=false,
hash=433779024], init=false, lastVer=null, partReleaseFut=GridCompoundFuture
[rdc=null, initFlag=1, lsnrCalls=4, done=true, cancelled=false, err=null,
futs=[true, true, true, true]], exchActions=null, affChangeMsg=null,
skipPreload=false, clientOnlyExchange=false, initTs=1504000183177,
centralizedAff=false, changeGlobalStateE=java.lang.NullPointerException,
forcedRebFut=null, done=true, evtLatch=0,
remaining=[fb4451e4-6e56-424d-968f-639e01a7c40b], super=GridFutureAdapter
[ignoreInterrupts=false, state=DONE, res=java.lang.NullPointerException,
hash=1275074362]] class org.apache.ignite.IgniteCheckedException: null
at
org.apache.ignite.internal.util.IgniteUtils.cast(IgniteUtils.java:7229)
at
org.apache.ignite.internal.util.future.GridFutureAdapter.resolve(GridFutureAdapter.java:258)
at
org.apache.ignite.internal.util.future.GridFutureAdapter.get0(GridFutureAdapter.java:206)
at
org.apache.ignite.internal.util.future.GridFutureAdapter.get(GridFutureAdapter.java:158)
at
org.apache.ignite.internal.processors.cache.GridCachePartitionExchangeManager$ExchangeWorker.body(GridCachePartitionExchangeManager.java:1911)
at
org.apache.ignite.internal.util.worker.GridWorker.run(GridWorker.java:110)
at java.lang.Thread.run(Thread.java:745)
Caused by: java.lang.NullPointerException
at
org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager$FileArchiver.releaseWorkSegment(FileWriteAheadLogManager.java:1313)
at
org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager$FileArchiver.access$6300(FileWriteAheadLogManager.java:1070)
at
org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager$RecordsIterator.releaseWorkSegment(FileWriteAheadLogManager.java:2484)
at
org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager$RecordsIterator.advanceSegment(FileWriteAheadLogManager.java:2464)
at
org.apache.ignite.internal.processors.cache.persistence.wal.AbstractWalRecordsIterator.advance(AbstractWalRecordsIterator.java:149)
at
org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager$RecordsIterator.<init>(FileWriteAheadLogManager.java:2352)
at
org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager$RecordsIterator.<init>(FileWriteAheadLogManager.java:2290)
at
org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager.replay(FileWriteAheadLogManager.java:553)
at
org.apache.ignite.internal.processors.cache.persistence.GridCacheDatabaseSharedManager.applyLastUpdates(GridCacheDatabaseSharedManager.java:1475)
at
org.apache.ignite.internal.processors.cache.persistence.GridCacheDatabaseSharedManager.restoreState(GridCacheDatabaseSharedManager.java:929)
at
org.apache.ignite.internal.processors.cache.persistence.GridCacheDatabaseSharedManager.beforeExchange(GridCacheDatabaseSharedManager.java:733)
at
org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionsExchangeFuture.distributedExchange(GridDhtPartitionsExchangeFuture.java:994)
at
org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionsExchangeFuture.init(GridDhtPartitionsExchangeFuture.java:632)
at
org.apache.ignite.internal.processors.cache.GridCachePartitionExchangeManager$ExchangeWorker.body(GridCachePartitionExchangeManager.java:1901)
What could be the reason for this Exception ?
*Logs of PC1*
2017-08-29 15:19:34,788 INFO
[disco-event-worker-#33%5d63c57f-77b4-443c-a014-d1c8e7b04923%] {}
org.apache.ignite.internal.managers.discovery.GridDiscoveryManager -
Topology snapshot [ver=3, servers=2, clients=1, CPUs=12, heap=19.0GB]
2017-08-29 15:19:42,167 INFO
[grid-nio-worker-tcp-comm-0-#17%5d63c57f-77b4-443c-a014-d1c8e7b04923%] {}
org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi - Accepted
incoming communication connection [locAddr=/0:0:0:0:0:0:0:1:47100,
rmtAddr=/0:0:0:0:0:0:0:1:60635]
2017-08-29 15:19:42,214 INFO
[tcp-disco-msg-worker-#3%5d63c57f-77b4-443c-a014-d1c8e7b04923%] {}
org.apache.ignite.internal.processors.cluster.GridClusterStateProcessor -
Start state transition: true
2017-08-29 15:19:42,222 INFO
[exchange-worker-#34%5d63c57f-77b4-443c-a014-d1c8e7b04923%] {}
org.apache.ignite.internal.exchange.time - Started exchange init
[topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], crd=true, evt=18,
node=TcpDiscoveryNode [id=fb4451e4-6e56-424d-968f-639e01a7c40b,
addrs=[0:0:0:0:0:0:0:1, 127.0.0.1, 144.203.209.80],
sockAddrs=[MUUWDP481.int.msci.com/144.203.209.80:47500,
/0:0:0:0:0:0:0:1:47500, /127.0.0.1:47500], discPort=47500, order=1,
intOrder=1, lastExchangeTime=1504000182212, loc=true,
ver=2.1.0#20170720-sha1:a6ca5c8a, isClient=false], evtNode=TcpDiscoveryNode
[id=fb4451e4-6e56-424d-968f-639e01a7c40b, addrs=[0:0:0:0:0:0:0:1, 127.0.0.1,
144.203.209.80], sockAddrs=[MUUWDP481.int.msci.com/144.203.209.80:47500,
/0:0:0:0:0:0:0:1:47500, /127.0.0.1:47500], discPort=47500, order=1,
intOrder=1, lastExchangeTime=1504000182212, loc=true,
ver=2.1.0#20170720-sha1:a6ca5c8a, isClient=false],
customEvt=ChangeGlobalStateMessage
[id=c96cf5d2e51-5a1af20a-b6d8-43c3-971d-9e4f71ddb5cb,
reqId=bb3f5aa7-5884-4e54-96c2-23f132125ef0,
initiatingNodeId=fb4451e4-6e56-424d-968f-639e01a7c40b, activate=true]]
2017-08-29 15:19:42,222 INFO
[exchange-worker-#34%5d63c57f-77b4-443c-a014-d1c8e7b04923%] {}
org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionsExchangeFuture
- Start activation process [nodeId=fb4451e4-6e56-424d-968f-639e01a7c40b,
client=false, topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1]]
2017-08-29 15:19:42,226 INFO
[exchange-worker-#34%5d63c57f-77b4-443c-a014-d1c8e7b04923%] {}
org.apache.ignite.internal.processors.cache.persistence.file.FilePageStoreManager
- Resolved page store work directory:
C:\Data\IPD\PersistentStore\0_0_0_0_0_0_0_1_127_0_0_1_144_203_209_80_47500
2017-08-29 15:19:42,226 INFO
[exchange-worker-#34%5d63c57f-77b4-443c-a014-d1c8e7b04923%] {}
org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager
- Resolved write ahead log work directory:
C:\Data\IPD\WAL\0_0_0_0_0_0_0_1_127_0_0_1_144_203_209_80_47500
2017-08-29 15:19:42,226 INFO
[exchange-worker-#34%5d63c57f-77b4-443c-a014-d1c8e7b04923%] {}
org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager
- Resolved write ahead log archive directory:
C:\Data\IPD\WAL\archive\0_0_0_0_0_0_0_1_127_0_0_1_144_203_209_80_47500
2017-08-29 15:19:42,231 INFO
[exchange-worker-#34%5d63c57f-77b4-443c-a014-d1c8e7b04923%] {}
org.apache.ignite.internal.processors.cache.persistence.GridCacheDatabaseSharedManager
- Default checkpoint page buffer size is too small, setting to an adjusted
value: 2.0 GiB
2017-08-29 15:19:42,241 WARN
[exchange-worker-#34%5d63c57f-77b4-443c-a014-d1c8e7b04923%] {}
org.apache.ignite.internal.processors.cache.persistence.GridCacheDatabaseSharedManager
- No user-defined default MemoryPolicy found; system default of 1GB size
will be used.
2017-08-29 15:19:42,247 INFO
[exchange-worker-#34%5d63c57f-77b4-443c-a014-d1c8e7b04923%] {}
org.apache.ignite.internal.processors.cache.persistence.pagemem.PageMemoryImpl
- Started page memory [memoryAllocated=100.0 MiB, pages=48592, tableSize=2.9
MiB, checkpointBuffer=2.0 GiB]
2017-08-29 15:19:42,261 INFO
[exchange-worker-#34%5d63c57f-77b4-443c-a014-d1c8e7b04923%] {}
org.apache.ignite.internal.processors.cache.persistence.pagemem.PageMemoryImpl
- Started page memory [memoryAllocated=1.0 GiB, pages=497616, tableSize=29.3
MiB, checkpointBuffer=2.0 GiB]
2017-08-29 15:19:42,286 INFO
[exchange-worker-#34%5d63c57f-77b4-443c-a014-d1c8e7b04923%] {}
org.apache.ignite.internal.processors.cache.persistence.GridCacheDatabaseSharedManager
- Read checkpoint status: start marker =
C:\Data\IPD\PersistentStore\0_0_0_0_0_0_0_1_127_0_0_1_144_203_209_80_47500\cp\1503998675594-22f1e1e6-f12e-41f6-8d07-922e5713dea9-START.bin,
end marker =
C:\Data\IPD\PersistentStore\0_0_0_0_0_0_0_1_127_0_0_1_144_203_209_80_47500\cp\1503998675594-22f1e1e6-f12e-41f6-8d07-922e5713dea9-END.bin
2017-08-29 15:19:42,286 INFO
[exchange-worker-#34%5d63c57f-77b4-443c-a014-d1c8e7b04923%] {}
org.apache.ignite.internal.processors.cache.persistence.GridCacheDatabaseSharedManager
- Checking memory state [lastValidPos=FileWALPointer [idx=0,
fileOffset=2209017, len=20287, forceFlush=false], lastMarked=FileWALPointer
[idx=0, fileOffset=2209017, len=20287, forceFlush=false],
lastCheckpointId=22f1e1e6-f12e-41f6-8d07-922e5713dea9]
2017-08-29 15:19:42,455 INFO
[exchange-worker-#34%5d63c57f-77b4-443c-a014-d1c8e7b04923%] {}
org.apache.ignite.internal.processors.cache.persistence.GridCacheDatabaseSharedManager
- Found last checkpoint marker [cpId=22f1e1e6-f12e-41f6-8d07-922e5713dea9,
pos=FileWALPointer [idx=0, fileOffset=2209017, len=20287, forceFlush=false]]
2017-08-29 15:19:42,463 INFO
[exchange-worker-#34%5d63c57f-77b4-443c-a014-d1c8e7b04923%] {}
org.apache.ignite.internal.processors.cache.persistence.wal.FileWriteAheadLogManager
- Resuming logging to WAL segment
[file=C:\Data\IPD\WAL\0_0_0_0_0_0_0_1_127_0_0_1_144_203_209_80_47500\0000000000000000.wal,
offset=2229304, ver=1]
2017-08-29 15:19:42,703 INFO
[exchange-worker-#34%5d63c57f-77b4-443c-a014-d1c8e7b04923%] {}
org.apache.ignite.internal.processors.cache.GridCacheProcessor - Started
cache [name=1000-LIVE-0, memoryPolicyName=default, mode=REPLICATED,
atomicity=ATOMIC]
2017-08-29 15:19:42,723 INFO
[exchange-worker-#34%5d63c57f-77b4-443c-a014-d1c8e7b04923%] {}
org.apache.ignite.internal.processors.cache.GridCacheProcessor - Started
cache [name=ignite-sys-cache, memoryPolicyName=sysMemPlc, mode=REPLICATED,
atomicity=TRANSACTIONAL]
2017-08-29 15:19:42,727 INFO
[exchange-worker-#34%5d63c57f-77b4-443c-a014-d1c8e7b04923%] {}
org.apache.ignite.internal.processors.cache.GridCacheProcessor - Started
cache [name=8574-LOCKED-5, memoryPolicyName=default, mode=REPLICATED,
atomicity=ATOMIC]
2017-08-29 15:19:42,734 INFO
[exchange-worker-#34%5d63c57f-77b4-443c-a014-d1c8e7b04923%] {}
org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionsExchangeFuture
- Successfully activated caches
[nodeId=fb4451e4-6e56-424d-968f-639e01a7c40b, client=false,
topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1]]
2017-08-29 15:19:42,736 INFO
[exchange-worker-#34%5d63c57f-77b4-443c-a014-d1c8e7b04923%] {}
org.apache.ignite.internal.processors.cache.distributed.dht.preloader.GridDhtPartitionsExchangeFuture
- Finished waiting for partition release future
[topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], waitTime=0ms]
2017-08-29 15:19:42,834 INFO
[exchange-worker-#34%5d63c57f-77b4-443c-a014-d1c8e7b04923%] {}
org.apache.ignite.internal.processors.cache.persistence.GridCacheDatabaseSharedManager
- Read checkpoint status: start marker =
C:\Data\IPD\PersistentStore\0_0_0_0_0_0_0_1_127_0_0_1_144_203_209_80_47500\cp\1503998675594-22f1e1e6-f12e-41f6-8d07-922e5713dea9-START.bin,
end marker =
C:\Data\IPD\PersistentStore\0_0_0_0_0_0_0_1_127_0_0_1_144_203_209_80_47500\cp\1503998675594-22f1e1e6-f12e-41f6-8d07-922e5713dea9-END.bin
2017-08-29 15:19:42,834 INFO
[exchange-worker-#34%5d63c57f-77b4-443c-a014-d1c8e7b04923%] {}
org.apache.ignite.internal.processors.cache.persistence.GridCacheDatabaseSharedManager
- Applying lost cache updates since last checkpoint record
[lastMarked=FileWALPointer [idx=0, fileOffset=2209017, len=20287,
forceFlush=false], lastCheckpointId=22f1e1e6-f12e-41f6-8d07-922e5713dea9]
2017-08-29 15:19:43,020 INFO
[exchange-worker-#34%5d63c57f-77b4-443c-a014-d1c8e7b04923%] {}
org.apache.ignite.internal.processors.cache.persistence.GridCacheDatabaseSharedManager
- Finished applying WAL changes [updatesApplied=0, time=182ms]
2017-08-29 15:19:43,022 INFO
[exchange-worker-#34%5d63c57f-77b4-443c-a014-d1c8e7b04923%] {}
org.apache.ignite.internal.exchange.time - Finished exchange init
[topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], crd=true]
2017-08-29 15:19:53,023 WARN
[exchange-worker-#34%5d63c57f-77b4-443c-a014-d1c8e7b04923%] {}
org.apache.ignite.internal.diagnostic - Failed to wait for partition map
exchange [topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1],
node=fb4451e4-6e56-424d-968f-639e01a7c40b]. Dumping pending objects that
might be the cause:
2017-08-29 15:19:53,023 WARN
[exchange-worker-#34%5d63c57f-77b4-443c-a014-d1c8e7b04923%] {}
org.apache.ignite.internal.diagnostic - Ready affinity version:
AffinityTopologyVersion [topVer=-1, minorTopVer=0]
2017-08-29 15:19:53,024 WARN
[exchange-worker-#34%5d63c57f-77b4-443c-a014-d1c8e7b04923%] {}
org.apache.ignite.internal.diagnostic - Last exchange future:
GridDhtPartitionsExchangeFuture [dummy=false, forcePreload=false,
reassign=false, discoEvt=DiscoveryCustomEvent
[customMsg=ChangeGlobalStateMessage
[id=c96cf5d2e51-5a1af20a-b6d8-43c3-971d-9e4f71ddb5cb,
reqId=bb3f5aa7-5884-4e54-96c2-23f132125ef0,
initiatingNodeId=fb4451e4-6e56-424d-968f-639e01a7c40b, activate=true],
affTopVer=AffinityTopologyVersion [topVer=3, minorTopVer=1],
super=DiscoveryEvent [evtNode=TcpDiscoveryNode
[id=fb4451e4-6e56-424d-968f-639e01a7c40b, addrs=[0:0:0:0:0:0:0:1, 127.0.0.1,
144.203.209.80], sockAddrs=[MUUWDP481.int.msci.com/144.203.209.80:47500,
/0:0:0:0:0:0:0:1:47500, /127.0.0.1:47500], discPort=47500, order=1,
intOrder=1, lastExchangeTime=1504000192724, loc=true,
ver=2.1.0#20170720-sha1:a6ca5c8a, isClient=false], topVer=3,
nodeId8=fb4451e4, msg=null, type=DISCOVERY_CUSTOM_EVT,
tstamp=1504000182212]], crd=TcpDiscoveryNode
[id=fb4451e4-6e56-424d-968f-639e01a7c40b, addrs=[0:0:0:0:0:0:0:1, 127.0.0.1,
144.203.209.80], sockAddrs=[MUUWDP481.int.msci.com/144.203.209.80:47500,
/0:0:0:0:0:0:0:1:47500, /127.0.0.1:47500], discPort=47500, order=1,
intOrder=1, lastExchangeTime=1504000192724, loc=true,
ver=2.1.0#20170720-sha1:a6ca5c8a, isClient=false],
exchId=GridDhtPartitionExchangeId [topVer=AffinityTopologyVersion [topVer=3,
minorTopVer=1], nodeId=fb4451e4, evt=DISCOVERY_CUSTOM_EVT], added=true,
initFut=GridFutureAdapter [ignoreInterrupts=false, state=DONE, res=true,
hash=1096257158], init=true, lastVer=null, partReleaseFut=GridCompoundFuture
[rdc=null, initFlag=1, lsnrCalls=4, done=true, cancelled=false, err=null,
futs=[true, true, true, true]], exchActions=ExchangeActions
[startCaches=[1000-LIVE-0, ignite-sys-cache, 8574-LOCKED-5],
stopCaches=null, startGrps=[ignite-sys-cache, 1000-LIVE-0, 8574-LOCKED-5],
stopGrps=[], resetParts=null, stateChangeRequest=StateChangeRequest
[msg=ChangeGlobalStateMessage
[id=c96cf5d2e51-5a1af20a-b6d8-43c3-971d-9e4f71ddb5cb,
reqId=bb3f5aa7-5884-4e54-96c2-23f132125ef0,
initiatingNodeId=fb4451e4-6e56-424d-968f-639e01a7c40b, activate=true],
topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1]]],
affChangeMsg=null, skipPreload=false, clientOnlyExchange=false,
initTs=1504000182212, centralizedAff=false, changeGlobalStateE=null,
forcedRebFut=null, done=false, evtLatch=0,
remaining=[77dbb8f3-076a-467a-bb4c-55b7269b029c], super=GridFutureAdapter
[ignoreInterrupts=false, state=INIT, res=null, hash=1393022510]]
2017-08-29 15:19:53,024 WARN
[exchange-worker-#34%5d63c57f-77b4-443c-a014-d1c8e7b04923%] {}
org.apache.ignite.internal.processors.cache.GridCachePartitionExchangeManager
- First 10 pending exchange futures [total=0]
2017-08-29 15:19:53,024 WARN
[exchange-worker-#34%5d63c57f-77b4-443c-a014-d1c8e7b04923%] {}
org.apache.ignite.internal.diagnostic - Last 10 exchange futures (total: 1):
2017-08-29 15:19:53,025 WARN
[exchange-worker-#34%5d63c57f-77b4-443c-a014-d1c8e7b04923%] {}
org.apache.ignite.internal.diagnostic - >>> GridDhtPartitionsExchangeFuture
[topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1], evt=18,
evtNode=TcpDiscoveryNode [id=fb4451e4-6e56-424d-968f-639e01a7c40b,
addrs=[0:0:0:0:0:0:0:1, 127.0.0.1, 144.203.209.80],
sockAddrs=[MUUWDP481.int.msci.com/144.203.209.80:47500,
/0:0:0:0:0:0:0:1:47500, /127.0.0.1:47500], discPort=47500, order=1,
intOrder=1, lastExchangeTime=1504000192724, loc=true,
ver=2.1.0#20170720-sha1:a6ca5c8a, isClient=false], done=false]
2017-08-29 15:19:53,025 WARN
[exchange-worker-#34%5d63c57f-77b4-443c-a014-d1c8e7b04923%] {}
org.apache.ignite.internal.diagnostic - Pending transactions:
2017-08-29 15:19:53,025 WARN
[exchange-worker-#34%5d63c57f-77b4-443c-a014-d1c8e7b04923%] {}
org.apache.ignite.internal.diagnostic - Pending explicit locks:
2017-08-29 15:19:53,025 WARN
[exchange-worker-#34%5d63c57f-77b4-443c-a014-d1c8e7b04923%] {}
org.apache.ignite.internal.diagnostic - Pending cache futures:
2017-08-29 15:19:53,025 WARN
[exchange-worker-#34%5d63c57f-77b4-443c-a014-d1c8e7b04923%] {}
org.apache.ignite.internal.diagnostic - Pending atomic cache futures:
2017-08-29 15:19:53,025 WARN
[exchange-worker-#34%5d63c57f-77b4-443c-a014-d1c8e7b04923%] {}
org.apache.ignite.internal.diagnostic - Pending data streamer futures:
2017-08-29 15:19:53,025 WARN
[exchange-worker-#34%5d63c57f-77b4-443c-a014-d1c8e7b04923%] {}
org.apache.ignite.internal.diagnostic - Pending transaction deadlock
detection futures:
2017-08-29 15:19:54,055 INFO
[grid-nio-worker-tcp-comm-1-#18%5d63c57f-77b4-443c-a014-d1c8e7b04923%] {}
org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi - Established
outgoing communication connection [locAddr=/144.203.209.80:60639,
rmtAddr=MUUWDP513.int.msci.com/144.203.209.28:47100]
2017-08-29 15:19:54,074 INFO [sys-#67%5d63c57f-77b4-443c-a014-d1c8e7b04923%]
{} org.apache.ignite.internal.diagnostic - Exchange future on coordinator
waiting for server response [node=77dbb8f3-076a-467a-bb4c-55b7269b029c,
topVer=AffinityTopologyVersion [topVer=3, minorTopVer=1]]
Remote node information:
General node info [id=77dbb8f3-076a-467a-bb4c-55b7269b029c, client=false,
discoTopVer=AffinityTopologyVersion [topVer=3, minorTopVer=1],
time=15:19:55.029]
Partitions exchange info [readyVer=AffinityTopologyVersion [topVer=-1,
minorTopVer=0]]
Last initialized exchange future: GridDhtPartitionsExchangeFuture
[dummy=false, forcePreload=false, reassign=false,
discoEvt=DiscoveryCustomEvent [customMsg=null,
affTopVer=AffinityTopologyVersion [topVer=3, minorTopVer=1],
super=DiscoveryEvent [evtNode=TcpDiscoveryNode
[id=fb4451e4-6e56-424d-968f-639e01a7c40b, addrs=[0:0:0:0:0:0:0:1, 127.0.0.1,
144.203.209.80], sockAddrs=[MUUWDP481.int.msci.com/144.203.209.80:47500,
/0:0:0:0:0:0:0:1:47500, /127.0.0.1:47500], discPort=47500, order=1,
intOrder=1, lastExchangeTime=1503999848115, loc=false,
ver=2.1.0#20170720-sha1:a6ca5c8a, isClient=false], topVer=3,
nodeId8=77dbb8f3, msg=null, type=DISCOVERY_CUSTOM_EVT,
tstamp=1504000183177]], crd=TcpDiscoveryNode
[id=fb4451e4-6e56-424d-968f-639e01a7c40b, addrs=[0:0:0:0:0:0:0:1, 127.0.0.1,
144.203.209.80], sockAddrs=[MUUWDP481.int.msci.com/144.203.209.80:47500,
/0:0:0:0:0:0:0:1:47500, /127.0.0.1:47500], discPort=47500, order=1,
intOrder=1, lastExchangeTime=1503999848115, loc=false,
ver=2.1.0#20170720-sha1:a6ca5c8a, isClient=false],
exchId=GridDhtPartitionExchangeId [topVer=AffinityTopologyVersion [topVer=3,
minorTopVer=1], nodeId=fb4451e4, evt=DISCOVERY_CUSTOM_EVT], added=true,
initFut=GridFutureAdapter [ignoreInterrupts=false, state=DONE, res=false,
hash=433779024], init=false, lastVer=null, partReleaseFut=GridCompoundFuture
[rdc=null, initFlag=1, lsnrCalls=4, done=true, cancelled=false, err=null,
futs=[true, true, true, true]], exchActions=null, affChangeMsg=null,
skipPreload=false, clientOnlyExchange=false, initTs=1504000183177,
centralizedAff=false, changeGlobalStateE=java.lang.NullPointerException,
forcedRebFut=null, done=true, evtLatch=0,
remaining=[fb4451e4-6e56-424d-968f-639e01a7c40b], super=GridFutureAdapter
[ignoreInterrupts=false, state=DONE, res=java.lang.NullPointerException,
hash=1275074362]]
Communication SPI statistics [rmtNode=fb4451e4-6e56-424d-968f-639e01a7c40b]
Communication SPI recovery descriptors:
[key=ConnectionKey [nodeId=fb4451e4-6e56-424d-968f-639e01a7c40b, idx=0,
connCnt=0], msgsSent=0, msgsAckedByRmt=0, msgsRcvd=1, lastAcked=0,
reserveCnt=1, descIdHash=450968442]
Communication SPI clients:
[node=fb4451e4-6e56-424d-968f-639e01a7c40b,
client=GridTcpNioCommunicationClient [ses=GridSelectorNioSessionImpl
[worker=DirectNioClientWorker [super=AbstractNioClientWorker [idx=0,
bytesRcvd=895, bytesSent=28, bytesRcvd0=895, bytesSent0=28, select=true,
super=GridWorker [name=grid-nio-worker-tcp-comm-0,
igniteInstanceName=8b989fba-96d8-456f-9dac-8e3d1cb9b453, finished=false,
hashCode=1376146757, interrupted=false,
runner=grid-nio-worker-tcp-comm-0-#17%8b989fba-96d8-456f-9dac-8e3d1cb9b453%]]],
writeBuf=java.nio.DirectByteBuffer[pos=0 lim=32768 cap=32768],
readBuf=java.nio.DirectByteBuffer[pos=0 lim=32768 cap=32768],
inRecovery=GridNioRecoveryDescriptor [acked=0, resendCnt=0, rcvCnt=1,
sentCnt=0, reserved=true, lastAck=0, nodeLeft=false, node=TcpDiscoveryNode
[id=fb4451e4-6e56-424d-968f-639e01a7c40b, addrs=[0:0:0:0:0:0:0:1, 127.0.0.1,
144.203.209.80], sockAddrs=[MUUWDP481.int.msci.com/144.203.209.80:47500,
/0:0:0:0:0:0:0:1:47500, /127.0.0.1:47500], discPort=47500, order=1,
intOrder=1, lastExchangeTime=1503999848115, loc=false,
ver=2.1.0#20170720-sha1:a6ca5c8a, isClient=false], connected=true,
connectCnt=0, queueLimit=4096, reserveCnt=1, pairedConnections=false],
outRecovery=GridNioRecoveryDescriptor [acked=0, resendCnt=0, rcvCnt=1,
sentCnt=0, reserved=true, lastAck=0, nodeLeft=false, node=TcpDiscoveryNode
[id=fb4451e4-6e56-424d-968f-639e01a7c40b, addrs=[0:0:0:0:0:0:0:1, 127.0.0.1,
144.203.209.80], sockAddrs=[MUUWDP481.int.msci.com/144.203.209.80:47500,
/0:0:0:0:0:0:0:1:47500, /127.0.0.1:47500], discPort=47500, order=1,
intOrder=1, lastExchangeTime=1503999848115, loc=false,
ver=2.1.0#20170720-sha1:a6ca5c8a, isClient=false], connected=true,
connectCnt=0, queueLimit=4096, reserveCnt=1, pairedConnections=false],
super=GridNioSessionImpl [locAddr=/144.203.209.28:47100,
rmtAddr=/144.203.209.80:60639, createTime=1504000194999, closeTime=0,
bytesSent=28, bytesRcvd=895, bytesSent0=28, bytesRcvd0=895,
sndSchedTime=1504000194999, lastSndTime=1504000195009,
lastRcvTime=1504000195009, readsPaused=false,
filterChain=FilterChain[filters=[GridNioCodecFilter
[parser=org.apache.ignite.internal.util.nio.GridDirectParser@4b29e4ef,
directMode=true], GridConnectionBytesVerifyFilter], accepted=true]],
super=GridAbstractCommunicationClient [lastUsed=1504000195009, closed=false,
connIdx=0]]]
NIO sessions statistics:
>> Selector info [idx=0, keysCnt=1, bytesRcvd=895, bytesRcvd0=895,
>> bytesSent=28, bytesSent0=28]
Connection info [in=true, rmtAddr=/144.203.209.80:60639,
locAddr=/144.203.209.28:47100, msgsSent=0, msgsAckedByRmt=0,
descIdHash=450968442, msgsRcvd=1, lastAcked=0, descIdHash=450968442,
bytesRcvd=895, bytesRcvd0=895, bytesSent=28, bytesSent0=28, opQueueSize=0]
Exchange future: GridDhtPartitionsExchangeFuture [dummy=false,
forcePreload=false, reassign=false, discoEvt=DiscoveryCustomEvent
[customMsg=null, affTopVer=AffinityTopologyVersion [topVer=3,
minorTopVer=1], super=DiscoveryEvent [evtNode=TcpDiscoveryNode
[id=fb4451e4-6e56-424d-968f-639e01a7c40b, addrs=[0:0:0:0:0:0:0:1, 127.0.0.1,
144.203.209.80], sockAddrs=[MUUWDP481.int.msci.com/144.203.209.80:47500,
/0:0:0:0:0:0:0:1:47500, /127.0.0.1:47500], discPort=47500, order=1,
intOrder=1, lastExchangeTime=1503999848115, loc=false,
ver=2.1.0#20170720-sha1:a6ca5c8a, isClient=false], topVer=3,
nodeId8=77dbb8f3, msg=null, type=DISCOVERY_CUSTOM_EVT,
tstamp=1504000183177]], crd=TcpDiscoveryNode
[id=fb4451e4-6e56-424d-968f-639e01a7c40b, addrs=[0:0:0:0:0:0:0:1, 127.0.0.1,
144.203.209.80], sockAddrs=[MUUWDP481.int.msci.com/144.203.209.80:47500,
/0:0:0:0:0:0:0:1:47500, /127.0.0.1:47500], discPort=47500, order=1,
intOrder=1, lastExchangeTime=1503999848115, loc=false,
ver=2.1.0#20170720-sha1:a6ca5c8a, isClient=false],
exchId=GridDhtPartitionExchangeId [topVer=AffinityTopologyVersion [topVer=3,
minorTopVer=1], nodeId=fb4451e4, evt=DISCOVERY_CUSTOM_EVT], added=true,
initFut=GridFutureAdapter [ignoreInterrupts=false, state=DONE, res=false,
hash=433779024], init=false, lastVer=null, partReleaseFut=GridCompoundFuture
[rdc=null, initFlag=1, lsnrCalls=4, done=true, cancelled=false, err=null,
futs=[true, true, true, true]], exchActions=null, affChangeMsg=null,
skipPreload=false, clientOnlyExchange=false, initTs=1504000183177,
centralizedAff=false, changeGlobalStateE=java.lang.NullPointerException,
forcedRebFut=null, done=true, evtLatch=0,
remaining=[fb4451e4-6e56-424d-968f-639e01a7c40b], super=GridFutureAdapter
[ignoreInterrupts=false, state=DONE, res=java.lang.NullPointerException,
hash=1275074362]]
Local communication statistics:
Communication SPI statistics [rmtNode=77dbb8f3-076a-467a-bb4c-55b7269b029c]
--
View this message in context:
http://apache-ignite-users.70518.x6.nabble.com/Error-during-activation-of-cluster-tp16478.html
Sent from the Apache Ignite Users mailing list archive at Nabble.com.
