Hello, Ok, the topology destruction take place at 22:03:38, but I do not see any rows at the time. Not in GC (172.21.0.183-gc.log) as not ignite-ac184004.0.log-172.21.0.183. Also, I can not find a needed logs in other files.
The logs need for investigation and understanding what to do next. Please, check (by timestamp) what all file contains rows where is there issue. Can you attach need a log files? On Tue, Aug 9, 2016 at 4:26 AM, suhuadong <[email protected]> wrote: > hi, > Gc logs from all nine node. > > http://apache-ignite-users.70518.x6.nabble.com/file/n6758/gc-logs.bz2 > Ignite logs from all nine node. > > http://apache-ignite-users.70518.x6.nabble.com/file/n6757/ignite-logs.bz2 > > I allocate 60g memory to jvm, jvm used memory is about 30g. > > My JVM_OPTS： > -server -Xms60g -Xmx60g -Djava.net.preferIPv4Stack=true -XX:+UseG1GC > -XX:MaxGCPauseMillis=500 -XX:InitiatingHeapOccupancyPercent=30 > -XX:ConcGCThreads=8 -XX:+UseTLAB -XX:+DisableExplicitGC -XX:+PrintGCDetails > -XX:+PrintGCTimeStamps -XX:+PrintGCDateStamps -XX:+UseGCLogFileRotation > -XX:NumberOfGCLogFiles=100 -XX:GCLogFileSize=100M > -Xloggc:/data/ignite-1.6/gc/logs/log.txt > > My ignite config file: > > <beans xmlns="http://www.springframework.org/schema/beans"; > xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"; > xsi:schemaLocation=" > http://www.springframework.org/schema/beans > http://www.springframework.org/schema/beans/spring-beans.xsd";> > > <bean id="cassandraAdminCredentials" > class="org.apache.ignite.cache.store.cassandra. > datasource.PlainCredentials"> > <constructor-arg index="0" value=""/> > <constructor-arg index="1" value=""/> > </bean> > <bean id="loadBalancingPolicy" > class="com.datastax.driver.core.policies.RoundRobinPolicy"/> > <bean id="device_persistence_settings" > > class="org.apache.ignite.cache.store.cassandra.persistence. > KeyValuePersistenceSettings"> > <constructor-arg type="org.springframework.core.io.Resource" > > value="classpath:com/yiche/abraham/domain/persistence-device.xml"/> > </bean> > <bean id="click_persistence_settings" > > class="org.apache.ignite.cache.store.cassandra.persistence. > KeyValuePersistenceSettings"> > <constructor-arg type="org.springframework.core.io.Resource" > > value="classpath:com/yiche/abraham/domain/persistence-click.xml"/> > </bean> > <bean id="idfa_persistence_settings" > > class="org.apache.ignite.cache.store.cassandra.persistence. > KeyValuePersistenceSettings"> > <constructor-arg type="org.springframework.core.io.Resource" > > value="classpath:com/yiche/abraham/domain/persistence-idfa.xml"/> > </bean> > > <bean id="cassandraRegularDataSource" > class="org.apache.ignite.cache.store.cassandra.datasource.DataSource"> > <property name="credentials" ref="cassandraAdminCredentials"/> > > <property name="contactPoints"> > <list> > <value>172.21.0.177</value> > <value>172.21.0.178</value> > <value>172.21.0.179</value> > <value>172.21.0.180</value> > </list> > </property> > <property name="readConsistency" value="ONE"/> > <property name="writeConsistency" value="ONE"/> > <property name="loadBalancingPolicy" ref="loadBalancingPolicy"/> > </bean> > > <bean id="ignite.cfg" > class="org.apache.ignite.configuration.IgniteConfiguration"> > <property name="peerClassLoadingEnabled" value="true"/> > <property name="cacheConfiguration"> > <list> > > <bean > class="org.apache.ignite.configuration.CacheConfiguration"> > <property name="name" value="deviceCache"/> > > <property name="writeSynchronizationMode" > value="PRIMARY_SYNC"/> > > <property name="cacheMode" value="PARTITIONED"/> > <property name="atomicityMode" value="ATOMIC"/> > <property name="backups" value="0"/> > <property name="readThrough" value="true"/> > <property name="writeThrough" value="true"/> > <property name="cacheStoreFactory"> > > <bean > class="org.apache.ignite.cache.store.cassandra. > CassandraCacheStoreFactory"> > <property name="dataSourceBean" > value="cassandraRegularDataSource"/> > <property name="persistenceSettingsBean" > value="device_persistence_settings"/> > </bean> > </property> > > <property name="memoryMode" value="ONHEAP_TIERED"/> > <property name="evictionPolicy"> > > <bean > class="org.apache.ignite.cache.eviction.lru.LruEvictionPolicy"> > > <property name="maxSize" value="1000000"/> > </bean> > </property> > > </bean> > > <bean > class="org.apache.ignite.configuration.CacheConfiguration"> > <property name="name" value="clickedArticleCache"/> > > <property name="memoryMode" value="ONHEAP_TIERED"/> > <property name="evictionPolicy"> > > <bean > class="org.apache.ignite.cache.eviction.lru.LruEvictionPolicy"> > > <property name="maxSize" value="1000000"/> > </bean> > </property> > > > <property name="writeSynchronizationMode" > value="PRIMARY_SYNC"/> > > <property name="cacheMode" value="PARTITIONED"/> > <property name="atomicityMode" value="ATOMIC"/> > <property name="backups" value="0"/> > > <property name="readThrough" value="true"/> > <property name="writeThrough" value="true"/> > <property name="cacheStoreFactory"> > > <bean > class="org.apache.ignite.cache.store.cassandra. > CassandraCacheStoreFactory"> > <property name="dataSourceBean" > value="cassandraRegularDataSource"/> > <property name="persistenceSettingsBean" > value="click_persistence_settings"/> > </bean> > </property> > > </bean> > <bean > class="org.apache.ignite.configuration.CacheConfiguration"> > <property name="name" value="idfaCache"/> > > <property name="memoryMode" value="ONHEAP_TIERED"/> > <property name="evictionPolicy"> > > <bean > class="org.apache.ignite.cache.eviction.lru.LruEvictionPolicy"> > > <property name="maxSize" value="1000000"/> > </bean> > </property> > > > > <property name="writeSynchronizationMode" > value="PRIMARY_SYNC"/> > <property name="cacheMode" value="PARTITIONED"/> > <property name="atomicityMode" value="ATOMIC"/> > <property name="backups" value="0"/> > > <property name="readThrough" value="true"/> > <property name="writeThrough" value="true"/> > <property name="cacheStoreFactory"> > > <bean > class="org.apache.ignite.cache.store.cassandra. > CassandraCacheStoreFactory"> > <property name="dataSourceBean" > value="cassandraRegularDataSource"/> > <property name="persistenceSettingsBean" > value="idfa_persistence_settings"/> > </bean> > </property> > </bean> > > <bean > class="org.apache.ignite.configuration.CacheConfiguration"> > <property name="name" value=" > yiCheAppRecommendedCache"/> > > <property name="memoryMode" value="ONHEAP_TIERED"/> > <property name="evictionPolicy"> > > <bean > class="org.apache.ignite.cache.eviction.lru.LruEvictionPolicy"> > > <property name="maxSize" value="2000000"/> > </bean> > </property> > > <property name="writeSynchronizationMode" > value="PRIMARY_SYNC"/> > > <property name="cacheMode" value="PARTITIONED"/> > <property name="atomicityMode" value="ATOMIC"/> > <property name="backups" value="1"/> > </bean> > > <bean > class="org.apache.ignite.configuration.CacheConfiguration"> > > <property name="memoryMode" value="ONHEAP_TIERED"/> > <property name="evictionPolicy"> > > <bean > class="org.apache.ignite.cache.eviction.lru.LruEvictionPolicy"> > > <property name="maxSize" value="500000"/> > </bean> > </property> > > <property name="name" > value="yiCheAppRecommendingCache"/> > > <property name="writeSynchronizationMode" > value="PRIMARY_SYNC"/> > > <property name="cacheMode" value="PARTITIONED"/> > <property name="atomicityMode" value="ATOMIC"/> > <property name="backups" value="0"/> > > </bean> > > <bean > class="org.apache.ignite.configuration.CacheConfiguration"> > <property name="name" value=" > bjdqAppRecommendedCache"/> > > <property name="memoryMode" value="ONHEAP_TIERED"/> > <property name="evictionPolicy"> > > <bean > class="org.apache.ignite.cache.eviction.lru.LruEvictionPolicy"> > > <property name="maxSize" value="2000000"/> > </bean> > </property> > > > <property name="writeSynchronizationMode" > value="PRIMARY_SYNC"/> > > <property name="cacheMode" value="PARTITIONED"/> > <property name="atomicityMode" value="ATOMIC"/> > <property name="backups" value="1"/> > > > </bean> > > <bean > class="org.apache.ignite.configuration.CacheConfiguration"> > <property name="name" value=" > bjdqAppRecommendingCache"/> > > <property name="memoryMode" value="ONHEAP_TIERED"/> > <property name="evictionPolicy"> > > <bean > class="org.apache.ignite.cache.eviction.lru.LruEvictionPolicy"> > > <property name="maxSize" value="500000"/> > </bean> > </property> > > > <property name="writeSynchronizationMode" > value="PRIMARY_SYNC"/> > > <property name="cacheMode" value="PARTITIONED"/> > <property name="atomicityMode" value="ATOMIC"/> > <property name="backups" value="0"/> > </bean> > > </list> > </property> > > > <property name="discoverySpi"> > <bean > class="org.apache.ignite.spi.discovery.tcp.TcpDiscoverySpi"> > > > > <property name="localPort" value="58600"/> > > > <property name="localPortRange" value="20"/> > > <property name="ipFinder"> > > > > <bean > class="org.apache.ignite.spi.discovery.tcp.ipfinder.vm. > TcpDiscoveryVmIpFinder"> > > <property name="addresses"> > <list> > > > <value>172.21.0.181:58600..58620</value> > <value>172.21.0.182:58600..58620</value> > <value>172.21.0.183:58600..58620</value> > </list> > </property> > </bean> > </property> > </bean> > </property> > > > <property name="communicationSpi"> > <bean > class="org.apache.ignite.spi.communication.tcp.TcpCommunicationSpi"> > <property name="localPort" value="58200"/> > <property name="localAddress" value="172.21.0.183"/> > </bean> > </property> > </bean> > </beans> > > > > The stoped server node'ip is 172.20.0.183. > > work/log: > > [22:03:38,100][WARNING][tcp-disco-msg-worker-#2%null%][TcpDiscoverySpi] > Node > is out of topology (probably, due to short-time network problems). > [22:03:38,103][WARNING][disco-event-worker-#144%null%][ > GridDiscoveryManager] > Local node SEGMENTED: TcpDiscoveryNode > [id=424ef276-c1b6-48b0-9ded-c6fca0997502, addrs=[124.250.36.149, > 127.0.0.1, > 172.21.0.183], sockAddrs=[/172.21.0.183:58600, /124.250.36.149:58600, > /124.250.36.149:58600, /127.0.0.1:58600, /172.21.0.183:58600], > discPort=58600, order=485, intOrder=255, lastExchangeTime=1469714618102, > loc=true, ver=1.6.0#20160518-sha1:0b22c45b, isClient=false] > [22:03:38,134][WARNING][disco-event-worker-#144%null%][ > GridDiscoveryManager] > Stopping local node according to configured segmentation policy. > [22:03:38,135][WARNING][disco-event-worker-#144%null%][ > GridDiscoveryManager] > Node FAILED: TcpDiscoveryNode [id=588dbb39-a124-4879-a476-3bb723e1e4d9, > addrs=[124.250.36.148, 127.0.0.1, 172.21.0.182], > sockAddrs=[/124.250.36.148:58600, /124.250.36.148:58600, > /124.250.36.148:58600, /127.0.0.1:58600, /172.21.0.182:58600], > discPort=58600, order=244, intOrder=132, lastExchangeTime=1469624391582, > loc=false, ver=1.6.0#20160518-sha1:0b22c45b, isClient=false] > [22:03:38,138][INFO][disco-event-worker-#144%null%][GridDiscoveryManager] > Topology snapshot [ver=527, servers=1, clients=0, CPUs=32, heap=60.0GB] > [22:03:38,139][WARNING][disco-event-worker-#144%null%][ > GridDiscoveryManager] > Node FAILED: TcpDiscoveryNode [id=ea39b0d0-fb6b-483b-86d5-d2cfda7c0abf, > addrs=[127.0.0.1, 172.21.0.39], sockAddrs=[/172.21.0.39:58600, > /127.0.0.1:58600, /172.21.0.39:58600], discPort=58600, order=251, > intOrder=136, lastExchangeTime=1469624391582, loc=false, > ver=1.6.0#20160518-sha1:0b22c45b, isClient=false] > [22:03:38,143][INFO][Thread-117][GridTcpRestProtocol] Command protocol > successfully stopped: TCP binary > [22:03:38,144][WARNING][disco-event-worker-#144%null%][ > GridDiscoveryManager] > Node FAILED: TcpDiscoveryNode [id=51421fee-0d08-4f46-82ea-1a12f8d80f6f, > addrs=[127.0.0.1, 172.21.0.40], sockAddrs=[/172.21.0.40:58600, > /127.0.0.1:58600, /172.21.0.40:58600], discPort=58600, order=257, > intOrder=139, lastExchangeTime=1469624391582, loc=false, > ver=1.6.0#20160518-sha1:0b22c45b, isClient=false] > [22:03:38,145][WARNING][disco-event-worker-#144%null%][ > GridDiscoveryManager] > Node FAILED: TcpDiscoveryNode [id=14d75a27-f8ae-4da6-9285-f6b6abfe645c, > addrs=[127.0.0.1, 172.21.0.41], sockAddrs=[/172.21.0.41:58600, > /127.0.0.1:58600, /172.21.0.41:58600], discPort=58600, order=263, > intOrder=142, lastExchangeTime=1469624391582, loc=false, > ver=1.6.0#20160518-sha1:0b22c45b, isClient=false] > [22:03:38,146][WARNING][disco-event-worker-#144%null%][ > GridDiscoveryManager] > Node FAILED: TcpDiscoveryNode [id=2333a45f-4d81-423d-90fe-445efc233883, > addrs=[127.0.0.1, 172.21.0.42], sockAddrs=[/172.21.0.42:58600, > /127.0.0.1:58600, /172.21.0.42:58600], discPort=58600, order=265, > intOrder=143, lastExchangeTime=1469624391582, loc=false, > ver=1.6.0#20160518-sha1:0b22c45b, isClient=false] > [22:03:38,146][WARNING][disco-event-worker-#144%null%][ > GridDiscoveryManager] > Node FAILED: TcpDiscoveryNode [id=f67c2596-bf28-41d5-b79d-7e351b72768f, > addrs=[127.0.0.1, 172.21.0.43], sockAddrs=[/172.21.0.43:58600, > /127.0.0.1:58600, /172.21.0.43:58600], discPort=58600, order=267, > intOrder=144, lastExchangeTime=1469624391582, loc=false, > ver=1.6.0#20160518-sha1:0b22c45b, isClient=false] > [22:03:38,147][WARNING][disco-event-worker-#144%null%][ > GridDiscoveryManager] > Node FAILED: TcpDiscoveryNode [id=ddcbfdba-cf93-415c-a914-e84ac729ccc4, > addrs=[124.250.36.139, 127.0.0.1, 172.21.0.173], > sockAddrs=[/124.250.36.139:0, /124.250.36.139:0, /124.250.36.139:0, > /127.0.0.1:0, /172.21.0.173:0], discPort=0, order=299, intOrder=160, > lastExchangeTime=1469624391582, loc=false, ver=1.6.0#20160518-sha1: > 0b22c45b, > isClient=true] > [22:03:38,148][WARNING][disco-event-worker-#144%null%][ > GridDiscoveryManager] > Node FAILED: TcpDiscoveryNode [id=36e21ab4-2d96-4e22-8496-755ae90253ba, > addrs=[124.250.36.70, 124.250.36.74, 127.0.0.1, 172.21.0.77], > sockAddrs=[/124.250.36.70:0, /124.250.36.70:0, /124.250.36.74:0, > /124.250.36.74:0, /127.0.0.1:0, /127.0.0.1:0, /172.21.0.77:0], discPort=0, > order=307, intOrder=164, lastExchangeTime=1469624391582, loc=false, > ver=1.6.0#20160518-sha1:0b22c45b, isClient=true] > [22:03:38,150][WARNING][disco-event-worker-#144%null%][ > GridDiscoveryManager] > Node FAILED: TcpDiscoveryNode [id=048e6c2a-7520-4197-8074-a65beefac047, > addrs=[124.250.36.73, 124.250.36.74, 127.0.0.1, 172.21.0.80], > sockAddrs=[/124.250.36.73:0, /124.250.36.73:0, /124.250.36.73:0, > /124.250.36.74:0, /124.250.36.74:0, /127.0.0.1:0, /172.21.0.80:0], > discPort=0, order=313, intOrder=167, lastExchangeTime=1469624391582, > loc=false, ver=1.6.0#20160518-sha1:0b22c45b, isClient=true] > [22:03:38,150][WARNING][disco-event-worker-#144%null%][ > GridDiscoveryManager] > Node FAILED: TcpDiscoveryNode [id=0a8abdd3-ebe9-4bf3-a1af-ffaa40f8c3ac, > addrs=[124.250.36.196, 124.250.36.74, 127.0.0.1, 172.21.0.223], > sockAddrs=[/172.21.0.223:0, /124.250.36.196:0, /124.250.36.196:0, > /124.250.36.74:0, /124.250.36.74:0, /127.0.0.1:0, /172.21.0.223:0], > discPort=0, order=319, intOrder=170, lastExchangeTime=1469624391582, > loc=false, ver=1.6.0#20160518-sha1:0b22c45b, isClient=true] > [22:03:38,151][WARNING][disco-event-worker-#144%null%][ > GridDiscoveryManager] > Node FAILED: TcpDiscoveryNode [id=aef17bf7-ef0d-4a9b-8d7b-a87ffa42afbf, > addrs=[124.250.36.69, 124.250.36.74, 124.250.36.74, 127.0.0.1, > 172.21.0.76], > sockAddrs=[/124.250.36.69:0, /124.250.36.69:0, /124.250.36.74:0, > /124.250.36.74:0, /124.250.36.74:0, /124.250.36.74:0, > test.com/69.172.200.235:0, /127.0.0.1:0, /172.21.0.76:0], discPort=0, > order=358, intOrder=188, lastExchangeTime=1469624391592, loc=false, > ver=1.6.0#20160518-sha1:0b22c45b, isClient=true] > [22:03:38,152][WARNING][disco-event-worker-#144%null%][ > GridDiscoveryManager] > Node FAILED: TcpDiscoveryNode [id=a51432a3-25e8-41e1-9201-ad626852af80, > addrs=[124.250.36.72, 124.250.36.74, 127.0.0.1, 172.21.0.79], > sockAddrs=[/124.250.36.72:0, /124.250.36.72:0, /124.250.36.72:0, > /124.250.36.74:0, /124.250.36.74:0, /127.0.0.1:0, /172.21.0.79:0], > discPort=0, order=359, intOrder=189, lastExchangeTime=1469624391592, > loc=false, ver=1.6.0#20160518-sha1:0b22c45b, isClient=true] > [22:03:38,152][WARNING][disco-event-worker-#144%null%][ > GridDiscoveryManager] > Node FAILED: TcpDiscoveryNode [id=1178eb68-3025-4cbf-8515-d34e5a28a452, > addrs=[124.250.36.71, 124.250.36.74, 127.0.0.1, 172.21.0.78], > sockAddrs=[/124.250.36.71:0, /124.250.36.71:0, /124.250.36.74:0, > /124.250.36.74:0, /124.250.36.74:0, /127.0.0.1:0, /172.21.0.78:0], > discPort=0, order=360, intOrder=190, lastExchangeTime=1469624391592, > loc=false, ver=1.6.0#20160518-sha1:0b22c45b, isClient=true] > [22:03:38,153][WARNING][disco-event-worker-#144%null%][ > GridDiscoveryManager] > Node FAILED: TcpDiscoveryNode [id=89f1d6cd-8c40-4465-86e7-b2169bb59e8c, > addrs=[124.250.36.197, 124.250.36.74, 127.0.0.1, 172.21.0.224], > sockAddrs=[/172.21.0.224:0, /124.250.36.197:0, /124.250.36.74:0, > /124.250.36.74:0, /124.250.36.197:0, /127.0.0.1:0, /172.21.0.224:0], > discPort=0, order=362, intOrder=192, lastExchangeTime=1469624391592, > loc=false, ver=1.6.0#20160518-sha1:0b22c45b, isClient=true] > [22:03:38,154][WARNING][disco-event-worker-#144%null%][ > GridDiscoveryManager] > Node FAILED: TcpDiscoveryNode [id=4e040db4-6a6e-4f90-ad1c-a4100a28b792, > addrs=[124.250.36.185, 124.250.36.45, 127.0.0.1, 172.21.0.35], > sockAddrs=[/172.21.0.35:0, /124.250.36.185:0, /124.250.36.45:0, > /124.250.36.45:0, /124.250.36.185:0, /127.0.0.1:0, /172.21.0.35:0], > discPort=0, order=366, intOrder=194, lastExchangeTime=1469624391592, > loc=false, ver=1.6.0#20160518-sha1:0b22c45b, isClient=true] > [22:03:38,154][WARNING][disco-event-worker-#144%null%][ > GridDiscoveryManager] > Node FAILED: TcpDiscoveryNode [id=2f84fb8b-ec6c-435a-8175-bc87e3db252c, > addrs=[124.250.36.185, 124.250.36.185, 124.250.36.46, 127.0.0.1, > 172.21.0.36], sockAddrs=[/124.250.36.185:0, /124.250.36.185:0, > /124.250.36.185:0, /124.250.36.185:0, /124.250.36.46:0, /124.250.36.46:0, > /124.250.36.185:0, /127.0.0.1:0, /172.21.0.36:0], discPort=0, order=372, > intOrder=197, lastExchangeTime=1469624391592, loc=false, > ver=1.6.0#20160518-sha1:0b22c45b, isClient=true] > [22:03:38,156][WARNING][disco-event-worker-#144%null%][ > GridDiscoveryManager] > Node FAILED: TcpDiscoveryNode [id=b79cced2-1175-443b-8e7b-b73b2a622d5f, > addrs=[127.0.0.1, 172.21.0.38], sockAddrs=[/172.21.0.38:58600, > /127.0.0.1:58600, /172.21.0.38:58600], discPort=58600, order=390, > intOrder=207, lastExchangeTime=1469624391592, loc=false, > ver=1.6.0#20160518-sha1:0b22c45b, isClient=false] > [22:03:38,156][INFO][Thread-117][GridJettyRestProtocol] Command protocol > successfully stopped: Jetty REST > [22:03:38,156][WARNING][disco-event-worker-#144%null%][ > GridDiscoveryManager] > Node FAILED: TcpDiscoveryNode [id=f0f33c05-7173-4a38-97ed-74f709514b32, > addrs=[124.250.36.223, 127.0.0.1, 172.21.0.127], sockAddrs=[/ > 172.21.0.127:0, > /124.250.36.223:0, /124.250.36.223:0, /127.0.0.1:0, /172.21.0.127:0], > discPort=0, order=427, intOrder=225, lastExchangeTime=1469624388223, > loc=false, ver=1.6.0#20160518-sha1:0b22c45b, isClient=true] > [22:03:38,157][WARNING][disco-event-worker-#144%null%][ > GridDiscoveryManager] > Node FAILED: TcpDiscoveryNode [id=ec94b23e-f3d7-4e6d-aa22-570a248f7172, > addrs=[124.250.36.222, 127.0.0.1, 172.21.0.126], sockAddrs=[/ > 172.21.0.126:0, > /124.250.36.222:0, /124.250.36.222:0, /127.0.0.1:0, /172.21.0.126:0], > discPort=0, order=431, intOrder=227, lastExchangeTime=1469624388234, > loc=false, ver=1.6.0#20160518-sha1:0b22c45b, isClient=true] > [22:03:38,158][WARNING][disco-event-worker-#144%null%][ > GridDiscoveryManager] > Node FAILED: TcpDiscoveryNode [id=0687433b-a7a2-47db-ba38-6d1d4f34f82e, > addrs=[124.250.36.147, 127.0.0.1, 172.21.0.181], > sockAddrs=[/172.21.0.181:58600, /124.250.36.147:58600, > /124.250.36.147:58600, /127.0.0.1:58600, /172.21.0.181:58600], > discPort=58600, order=440, intOrder=232, lastExchangeTime=1469624391592, > loc=false, ver=1.6.0#20160518-sha1:0b22c45b, isClient=false] > [22:03:38,158][WARNING][disco-event-worker-#144%null%][ > GridDiscoveryManager] > Node FAILED: TcpDiscoveryNode [id=0d2fc522-5d2d-41b3-a0a4-98e12f3aa876, > addrs=[124.250.36.47, 127.0.0.1, 172.21.0.37, 33.33.33.1], > sockAddrs=[/33.33.33.1:0, /124.250.36.47:0, /172.21.0.37:0, /127.0.0.1:0, > /124.250.36.47:0, /172.21.0.37:0, /33.33.33.1:0], discPort=0, order=496, > intOrder=260, lastExchangeTime=1469676024755, loc=false, > ver=1.6.0#20160518-sha1:0b22c45b, isClient=true] > [22:03:38,159][WARNING][disco-event-worker-#144%null%][ > GridDiscoveryManager] > Node FAILED: TcpDiscoveryNode [id=bf64226a-7597-4bc8-866b-6d99c7e9f2aa, > addrs=[124.250.36.47, 127.0.0.1, 172.21.0.37, 33.33.33.1], > sockAddrs=[/33.33.33.1:0, /124.250.36.47:0, /172.21.0.37:0, /127.0.0.1:0, > /124.250.36.47:0, /172.21.0.37:0, /33.33.33.1:0], discPort=0, order=503, > intOrder=264, lastExchangeTime=1469698198271, loc=false, > ver=1.6.0#20160518-sha1:0b22c45b, isClient=true] > [22:03:38,561][INFO][Thread-117][GridCacheProcessor] Stopped cache: > bjdqAppRecommendingCache > [22:03:38,563][INFO][Thread-117][GridCacheProcessor] Stopped cache: > bjdqAppRecommendedCache > [22:03:38,564][INFO][Thread-117][GridCacheProcessor] Stopped cache: > yiCheAppRecommendingCache > [22:03:38,564][INFO][Thread-117][GridCacheProcessor] Stopped cache: > yiCheAppRecommendedCache > [22:03:38,565][INFO][Thread-117][GridCacheProcessor] Stopped cache: > idfaCache > [22:03:38,566][INFO][Thread-117][GridCacheProcessor] Stopped cache: > clickedArticleCache > [22:03:38,566][INFO][Thread-117][GridCacheProcessor] Stopped cache: > deviceCache > [22:03:38,567][INFO][Thread-117][GridCacheProcessor] Stopped cache: > ignite-marshaller-sys-cache > [22:03:38,567][INFO][Thread-117][GridCacheProcessor] Stopped cache: > ignite-sys-cache > [22:03:38,568][INFO][Thread-117][GridCacheProcessor] Stopped cache: > ignite-atomics-sys-cache > [22:03:38,571][INFO][Thread-117][GridDeploymentLocalStore] Removed > undeployed class: GridDeployment [ts=1469624393224, depMode=SHARED, > clsLdr=sun.misc.Launcher$AppClassLoader@18b4aac2, > clsLdrId=a1d707c2651-424ef276-c1b6-48b0-9ded-c6fca0997502, userVer=0, > loc=true, > sampleClsName=org.apache.ignite.internal.processors.cache.distributed.dht. > preloader.GridDhtPartitionFullMap, > pendingUndeploy=false, undeployed=true, usage=0] > [22:03:38,585][INFO][Thread-117][IgniteKernal] > > > > -- > View this message in context: http://apache-ignite-users. > 70518.x6.nabble.com/Ignite-Cluster-node-stopped-tp6608p6865.html > Sent from the Apache Ignite Users mailing list archive at Nabble.com. > -- Vladislav Pyatkov
