Hi Ignite Community, I have a Ignite server node running well, it has a cache store connect to Oracle, and here I already created my own factory to create the cache store to avoid Serialization problem. The server node suppose to store BinaryObject as value. I already tested all the get, put, remove, query... all these functions on the single node and they all work fine.
Then I start a Ignite client node on the same machine, try to produce one of the use cases which is two applications on the same machine and they share the same data set. There is no error on the client side log, but it shows exception on server node(see log below), I don't know why, *what happened to server node when client node connect to it? It tries to serialize something? * it seems that they already find each other... but I'm not sure about what the exception mean here... please give some advices, thanks. 2017-10-25_13:56:34.403 [INFO ] [main] [o.a.ignite.internal.IgniteKernal] >>> __________ ________________ >>> / _/ ___/ |/ / _/_ __/ __/ >>> _/ // (7 7 // / / / / _/ >>> /___/\___/_/|_/___/ /_/ /___/ >>> >>> ver. 2.1.0#20170721-sha1:a6ca5c8a >>> 2017 Copyright(C) Apache Software Foundation >>> >>> Ignite documentation: http://ignite.apache.org [13:56:34] __________ ________________ [13:56:34] / _/ ___/ |/ / _/_ __/ __/ [13:56:34] _/ // (7 7 // / / / / _/ [13:56:34] /___/\___/_/|_/___/ /_/ /___/ [13:56:34] [13:56:34] ver. 2.1.0#20170721-sha1:a6ca5c8a [13:56:34] 2017 Copyright(C) Apache Software Foundation [13:56:34] [13:56:34] Ignite documentation: http://ignite.apache.org [13:56:34] [13:56:34] Quiet mode. [13:56:34] ^-- To see **FULL** console log here add -DIGNITE_QUIET=false or "-v" to ignite.{sh|bat} [13:56:34] 2017-10-25_13:56:34.403 [INFO ] [main] [o.a.ignite.internal.IgniteKernal] Config URL: n/a 2017-10-25_13:56:34.403 [INFO ] [main] [o.a.ignite.internal.IgniteKernal] Daemon mode: off [13:56:34] OS: Windows 7 6.1 amd64 2017-10-25_13:56:34.403 [INFO ] [main] [o.a.ignite.internal.IgniteKernal] OS: Windows 7 6.1 amd64 2017-10-25_13:56:34.403 [INFO ] [main] [o.a.ignite.internal.IgniteKernal] OS user: JiaoYiMing601 2017-10-25_13:56:34.403 [INFO ] [main] [o.a.ignite.internal.IgniteKernal] PID: 2236 [13:56:34] VM information: Java(TM) SE Runtime Environment 1.8.0_40-b25 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.40-b25 2017-10-25_13:56:34.403 [INFO ] [main] [o.a.ignite.internal.IgniteKernal] Language runtime: Java Platform API Specification ver. 1.8 2017-10-25_13:56:34.403 [INFO ] [main] [o.a.ignite.internal.IgniteKernal] VM information: Java(TM) SE Runtime Environment 1.8.0_40-b25 Oracle Corporation Java HotSpot(TM) 64-Bit Server VM 25.40-b25 2017-10-25_13:56:34.403 [INFO ] [main] [o.a.ignite.internal.IgniteKernal] VM total memory: 3.5GB 2017-10-25_13:56:34.403 [INFO ] [main] [o.a.ignite.internal.IgniteKernal] Remote Management [restart: off, REST: on, JMX (remote: off)] 2017-10-25_13:56:34.403 [INFO ] [main] [o.a.ignite.internal.IgniteKernal] IGNITE_HOME=null 2017-10-25_13:56:34.403 [INFO ] [main] [o.a.ignite.internal.IgniteKernal] VM arguments: [-DFAST_DB_URL=jdbc:oracle:thin:@192.168.5.11/ideadev3, -DFAST_DB_USERNAME=ideafastdev3, -DFAST_DB_PASSWORD=---BPOP---YCUNWakVnX0gBE8RIFP2TxAAbhKitiqUlMj5+6RqsIPc/QgAAAAQAAAAwNGlVKTZQmxfzsBa3CXBuw==---EPOP---, -Dfile.encoding=GBK] 2017-10-25_13:56:34.403 [INFO ] [main] [o.a.ignite.internal.IgniteKernal] System cache's MemoryPolicy size is configured to 40 MB. Use MemoryConfiguration.systemCacheMemorySize property to change the setting. 2017-10-25_13:56:34.403 [INFO ] [main] [o.a.ignite.internal.IgniteKernal] Configured caches [in 'sysMemPlc' memoryPolicy: ['ignite-sys-cache'], in 'default' memoryPolicy: ['igniteTestCache']] 2017-10-25_13:56:34.403 [WARN ] [pub-#14%null%] [o.a.ignite.internal.GridDiagnostic] Initial heap size is 256MB (should be no less than 512MB, use -Xms512m -Xmx512m). [13:56:34] Initial heap size is 256MB (should be no less than 512MB, use -Xms512m -Xmx512m). [13:56:34] Configured plugins: 2017-10-25_13:56:34.443 [INFO ] [main] [o.a.i.i.p.p.IgnitePluginProcessor] Configured plugins: [13:56:34] ^-- None 2017-10-25_13:56:34.443 [INFO ] [main] [o.a.i.i.p.p.IgnitePluginProcessor] ^-- None [13:56:34] 2017-10-25_13:56:34.453 [INFO ] [main] [o.a.i.i.p.p.IgnitePluginProcessor] 2017-10-25_13:56:34.493 [INFO ] [main] [o.a.i.s.c.tcp.TcpCommunicationSpi] Successfully bound communication NIO server to TCP port [port=47100, locHost=/192.168.6.71, selectorsCnt=4, selectorSpins=0, pairedConn=false] 2017-10-25_13:56:34.493 [WARN ] [main] [o.a.i.s.c.tcp.TcpCommunicationSpi] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. [13:56:34] Message queue limit is set to 0 which may lead to potential OOMEs when running cache operations in FULL_ASYNC or PRIMARY_SYNC modes due to message queues growth on sender and receiver sides. 2017-10-25_13:56:34.503 [WARN ] [main] [o.a.i.s.c.noop.NoopCheckpointSpi] Checkpoints are disabled (to enable configure any GridCheckpointSpi implementation) 2017-10-25_13:56:34.523 [WARN ] [main] [o.a.i.i.m.c.GridCollisionManager] Collision resolution is disabled (all jobs will be activated upon arrival). [13:56:34] Security status [authentication=off, tls/ssl=off] 2017-10-25_13:56:34.523 [INFO ] [main] [o.a.ignite.internal.IgniteKernal] Security status [authentication=off, tls/ssl=off] 2017-10-25_13:56:34.725 [INFO ] [main] [o.a.i.i.p.odbc.SqlListenerProcessor] SQL connector processor has started on TCP port 10800 2017-10-25_13:56:34.755 [INFO ] [main] [o.a.i.i.p.r.p.t.GridTcpRestProtocol] Command protocol successfully started [name=TCP binary, host=0.0.0.0/0.0.0.0, port=11211] 2017-10-25_13:56:35.925 [INFO ] [main] [o.a.ignite.internal.IgniteKernal] Non-loopback local IPs: 192.168.6.71, fe80:0:0:0:10c6:eeae:c9d2:6a85%eth3 2017-10-25_13:56:35.925 [INFO ] [main] [o.a.ignite.internal.IgniteKernal] Enabled local MACs: 6C0B846B0436 2017-10-25_13:56:35.956 [INFO ] [main] [o.a.i.s.d.tcp.TcpDiscoverySpi] Successfully bound to TCP port [port=47500, localHost=/192.168.6.71, locNodeId=7fe51f25-0d33-446d-8edc-8df45960a9a5] 2017-10-25_13:56:35.976 [INFO ] [exchange-worker-#34%null%] [o.a.ignite.internal.exchange.time] Started exchange init [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], crd=true, evt=10, node=TcpDiscoveryNode [id=7fe51f25-0d33-446d-8edc-8df45960a9a5, addrs=[192.168.6.71], sockAddrs=[HSZ-P0019.pilot.pingan.com.cn/192.168.6.71:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1508910995956, loc=true, ver=2.1.0#20170721-sha1:a6ca5c8a, isClient=false], evtNode=TcpDiscoveryNode [id=7fe51f25-0d33-446d-8edc-8df45960a9a5, addrs=[192.168.6.71], sockAddrs=[HSZ-P0019.pilot.pingan.com.cn/192.168.6.71:47500], discPort=47500, order=1, intOrder=1, lastExchangeTime=1508910995956, loc=true, ver=2.1.0#20170721-sha1:a6ca5c8a, isClient=false], customEvt=null] 2017-10-25_13:56:35.986 [WARN ] [exchange-worker-#34%null%] [o.a.i.i.p.c.p.IgniteCacheDatabaseSharedManager] No user-defined default MemoryPolicy found; system default of 1GB size will be used. 2017-10-25_13:56:36.156 [INFO ] [exchange-worker-#34%null%] [o.a.i.i.p.cache.GridCacheProcessor] Started cache [name=ignite-sys-cache, memoryPolicyName=sysMemPlc, mode=REPLICATED, atomicity=TRANSACTIONAL] 2017-10-25_13:56:36.206 [INFO ] [exchange-worker-#34%null%] [o.a.i.i.p.cache.GridCacheProcessor] Started cache [name=igniteTestCache, memoryPolicyName=default, mode=PARTITIONED, atomicity=ATOMIC] 2017-10-25_13:56:36.216 [INFO ] [exchange-worker-#34%null%] [o.a.i.i.p.c.d.d.p.GridDhtPartitionsExchangeFuture] Finished waiting for partition release future [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], waitTime=0ms] 2017-10-25_13:56:36.266 [INFO ] [exchange-worker-#34%null%] [o.a.i.i.p.c.d.d.p.GridDhtPartitionsExchangeFuture] Snapshot initialization completed [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], time=0ms] 2017-10-25_13:56:36.276 [INFO ] [exchange-worker-#34%null%] [o.a.ignite.internal.exchange.time] Finished exchange init [topVer=AffinityTopologyVersion [topVer=1, minorTopVer=0], crd=true] 2017-10-25_13:56:36.276 [INFO ] [exchange-worker-#34%null%] [o.a.i.i.p.c.GridCachePartitionExchangeManager] Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=1, minorTopVer=0], evt=NODE_JOINED, node=7fe51f25-0d33-446d-8edc-8df45960a9a5] [13:56:36] Performance suggestions for grid (fix if possible) 2017-10-25_13:56:36.306 [INFO ] [main] [o.a.ignite.internal.IgniteKernal] Performance suggestions for grid (fix if possible) [13:56:36] To disable, set -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true 2017-10-25_13:56:36.306 [INFO ] [main] [o.a.ignite.internal.IgniteKernal] To disable, set -DIGNITE_PERFORMANCE_SUGGESTIONS_DISABLED=true [13:56:36] ^-- Enable G1 Garbage Collector (add '-XX:+UseG1GC' to JVM options) 2017-10-25_13:56:36.306 [INFO ] [main] [o.a.ignite.internal.IgniteKernal] ^-- Enable G1 Garbage Collector (add '-XX:+UseG1GC' to JVM options) [13:56:36] ^-- Specify JVM heap max size (add '-Xmx<size>[g|G|m|M|k|K]' to JVM options) 2017-10-25_13:56:36.306 [INFO ] [main] [o.a.ignite.internal.IgniteKernal] ^-- Specify JVM heap max size (add '-Xmx<size>[g|G|m|M|k|K]' to JVM options) [13:56:36] ^-- Set max direct memory size if getting 'OOME: Direct buffer memory' (add '-XX:MaxDirectMemorySize=<size>[g|G|m|M|k|K]' to JVM options) 2017-10-25_13:56:36.306 [INFO ] [main] [o.a.ignite.internal.IgniteKernal] ^-- Set max direct memory size if getting 'OOME: Direct buffer memory' (add '-XX:MaxDirectMemorySize=<size>[g|G|m|M|k|K]' to JVM options) [13:56:36] ^-- Disable processing of calls to System.gc() (add '-XX:+DisableExplicitGC' to JVM options) 2017-10-25_13:56:36.306 [INFO ] [main] [o.a.ignite.internal.IgniteKernal] ^-- Disable processing of calls to System.gc() (add '-XX:+DisableExplicitGC' to JVM options) [13:56:36] ^-- Enable write-behind to persistent store (set 'writeBehindEnabled' to true) 2017-10-25_13:56:36.306 [INFO ] [main] [o.a.ignite.internal.IgniteKernal] ^-- Enable write-behind to persistent store (set 'writeBehindEnabled' to true) [13:56:36] Refer to this page for more performance suggestions: https://apacheignite.readme.io/docs/jvm-and-system-tuning 2017-10-25_13:56:36.306 [INFO ] [main] [o.a.ignite.internal.IgniteKernal] Refer to this page for more performance suggestions: https://apacheignite.readme.io/docs/jvm-and-system-tuning [13:56:36] 2017-10-25_13:56:36.306 [INFO ] [main] [o.a.ignite.internal.IgniteKernal] [13:56:36] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} 2017-10-25_13:56:36.306 [INFO ] [main] [o.a.ignite.internal.IgniteKernal] To start Console Management & Monitoring run ignitevisorcmd.{sh|bat} [13:56:36] [13:56:36] Ignite node started OK (id=7fe51f25) 2017-10-25_13:56:36.306 [INFO ] [main] [o.a.ignite.internal.IgniteKernal] 2017-10-25_13:56:36.316 [INFO ] [main] [o.a.ignite.internal.IgniteKernal] >>> +----------------------------------------------------------------------+ >>> Ignite ver. 2.1.0#20170721-sha1:a6ca5c8a97e9a4c9d73d40ce76d1504c14ba1940 >>> +----------------------------------------------------------------------+ >>> OS name: Windows 7 6.1 amd64 >>> CPU(s): 4 >>> Heap: 3.5GB >>> VM name: 2236@HSZ-P0019 >>> Local node [ID=7FE51F25-0D33-446D-8EDC-8DF45960A9A5, order=1, >>> clientMode=false] >>> Local node addresses: [HSZ-P0019.pilot.pingan.com.cn/192.168.6.71] >>> Local ports: TCP:10800 TCP:11211 TCP:47100 TCP:47500 [13:56:36] Topology snapshot [ver=1, servers=1, clients=0, CPUs=4, heap=3.5GB] 2017-10-25_13:56:36.316 [INFO ] [main] [o.a.i.i.m.d.GridDiscoveryManager] Topology snapshot [ver=1, servers=1, clients=0, CPUs=4, heap=3.5GB] 2017-10-25_13:56:52.179 [ERROR] [tcp-disco-msg-worker-#2%null%] [o.a.i.s.d.tcp.TcpDiscoverySpi] Failed to marshal discovery data [comp=1, data=CacheNodeCommonDiscoveryData [caches={igniteTestCache=CacheData [cacheCfg=CacheConfiguration [name=igniteTestCache, grpName=null, memPlcName=null, storeConcurrentLoadAllThreshold=5, rebalancePoolSize=2, rebalanceTimeout=10000, evictPlc=null, onheapCache=false, evictFilter=null, eagerTtl=true, dfltLockTimeout=0, nearCfg=null, writeSync=PRIMARY_SYNC, storeFactory=com.pingan.pilot.cache.impl.ignite.PIgniteCacheStoreFactory@3976ebfa, storeKeepBinary=false, loadPrevVal=false, aff=o.a.i.cache.affinity.rendezvous.RendezvousAffinityFunction@4c5a2baf, cacheMode=PARTITIONED, atomicityMode=ATOMIC, backups=0, invalidate=false, tmLookupClsName=null, rebalanceMode=ASYNC, rebalanceOrder=0, rebalanceBatchSize=524288, rebalanceBatchesPrefetchCnt=2, maxConcurrentAsyncOps=500, sqlIdxMaxInlineSize=-1, writeBehindEnabled=false, writeBehindFlushSize=10240, writeBehindFlushFreq=5000, writeBehindFlushThreadCnt=1, writeBehindBatchSize=512, writeBehindCoalescing=true, maxQryIterCnt=1024, affMapper=o.a.i.i.processors.cache.CacheDefaultBinaryAffinityKeyMapper@1ec22831, rebalanceDelay=0, rebalanceThrottle=0, interceptor=null, longQryWarnTimeout=3000, qryDetailMetricsSz=0, readFromBackup=true, nodeFilter=IgniteAllNodesPredicate [], sqlSchema=null, sqlEscapeAll=false, cpOnRead=true, topValidator=null, partLossPlc=IGNORE, qryParallelism=1], cacheId=1736874406, grpId=1736874406, cacheType=USER, deploymentId=7f87a125f51-d2347c54-52fa-4a91-b2b3-c4b9eb81bcf7, schema=QuerySchema [], rcvdFrom=7fe51f25-0d33-446d-8edc-8df45960a9a5, staticCfg=true, sql=false, template=false, flags=0, cacheName=igniteTestCache], ignite-sys-cache=CacheData [cacheCfg=CacheConfiguration [name=ignite-sys-cache, grpName=null, memPlcName=sysMemPlc, storeConcurrentLoadAllThreshold=5, rebalancePoolSize=2, rebalanceTimeout=10000, evictPlc=null, onheapCache=false, evictFilter=null, eagerTtl=true, dfltLockTimeout=0, nearCfg=null, writeSync=FULL_SYNC, storeFactory=null, storeKeepBinary=false, loadPrevVal=false, aff=o.a.i.cache.affinity.rendezvous.RendezvousAffinityFunction@7978e022, cacheMode=REPLICATED, atomicityMode=TRANSACTIONAL, backups=2147483647, invalidate=false, tmLookupClsName=null, rebalanceMode=SYNC, rebalanceOrder=-2, rebalanceBatchSize=524288, rebalanceBatchesPrefetchCnt=2, maxConcurrentAsyncOps=500, sqlIdxMaxInlineSize=-1, writeBehindEnabled=false, writeBehindFlushSize=10240, writeBehindFlushFreq=5000, writeBehindFlushThreadCnt=1, writeBehindBatchSize=512, writeBehindCoalescing=true, maxQryIterCnt=1024, affMapper=o.a.i.i.processors.cache.GridCacheDefaultAffinityKeyMapper@5e5beb8a, rebalanceDelay=0, rebalanceThrottle=0, interceptor=null, longQryWarnTimeout=3000, qryDetailMetricsSz=0, readFromBackup=true, nodeFilter=IgniteAllNodesPredicate [], sqlSchema=null, sqlEscapeAll=false, cpOnRead=false, topValidator=null, partLossPlc=IGNORE, qryParallelism=1], cacheId=-2100569601, grpId=-2100569601, cacheType=UTILITY, deploymentId=7f87a125f51-d2347c54-52fa-4a91-b2b3-c4b9eb81bcf7, schema=QuerySchema [], rcvdFrom=7fe51f25-0d33-446d-8edc-8df45960a9a5, staticCfg=true, sql=false, template=false, flags=0, cacheName=ignite-sys-cache]}, templates={}, cacheGrps={1736874406=CacheGroupData [grpId=1736874406, grpName=null, startTopVer=null, rcvdFrom=7fe51f25-0d33-446d-8edc-8df45960a9a5, deploymentId=7f87a125f51-d2347c54-52fa-4a91-b2b3-c4b9eb81bcf7, cacheCfg=CacheConfiguration [name=igniteTestCache, grpName=null, memPlcName=null, storeConcurrentLoadAllThreshold=5, rebalancePoolSize=2, rebalanceTimeout=10000, evictPlc=null, onheapCache=false, evictFilter=null, eagerTtl=true, dfltLockTimeout=0, nearCfg=null, writeSync=PRIMARY_SYNC, storeFactory=com.pingan.pilot.cache.impl.ignite.PIgniteCacheStoreFactory@3976ebfa, storeKeepBinary=false, loadPrevVal=false, aff=o.a.i.cache.affinity.rendezvous.RendezvousAffinityFunction@4c5a2baf, cacheMode=PARTITIONED, atomicityMode=ATOMIC, backups=0, invalidate=false, tmLookupClsName=null, rebalanceMode=ASYNC, rebalanceOrder=0, rebalanceBatchSize=524288, rebalanceBatchesPrefetchCnt=2, maxConcurrentAsyncOps=500, sqlIdxMaxInlineSize=-1, writeBehindEnabled=false, writeBehindFlushSize=10240, writeBehindFlushFreq=5000, writeBehindFlushThreadCnt=1, writeBehindBatchSize=512, writeBehindCoalescing=true, maxQryIterCnt=1024, affMapper=o.a.i.i.processors.cache.CacheDefaultBinaryAffinityKeyMapper@1ec22831, rebalanceDelay=0, rebalanceThrottle=0, interceptor=null, longQryWarnTimeout=3000, qryDetailMetricsSz=0, readFromBackup=true, nodeFilter=IgniteAllNodesPredicate [], sqlSchema=null, sqlEscapeAll=false, cpOnRead=true, topValidator=null, partLossPlc=IGNORE, qryParallelism=1], caches={igniteTestCache=1736874406}, flags=0], -2100569601=CacheGroupData [grpId=-2100569601, grpName=null, startTopVer=null, rcvdFrom=7fe51f25-0d33-446d-8edc-8df45960a9a5, deploymentId=7f87a125f51-d2347c54-52fa-4a91-b2b3-c4b9eb81bcf7, cacheCfg=CacheConfiguration [name=ignite-sys-cache, grpName=null, memPlcName=sysMemPlc, storeConcurrentLoadAllThreshold=5, rebalancePoolSize=2, rebalanceTimeout=10000, evictPlc=null, onheapCache=false, evictFilter=null, eagerTtl=true, dfltLockTimeout=0, nearCfg=null, writeSync=FULL_SYNC, storeFactory=null, storeKeepBinary=false, loadPrevVal=false, aff=o.a.i.cache.affinity.rendezvous.RendezvousAffinityFunction@7978e022, cacheMode=REPLICATED, atomicityMode=TRANSACTIONAL, backups=2147483647, invalidate=false, tmLookupClsName=null, rebalanceMode=SYNC, rebalanceOrder=-2, rebalanceBatchSize=524288, rebalanceBatchesPrefetchCnt=2, maxConcurrentAsyncOps=500, sqlIdxMaxInlineSize=-1, writeBehindEnabled=false, writeBehindFlushSize=10240, writeBehindFlushFreq=5000, writeBehindFlushThreadCnt=1, writeBehindBatchSize=512, writeBehindCoalescing=true, maxQryIterCnt=1024, affMapper=o.a.i.i.processors.cache.GridCacheDefaultAffinityKeyMapper@5e5beb8a, rebalanceDelay=0, rebalanceThrottle=0, interceptor=null, longQryWarnTimeout=3000, qryDetailMetricsSz=0, readFromBackup=true, nodeFilter=IgniteAllNodesPredicate [], sqlSchema=null, sqlEscapeAll=false, cpOnRead=false, topValidator=null, partLossPlc=IGNORE, qryParallelism=1], caches={ignite-sys-cache=-2100569601}, flags=0]}]] org.apache.ignite.IgniteCheckedException: Failed to serialize object: CacheNodeCommonDiscoveryData [caches={igniteTestCache=CacheData [cacheCfg=CacheConfiguration [name=igniteTestCache, grpName=null, memPlcName=null, storeConcurrentLoadAllThreshold=5, rebalancePoolSize=2, rebalanceTimeout=10000, evictPlc=null, onheapCache=false, evictFilter=null, eagerTtl=true, dfltLockTimeout=0, nearCfg=null, writeSync=PRIMARY_SYNC, storeFactory=com.pingan.pilot.cache.impl.ignite.PIgniteCacheStoreFactory@3976ebfa, storeKeepBinary=false, loadPrevVal=false, aff=org.apache.ignite.cache.affinity.rendezvous.RendezvousAffinityFunction@4c5a2baf, cacheMode=PARTITIONED, atomicityMode=ATOMIC, backups=0, invalidate=false, tmLookupClsName=null, rebalanceMode=ASYNC, rebalanceOrder=0, rebalanceBatchSize=524288, rebalanceBatchesPrefetchCnt=2, maxConcurrentAsyncOps=500, sqlIdxMaxInlineSize=-1, writeBehindEnabled=false, writeBehindFlushSize=10240, writeBehindFlushFreq=5000, writeBehindFlushThreadCnt=1, writeBehindBatchSize=512, writeBehindCoalescing=true, maxQryIterCnt=1024, affMapper=org.apache.ignite.internal.processors.cache.CacheDefaultBinaryAffinityKeyMapper@1ec22831, rebalanceDelay=0, rebalanceThrottle=0, interceptor=null, longQryWarnTimeout=3000, qryDetailMetricsSz=0, readFromBackup=true, nodeFilter=IgniteAllNodesPredicate [], sqlSchema=null, sqlEscapeAll=false, cpOnRead=true, topValidator=null, partLossPlc=IGNORE, qryParallelism=1], cacheId=1736874406, grpId=1736874406, cacheType=USER, deploymentId=7f87a125f51-d2347c54-52fa-4a91-b2b3-c4b9eb81bcf7, schema=QuerySchema [], rcvdFrom=7fe51f25-0d33-446d-8edc-8df45960a9a5, staticCfg=true, sql=false, template=false, flags=0, cacheName=igniteTestCache], ignite-sys-cache=CacheData [cacheCfg=CacheConfiguration [name=ignite-sys-cache, grpName=null, memPlcName=sysMemPlc, storeConcurrentLoadAllThreshold=5, rebalancePoolSize=2, rebalanceTimeout=10000, evictPlc=null, onheapCache=false, evictFilter=null, eagerTtl=true, dfltLockTimeout=0, nearCfg=null, writeSync=FULL_SYNC, storeFactory=null, storeKeepBinary=false, loadPrevVal=false, aff=org.apache.ignite.cache.affinity.rendezvous.RendezvousAffinityFunction@7978e022, cacheMode=REPLICATED, atomicityMode=TRANSACTIONAL, backups=2147483647, invalidate=false, tmLookupClsName=null, rebalanceMode=SYNC, rebalanceOrder=-2, rebalanceBatchSize=524288, rebalanceBatchesPrefetchCnt=2, maxConcurrentAsyncOps=500, sqlIdxMaxInlineSize=-1, writeBehindEnabled=false, writeBehindFlushSize=10240, writeBehindFlushFreq=5000, writeBehindFlushThreadCnt=1, writeBehindBatchSize=512, writeBehindCoalescing=true, maxQryIterCnt=1024, affMapper=org.apache.ignite.internal.processors.cache.GridCacheDefaultAffinityKeyMapper@5e5beb8a, rebalanceDelay=0, rebalanceThrottle=0, interceptor=null, longQryWarnTimeout=3000, qryDetailMetricsSz=0, readFromBackup=true, nodeFilter=IgniteAllNodesPredicate [], sqlSchema=null, sqlEscapeAll=false, cpOnRead=false, topValidator=null, partLossPlc=IGNORE, qryParallelism=1], cacheId=-2100569601, grpId=-2100569601, cacheType=UTILITY, deploymentId=7f87a125f51-d2347c54-52fa-4a91-b2b3-c4b9eb81bcf7, schema=QuerySchema [], rcvdFrom=7fe51f25-0d33-446d-8edc-8df45960a9a5, staticCfg=true, sql=false, template=false, flags=0, cacheName=ignite-sys-cache]}, templates={}, cacheGrps={1736874406=CacheGroupData [grpId=1736874406, grpName=null, startTopVer=null, rcvdFrom=7fe51f25-0d33-446d-8edc-8df45960a9a5, deploymentId=7f87a125f51-d2347c54-52fa-4a91-b2b3-c4b9eb81bcf7, cacheCfg=CacheConfiguration [name=igniteTestCache, grpName=null, memPlcName=null, storeConcurrentLoadAllThreshold=5, rebalancePoolSize=2, rebalanceTimeout=10000, evictPlc=null, onheapCache=false, evictFilter=null, eagerTtl=true, dfltLockTimeout=0, nearCfg=null, writeSync=PRIMARY_SYNC, storeFactory=com.pingan.pilot.cache.impl.ignite.PIgniteCacheStoreFactory@3976ebfa, storeKeepBinary=false, loadPrevVal=false, aff=org.apache.ignite.cache.affinity.rendezvous.RendezvousAffinityFunction@4c5a2baf, cacheMode=PARTITIONED, atomicityMode=ATOMIC, backups=0, invalidate=false, tmLookupClsName=null, rebalanceMode=ASYNC, rebalanceOrder=0, rebalanceBatchSize=524288, rebalanceBatchesPrefetchCnt=2, maxConcurrentAsyncOps=500, sqlIdxMaxInlineSize=-1, writeBehindEnabled=false, writeBehindFlushSize=10240, writeBehindFlushFreq=5000, writeBehindFlushThreadCnt=1, writeBehindBatchSize=512, writeBehindCoalescing=true, maxQryIterCnt=1024, affMapper=org.apache.ignite.internal.processors.cache.CacheDefaultBinaryAffinityKeyMapper@1ec22831, rebalanceDelay=0, rebalanceThrottle=0, interceptor=null, longQryWarnTimeout=3000, qryDetailMetricsSz=0, readFromBackup=true, nodeFilter=IgniteAllNodesPredicate [], sqlSchema=null, sqlEscapeAll=false, cpOnRead=true, topValidator=null, partLossPlc=IGNORE, qryParallelism=1], caches={igniteTestCache=1736874406}, flags=0], -2100569601=CacheGroupData [grpId=-2100569601, grpName=null, startTopVer=null, rcvdFrom=7fe51f25-0d33-446d-8edc-8df45960a9a5, deploymentId=7f87a125f51-d2347c54-52fa-4a91-b2b3-c4b9eb81bcf7, cacheCfg=CacheConfiguration [name=ignite-sys-cache, grpName=null, memPlcName=sysMemPlc, storeConcurrentLoadAllThreshold=5, rebalancePoolSize=2, rebalanceTimeout=10000, evictPlc=null, onheapCache=false, evictFilter=null, eagerTtl=true, dfltLockTimeout=0, nearCfg=null, writeSync=FULL_SYNC, storeFactory=null, storeKeepBinary=false, loadPrevVal=false, aff=org.apache.ignite.cache.affinity.rendezvous.RendezvousAffinityFunction@7978e022, cacheMode=REPLICATED, atomicityMode=TRANSACTIONAL, backups=2147483647, invalidate=false, tmLookupClsName=null, rebalanceMode=SYNC, rebalanceOrder=-2, rebalanceBatchSize=524288, rebalanceBatchesPrefetchCnt=2, maxConcurrentAsyncOps=500, sqlIdxMaxInlineSize=-1, writeBehindEnabled=false, writeBehindFlushSize=10240, writeBehindFlushFreq=5000, writeBehindFlushThreadCnt=1, writeBehindBatchSize=512, writeBehindCoalescing=true, maxQryIterCnt=1024, affMapper=org.apache.ignite.internal.processors.cache.GridCacheDefaultAffinityKeyMapper@5e5beb8a, rebalanceDelay=0, rebalanceThrottle=0, interceptor=null, longQryWarnTimeout=3000, qryDetailMetricsSz=0, readFromBackup=true, nodeFilter=IgniteAllNodesPredicate [], sqlSchema=null, sqlEscapeAll=false, cpOnRead=false, topValidator=null, partLossPlc=IGNORE, qryParallelism=1], caches={ignite-sys-cache=-2100569601}, flags=0]}] at org.apache.ignite.marshaller.jdk.JdkMarshaller.marshal0(JdkMarshaller.java:85) ~[ignite-core-2.1.0.jar:2.1.0] at org.apache.ignite.marshaller.AbstractNodeNameAwareMarshaller.marshal(AbstractNodeNameAwareMarshaller.java:70) ~[ignite-core-2.1.0.jar:2.1.0] at org.apache.ignite.marshaller.jdk.JdkMarshaller.marshal0(JdkMarshaller.java:99) ~[ignite-core-2.1.0.jar:2.1.0] at org.apache.ignite.marshaller.AbstractNodeNameAwareMarshaller.marshal(AbstractNodeNameAwareMarshaller.java:58) ~[ignite-core-2.1.0.jar:2.1.0] at org.apache.ignite.spi.discovery.tcp.internal.DiscoveryDataPacket.marshalData(DiscoveryDataPacket.java:308) [ignite-core-2.1.0.jar:2.1.0] at org.apache.ignite.spi.discovery.tcp.internal.DiscoveryDataPacket.marshalGridNodeData(DiscoveryDataPacket.java:77) [ignite-core-2.1.0.jar:2.1.0] at org.apache.ignite.spi.discovery.tcp.TcpDiscoverySpi.collectExchangeData(TcpDiscoverySpi.java:1801) [ignite-core-2.1.0.jar:2.1.0] at org.apache.ignite.spi.discovery.tcp.ServerImpl$RingMessageWorker.processNodeAddedMessage(ServerImpl.java:4171) [ignite-core-2.1.0.jar:2.1.0] at org.apache.ignite.spi.discovery.tcp.ServerImpl$RingMessageWorker.processJoinRequestMessage(ServerImpl.java:3785) [ignite-core-2.1.0.jar:2.1.0] at org.apache.ignite.spi.discovery.tcp.ServerImpl$RingMessageWorker.processMessage(ServerImpl.java:2602) [ignite-core-2.1.0.jar:2.1.0] at org.apache.ignite.spi.discovery.tcp.ServerImpl$RingMessageWorker.processMessage(ServerImpl.java:2420) [ignite-core-2.1.0.jar:2.1.0] at org.apache.ignite.spi.discovery.tcp.ServerImpl$MessageWorkerAdapter.body(ServerImpl.java:6576) [ignite-core-2.1.0.jar:2.1.0] at org.apache.ignite.spi.discovery.tcp.ServerImpl$RingMessageWorker.body(ServerImpl.java:2506) [ignite-core-2.1.0.jar:2.1.0] at org.apache.ignite.spi.IgniteSpiThread.run(IgniteSpiThread.java:62) [ignite-core-2.1.0.jar:2.1.0] Caused by: java.io.NotSerializableException: org.apache.ignite.internal.processors.cache.binary.IgniteBinaryImpl at java.io.ObjectOutputStream.writeObject0(Unknown Source) ~[na:1.8.0_40] at java.io.ObjectOutputStream.defaultWriteFields(Unknown Source) ~[na:1.8.0_40] at java.io.ObjectOutputStream.writeSerialData(Unknown Source) ~[na:1.8.0_40] at java.io.ObjectOutputStream.writeOrdinaryObject(Unknown Source) ~[na:1.8.0_40] at java.io.ObjectOutputStream.writeObject0(Unknown Source) ~[na:1.8.0_40] at java.io.ObjectOutputStream.defaultWriteFields(Unknown Source) ~[na:1.8.0_40] at java.io.ObjectOutputStream.writeSerialData(Unknown Source) ~[na:1.8.0_40] at java.io.ObjectOutputStream.writeOrdinaryObject(Unknown Source) ~[na:1.8.0_40] at java.io.ObjectOutputStream.writeObject0(Unknown Source) ~[na:1.8.0_40] at java.io.ObjectOutputStream.defaultWriteFields(Unknown Source) ~[na:1.8.0_40] at java.io.ObjectOutputStream.writeSerialData(Unknown Source) ~[na:1.8.0_40] at java.io.ObjectOutputStream.writeOrdinaryObject(Unknown Source) ~[na:1.8.0_40] at java.io.ObjectOutputStream.writeObject0(Unknown Source) ~[na:1.8.0_40] at java.io.ObjectOutputStream.defaultWriteFields(Unknown Source) ~[na:1.8.0_40] at java.io.ObjectOutputStream.writeSerialData(Unknown Source) ~[na:1.8.0_40] at java.io.ObjectOutputStream.writeOrdinaryObject(Unknown Source) ~[na:1.8.0_40] at java.io.ObjectOutputStream.writeObject0(Unknown Source) ~[na:1.8.0_40] at java.io.ObjectOutputStream.writeObject(Unknown Source) ~[na:1.8.0_40] at java.util.HashMap.internalWriteEntries(Unknown Source) ~[na:1.8.0_40] at java.util.HashMap.writeObject(Unknown Source) ~[na:1.8.0_40] at sun.reflect.GeneratedMethodAccessor6.invoke(Unknown Source) ~[na:na] at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source) ~[na:1.8.0_40] at java.lang.reflect.Method.invoke(Unknown Source) ~[na:1.8.0_40] at java.io.ObjectStreamClass.invokeWriteObject(Unknown Source) ~[na:1.8.0_40] at java.io.ObjectOutputStream.writeSerialData(Unknown Source) ~[na:1.8.0_40] at java.io.ObjectOutputStream.writeOrdinaryObject(Unknown Source) ~[na:1.8.0_40] at java.io.ObjectOutputStream.writeObject0(Unknown Source) ~[na:1.8.0_40] at java.io.ObjectOutputStream.defaultWriteFields(Unknown Source) ~[na:1.8.0_40] at java.io.ObjectOutputStream.writeSerialData(Unknown Source) ~[na:1.8.0_40] at java.io.ObjectOutputStream.writeOrdinaryObject(Unknown Source) ~[na:1.8.0_40] at java.io.ObjectOutputStream.writeObject0(Unknown Source) ~[na:1.8.0_40] at java.io.ObjectOutputStream.writeObject(Unknown Source) ~[na:1.8.0_40] at org.apache.ignite.marshaller.jdk.JdkMarshaller.marshal0(JdkMarshaller.java:80) ~[ignite-core-2.1.0.jar:2.1.0] ... 13 common frames omitted 2017-10-25_13:56:52.180 [INFO ] [disco-event-worker-#33%null%] [o.a.i.i.m.d.GridDiscoveryManager] Added new node to topology: TcpDiscoveryNode [id=a8c6e97d-20cf-4dc6-b49e-23e7c0a54039, addrs=[192.168.6.71], sockAddrs=[HSZ-P0019.pilot.pingan.com.cn/192.168.6.71:0], discPort=0, order=2, intOrder=2, lastExchangeTime=1508911012159, loc=false, ver=2.1.0#20170721-sha1:a6ca5c8a, isClient=true] [13:56:52] Topology snapshot [ver=2, servers=1, clients=1, CPUs=4, heap=7.1GB] 2017-10-25_13:56:52.200 [INFO ] [disco-event-worker-#33%null%] [o.a.i.i.m.d.GridDiscoveryManager] Topology snapshot [ver=2, servers=1, clients=1, CPUs=4, heap=7.1GB] *and this is my Ignite config, I comment out the binaryConfiguration part, it seems not helpful here* <bean id="igniteConfig" class="org.apache.ignite.configuration.IgniteConfiguration"> <property name="clientMode" value="false" /> <property name="gridLogger"> <bean class="org.apache.ignite.logger.slf4j.Slf4jLogger" /> </property> <property name="cacheConfiguration"> <list> <ref bean="cache1" /> </list> </property> </bean> <bean id="cache1" class="org.apache.ignite.configuration.CacheConfiguration"> <property name="name" value="igniteTestCache" /> <property name="cacheMode" value="PARTITIONED" /> <property name="backups" value="0" /> <property name="atomicityMode" value="ATOMIC" /> <property name="statisticsEnabled" value="true" /> <property name="managementEnabled" value="true" /> <property name="readThrough" value="true" /> <property name="writeThrough" value="true" /> <property name="cacheStoreFactory"> <bean class="com.pingan.pilot.cache.impl.ignite.PIgniteCacheStoreFactory"> <property name="converter" ref="boConverter" /> <property name="valueClass"> <bean class="java.lang.Class" factory-method="forName"> <constructor-arg value="com.abc.efg.ignite.test.bo.otw.IgniteTestBO_OTW" /> </bean> </property> </bean> </property> <property name="queryEntities"> <list> <bean class="org.apache.ignite.cache.QueryEntity"> <property name="keyType" value="java.lang.String" /> <property name="valueType" value="IPIgniteTestBOImmutable" /> <property name="fields"> <map> <entry key="intf" value="java.lang.Integer" /> <entry key="longf" value="java.lang.Long" /> <entry key="doublef" value="java.lang.Double" /> <entry key="stringf" value="java.lang.String" /> <entry key="floatf" value="java.lang.Float" /> <entry key="bo" value="java.util.Array" /> </map> </property> <property name="indexes"> <list> <bean class="org.apache.ignite.cache.QueryIndex"> <constructor-arg value="intf" /> </bean> <bean class="org.apache.ignite.cache.QueryIndex"> <constructor-arg value="longf" /> </bean> <bean class="org.apache.ignite.cache.QueryIndex"> <constructor-arg value="doublef" /> </bean> <bean class="org.apache.ignite.cache.QueryIndex"> <constructor-arg value="stringf" /> </bean> <bean class="org.apache.ignite.cache.QueryIndex"> <constructor-arg value="floatf" /> </bean> </list> </property> </bean> </list> </property> </bean> -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/
