Switched to Ignite 2.3.0 in hope it has better behavior. Unfortunately it is not.
During the execution of Spark job number of cache rows is growing but after Spark job completes - looks like some entries has been removed. JavaIgniteRDD shows correct count but again final result is incorrect. I was using sqlline to track count of record during Spark job execution - it shows some problem also: 0: jdbc:ignite:thin://10.238.42.86/> select count(*) from data3; +--------------------------------+ | COUNT(*) | +--------------------------------+ | 6428 | +--------------------------------+ 1 row selected (0.063 seconds) 0: jdbc:ignite:thin://10.238.42.86/> select count(*) from data3; +--------------------------------+ | COUNT(*) | +--------------------------------+ | 62501 | +--------------------------------+ 1 row selected (0.096 seconds) 0: jdbc:ignite:thin://10.238.42.86/> select count(*) from data3; +--------------------------------+ | COUNT(*) | +--------------------------------+ | 268183 | +--------------------------------+ 1 row selected (0.154 seconds) 0: jdbc:ignite:thin://10.238.42.86/> select count(*) from data3; +--------------------------------+ | COUNT(*) | +--------------------------------+ | 482616 | +--------------------------------+ 1 row selected (0.159 seconds) 0: jdbc:ignite:thin://10.238.42.86/> select count(*) from data3; +--------------------------------+ | COUNT(*) | +--------------------------------+ | 722436 | +--------------------------------+ 1 row selected (0.159 seconds) 0: jdbc:ignite:thin://10.238.42.86/> select count(*) from data3; +--------------------------------+ | COUNT(*) | +--------------------------------+ | 1017236 | <--------------------------- Still looks good here +--------------------------------+ 1 row selected (0.205 seconds) 0: jdbc:ignite:thin://10.238.42.86/> select count(*) from data3; +--------------------------------+ | COUNT(*) | +--------------------------------+ | 542535 | <--------------------------- Ooops! +--------------------------------+ -- Sent from: http://apache-ignite-users.70518.x6.nabble.com/
