Hi,
The size in my store is about 9k. I do have loadAll() working now, so once
that completes, the cache has 9k items as well.
For deleteAll(), I had it work once where it called my adapter multiple
times with all of the expected keys. But then restarting my app and trying
again (after loading new data) it didn't work at all. Do I need to loadAll()
into my Ignite cache before I can delete everything from the backend store?
Here's my configuration:
String name = "foo";
CacheConfiguration cacheConfig = new
CacheConfiguration<>();
cacheConfig.setName(name);
cacheConfig.setCacheMode(CacheMode.PARTITIONED);
cacheConfig.setBackups(2);
cacheConfig.setWriteSynchronizationMode(CacheWriteSynchronizationMode.FULL_SYNC);
cacheConfig.setAtomicityMode(CacheAtomicityMode.ATOMIC);
cacheConfig.setWriteBehindEnabled(true);
cacheConfig.setWriteBehindBatchSize(512);
cacheConfig.setWriteBehindFlushSize(10240);
cacheConfig.setWriteBehindFlushFrequency(5_000);
cacheConfig.setCacheStoreFactory(new
MyCacheStoreAdapter.MyCacheStoreFactory(name));
cacheConfig.setReadThrough(true);
cacheConfig.setWriteThrough(true);
--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/
Hi Matt,
I think you can use IgniteCache.loadCache() [1] in order to load all
key-value pairs into the cache before running any job.
> For removeAll, I'm seeing that my cache store adapter only ever gets
> called once (deleteAll) but the keys only ever have 1000 keys
I've tried this use case and it works as expected.
Could you please share cache configuration and clarify the size of your
cache before IgniteCache.size(..)?
[1] https://apacheignite.readme.io/docs/data-loading#ignitecacheloadcache
Thanks!
--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/
For the removeAll() call, I do see that after I do a loadCache((k,v) -> true)
I can delete items from the store, but my store's deleteAll() only ever gets
1k items once, deletes them from the store, and then is never called again
to delete the rest of the items in the store.
--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/
Hi,
For loading all data into Ignite before running a job, is loadAll
sufficient? How can I prevent running loadAll on subsequent job runs? Is
there a way to control whether or not the cache is loaded from the
read-through store if the data has already been loaded? I'm concerned about
job startup time in this case.
For removeAll, I'm seeing that my cache store adapter only ever gets called
once (deleteAll) but the keys only ever have 1000 keys, which is the same
size as my setWriteBehindBatchSize - but my custom store (Apache Solr) has 4
times that. I must be missing something here, but not sure what. What's the
best way for me to delete all items in the cache _and_ the backend store in
the most efficient way?
Thanks,
- Matt
--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/