Hi Prasad,
Any update on this? I have a similar use case when I have to load 10million
of records from a mysql database table but I keep getting the error
"(jvm-pause-detector-worker) Possible too long JVM pause" even ignite
persistence is enabled (which should write in disk the data when the d
Hello!
20 minutes for 40 mln entries seems in reasonable ballpark to me. What's
the CPU usage on Ignite nodes at that time?
Regards,
--
Ilya Kasnacheev
ср, 19 февр. 2020 г. в 19:43, Prasad Bhalerao :
> Hi,
> I am using partition aware loading to load big tables using 4-8 threads on
> each nod
Hi,
I am using partition aware loading to load big tables using 4-8 threads on
each nodes.
I have around 16 caches. 2 caches have 38-40 million entries. It takes
around approx 21 minutes to load the caches on 6 nodes.
I have kept the backup count to 2.
Will share the code tomorrow.
Regards,
Prasa
Hi Prasad,
Is there a improvement in performance. If so can you please share the sample
code as i am also looking for a similar solution.
--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/
Yes, you could use standard Java ExecutorService within CacheStore.loadCache
implementation.
--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/
Hi Vinokurov,
I was thinking to use Java ExecutoreService to submit the task (task to
invoke CacheStore.loadCache method). Is it ok to use ExecutorService or
ignite provides some way to submit the task?
Thanks,
Prasad
On Fri, Feb 9, 2018 at 6:04 PM, Vinokurov Pavel
wrote:
> Hi Prasad,
>
> With
Hi Prasad,
Within your implementation of CacheStore.loadCacheYou you could use
multiple threads to retrieve rows by batches.
Note that each thread should use different jdbc connection.
2018-02-09 13:57 GMT+03:00 Prasad Bhalerao :
> Hi,
>
> I have multiple oracle tables with more 50 million rows.
Hi,
I have multiple oracle tables with more 50 million rows. I want to load
those table in cache.To load the cache I am using CacheStore.loadCache
method.
Is there anyway where I can load a single table in multithreaded way to
improve the loading performance?
What I actually want to do is,
1) Get
