Hi Srikanta, Have you tried to load data without indexto compare time? I think Wal disabling for data load can save some hours for you: https://www.gridgain.com/docs/latest/developers-guide/persistence/native-persistence#disabling-wal
Thanks, Mike. On Wed, Aug 26, 2020, 8:47 AM Srikanta Patanjali <p.srika...@gmail.com> wrote: > Currently I'm using Apache Ignite v2.8.1 to preload a cache from the > RDBMS. There are two tables with each 27M rows. The index is defined on a > single column of type String in 1st table and Integer in the 2nd table. > Together the total size of the two tables is around 120GB. > > The preloading process (triggered using loadCacheAsync() from within a > Java app) takes about 45hrs. The cache is persistence enabled and a > common EBS volume (SSD) is being used for both the WAL and other locations. > > I'm unable to figure out the bottleneck for increasing the speed. > > Apart from defining a separate path for WAL and the persistence, is there > any other way to load the cache faster (with indexing enabled) ? > > > Thanks, > Srikanta >
