Hello Vincent,
What kind of Ignites API you are using for initial data loading? I always use this man page [1] for my local tests with simultaneously disabling WALs if the Ignite native persistence enabled. [1] https://apacheignite.readme.io/docs/data-loading On Mon, 30 Nov 2020 at 16:55, VincentCE <v...@cephei.com> wrote: > > Hi! > > I made the observation that loading data initially into the ignite-cluster > with native persistence enabled is usually a lot faster than subsequent > loadings of the same data, that is 30 min (initially) vs 52 min (4th time) > for 170 GB of data. > > Does this indicate bad configurations from our side or is this expected > behaviour? In fact we are quite happy with the initial loading speed of our > data but will generally need to overwrite significant parts of it (which is > the reasons for my question). I already tried to apply all the suggestion > mentioned in https://apacheignite.readme.io/docs/durable-memory-tuning. > > We are using ignite 2.8.1 currently. Here is our data storage configuration: > > <property name="\"dataStorageConfiguration\""> > <bean > class="\"org.apache.ignite.configuration.DataStorageConfiguration\""> > <property name="\"walMode\"" value="\"BACKGROUND\""/> > <property name="\"writeThrottlingEnabled\"" value="\"true\""/> > <property name="\"pageSize\"" value="\"#{4 * 1024}\""/> > <property name="\"walSegmentSize\"" > value="\"#{2 * 1000 * 1000 * 1000}\""/> > <property name="\"maxWalArchiveSize\"" > value="\"#{10L * 1024 * 1024 * 1024}\""/> > > <property name="\"defaultDataRegionConfiguration\""> > <bean > class="\"org.apache.ignite.configuration.DataRegionConfiguration\""> > <property name="\"persistenceEnabled\"" > value="\"true\""/> > <property > name="\"checkpointPageBufferSize\"" > value="\"#{2L * 1024 * 1024 * 1024}\""/> > <property name="\"name\"" > value="\"Default_Region\""/> > <property name="\"initialSize\"" > value="\"${IGNITE_DEFAULT_REGION}\""/> > <property name="\"maxSize\"" > value="\"${IGNITE_DEFAULT_REGION}\""/> > </bean> > </property> > <property name="\"storagePath\"" value="\"/persistence\""/> > <property name="\"walPath\"" value="\"/wal\""/> > <property name="\"walArchivePath\"" value="\"/wal\""/> > </bean> > > Thanks in advance! > > > > -- > Sent from: http://apache-ignite-users.70518.x6.nabble.com/
