Hi!

I made the observation that loading data initially into the ignite-cluster
with native persistence enabled is usually a lot faster than subsequent
loadings of the same data, that is 30 min (initially) vs 52 min (4th time)
for 170 GB of data.

Does this indicate bad configurations from our side or is this expected
behaviour? In fact we are quite happy with the initial loading speed of our
data but will generally need to overwrite significant parts of it (which is
the reasons for my question). I already tried to apply all the suggestion
mentioned in https://apacheignite.readme.io/docs/durable-memory-tuning.

We are using ignite 2.8.1 currently. Here is our data storage configuration:

<property name="\"dataStorageConfiguration\"">
        <bean 
class="\"org.apache.ignite.configuration.DataStorageConfiguration\"">
                <property name="\"walMode\"" value="\"BACKGROUND\""/>
                <property name="\"writeThrottlingEnabled\"" value="\"true\""/>
                <property name="\"pageSize\"" value="\"#{4 * 1024}\""/>
                <property name=&quot;\&quot;walSegmentSize\&quot;&quot;
value=&quot;\&quot;#{2 * 1000 * 1000 * 1000}\&quot;&quot;/>
                <property name=&quot;\&quot;maxWalArchiveSize\&quot;&quot;
value=&quot;\&quot;#{10L * 1024 * 1024 * 1024}\&quot;&quot;/>
                
                <property name="\"defaultDataRegionConfiguration\"">
                        <bean
class="\"org.apache.ignite.configuration.DataRegionConfiguration\"">
                                <property name="\"persistenceEnabled\"" 
value="\"true\""/>
                                <property 
name=&quot;\&quot;checkpointPageBufferSize\&quot;&quot;
value=&quot;\&quot;#{2L * 1024 * 1024 * 1024}\&quot;&quot;/>
                                <property name="\"name\"" 
value="\"Default_Region\""/>
                                <property name="\"initialSize\"" 
value="\"${IGNITE_DEFAULT_REGION}\""/>
                                <property name="\"maxSize\"" 
value="\"${IGNITE_DEFAULT_REGION}\""/>
                        </bean>
                </property>
                <property name="\"storagePath\"" value="\"/persistence\""/>
                <property name="\"walPath\"" value="\"/wal\""/>
                <property name="\"walArchivePath\"" value="\"/wal\""/>
        </bean>

Thanks in advance!



--
Sent from: http://apache-ignite-users.70518.x6.nabble.com/

Reply via email to