[
https://issues.apache.org/jira/browse/IGNITE-29234?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=18136469#comment-18136469
]
Vladislav Pyatkov commented on IGNITE-29234:
--------------------------------------------
Merged f14cd949ea9cfeb7c3210567e1c95bea1e04976d
> Parallelize page store initialization during persistent node recovery
> ---------------------------------------------------------------------
>
> Key: IGNITE-29234
> URL: https://issues.apache.org/jira/browse/IGNITE-29234
> Project: Ignite
> Issue Type: Improvement
> Reporter: Vladislav Pyatkov
> Assignee: Vladislav Pyatkov
> Priority: Major
> Fix For: 2.20
>
> Time Spent: 1.5h
> Remaining Estimate: 0h
>
> When a persistent node has many caches and cache groups, startup can spend
> considerable time initializing page stores before binary memory recovery.
> {{GridCacheProcessor.CacheRecoveryLifecycle.beforeBinaryMemoryRestore()}}
> currently iterates over persistent caches sequentially:
> {code:java}
> for (DynamicCacheDescriptor cacheDescriptor : persistentCaches())
> preparePageStore(cacheDescriptor, true);
> {code}
> Initialization checks existing partition files and opens them to read page
> store version headers. With many cache groups and partitions, these
> filesystem operations accumulate on the startup thread.
> The following stack was observed on Windows with JDK 21.0.2:
> {noformat}
> "main" cpu=42046.88ms elapsed=426.56s
> java.lang.Thread.State: RUNNABLE
> at sun.nio.fs.WindowsNativeDispatcher.CreateFile0(Native Method)
> at sun.nio.fs.WindowsChannelFactory.open(...)
> at java.nio.channels.AsynchronousFileChannel.open(...)
> at
> o.a.i.internal.processors.cache.persistence.file.AsyncFileIO.<init>(...)
> at
> o.a.i.internal.processors.cache.persistence.file.AsyncFileIOFactory.create(...)
> at
> o.a.i.internal.processors.cache.persistence.file.FileVersionCheckingFactory.createPageStore(...)
> at
> o.a.i.internal.processors.cache.persistence.file.FilePageStoreManager.initDir(...)
> at
> o.a.i.internal.processors.cache.persistence.file.FilePageStoreManager.initForCache(...)
> at
> o.a.i.internal.processors.cache.persistence.file.FilePageStoreManager.initializeForCache(...)
> at
> o.a.i.internal.processors.cache.GridCacheProcessor.preparePageStore(...)
> at
> o.a.i.internal.processors.cache.GridCacheProcessor$CacheRecoveryLifecycle.beforeBinaryMemoryRestore(...)
> at
> o.a.i.internal.processors.cache.persistence.GridCacheDatabaseSharedManager.restoreBinaryMemory(...)
> {noformat}
--
This message was sent by Atlassian Jira
(v10.3.26#10030026)
