Nuno Santos created OAK-11412:
---------------------------------
Summary: indexing job: delay creation of index writers backend
until the start of the indexing phase
Key: OAK-11412
URL: https://issues.apache.org/jira/browse/OAK-11412
Project: Jackrabbit Oak
Issue Type: Task
Components: indexing
Reporter: Nuno Santos
Currently, the indexing job creates the index writers (one per index, for both
Lucene and Elastic) at the start of the job. But these writers and associated
objects are not needed for the download phase of the job, they are only needed
for the indexing phase. By creating them at the start, they are taking up
memory and resources which could be better used for the download. When indexing
a large number of indexes, they may consume a significant amount of memory (I
did not measure, but these objects are heavy-weight, with significant internal
buffers and may also start background threads).
These writers should be created only at the start of the indexing phase, after
the download phase is terminated and its resources are released.
--
This message was sent by Atlassian Jira
(v8.20.10#820010)
