[ https://issues.apache.org/jira/browse/OAK-9052?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=17101789#comment-17101789 ]
Thomas Mueller commented on OAK-9052: ------------------------------------- I added a "file size over time" diagram. It looks like there are two spikes at the beginning, and then it stays within 1 MB. Compacting is done every minute, I think that's fine, except that it's not needed if the file is smaller than 10 MB. > Reindexing using --doc-traversal-mode may need a lot of memory > -------------------------------------------------------------- > > Key: OAK-9052 > URL: https://issues.apache.org/jira/browse/OAK-9052 > Project: Jackrabbit Oak > Issue Type: Improvement > Components: indexing, mongomk > Reporter: Thomas Mueller > Assignee: Thomas Mueller > Priority: Major > Attachments: fileSizeOverTime.png > > > Indexing using oak-run and --doc-traversal-mode uses the FlatFileStore. For > aggregation, there is a limit on memory usage, by default around 100 MB. > Depending on the content structure, this limit can be exceeded. > It would be good to find a way to avoid a memory limit, for example using a > temporary storage (a file, or a persistent key/value store). -- This message was sent by Atlassian Jira (v8.3.4#803005)