[
https://issues.apache.org/jira/browse/LUCENE-1741?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12730551#action_12730551
]
Paul Smith commented on LUCENE-1741:
------------------------------------
An algorithm is nice if there are no specific settings specified, but in an
environment where large indexes may be opened more frequently than the common
use cases, then what is happening is that the Memory layer is getting OOM
conditions too much, forcing too much GC activity to attempt the operation.
I'd vote for checking if settings have been requested and using them, and if
not set rely on a self-tuning algorithm.
In a really long running application, the process address space may become more
and more fragmented, and the malloc library may not be able to defragment it,
so the auto-tuning is nice, but it may not be great for all peoples needs.
For example, our specific use case (crazy as this may be) is to have many
different indexes open at any one time, closing and opening them frequently
(the Realtime Search stuff we are following very closely indeed.. :) ). I'm
just thinking that our VM (64bit) may find it difficult to find the contiguous
non-heap space for the MMap operation after many days/weeks in operation.
Maybe I'm just paranoid. But for operational purposes, it'd be nice to know we
could change the setting based on our observations.
thanks!
> Make MMapDirectory.MAX_BBUF user configureable to support chunking the index
> files in smaller parts
> ---------------------------------------------------------------------------------------------------
>
> Key: LUCENE-1741
> URL: https://issues.apache.org/jira/browse/LUCENE-1741
> Project: Lucene - Java
> Issue Type: Improvement
> Affects Versions: 2.9
> Reporter: Uwe Schindler
> Assignee: Uwe Schindler
> Priority: Minor
> Fix For: 2.9
>
> Attachments: LUCENE-1741.patch, LUCENE-1741.patch
>
>
> This is a followup for java-user thred:
> http://www.lucidimagination.com/search/document/9ba9137bb5d8cb78/oom_with_2_9#9bf3b5b8f3b1fb9b
> It is easy to implement, just add a setter method for this parameter to
> MMapDir.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
---------------------------------------------------------------------
To unsubscribe, e-mail: java-dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: java-dev-h...@lucene.apache.org
