the termsInfosDivisor for readers opened by indexWriter should be configurable 
in Solr
--------------------------------------------------------------------------------------

                 Key: SOLR-2290
                 URL: https://issues.apache.org/jira/browse/SOLR-2290
             Project: Solr
          Issue Type: New Feature
            Reporter: Tom Burton-West
            Priority: Minor


Solr allows users to set the termInfosIndexDivisor used by the  indexReader 
during search time  in solrconfig.xml, but not in the  indexReader opened by 
the IndexWriter when indexing/merging.

When dealing with an index with a large number of unique terms, setting the 
termInfosIndexDivisor at search time is helpful in  reducing memory use.  It 
would also be helpful in reducing memory use during indexing/merging if it was 
made configurable for indexReaders opened by indexWriter during 
indexing/merging.

This thread contains some background:
http://www.lucidimagination.com/search/document/b5c756a366e1a0d6/memory_use_during_merges_oom

In the Lucene 3.x branch it looks like this is done in 
IndexWriterConfig.setReaderTermsIndexDivisor, although there is also this 
method signature in IndexWriter.java: IndexReader getReader(int 
termInfosIndexDivisor)

  

-- 
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.


---------------------------------------------------------------------
To unsubscribe, e-mail: [email protected]
For additional commands, e-mail: [email protected]

Reply via email to