[
https://issues.apache.org/jira/browse/SOLR-236?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12679662#action_12679662
]
Mark Miller commented on SOLR-236:
----------------------------------
bq. Thanks. In the wiki next to each one of these parameters it explicitly says
that reducing this parameter will decrease memory usage, this is why we reduced
these parameters (it did not mention the filterCache at all).
They will save RAM to a certain extent for certain situations. But not very
helpful at the sizes you are working with (and not settings I would use to save
RAM anyway, unless the amount I need to save was pretty small). Also, the
savings are largely index side - not likely a huge part of your RAM concerns,
which are search side.
bq. My filterCache stats are great- you know it's set to 64K but right now,
with almost all the RAM used up (we're at 71.9% now), but it's only using 36290
entries at the moment and it's holding pretty steady there(even as RAM usage
increased by 10%). None of the other caches have gone up much either. We have
no cache evictions, at all, but a 99% hit ratio.
The sizes may be higher than you need then. They should be adjusted to the best
settings based on the wiki info. I was originally suggesting you might
sacrifice speed with the caches for RAM - but, its always best to use the best
settings and have the necessary RAM.
> Field collapsing
> ----------------
>
> Key: SOLR-236
> URL: https://issues.apache.org/jira/browse/SOLR-236
> Project: Solr
> Issue Type: New Feature
> Components: search
> Affects Versions: 1.3
> Reporter: Emmanuel Keller
> Fix For: 1.5
>
> Attachments: collapsing-patch-to-1.3.0-dieter.patch,
> collapsing-patch-to-1.3.0-ivan.patch, collapsing-patch-to-1.3.0-ivan_2.patch,
> collapsing-patch-to-1.3.0-ivan_3.patch,
> field-collapsing-extended-592129.patch, field_collapsing_1.1.0.patch,
> field_collapsing_1.3.patch, field_collapsing_dsteigerwald.diff,
> field_collapsing_dsteigerwald.diff, field_collapsing_dsteigerwald.diff,
> SOLR-236-FieldCollapsing.patch, SOLR-236-FieldCollapsing.patch,
> SOLR-236-FieldCollapsing.patch, solr-236.patch
>
>
> This patch include a new feature called "Field collapsing".
> "Used in order to collapse a group of results with similar value for a given
> field to a single entry in the result set. Site collapsing is a special case
> of this, where all results for a given web site is collapsed into one or two
> entries in the result set, typically with an associated "more documents from
> this site" link. See also Duplicate detection."
> http://www.fastsearch.com/glossary.aspx?m=48&amid=299
> The implementation add 3 new query parameters (SolrParams):
> "collapse.field" to choose the field used to group results
> "collapse.type" normal (default value) or adjacent
> "collapse.max" to select how many continuous results are allowed before
> collapsing
> TODO (in progress):
> - More documentation (on source code)
> - Test cases
> Two patches:
> - "field_collapsing.patch" for current development version
> - "field_collapsing_1.1.0.patch" for Solr-1.1.0
> P.S.: Feedback and misspelling correction are welcome ;-)
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
