On 9/11/13 3:11 AM, Per Steffensen wrote:
Hi
We have a SolrCloud setup handling huge amounts of data. When we do
group, facet or sort searches Solr will use its FieldCache, and add
data in it for every single document we have. For us it is not
realistic that this will ever fit in memory and we get OOM exceptions.
Are there some way of disabling the FieldCache (taking the performance
penalty of course) or make it behave in a nicer way where it only uses
up to e.g. 80% of the memory available to the JVM? Or other suggestions?
Regards, Per Steffensen
I think you might want to look into using DocValues fields, which are
column-stride fields stored as compressed arrays - one value per
document -- for the fields on which you are sorting and faceting. My
understanding (which is limited) is that these avoid the use of the
field cache, and I believe you have the option to control whether they
are held in memory or on disk. I hope someone who knows more will
elaborate...
-Mike
