: Thanks for your kind reply. The problem is solved with sharding and using
: facet.method=enum. I am curious about what's the different between enum
: and fc, so that enum works but fc does not. Do you know something about
: this?
method=fc/fcs uses the field caches (or uninverted fields i
Joel,
Thanks for your kind reply. The problem is solved with sharding and using
facet.method=enum. I am curious about what's the different between enum
and fc, so that enum works but fc does not. Do you know something about
this?
Thank you!
Regards,
Ming
On Fri, Apr 19, 2013 at 6:18 AM,
Faceting on a high cardinality string field, like url, on a 120 million
record index is going to be very memory intensive.
You will very likely need to shard the index to get the performance that
you need.
In Solr 4.2, you can make the url field a Disk based DocValue and shift the
memory from Sol
20G is allocated to Solr already.
Ming
On Wed, Apr 17, 2013 at 11:56 PM, Toke Eskildsen
wrote:
> On Wed, 2013-04-17 at 20:06 +0200, Mingfeng Yang wrote:
> > I am doing faceting on an index of 120M documents,
> > on the field of url[...]
>
> I would guess that you would need 3-4GB for that.
> H
On Wed, 2013-04-17 at 20:06 +0200, Mingfeng Yang wrote:
> I am doing faceting on an index of 120M documents,
> on the field of url[...]
I would guess that you would need 3-4GB for that.
How much memory do you allocate to Solr?
- Toke Eskildsen
Does Solr 3.6 has facet.method=fcs? I tried anyway, and got
ERROR 500: GC overhead limit exceeded java.lang.OutOfMemoryError: GC
overhead limit exceeded.
On Wed, Apr 17, 2013 at 12:38 PM, Timothy Potter wrote:
> What are your results when using facet.method=fcs?
>
>
> On Wed, Apr 17, 2013 at
What are your results when using facet.method=fcs?
On Wed, Apr 17, 2013 at 12:06 PM, Mingfeng Yang wrote:
> I am doing faceting on an index of 120M documents, on the field of url,
> using the following two queries. Note that the only difference of the two
> queries is that first one uses defaul
I am doing faceting on an index of 120M documents, on the field of url,
using the following two queries. Note that the only difference of the two
queries is that first one uses default facet.method, and the second one
uses face.method=enum. ( each document in the index contains a review we
extra
Thank you Erick, your explanation was helpful.
I'll stick with fc and come back to this later if I need further tuning.
Paolo
Erick Erickson wrote:
Yep, that was probably the best choice
It's a classic time/space tradeoff. The enum method creates a bitset for
#each#
unique facet value. The
Yep, that was probably the best choice
It's a classic time/space tradeoff. The enum method creates a bitset for
#each#
unique facet value. The bit set is (maxdocs / 8) bytes in size (I'm ignoring
some overhead here). So if your facet field has 10 unique values, and 8M
documents,
you'll use up
Hi,
I am using Solr v1.4 and I am not sure which facet.method I should use.
What should I use if I do not know in advance if the number of values
for a given field will be high or low?
What are the pros/cons of using facet.method=enum vs. facet.method=fc?
When should I use enum vs. fc?
I have
11 matches
Mail list logo
