Re: How can a distributed Solr setup scale to TB-data, if URL limitations are 4000 for distributed shard search?

2012-01-19 Thread Daniel Bruegge
, 2012 at 12:14 AM, Mark Miller markrmil...@gmail.com wrote: You can raise the limit to a point. On Jan 18, 2012, at 5:59 PM, Daniel Bruegge wrote: Hi, I am just wondering how I can 'grow' a distributed Solr setup to an index size of a couple of terabytes, when one

Solr hides some facet.fields when doing a distributed search over multiple shards

2012-01-18 Thread Daniel Bruegge
Hi, I have asked the question already over Stackoverflow ( http://stackoverflow.com/questions/8913654/solr-hides-some-facet-fields-when-doing-a-distributed-search), but maybe someone here can give me a hint how to solve this issue: I am searching over 6 Solr shards (Solr version 3.5). What I

Re: Solr hides some facet.fields when doing a distributed search over multiple shards

2012-01-18 Thread Daniel Bruegge
Thanks a lot. That worked like a charm. On Wed, Jan 18, 2012 at 9:50 PM, Yonik Seeley yo...@lucidimagination.comwrote: On Wed, Jan 18, 2012 at 3:36 PM, Daniel Bruegge daniel.brue...@googlemail.com wrote: Hi, I have asked the question already over Stackoverflow ( http

How can a distributed Solr setup scale to TB-data, if URL limitations are 4000 for distributed shard search?

2012-01-18 Thread Daniel Bruegge
Hi, I am just wondering how I can 'grow' a distributed Solr setup to an index size of a couple of terabytes, when one of the distributed Solr limitations is max. 4000 characters in URI limitation. See: *The number of shards is limited by number of characters allowed for GET method's URI; most

Re: How can a distributed Solr setup scale to TB-data, if URL limitations are 4000 for distributed shard search?

2012-01-18 Thread Daniel Bruegge
on the totally wrong track? Daniel On Thu, Jan 19, 2012 at 12:14 AM, Mark Miller markrmil...@gmail.com wrote: You can raise the limit to a point. On Jan 18, 2012, at 5:59 PM, Daniel Bruegge wrote: Hi, I am just wondering how I can 'grow' a distributed Solr setup to an index size of a couple

really slow performance when trying to get facet.field

2012-01-17 Thread Daniel Bruegge
Hi, I have 2 Solr-shards. One is filled with approx. 25mio documents (local index 6GB), the other with 10mio documents (2.7GB size). I am trying to create some kind of 'word cloud' to see the frequency of words for a *text_general *field. For this I am currently using a facet over this field and

Re: really slow performance when trying to get facet.field

2012-01-17 Thread Daniel Bruegge
of these can be interconnected. Dmitry On Tue, Jan 17, 2012 at 2:49 PM, Daniel Bruegge daniel.brue...@googlemail.com wrote: Hi, I have 2 Solr-shards. One is filled with approx. 25mio documents (local index 6GB), the other with 10mio documents (2.7GB size). I am trying to create some

Re: really slow performance when trying to get facet.field

2012-01-17 Thread Daniel Bruegge
of server is it, in terms of CPU and OS? How often do you commit to the index? Dmitry On Tue, Jan 17, 2012 at 3:01 PM, Daniel Bruegge daniel.brue...@googlemail.com wrote: Hi Dmitry, I had everything on one Solr Instance before, but this got to heavy and I had the same issue here

Re: really slow performance when trying to get facet.field

2012-01-17 Thread Daniel Bruegge
of server is it, in terms of CPU and OS? How often do you commit to the index? Dmitry On Tue, Jan 17, 2012 at 3:01 PM, Daniel Bruegge daniel.brue...@googlemail.com wrote: Hi Dmitry, I had everything on one Solr Instance before, but this got to heavy and I had the same issue here

Re: really slow performance when trying to get facet.field

2012-01-17 Thread Daniel Bruegge
str name=facet.mincount1/str /lst /arr /listener On Tue, Jan 17, 2012 at 2:36 PM, Daniel Bruegge daniel.brue...@googlemail.com wrote: Evictions are 0 for all cache types. Your server max heap space with 12G is pretty huge. Which is good I think. The CPU on my