Montag, 1. September 2014 14:50
An: solr-user@lucene.apache.org
Betreff: Re: AW: Scaling to large Number of Collections
And I would add another suggested requirement - "dormant collections" -
collections which may once have been active, but have not seen any recent
activity and can h
r?
-- Jack Krupansky
-Original Message-
From: Christoph Schmidt
Sent: Monday, September 1, 2014 3:50 AM
To: solr-user@lucene.apache.org
Subject: AW: Scaling to large Number of Collections
Yes, this would help us in our scenario.
-Ursprüngliche Nachricht-
Von: Jack Krupansky [mailto
: solr-user@lucene.apache.org; Mark Miller
Betreff: Re: Scaling to large Number of Collections
Yeah, I second Mark's suggestion on reducing the stack size. The default on
modern 64-bit boxes is usually 1024KB which adds up to a lot when you're
running 5000 cores (5000 * 2 = 1MB). I th
Yes, this would help us in our scenario.
-Ursprüngliche Nachricht-
Von: Jack Krupansky [mailto:j...@basetechnology.com]
Gesendet: Sonntag, 31. August 2014 18:10
An: solr-user@lucene.apache.org
Betreff: Re: Scaling to large Number of Collections
We should also consider "lightly-sh
ing a new "user-id" field and combining user
collections.
Best
Christoph
-Ursprüngliche Nachricht-
Von: Erick Erickson [mailto:erickerick...@gmail.com]
Gesendet: Sonntag, 31. August 2014 18:04
An: solr-user@lucene.apache.org
Betreff: Re: Scaling to large Number of Collections
W
engar [mailto:andyetitmo...@gmail.com]
Gesendet: Sonntag, 31. August 2014 17:53
An: solr-user@lucene.apache.org
Betreff: Re: Scaling to large Number of Collections
On 31 Aug 2014 13:24, "Mark Miller" wrote:
>
>
> > On Aug 31, 2014, at 4:04 AM, Christoph Schmidt <
christo
31, 2014 at 8:23 AM, Mark Miller wrote:
>
> > On Aug 31, 2014, at 4:04 AM, Christoph Schmidt <
> christoph.schm...@moresophy.de> wrote:
> >
> > we see at least two problems when scaling to large number of
> collections. I would like to ask the community, if th
Is there a Jira task for this?
Thanks
Christoph
-Ursprüngliche Nachricht-
Von: Mark Miller [mailto:markrmil...@gmail.com]
Gesendet: Sonntag, 31. August 2014 14:24
An: solr-user
Betreff: Re: Scaling to large Number of Collections
> On Aug 31, 2014, at 4:04 AM, Christoph Schm
; On 31 Aug 2014 13:24, "Mark Miller" wrote:
> > >
> > >
> > > > On Aug 31, 2014, at 4:04 AM, Christoph Schmidt <
> > christoph.schm...@moresophy.de> wrote:
> > > >
> > > > we see at least two problems when scaling to large numb
t; > > On Aug 31, 2014, at 4:04 AM, Christoph Schmidt <
> christoph.schm...@moresophy.de> wrote:
> > >
> > > we see at least two problems when scaling to large number of
> collections. I would like to ask the community, if they are known and maybe
> already ad
apache.org
Subject: Re: Scaling to large Number of Collections
What is your access pattern? By that I mean do all the cores need to be
searched at the same time or is it reasonable for them to be loaded on
demand? This latter would impose the penalty of the first time a collection
was accessed there
From: Christoph Schmidt
Sent: Sunday, August 31, 2014 11:44 AM
To: solr-user@lucene.apache.org
Subject: AW: Scaling to large Number of Collections
One collection has 2 replicas, no sharding, the collections are not that
big.
No, they are unfortunately not independent. There are collec
What is your access pattern? By that I mean do all the cores need to be
searched at the same time or is it reasonable for them to be loaded on
demand? This latter would impose the penalty of the first time a collection
was accessed there would be a delay while the core loaded. I suppose I'm
asking
On 31 Aug 2014 13:24, "Mark Miller" wrote:
>
>
> > On Aug 31, 2014, at 4:04 AM, Christoph Schmidt <
christoph.schm...@moresophy.de> wrote:
> >
> > we see at least two problems when scaling to large number of
collections. I would like to ask the commun
gle SolrCloud cluster" is
not a supported scenario at this time. Certainly suggestions for future
enhancement can be made though.
-- Jack Krupansky
-Original Message-
From: Christoph Schmidt
Sent: Sunday, August 31, 2014 4:04 AM
To: solr-user@lucene.apache.org
Subject: Scaling to l
On 8/31/2014 8:58 AM, Joseph Obernberger wrote:
> Could you add another field(s) to your application and use that instead of
> creating collections/cores? When you execute a search, instead of picking
> a core, just search a single large core but add in a field which contains
> some core ID.
This
at 8:23 AM, Mark Miller wrote:
>
> > On Aug 31, 2014, at 4:04 AM, Christoph Schmidt <
> christoph.schm...@moresophy.de> wrote:
> >
> > we see at least two problems when scaling to large number of
> collections. I would like to ask the community, if they are known
> On Aug 31, 2014, at 4:04 AM, Christoph Schmidt
> wrote:
>
> we see at least two problems when scaling to large number of collections. I
> would like to ask the community, if they are known and maybe already
> addressed in development:
> We have a SolrCloud runni
is
not a supported scenario at this time. Certainly suggestions for future
enhancement can be made though.
-- Jack Krupansky
-Original Message-
From: Christoph Schmidt
Sent: Sunday, August 31, 2014 4:04 AM
To: solr-user@lucene.apache.org
Subject: Scaling to large Number of Collections
we se
we see at least two problems when scaling to large number of collections. I
would like to ask the community, if they are known and maybe already addressed
in development:
We have a SolrCloud running with the following numbers:
- 5 Servers (each 24 CPUs, 128 RAM)
- 13.000
20 matches
Mail list logo
