On 7/31/2014 12:58 AM, shuss...@del.aithent.com wrote:
> Thanks for giving great explanation about the memory requirements. Could you
> tell be what all parameters that I need to change in my SolrConfig.xml to
> handle large index size. What are the optimal values that I need to use.
>
> My index
ex (I'm presuming this is doable in solr cloud, but I haven't put it to
> task yet). If I could purpose Hadoop to index the shards, that would be
> ideal, though I haven't quite figured out how to go about it yet.
>
> David
>
>
> -Original Message-----
>
Friday, April 19, 2013 9:42 PM
To: solr-user@lucene.apache.org
Subject: Re: SolrCloud loadbalancing, replication, and failover
On 4/19/2013 3:48 AM, David Parks wrote:
> The Physical Memory is 90% utilized (21.18GB of 23.54GB). Solr has
> dark grey allocation of 602MB, and light grey of an
On 4/19/2013 3:48 AM, David Parks wrote:
> The Physical Memory is 90% utilized (21.18GB of 23.54GB). Solr has dark grey
> allocation of 602MB, and light grey of an additional 108MB, for a JVM total
> of 710MB allocated. If I understand correctly, Solr memory utilization is
> *not* for caching (unle
Sent: Friday, April 19, 2013 5:17 PM
To: solr-user@lucene.apache.org
Subject: Re: SolrCloud loadbalancing, replication, and failover
On Fri, 2013-04-19 at 06:51 +0200, Shawn Heisey wrote:
> Using SSDs for storage can speed things up dramatically and may reduce
> the total memory requirement to
On Fri, 2013-04-19 at 06:51 +0200, Shawn Heisey wrote:
> Using SSDs for storage can speed things up dramatically and may reduce
> the total memory requirement to some degree,
We have been using SSDs for several years in our servers. It is our
clear experience that "to some degree" should be replac
day, April 19, 2013 4:19 PM
To: solr-user@lucene.apache.org
Subject: Re: SolrCloud loadbalancing, replication, and failover
On 4/19/2013 2:15 AM, David Parks wrote:
> Interesting. I'm trying to correlate this new understanding to what I
> see on my servers. I've got one server
On 4/19/2013 2:15 AM, David Parks wrote:
> Interesting. I'm trying to correlate this new understanding to what I see on
> my servers. I've got one server with 5GB dedicated to solr, solr dashboard
> reports a 167GB index actually.
>
> When I do many typical queries I see between 3MB and 9MB of di
On 4/19/2013 1:34 AM, John Nielsen wrote:
> Well, to consume 120GB of RAM with a 120GB index, you would have to query
> over every single GB of data.
>
> If you only actually query over, say, 500MB of the 120GB data in your dev
> environment, you would only use 500MB worth of RAM for caching. Not
red correctly here?
Dave
-Original Message-
From: John Nielsen [mailto:j...@mcb.dk]
Sent: Friday, April 19, 2013 2:35 PM
To: solr-user@lucene.apache.org
Subject: Re: SolrCloud loadbalancing, replication, and failover
Well, to consume 120GB of RAM with a 120GB index, you would have to q
thing? In a dev environment, I didn't notice SOLR
> consuming the full 5GB of RAM assigned to it with a 120GB index.
>
> Dave
>
>
> -Original Message-----
> From: Shawn Heisey [mailto:s...@elyograg.org]
> Sent: Friday, April 19, 2013 11:51 AM
> To: solr-user@
---Original Message-
From: Shawn Heisey [mailto:s...@elyograg.org]
Sent: Friday, April 19, 2013 11:51 AM
To: solr-user@lucene.apache.org
Subject: Re: SolrCloud loadbalancing, replication, and failover
On 4/18/2013 8:12 PM, David Parks wrote:
> I think I still don't understand something h
On 4/18/2013 8:12 PM, David Parks wrote:
> I think I still don't understand something here.
>
> My concern right now is that query times are very slow for 120GB index (14s
> on avg), I've seen a lot of disk activity when running queries.
>
> I'm hoping that distributing that query across 2 serve
ly be many to try to
work our query times down from 14s to what I want to be around 1s.
Dave
-Original Message-
From: Timothy Potter [mailto:thelabd...@gmail.com]
Sent: Thursday, April 18, 2013 9:16 PM
To: solr-user@lucene.apache.org
Subject: Re: SolrCloud loadbalancing, replication, and
Dave
>
>
>
> -Original Message-
> From: Otis Gospodnetic [mailto:otis.gospodne...@gmail.com]
> Sent: Thursday, April 18, 2013 8:13 PM
> To: solr-user@lucene.apache.org
> Subject: Re: SolrCloud loadbalancing, replication, and failover
>
> Correct. This is what
is Gospodnetic [mailto:otis.gospodne...@gmail.com]
Sent: Thursday, April 18, 2013 8:13 PM
To: solr-user@lucene.apache.org
Subject: Re: SolrCloud loadbalancing, replication, and failover
Correct. This is what you want if server 2 goes down.
Otis
Solr & ElasticSearch Support
http://sematext.com/
Correct. This is what you want if server 2 goes down.
Otis
Solr & ElasticSearch Support
http://sematext.com/
On Apr 18, 2013 3:11 AM, "David Parks" wrote:
> Step 1: distribute processing
>
> We have 2 servers in which we'll run 2 SolrCloud instances on.
>
> We'll define 2 shards so that both ser
17 matches
Mail list logo
