I've actually run into this issue; huge, 30 minute warm up times. I've
found that reducing the auto-warm count on caches (and the general size
of the cache) helped a -lot-, as did making sure my warm up query wasn't
something like:
q=*:*&facet=true&facet.field=somethingWithAWholeLotOfTerms
Tune your warm up queries so they are a bit more conservative, and you
should be fine. Don't warm facets on fields with a billion terms, and
make sure your application makes effective use of query and faceting. I
warm an index with ~30 /million/ records in about 50 seconds, and I'm
pretty sure I could do better!
Hope this helps!
On 2/17/2010 12:29 AM, Lance Norskog wrote:
These are some very large numbers. 700k ms is 70 seconds, 4M ms is 4k
seconds or 66 minutes. No Solr installation should take this long to
warm up.
There is something very wrong here. Have you optimized lately? What
queries do you run to warm it up? And, the basics: how many documents,
how much data per document, how much disk space is the index?
On Tue, Feb 16, 2010 at 3:02 AM, Bohnsack, Sven
<sven.bohns...@shopping24.de> wrote:
Hi Shalin!
Thanks for quick response. Sadly it tells me, that i have to look elsewhere to
fix the problem.
Anyone an idea what could cause the increasing warmup-Times? If required I can
post some stats.
Thanking you in anticipation!
Regards,
Sven
Feed: Solr-Mailing-List
Bereitgestellt am: Dienstag, 16. Februar 2010 09:05
Autor: Shalin Shekhar Mangar<shalinman...@gmail.com>
Betreff: Re: Performance-Issues and raising numbers of "cumulative inserts"
On Tue, Feb 16, 2010 at 1:06 PM, Bohnsack, Sven<sven.bohns...@shopping24.de> wrote:> Hey IT-Crowd!> > I'm dealing with some
performance issues during warmup the> queryResultCache. Normally it tooks about 11 Minutes (~700.000 ms), but> now it tooks about 4
MILLION and more ms. All I can see in the solr.log> ist that the number of cumulative_inserts ascends from from ~250.000 to>
~670.000.> > I asked Google about the cumulative_inserts, but did not get an answer.> Can anyone tell me what "cumulative
inserts" are and what they stand> for? What does it mean, if the number of such inserts raises?> > cumulative_inserts are the
total number of inserts into the cache since Solr started up. The "inserts" shows the number of inserts since the last commit. --
Regards, Shalin Shekhar Mangar.
Artikel
anzeigen...<http://mail-archives.apache.org/mod_mbox/lucene-solr-user/201002.mbox/%3c69de18141002160004p2f34680ase9eabfc5d0bab...@mail.gmail.com%3e>
