Ah sorry - didn't realize attachments were stripped. Here's a web version: http://img.skitch.com/20100108-t99a1emmar32w9gkcfcius8afm.png
-Peter On Thu, Jan 7, 2010 at 9:53 PM, Otis Gospodnetic <otis_gospodne...@yahoo.com> wrote: > I'd love to see the screenshot, but it didn't come through - got stripped by > ML manager. Maybe upload it somewhere? > Otis > -- > Sematext -- http://sematext.com/ -- Solr - Lucene - Nutch > > > > ----- Original Message ---- >> From: Peter Wolanin <peter.wola...@acquia.com> >> To: solr-user@lucene.apache.org >> Sent: Thu, January 7, 2010 9:32:26 PM >> Subject: Re: Solr 1.4 - stats page slow >> >> I recently noticed the same sort of thing. >> >> The attached screenshot shows the transition on a search server >> when we updated from a Solr 1.4 dev build (revision 779609 from >> 2009-05-28) to the Solr 1.4.0 released code. Every 3 hours we have a >> cron task to log some of the data from the stats.jsp page from each >> core (about 100 cores, most of which are small indexes). >> >> You can see there is a dramatic spiking of the load after the update - >> I think due to added reporting on that page such as from the lucene >> field cache. Is this amount of load expected? >> >> -Peter >> >> On Thu, Dec 24, 2009 at 12:23 PM, Jay Hill wrote: >> > Also, what is your heap size and the amount of RAM on the machine? >> > >> > I've also noticed that, when watching memory usage through JConsole or >> > YourKit while loading the stats page, the memory usage spikes dramatically >> > - >> > are you seeing this as well? >> > >> > -Jay >> > >> > On Thu, Dec 24, 2009 at 9:12 AM, Jay Hill wrote: >> > >> >> I've noticed this as well, usually when working with a large field cache. >> >> I >> >> haven't done in-depth analysis of this yet, but it seems like when the >> >> stats >> >> page is trying to pull data from a large field cache it takes quite a long >> >> time. >> >> >> >> Are you doing a lot of sorting? If so, what are the field types of the >> >> fields you're sorting on? How large is the index both in document count >> >> and >> >> file size? >> >> >> >> Another approach to get data from the Solr instance would be to use JMX. >> >> And I've been working on a request handler (started by Erik Hatcher) that >> >> will provide the same information as the stats page, but a little more >> >> efficiently. I may try to put up a patch with this soon. >> >> >> >> -Jay >> >> >> >> >> >> >> >> On Wed, Dec 23, 2009 at 6:43 AM, Stephen Weiss wrote: >> >> >> >>> We've been using Solr 1.4 for a few days now and one slight downside >> >>> we've >> >>> noticed is the stats page comes up very slowly for some reason - >> >>> sometimes >> >>> more than 10 seconds. We call this programmatically to retrieve the last >> >>> commit date so that we can keep users from committing too frequently. >> >>> This >> >>> means some of our administration pages are now taking a long time to >> >>> load. >> >>> Is there anything we should be doing to ensure that this page comes up >> >>> quickly? I see some notes on this back in October but it looks like that >> >>> update should already be applied by now. Or, better yet, is there now a >> >>> better way to just retrieve the last commit date from Solr without >> >>> pulling >> >>> all of the statistics? >> >>> >> >>> Thanks in advance. >> >>> >> >>> -- >> >>> Steve >> >>> >> >> >> >> >> > >> >> >> >> -- >> Peter M. Wolanin, Ph.D. >> Momentum Specialist, Acquia. Inc. >> peter.wola...@acquia.com > > -- Peter M. Wolanin, Ph.D. Momentum Specialist, Acquia. Inc. peter.wola...@acquia.com
