Have you looked at the garbage collector statistics? I've experienced this kind
of issues in the past
and I was getting huge spikes when the GC was doing its job.
On 2010-06-09, at 10:52 AM, Paul wrote:
> Hi all,
>
> In my app, it seems like solr has become slower over time. The index
> has grown a bit, and there are probably a few more people using the
> site, but the changes are not drastic.
>
> I notice that when a solr search is made, the amount of cpu and ram
> spike precipitously.
>
> I notice in the solr log, a bunch of entries in the same second that end in:
>
> status=0 QTime=212
> status=0 QTime=96
> status=0 QTime=44
> status=0 QTime=276
> status=0 QTime=8552
> status=0 QTime=16
> status=0 QTime=20
> status=0 QTime=56
>
> and then:
>
> status=0 QTime=315919
> status=0 QTime=325071
>
> My questions: How do I figure out what to fix? Do I need to start java
> with more memory? How do I tell what is the correct amount of memory
> to use? Is there something particularly inefficient about something
> else in my configuration, or the way I'm formulating the solr request,
> and how would I narrow down what it could be? I can't tell, but it
> seems like it happens after solr has been running unattended for a
> little while. Should I have a cron job that restarts solr every day?
> Could the solr process be starved by something else on the server
> (although -- the only other thing that is particularly running is
> apache/passenger/rails app)?
>
> In other words, I'm at a total loss about how to fix this.
>
> Thanks!
>
> P.S. In case this helps, here's the exact log entry for the first item
> that failed:
>
> Jun 9, 2010 1:02:52 PM org.apache.solr.core.SolrCore execute
> INFO: [resources] webapp=/solr path=/select
> params={hl.fragsize=600&facet.missing=true&facet=false&facet.mincount=1&ids=http://pm.nlx.com/xtf/view?docId%3Dshelley/shelley.04.xml;chunk.id%3Ddiv.ww.shelleyworks.v4.44,http://pm.nlx.com/xtf/view?docId%3Dshelley/shelley.06.xml;chunk.id%3Ddiv.ww.shelleyworks.v6.67,http://pm.nlx.com/xtf/view?docId%3Dtennyson_c/tennyson_c.02.xml;chunk.id%3Ddiv.tennyson.v2.1115,http://pm.nlx.com/xtf/view?docId%3Dmarx/marx.39.xml;chunk.id%3Ddiv.marx.engels.39.325,http://pm.nlx.com/xtf/view?docId%3Dshelley_j/shelley_j.01.xml;chunk.id%3Ddiv.ww.shelley.journals.v1.80,http://pm.nlx.com/xtf/view?docId%3Deliot/eliot.01.xml;chunk.id%3Ddiv.eliot.novels.bede.116,http://pm.nlx.com/xtf/view?docId%3Deliot/eliot.01.xml;chunk.id%3Ddiv.eliot.novels.bede.115,http://pm.nlx.com/xtf/view?docId%3Deliot/eliot.01.xml;chunk.id%3Ddiv.eliot.novels.bede.75,http://pm.nlx.com/xtf/view?docId%3Deliot/eliot.01.xml;chunk.id%3Ddiv.eliot.novels.bede.76,http://pm.nlx.com/xtf/view?docId%3Demerson/emerson.05.xml;chunk.id%3Dralph.waldo.v5.d083,http://pm.nlx.com/xtf/view?docId%3Dshelley/shelley.04.xml;chunk.id%3Ddiv.ww.shelleyworks.v4.31,http://pm.nlx.com/xtf/view?docId%3Dshelley_j/shelley_j.01.xml;chunk.id%3Ddiv.ww.shelley.journals.v1.88,http://pm.nlx.com/xtf/view?docId%3Deliot/eliot.03.xml;chunk.id%3Ddiv.eliot.romola.48&facet.limit=-1&hl.fl=text&hl.maxAnalyzedChars=512000&wt=javabin&hl=true&rows=30&version=1&fl=uri,archive,date_label,genre,source,image,thumbnail,title,alternative,url,role_ART,role_AUT,role_EDT,role_PBL,role_TRL,role_EGR,role_ETR,role_CRE,freeculture,is_ocr,federation,has_full_text,source_xml,uri&start=0&q=(*:*+AND+(life)+AND+(death)+AND+(of)+AND+(jason)+AND+federation:NINES)+OR+(*:*+AND+(life)+AND+(death)+AND+(of)+AND+(jason)+AND+federation:NINES+-genre:Citation)^5&facet.field=genre&facet.field=archive&facet.field=freeculture&facet.field=has_full_text&facet.field=federation&isShard=true&fq=year:"1882"}
> status=0 QTime=315919
