Re: No response from Solr on complex request after several days

[Xavier Schepler]

On 29/10/2010 12:08, Lance Norskog wrote:
There are a few problems that can happen. This is usually a sign of
garbage collection problems.
You can monitor the Tomcat instance with JConsole or one of the other
java monitoring tools and see if there is a memory leak.
Also, most people don't need to do it, but you can automatically
restart it once a day.

On Thu, Oct 28, 2010 at 2:20 AM, Xavier Schepler
<xavier.schep...@sciences-po.fr>  wrote:
   
Hi,

We are in a beta testing phase, with several users a day.

After several days of waiting, the solr server didn't respond to requests
that require a lot of processing time.

I'm using Solr inside Tomcat.

This is the request that had no response from the server :

wt=json&omitHeader=true&q=qiAndMSwFR%3A%28transport%29&q.op=AND&start=0&rows=5&fl=id,domainId,solrLangCode,ddiFileId,studyDescriptionId,studyYearAndDescriptionId,nesstarServerId,studyNesstarId,variableId,questionId,variableNesstarId,concept,studyTitle,studyQuestionCount,hasMultipleItems,variableName,hasQuestionnaire,questionnaireUrl,studyDescriptionUrl,universe,notes,preQuestionText,postQuestionText,interviewerInstructions,questionPosition,vlFR,qFR,iFR,mFR,vlEN,qEN,iEN,mEN,&sort=score%20desc&fq=solrLangCode%3AFR&facet=true&facet.field=%7B%21ex%3DstudySerieIds%2Cdecades%2CstudyIds%2CqueryFilters%2CconceptIds%2CdomainIds%7DdomainId&facet.field=%7B%21ex%3DstudySerieIds%2Cdecades%2CstudyIds%2CqueryFilters%2CconceptIds%2CdomainIds%7DstudyDecade&facet.field=%7B%21ex%3DstudySerieIds%2Cdecades%2CstudyIds%2CqueryFilters%2CconceptIds%2CdomainIds%7DstudySerieId&facet.field=%7B%21ex%3DstudySerieIds%2Cdecades%2CstudyIds%2CqueryFilters%2CconceptIds%2CdomainIds%7DstudyYearAndDescriptionId&facet.sort=count&f.studyDecade.facet.sort=lex&spellcheck=true&spellcheck.count=10&spellcheck.dictionary=qiAndMFR&spellcheck.q=transport&hl=on&hl.fl=qSwFR,iHLSwFR,mHLSwFR&hl.fragsize=0&hl.snippets=10000&hl.usePhraseHighlighter=true&hl.highlightMultiTerm=true&hl.simple.pre=%3Cb%3E&hl.simple.post=%3C%2Fb%3E&hl.mergeContiguous=false

It involves highlighting on a multivalued field with more than 600 short
values inside. It takes 200 or 300 ms because of highlighting.

After restarting tomcat all went fine again.

I'm trying to understand why I had to restart tomcat and solr and what
should I do to have it working 7/7 24/24.

Xavier



     


   
Thanks for your response.
Today, I've increased the Tomcat JVM heap size from 128-256 to 
1024-2048. I will see if it helps.