[
https://issues.apache.org/jira/browse/LUCENE-1205?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Rajesh Srinivasan updated LUCENE-1205:
--------------------------------------
Description:
The below exception starts occuring when my application tries to update index
of consumers.
When all consumers are rebuild, the indexes are not updated and all threads of
apache is occupied by this error.
So I need to restart my tomcat every time and this happens for every 4 hours.
I saw some issues related in JIRA but when I used links to go to bugzilla it
never works.
It would be great if some explanation is given.
For setting ulimit in linux it is told that it should be (1+mergeFactor) *
FilesPerSegment.
We have mergeFactor of 10.
We are also not clear on what is FilesPerSegment
Below is the stack trace which comes continuosly
06.03.2008 10:25:02 [ERROR] MQ Consumer (Index.Update)
com.unilever.brandcom.sdse.services.index.IndexUpdateConsumer []:
Got solr server exception:
org.apache.solr.client.exception.SolrServerException: Server returned non-zero
status:
Caused by:
Server side exception, status = 1: java.io.FileNotFoundException:
/data/tomcats/tomcat-public/solr/data/index/_1u5.nrm (Too many open files)
at java.io.RandomAccessFile.open(Native Method)
at java.io.RandomAccessFile.<init>(RandomAccessFile.java:212)
at org.apache.lucene.store.FSIndexInput$Descriptor.<init>(FSDirectory.java:497)
at org.apache.lucene.store.FSIndexInput.<init>(FSDirectory.java:522)
at org.apache.lucene.store.FSDirectory.openInput(FSDirectory.java:434)
at org.apache.lucene.index.SegmentReader.openNorms(SegmentReader.java:503)
at org.apache.lucene.index.SegmentReader.initialize(SegmentReader.java:183)
at org.apache.lucene.index.SegmentReader.get(SegmentReader.java:140)
at org.apache.lucene.index.SegmentReader.get(SegmentReader.java:121)
at org.apache.lucene.index.IndexReader$1.doBody(IndexReader.java:166)
at
org.apache.lucene.index.SegmentInfos$FindSegmentsFile.run(SegmentInfos.java:579)
at org.apache.lucene.index.IndexReader.open(IndexReader.java:147)
at org.apache.lucene.index.IndexReader.open(IndexReader.java:131)
at org.apache.solr.search.SolrIndexSearcher.<init>(SolrIndexSearcher.java:86)
at org.apache.solr.core.SolrCore.newSearcher(SolrCore.java:117)
at
org.apache.solr.update.DirectUpdateHandler2.openSearcher(DirectUpdateHandler2.java:199)
at
org.apache.solr.update.DirectUpdateHandler2.doDeletions(DirectUpdateHandler2.java:423)
at
org.apache.solr.update.DirectUpdateHandler2.commit(DirectUpdateHandler2.java:496)
at
org.apache.solr.handler.XmlUpdateRequestHandler.update(XmlUpdateRequestHandler.java:225)
at
org.apache.solr.handler.XmlUpdateRequestHandler.doLegacyUpdate(XmlUpdateRequestHandler.java:366)
at org.apache.solr.servlet.SolrUpdateServlet.doPost(SolrUpdateServlet.java:58)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:709)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:802)
at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:252)
at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173)
at com.freiheit.commons.sensor.PerformanceLogFilter.doFilter(Unknown Source)
at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:202)
at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173)
at
org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:213)
at
org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:178)
at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:126)
at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:105)
at
org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:107)
at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:148)
at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:869)
at
org.apache.coyote.http11.Http11BaseProtocol$Http11ConnectionHandler.processConnection(Http11BaseProtocol.java:664)
at
org.apache.tomcat.util.net.PoolTcpEndpoint.processSocket(PoolTcpEndpoint.java:527)
at
org.apache.tomcat.util.net.LeaderFollowerWorkerThread.runIt(LeaderFollowerWorkerThread.java:80)
at
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:684)
at java.lang.Thread.run(Thread.java:595)
After sending request:
<commit waitFlush="true" waitSearcher="true" />
at
org.apache.solr.client.impl.SolrClientImpl.postUpdateXml(SolrClientImpl.java:187)
at org.apache.solr.client.impl.SolrClientImpl.commit(SolrClientImpl.java:332)
at
com.unilever.brandcom.sdse.services.index.IndexUpdateConsumer.closeClient(IndexUpdateConsumer.java:114)
at
com.unilever.brandcom.sdse.services.index.IndexUpdateConsumer.solRCommit(IndexUpdateConsumer.java:83)
at
com.unilever.brandcom.sdse.services.index.IndexUpdateConsumer.checkForSolrCommit(IndexUpdateConsumer.java:75)
at
com.unilever.brandcom.sdse.services.index.IndexUpdateConsumer.onBeforeCommit(IndexUpdateConsumer.java:64)
at
com.unilever.brandcom.sdse.services.AbstractConsumer.run(AbstractConsumer.java:339)
at java.lang.Thread.run(Thread.java:595)
org.apache.solr.client.exception.SolrServerException: Server returned non-zero
status:
was:
06.03.2008 10:25:02 [ERROR] MQ Consumer (Index.Update)
com.unilever.brandcom.sdse.services.index.IndexUpdateConsumer []:
Got solr server exception:
org.apache.solr.client.exception.SolrServerException: Server returned non-zero
status:
Caused by:
Server side exception, status = 1: java.io.FileNotFoundException:
/data/tomcats/tomcat-public/solr/data/index/_1u5.nrm (Too many open files)
at java.io.RandomAccessFile.open(Native Method)
at java.io.RandomAccessFile.<init>(RandomAccessFile.java:212)
at org.apache.lucene.store.FSIndexInput$Descriptor.<init>(FSDirectory.java:497)
at org.apache.lucene.store.FSIndexInput.<init>(FSDirectory.java:522)
at org.apache.lucene.store.FSDirectory.openInput(FSDirectory.java:434)
at org.apache.lucene.index.SegmentReader.openNorms(SegmentReader.java:503)
at org.apache.lucene.index.SegmentReader.initialize(SegmentReader.java:183)
at org.apache.lucene.index.SegmentReader.get(SegmentReader.java:140)
at org.apache.lucene.index.SegmentReader.get(SegmentReader.java:121)
at org.apache.lucene.index.IndexReader$1.doBody(IndexReader.java:166)
at
org.apache.lucene.index.SegmentInfos$FindSegmentsFile.run(SegmentInfos.java:579)
at org.apache.lucene.index.IndexReader.open(IndexReader.java:147)
at org.apache.lucene.index.IndexReader.open(IndexReader.java:131)
at org.apache.solr.search.SolrIndexSearcher.<init>(SolrIndexSearcher.java:86)
at org.apache.solr.core.SolrCore.newSearcher(SolrCore.java:117)
at
org.apache.solr.update.DirectUpdateHandler2.openSearcher(DirectUpdateHandler2.java:199)
at
org.apache.solr.update.DirectUpdateHandler2.doDeletions(DirectUpdateHandler2.java:423)
at
org.apache.solr.update.DirectUpdateHandler2.commit(DirectUpdateHandler2.java:496)
at
org.apache.solr.handler.XmlUpdateRequestHandler.update(XmlUpdateRequestHandler.java:225)
at
org.apache.solr.handler.XmlUpdateRequestHandler.doLegacyUpdate(XmlUpdateRequestHandler.java:366)
at org.apache.solr.servlet.SolrUpdateServlet.doPost(SolrUpdateServlet.java:58)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:709)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:802)
at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:252)
at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173)
at com.freiheit.commons.sensor.PerformanceLogFilter.doFilter(Unknown Source)
at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:202)
at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173)
at
org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:213)
at
org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:178)
at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:126)
at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:105)
at
org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:107)
at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:148)
at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:869)
at
org.apache.coyote.http11.Http11BaseProtocol$Http11ConnectionHandler.processConnection(Http11BaseProtocol.java:664)
at
org.apache.tomcat.util.net.PoolTcpEndpoint.processSocket(PoolTcpEndpoint.java:527)
at
org.apache.tomcat.util.net.LeaderFollowerWorkerThread.runIt(LeaderFollowerWorkerThread.java:80)
at
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:684)
at java.lang.Thread.run(Thread.java:595)
After sending request:
<commit waitFlush="true" waitSearcher="true" />
at
org.apache.solr.client.impl.SolrClientImpl.postUpdateXml(SolrClientImpl.java:187)
at org.apache.solr.client.impl.SolrClientImpl.commit(SolrClientImpl.java:332)
at
com.unilever.brandcom.sdse.services.index.IndexUpdateConsumer.closeClient(IndexUpdateConsumer.java:114)
at
com.unilever.brandcom.sdse.services.index.IndexUpdateConsumer.solRCommit(IndexUpdateConsumer.java:83)
at
com.unilever.brandcom.sdse.services.index.IndexUpdateConsumer.checkForSolrCommit(IndexUpdateConsumer.java:75)
at
com.unilever.brandcom.sdse.services.index.IndexUpdateConsumer.onBeforeCommit(IndexUpdateConsumer.java:64)
at
com.unilever.brandcom.sdse.services.AbstractConsumer.run(AbstractConsumer.java:339)
at java.lang.Thread.run(Thread.java:595)
org.apache.solr.client.exception.SolrServerException: Server returned non-zero
status:
Environment: Linux , Tomcat 5.5
> java.io.FileNotFoundException:
> /data/tomcats/tomcat-public/solr/data/index/_1u5.nrm (Too many open files)
> ---------------------------------------------------------------------------------------------------------
>
> Key: LUCENE-1205
> URL: https://issues.apache.org/jira/browse/LUCENE-1205
> Project: Lucene - Java
> Issue Type: Bug
> Environment: Linux , Tomcat 5.5
> Reporter: Rajesh Srinivasan
> Priority: Blocker
>
> The below exception starts occuring when my application tries to update index
> of consumers.
> When all consumers are rebuild, the indexes are not updated and all threads
> of apache is occupied by this error.
> So I need to restart my tomcat every time and this happens for every 4 hours.
> I saw some issues related in JIRA but when I used links to go to bugzilla it
> never works.
> It would be great if some explanation is given.
> For setting ulimit in linux it is told that it should be (1+mergeFactor) *
> FilesPerSegment.
> We have mergeFactor of 10.
> We are also not clear on what is FilesPerSegment
> Below is the stack trace which comes continuosly
> 06.03.2008 10:25:02 [ERROR] MQ Consumer (Index.Update)
> com.unilever.brandcom.sdse.services.index.IndexUpdateConsumer []:
> Got solr server exception:
> org.apache.solr.client.exception.SolrServerException: Server returned
> non-zero status:
> Caused by:
> Server side exception, status = 1: java.io.FileNotFoundException:
> /data/tomcats/tomcat-public/solr/data/index/_1u5.nrm (Too many open files)
> at java.io.RandomAccessFile.open(Native Method)
> at java.io.RandomAccessFile.<init>(RandomAccessFile.java:212)
> at
> org.apache.lucene.store.FSIndexInput$Descriptor.<init>(FSDirectory.java:497)
> at org.apache.lucene.store.FSIndexInput.<init>(FSDirectory.java:522)
> at org.apache.lucene.store.FSDirectory.openInput(FSDirectory.java:434)
> at org.apache.lucene.index.SegmentReader.openNorms(SegmentReader.java:503)
> at org.apache.lucene.index.SegmentReader.initialize(SegmentReader.java:183)
> at org.apache.lucene.index.SegmentReader.get(SegmentReader.java:140)
> at org.apache.lucene.index.SegmentReader.get(SegmentReader.java:121)
> at org.apache.lucene.index.IndexReader$1.doBody(IndexReader.java:166)
> at
> org.apache.lucene.index.SegmentInfos$FindSegmentsFile.run(SegmentInfos.java:579)
> at org.apache.lucene.index.IndexReader.open(IndexReader.java:147)
> at org.apache.lucene.index.IndexReader.open(IndexReader.java:131)
> at org.apache.solr.search.SolrIndexSearcher.<init>(SolrIndexSearcher.java:86)
> at org.apache.solr.core.SolrCore.newSearcher(SolrCore.java:117)
> at
> org.apache.solr.update.DirectUpdateHandler2.openSearcher(DirectUpdateHandler2.java:199)
> at
> org.apache.solr.update.DirectUpdateHandler2.doDeletions(DirectUpdateHandler2.java:423)
> at
> org.apache.solr.update.DirectUpdateHandler2.commit(DirectUpdateHandler2.java:496)
> at
> org.apache.solr.handler.XmlUpdateRequestHandler.update(XmlUpdateRequestHandler.java:225)
> at
> org.apache.solr.handler.XmlUpdateRequestHandler.doLegacyUpdate(XmlUpdateRequestHandler.java:366)
> at org.apache.solr.servlet.SolrUpdateServlet.doPost(SolrUpdateServlet.java:58)
> at javax.servlet.http.HttpServlet.service(HttpServlet.java:709)
> at javax.servlet.http.HttpServlet.service(HttpServlet.java:802)
> at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:252)
> at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173)
> at com.freiheit.commons.sensor.PerformanceLogFilter.doFilter(Unknown Source)
> at
> org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:202)
> at
> org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173)
> at
> org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:213)
> at
> org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:178)
> at
> org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:126)
> at
> org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:105)
> at
> org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:107)
> at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:148)
> at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:869)
> at
> org.apache.coyote.http11.Http11BaseProtocol$Http11ConnectionHandler.processConnection(Http11BaseProtocol.java:664)
> at
> org.apache.tomcat.util.net.PoolTcpEndpoint.processSocket(PoolTcpEndpoint.java:527)
> at
> org.apache.tomcat.util.net.LeaderFollowerWorkerThread.runIt(LeaderFollowerWorkerThread.java:80)
> at
> org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:684)
> at java.lang.Thread.run(Thread.java:595)
> After sending request:
> <commit waitFlush="true" waitSearcher="true" />
> at
> org.apache.solr.client.impl.SolrClientImpl.postUpdateXml(SolrClientImpl.java:187)
> at org.apache.solr.client.impl.SolrClientImpl.commit(SolrClientImpl.java:332)
> at
> com.unilever.brandcom.sdse.services.index.IndexUpdateConsumer.closeClient(IndexUpdateConsumer.java:114)
> at
> com.unilever.brandcom.sdse.services.index.IndexUpdateConsumer.solRCommit(IndexUpdateConsumer.java:83)
> at
> com.unilever.brandcom.sdse.services.index.IndexUpdateConsumer.checkForSolrCommit(IndexUpdateConsumer.java:75)
> at
> com.unilever.brandcom.sdse.services.index.IndexUpdateConsumer.onBeforeCommit(IndexUpdateConsumer.java:64)
> at
> com.unilever.brandcom.sdse.services.AbstractConsumer.run(AbstractConsumer.java:339)
> at java.lang.Thread.run(Thread.java:595)
> org.apache.solr.client.exception.SolrServerException: Server returned
> non-zero status:
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
---------------------------------------------------------------------
To unsubscribe, e-mail: [EMAIL PROTECTED]
For additional commands, e-mail: [EMAIL PROTECTED]
