But that means that it can't fit all documents in the cache, doesn't
it? The index is 12GB and your allocated heap is 6GB... 12GB > 6GB...
/Jimi
Quoting gurudev <[EMAIL PROTECTED]>:
Just to add more:
The JVM heap allocated is 6GB with initial heap size as 2GB. We use
quadro(which is 8 cpus) on linux servers for SOLR slaves.
We use facet searches, sorting.
document cache is set to 7 million (which is total documents in index)
filtercache 10000
gurudev wrote:
Hi
We currently host index of size approx 12GB on 5 SOLR slaves machines,
which are load balanced under cluster. At some point of time, which is
after 8-10 hours, some SOLR slave would give Out of memory error, after
which it just stops responding, which then requires restart and after
restart it works perfectly. Sometimes we notice long query processing time
of specific SOLR slaves after which we restart just to avoid any
forthcoming problem. Can anyone suggest how to avoid OOM problem. Out
slave SOLR are read only and we do the incremental updations during night
only. Below is the snapshot of error we get as OOM:
SEVERE: java.lang.OutOfMemoryError: Java heap space
at org.apache.solr.util.OpenBitSet.<init>(OpenBitSet.java:87)
at
org.apache.solr.search.DocSetHitCollector.collect(DocSetHitCollector.java:61)
at
org.apache.solr.search.SolrIndexSearcher$9.collect(SolrIndexSearcher.java:1064)
at
org.apache.lucene.search.BooleanScorer2.score(BooleanScorer2.java:292)
at
org.apache.lucene.search.IndexSearcher.search(IndexSearcher.java:133)
at org.apache.lucene.search.Searcher.search(Searcher.java:117)
at org.apache.lucene.search.Searcher.search(Searcher.java:96)
at
org.apache.solr.search.SolrIndexSearcher.getDocListAndSetNC(SolrIndexSearcher.java:1061)
at
org.apache.solr.search.SolrIndexSearcher.getDocListC(SolrIndexSearcher.java:801)
at
org.apache.solr.search.SolrIndexSearcher.getDocListAndSet(SolrIndexSearcher.java:1237)
at
org.apache.solr.request.DisMaxRequestHandler.handleRequestBody(DisMaxRequestHandler.java:315)
at
org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:77)
at org.apache.solr.core.SolrCore.execute(SolrCore.java:658)
at
org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:191)
at
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:159)
at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:202)
at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173)
at
org.jboss.web.tomcat.filters.ReplyHeaderFilter.doFilter(ReplyHeaderFilter.java:96)
at
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:202)
at
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:173)
at
org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:213)
at
org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:178)
at
org.jboss.web.tomcat.security.SecurityAssociationValve.invoke(SecurityAssociationValve.java:175)
at
org.jboss.web.tomcat.security.JaccContextValve.invoke(JaccContextValve.java:74)
at
org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:126)
at
org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:105)
at
org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:107)
at
org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:148)
at
org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:869)
at
org.apache.coyote.http11.Http11BaseProtocol$Http11ConnectionHandler.processConnection(Http11BaseProtocol.java:664)
at
org.apache.tomcat.util.net.PoolTcpEndpoint.processSocket(PoolTcpEndpoint.java:527)
at
org.apache.tomcat.util.net.MasterSlaveWorkerThread.run(MasterSlaveWorkerThread.java:112)
--
View this message in context:
http://www.nabble.com/SOLR-OOM-%28out-of-memory%29-problem-tp17364146p17364150.html
Sent from the Solr - User mailing list archive at Nabble.com.
