I've set the maxFieldLength to the maximum because I'm indexing documents which can be quite big:

    <maxFieldLength>2147483647</maxFieldLength>

Load average is about 0.9 but CPU is running at 35% percent. Probably because tika has to extract the documents

The virtual machine is having 4 CPU's (2.67GHz each) with 12 GB of memory. Tomcat is configured like this:
-Xms2048M -Xmx4096M

If you need more information, please let me know!

On 06/27/2012 03:09 PM, Li Li wrote:

seems that the indexwriter wants to flush but need to wait others become idle. but i see you the n gram filter is working. is your field's value too long? you sould also tell us average load the system. the free memory and memory used by jvm

在 2012-6-27 晚上7:51,"Arkadi Colson" <ark...@smartbit.be <mailto:ark...@smartbit.be>> 写道:

    Anybody an idea?

    The thread Dump looks like this:

    Full thread dump Java HotSpot(TM) 64-Bit Server VM (20.1-b02 mixed
    mode):

    "http-8983-6" daemon prio=10 tid=0x0000000041126000 nid=0x5c1 in
    Object.wait() [0x00007fa0ad197000]
      java.lang.Thread.State: WAITING (on object monitor)
           at java.lang.Object.wait(Native Method)
           - waiting on <0x000000070abf4ad0> (a
    org.apache.tomcat.util.net
    <http://org.apache.tomcat.util.net>.JIoEndpoint$Worker)
           at java.lang.Object.wait(Object.java:485)
           at org.apache.tomcat.util.net
    
<http://org.apache.tomcat.util.net>.JIoEndpoint$Worker.await(JIoEndpoint.java:458)
           - locked <0x000000070abf4ad0> (a org.apache.tomcat.util.net
    <http://org.apache.tomcat.util.net>.JIoEndpoint$Worker)
           at org.apache.tomcat.util.net
    
<http://org.apache.tomcat.util.net>.JIoEndpoint$Worker.run(JIoEndpoint.java:484)
           at java.lang.Thread.run(Thread.java:662)

    "pool-4-thread-1" prio=10 tid=0x00007fa0a054d800 nid=0x5be waiting
    on condition [0x00007f9f962f4000]
      java.lang.Thread.State: WAITING (parking)
           at sun.misc.Unsafe.park(Native Method)
           - parking to wait for  <0x0000000702598b30> (a
    java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
           at
    java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)
           at
    
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)
           at java.util.concurrent.DelayQueue.take(DelayQueue.java:160)
           at
    
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:609)
           at
    
java.util.concurrent.ScheduledThreadPoolExecutor$DelayedWorkQueue.take(ScheduledThreadPoolExecutor.java:602)
           at
    java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
           at
    
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
           at java.lang.Thread.run(Thread.java:662)

    "http-8983-5" daemon prio=10 tid=0x00000000412d2800 nid=0x5bd
    runnable [0x00007f9f94171000]
      java.lang.Thread.State: RUNNABLE
           at java.net.SocketInputStream.socketRead0(Native Method)
           at java.net.SocketInputStream.read(SocketInputStream.java:129)
           at
    
org.apache.coyote.http11.InternalInputBuffer.fill(InternalInputBuffer.java:735)
           at
    
org.apache.coyote.http11.InternalInputBuffer.parseRequestLine(InternalInputBuffer.java:366)
           at
    org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:814)
           at
    
org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:602)
           at org.apache.tomcat.util.net
    
<http://org.apache.tomcat.util.net>.JIoEndpoint$Worker.run(JIoEndpoint.java:489)
           at java.lang.Thread.run(Thread.java:662)

    "http-8983-4" daemon prio=10 tid=0x0000000041036000 nid=0x5b1 in
    Object.wait() [0x00007f9f966c9000]
      java.lang.Thread.State: WAITING (on object monitor)
           at java.lang.Object.wait(Native Method)
           - waiting on <0x000000070b6e4790> (a
    org.apache.lucene.index.DocumentsWriter)
           at java.lang.Object.wait(Object.java:485)
           at
    org.apache.lucene.index.DocumentsWriter.waitIdle(DocumentsWriter.java:986)
           - locked <0x000000070b6e4790> (a
    org.apache.lucene.index.DocumentsWriter)
           at
    org.apache.lucene.index.DocumentsWriter.flush(DocumentsWriter.java:524)
           - locked <0x000000070b6e4790> (a
    org.apache.lucene.index.DocumentsWriter)
           at
    org.apache.lucene.index.IndexWriter.doFlush(IndexWriter.java:3580)
           - locked <0x000000070b6e4858> (a
    org.apache.solr.update.SolrIndexWriter)
           at
    org.apache.lucene.index.IndexWriter.flush(IndexWriter.java:3545)
           at
    org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:2328)
           at
    org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:2293)
           at
    
org.apache.solr.update.DirectUpdateHandler2.addDoc(DirectUpdateHandler2.java:240)
           at
    
org.apache.solr.update.processor.RunUpdateProcessor.processAdd(RunUpdateProcessorFactory.java:61)
           at
    
org.apache.solr.update.processor.LogUpdateProcessor.processAdd(LogUpdateProcessorFactory.java:115)
           at
    
org.apache.solr.handler.extraction.ExtractingDocumentLoader.doAdd(ExtractingDocumentLoader.java:141)
           at
    
org.apache.solr.handler.extraction.ExtractingDocumentLoader.addDoc(ExtractingDocumentLoader.java:146)
           at
    
org.apache.solr.handler.extraction.ExtractingDocumentLoader.load(ExtractingDocumentLoader.java:236)
           at
    
org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:58)
           at
    
org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:129)
           at
    
org.apache.solr.core.RequestHandlers$LazyRequestHandlerWrapper.handleRequest(RequestHandlers.java:244)
           at org.apache.solr.core.SolrCore.execute(SolrCore.java:1376)
           at
    
org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:365)
           at
    
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:260)
           at
    
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
           at
    
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
           at
    
org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233)
           at
    
org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191)
           at
    
org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
           at
    
org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
           at
    
org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
           at
    org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:293)
           at
    org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:859)
           at
    
org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:602)
           at org.apache.tomcat.util.net
    
<http://org.apache.tomcat.util.net>.JIoEndpoint$Worker.run(JIoEndpoint.java:489)
           at java.lang.Thread.run(Thread.java:662)

    "http-8983-3" daemon prio=10 tid=0x00000000411ec000 nid=0x5b0 in
    Object.wait() [0x00007f9f967cb000]
      java.lang.Thread.State: WAITING (on object monitor)
           at java.lang.Object.wait(Native Method)
           - waiting on <0x00000007024cdc38> (a
    org.apache.tomcat.util.net
    <http://org.apache.tomcat.util.net>.JIoEndpoint$Worker)
           at java.lang.Object.wait(Object.java:485)
           at org.apache.tomcat.util.net
    
<http://org.apache.tomcat.util.net>.JIoEndpoint$Worker.await(JIoEndpoint.java:458)
           - locked <0x00000007024cdc38> (a org.apache.tomcat.util.net
    <http://org.apache.tomcat.util.net>.JIoEndpoint$Worker)
           at org.apache.tomcat.util.net
    
<http://org.apache.tomcat.util.net>.JIoEndpoint$Worker.run(JIoEndpoint.java:484)
           at java.lang.Thread.run(Thread.java:662)

    "http-8983-2" daemon prio=10 tid=0x0000000041447800 nid=0x5ae
    runnable [0x00007f9f968cb000]
      java.lang.Thread.State: RUNNABLE
           at
    
org.apache.lucene.analysis.ngram.NGramTokenFilter.incrementToken(NGramTokenFilter.java:107)
           at
    
org.apache.lucene.index.DocInverterPerField.processFields(DocInverterPerField.java:197)
           at
    
org.apache.lucene.index.DocFieldProcessorPerThread.processDocument(DocFieldProcessorPerThread.java:276)
           at
    
org.apache.lucene.index.DocumentsWriter.updateDocument(DocumentsWriter.java:766)
           at
    org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:2321)
           at
    org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:2293)
           at
    
org.apache.solr.update.DirectUpdateHandler2.addDoc(DirectUpdateHandler2.java:240)
           at
    
org.apache.solr.update.processor.RunUpdateProcessor.processAdd(RunUpdateProcessorFactory.java:61)
           at
    
org.apache.solr.update.processor.LogUpdateProcessor.processAdd(LogUpdateProcessorFactory.java:115)
           at
    
org.apache.solr.handler.extraction.ExtractingDocumentLoader.doAdd(ExtractingDocumentLoader.java:141)
           at
    
org.apache.solr.handler.extraction.ExtractingDocumentLoader.addDoc(ExtractingDocumentLoader.java:146)
           at
    
org.apache.solr.handler.extraction.ExtractingDocumentLoader.load(ExtractingDocumentLoader.java:236)
           at
    
org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:58)
           at
    
org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:129)
           at
    
org.apache.solr.core.RequestHandlers$LazyRequestHandlerWrapper.handleRequest(RequestHandlers.java:244)
           at org.apache.solr.core.SolrCore.execute(SolrCore.java:1376)
           at
    
org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:365)
           at
    
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:260)
           at
    
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
           at
    
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
           at
    
org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233)
           at
    
org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191)
           at
    
org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
           at
    
org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
           at
    
org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
           at
    org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:293)
           at
    org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:859)
           at
    
org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:602)
           at org.apache.tomcat.util.net
    
<http://org.apache.tomcat.util.net>.JIoEndpoint$Worker.run(JIoEndpoint.java:489)
           at java.lang.Thread.run(Thread.java:662)

    "TP-Monitor" daemon prio=10 tid=0x00007fa0a0093800 nid=0x5ad in
    Object.wait() [0x00007f9f969cd000]
      java.lang.Thread.State: TIMED_WAITING (on object monitor)
           at java.lang.Object.wait(Native Method)
           - waiting on <0x0000000703ff52c0> (a
    org.apache.tomcat.util.threads.ThreadPool$MonitorRunnable)
           at
    
org.apache.tomcat.util.threads.ThreadPool$MonitorRunnable.run(ThreadPool.java:565)
           - locked <0x0000000703ff52c0> (a
    org.apache.tomcat.util.threads.ThreadPool$MonitorRunnable)
           at java.lang.Thread.run(Thread.java:662)

    "TP-Processor4" daemon prio=10 tid=0x00007fa0a038c000 nid=0x5ac
    runnable [0x00007f9f96ace000]
      java.lang.Thread.State: RUNNABLE
           at java.net.PlainSocketImpl.socketAccept(Native Method)
           at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:408)
           - locked <0x0000000702599120> (a java.net.SocksSocketImpl)
           at java.net.ServerSocket.implAccept(ServerSocket.java:462)
           at java.net.ServerSocket.accept(ServerSocket.java:430)
           at
    org.apache.jk.common.ChannelSocket.accept(ChannelSocket.java:311)
           at
    org.apache.jk.common.ChannelSocket.acceptConnections(ChannelSocket.java:668)
           at
    
org.apache.jk.common.ChannelSocket$SocketAcceptor.runIt(ChannelSocket.java:879)
           at
    
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:690)
           at java.lang.Thread.run(Thread.java:662)

    "TP-Processor3" daemon prio=10 tid=0x00007fa0a0048000 nid=0x5ab in
    Object.wait() [0x00007f9f96bcf000]
      java.lang.Thread.State: WAITING (on object monitor)
           at java.lang.Object.wait(Native Method)
           - waiting on <0x0000000703ff5650> (a
    org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
           at java.lang.Object.wait(Object.java:485)
           at
    
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:662)
           - locked <0x0000000703ff5650> (a
    org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
           at java.lang.Thread.run(Thread.java:662)

    "TP-Processor2" daemon prio=10 tid=0x00007fa0a0073800 nid=0x5aa in
    Object.wait() [0x00007f9f96cd0000]
      java.lang.Thread.State: WAITING (on object monitor)
           at java.lang.Object.wait(Native Method)
           - waiting on <0x0000000703ff58c0> (a
    org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
           at java.lang.Object.wait(Object.java:485)
           at
    
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:662)
           - locked <0x0000000703ff58c0> (a
    org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
           at java.lang.Thread.run(Thread.java:662)

    "TP-Processor1" daemon prio=10 tid=0x00007fa0a0162000 nid=0x5a9 in
    Object.wait() [0x00007f9f96dd1000]
      java.lang.Thread.State: WAITING (on object monitor)
           at java.lang.Object.wait(Native Method)
           - waiting on <0x0000000703ff5b30> (a
    org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
           at java.lang.Object.wait(Object.java:485)
           at
    
org.apache.tomcat.util.threads.ThreadPool$ControlRunnable.run(ThreadPool.java:662)
           - locked <0x0000000703ff5b30> (a
    org.apache.tomcat.util.threads.ThreadPool$ControlRunnable)
           at java.lang.Thread.run(Thread.java:662)

    "http-8983-1" daemon prio=10 tid=0x00000000410ab800 nid=0x5a8 in
    Object.wait() [0x00007f9f96ed1000]
      java.lang.Thread.State: WAITING (on object monitor)
           at java.lang.Object.wait(Native Method)
           - waiting on <0x000000070b7198f0> (a
    org.apache.lucene.index.IndexWriter$FlushControl)
           at java.lang.Object.wait(Object.java:485)
           at
    
org.apache.lucene.index.IndexWriter$FlushControl.waitUpdate(IndexWriter.java:4877)
           - locked <0x000000070b7198f0> (a
    org.apache.lucene.index.IndexWriter$FlushControl)
           at
    
org.apache.lucene.index.IndexWriter$FlushControl.waitUpdate(IndexWriter.java:4871)
           - locked <0x000000070b7198f0> (a
    org.apache.lucene.index.IndexWriter$FlushControl)
           at
    
org.apache.lucene.index.DocumentsWriter.updateDocument(DocumentsWriter.java:751)
           at
    org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:2321)
           at
    org.apache.lucene.index.IndexWriter.updateDocument(IndexWriter.java:2293)
           at
    
org.apache.solr.update.DirectUpdateHandler2.addDoc(DirectUpdateHandler2.java:240)
           at
    
org.apache.solr.update.processor.RunUpdateProcessor.processAdd(RunUpdateProcessorFactory.java:61)
           at
    
org.apache.solr.update.processor.LogUpdateProcessor.processAdd(LogUpdateProcessorFactory.java:115)
           at
    
org.apache.solr.handler.extraction.ExtractingDocumentLoader.doAdd(ExtractingDocumentLoader.java:141)
           at
    
org.apache.solr.handler.extraction.ExtractingDocumentLoader.addDoc(ExtractingDocumentLoader.java:146)
           at
    
org.apache.solr.handler.extraction.ExtractingDocumentLoader.load(ExtractingDocumentLoader.java:236)
           at
    
org.apache.solr.handler.ContentStreamHandlerBase.handleRequestBody(ContentStreamHandlerBase.java:58)
           at
    
org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:129)
           at
    
org.apache.solr.core.RequestHandlers$LazyRequestHandlerWrapper.handleRequest(RequestHandlers.java:244)
           at org.apache.solr.core.SolrCore.execute(SolrCore.java:1376)
           at
    
org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:365)
           at
    
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:260)
           at
    
org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
           at
    
org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
           at
    
org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:233)
           at
    
org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:191)
           at
    
org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
           at
    
org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
           at
    
org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
           at
    org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:293)
           at
    org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:859)
           at
    
org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:602)
           at org.apache.tomcat.util.net
    
<http://org.apache.tomcat.util.net>.JIoEndpoint$Worker.run(JIoEndpoint.java:489)
           at java.lang.Thread.run(Thread.java:662)

    "http-8983-Acceptor-0" daemon prio=10 tid=0x00007fa0a0012800
    nid=0x5a7 runnable [0x00007f9f96fd3000]
      java.lang.Thread.State: RUNNABLE
           at java.net.PlainSocketImpl.socketAccept(Native Method)
           at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:408)
           - locked <0x00000007022e9320> (a java.net.SocksSocketImpl)
           at java.net.ServerSocket.implAccept(ServerSocket.java:462)
           at java.net.ServerSocket.accept(ServerSocket.java:430)
           at org.apache.tomcat.util.net
    
<http://org.apache.tomcat.util.net>.DefaultServerSocketFactory.acceptSocket(DefaultServerSocketFactory.java:61)
           at org.apache.tomcat.util.net
    
<http://org.apache.tomcat.util.net>.JIoEndpoint$Acceptor.run(JIoEndpoint.java:352)
           at java.lang.Thread.run(Thread.java:662)

    "ContainerBackgroundProcessor[StandardEngine[Catalina]]" daemon
    prio=10 tid=0x00007fa0a004e800 nid=0x5a6 waiting on condition
    [0x00007fa0ad29f000]
      java.lang.Thread.State: TIMED_WAITING (sleeping)
           at java.lang.Thread.sleep(Native Method)
           at
    
org.apache.catalina.core.ContainerBase$ContainerBackgroundProcessor.run(ContainerBase.java:1631)
           at java.lang.Thread.run(Thread.java:662)

    "pool-1-thread-1" prio=10 tid=0x00007fa0a005c000 nid=0x5a4 waiting
    on condition [0x00007fa0ad69b000]
      java.lang.Thread.State: WAITING (parking)
           at sun.misc.Unsafe.park(Native Method)
           - parking to wait for  <0x0000000702319730> (a
    java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject)
           at
    java.util.concurrent.locks.LockSupport.park(LockSupport.java:158)
           at
    
java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:1987)
           at
    java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:399)
           at
    java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:947)
           at
    
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907)
           at java.lang.Thread.run(Thread.java:662)

    "GC Daemon" daemon prio=10 tid=0x00007fa0a8633000 nid=0x5a3 in
    Object.wait() [0x00007fa0adb30000]
      java.lang.Thread.State: TIMED_WAITING (on object monitor)
           at java.lang.Object.wait(Native Method)
           - waiting on <0x0000000700082560> (a sun.misc.GC$LatencyLock)
           at sun.misc.GC$Daemon.run(GC.java:100)
           - locked <0x0000000700082560> (a sun.misc.GC$LatencyLock)

    "Low Memory Detector" daemon prio=10 tid=0x00007fa0a8002800
    nid=0x5a1 runnable [0x0000000000000000]
      java.lang.Thread.State: RUNNABLE

    "C2 CompilerThread1" daemon prio=10 tid=0x0000000040f71000
    nid=0x5a0 waiting on condition [0x0000000000000000]
      java.lang.Thread.State: RUNNABLE

    "C2 CompilerThread0" daemon prio=10 tid=0x0000000040f6d800
    nid=0x59f waiting on condition [0x0000000000000000]
      java.lang.Thread.State: RUNNABLE

    "Signal Dispatcher" daemon prio=10 tid=0x0000000040f6b800
    nid=0x59e waiting on condition [0x0000000000000000]
      java.lang.Thread.State: RUNNABLE

    "Finalizer" daemon prio=10 tid=0x0000000040f4f000 nid=0x59d in
    Object.wait() [0x00007fa0ae3eb000]
      java.lang.Thread.State: WAITING (on object monitor)
           at java.lang.Object.wait(Native Method)
           - waiting on <0x000000070007a850> (a
    java.lang.ref.ReferenceQueue$Lock)
           at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:118)
           - locked <0x000000070007a850> (a
    java.lang.ref.ReferenceQueue$Lock)
           at java.lang.ref.ReferenceQueue.remove(ReferenceQueue.java:134)
           at
    java.lang.ref.Finalizer$FinalizerThread.run(Finalizer.java:159)

    "Reference Handler" daemon prio=10 tid=0x0000000040f47800
    nid=0x59c in Object.wait() [0x00007fa0ae4ec000]
      java.lang.Thread.State: WAITING (on object monitor)
           at java.lang.Object.wait(Native Method)
           - waiting on <0x0000000700082550> (a
    java.lang.ref.Reference$Lock)
           at java.lang.Object.wait(Object.java:485)
           at
    java.lang.ref.Reference$ReferenceHandler.run(Reference.java:116)
           - locked <0x0000000700082550> (a java.lang.ref.Reference$Lock)

    "main" prio=10 tid=0x0000000040ee3000 nid=0x596 runnable
    [0x00007fa0b3d24000]
      java.lang.Thread.State: RUNNABLE
           at java.net.PlainSocketImpl.socketAccept(Native Method)
           at java.net.PlainSocketImpl.accept(PlainSocketImpl.java:408)
           - locked <0x0000000702599208> (a java.net.SocksSocketImpl)
           at java.net.ServerSocket.implAccept(ServerSocket.java:462)
           at java.net.ServerSocket.accept(ServerSocket.java:430)
           at
    org.apache.catalina.core.StandardServer.await(StandardServer.java:431)
           at
    org.apache.catalina.startup.Catalina.await(Catalina.java:676)
           at
    org.apache.catalina.startup.Catalina.start(Catalina.java:628)
           at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
           at
    
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
           at
    
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
           at java.lang.reflect.Method.invoke(Method.java:597)
           at
    org.apache.catalina.startup.Bootstrap.start(Bootstrap.java:289)
           at
    org.apache.catalina.startup.Bootstrap.main(Bootstrap.java:414)

    "VM Thread" prio=10 tid=0x0000000040f40800 nid=0x59b runnable

    "GC task thread#0 (ParallelGC)" prio=10 tid=0x0000000040ef6000
    nid=0x597 runnable

    "GC task thread#1 (ParallelGC)" prio=10 tid=0x0000000040ef7800
    nid=0x598 runnable

    "GC task thread#2 (ParallelGC)" prio=10 tid=0x0000000040ef9800
    nid=0x599 runnable

    "GC task thread#3 (ParallelGC)" prio=10 tid=0x0000000040efb800
    nid=0x59a runnable

    "VM Periodic Task Thread" prio=10 tid=0x00007fa0a8015800 nid=0x5a2
    waiting on condition

    JNI global references: 1660

    Heap
     PSYoungGen      total 802560K, used 144888K [0x00000007aaab0000,
    0x00000007f9c40000, 0x0000000800000000)
     eden space 802432K, 18% used
    [0x00000007aaab0000,0x00000007b381e190,0x00000007dba50000)
     from space 128K, 50% used
    [0x00000007f9c20000,0x00000007f9c30020,0x00000007f9c40000)
     to   space 8448K, 0% used
    [0x00000007f8bc0000,0x00000007f8bc0000,0x00000007f9400000)
     PSOldGen        total 1398144K, used 867862K [0x0000000700000000,
    0x0000000755560000, 0x00000007aaab0000)
     object space 1398144K, 62% used
    [0x0000000700000000,0x0000000734f85980,0x0000000755560000)
     PSPermGen       total 54464K, used 54387K [0x00000006fae00000,
    0x00000006fe330000, 0x0000000700000000)
     object space 54464K, 99% used
    [0x00000006fae00000,0x00000006fe31cce8,0x00000006fe330000)



    On 06/26/2012 02:36 PM, Arkadi Colson wrote:

        Hi,


        I'm indexing about 200.000 files (average size of 1 MB) with
        the tika processor. At some point Solr started hanging. The
        logs is only reporting:

        INFO: [] webapp=/solr path=/replication
        params={command=indexversion&wt=javabin} status=0 QTime=0
        Jun 26, 2012 2:34:00 PM org.apache.solr.core.SolrCore execute

        The index is already about 18 GB big. Could that be the
        problem? Is you need more information please let me know...


        Thanks in advance!


-- Smartbit bvba
    Hoogstraat 13
    B-3670 Meeuwen
    T: +32 11 64 08 80
    F: +32 89 46 81 10
    W: http://www.smartbit.be
    E: ark...@smartbit.be <mailto:ark...@smartbit.be>




--
Smartbit bvba
Hoogstraat 13
B-3670 Meeuwen
T: +32 11 64 08 80
F: +32 89 46 81 10
W: http://www.smartbit.be
E: ark...@smartbit.be



Reply via email to