it's completely off-topic. Solr does nothing with logging bolts. Solr uses slf4j bridge to other logging backends, java.util.logging by default.
I bet for slow disk io. Try to bypass it: add > NUL to your java command. Or configure java util logging with WARN root level to suppress INFO output. also you have a typo in memory option. it should be java -Xmx8192m If your disk slow for read as it's slow for write, your search would take a couple of minutes, I'm afraid. On Sat, Aug 4, 2012 at 6:40 PM, bluephoenix2010 <bluephoenix2...@gmail.com>wrote: > Hello All, > > We are running into issues with our Solr servers where threads start > blocking after about 30 minutes of running. I am using Apache Solr 3.6.1 > with Jetty 6.1. The Apache Solr is running on a Windows Server 2008 R2 > with > 12GB of RAM. I am thinking that the issue could be possibly related to > disk > latency on our SAN. Take a look at Thread ID 77 below. This is the thread > all the otherones are waiting to lock on. > > Here is the system parameters I use for java > > java -mx8192m -server -Dcom.sun.management.jmxremote.port=3000 > -Dcom.sun.management.jmxremote.ssl=false > -Dcom.sun.management.jmxremote.authenticate=false > -Dcom.sun.management.snmp.port=1161 -verbose:gc -Xloggc:C:\gcLog.log > -XX:+UseConcMarkSweepGC -jar start.jar > > Thanks for your help! > > > "1462043760@qtp-924653460-20" - Thread t@77 > java.lang.Thread.State: RUNNABLE > at java.io.FileOutputStream.writeBytes(Native Method) > at java.io.FileOutputStream.write(Unknown Source) > at java.io.BufferedOutputStream.write(Unknown Source) > - locked <4bedf476> (a java.io.BufferedOutputStream) > at java.io.PrintStream.write(Unknown Source) > - locked <734c95eb> (a java.io.PrintStream) > at sun.nio.cs.StreamEncoder.writeBytes(Unknown Source) > at sun.nio.cs.StreamEncoder.implWrite(Unknown Source) > at sun.nio.cs.StreamEncoder.write(Unknown Source) > - locked <2906b270> (a java.io.OutputStreamWriter) > at sun.nio.cs.StreamEncoder.write(Unknown Source) > at java.io.OutputStreamWriter.write(Unknown Source) > at java.io.Writer.write(Unknown Source) > at java.util.logging.StreamHandler.publish(Unknown Source) > - locked <23efc88b> (a java.util.logging.ConsoleHandler) > at java.util.logging.ConsoleHandler.publish(Unknown Source) > at java.util.logging.Logger.log(Unknown Source) > at > org.slf4j.impl.JDK14LoggerAdapter.log(JDK14LoggerAdapter.java:588) > at org.slf4j.impl.JDK14LoggerAdapter.info > (JDK14LoggerAdapter.java:285) > at org.apache.solr.core.SolrCore.execute(SolrCore.java:1378) > at > > org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:356) > at > > org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:252) > at > > org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212) > at > org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:399) > at > org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216) > at > org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182) > at > org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:766) > at > org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:450) > at > > org.mortbay.jetty.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:230) > at > > org.mortbay.jetty.handler.HandlerCollection.handle(HandlerCollection.java:114) > at > org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152) > at org.mortbay.jetty.Server.handle(Server.java:326) > at > org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542) > at > > org.mortbay.jetty.HttpConnection$RequestHandler.content(HttpConnection.java:945) > at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:756) > at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212) > at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404) > at > > org.mortbay.jetty.bio.SocketConnector$Connection.run(SocketConnector.java:228) > at > > org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582) > Locked ownable synchronizers: > - None > > > > > "748520345@qtp-924653460-111" - Thread t@937 > java.lang.Thread.State: BLOCKED > at java.util.logging.StreamHandler.publish(Unknown Source) > - waiting to lock <23efc88b> (a java.util.logging.ConsoleHandler) > owned by "1462043760@qtp-924653460-20" t@77 > at java.util.logging.ConsoleHandler.publish(Unknown Source) > at java.util.logging.Logger.log(Unknown Source) > at > org.slf4j.impl.JDK14LoggerAdapter.log(JDK14LoggerAdapter.java:588) > at > org.slf4j.impl.JDK14LoggerAdapter.info(JDK14LoggerAdapter.java:285) > at org.apache.solr.core.SolrCore.execute(SolrCore.java:1378) > at > > org.apache.solr.handler.PingRequestHandler.handleRequestBody(PingRequestHandler.java:68) > at > > org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:129) > at org.apache.solr.core.SolrCore.execute(SolrCore.java:1368) > at > > org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:356) > at > > org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:252) > at > > org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212) > at > org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:399) > at > org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216) > at > org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182) > at > org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:766) > at > org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:450) > at > > org.mortbay.jetty.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:230) > at > > org.mortbay.jetty.handler.HandlerCollection.handle(HandlerCollection.java:114) > at > org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152) > at org.mortbay.jetty.Server.handle(Server.java:326) > at > org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542) > at > > org.mortbay.jetty.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:928) > at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:549) > at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212) > at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404) > at > > org.mortbay.jetty.bio.SocketConnector$Connection.run(SocketConnector.java:228) > at > > org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582) > Locked ownable synchronizers: > - None > "630432105@qtp-924653460-90" - Thread t@195 > java.lang.Thread.State: BLOCKED > at java.util.logging.StreamHandler.publish(Unknown Source) > - waiting to lock <23efc88b> (a java.util.logging.ConsoleHandler) > owned by "1462043760@qtp-924653460-20" t@77 > at java.util.logging.ConsoleHandler.publish(Unknown Source) > at java.util.logging.Logger.log(Unknown Source) > at > org.slf4j.impl.JDK14LoggerAdapter.log(JDK14LoggerAdapter.java:588) > at > org.slf4j.impl.JDK14LoggerAdapter.info(JDK14LoggerAdapter.java:285) > at org.apache.solr.core.SolrCore.execute(SolrCore.java:1378) > at > > org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:356) > at > > org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:252) > at > > org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212) > at > org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:399) > at > org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216) > at > org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182) > at > org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:766) > at > org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:450) > at > > org.mortbay.jetty.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:230) > at > > org.mortbay.jetty.handler.HandlerCollection.handle(HandlerCollection.java:114) > at > org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152) > at org.mortbay.jetty.Server.handle(Server.java:326) > at > org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542) > at > > org.mortbay.jetty.HttpConnection$RequestHandler.content(HttpConnection.java:945) > at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:756) > at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212) > at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404) > at > > org.mortbay.jetty.bio.SocketConnector$Connection.run(SocketConnector.java:228) > at > > org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582) > Locked ownable synchronizers: > - None > "255852818@qtp-924653460-89" - Thread t@194 > java.lang.Thread.State: BLOCKED > at java.util.logging.StreamHandler.publish(Unknown Source) > - waiting to lock <23efc88b> (a java.util.logging.ConsoleHandler) > owned by "1462043760@qtp-924653460-20" t@77 > at java.util.logging.ConsoleHandler.publish(Unknown Source) > at java.util.logging.Logger.log(Unknown Source) > at > org.slf4j.impl.JDK14LoggerAdapter.log(JDK14LoggerAdapter.java:588) > at > org.slf4j.impl.JDK14LoggerAdapter.info(JDK14LoggerAdapter.java:285) > at org.apache.solr.core.SolrCore.execute(SolrCore.java:1378) > at > > org.apache.solr.handler.PingRequestHandler.handleRequestBody(PingRequestHandler.java:68) > at > > org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:129) > at org.apache.solr.core.SolrCore.execute(SolrCore.java:1368) > at > > org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:356) > at > > org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:252) > at > > org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212) > at > org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:399) > at > org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216) > at > org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182) > at > org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:766) > at > org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:450) > at > > org.mortbay.jetty.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:230) > at > > org.mortbay.jetty.handler.HandlerCollection.handle(HandlerCollection.java:114) > at > org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152) > at org.mortbay.jetty.Server.handle(Server.java:326) > at > org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542) > at > > org.mortbay.jetty.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:928) > at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:549) > at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212) > at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404) > at > > org.mortbay.jetty.bio.SocketConnector$Connection.run(SocketConnector.java:228) > at > > org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582) > Locked ownable synchronizers: > - None > "1521159967@qtp-924653460-88" - Thread t@192 > java.lang.Thread.State: BLOCKED > at java.util.logging.StreamHandler.publish(Unknown Source) > - waiting to lock <23efc88b> (a java.util.logging.ConsoleHandler) > owned by "1462043760@qtp-924653460-20" t@77 > at java.util.logging.ConsoleHandler.publish(Unknown Source) > at java.util.logging.Logger.log(Unknown Source) > at > org.slf4j.impl.JDK14LoggerAdapter.log(JDK14LoggerAdapter.java:588) > at > org.slf4j.impl.JDK14LoggerAdapter.info(JDK14LoggerAdapter.java:285) > at org.apache.solr.core.SolrCore.execute(SolrCore.java:1378) > at > > org.apache.solr.handler.PingRequestHandler.handleRequestBody(PingRequestHandler.java:68) > at > > org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:129) > at org.apache.solr.core.SolrCore.execute(SolrCore.java:1368) > at > > org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:356) > at > > org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:252) > at > > org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212) > at > org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:399) > at > org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216) > at > org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182) > at > org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:766) > at > org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:450) > at > > org.mortbay.jetty.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:230) > at > > org.mortbay.jetty.handler.HandlerCollection.handle(HandlerCollection.java:114) > at > org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152) > at org.mortbay.jetty.Server.handle(Server.java:326) > at > org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542) > at > > org.mortbay.jetty.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:928) > at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:549) > at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212) > at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404) > at > > org.mortbay.jetty.bio.SocketConnector$Connection.run(SocketConnector.java:228) > at > > org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582) > Locked ownable synchronizers: > - None > "1840417105@qtp-924653460-79" - Thread t@167 > java.lang.Thread.State: BLOCKED > at java.util.logging.StreamHandler.publish(Unknown Source) > - waiting to lock <23efc88b> (a java.util.logging.ConsoleHandler) > owned by "1462043760@qtp-924653460-20" t@77 > at java.util.logging.ConsoleHandler.publish(Unknown Source) > at java.util.logging.Logger.log(Unknown Source) > at > org.slf4j.impl.JDK14LoggerAdapter.log(JDK14LoggerAdapter.java:588) > at > org.slf4j.impl.JDK14LoggerAdapter.info(JDK14LoggerAdapter.java:285) > at org.apache.solr.core.SolrCore.execute(SolrCore.java:1378) > at > > org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:356) > at > > org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:252) > at > > org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212) > at > org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:399) > at > org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216) > at > org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182) > at > org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:766) > at > org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:450) > at > > org.mortbay.jetty.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:230) > at > > org.mortbay.jetty.handler.HandlerCollection.handle(HandlerCollection.java:114) > at > org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152) > at org.mortbay.jetty.Server.handle(Server.java:326) > at > org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542) > at > > org.mortbay.jetty.HttpConnection$RequestHandler.content(HttpConnection.java:945) > at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:756) > at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212) > at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404) > at > > org.mortbay.jetty.bio.SocketConnector$Connection.run(SocketConnector.java:228) > at > > org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582) > Locked ownable synchronizers: > - None > "1435709112@qtp-924653460-56" - Thread t@141 > java.lang.Thread.State: BLOCKED > at java.util.logging.StreamHandler.publish(Unknown Source) > - waiting to lock <23efc88b> (a java.util.logging.ConsoleHandler) > owned by "1462043760@qtp-924653460-20" t@77 > at java.util.logging.ConsoleHandler.publish(Unknown Source) > at java.util.logging.Logger.log(Unknown Source) > at > org.slf4j.impl.JDK14LoggerAdapter.log(JDK14LoggerAdapter.java:588) > at > org.slf4j.impl.JDK14LoggerAdapter.info(JDK14LoggerAdapter.java:285) > at org.apache.solr.core.SolrCore.execute(SolrCore.java:1378) > at > > org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:356) > at > > org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:252) > at > > org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212) > at > org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:399) > at > org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216) > at > org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182) > at > org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:766) > at > org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:450) > at > > org.mortbay.jetty.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:230) > at > > org.mortbay.jetty.handler.HandlerCollection.handle(HandlerCollection.java:114) > at > org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152) > at org.mortbay.jetty.Server.handle(Server.java:326) > at > org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542) > at > > org.mortbay.jetty.HttpConnection$RequestHandler.content(HttpConnection.java:945) > at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:756) > at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212) > at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404) > at > > org.mortbay.jetty.bio.SocketConnector$Connection.run(SocketConnector.java:228) > at > > org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582) > Locked ownable synchronizers: > - None > "2009477513@qtp-924653460-53" - Thread t@138 > java.lang.Thread.State: BLOCKED > at java.util.logging.StreamHandler.publish(Unknown Source) > - waiting to lock <23efc88b> (a java.util.logging.ConsoleHandler) > owned by "1462043760@qtp-924653460-20" t@77 > at java.util.logging.ConsoleHandler.publish(Unknown Source) > at java.util.logging.Logger.log(Unknown Source) > at > org.slf4j.impl.JDK14LoggerAdapter.log(JDK14LoggerAdapter.java:588) > at > org.slf4j.impl.JDK14LoggerAdapter.info(JDK14LoggerAdapter.java:285) > at org.apache.solr.core.SolrCore.execute(SolrCore.java:1378) > at > > org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:356) > at > > org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:252) > at > > org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212) > at > org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:399) > at > org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216) > at > org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182) > at > org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:766) > at > org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:450) > at > > org.mortbay.jetty.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:230) > at > > org.mortbay.jetty.handler.HandlerCollection.handle(HandlerCollection.java:114) > at > org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152) > at org.mortbay.jetty.Server.handle(Server.java:326) > at > org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542) > at > > org.mortbay.jetty.HttpConnection$RequestHandler.content(HttpConnection.java:945) > at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:756) > at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212) > at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404) > at > > org.mortbay.jetty.bio.SocketConnector$Connection.run(SocketConnector.java:228) > at > > org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582) > Locked ownable synchronizers: > - None > "2136587549@qtp-924653460-46" - Thread t@127 > java.lang.Thread.State: BLOCKED > at java.util.logging.StreamHandler.publish(Unknown Source) > - waiting to lock <23efc88b> (a java.util.logging.ConsoleHandler) > owned by "1462043760@qtp-924653460-20" t@77 > at java.util.logging.ConsoleHandler.publish(Unknown Source) > at java.util.logging.Logger.log(Unknown Source) > at > org.slf4j.impl.JDK14LoggerAdapter.log(JDK14LoggerAdapter.java:588) > at > org.slf4j.impl.JDK14LoggerAdapter.info(JDK14LoggerAdapter.java:285) > at org.apache.solr.core.SolrCore.execute(SolrCore.java:1378) > at > > org.apache.solr.handler.PingRequestHandler.handleRequestBody(PingRequestHandler.java:68) > at > > org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:129) > at org.apache.solr.core.SolrCore.execute(SolrCore.java:1368) > at > > org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:356) > at > > org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:252) > at > > org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212) > at > org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:399) > at > org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216) > at > org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182) > at > org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:766) > at > org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:450) > at > > org.mortbay.jetty.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:230) > at > > org.mortbay.jetty.handler.HandlerCollection.handle(HandlerCollection.java:114) > at > org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152) > at org.mortbay.jetty.Server.handle(Server.java:326) > at > org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542) > at > > org.mortbay.jetty.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:928) > at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:549) > at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212) > at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404) > at > > org.mortbay.jetty.bio.SocketConnector$Connection.run(SocketConnector.java:228) > at > > org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582) > Locked ownable synchronizers: > - None > "203393982@qtp-924653460-42" - Thread t@123 > java.lang.Thread.State: BLOCKED > at java.util.logging.StreamHandler.publish(Unknown Source) > - waiting to lock <23efc88b> (a java.util.logging.ConsoleHandler) > owned by "1462043760@qtp-924653460-20" t@77 > at java.util.logging.ConsoleHandler.publish(Unknown Source) > at java.util.logging.Logger.log(Unknown Source) > at > org.slf4j.impl.JDK14LoggerAdapter.log(JDK14LoggerAdapter.java:588) > at > org.slf4j.impl.JDK14LoggerAdapter.info(JDK14LoggerAdapter.java:285) > at org.apache.solr.core.SolrCore.execute(SolrCore.java:1378) > at > > org.apache.solr.handler.PingRequestHandler.handleRequestBody(PingRequestHandler.java:68) > at > > org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:129) > at org.apache.solr.core.SolrCore.execute(SolrCore.java:1368) > at > > org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:356) > at > > org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:252) > at > > org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212) > at > org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:399) > at > org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216) > at > org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182) > at > org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:766) > at > org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:450) > at > > org.mortbay.jetty.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:230) > at > > org.mortbay.jetty.handler.HandlerCollection.handle(HandlerCollection.java:114) > at > org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152) > at org.mortbay.jetty.Server.handle(Server.java:326) > at > org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542) > at > > org.mortbay.jetty.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:928) > at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:549) > at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212) > at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404) > at > > org.mortbay.jetty.bio.SocketConnector$Connection.run(SocketConnector.java:228) > at > > org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582) > Locked ownable synchronizers: > - None > "447403578@qtp-924653460-38" - Thread t@107 > java.lang.Thread.State: BLOCKED > at java.util.logging.StreamHandler.publish(Unknown Source) > - waiting to lock <23efc88b> (a java.util.logging.ConsoleHandler) > owned by "1462043760@qtp-924653460-20" t@77 > at java.util.logging.ConsoleHandler.publish(Unknown Source) > at java.util.logging.Logger.log(Unknown Source) > at > org.slf4j.impl.JDK14LoggerAdapter.log(JDK14LoggerAdapter.java:588) > at > org.slf4j.impl.JDK14LoggerAdapter.info(JDK14LoggerAdapter.java:285) > at org.apache.solr.core.SolrCore.execute(SolrCore.java:1378) > at > > org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:356) > at > > org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:252) > at > > org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212) > at > org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:399) > at > org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216) > at > org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182) > at > org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:766) > at > org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:450) > at > > org.mortbay.jetty.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:230) > at > > org.mortbay.jetty.handler.HandlerCollection.handle(HandlerCollection.java:114) > at > org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152) > at org.mortbay.jetty.Server.handle(Server.java:326) > at > org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542) > at > > org.mortbay.jetty.HttpConnection$RequestHandler.content(HttpConnection.java:945) > at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:756) > at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:218) > at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404) > at > > org.mortbay.jetty.bio.SocketConnector$Connection.run(SocketConnector.java:228) > at > > org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582) > Locked ownable synchronizers: > - None > "565541321@qtp-924653460-37" - Thread t@103 > java.lang.Thread.State: BLOCKED > at java.util.logging.StreamHandler.publish(Unknown Source) > - waiting to lock <23efc88b> (a java.util.logging.ConsoleHandler) > owned by "1462043760@qtp-924653460-20" t@77 > at java.util.logging.ConsoleHandler.publish(Unknown Source) > at java.util.logging.Logger.log(Unknown Source) > at > org.slf4j.impl.JDK14LoggerAdapter.log(JDK14LoggerAdapter.java:588) > at > org.slf4j.impl.JDK14LoggerAdapter.info(JDK14LoggerAdapter.java:285) > at org.apache.solr.core.SolrCore.execute(SolrCore.java:1378) > at > > org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:356) > at > > org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:252) > at > > org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212) > at > org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:399) > at > org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216) > at > org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182) > at > org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:766) > at > org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:450) > at > > org.mortbay.jetty.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:230) > at > > org.mortbay.jetty.handler.HandlerCollection.handle(HandlerCollection.java:114) > at > org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152) > at org.mortbay.jetty.Server.handle(Server.java:326) > at > org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542) > at > > org.mortbay.jetty.HttpConnection$RequestHandler.content(HttpConnection.java:945) > at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:756) > at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:218) > at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404) > at > > org.mortbay.jetty.bio.SocketConnector$Connection.run(SocketConnector.java:228) > at > > org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582) > Locked ownable synchronizers: > - None > "1474495170@qtp-924653460-35" - Thread t@101 > java.lang.Thread.State: BLOCKED > at java.util.logging.StreamHandler.publish(Unknown Source) > - waiting to lock <23efc88b> (a java.util.logging.ConsoleHandler) > owned by "1462043760@qtp-924653460-20" t@77 > at java.util.logging.ConsoleHandler.publish(Unknown Source) > at java.util.logging.Logger.log(Unknown Source) > at > org.slf4j.impl.JDK14LoggerAdapter.log(JDK14LoggerAdapter.java:588) > at > org.slf4j.impl.JDK14LoggerAdapter.info(JDK14LoggerAdapter.java:285) > at org.apache.solr.core.SolrCore.execute(SolrCore.java:1378) > at > > org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:356) > at > > org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:252) > at > > org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212) > at > org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:399) > at > org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216) > at > org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182) > at > org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:766) > at > org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:450) > at > > org.mortbay.jetty.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:230) > at > > org.mortbay.jetty.handler.HandlerCollection.handle(HandlerCollection.java:114) > at > org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152) > at org.mortbay.jetty.Server.handle(Server.java:326) > at > org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542) > at > > org.mortbay.jetty.HttpConnection$RequestHandler.content(HttpConnection.java:945) > at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:756) > at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:218) > at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404) > at > > org.mortbay.jetty.bio.SocketConnector$Connection.run(SocketConnector.java:228) > at > > org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582) > Locked ownable synchronizers: > - None > "1903648782@qtp-924653460-33" - Thread t@96 > java.lang.Thread.State: BLOCKED > at java.util.logging.StreamHandler.publish(Unknown Source) > - waiting to lock <23efc88b> (a java.util.logging.ConsoleHandler) > owned by "1462043760@qtp-924653460-20" t@77 > at java.util.logging.ConsoleHandler.publish(Unknown Source) > at java.util.logging.Logger.log(Unknown Source) > at > org.slf4j.impl.JDK14LoggerAdapter.log(JDK14LoggerAdapter.java:588) > at > org.slf4j.impl.JDK14LoggerAdapter.info(JDK14LoggerAdapter.java:285) > at org.apache.solr.core.SolrCore.execute(SolrCore.java:1378) > at > > org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:356) > at > > org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:252) > at > > org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212) > at > org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:399) > at > org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216) > at > org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182) > at > org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:766) > at > org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:450) > at > > org.mortbay.jetty.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:230) > at > > org.mortbay.jetty.handler.HandlerCollection.handle(HandlerCollection.java:114) > at > org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152) > at org.mortbay.jetty.Server.handle(Server.java:326) > at > org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542) > at > > org.mortbay.jetty.HttpConnection$RequestHandler.content(HttpConnection.java:945) > at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:756) > at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:218) > at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404) > at > > org.mortbay.jetty.bio.SocketConnector$Connection.run(SocketConnector.java:228) > at > > org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582) > Locked ownable synchronizers: > - None > "1414979395@qtp-924653460-32" - Thread t@95 > java.lang.Thread.State: BLOCKED > at java.util.logging.StreamHandler.publish(Unknown Source) > - waiting to lock <23efc88b> (a java.util.logging.ConsoleHandler) > owned by "1462043760@qtp-924653460-20" t@77 > at java.util.logging.ConsoleHandler.publish(Unknown Source) > at java.util.logging.Logger.log(Unknown Source) > at > org.slf4j.impl.JDK14LoggerAdapter.log(JDK14LoggerAdapter.java:588) > at > org.slf4j.impl.JDK14LoggerAdapter.info(JDK14LoggerAdapter.java:285) > at org.apache.solr.core.SolrCore.execute(SolrCore.java:1378) > at > > org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:356) > at > > org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:252) > at > > org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212) > at > org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:399) > at > org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216) > at > org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182) > at > org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:766) > at > org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:450) > at > > org.mortbay.jetty.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:230) > at > > org.mortbay.jetty.handler.HandlerCollection.handle(HandlerCollection.java:114) > at > org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152) > at org.mortbay.jetty.Server.handle(Server.java:326) > at > org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542) > at > > org.mortbay.jetty.HttpConnection$RequestHandler.content(HttpConnection.java:945) > at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:756) > at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:218) > at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404) > at > > org.mortbay.jetty.bio.SocketConnector$Connection.run(SocketConnector.java:228) > at > > org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582) > Locked ownable synchronizers: > - None > "299909417@qtp-924653460-26" - Thread t@86 > java.lang.Thread.State: BLOCKED > at java.util.logging.StreamHandler.publish(Unknown Source) > - waiting to lock <23efc88b> (a java.util.logging.ConsoleHandler) > owned by "1462043760@qtp-924653460-20" t@77 > at java.util.logging.ConsoleHandler.publish(Unknown Source) > at java.util.logging.Logger.log(Unknown Source) > at > org.slf4j.impl.JDK14LoggerAdapter.log(JDK14LoggerAdapter.java:588) > at > org.slf4j.impl.JDK14LoggerAdapter.info(JDK14LoggerAdapter.java:285) > at org.apache.solr.core.SolrCore.execute(SolrCore.java:1378) > at > > org.apache.solr.handler.PingRequestHandler.handleRequestBody(PingRequestHandler.java:68) > at > > org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:129) > at org.apache.solr.core.SolrCore.execute(SolrCore.java:1368) > at > > org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:356) > at > > org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:252) > at > > org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212) > at > org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:399) > at > org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216) > at > org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182) > at > org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:766) > at > org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:450) > at > > org.mortbay.jetty.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:230) > at > > org.mortbay.jetty.handler.HandlerCollection.handle(HandlerCollection.java:114) > at > org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152) > at org.mortbay.jetty.Server.handle(Server.java:326) > at > org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542) > at > > org.mortbay.jetty.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:928) > at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:549) > at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212) > at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404) > at > > org.mortbay.jetty.bio.SocketConnector$Connection.run(SocketConnector.java:228) > at > > org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582) > Locked ownable synchronizers: > - None > "2049963161@qtp-924653460-23" - Thread t@80 > java.lang.Thread.State: BLOCKED > at java.util.logging.StreamHandler.publish(Unknown Source) > - waiting to lock <23efc88b> (a java.util.logging.ConsoleHandler) > owned by "1462043760@qtp-924653460-20" t@77 > at java.util.logging.ConsoleHandler.publish(Unknown Source) > at java.util.logging.Logger.log(Unknown Source) > at > org.slf4j.impl.JDK14LoggerAdapter.log(JDK14LoggerAdapter.java:588) > at > org.slf4j.impl.JDK14LoggerAdapter.info(JDK14LoggerAdapter.java:285) > at org.apache.solr.core.SolrCore.execute(SolrCore.java:1378) > at > > org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:356) > at > > org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:252) > at > > org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212) > at > org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:399) > at > org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216) > at > org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182) > at > org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:766) > at > org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:450) > at > > org.mortbay.jetty.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:230) > at > > org.mortbay.jetty.handler.HandlerCollection.handle(HandlerCollection.java:114) > at > org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152) > at org.mortbay.jetty.Server.handle(Server.java:326) > at > org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542) > at > > org.mortbay.jetty.HttpConnection$RequestHandler.content(HttpConnection.java:945) > at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:756) > at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:218) > at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404) > at > > org.mortbay.jetty.bio.SocketConnector$Connection.run(SocketConnector.java:228) > at > > org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582) > Locked ownable synchronizers: > - None > "959425865@qtp-924653460-22" - Thread t@79 > java.lang.Thread.State: BLOCKED > at java.util.logging.StreamHandler.publish(Unknown Source) > - waiting to lock <23efc88b> (a java.util.logging.ConsoleHandler) > owned by "1462043760@qtp-924653460-20" t@77 > at java.util.logging.ConsoleHandler.publish(Unknown Source) > at java.util.logging.Logger.log(Unknown Source) > at > org.slf4j.impl.JDK14LoggerAdapter.log(JDK14LoggerAdapter.java:588) > at > org.slf4j.impl.JDK14LoggerAdapter.info(JDK14LoggerAdapter.java:285) > at org.apache.solr.core.SolrCore.execute(SolrCore.java:1378) > at > > org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:356) > at > > org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:252) > at > > org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212) > at > org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:399) > at > org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216) > at > org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182) > at > org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:766) > at > org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:450) > at > > org.mortbay.jetty.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:230) > at > > org.mortbay.jetty.handler.HandlerCollection.handle(HandlerCollection.java:114) > at > org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152) > at org.mortbay.jetty.Server.handle(Server.java:326) > at > org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542) > at > > org.mortbay.jetty.HttpConnection$RequestHandler.content(HttpConnection.java:945) > at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:756) > at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:218) > at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404) > at > > org.mortbay.jetty.bio.SocketConnector$Connection.run(SocketConnector.java:228) > at > > org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582) > Locked ownable synchronizers: > - None > "1854553074@qtp-924653460-15" - Thread t@69 > java.lang.Thread.State: BLOCKED > at java.util.logging.StreamHandler.publish(Unknown Source) > - waiting to lock <23efc88b> (a java.util.logging.ConsoleHandler) > owned by "1462043760@qtp-924653460-20" t@77 > at java.util.logging.ConsoleHandler.publish(Unknown Source) > at java.util.logging.Logger.log(Unknown Source) > at > org.slf4j.impl.JDK14LoggerAdapter.log(JDK14LoggerAdapter.java:588) > at > org.slf4j.impl.JDK14LoggerAdapter.info(JDK14LoggerAdapter.java:285) > at org.apache.solr.core.SolrCore.execute(SolrCore.java:1378) > at > > org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:356) > at > > org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:252) > at > > org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212) > at > org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:399) > at > org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216) > at > org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182) > at > org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:766) > at > org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:450) > at > > org.mortbay.jetty.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:230) > at > > org.mortbay.jetty.handler.HandlerCollection.handle(HandlerCollection.java:114) > at > org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152) > at org.mortbay.jetty.Server.handle(Server.java:326) > at > org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542) > at > > org.mortbay.jetty.HttpConnection$RequestHandler.content(HttpConnection.java:945) > at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:756) > at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:218) > at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404) > at > > org.mortbay.jetty.bio.SocketConnector$Connection.run(SocketConnector.java:228) > at > > org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582) > Locked ownable synchronizers: > - None > "440688079@qtp-924653460-8 - Acceptor1 SocketConnector@0.0.0.0:8983" - > Thread t@26 > java.lang.Thread.State: BLOCKED > at java.net.PlainSocketImpl.accept(Unknown Source) > - waiting to lock <5b5bd00c> (a java.net.SocksSocketImpl) owned by > "370915326@qtp-924653460-9 - Acceptor0 SocketConnector@0.0.0.0:8983" t@27 > at java.net.ServerSocket.implAccept(Unknown Source) > at java.net.ServerSocket.accept(Unknown Source) > at > org.mortbay.jetty.bio.SocketConnector.accept(SocketConnector.java:99) > at > > org.mortbay.jetty.AbstractConnector$Acceptor.run(AbstractConnector.java:708) > at > > org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582) > Locked ownable synchronizers: > - None > "1422284074@qtp-924653460-7 - Acceptor2 SocketConnector@0.0.0.0:8983" - > Thread t@25 > java.lang.Thread.State: BLOCKED > at java.net.PlainSocketImpl.accept(Unknown Source) > - waiting to lock <5b5bd00c> (a java.net.SocksSocketImpl) owned by > "370915326@qtp-924653460-9 - Acceptor0 SocketConnector@0.0.0.0:8983" t@27 > at java.net.ServerSocket.implAccept(Unknown Source) > at java.net.ServerSocket.accept(Unknown Source) > at > org.mortbay.jetty.bio.SocketConnector.accept(SocketConnector.java:99) > at > > org.mortbay.jetty.AbstractConnector$Acceptor.run(AbstractConnector.java:708) > at > > org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582) > Locked ownable synchronizers: > - None > > > > -- > View this message in context: > http://lucene.472066.n3.nabble.com/Thread-Blocking-Apache-Solr-3-6-1-tp3999191.html > Sent from the Solr - User mailing list archive at Nabble.com. > -- Sincerely yours Mikhail Khludnev Tech Lead Grid Dynamics <http://www.griddynamics.com> <mkhlud...@griddynamics.com>