it's completely off-topic. Solr does nothing with logging bolts. Solr uses
slf4j bridge to other logging backends, java.util.logging by default.

I bet for slow disk io. Try to bypass it: add > NUL to your java command.
Or configure java util logging with WARN root level to suppress INFO
output.

also you have a typo in memory option. it should be java -Xmx8192m

If your disk slow for read as it's slow for write, your search would take a
couple of minutes, I'm afraid.

On Sat, Aug 4, 2012 at 6:40 PM, bluephoenix2010
<bluephoenix2...@gmail.com>wrote:

> Hello All,
>
> We are running into issues with our Solr servers where threads start
> blocking after about 30 minutes of running.  I am using Apache Solr 3.6.1
> with Jetty 6.1.  The Apache Solr is running on a Windows Server 2008 R2
> with
> 12GB of RAM.  I am thinking that the issue could be possibly related to
> disk
> latency on our SAN.  Take a look at Thread ID 77 below.  This is the thread
> all the otherones are waiting to lock on.
>
> Here is the system parameters I use for java
>
> java -mx8192m -server -Dcom.sun.management.jmxremote.port=3000
> -Dcom.sun.management.jmxremote.ssl=false
> -Dcom.sun.management.jmxremote.authenticate=false
> -Dcom.sun.management.snmp.port=1161  -verbose:gc  -Xloggc:C:\gcLog.log
> -XX:+UseConcMarkSweepGC -jar start.jar
>
> Thanks for your help!
>
>
>     "1462043760@qtp-924653460-20" - Thread t@77
>    java.lang.Thread.State: RUNNABLE
>         at java.io.FileOutputStream.writeBytes(Native Method)
>         at java.io.FileOutputStream.write(Unknown Source)
>         at java.io.BufferedOutputStream.write(Unknown Source)
>         - locked <4bedf476> (a java.io.BufferedOutputStream)
>         at java.io.PrintStream.write(Unknown Source)
>         - locked <734c95eb> (a java.io.PrintStream)
>         at sun.nio.cs.StreamEncoder.writeBytes(Unknown Source)
>         at sun.nio.cs.StreamEncoder.implWrite(Unknown Source)
>         at sun.nio.cs.StreamEncoder.write(Unknown Source)
>         - locked <2906b270> (a java.io.OutputStreamWriter)
>         at sun.nio.cs.StreamEncoder.write(Unknown Source)
>         at java.io.OutputStreamWriter.write(Unknown Source)
>         at java.io.Writer.write(Unknown Source)
>         at java.util.logging.StreamHandler.publish(Unknown Source)
>         - locked <23efc88b> (a java.util.logging.ConsoleHandler)
>         at java.util.logging.ConsoleHandler.publish(Unknown Source)
>         at java.util.logging.Logger.log(Unknown Source)
>         at
> org.slf4j.impl.JDK14LoggerAdapter.log(JDK14LoggerAdapter.java:588)
>         at org.slf4j.impl.JDK14LoggerAdapter.info
> (JDK14LoggerAdapter.java:285)
>         at org.apache.solr.core.SolrCore.execute(SolrCore.java:1378)
>         at
>
> org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:356)
>         at
>
> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:252)
>         at
>
> org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
>         at
> org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:399)
>         at
> org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216)
>         at
> org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182)
>         at
> org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:766)
>         at
> org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:450)
>         at
>
> org.mortbay.jetty.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:230)
>         at
>
> org.mortbay.jetty.handler.HandlerCollection.handle(HandlerCollection.java:114)
>         at
> org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
>         at org.mortbay.jetty.Server.handle(Server.java:326)
>         at
> org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542)
>         at
>
> org.mortbay.jetty.HttpConnection$RequestHandler.content(HttpConnection.java:945)
>         at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:756)
>         at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212)
>         at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404)
>         at
>
> org.mortbay.jetty.bio.SocketConnector$Connection.run(SocketConnector.java:228)
>         at
>
> org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)
>    Locked ownable synchronizers:
>         - None
>
>
>
>
> "748520345@qtp-924653460-111" - Thread t@937
>    java.lang.Thread.State: BLOCKED
>         at java.util.logging.StreamHandler.publish(Unknown Source)
>         - waiting to lock <23efc88b> (a java.util.logging.ConsoleHandler)
> owned by "1462043760@qtp-924653460-20" t@77
>         at java.util.logging.ConsoleHandler.publish(Unknown Source)
>         at java.util.logging.Logger.log(Unknown Source)
>         at
> org.slf4j.impl.JDK14LoggerAdapter.log(JDK14LoggerAdapter.java:588)
>         at
> org.slf4j.impl.JDK14LoggerAdapter.info(JDK14LoggerAdapter.java:285)
>         at org.apache.solr.core.SolrCore.execute(SolrCore.java:1378)
>         at
>
> org.apache.solr.handler.PingRequestHandler.handleRequestBody(PingRequestHandler.java:68)
>         at
>
> org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:129)
>         at org.apache.solr.core.SolrCore.execute(SolrCore.java:1368)
>         at
>
> org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:356)
>         at
>
> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:252)
>         at
>
> org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
>         at
> org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:399)
>         at
> org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216)
>         at
> org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182)
>         at
> org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:766)
>         at
> org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:450)
>         at
>
> org.mortbay.jetty.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:230)
>         at
>
> org.mortbay.jetty.handler.HandlerCollection.handle(HandlerCollection.java:114)
>         at
> org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
>         at org.mortbay.jetty.Server.handle(Server.java:326)
>         at
> org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542)
>         at
>
> org.mortbay.jetty.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:928)
>         at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:549)
>         at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212)
>         at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404)
>         at
>
> org.mortbay.jetty.bio.SocketConnector$Connection.run(SocketConnector.java:228)
>         at
>
> org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)
>    Locked ownable synchronizers:
>         - None
> "630432105@qtp-924653460-90" - Thread t@195
>    java.lang.Thread.State: BLOCKED
>         at java.util.logging.StreamHandler.publish(Unknown Source)
>         - waiting to lock <23efc88b> (a java.util.logging.ConsoleHandler)
> owned by "1462043760@qtp-924653460-20" t@77
>         at java.util.logging.ConsoleHandler.publish(Unknown Source)
>         at java.util.logging.Logger.log(Unknown Source)
>         at
> org.slf4j.impl.JDK14LoggerAdapter.log(JDK14LoggerAdapter.java:588)
>         at
> org.slf4j.impl.JDK14LoggerAdapter.info(JDK14LoggerAdapter.java:285)
>         at org.apache.solr.core.SolrCore.execute(SolrCore.java:1378)
>         at
>
> org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:356)
>         at
>
> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:252)
>         at
>
> org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
>         at
> org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:399)
>         at
> org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216)
>         at
> org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182)
>         at
> org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:766)
>         at
> org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:450)
>         at
>
> org.mortbay.jetty.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:230)
>         at
>
> org.mortbay.jetty.handler.HandlerCollection.handle(HandlerCollection.java:114)
>         at
> org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
>         at org.mortbay.jetty.Server.handle(Server.java:326)
>         at
> org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542)
>         at
>
> org.mortbay.jetty.HttpConnection$RequestHandler.content(HttpConnection.java:945)
>         at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:756)
>         at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212)
>         at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404)
>         at
>
> org.mortbay.jetty.bio.SocketConnector$Connection.run(SocketConnector.java:228)
>         at
>
> org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)
>    Locked ownable synchronizers:
>         - None
> "255852818@qtp-924653460-89" - Thread t@194
>    java.lang.Thread.State: BLOCKED
>         at java.util.logging.StreamHandler.publish(Unknown Source)
>         - waiting to lock <23efc88b> (a java.util.logging.ConsoleHandler)
> owned by "1462043760@qtp-924653460-20" t@77
>         at java.util.logging.ConsoleHandler.publish(Unknown Source)
>         at java.util.logging.Logger.log(Unknown Source)
>         at
> org.slf4j.impl.JDK14LoggerAdapter.log(JDK14LoggerAdapter.java:588)
>         at
> org.slf4j.impl.JDK14LoggerAdapter.info(JDK14LoggerAdapter.java:285)
>         at org.apache.solr.core.SolrCore.execute(SolrCore.java:1378)
>         at
>
> org.apache.solr.handler.PingRequestHandler.handleRequestBody(PingRequestHandler.java:68)
>         at
>
> org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:129)
>         at org.apache.solr.core.SolrCore.execute(SolrCore.java:1368)
>         at
>
> org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:356)
>         at
>
> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:252)
>         at
>
> org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
>         at
> org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:399)
>         at
> org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216)
>         at
> org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182)
>         at
> org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:766)
>         at
> org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:450)
>         at
>
> org.mortbay.jetty.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:230)
>         at
>
> org.mortbay.jetty.handler.HandlerCollection.handle(HandlerCollection.java:114)
>         at
> org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
>         at org.mortbay.jetty.Server.handle(Server.java:326)
>         at
> org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542)
>         at
>
> org.mortbay.jetty.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:928)
>         at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:549)
>         at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212)
>         at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404)
>         at
>
> org.mortbay.jetty.bio.SocketConnector$Connection.run(SocketConnector.java:228)
>         at
>
> org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)
>    Locked ownable synchronizers:
>         - None
> "1521159967@qtp-924653460-88" - Thread t@192
>    java.lang.Thread.State: BLOCKED
>         at java.util.logging.StreamHandler.publish(Unknown Source)
>         - waiting to lock <23efc88b> (a java.util.logging.ConsoleHandler)
> owned by "1462043760@qtp-924653460-20" t@77
>         at java.util.logging.ConsoleHandler.publish(Unknown Source)
>         at java.util.logging.Logger.log(Unknown Source)
>         at
> org.slf4j.impl.JDK14LoggerAdapter.log(JDK14LoggerAdapter.java:588)
>         at
> org.slf4j.impl.JDK14LoggerAdapter.info(JDK14LoggerAdapter.java:285)
>         at org.apache.solr.core.SolrCore.execute(SolrCore.java:1378)
>         at
>
> org.apache.solr.handler.PingRequestHandler.handleRequestBody(PingRequestHandler.java:68)
>         at
>
> org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:129)
>         at org.apache.solr.core.SolrCore.execute(SolrCore.java:1368)
>         at
>
> org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:356)
>         at
>
> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:252)
>         at
>
> org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
>         at
> org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:399)
>         at
> org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216)
>         at
> org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182)
>         at
> org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:766)
>         at
> org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:450)
>         at
>
> org.mortbay.jetty.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:230)
>         at
>
> org.mortbay.jetty.handler.HandlerCollection.handle(HandlerCollection.java:114)
>         at
> org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
>         at org.mortbay.jetty.Server.handle(Server.java:326)
>         at
> org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542)
>         at
>
> org.mortbay.jetty.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:928)
>         at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:549)
>         at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212)
>         at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404)
>         at
>
> org.mortbay.jetty.bio.SocketConnector$Connection.run(SocketConnector.java:228)
>         at
>
> org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)
>    Locked ownable synchronizers:
>         - None
> "1840417105@qtp-924653460-79" - Thread t@167
>    java.lang.Thread.State: BLOCKED
>         at java.util.logging.StreamHandler.publish(Unknown Source)
>         - waiting to lock <23efc88b> (a java.util.logging.ConsoleHandler)
> owned by "1462043760@qtp-924653460-20" t@77
>         at java.util.logging.ConsoleHandler.publish(Unknown Source)
>         at java.util.logging.Logger.log(Unknown Source)
>         at
> org.slf4j.impl.JDK14LoggerAdapter.log(JDK14LoggerAdapter.java:588)
>         at
> org.slf4j.impl.JDK14LoggerAdapter.info(JDK14LoggerAdapter.java:285)
>         at org.apache.solr.core.SolrCore.execute(SolrCore.java:1378)
>         at
>
> org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:356)
>         at
>
> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:252)
>         at
>
> org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
>         at
> org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:399)
>         at
> org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216)
>         at
> org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182)
>         at
> org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:766)
>         at
> org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:450)
>         at
>
> org.mortbay.jetty.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:230)
>         at
>
> org.mortbay.jetty.handler.HandlerCollection.handle(HandlerCollection.java:114)
>         at
> org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
>         at org.mortbay.jetty.Server.handle(Server.java:326)
>         at
> org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542)
>         at
>
> org.mortbay.jetty.HttpConnection$RequestHandler.content(HttpConnection.java:945)
>         at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:756)
>         at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212)
>         at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404)
>         at
>
> org.mortbay.jetty.bio.SocketConnector$Connection.run(SocketConnector.java:228)
>         at
>
> org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)
>    Locked ownable synchronizers:
>         - None
> "1435709112@qtp-924653460-56" - Thread t@141
>    java.lang.Thread.State: BLOCKED
>         at java.util.logging.StreamHandler.publish(Unknown Source)
>         - waiting to lock <23efc88b> (a java.util.logging.ConsoleHandler)
> owned by "1462043760@qtp-924653460-20" t@77
>         at java.util.logging.ConsoleHandler.publish(Unknown Source)
>         at java.util.logging.Logger.log(Unknown Source)
>         at
> org.slf4j.impl.JDK14LoggerAdapter.log(JDK14LoggerAdapter.java:588)
>         at
> org.slf4j.impl.JDK14LoggerAdapter.info(JDK14LoggerAdapter.java:285)
>         at org.apache.solr.core.SolrCore.execute(SolrCore.java:1378)
>         at
>
> org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:356)
>         at
>
> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:252)
>         at
>
> org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
>         at
> org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:399)
>         at
> org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216)
>         at
> org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182)
>         at
> org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:766)
>         at
> org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:450)
>         at
>
> org.mortbay.jetty.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:230)
>         at
>
> org.mortbay.jetty.handler.HandlerCollection.handle(HandlerCollection.java:114)
>         at
> org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
>         at org.mortbay.jetty.Server.handle(Server.java:326)
>         at
> org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542)
>         at
>
> org.mortbay.jetty.HttpConnection$RequestHandler.content(HttpConnection.java:945)
>         at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:756)
>         at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212)
>         at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404)
>         at
>
> org.mortbay.jetty.bio.SocketConnector$Connection.run(SocketConnector.java:228)
>         at
>
> org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)
>    Locked ownable synchronizers:
>         - None
> "2009477513@qtp-924653460-53" - Thread t@138
>    java.lang.Thread.State: BLOCKED
>         at java.util.logging.StreamHandler.publish(Unknown Source)
>         - waiting to lock <23efc88b> (a java.util.logging.ConsoleHandler)
> owned by "1462043760@qtp-924653460-20" t@77
>         at java.util.logging.ConsoleHandler.publish(Unknown Source)
>         at java.util.logging.Logger.log(Unknown Source)
>         at
> org.slf4j.impl.JDK14LoggerAdapter.log(JDK14LoggerAdapter.java:588)
>         at
> org.slf4j.impl.JDK14LoggerAdapter.info(JDK14LoggerAdapter.java:285)
>         at org.apache.solr.core.SolrCore.execute(SolrCore.java:1378)
>         at
>
> org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:356)
>         at
>
> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:252)
>         at
>
> org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
>         at
> org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:399)
>         at
> org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216)
>         at
> org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182)
>         at
> org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:766)
>         at
> org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:450)
>         at
>
> org.mortbay.jetty.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:230)
>         at
>
> org.mortbay.jetty.handler.HandlerCollection.handle(HandlerCollection.java:114)
>         at
> org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
>         at org.mortbay.jetty.Server.handle(Server.java:326)
>         at
> org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542)
>         at
>
> org.mortbay.jetty.HttpConnection$RequestHandler.content(HttpConnection.java:945)
>         at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:756)
>         at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212)
>         at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404)
>         at
>
> org.mortbay.jetty.bio.SocketConnector$Connection.run(SocketConnector.java:228)
>         at
>
> org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)
>    Locked ownable synchronizers:
>         - None
> "2136587549@qtp-924653460-46" - Thread t@127
>    java.lang.Thread.State: BLOCKED
>         at java.util.logging.StreamHandler.publish(Unknown Source)
>         - waiting to lock <23efc88b> (a java.util.logging.ConsoleHandler)
> owned by "1462043760@qtp-924653460-20" t@77
>         at java.util.logging.ConsoleHandler.publish(Unknown Source)
>         at java.util.logging.Logger.log(Unknown Source)
>         at
> org.slf4j.impl.JDK14LoggerAdapter.log(JDK14LoggerAdapter.java:588)
>         at
> org.slf4j.impl.JDK14LoggerAdapter.info(JDK14LoggerAdapter.java:285)
>         at org.apache.solr.core.SolrCore.execute(SolrCore.java:1378)
>         at
>
> org.apache.solr.handler.PingRequestHandler.handleRequestBody(PingRequestHandler.java:68)
>         at
>
> org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:129)
>         at org.apache.solr.core.SolrCore.execute(SolrCore.java:1368)
>         at
>
> org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:356)
>         at
>
> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:252)
>         at
>
> org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
>         at
> org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:399)
>         at
> org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216)
>         at
> org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182)
>         at
> org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:766)
>         at
> org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:450)
>         at
>
> org.mortbay.jetty.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:230)
>         at
>
> org.mortbay.jetty.handler.HandlerCollection.handle(HandlerCollection.java:114)
>         at
> org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
>         at org.mortbay.jetty.Server.handle(Server.java:326)
>         at
> org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542)
>         at
>
> org.mortbay.jetty.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:928)
>         at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:549)
>         at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212)
>         at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404)
>         at
>
> org.mortbay.jetty.bio.SocketConnector$Connection.run(SocketConnector.java:228)
>         at
>
> org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)
>    Locked ownable synchronizers:
>         - None
> "203393982@qtp-924653460-42" - Thread t@123
>    java.lang.Thread.State: BLOCKED
>         at java.util.logging.StreamHandler.publish(Unknown Source)
>         - waiting to lock <23efc88b> (a java.util.logging.ConsoleHandler)
> owned by "1462043760@qtp-924653460-20" t@77
>         at java.util.logging.ConsoleHandler.publish(Unknown Source)
>         at java.util.logging.Logger.log(Unknown Source)
>         at
> org.slf4j.impl.JDK14LoggerAdapter.log(JDK14LoggerAdapter.java:588)
>         at
> org.slf4j.impl.JDK14LoggerAdapter.info(JDK14LoggerAdapter.java:285)
>         at org.apache.solr.core.SolrCore.execute(SolrCore.java:1378)
>         at
>
> org.apache.solr.handler.PingRequestHandler.handleRequestBody(PingRequestHandler.java:68)
>         at
>
> org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:129)
>         at org.apache.solr.core.SolrCore.execute(SolrCore.java:1368)
>         at
>
> org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:356)
>         at
>
> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:252)
>         at
>
> org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
>         at
> org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:399)
>         at
> org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216)
>         at
> org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182)
>         at
> org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:766)
>         at
> org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:450)
>         at
>
> org.mortbay.jetty.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:230)
>         at
>
> org.mortbay.jetty.handler.HandlerCollection.handle(HandlerCollection.java:114)
>         at
> org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
>         at org.mortbay.jetty.Server.handle(Server.java:326)
>         at
> org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542)
>         at
>
> org.mortbay.jetty.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:928)
>         at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:549)
>         at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212)
>         at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404)
>         at
>
> org.mortbay.jetty.bio.SocketConnector$Connection.run(SocketConnector.java:228)
>         at
>
> org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)
>    Locked ownable synchronizers:
>         - None
> "447403578@qtp-924653460-38" - Thread t@107
>    java.lang.Thread.State: BLOCKED
>         at java.util.logging.StreamHandler.publish(Unknown Source)
>         - waiting to lock <23efc88b> (a java.util.logging.ConsoleHandler)
> owned by "1462043760@qtp-924653460-20" t@77
>         at java.util.logging.ConsoleHandler.publish(Unknown Source)
>         at java.util.logging.Logger.log(Unknown Source)
>         at
> org.slf4j.impl.JDK14LoggerAdapter.log(JDK14LoggerAdapter.java:588)
>         at
> org.slf4j.impl.JDK14LoggerAdapter.info(JDK14LoggerAdapter.java:285)
>         at org.apache.solr.core.SolrCore.execute(SolrCore.java:1378)
>         at
>
> org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:356)
>         at
>
> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:252)
>         at
>
> org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
>         at
> org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:399)
>         at
> org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216)
>         at
> org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182)
>         at
> org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:766)
>         at
> org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:450)
>         at
>
> org.mortbay.jetty.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:230)
>         at
>
> org.mortbay.jetty.handler.HandlerCollection.handle(HandlerCollection.java:114)
>         at
> org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
>         at org.mortbay.jetty.Server.handle(Server.java:326)
>         at
> org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542)
>         at
>
> org.mortbay.jetty.HttpConnection$RequestHandler.content(HttpConnection.java:945)
>         at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:756)
>         at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:218)
>         at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404)
>         at
>
> org.mortbay.jetty.bio.SocketConnector$Connection.run(SocketConnector.java:228)
>         at
>
> org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)
>    Locked ownable synchronizers:
>         - None
> "565541321@qtp-924653460-37" - Thread t@103
>    java.lang.Thread.State: BLOCKED
>         at java.util.logging.StreamHandler.publish(Unknown Source)
>         - waiting to lock <23efc88b> (a java.util.logging.ConsoleHandler)
> owned by "1462043760@qtp-924653460-20" t@77
>         at java.util.logging.ConsoleHandler.publish(Unknown Source)
>         at java.util.logging.Logger.log(Unknown Source)
>         at
> org.slf4j.impl.JDK14LoggerAdapter.log(JDK14LoggerAdapter.java:588)
>         at
> org.slf4j.impl.JDK14LoggerAdapter.info(JDK14LoggerAdapter.java:285)
>         at org.apache.solr.core.SolrCore.execute(SolrCore.java:1378)
>         at
>
> org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:356)
>         at
>
> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:252)
>         at
>
> org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
>         at
> org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:399)
>         at
> org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216)
>         at
> org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182)
>         at
> org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:766)
>         at
> org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:450)
>         at
>
> org.mortbay.jetty.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:230)
>         at
>
> org.mortbay.jetty.handler.HandlerCollection.handle(HandlerCollection.java:114)
>         at
> org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
>         at org.mortbay.jetty.Server.handle(Server.java:326)
>         at
> org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542)
>         at
>
> org.mortbay.jetty.HttpConnection$RequestHandler.content(HttpConnection.java:945)
>         at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:756)
>         at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:218)
>         at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404)
>         at
>
> org.mortbay.jetty.bio.SocketConnector$Connection.run(SocketConnector.java:228)
>         at
>
> org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)
>    Locked ownable synchronizers:
>         - None
> "1474495170@qtp-924653460-35" - Thread t@101
>    java.lang.Thread.State: BLOCKED
>         at java.util.logging.StreamHandler.publish(Unknown Source)
>         - waiting to lock <23efc88b> (a java.util.logging.ConsoleHandler)
> owned by "1462043760@qtp-924653460-20" t@77
>         at java.util.logging.ConsoleHandler.publish(Unknown Source)
>         at java.util.logging.Logger.log(Unknown Source)
>         at
> org.slf4j.impl.JDK14LoggerAdapter.log(JDK14LoggerAdapter.java:588)
>         at
> org.slf4j.impl.JDK14LoggerAdapter.info(JDK14LoggerAdapter.java:285)
>         at org.apache.solr.core.SolrCore.execute(SolrCore.java:1378)
>         at
>
> org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:356)
>         at
>
> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:252)
>         at
>
> org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
>         at
> org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:399)
>         at
> org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216)
>         at
> org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182)
>         at
> org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:766)
>         at
> org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:450)
>         at
>
> org.mortbay.jetty.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:230)
>         at
>
> org.mortbay.jetty.handler.HandlerCollection.handle(HandlerCollection.java:114)
>         at
> org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
>         at org.mortbay.jetty.Server.handle(Server.java:326)
>         at
> org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542)
>         at
>
> org.mortbay.jetty.HttpConnection$RequestHandler.content(HttpConnection.java:945)
>         at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:756)
>         at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:218)
>         at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404)
>         at
>
> org.mortbay.jetty.bio.SocketConnector$Connection.run(SocketConnector.java:228)
>         at
>
> org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)
>    Locked ownable synchronizers:
>         - None
> "1903648782@qtp-924653460-33" - Thread t@96
>    java.lang.Thread.State: BLOCKED
>         at java.util.logging.StreamHandler.publish(Unknown Source)
>         - waiting to lock <23efc88b> (a java.util.logging.ConsoleHandler)
> owned by "1462043760@qtp-924653460-20" t@77
>         at java.util.logging.ConsoleHandler.publish(Unknown Source)
>         at java.util.logging.Logger.log(Unknown Source)
>         at
> org.slf4j.impl.JDK14LoggerAdapter.log(JDK14LoggerAdapter.java:588)
>         at
> org.slf4j.impl.JDK14LoggerAdapter.info(JDK14LoggerAdapter.java:285)
>         at org.apache.solr.core.SolrCore.execute(SolrCore.java:1378)
>         at
>
> org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:356)
>         at
>
> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:252)
>         at
>
> org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
>         at
> org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:399)
>         at
> org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216)
>         at
> org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182)
>         at
> org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:766)
>         at
> org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:450)
>         at
>
> org.mortbay.jetty.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:230)
>         at
>
> org.mortbay.jetty.handler.HandlerCollection.handle(HandlerCollection.java:114)
>         at
> org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
>         at org.mortbay.jetty.Server.handle(Server.java:326)
>         at
> org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542)
>         at
>
> org.mortbay.jetty.HttpConnection$RequestHandler.content(HttpConnection.java:945)
>         at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:756)
>         at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:218)
>         at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404)
>         at
>
> org.mortbay.jetty.bio.SocketConnector$Connection.run(SocketConnector.java:228)
>         at
>
> org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)
>    Locked ownable synchronizers:
>         - None
> "1414979395@qtp-924653460-32" - Thread t@95
>    java.lang.Thread.State: BLOCKED
>         at java.util.logging.StreamHandler.publish(Unknown Source)
>         - waiting to lock <23efc88b> (a java.util.logging.ConsoleHandler)
> owned by "1462043760@qtp-924653460-20" t@77
>         at java.util.logging.ConsoleHandler.publish(Unknown Source)
>         at java.util.logging.Logger.log(Unknown Source)
>         at
> org.slf4j.impl.JDK14LoggerAdapter.log(JDK14LoggerAdapter.java:588)
>         at
> org.slf4j.impl.JDK14LoggerAdapter.info(JDK14LoggerAdapter.java:285)
>         at org.apache.solr.core.SolrCore.execute(SolrCore.java:1378)
>         at
>
> org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:356)
>         at
>
> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:252)
>         at
>
> org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
>         at
> org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:399)
>         at
> org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216)
>         at
> org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182)
>         at
> org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:766)
>         at
> org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:450)
>         at
>
> org.mortbay.jetty.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:230)
>         at
>
> org.mortbay.jetty.handler.HandlerCollection.handle(HandlerCollection.java:114)
>         at
> org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
>         at org.mortbay.jetty.Server.handle(Server.java:326)
>         at
> org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542)
>         at
>
> org.mortbay.jetty.HttpConnection$RequestHandler.content(HttpConnection.java:945)
>         at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:756)
>         at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:218)
>         at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404)
>         at
>
> org.mortbay.jetty.bio.SocketConnector$Connection.run(SocketConnector.java:228)
>         at
>
> org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)
>    Locked ownable synchronizers:
>         - None
> "299909417@qtp-924653460-26" - Thread t@86
>    java.lang.Thread.State: BLOCKED
>         at java.util.logging.StreamHandler.publish(Unknown Source)
>         - waiting to lock <23efc88b> (a java.util.logging.ConsoleHandler)
> owned by "1462043760@qtp-924653460-20" t@77
>         at java.util.logging.ConsoleHandler.publish(Unknown Source)
>         at java.util.logging.Logger.log(Unknown Source)
>         at
> org.slf4j.impl.JDK14LoggerAdapter.log(JDK14LoggerAdapter.java:588)
>         at
> org.slf4j.impl.JDK14LoggerAdapter.info(JDK14LoggerAdapter.java:285)
>         at org.apache.solr.core.SolrCore.execute(SolrCore.java:1378)
>         at
>
> org.apache.solr.handler.PingRequestHandler.handleRequestBody(PingRequestHandler.java:68)
>         at
>
> org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:129)
>         at org.apache.solr.core.SolrCore.execute(SolrCore.java:1368)
>         at
>
> org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:356)
>         at
>
> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:252)
>         at
>
> org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
>         at
> org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:399)
>         at
> org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216)
>         at
> org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182)
>         at
> org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:766)
>         at
> org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:450)
>         at
>
> org.mortbay.jetty.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:230)
>         at
>
> org.mortbay.jetty.handler.HandlerCollection.handle(HandlerCollection.java:114)
>         at
> org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
>         at org.mortbay.jetty.Server.handle(Server.java:326)
>         at
> org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542)
>         at
>
> org.mortbay.jetty.HttpConnection$RequestHandler.headerComplete(HttpConnection.java:928)
>         at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:549)
>         at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:212)
>         at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404)
>         at
>
> org.mortbay.jetty.bio.SocketConnector$Connection.run(SocketConnector.java:228)
>         at
>
> org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)
>    Locked ownable synchronizers:
>         - None
> "2049963161@qtp-924653460-23" - Thread t@80
>    java.lang.Thread.State: BLOCKED
>         at java.util.logging.StreamHandler.publish(Unknown Source)
>         - waiting to lock <23efc88b> (a java.util.logging.ConsoleHandler)
> owned by "1462043760@qtp-924653460-20" t@77
>         at java.util.logging.ConsoleHandler.publish(Unknown Source)
>         at java.util.logging.Logger.log(Unknown Source)
>         at
> org.slf4j.impl.JDK14LoggerAdapter.log(JDK14LoggerAdapter.java:588)
>         at
> org.slf4j.impl.JDK14LoggerAdapter.info(JDK14LoggerAdapter.java:285)
>         at org.apache.solr.core.SolrCore.execute(SolrCore.java:1378)
>         at
>
> org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:356)
>         at
>
> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:252)
>         at
>
> org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
>         at
> org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:399)
>         at
> org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216)
>         at
> org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182)
>         at
> org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:766)
>         at
> org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:450)
>         at
>
> org.mortbay.jetty.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:230)
>         at
>
> org.mortbay.jetty.handler.HandlerCollection.handle(HandlerCollection.java:114)
>         at
> org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
>         at org.mortbay.jetty.Server.handle(Server.java:326)
>         at
> org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542)
>         at
>
> org.mortbay.jetty.HttpConnection$RequestHandler.content(HttpConnection.java:945)
>         at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:756)
>         at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:218)
>         at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404)
>         at
>
> org.mortbay.jetty.bio.SocketConnector$Connection.run(SocketConnector.java:228)
>         at
>
> org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)
>    Locked ownable synchronizers:
>         - None
> "959425865@qtp-924653460-22" - Thread t@79
>    java.lang.Thread.State: BLOCKED
>         at java.util.logging.StreamHandler.publish(Unknown Source)
>         - waiting to lock <23efc88b> (a java.util.logging.ConsoleHandler)
> owned by "1462043760@qtp-924653460-20" t@77
>         at java.util.logging.ConsoleHandler.publish(Unknown Source)
>         at java.util.logging.Logger.log(Unknown Source)
>         at
> org.slf4j.impl.JDK14LoggerAdapter.log(JDK14LoggerAdapter.java:588)
>         at
> org.slf4j.impl.JDK14LoggerAdapter.info(JDK14LoggerAdapter.java:285)
>         at org.apache.solr.core.SolrCore.execute(SolrCore.java:1378)
>         at
>
> org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:356)
>         at
>
> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:252)
>         at
>
> org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
>         at
> org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:399)
>         at
> org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216)
>         at
> org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182)
>         at
> org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:766)
>         at
> org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:450)
>         at
>
> org.mortbay.jetty.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:230)
>         at
>
> org.mortbay.jetty.handler.HandlerCollection.handle(HandlerCollection.java:114)
>         at
> org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
>         at org.mortbay.jetty.Server.handle(Server.java:326)
>         at
> org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542)
>         at
>
> org.mortbay.jetty.HttpConnection$RequestHandler.content(HttpConnection.java:945)
>         at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:756)
>         at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:218)
>         at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404)
>         at
>
> org.mortbay.jetty.bio.SocketConnector$Connection.run(SocketConnector.java:228)
>         at
>
> org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)
>    Locked ownable synchronizers:
>         - None
> "1854553074@qtp-924653460-15" - Thread t@69
>    java.lang.Thread.State: BLOCKED
>         at java.util.logging.StreamHandler.publish(Unknown Source)
>         - waiting to lock <23efc88b> (a java.util.logging.ConsoleHandler)
> owned by "1462043760@qtp-924653460-20" t@77
>         at java.util.logging.ConsoleHandler.publish(Unknown Source)
>         at java.util.logging.Logger.log(Unknown Source)
>         at
> org.slf4j.impl.JDK14LoggerAdapter.log(JDK14LoggerAdapter.java:588)
>         at
> org.slf4j.impl.JDK14LoggerAdapter.info(JDK14LoggerAdapter.java:285)
>         at org.apache.solr.core.SolrCore.execute(SolrCore.java:1378)
>         at
>
> org.apache.solr.servlet.SolrDispatchFilter.execute(SolrDispatchFilter.java:356)
>         at
>
> org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:252)
>         at
>
> org.mortbay.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1212)
>         at
> org.mortbay.jetty.servlet.ServletHandler.handle(ServletHandler.java:399)
>         at
> org.mortbay.jetty.security.SecurityHandler.handle(SecurityHandler.java:216)
>         at
> org.mortbay.jetty.servlet.SessionHandler.handle(SessionHandler.java:182)
>         at
> org.mortbay.jetty.handler.ContextHandler.handle(ContextHandler.java:766)
>         at
> org.mortbay.jetty.webapp.WebAppContext.handle(WebAppContext.java:450)
>         at
>
> org.mortbay.jetty.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:230)
>         at
>
> org.mortbay.jetty.handler.HandlerCollection.handle(HandlerCollection.java:114)
>         at
> org.mortbay.jetty.handler.HandlerWrapper.handle(HandlerWrapper.java:152)
>         at org.mortbay.jetty.Server.handle(Server.java:326)
>         at
> org.mortbay.jetty.HttpConnection.handleRequest(HttpConnection.java:542)
>         at
>
> org.mortbay.jetty.HttpConnection$RequestHandler.content(HttpConnection.java:945)
>         at org.mortbay.jetty.HttpParser.parseNext(HttpParser.java:756)
>         at org.mortbay.jetty.HttpParser.parseAvailable(HttpParser.java:218)
>         at org.mortbay.jetty.HttpConnection.handle(HttpConnection.java:404)
>         at
>
> org.mortbay.jetty.bio.SocketConnector$Connection.run(SocketConnector.java:228)
>         at
>
> org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)
>    Locked ownable synchronizers:
>         - None
> "440688079@qtp-924653460-8 - Acceptor1 SocketConnector@0.0.0.0:8983" -
> Thread t@26
>    java.lang.Thread.State: BLOCKED
>         at java.net.PlainSocketImpl.accept(Unknown Source)
>         - waiting to lock <5b5bd00c> (a java.net.SocksSocketImpl) owned by
> "370915326@qtp-924653460-9 - Acceptor0 SocketConnector@0.0.0.0:8983" t@27
>         at java.net.ServerSocket.implAccept(Unknown Source)
>         at java.net.ServerSocket.accept(Unknown Source)
>         at
> org.mortbay.jetty.bio.SocketConnector.accept(SocketConnector.java:99)
>         at
>
> org.mortbay.jetty.AbstractConnector$Acceptor.run(AbstractConnector.java:708)
>         at
>
> org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)
>    Locked ownable synchronizers:
>         - None
> "1422284074@qtp-924653460-7 - Acceptor2 SocketConnector@0.0.0.0:8983" -
> Thread t@25
>    java.lang.Thread.State: BLOCKED
>         at java.net.PlainSocketImpl.accept(Unknown Source)
>         - waiting to lock <5b5bd00c> (a java.net.SocksSocketImpl) owned by
> "370915326@qtp-924653460-9 - Acceptor0 SocketConnector@0.0.0.0:8983" t@27
>         at java.net.ServerSocket.implAccept(Unknown Source)
>         at java.net.ServerSocket.accept(Unknown Source)
>         at
> org.mortbay.jetty.bio.SocketConnector.accept(SocketConnector.java:99)
>         at
>
> org.mortbay.jetty.AbstractConnector$Acceptor.run(AbstractConnector.java:708)
>         at
>
> org.mortbay.thread.QueuedThreadPool$PoolThread.run(QueuedThreadPool.java:582)
>    Locked ownable synchronizers:
>         - None
>
>
>
> --
> View this message in context:
> http://lucene.472066.n3.nabble.com/Thread-Blocking-Apache-Solr-3-6-1-tp3999191.html
> Sent from the Solr - User mailing list archive at Nabble.com.
>



-- 
Sincerely yours
Mikhail Khludnev
Tech Lead
Grid Dynamics

<http://www.griddynamics.com>
 <mkhlud...@griddynamics.com>

Reply via email to