Hi,
Our indexer before starting does upload/reload of Solr configuration files
using ZK UPLOAD and RELOAD APIs. In this process zookeeper is not
stopped/restarted. ZK is alive and so are Solr nodes.
Doing this often causes following exception. Kindly note that the ZK
instance is standalone and not ensemble. This exception is only happening
at RELOAD.
{"responseHeader":{"status":500,"QTime":180028},"error":{"msg":"reload the
collection time out:180s","trace":"org.apache.solr.common.SolrException:
reload the collection time out:180s\n\tat
org.apache.solr.handler.admin.CollectionsHandler.handleResponse(CollectionsHandler.java:237)\n\tat
org.apache.solr.handler.admin.CollectionsHandler.handleRequestBody(CollectionsHandler.java:168)\n\tat
org.apache.solr.handler.RequestHandlerBase.handleRequest(RequestHandlerBase.java:143)\n\tat
org.apache.solr.servlet.HttpSolrCall.handleAdminRequest(HttpSolrCall.java:660)\n\tat
org.apache.solr.servlet.HttpSolrCall.call(HttpSolrCall.java:431)\n\tat
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:227)\n\tat
org.apache.solr.servlet.SolrDispatchFilter.doFilter(SolrDispatchFilter.java:196)\n\tat
org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652)\n\tat
org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:585)\n\tat
org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143)\n\tat
org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:577)\n\tat
org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:223)\n\tat
org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1127)\n\tat
org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:515)\n\tat
org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)\n\tat
org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1061)\n\tat
org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)\n\tat
org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:215)\n\tat
org.eclipse.jetty.server.handler.HandlerCollection.handle(HandlerCollection.java:110)\n\tat
org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:97)\n\tat
org.eclipse.jetty.server.Server.handle(Server.java:497)\n\tat
org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:310)\n\tat
org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:257)\n\tat
org.eclipse.jetty.io.AbstractConnection$2.run(AbstractConnection.java:540)\n\tat
org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:635)\n\tat
org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:555)\n\tat
java.lang.Thread.run(Thread.java:745)\n","code":500}}
Kindly help as this is blocking our smooth process of indexing.
Regards,
Modassar
On Tue, Jul 28, 2015 at 11:40 AM, Shawn Heisey <apa...@elyograg.org> wrote:
> On 7/27/2015 10:59 PM, Modassar Ather wrote:
> > If we upgrade zookeeper we need to restart. This upgrade process is
> > automated for future releases/changes of zookeeper.
> > This is a single external zookeeper which is completely stopped/shutdown.
> > No Solr node are restarted/shutdown.
> > What I have understanding that even if the zookeeper shuts down, after
> > restart the Solr nodes should come insync with the ZK state. Please
> correct
> > me if I am wrong.
>
> Disclaimer: I do not have a ton of concrete experience with SolrCloud.
> I do have a cloud setup, but it is running Solr 4.2.1, which at this
> point is ancient. I haven't needed to do much to maintain it ... it
> takes care of itself.
>
> Recovering correctly from a complete zookeeper failure is what I would
> hope for, but it's a scenario that I've never tried. I hope there's a
> unit test for it, but I haven't checked.
>
> A fully redundant zookeeper ensemble requires a minimum of three hosts.
> If you need to upgrade ZK, then you upgrade them one at a time, and the
> ensemble never loses quorum.
>
> http://wiki.apache.org/hadoop/ZooKeeper/FAQ#A6
>
> Thanks,
> Shawn
>
>
