[ https://issues.apache.org/jira/browse/SOLR-5477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13881414#comment-13881414 ]
Anshum Gupta edited comment on SOLR-5477 at 1/24/14 8:45 PM: ------------------------------------------------------------- Added checking for existing tasks with the same id. Have a lot of coming up in the logs. Trying to debug that. {quote} 414075 [Overseer-91131269805768705-10.0.0.3:7574_solr-n_0000000001] WARN org.apache.solr.cloud.OverseerCollectionProcessor – Overseer cannot talk to ZK 414075 [Thread-16] ERROR org.apache.solr.cloud.Overseer – Exception in Overseer main queue loop org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for /overseer/queue... at org.apache.zookeeper.KeeperException.create(KeeperException.java:99) at org.apache.zookeeper.KeeperException.create(KeeperException.java:51) at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1468) at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:256) at org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:253) at org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73) {quote} was (Author: anshumg): Added checking for existing tasks with the same id. Have a lot of coming up in the logs. Trying to debug that. {quote} 414075 [Overseer-91131269805768705-10.0.0.3:7574_solr-n_0000000001] WARN org.apache.solr.cloud.OverseerCollectionProcessor – Overseer cannot talk to ZK 414075 [Thread-16] ERROR org.apache.solr.cloud.Overseer – Exception in Overseer main queue loop org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = ConnectionLoss for /overseer/queue... {/quote} > Async execution of OverseerCollectionProcessor tasks > ---------------------------------------------------- > > Key: SOLR-5477 > URL: https://issues.apache.org/jira/browse/SOLR-5477 > Project: Solr > Issue Type: Sub-task > Components: SolrCloud > Reporter: Noble Paul > Assignee: Anshum Gupta > Attachments: SOLR-5477-CoreAdminStatus.patch, SOLR-5477.patch, > SOLR-5477.patch, SOLR-5477.patch, SOLR-5477.patch, SOLR-5477.patch, > SOLR-5477.patch, SOLR-5477.patch > > > Typical collection admin commands are long running and it is very common to > have the requests get timed out. It is more of a problem if the cluster is > very large.Add an option to run these commands asynchronously > add an extra param async=true for all collection commands > the task is written to ZK and the caller is returned a task id. > as separate collection admin command will be added to poll the status of the > task > command=status&id=7657668909 > if id is not passed all running async tasks should be listed > A separate queue is created to store in-process tasks . After the tasks are > completed the queue entry is removed. OverSeerColectionProcessor will perform > these tasks in multiple threads -- This message was sent by Atlassian JIRA (v6.1.5#6160) --------------------------------------------------------------------- To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org For additional commands, e-mail: dev-h...@lucene.apache.org