[ 
https://issues.apache.org/jira/browse/SOLR-5477?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13881414#comment-13881414
 ] 

Anshum Gupta edited comment on SOLR-5477 at 1/24/14 8:45 PM:
-------------------------------------------------------------

Added checking for existing tasks with the same id.

Have a lot of coming up in the logs. Trying to debug that.

{quote}
414075 [Overseer-91131269805768705-10.0.0.3:7574_solr-n_0000000001] WARN  
org.apache.solr.cloud.OverseerCollectionProcessor  – Overseer cannot talk to ZK
414075 [Thread-16] ERROR org.apache.solr.cloud.Overseer  – Exception in 
Overseer main queue loop
org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = 
ConnectionLoss for /overseer/queue...
        at org.apache.zookeeper.KeeperException.create(KeeperException.java:99)
        at org.apache.zookeeper.KeeperException.create(KeeperException.java:51)
        at org.apache.zookeeper.ZooKeeper.getChildren(ZooKeeper.java:1468)
        at 
org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:256)
        at 
org.apache.solr.common.cloud.SolrZkClient$6.execute(SolrZkClient.java:253)
        at 
org.apache.solr.common.cloud.ZkCmdExecutor.retryOperation(ZkCmdExecutor.java:73)
{quote}


was (Author: anshumg):
Added checking for existing tasks with the same id.

Have a lot of coming up in the logs. Trying to debug that.

{quote}
414075 [Overseer-91131269805768705-10.0.0.3:7574_solr-n_0000000001] WARN  
org.apache.solr.cloud.OverseerCollectionProcessor  – Overseer cannot talk to ZK
414075 [Thread-16] ERROR org.apache.solr.cloud.Overseer  – Exception in 
Overseer main queue loop
org.apache.zookeeper.KeeperException$ConnectionLossException: KeeperErrorCode = 
ConnectionLoss for /overseer/queue...
{/quote}

> Async execution of OverseerCollectionProcessor tasks
> ----------------------------------------------------
>
>                 Key: SOLR-5477
>                 URL: https://issues.apache.org/jira/browse/SOLR-5477
>             Project: Solr
>          Issue Type: Sub-task
>          Components: SolrCloud
>            Reporter: Noble Paul
>            Assignee: Anshum Gupta
>         Attachments: SOLR-5477-CoreAdminStatus.patch, SOLR-5477.patch, 
> SOLR-5477.patch, SOLR-5477.patch, SOLR-5477.patch, SOLR-5477.patch, 
> SOLR-5477.patch, SOLR-5477.patch
>
>
> Typical collection admin commands are long running and it is very common to 
> have the requests get timed out.  It is more of a problem if the cluster is 
> very large.Add an option to run these commands asynchronously
> add an extra param async=true for all collection commands
> the task is written to ZK and the caller is returned a task id. 
> as separate collection admin command will be added to poll the status of the 
> task
> command=status&id=7657668909
> if id is not passed all running async tasks should be listed
> A separate queue is created to store in-process tasks . After the tasks are 
> completed the queue entry is removed. OverSeerColectionProcessor will perform 
> these tasks in multiple threads



--
This message was sent by Atlassian JIRA
(v6.1.5#6160)

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org

Reply via email to