Re: Overseer & Backups - Questions

2020-03-10 Thread Ashwin Ramesh
Hey Aroop, Yes we sent ASYNC= Backups are taken to an EFS drive (AWS's managed NFS) I also thought it was async and Solr can process multiple tasks at once. But the ZK state definitely showed that only the backup task was in progress while all the other tasks were queued up. Regards, Ash On W

Re: Overseer & Backups - Questions

2020-03-10 Thread Aroop Ganguly
Backups on hdfs ? These should not be blocking if invoked asynchronously, are u doing them async by passing the async flag? > On Mar 10, 2020, at 3:19 PM, Ashwin Ramesh wrote: > > We use the collection API to invoke backups. The tasks we noticed that > stalled are ADDREPLICA. As expected when t

Re: Overseer & Backups - Questions

2020-03-10 Thread Ashwin Ramesh
We use the collection API to invoke backups. The tasks we noticed that stalled are ADDREPLICA. As expected when the backup completed a few hours ago, the task then got completed. Is there some concurrency setting with these tasks? Or is a backup a blocking task? We noticed that the index was still

Re: Overseer & Backups - Questions

2020-03-10 Thread Aroop Ganguly
May we know how you are invoking backups ? > On Mar 9, 2020, at 11:53 PM, Ashwin Ramesh wrote: > > Hi everybody, > > Quick Specs: > - Solr 7.4 Solr Cloud > - 30gb index on 8 shards Tlog/Pull > > We run daily backups on our 30gb index and noticed that the overseer does > not process other jobs

Overseer & Backups - Questions

2020-03-09 Thread Ashwin Ramesh
Hi everybody, Quick Specs: - Solr 7.4 Solr Cloud - 30gb index on 8 shards Tlog/Pull We run daily backups on our 30gb index and noticed that the overseer does not process other jobs on it's task list while the backup is being taken. They remain on the pending list (in ZK). Is this expected? Also