Re: Challenges with new Solrcloud Backup/Restore functionality

2016-11-08 Thread Hrishikesh Gadre
Hi Stephen, Thanks for the update. Regarding SOLR-9527 - I think we need a unit test for verifying "createNodeSet" functionality. I will spend some time on it in next couple of days. Also regarding #2, i also found similar issue (doc count mismatch after restore) while testing with a large

Re: Challenges with new Solrcloud Backup/Restore functionality

2016-11-08 Thread Stephen Weiss
Just wanted to note that we tested out the patch from SOLR-9527 and it worked perfectly for the balancing issue - thank you so much for that! As for issue #2, we've resorted to doing a hard commit, stopping all indexing against the index, and then taking the backup, and we have a reasonably

Re: Challenges with new Solrcloud Backup/Restore functionality

2016-10-04 Thread Stephen Lewis
Hi All, I have been experiencing error#1 too with the current branch_6_2 build. I started noticing after I applied my patch to that branch (on issue #2), but it appears to occur without the patch as well. I haven't seen this issue with solr 6.1.0

Re: Challenges with new Solrcloud Backup/Restore functionality

2016-09-26 Thread Hrishikesh Gadre
Hi Stephen, regarding #1, can you verify following steps during backup/restore? - Before backup command, make sure to run a "hard" commit on the original collection. The backup operation will capture only hard committed data. - After restore command, check the Solr web UI to verify that all

Re: Challenges with new Solrcloud Backup/Restore functionality

2016-09-26 Thread Stephen Weiss
#2 - that's great news. I'll try to patch it in and test it out. #1 - In all cases, the backup and restore both appear successful. There are no failure messages for any of the shards, no warnings, etc - I didn't even realize at first that data was missing until I noticed differences in some

Re: Challenges with new Solrcloud Backup/Restore functionality

2016-09-25 Thread Hrishikesh Gadre
Hi Steve, Regarding the 2nd issue, a JIRA is already created and patch is uploaded (SOLR-9527). Can someone review and commit the patch? Regarding 1st issue, does backup command succeeds? Also do you see any warning/error log messages? How about the restore command? Thanks Hrishikesh On Sat,

Challenges with new Solrcloud Backup/Restore functionality

2016-09-24 Thread Stephen Weiss
Hi everyone, We're very excited about SolrCloud's new backup / restore collection APIs, which should introduce some major new efficiencies into our indexing workflow. Unfortunately, we've run into some snags with it that are preventing us from moving into production. I was hoping someone on