Re: Bootstrapping / Full Importing using Solr Cloud

2013-10-08 Thread Erick Erickson
DIH works with SolrCloud as far as I understand. But moving to SolrJ has several advantages: 1> you have more control over our process, beter ability to debug etc. 2> If you can partition your data up amongst several clients, you can probably get through your jobs much faster. 3> You're not overloa

Bootstrapping / Full Importing using Solr Cloud

2013-10-08 Thread Mark
We are in the process of upgrading our Solr cluster to the latest and greatest Solr Cloud. I have some questions regarding full indexing though. We're currently running a long job (~30 hours) using DIH to do a full index on over 10M products. This process consumes a lot of memory and while updat