Re: SolrCloud DIH issue

2015-09-20 Thread Upayavira
It is worth noting that the ref guide page on configsets refers to non-cloud mode (a useful new feature) whereas people may confuse this with configsets in cloud mode, which use Zookeeper. Upayavira On Sun, Sep 20, 2015, at 04:59 AM, Ravi Solr wrote: > Cant thank you enough for clarifying it at

Re: SolrCloud DIH issue

2015-09-20 Thread Ravi Solr
Yes Upayavira, that's exactly what prompted me to ask Erick as soon as I read https://cwiki.apache.org/confluence/display/solr/Config+Sets Erick, Regarding my delta-import not working I do see the dataimport.properties in zookeeper. after I "upconfig" and "linkconfig" my conf files into ZK...see

Re: SolrCloud DIH issue

2015-09-19 Thread Ravi Solr
Thanks Erick, I will report back once the reindex is finished. Oh, your answer reminded me of another question - Regarding configsets the documentation says "On a multicore Solr instance, you may find that you want to share configuration between a number of different cores." Can the same be used

Re: SolrCloud DIH issue

2015-09-19 Thread Erick Erickson
Let's back up a second. Configsets are what _used_ to be in the conf directory for each core on a local drive, it's just that they're now kept up on Zookeeper. Otherwise, you'd have to put them on each instance in SolrCloud, and bringing up a new replica on a new machine would look a lot like

Re: SolrCloud DIH issue

2015-09-19 Thread Ravi Solr
Cant thank you enough for clarifying it at length. Yeah its pretty confusing even for experienced Solr users. I used the upconfig and linkconfig commands to update 4 collections into zookeeper...As you described, I lucked out as I used the same name for configset and the collection and hence did

Re: SolrCloud DIH issue

2015-09-19 Thread Ravi Solr
Thank you for the prompt response Erick. I did a full-import yesterday, you are correct that I did not push dataimport.properties to ZK, should it have not worked even for a full import ?. You may be right about 'clean' option, I will reindex again today. BTW how do we push a single file to a

Re: SolrCloud DIH issue

2015-09-19 Thread Erick Erickson
Just pushing up the entire configset would be easiest, but the Zookeeper command line tools allow you to push up a single file if you want. Yeah, it puzzles me too that the import worked yesterday, not really sure what happened, the file shouldn't just disappear Erick On Sat, Sep 19, 2015

SolrCloud DIH issue

2015-09-19 Thread Ravi Solr
I am facing a weird problem. As part of upgrade from 4.7.2 (Master-Slave) to 5.3.0 (Solrcloud) I re-indexed 1.5 million records via DIH using SolrEntityProcessor yesterday, all of them indexed properly. Today morning I just ran the DIH again with delta import and I lost all docs...what am I

Re: SolrCloud DIH issue

2015-09-19 Thread Erick Erickson
Could not read DIH properties from /configs/sitesearchcore/dataimport.properties This looks like somehow you didn't push this file up to Zookeeper. You can check what files are there in the admin UI. How you indexed yesterday is a mystery though, unless somehow this file was removed from ZK. As