Re: Solr re-indexing in case of store=false

2016-05-09 Thread Erick Erickson
Stored data is compressed by default, anecdotally there's about a 2:1 compression ratio. But the _other_ reason not to store all the data is that it then gets replicated. If you have master/slave or SolrCloud with replicas, you have N copies of your index and each and every one of them has a copy

Re: Solr re-indexing in case of store=false

2016-05-09 Thread Ali Nazemian
Dear Erick, Hi, Thank you very much. About the storing part you are right, unless the primary datastore uses some kind of data compression which in my case it does (I am using Cassandra as a primary datastore), and I am not sure about Solr that it has any kind of compression or not. According to yo

Re: Solr re-indexing in case of store=false

2016-05-08 Thread Erick Erickson
bq: I would be grateful if somebody could introduce other way of re-indexing the whole data without using another datastore Not possible currently. Consider what's _in_ the index when stored="false". The actual terms are the output of the entire analysis chain, including stemming, stopword removal

Solr re-indexing in case of store=false

2016-05-08 Thread Ali Nazemian
Dear all, Hi, I was wondering, is it possible to re-index Solr 6.0 data in case of store=false? I am using Solr as a secondary datastore, and for the sake of space efficiency all the fields (except id) are considered as store=false. Currently, due to some changes in application business, Solr schem