Re: questions regrading stored fields role in query time

2019-02-26 Thread Erick Erickson
It Depends (tm). See: SOLR-12598 for details. The short form is that as of Solr 7.5, Solr attempts to do the most efficient thing possible when fetching fields to return to the client. 1> if all requested fields are docValues, return from docValues. 2> if _any_ field is stored, return from the

Re: questions regrading stored fields role in query time

2019-02-26 Thread Shawn Heisey
On 2/26/2019 1:34 AM, Saurabh Sharma wrote: Now we want to do partial updates.I went through the documentation and found that all the fields should be stored or docValues for partial updates. I have few questions regarding this? 1) In case i am just fetching only 1 field while making query.What

Re: questions regrading stored fields role in query time

2019-02-26 Thread Emir Arnautović
Hi Saurabh, DocValues can be used for retrieving field values (note that order will not be preserved in case of multivalue field) but they are also stored in files, just different structures. Doc values will load some structure in memory, but will also use memory mapped files to access values (n

Re: questions regrading stored fields role in query time

2019-02-26 Thread Saurabh Sharma
Hi Emir, I had this question in my mind if I store my only returnable field as docValue in RAM.will my stored documents be referenced while constructing the response after the query. Ideally, as the field asked to return i.e fl is already in RAM then documents on disk should not be consulted for t

Re: questions regrading stored fields role in query time

2019-02-26 Thread Emir Arnautović
Hi Saurabh, Welcome to the channel! Storing fields should not affect query performances directly if you use lazy field loading and it is the default set. And it should not affect at all if you have enough RAM compared to index size. Otherwise OS caches might be affected by stored fields. The bes

questions regrading stored fields role in query time

2019-02-26 Thread Saurabh Sharma
Hi All , I am new here on this channel. Few days back we upgraded our solr cloud to version 7.3 and doing real-time document posting with 15 seconds soft commit and 2 minutes hard commit time.As of now we posting full document to solr which includes data accumulations from various sources. Now w