Re: BinaryResponseWriter fetches unnecessary fields?

2018-01-24 Thread Chris Hostetter
: Thanks Chris! Is RetrieveFieldsOptimizer a new functionality introduced in : 7.x? Our observation is with botht 5.4 & 6.4. I have created a jira for : the issue: The same basic code path (related to stored fields) probably existed largely as is in 5.x and 6.x and was then later refactored

Re: BinaryResponseWriter fetches unnecessary fields?

2018-01-23 Thread Wei
Thanks Chris! Is RetrieveFieldsOptimizer a new functionality introduced in 7.x? Our observation is with botht 5.4 & 6.4. I have created a jira for the issue: https://issues.apache.org/jira/browse/SOLR-11891 I am also wondering how enableLazyFieldLoading affect the case, but haven't tested yet.

Re: BinaryResponseWriter fetches unnecessary fields?

2018-01-22 Thread Chris Hostetter
: Inside convertLuceneDocToSolrDoc(): : : : https://github.com/apache/lucene-solr/blob/df874432b9a17b547acb24a01d3491 : 839e6a6b69/solr/core/src/java/org/apache/solr/response/ : DocsStreamer.java#L182 : : :for (IndexableField f : doc.getFields()) : : : I am a bit puzzled why we need to

BinaryResponseWriter fetches unnecessary fields?

2018-01-19 Thread Wei
Hi all, We observe that solr query time increases significantly with the number of rows requested, even all we retrieve for each document is just fl=id,score. Debugged a bit and see that most of the increased time was spent in BinaryResponseWriter, converting lucene document into