[
https://issues.apache.org/jira/browse/SOLR-1632?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Markus Jelsma updated SOLR-1632:
--------------------------------
Attachment: SOLR-1632.patch
Ok, i updated the patch for today's trunk and it actually works now with
ExactStatsCache. We now have correct DF for distributed queries.
I removed the perReaderTermContext in ExactStatsCache, this cached the
TermContext for new terms. This was a problem because caching it this way meant
that any second term got the same DF as the first.
I also added a local boolean to SolrIndexSearcher's collectionStatistics() and
termStatistics() to force it to return only local scores. This is a nasty hack
to prevent it from returning the other shard's DF. Without this, DF will
increase for every other request, in the end it will crash the systems because
the number gets too high.
Also, the warning ## Missing global termStats info: " + term + ", using local
should perhaps not be a warning at all. This gets emitted also for fields not
having those terms. The check in returnLocalStats doesn't add terms for docFreq
== 0.
Add <globalStats class="org.apache.solr.search.stats.ExactStatsCache"/> to your
solrconfig in the config section to make it work.
Please check my patch and let's fix this issue so we hopefully can get
distributed IDF in Solr 4.7.
> Distributed IDF
> ---------------
>
> Key: SOLR-1632
> URL: https://issues.apache.org/jira/browse/SOLR-1632
> Project: Solr
> Issue Type: New Feature
> Components: search
> Affects Versions: 1.5
> Reporter: Andrzej Bialecki
> Fix For: 5.0
>
> Attachments: 3x_SOLR-1632_doesntwork.patch, SOLR-1632.patch,
> SOLR-1632.patch, SOLR-1632.patch, SOLR-1632.patch, SOLR-1632.patch,
> SOLR-1632.patch, distrib-2.patch, distrib.patch
>
>
> Distributed IDF is a valuable enhancement for distributed search across
> non-uniform shards. This issue tracks the proposed implementation of an API
> to support this functionality in Solr.
--
This message was sent by Atlassian JIRA
(v6.1#6144)
---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscr...@lucene.apache.org
For additional commands, e-mail: dev-h...@lucene.apache.org
