On Sep 23, 2009, at 4:26 PM, Luo, Jeff wrote:
Hi,
We are experimenting a parallel approach to issue a large OR-Boolean
query, e.g., keywords:(1 OR 2 OR 3 OR ... OR 102400), against several
solr shards.
The way we are trying is to break the large query into smaller ones,
e.g.,
the example above can be broken into 10 small queries: keywords:(1
OR 2
OR 3 OR ... OR 1024), keywords:(1025 OR 1026 OR 1027 OR ... OR 2048),
etc
Now each shard will get 10 requests and the master will merge the
results coming back from each shard, similar to the regular
distributed
search.
Can you tell us a little bit more about the why/what of this? Are you
really searching numbers or are those just for example? Do you care
about the score or do you just need to know whether the result is
there or not?
--------------------------
Grant Ingersoll
http://www.lucidimagination.com/
Search the Lucene ecosystem (Lucene/Solr/Nutch/Mahout/Tika/Droids)
using Solr/Lucene:
http://www.lucidimagination.com/search
