Re: compare two shards.
If you can spare the load of a long request, I'd do an unsorted query for everything, non-paged. I'd dump that into a line-per-row format and use something like Apache Hive to do the analysis. Michael Della Bitta Appinions 18 East 41st Street, 2nd Floor New York, NY 10017-6271 www.appinions.com Where Influence Isn’t a Game On Tue, Feb 12, 2013 at 4:20 AM, stockii wrote: > hello. > > i want to compare two shards each other, because these shards should have > the same index. but this isnt so =( > so i want to find these documents, there are missing in one shard of my both > shards. > > my ideas > - distrubuted shard request on my nodes and fire a facet search on my > unique-field. but the result of facet component isnt reversable =( > > - grouping. but its not working correctly i think so. no groups of the same > uniquekey in the resultset. > > > does anyone some better ideas? > > > > -- > View this message in context: > http://lucene.472066.n3.nabble.com/compare-two-shards-tp4039887.html > Sent from the Solr - User mailing list archive at Nabble.com.
Re: compare two shards.
I do a brute-force regression test where I read all the documents from shard 1 and compare them to documents in shard 2. I had to have all the fields stored to do that, but in my case that doesn't change the size of the index much. So, in other words, I do a search for a page's worth of documents sorted by the same thing and compare them, then get the next page and do the same. On Tue, Feb 12, 2013 at 4:20 AM, stockii wrote: > hello. > > i want to compare two shards each other, because these shards should have > the same index. but this isnt so =( > so i want to find these documents, there are missing in one shard of my > both > shards. > > my ideas > - distrubuted shard request on my nodes and fire a facet search on my > unique-field. but the result of facet component isnt reversable =( > > - grouping. but its not working correctly i think so. no groups of the same > uniquekey in the resultset. > > > does anyone some better ideas? > > > > -- > View this message in context: > http://lucene.472066.n3.nabble.com/compare-two-shards-tp4039887.html > Sent from the Solr - User mailing list archive at Nabble.com. >
compare two shards.
hello. i want to compare two shards each other, because these shards should have the same index. but this isnt so =( so i want to find these documents, there are missing in one shard of my both shards. my ideas - distrubuted shard request on my nodes and fire a facet search on my unique-field. but the result of facet component isnt reversable =( - grouping. but its not working correctly i think so. no groups of the same uniquekey in the resultset. does anyone some better ideas? -- View this message in context: http://lucene.472066.n3.nabble.com/compare-two-shards-tp4039887.html Sent from the Solr - User mailing list archive at Nabble.com.
