Have you looked at SOLRs TermComponent? Assuming you have a unique key, I think you could use TermsComponent to walk that field for comparing against your database rather then getting all the documents.
HTH Erick On Tue, Sep 28, 2010 at 5:11 PM, dshvadskiy <dshvads...@gmail.com> wrote: > > That will certainly work for most recent updates but I need to compare > entire > index. > > Dmitriy > > Luke Crouch wrote: > > > > Is there a 1:1 ratio of db records to solr documents? If so, couldn't you > > simply select the most recent updated record from the db and check to > make > > sure the corresponding solr doc has the same timestamp? > > > > -L > > > > On Tue, Sep 28, 2010 at 3:48 PM, Dmitriy Shvadskiy > > <dshvads...@gmail.com>wrote: > > > >> Hello, > >> What would be the best way to check Solr index against original system > >> (Database) to make sure index is up to date? I can use Solr fields like > >> Id > >> and timestamp to check against appropriate fields in database. Our index > >> currently contains over 2 mln documents across several cores. Pulling > all > >> documents from Solr index via search (1000 docs at a time) is very slow. > >> Is > >> there a better way to do it? > >> > >> Thanks, > >> Dmitriy > >> > > > > > > -- > View this message in context: > http://lucene.472066.n3.nabble.com/Best-way-to-check-Solr-index-for-completeness-tp1598626p1598733.html > Sent from the Solr - User mailing list archive at Nabble.com. >
