Re: Incremental Indexing when Source Data is not Incremental

2017-05-19 Thread Erick Erickson
Yes, you can get all the current IDs from Solr, but it's a bit cumbersome. Use the /export handler (you have to insure that all fields you return are docValues="true", then write some sort of script that diffed them against your source file. There's nothing in Solr that will do the diff for you, y

Re: Incremental Indexing when Source Data is not Incremental

2017-05-19 Thread David Smiley
Please ask for help on the solr-user list. This is the dev list for Solr internals. Thanks On Fri, May 19, 2017 at 3:51 PM William Nelis wrote: > Hello. > > > > I am new to Solr and have a question about incremental indexing. We have a > source text file that contains millions of rows. Each row

Incremental Indexing when Source Data is not Incremental

2017-05-19 Thread William Nelis
Hello. I am new to Solr and have a question about incremental indexing. We have a source text file that contains millions of rows. Each row is saved as a document in Solr. There is one field in each row that is a unique identifier. Unfortunately, this source text file can change. We need to che