Re: [EXTERNAL] Re: Does anybody crawl to a database and then index from the database to Solr?

2016-05-16 Thread Erick Erickson
bq: ...my primary customer for the deleted docs functionality wants to see it immediately... I don't quite know how docs get deleted, but presumably you have a uniquekey. The fastest would be to have a delete trigger on your database table that puts that uniqueKey and timestamp in a "delete_docs"

Re: [EXTERNAL] Re: Does anybody crawl to a database and then index from the database to Solr?

2016-05-15 Thread abhi Abhishek
Clayton you could also try running and optimize on the SOLR index as a weekly/bi weekly maintenance task to keep the segment count in check and the maxdoc , numdoc count as close as possible (in DB terms de-fragmenting the solr indexes) Best Regards, Abhishek On Sun, May 15, 2016 at 7:1

RE: [EXTERNAL] Re: Does anybody crawl to a database and then index from the database to Solr?

2016-05-15 Thread Pryor, Clayton J
Thank you for your feedback. I really appreciate you taking the time to write it up for me (and hopefully others who might be considering the same). My first thought for dealing with deleted docs was to delete the contents and rebuild the index from scratch but my primary customer for the dele