RE: Delete all, index all, end up with 1 segment with 50% deletes

2018-11-28 Thread Markus Jelsma
> Sent: Wednesday 28th November 2018 2:59 > To: solr-user > Subject: Re: Delete all, index all, end up with 1 segment with 50% deletes > > Shawn's comment seems likely, somehow you're adding all the docs twice > and only committing at the end. In that case there'd be on

Re: Delete all, index all, end up with 1 segment with 50% deletes

2018-11-27 Thread Erick Erickson
Shawn's comment seems likely, somehow you're adding all the docs twice and only committing at the end. In that case there'd be only 1 segment. That's about the only way I can imagine your index has exactly one segment with exactly half the docs deleted. It'd be interesting for you to look at the a

Re: Delete all, index all, end up with 1 segment with 50% deletes

2018-11-27 Thread Shawn Heisey
On 11/27/2018 5:29 AM, Markus Jelsma wrote: A background batch process compiles a data set, when finished, it sends a delete all to its target collection, then everything gets sent by SolrJ, followed by a regular commit. When inspecting the core i notice it has one segment with 9578 documents