i would have understood if the index stayed the same, but the document is removed entirely.
On Mon, Aug 22, 2016 at 5:48 AM, Erick Erickson <erickerick...@gmail.com> wrote: > You can't rely on any searches with that autocommit configuration. > > openSearcher is set to false. Therefore you will not see any changes to > your index as a result of an expiring autoCommit interval. > > I'm not sure whether DIH issues its own commit when done, but your > tests so far aren't particularly dependable. I'd try again after issuing > a manual hard commit or a soft commit. > > You can do this in a URL by > ..../collection/update?commit=true > > Here's the whole run-down on the various commit options. > https://lucidworks.com/blog/2013/08/23/understanding- > transaction-logs-softcommit-and-commit-in-sorlcloud/ > > Best, > Erick > > On Sun, Aug 21, 2016 at 7:43 AM, Or Gerson <o...@watchdox.com> wrote: > > Hello, > > > > I have Solr version 4.3.0. > > > > I have encountered a problem where document is not returning from queries > > after delta import although the delta import does not report that a > > document has been deleted. > > > > i have a document that is composed of several fields , the delta import > > looks for a field > > called "update_date" and checks whether the date is after the last time > > delta import was ran. > > > > so something like > > > > select d.ID as UNIQUE_ID > > from document d > > where d.UPDATE_DATE >= '${dataimporter.last_index_time}' and > > d.OWNER_ID IS NOT NULL and d.DELETE_DATE IS NULL > > > > > > deletePKQuery looks like > > > > select d.ID as UNIQUE_ID from document d > > where d.DELETE_DATE >= '${dataimporter.last_index_time}' > > > > doing full import will successfully fetch the documents > > > > then changing the update_date on a document will remove it from the index > > (but this is not reported in the log) > > > > "07 Aug 2016 18:29:24,278 [Thread-53] INFO DocBuilder - Completed > > DeletedRowKey for Entity: permission_set rows obtained : 0" > > > > 07 Aug 2016 18:29:24,438 [Thread-53] INFO MetadataOnImportEndEventListen > er > > - metadata import process end: {deletedDocCount=0, docCount=1, > > queryCount=6, rowCount=6, skipDocCount=0} > > > > > > merge policy is : > > > > <mergePolicy class="org.apache.lucene.index.TieredMergePolicy"> > > <int name="maxMergeAtOnce">10</int> > > <int name="segmentsPerTier">10</int> > > </mergePolicy> > > > > > > <deletionPolicy class="solr.SolrDeletionPolicy"> > > <!-- The number of commit points to be kept --> > > <str name="maxCommitsToKeep">1</str> > > <!-- The number of optimized commit points to be kept --> > > <str name="maxOptimizedCommitsToKeep">1</str></deletionPolicy> > > > > > > only hard commit is configured, soft commit is commented out: > > > > <autoCommit> > > <maxDocs>1000</maxDocs> > > <maxTime>30000</maxTime> > > <openSearcher>false</openSearcher> > > </autoCommit> > > > > > > will greatly appreciate your help > > > > Thanks, > > Or Gerson >
