[ https://issues.apache.org/jira/browse/CONNECTORS-850?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13899907#comment-13899907 ]
Karl Wright commented on CONNECTORS-850: ---------------------------------------- Hi Florian, According to your "***" notes: First fetch: 17:00:33.256 First detected change to the document: 18:11:41.058 But: ingestions are inconsistent with this; they seem to reflect much more frequent changes. Ingestions should not happen unless there has been a change noted. The change would be to any feature of the document that would change how it was indexed. Can you explain? > Maximum interval in dynamic crawling > ------------------------------------ > > Key: CONNECTORS-850 > URL: https://issues.apache.org/jira/browse/CONNECTORS-850 > Project: ManifoldCF > Issue Type: New Feature > Components: Framework crawler agent > Affects Versions: ManifoldCF 1.4.1 > Reporter: Florian Schmedding > Assignee: Karl Wright > Priority: Minor > Labels: features > Fix For: ManifoldCF 1.5 > > > Currently, the dynamic crawling method used for a continuous job extends the > reseed and recrawl intervals when no changes are found in a checked document. > However, it should be possible to restrict this extension to a maximum value > in order to make sure that new documents are discovered within a certain > interval. -- This message was sent by Atlassian JIRA (v6.1.5#6160)