[
https://issues.apache.org/jira/browse/NUTCH-2573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sebastian Nagel updated NUTCH-2573:
---
Description:
Fetcher should optionally (by default) suspend crawling by a configurable
inter
[
https://issues.apache.org/jira/browse/NUTCH-2573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sebastian Nagel updated NUTCH-2573:
---
Fix Version/s: (was: 1.16)
1.17
> Suspend crawling if robots.txt fails
[
https://issues.apache.org/jira/browse/NUTCH-2573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sebastian Nagel updated NUTCH-2573:
---
Fix Version/s: (was: 1.15)
1.16
> Suspend crawling if robots.txt fails
[
https://issues.apache.org/jira/browse/NUTCH-2573?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Sebastian Nagel updated NUTCH-2573:
---
Description:
Fetcher should optionally (by default) suspend crawling by a configurable
interv
4 matches
Mail list logo