[jira] [Commented] (NUTCH-1619) Writes Dmoz Description and Title information to db with snippet argument

[ https://issues.apache.org/jira/browse/NUTCH-1619?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13743621#comment-13743621 ] lufeng commented on NUTCH-1619: --- Hi Yasin, Do you forget to close the data store? good.

Re: crawl.gen.delay

yes, it is used in Nutch 1.x , but never used in Nutch 2.x. because in Nutch 2.x it will never generate selected url. the correct expression of crawl.gen.crawl is milliseconds you can check the Nutch 1.x nutch-default.xml. the property description like this: crawl.gen.delay 60480 T

[jira] [Commented] (NUTCH-1623) Implement file.content.ignored function

[ https://issues.apache.org/jira/browse/NUTCH-1623?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=13743856#comment-13743856 ] Osy commented on NUTCH-1623: Sure Lewis, For Nutch 2.2.1 in nutch-default.xml there is a descr

nofollow behaviour [#NUTCH-693]

Hi, I've experimented with Nutch for crawling Tor hidden services and I still find an annoying issue that requires a patched Nutch version. That is #NUTCH-693 [1] This issue is a request for an option to control the behaviour of Nutch when getting a rel="nofollow" link. Currently, Nutch always ig

[jira] [Created] (NUTCH-1626) Homebrew formula for installing Nutch in Mac OS X

Andrew Pennebaker created NUTCH-1626: Summary: Homebrew formula for installing Nutch in Mac OS X Key: NUTCH-1626 URL: https://issues.apache.org/jira/browse/NUTCH-1626 Project: Nutch Issue

[jira] [Created] (NUTCH-1627) Debian package for installing nutch

Andrew Pennebaker created NUTCH-1627: Summary: Debian package for installing nutch Key: NUTCH-1627 URL: https://issues.apache.org/jira/browse/NUTCH-1627 Project: Nutch Issue Type: Improve

[jira] [Created] (NUTCH-1628) Chocolatey package for Windows users

Andrew Pennebaker created NUTCH-1628: Summary: Chocolatey package for Windows users Key: NUTCH-1628 URL: https://issues.apache.org/jira/browse/NUTCH-1628 Project: Nutch Issue Type: Improv