[
https://issues.apache.org/jira/browse/NUTCH-167?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]
Andrzej Bialecki closed NUTCH-167.
-----------------------------------
Resolution: Fixed
Fix Version/s: 0.9.0
Assignee: Andrzej Bialecki
Patch applied with minor changes, rev. 515844.
> Observation of <META NAME="ROBOTS" CONTENT="NOARCHIVE"> directive
> -----------------------------------------------------------------
>
> Key: NUTCH-167
> URL: https://issues.apache.org/jira/browse/NUTCH-167
> Project: Nutch
> Issue Type: Improvement
> Components: indexer, web gui
> Affects Versions: 0.7.1
> Reporter: Ed Whittaker
> Assigned To: Andrzej Bialecki
> Priority: Critical
> Fix For: 0.9.0
>
> Attachments: patch.txt
>
>
> Though not strictly a bug, this issue is potentially serious for users of
> Nutch who deploy live systems who might be threatened with legal action for
> caching copies of copyrighted material. The major search engines all observe
> this directive (even though apparently it's not stanard) so there's every
> reason why Nutch should too.
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
