[
https://issues.apache.org/jira/browse/HDFS-330?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=12896306#action_12896306
]
Jakob Homan commented on HDFS-330:
----------------------------------
+1. This is reasonable. Since this is a minor change, previous Hudson run is
still ok. Release audit warning is about lack of license in the robots.txt,
which is ok.
> Web UIs should provide robots.txt
> ---------------------------------
>
> Key: HDFS-330
> URL: https://issues.apache.org/jira/browse/HDFS-330
> Project: Hadoop HDFS
> Issue Type: Improvement
> Affects Versions: 0.20.2
> Reporter: Allen Wittenauer
> Priority: Trivial
> Attachments: HDFS-330.txt
>
>
> There is a potential issue that someone might have an internal corporate
> crawler that goes through HDFS browser accidentally. It might be a good idea
> to provide a default robots file that disables crawling. [No, this didn't
> happen to us. :) ]
--
This message is automatically generated by JIRA.
-
You can reply to this email to add a comment to the issue online.
