[ 
https://issues.apache.org/jira/browse/HDFS-9651?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15946042#comment-15946042
 ] 

Junping Du commented on HDFS-9651:
----------------------------------

Patch LGTM. Will commit it in next couple of days if no objections.

> All web UIs should include a robots.txt file
> --------------------------------------------
>
>                 Key: HDFS-9651
>                 URL: https://issues.apache.org/jira/browse/HDFS-9651
>             Project: Hadoop HDFS
>          Issue Type: Improvement
>            Reporter: Lars Francke
>            Assignee: Lars Francke
>            Priority: Trivial
>         Attachments: HDFS-9651.1.patch, HDFS-9651.2.patch
>
>
> Similar to HDFS-330. So that public UIs don't get crawled.
> I can provide a patch that includes a simple robots.txt. Another alternative 
> is probably a Filter that provides one automatically for all UIs but I don't 
> have time to do that.
> If anyone wants to take over please go ahead.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

---------------------------------------------------------------------
To unsubscribe, e-mail: hdfs-issues-unsubscr...@hadoop.apache.org
For additional commands, e-mail: hdfs-issues-h...@hadoop.apache.org

Reply via email to