Lars Francke created HDFS-9651:
----------------------------------

             Summary: All web UIs should include a robots.txt file
                 Key: HDFS-9651
                 URL: https://issues.apache.org/jira/browse/HDFS-9651
             Project: Hadoop HDFS
          Issue Type: Improvement
            Reporter: Lars Francke
            Assignee: Lars Francke
            Priority: Trivial


Similar to HDFS-330. So that public UIs don't get crawled.

I can provide a patch that includes a simple robots.txt. Another alternative is 
probably a Filter that provides one automatically for all UIs but I don't have 
time to do that.

If anyone wants to take over please go ahead.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Reply via email to