Lars Francke created HDFS-9651: ---------------------------------- Summary: All web UIs should include a robots.txt file Key: HDFS-9651 URL: https://issues.apache.org/jira/browse/HDFS-9651 Project: Hadoop HDFS Issue Type: Improvement Reporter: Lars Francke Assignee: Lars Francke Priority: Trivial
Similar to HDFS-330. So that public UIs don't get crawled. I can provide a patch that includes a simple robots.txt. Another alternative is probably a Filter that provides one automatically for all UIs but I don't have time to do that. If anyone wants to take over please go ahead. -- This message was sent by Atlassian JIRA (v6.3.4#6332)