https://bugzilla.wikimedia.org/show_bug.cgi?id=22932
Summary: Add charset to robots.txt
Product: Wikimedia
Version: unspecified
Platform: All
OS/Version: All
Status: NEW
Severity: minor
Priority: Normal
Component: Site requests
AssignedTo: wikibugs-l@lists.wikimedia.org
ReportedBy: platoni...@gmail.com
>From mediawiki-l discussion about not viewing robots utf characters
http://thread.gmane.org/gmane.org.wikimedia.mediawiki/33601
robots.txt served from wikimedia wikis should have content-type
text/plain;charset=utf-8 not just text/plain
robots.txt spec doesn't take content-types into account, no bot should be
relying on a specific content-type.
http://www.robotstxt.org/orig.html
--
Configure bugmail: https://bugzilla.wikimedia.org/userprefs.cgi?tab=email
------- You are receiving this mail because: -------
You are the assignee for the bug.
You are on the CC list for the bug.
_______________________________________________
Wikibugs-l mailing list
Wikibugs-l@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikibugs-l
