Graham wrote:
(And before you say "but my aggregator is nothing but a podcast client, and the feeds are nothing but links to enclosures, so it's obvious that the publisher wanted me to download them" -- WRONG! The publisher might want that, or they might not ...So you're saying browsers should check robots.txt before downloading images?
... and stylesheets, framesets, embedded objects, etc? - James