Le 05-08-25 à 12:51, Walter Underwood a écrit :
/robots.txt is one approach. Wouldn't hurt to have a recommendation
for whether Atom clients honor that.

Not many honor it.
A while ago I had this list from http://varchars.com/blog/node/view/59
The Good

    BlogPulse

    NITLE Blog Spider
    Yahoo! Slurp
The Bad

    Blogdigger
    Bloglines
    fastbuzz
    Feedster Crawler
    LiveJournal.com
    NIF
    PubSub
    Oddbot
    Syndic8
    Technoratibot



--
Karl Dubost - http://www.w3.org/People/karl/
W3C Conformance Manager
*** Be Strict To Be Cool ***



Reply via email to