On 7/4/2008 12:30 AM, Michael Crawford wrote:
On Thu, Jul 3, 2008 at 8:37 AM, Jeremy Wadsack
[EMAIL PROTECTED] wrote:
The robots list from which that page was built no longer exists. The group that was
maintaining it decided that it didn't make sense to maintain a database of known
robots any
I'd like to know the success of my efforts to submit a new site to all
the search engines; some spiders won't visit a site until it's been
online for a while, and some will only visit the home page.
I can see some of the spiders in the BROWSERREP and BROWSERSUM, but
it's missing some because it's
On 7/3/2008 3:48 AM, Michael Crawford wrote:
I'd like to know the success of my efforts to submit a new site to all
the search engines; some spiders won't visit a site until it's been
online for a while, and some will only visit the home page.
I can see some of the spiders in the BROWSERREP and
Sent: Thursday, July 03, 2008 4:30 AM
To: Support for analog web log analyzer
Subject: Re: [analog-help] Identifying Known Spiders?
On 7/3/2008 3:48 AM, Michael Crawford wrote:
I'd like to know the success of my efforts to submit a new site to all
the search engines; some spiders won't visit
On Thu, Jul 3, 2008 at 8:37 AM, Jeremy Wadsack
[EMAIL PROTECTED] wrote:
The robots list from which that page was built no longer exists. The group
that was maintaining it decided that it didn't make sense to maintain a
database of known robots any more as anyone can make a robot.
In my
5 matches
Mail list logo
