On Wed, Jul 12, 2006 at 06:24:08PM -0400,
Jim Popovitch <[EMAIL PROTECTED]> wrote
a message of 32 lines which said:
> The strangeness is that some of their crawling is looking for URLs
> with multiple exclamation points, those URLs never existed. This may
> be indicative of a character transla
> What gigablast seems to be doing, on the other hand, is trying to open
> every window in a house in the hopes that it will find one that's open.
Just looking at the text strings in the URLs, my off-the-top-of-my-head
guess was that those were URLs it saw in email spam. They looked v
longer feel a need to be concerned about them.
Thanks all,
-Jim P.
Jim Popovitch wrote:
Feel free to clue me in on this please... ;-)
What is www.gigablast.com? And why is it constantly performing
"questionable" queries (mostly http) across every IP that I have access
to check.
On Wed, Jul 12, 2006 at 02:50:54PM -0700, Malcolm Staudinger wrote:
> Google is your friend?
> They're a search engine. robots.txt and forget it.
>
> Malcolm
That's assuming whoever designed their software actually adheres
to robots.txt. RFCs recommend people adhere to it, but there are
some wh
> :-) Let me add something before everyone on NANOG reminds me that
> gigablast is a search engine. I know what they do, but what I don't
> understand is why are they searching my systems for URLs that haven't
> ever existed there before. It's as though they are doing random word
> searches
> They're a search engine. robots.txt and forget it.
>
> Malcolm
>
> Jim Popovitch wrote:
>>
>> Feel free to clue me in on this please... ;-)
>>
>> What is www.gigablast.com? And why is it constantly performing
>> "questionable" queries (mos
Google is your friend?
They're a search engine. robots.txt and forget it.
Malcolm
Jim Popovitch wrote:
Feel free to clue me in on this please... ;-)
What is www.gigablast.com? And why is it constantly performing
"questionable" queries (mostly http) across every IP that I
!!!
/Pr!!f!!rencesUtilisateur
/WikiHomePage
/HilfeZuParsern
/AiutoModello
/GewenstePaginas
/HilfeZu!!berschriften
-Jim P.
Jim Popovitch wrote:
Feel free to clue me in on this please... ;-)
What is www.gigablast.com? And why is it constantly performing
"questionable" quer
Feel free to clue me in on this please... ;-)
What is www.gigablast.com? And why is it constantly performing
"questionable" queries (mostly http) across every IP that I have access
to check.
I get a could of thousand hits (mostly questionable non-existing URL
requests) fr
