link to webmasterworld in this thread
is a good example. Their site comes up as high ranking hits for quite a
few searches relating to this sort of thing, but you need to log in to
read the forums.
Against google's terms and might get them kicked off the index. (Does
google cache wemasterw
> C.H. - cable is always static. Besides google spiders by website, not
> IP, so shouldn't matter if it was dynamic. All the .pdf are static
> content, so playing with expiry times doesn't seem to be a good idea to
> me? I haven't set any expiry anywhere.
My experience with using configured expiry
On Thu, 28 Sep 2006 09:22:00 +1200
Volker Kuhlmann <[EMAIL PROTECTED]> wrote:
> > > And that causes repeated downloads of the same .pdf how??
>
> > ...by repeatedly rescanning your website, and repeatedly picking up
> > the same things to upload, which is what you'd expect.
>
> No index page was
> > And that causes repeated downloads of the same .pdf how??
> ...by repeatedly rescanning your website, and repeatedly picking up
> the same things to upload, which is what you'd expect.
No index page was fetched in between the .pdf downloads of the same
.pdf.
> Tell you what, why not just cha
On Wed, 27 Sep 2006, Steve Holdoway wrote:
I've just noticed that a host known as 'dedicated.jjmorrison.org' ,
who is obviously using shared hosting somewhere in the US, is visiting
my websites (which are LAMP based - tenuous link) and identifying itsenf
as a Googlebot, version 2.1.
Has anyon
On Thu, 2006-09-28 at 08:02 +1200, Volker Kuhlmann wrote:
> Anyone else finding that google DoSes servers on a regular basis?
> Downloading the same pdf as fast as they can. If it's only 30 times it's
> lucky, bringing the net plan over quota is not unheard of.
Just Seeing Steve's reply to this...
On Thu, 2006-09-28 at 08:02 +1200, Volker Kuhlmann wrote:
> > few searches relating to this sort of thing, but you need to log in to
> > read the forums.
>
> Against google's terms and might get them kicked off the index. (Does
> google cache wemasterworld...?)
Yes, Google have webmasterworld (A
On Thu, 28 Sep 2006 08:31:50 +1200
Volker Kuhlmann <[EMAIL PROTECTED]> wrote:
> > > Anyone else finding that google DoSes servers on a regular basis?
> > > Downloading the same pdf as fast as they can. If it's only 30 times it's
> > > lucky, bringing the net plan over quota is not unheard of.
> >
> > Anyone else finding that google DoSes servers on a regular basis?
> > Downloading the same pdf as fast as they can. If it's only 30 times it's
> > lucky, bringing the net plan over quota is not unheard of.
>
> No, it works fine for me. Maybe it's your code... like ' href="http://volker.dnsalia
On Thu, 28 Sep 2006 08:02:45 +1200
Volker Kuhlmann <[EMAIL PROTECTED]> wrote:
> Anyone else finding that google DoSes servers on a regular basis?
> Downloading the same pdf as fast as they can. If it's only 30 times it's
> lucky, bringing the net plan over quota is not unheard of.
No, it works f
> Going back to the previous thread about google/search engines, if you
> pretend to be google (or another robot) lots of things work that might
> not work otherwise. Andy Leach's link to webmasterworld in this thread
> is a good example. Their site comes up as high ranking hits for quite a
>
Hi-ho,
I've seen this as well, although one pretending to be Baiduspider in my
case which is a Chinese search engine (www.baidu.com is the real site)
I was getting 300-400 hits a day from three IP's in a range without
reverse DNS records, somewhere in Asia.
I put a block on the IP address r
Steve Holdoway wrote:
I've just noticed that a host known as 'dedicated.jjmorrison.org' , who is
obviously using shared hosting somewhere in the US, is visiting my websites
(which are LAMP based - tenuous link) and identifying itsenf as a Googlebot,
version 2.1.
Has anyone else seen similar b
I've just noticed that a host known as 'dedicated.jjmorrison.org' , who is
obviously using shared hosting somewhere in the US, is visiting my websites
(which are LAMP based - tenuous link) and identifying itsenf as a Googlebot,
version 2.1.
Has anyone else seen similar behaviour???
Cheers,
St
14 matches
Mail list logo
