Fixed. This google thread is now the top result for islam medical video
editing scandal.
--
You received this message because you are subscribed to the Google Groups
Google App Engine group.
To view this discussion on the web visit
: [google-appengine] Re: Google Bot Is Your enemy Part 2
Fixed. This google thread is now the top result for islam medical video
editing scandal.
--
You received this message because you are subscribed to the Google Groups
Google App Engine group.
To view this discussion on the web visit
https
noticed.
From: google-appengine@googlegroups.com
[mailto:google-appengine@googlegroups.com] On Behalf Of Plumo
Sent: Sunday, November 20, 2011 6:23 AM
To: google-appengine@googlegroups.com
Subject: [google-appengine] Re: Google Bot Is Your enemy Part 2
pity the Google Bot doesn't support
pity the Google Bot doesn't support Crawl-delay in robots.txt
--
You received this message because you are subscribed to the Google Groups
Google App Engine group.
To view this discussion on the web visit
https://groups.google.com/d/msg/google-appengine/-/68trxyxxuaMJ.
To post to this group,
Here is what I noticied
: http://www.d-ro.ch/2011/09/appengine-cloudflare-crawlrate
Anyway you shouldn't block Googlebot that would de-index you form google.
--
You received this message because you are subscribed to the Google Groups
Google App Engine group.
To view this discussion on the web
@googlegroups.com
Subject: [google-appengine] Re: Google Bot Is Your Enemy
Here is what I noticied :
http://www.d-ro.ch/2011/09/appengine-cloudflare-crawlrate
Anyway you shouldn't block Googlebot that would de-index you form google.
--
You received this message because you are subscribed
they will be back to normal.
** **
** **
*From:* google-appengine@googlegroups.com [mailto:
google-appengine@googlegroups.com] *On Behalf Of *Roch Delsalle
*Sent:* Sunday, September 11, 2011 5:02 AM
*To:* google-appengine@googlegroups.com
*Subject:* [google-appengine] Re: Google Bot
: google-appengine@googlegroups.com
[mailto:google-appengine@googlegroups.com] On Behalf Of Roch Delsalle
Sent: Sunday, September 11, 2011 2:17 PM
To: google-appengine@googlegroups.com
Subject: Re: [google-appengine] Re: Google Bot Is Your Enemy
Ok, I agree that must have had an impact but how
Joshua,
I just read your post about idle instances, and scheduling, and it
makes a lot of sense. Also given this google bot stuff, I wonder if it
would be useful to have the ability to filter traffic into different
'types', each of which have different scheduling requirements.
Steve
On Sep 3,
I've created this feature request (http://code.google.com/p/
googleappengine/issues/detail?id=5775) for the ability to create
scheduler profiles, filter requests into one of these profiles, and
maybe even route requests to a particular instance/backend.
Star it if you think it will be helpful.
Joshua, can you see my posts? Not sure why I can't post
On Sep 3, 4:15 pm, Joshua Smith joshuaesm...@charter.net wrote:
Is there some way to get google bot requests to go to a dedicated back end?
On Sep 3, 2011, at 3:35 PM, Brandon Wirtz wrote:
The biggest Problem I have with the
-appengine] Re: Google Bot Is Your Enemy
@Brandon :
This is the case for one of my popular web-sites too. I believe if latency
time increases, Google bot will automatically scale down its crawl rate and
I also fear that such an increased latency will have a negative effect on
the page ranking
On Sun, Sep 4, 2011 at 8:49 AM, zdravko email.workbe...@gmail.com wrote:
Or even better, what if GAE had a mechanism by which the apps could
announce when they have something new to be crawled?
If only...
http://www.sitemaps.org/
--
You received this message because you are subscribed to
+1 from me on that score Brandon.
T
--
You received this message because you are subscribed to the Google Groups
Google App Engine group.
To view this discussion on the web visit
https://groups.google.com/d/msg/google-appengine/-/WUlDa8bUNGgJ.
To post to this group, send email to
On Sep 4, 8:40 pm, Brandon Wirtz drak...@digerat.com wrote:
Though I do kind of think that the bandwidth consumed by GOOG on GOOG
infrastructure should be free.
+1. It will be entirely internal to their network, and should be
extremely cheap if not free.
--
You received this message because
I might not be entirely internal network traffic, but at least the
communication between the appengine apps should be discounted.
--
You received this message because you are subscribed to the Google Groups
Google App Engine group.
To view this discussion on the web visit
Nice, so basically Google is using their own service to tack on
additional charges to your bill. Doesn't sound ethical.
--
You received this message because you are subscribed to the Google Groups
Google App Engine group.
To post to this group, send email to google-appengine@googlegroups.com.
@Brandon :
This is the case for one of my popular web-sites too. I believe if latency
time increases, Google bot will automatically scale down its crawl rate and
I also fear that such an increased latency will have a negative effect on
the page ranking.
By the way, have you started using 304
I think in webmaster tools you can change crawl-rate preferences.
Otherwise - just block it with robots.txt.
On Sep 3, 12:35 pm, Brandon Wirtz drak...@digerat.com wrote:
The biggest Problem I have with the Scheduler/GAE isn't GAE it is Google
Bot.
Under the new model you are on the hook for
how about desallow googlebot in robots.txt or in code?
googlebot is my biggest access source too.
On 9月4日, 上午9时50分, johnP j...@thinkwave.com wrote:
I think in webmaster tools you can change crawl-rate preferences.
Otherwise - just block it with robots.txt.
On Sep 3, 12:35 pm, Brandon Wirtz
: Re: [google-appengine] Re: Google Bot Is Your Enemy
@Brandon :
This is the case for one of my popular web-sites too. I believe if latency
time increases, Google bot will automatically scale down its crawl rate and
I also fear that such an increased latency will have a negative effect
21 matches
Mail list logo
