In http://highscalability.com/blog/2011/9/7/what-google-app-engine-price-changes-say-about-the-future-of.html he wrote:
> With each crawl costing money, the whole idea of crawling the Internet will > have to change. which led me to a thought: Since google bot is crawling zillions of web sites, a change from depth-first crawling to bread-first crawling would make a huge difference here. Dunno if that's practical, but it would be a nice thing for the google search guys to look into, to make GAE and Google-Bot more compatible. Because right now, there's a lot of evidence that they are accidentally conspiring to be evil. -Joshua -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
