I'm not sure that would be acceptable in the Terms of Most Search engines... And many of the search engines are likely going to start blocking GAE traffic... But for arguments sake let's say you are using API's and it was allowed. Because you are building say a Price Engine powered by Amazon and Buy.com and 28 others.
I have done a similar project already. Caching. 80% of your queries will be for 20% of the terms as such new queries will take 2 seconds (your number), old queries will take 85ms. With 80% cache hit you will have an average page served time of 468ms. To reduce this you would do predictive searches. (Crawling :-) ) Precaching terms you expect to see. Which could take you to 95% cache hits and closer to 90ms average response time. -Brandon Wirtz -----Original Message----- From: google-appengine@googlegroups.com [mailto:google-appeng...@googlegroups.com] On Behalf Of ted stockwell Sent: Wednesday, September 02, 2009 1:59 PM To: Google App Engine Subject: [google-appengine] Re: 30 Max simultaneous requests (maxThreads)? On Sep 2, 2:34 pm, "Brandon N. Wirtz" <drak...@digerat.com> wrote: > What would you need all those threads for in a web App? If you were > crunching DNA, or calculating the path of particles from the big bang that > would make sense... > When you make an asynchronous URLFetch call does each asynchronous call to URLFetch count as a separate thread??? Suppose I want to write an app that will aggregate the search results from 30 different search engines (that's not an unrealistic real-life scenario, lots of things have to be done asynchrounously). Suppose each call to a search engine takes 1 second. Suppose I make 30 aynchronous calls to each search engine. It'll take 2 seconds for each request (cause I blew pass my thread limit on the 30th async call so I'll have to wait an extra second for that last request). And now I can only handle one user every second. --~--~---------~--~----~------------~-------~--~----~ You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en -~----------~----~----~----~------~----~------~--~---
