Hi, My primary concern is throughput, not cost. I would be happy to pay more to gain higher concurrency and higher throughput.
If a customer uploads a list with 100,000 items to process, I would like to burst to some upper limit of concurrency (higher than 20 qps at least) and process the list as quickly as possible. This seems to be something GAE could provide if the concurrency limits were raised. My question is whether Google would allow a customer to request a quota increase for task queue concurrency in situations like this, or whether that's forbidden across the board for some reason. Anyone from Google who can help answer this? thanks, -- James On Nov 18, 1:24 am, djidjadji <djidja...@gmail.com> wrote: > Is your processing not possible with the deferred module added in 1.2.5 > > http://code.google.com/appengine/articles/deferred.html > > If you launch many tasks to process the uploads you waste a lot of CPU > retrieving the data needed. With the deferred method you run for about > 30 sec, then store the state and schedule to get called again. You can > setup multiple deferred tasks to process 1 upload by using parameters > of the function that deferred calls. > -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appeng...@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=.
