I'm not sure about what you want to do but just a thought: have you
considered Amazon Elastic MapReduce ?
It's sure doable with task queues but you're likely to encounter
various limitation problems as you cite.
On Nov 18, 1:46 am, James Cooper wrote:
> Hi,
>
> I'm evaluating GAE suitability for
Hi there,
Yes, I've considered Amazon's offering, but would prefer to keep the
entire system on GAE if possible to reduce complexity.
thanks,
-- James
On Nov 17, 7:13 pm, Julian Namaro wrote:
> I'm not sure about what you want to do but just a thought: have you
> considered Amazon Elastic MapR
Hi,
My primary concern is throughput, not cost. I would be happy to pay
more to gain higher concurrency and higher throughput.
If a customer uploads a list with 100,000 items to process, I would
like to burst to some upper limit of concurrency (higher than 20 qps
at least) and process the list a
Is your processing not possible with the deferred module added in 1.2.5
http://code.google.com/appengine/articles/deferred.html
If you launch many tasks to process the uploads you waste a lot of CPU
retrieving the data needed. With the deferred method you run for about
30 sec, then store the stat
