Your task queue can only send tasks to your backend as fast as the backend can execute them, and unlike a task queue, it can't dynamically spin up more instances to handle the load. Setting your rate to 360/m will only work if your backend can handle 6 requests a second (eg, latency less than 166ms).
Why aren't you just using a task queue for this? -Nick Johnson On Tue, Aug 16, 2011 at 9:22 AM, pdknsk <pdk...@googlemail.com> wrote: > I've got a dynamic backend just for sending mail (billing enabled). > Mails are enqueued elsewhere, not on this backend, practically > instantly. The queue is configured like this. > > - name: mail > rate: 360/m > bucket_size: 40 > retry_parameters: > task_age_limit: 1d > min_backoff_seconds: 20 > > And the dashboard figures it out like this. > > mail 360/m 0.75/s 40.0 > > Slower than configured at 0.75/s enforced rate, but still acceptable, > because mails are send much slower. > > 2011-08-15 16:04:28.329 /mail/ 200 94ms 0cpu_ms 0kb instance=0 > 2011-08-15 16:04:08.254 /mail/ 200 26ms 23cpu_ms 0kb instance=0 > 2011-08-15 16:03:48.250 /mail/ 200 30ms 23cpu_ms 0kb instance=0 > 2011-08-15 16:03:28.258 /mail/ 200 44ms 0cpu_ms 0kb instance=0 > 2011-08-15 16:02:30.802 /mail/ 200 317ms 0cpu_ms 0kb instance=0 > 2011-08-15 16:02:30.770 /_ah/start 404 89ms 70cpu_ms 0kb instance=0 > > The previous run worked better, but you'll still notice the huge delay > between the first and second mail. > > 2011-08-15 13:02:27.016 /mail/ 200 53ms 0cpu_ms 0kb instance=0 > 2011-08-15 13:02:26.676 /mail/ 200 45ms 0cpu_ms 0kb instance=0 > 2011-08-15 13:02:26.545 /mail/ 200 248ms 23cpu_ms 0kb instance=0 > 2011-08-15 13:02:25.833 /mail/ 200 217ms 0cpu_ms 0kb instance=0 > 2011-08-15 13:01:50.969 /mail/ 200 347ms 0cpu_ms 0kb instance=0 > 2011-08-15 13:01:50.931 /_ah/start 404 200ms 70cpu_ms 0kb instance=0 > > What could be the reason? There are no errors on the backend in the > past 7 days. > > -- > You received this message because you are subscribed to the Google Groups > "Google App Engine" group. > To post to this group, send email to google-appengine@googlegroups.com. > To unsubscribe from this group, send email to > google-appengine+unsubscr...@googlegroups.com. > For more options, visit this group at > http://groups.google.com/group/google-appengine?hl=en. > > -- Nick Johnson, Developer Programs Engineer, App Engine -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
