They payloads of the tasks count towards the store bytes quota. So that does limit how many you can add to the queue, but that is not the issue here.
The bucket/token stuff doesnt impact adding to the queue. from the docs... """The task queue uses token buckets to control the rate of task execution. Each named queue has a token bucket that holds a certain number of tokens, defined by the bucket_size directive. Each time your application executes a task, it uses a token. Your app continues processing tasks in the queue until the queue's bucket runs out of tokens. App Engine refills the bucket with new tokens continuously based on the rate that you specified for the queue.""" On Feb 10, 2:52 pm, "Brandon Wirtz" <drak...@digerat.com> wrote: > > The bucket and rates are for controlling execution. They don't limit > adding > > tasks to a queue. > > Doesn't the Token bucket? > > Also there is a max QueSize in MB you can specify in the YAML. I don't know > what the limit is. > > My rough understanding was that > > Token Rate was how many task/s you could add. > > Process rate was how fast tasks would be processed. > > Queue Size was number of tasks that could be pending. > > Time Out was the time to expire > > If your token rate is 5 per S > And your process is 2 per > And your Queue size is 5000 > And your time out is 75 minutes > > If 18 people wanted to make 10 new tasks in 3 seconds. The Token bucket > would empty and only 15 tasks would be created. > > If 500 people an hour wanted to create 20 tasks each (10000 tasks, 3600 > seconds) yields 2.78 Tasks/s the Token bucket would not go dry. The Process > bucket would spin up instances enough to process the tasks, and it would try > to space them out such that it would take 5000 seconds > But you would lose some of those task because the Task Queue would not have > only processed all of the tasks before it hit the 5000 task limit (7200-ish > would complete) > And because you are limiting tasks to 75 minutes, but it would take 1 hour > 23 minutes to process the task a portion would get dropped. -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
