[appengine-java] performance of Task Queue Java API

2010-03-25 Thread Eugene Kuleshov

  My application need to create bunch of tasks to do some data
processing. I've tried to prototype a small application that spawns
5000 tasks from the process initiated by cron job, but it seem like I
am hitting some wall, because my test can't spawn more then 1000 tasks
and it is terminated by GAE runtime after 30 seconds.

  Is there any known performance limitations of the Task Queue Java
API or any best practices on how to spawn large number of tasks?

  Thanks

  Eugene

-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine for Java group.
To post to this group, send email to google-appengine-j...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine-java+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine-java?hl=en.



Re: [appengine-java] performance of Task Queue Java API

2010-03-25 Thread Don Schwarz
There is a bulk add API in the upcoming 1.3.2 release that should help with
this.

On Thu, Mar 25, 2010 at 9:45 AM, Eugene Kuleshov ekules...@gmail.comwrote:


  My application need to create bunch of tasks to do some data
 processing. I've tried to prototype a small application that spawns
 5000 tasks from the process initiated by cron job, but it seem like I
 am hitting some wall, because my test can't spawn more then 1000 tasks
 and it is terminated by GAE runtime after 30 seconds.

  Is there any known performance limitations of the Task Queue Java
 API or any best practices on how to spawn large number of tasks?

  Thanks

  Eugene

 --
 You received this message because you are subscribed to the Google Groups
 Google App Engine for Java group.
 To post to this group, send email to
 google-appengine-j...@googlegroups.com.
 To unsubscribe from this group, send email to
 google-appengine-java+unsubscr...@googlegroups.comgoogle-appengine-java%2bunsubscr...@googlegroups.com
 .
 For more options, visit this group at
 http://groups.google.com/group/google-appengine-java?hl=en.



-- 
You received this message because you are subscribed to the Google Groups 
Google App Engine for Java group.
To post to this group, send email to google-appengine-j...@googlegroups.com.
To unsubscribe from this group, send email to 
google-appengine-java+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/google-appengine-java?hl=en.