Hello,

I have a screen scraper that I would like to call from web2py.  I
currently have a controller method that calls it and updates data in
the DAL.  The problem is, the number of users of this app is growing
quickly.  I need to queue the updates so I don't overwhelm the server
that it is scraping.

I would like a cron script to fire off daily and set the queue in
motion.  I would like to limit the queue to update 5 users or so per
minute.

Any recommendations on attacking this problem?

-- 
You received this message because you are subscribed to the Google Groups 
"web2py-users" group.
To post to this group, send email to web...@googlegroups.com.
To unsubscribe from this group, send email to 
web2py+unsubscr...@googlegroups.com.
For more options, visit this group at 
http://groups.google.com/group/web2py?hl=en.

Reply via email to