Hey Michal, You can get good performance while controling the rate by using a combination of the two methods. Split the list into several "large" chunks, inserting a processor for each chunk. Then each of those processors can run over their respective sets of addresses either mailing or inserting mailer tasks. Just be sure to persist your current position in the lists and use small batch sizes in your mailer tasks. If a task reruns for some reason it will reduce the number of people who get duplicate mails.
Robert On Jul 20, 2011 5:45 AM, "Michal Makarewicz" <makarew...@google.com> wrote: > > A have a scenario where I have to send customized alerts to large > amount of users (~30k) in certain, specified beforehand, time. My main > idea was to make a cron job, which would check every minute if there > is an alert to send and if so mark this alert as queued and add task > to task queue (this would be done in transactional manner). Now I have > two available approaches: > Approach I: > Have two different queue commands: > 1. Split email list into smaller chunks (I'm not sure how big, I was > thinking about ~500) and for each of them put second command on queue. > (this one will be queued in cron job) > 2. Send mail for each email address in the list. > My main concern with this approach is lack of control on how many > emails will be send simultaneously and possibility that my email will > be classified as spam. > > Approach II: > Just one task: > 1. Send emails for predetermined number of people (again ~500) > starting from start_index add to queue the same task with start_index > + ~500. > This approach will be slower, so is less preferable. > > I have pretty much unlimited quota so that wouldn't be a problem. > Which approach is better in this situation? > > -- > You received this message because you are subscribed to the Google Groups "Google App Engine" group. > To post to this group, send email to google-appengine@googlegroups.com. > To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. > For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en. > -- You received this message because you are subscribed to the Google Groups "Google App Engine" group. To post to this group, send email to google-appengine@googlegroups.com. To unsubscribe from this group, send email to google-appengine+unsubscr...@googlegroups.com. For more options, visit this group at http://groups.google.com/group/google-appengine?hl=en.
