Re: [Dovecot] architecture to handle 1000 messages per second?

2010-01-04 Thread Ed W
On 04/01/2010 03:28, Bob Eastbrook wrote: Hi all, Thanks for the suggestions. It sounds like the consensus is that I should avoid polling with POP or IMAP and deal with incoming messages directly. I think it depends on your expected load and the results of a few benchmarks... The

Re: [Dovecot] architecture to handle 1000 messages per second?

2010-01-03 Thread Bob Eastbrook
Hi all, Thanks for the suggestions. It sounds like the consensus is that I should avoid polling with POP or IMAP and deal with incoming messages directly. Bob

Re: [Dovecot] architecture to handle 1000 messages per second?

2010-01-02 Thread David Goncalves
Hi, Don't use POP3 or IMAP; instead deliver the messages to a command. For example, GNU Mailman is mailing list software which pipes each incoming list message to a Python script. That command can then perform the necessary processing. I don't know what you had in mind, but if the messages can

Re: [Dovecot] architecture to handle 1000 messages per second?

2010-01-02 Thread Thomas Løcke
Hello, Actually, thousands of customers would send order emails to a system running postifx. All orders end up in ord...@example.com. Then, another app fetches these emails via Dovecot (POP or IMAP), ideally at the rate of 1000 per second. I think it might be difficult to accomplish

Re: [Dovecot] architecture to handle 1000 messages per second?

2010-01-02 Thread Charles Marcus
On 2010-01-01 8:01 PM, Michael wrote: On Sat, 02 Jan 2010 11:09:33 Bob Eastbrook wrote: Can anyone describe an architecture which can handle 1000 IMAP or POP messages per second? Ideally, it would be hosted in the cloud and additional instances could be launched to handle additional load.

[Dovecot] architecture to handle 1000 messages per second?

2010-01-01 Thread Bob Eastbrook
Can anyone describe an architecture which can handle 1000 IMAP or POP messages per second? Ideally, it would be hosted in the cloud and additional instances could be launched to handle additional load. Bob

Re: [Dovecot] architecture to handle 1000 messages per second?

2010-01-01 Thread Bob Eastbrook
On Fri, Jan 1, 2010 at 2:09 PM, Bob Eastbrook baconeater...@gmail.com wrote: Can anyone describe an architecture which can handle 1000 IMAP or POP messages per second?  Ideally, it would be hosted in the cloud and additional instances could be launched to handle additional load. More

Re: [Dovecot] architecture to handle 1000 messages per second?

2010-01-01 Thread Timo Sirainen
On 1.1.2010, at 17.23, Bob Eastbrook wrote: More information: imagine an app which processes orders for concert tickets via email. The app connects to a server via POP or IMAP, downloads orders, and then deletes them from the server. There aren't thousands of users simultaneously accessing

Re: [Dovecot] architecture to handle 1000 messages per second?

2010-01-01 Thread Thomas Løcke
On Fri, Jan 1, 2010 at 11:23 PM, Bob Eastbrook baconeater...@gmail.comwrote: On Fri, Jan 1, 2010 at 2:09 PM, Bob Eastbrook baconeater...@gmail.com wrote: Can anyone describe an architecture which can handle 1000 IMAP or POP messages per second? Ideally, it would be hosted in the cloud and

Re: [Dovecot] architecture to handle 1000 messages per second?

2010-01-01 Thread Bob Eastbrook
On Fri, Jan 1, 2010 at 3:07 PM, Thomas Løcke thomas.granv...@gmail.com wrote: Hi Bob, Just to make sure I understand you: Some app is sending emails to ord...@example.com at the rate of 1000 per second, and another app is fetching email from ord...@example.com to process them? Hello,

Re: [Dovecot] architecture to handle 1000 messages per second?

2010-01-01 Thread Timo Sirainen
On 1.1.2010, at 18.15, Bob Eastbrook wrote: I think it might be difficult to accomplish this via POP since I think Dovecot would have to lock the account while doing the POP downloads. This makes it difficult to have more than one app downloading at a time. The locking behavior is optional,

Re: [Dovecot] architecture to handle 1000 messages per second?

2010-01-01 Thread Michael
On Sat, 02 Jan 2010 11:09:33 Bob Eastbrook wrote: Can anyone describe an architecture which can handle 1000 IMAP or POP messages per second? Ideally, it would be hosted in the cloud and additional instances could be launched to handle additional load. Bob The Courier IMAP server is a fast,

Re: [Dovecot] architecture to handle 1000 messages per second?

2010-01-01 Thread Michael Orlitzky
Bob Eastbrook wrote: On Fri, Jan 1, 2010 at 3:07 PM, Thomas Løcke thomas.granv...@gmail.com wrote: Hi Bob, Just to make sure I understand you: Some app is sending emails to ord...@example.com at the rate of 1000 per second, and another app is fetching email from ord...@example.com to process