Re: [Dovecot] Integrating Dovecot with Amazon Web Services

2012-06-28 Thread Timo Sirainen
On 28.6.2012, at 17.43, Gary Mort wrote: http://wiki2.dovecot.org/MailboxFormat/dbox To make life easy, I'll stick with just single-dbox as a start, however multi-dbox would be doable. With dbox, the only thing that I need to change is the alternate storage model: An upshot of the way

Re: [Dovecot] Integrating Dovecot with Amazon Web Services

2012-06-28 Thread Timo Sirainen
On 28.6.2012, at 20.14, Timo Sirainen wrote: An upshot of the way alternate storage works is that any given storage file (mailboxes/folder/dbox-Mails/u.* (sdbox) or storage/m.* (mdbox)) can only appear *either* in the primary storage area *or* the alternate storage area but not both — if the

Re: [Dovecot] Integrating Dovecot with Amazon Web Services

2012-06-28 Thread Gary Mort
On Thu, Jun 28, 2012 at 1:14 PM, Timo Sirainen t...@iki.fi wrote: On 28.6.2012, at 17.43, Gary Mort wrote: First I want to add AWS S3 as a storage option for alternate storage. Then instead of the above model, the new model would be that email is always stored in alternate storage, and

Re: [Dovecot] Integrating Dovecot with Amazon Web Services

2012-06-28 Thread Timo Sirainen
On 28.6.2012, at 20.55, Gary Mort wrote: The indexes have to be in primary storage. True, but the data they are based on I'm assuming does not include the full email message, just a few key pieces: uniqueid, subject, from, to, etc. For an always running server, the indexes are always up

Re: [Dovecot] Integrating Dovecot with Amazon Web Services

2012-06-28 Thread Gary Mort
On Thu, Jun 28, 2012 at 1:21 PM, Timo Sirainen t...@iki.fi wrote: On 28.6.2012, at 20.14, Timo Sirainen wrote: An upshot of the way alternate storage works is that any given storage file (mailboxes/folder/dbox-Mails/u.* (sdbox) or storage/m.* (mdbox)) can only appear *either* in the

Re: [Dovecot] Integrating Dovecot with Amazon Web Services

2012-06-28 Thread Timo Sirainen
On 28.6.2012, at 21.04, Gary Mort wrote: mdbox though is different, multiple messages are stored in a single file. The index indicates in which file each message is located. When the data is moved to alt storage, the filename can change in which case the index is updated. IE:

Re: [Dovecot] Integrating Dovecot with Amazon Web Services

2012-06-28 Thread Charles Marcus
On 2012-06-28 2:04 PM, Gary Mort garyam...@gmail.com wrote: That's probably due to the different structures they use. sdbox can safely use either because each email message has a unique filename, and if it exists in both places it doesn't matter. Eh?? Sdbox is like mbox - one file per

Re: [Dovecot] Integrating Dovecot with Amazon Web Services

2012-06-28 Thread Charles Marcus
On 2012-06-28 4:22 PM, Alex Crow ac...@integrafin.co.uk wrote: On 28/06/12 20:28, Charles Marcus wrote: On 2012-06-28 2:04 PM, Gary Mort garyam...@gmail.com wrote: That's probably due to the different structures they use. sdbox can safely use either because each email message has a unique