[Dovecot] Mailbox Format

2013-08-10 Thread Vijay Rajah
Hello List, I'm in the process of implementing a new mail server environment from scratch. I was wondering, what mailbox format is recommended? I have been using maildir format for my other projects. I would like to use some format that provides Single Instance Storage. I'm using postfix 2.11

Re: [Dovecot] mailbox format w/ separate headers/data

2010-01-25 Thread John Tobin
On Fri, Jan 22, 2010 at 09:03:42PM -0500, Charles Sprickman wrote: On Fri, 22 Jan 2010, Frank Cusack wrote: On January 22, 2010 11:05:22 PM +0200 Timo Sirainen t...@iki.fi wrote: Dunno about zfs, but I've heard that at least in one NetApp installation deduplication was way too heavyweight.

[Dovecot] mailbox format w/ separate headers/data

2010-01-22 Thread Frank Cusack
In the future, it would be cool if there were a mailbox format (dbox2?) where mail headers and each mime part were stored in separate files. This would enable the zfs dedup feature to be used to maximum benefit. In the zfs filesystem, there is a dedup feature which stores only 1 copy of

Re: [Dovecot] mailbox format w/ separate headers/data

2010-01-22 Thread Timo Sirainen
On Fri, 2010-01-22 at 23:05 +0200, Timo Sirainen wrote: It would also be possible to already write such Maildir feature. Someone on this list already wrote header/body separation code, which was pretty easy to do with a plugin. Someone = Alex Baule signature.asc Description: This is a

Re: [Dovecot] mailbox format w/ separate headers/data

2010-01-22 Thread Frank Cusack
On January 22, 2010 11:05:22 PM +0200 Timo Sirainen t...@iki.fi wrote: Dunno about zfs, but I've heard that at least in one NetApp installation deduplication was way too heavyweight. zfs dedup is pretty resources intensive -- for writes. For mail I suspect reads overwhelm writes? -frank

Re: [Dovecot] mailbox format w/ separate headers/data

2010-01-22 Thread Timo Sirainen
On Fri, 2010-01-22 at 16:09 -0500, Frank Cusack wrote: On January 22, 2010 11:05:22 PM +0200 Timo Sirainen t...@iki.fi wrote: Dunno about zfs, but I've heard that at least in one NetApp installation deduplication was way too heavyweight. zfs dedup is pretty resources intensive -- for

Re: [Dovecot] mailbox format w/ separate headers/data

2010-01-22 Thread Timo Sirainen
On Fri, 2010-01-22 at 23:12 +0200, Timo Sirainen wrote: I don't have any evidence, but my logic goes like: Mail is written to disk once. Most users use a single client, which downloads the message once. Or maybe they're using webmail, and they read the same message approximately once (or

Re: [Dovecot] mailbox format w/ separate headers/data

2010-01-22 Thread Frank Cusack
On January 22, 2010 11:05:22 PM +0200 Timo Sirainen t...@iki.fi wrote: On Fri, 2010-01-22 at 15:53 -0500, Frank Cusack wrote: In the future, it would be cool if there were a mailbox format (dbox2?) where mail headers and each mime part were stored in separate files. This would enable the zfs

Re: [Dovecot] mailbox format w/ separate headers/data

2010-01-22 Thread Timo Sirainen
On 22.1.2010, at 23.14, Frank Cusack wrote: This is more or less what dbox's single instance storage is going to do. Maybe in half a year or so.. And you don't even need filesystem deduplication feature. :) But if the mail system has to handle it, it only knows about mails written at the

Re: [Dovecot] mailbox format w/ separate headers/data

2010-01-22 Thread Timo Sirainen
On 22.1.2010, at 23.39, Frank Cusack wrote: On January 22, 2010 11:21:09 PM +0200 Timo Sirainen t...@iki.fi wrote: Or will there be a global index? Yes. That's what dbox SIS is about. You have a global repository of (large) MIME parts, indexed by their SHA1 sum (or something). In the

Re: [Dovecot] mailbox format w/ separate headers/data

2010-01-22 Thread Frank Cusack
On January 22, 2010 11:44:07 PM +0200 Timo Sirainen t...@iki.fi wrote: On 22.1.2010, at 23.39, Frank Cusack wrote: On January 22, 2010 11:21:09 PM +0200 Timo Sirainen t...@iki.fi wrote: Or will there be a global index? Yes. That's what dbox SIS is about. You have a global repository of

Re: [Dovecot] mailbox format w/ separate headers/data

2010-01-22 Thread Charles Sprickman
On Fri, 22 Jan 2010, Frank Cusack wrote: On January 22, 2010 11:05:22 PM +0200 Timo Sirainen t...@iki.fi wrote: Dunno about zfs, but I've heard that at least in one NetApp installation deduplication was way too heavyweight. zfs dedup is pretty resources intensive -- for writes. For mail I

Re: [Dovecot] Mailbox format conversion with dsync

2009-11-18 Thread Pascal Volk
On 11/12/2009 12:42 AM Pascal Volk wrote: On 11/11/2009 06:47 PM Timo Sirainen wrote: example: dsync -e 'dsync -r -O -o mail_location=maildir:~/Maildir' For the archive: I'm using virtual users, without system access. So I had to add '-u user' to both dsync commands. It was also necessary

[Dovecot] Mailbox format conversion with dsync [was: Re: v2.0.tip Panic: file index-storage.c: line 385 (index_storage_mailbox_open): assertion failed: (!box-opened)]

2009-11-11 Thread Pascal Volk
On 11/11/2009 06:47 PM Timo Sirainen wrote: convert-tool is going away. dsync is the new way to do conversion. For example: dsync -e 'dsync -r -O -o mail_location=maildir:~/Maildir' For the archive: I'm using virtual users, without system access. So I had to add '-u user' to both dsync