Re: [Dovecot] index IO patterns

2012-05-12 Thread Stan Hoeppner
On 5/12/2012 2:32 AM, Cor Bosman wrote: >> Mail is always a random IO workload, unless your mailbox count is 1, >> whether accessing indexes or mail files. Regarding the other two >> questions, you'll likely need to take your own measurements. > > Wait, maybe there is a misunderstanding. I mean t

Re: [Dovecot] index IO patterns

2012-05-12 Thread Stan Hoeppner
On 5/12/2012 2:26 AM, Cor Bosman wrote: > The indexes are doing a lot of iops on the metrocluster, and it's a bit > of an expensive option for something it's not even that good at. This clears things up a bit. > Im aiming for something with 2 servers, each with a 12 disk enclosure > with SSD fo

Re: [Dovecot] index IO patterns

2012-05-12 Thread Timo Sirainen
On 12.5.2012, at 10.32, Cor Bosman wrote: >> Mail is always a random IO workload, unless your mailbox count is 1, >> whether accessing indexes or mail files. Regarding the other two >> questions, you'll likely need to take your own measurements. > > Wait, maybe there is a misunderstanding. I mea

Re: [Dovecot] index IO patterns

2012-05-12 Thread Cor Bosman
> Mail is always a random IO workload, unless your mailbox count is 1, > whether accessing indexes or mail files. Regarding the other two > questions, you'll likely need to take your own measurements. Wait, maybe there is a misunderstanding. I mean the IO inside one index file, not across the dif

Re: [Dovecot] index IO patterns

2012-05-12 Thread Cor Bosman
> >> Alternatively, does anyone have any experience with other redundant storage >> options? Im thinking things like MooseFS, DRBD, etc? > > You seem to be interested in multi-site clustering/failover solutions, > not simply redundant storage. These two are clustering software > solutions but

Re: [Dovecot] index IO patterns

2012-05-11 Thread Stan Hoeppner
On 5/11/2012 1:41 AM, Cor Bosman wrote: > Hey all, we're in the process of checking out alternatives to our index > storage. We're currently storing indexes on a NetApp Metrocluster which > works fine, but is very expensive. We're planning a few different setups and > doing some actual performa

Re: [Dovecot] index IO patterns

2012-05-11 Thread Timo Sirainen
On 11.5.2012, at 13.56, Javier de Miguel Rodríguez wrote: >> Even without LDA/LMTP dovecot-imap needs to write right? It would >> need to update the index every time an imap connect happens and >> new mails are found in the mail store. > > Well of course. Indexes are also updated when flags are m

Re: [Dovecot] index IO patterns

2012-05-11 Thread Javier de Miguel Rodríguez
Even without LDA/LMTP dovecot-imap needs to write right? It would need to update the index every time an imap connect happens and new mails are found in the mail store. Well of course. Indexes are also updated when flags are modified, moved a messages, delete a message, etc.. But in my setup th

Re: [Dovecot] index IO patterns

2012-05-11 Thread Cor Bosman
Hi javier, > > > Indexes are very random, mostly read, some writes if using > dovecot-lda (ej: dbox). The average size is rather small, maybe 5 KB in > our setup. Bandwith is rather low, 20-30 MB/sec Even without LDA/LMTP dovecot-imap needs to write right? It would need to update the index ev

Re: [Dovecot] index IO patterns

2012-05-10 Thread Javier Miguel Rodríguez
Indexes are very random, mostly read, some writes if using dovecot-lda (ej: dbox). The average size is rather small, maybe 5 KB in our setup. Bandwith is rather low, 20-30 MB/sec We are using HP LeftHand for our replicated storage needs. Regards Javier El 11/05/2012 08:41, Cor Bosman esc

[Dovecot] index IO patterns

2012-05-10 Thread Cor Bosman
Hey all, we're in the process of checking out alternatives to our index storage. We're currently storing indexes on a NetApp Metrocluster which works fine, but is very expensive. We're planning a few different setups and doing some actual performance tests on them. Does anyone know some of t