Re: [Dovecot] keeping indexes in tmpfs
Daniel L. Miller wrote: Justin McAleer wrote: I have the source mail spools on NFS as well. Just asking - not looking for a flame war. I had a miserable time trying to get NFS working with just my simple LAN - I've had much better results via Samba with either SMBFS or CIFS. Off-topic - but can I ask why you're using NFS? Going back to my first mail, the long and short of it is: However, we plan to run a cluster of these servers anyway, where we will keep domains/accounts going to a particular server but fail over to one of the others in case of an outage. We have a new Netapp, and have been running our email off NFS for years without problems. To be fair, we haven't needed shared storage before, but we spent a lot of money on reliable storage, so there the data stayed. What sort of problems have you run into? So far in my dovecot testing I haven't had any issues either. We did try a few clustered filesystems on a SAN mount instead, but the results were, at best, poor.
Re: [Dovecot] keeping indexes in tmpfs
Justin McAleer wrote: Daniel L. Miller wrote: Justin McAleer wrote: I have the source mail spools on NFS as well. Just asking - not looking for a flame war. I had a miserable time trying to get NFS working with just my simple LAN - I've had much better results via Samba with either SMBFS or CIFS. Off-topic - but can I ask why you're using NFS? Going back to my first mail, the long and short of it is: However, we plan to run a cluster of these servers anyway, where we will keep domains/accounts going to a particular server but fail over to one of the others in case of an outage. We have a new Netapp, and have been running our email off NFS for years without problems. To be fair, we haven't needed shared storage before, but we spent a lot of money on reliable storage, so there the data stayed. What sort of problems have you run into? So far in my dovecot testing I haven't had any issues either. I had issues just trying to get it to work at all. Either portmap wouldn't start, wouldn't share, wouldn't talk - something. Or I'd get it to work, and then my joke of a wiring closet would get bumped and the clients would freeze when their connection was interrupted. That last was actually one of my biggest problems (admittedly not an NFS fault - but an NFS overreaction). When the wires were repaired NFS settled down - but I had far more success with Samba, including automatically restoring broken connections without having the clients re-mount and/or re-boot. -- Daniel
Re: [Dovecot] keeping indexes in tmpfs
On Mon, 2007-04-16 at 09:37 -0400, Justin McAleer wrote: While doing some testing with converting accounts while simulating incoming mail load (no other pop/imap processes going but 4 processes converting users), we found that we were maxing out the local disk in the server with the index activity. To find out that it was the index activity, I mounted a tmpfs for dovecot to keep indexes on, and the system load dropped from 70 to 3 :) How exactly were you converting the users? I guess if the system is building new index files for tons of users that could take a while. fsync_disable=yes could help a lot with reducing the disk writes, and maybe also mmap_disable=yes. For Dovecot v2.0 I'm planning on reducing at least dovecot.index.log file sizes. I think currently it uses way too much space when building the initial indexes. Anyway, Timo and others, do you have any thoughts about keeping indexes on a tmpfs partition? I realize the obvious issues with this: running out of space, and the fact that the partition is lost on reboot. I think memory would be better used for keeping mailbox data cached that's actually useful at the time. Also if you've POP3 users who keep messages in the server and dovecot.index.cache file is lost, all the messages are read to calculate the messages' virtual sizes when the user logs in the next time. That could be expensive. signature.asc Description: This is a digitally signed message part
Re: [Dovecot] keeping indexes in tmpfs
Timo Sirainen wrote: On Mon, 2007-04-16 at 10:41 -0400, Justin McAleer wrote: OK, that also causes it to read the mailboxes and save the message sizes to cache files. I expected as much. But just to make sure we're on the same page, after converting a user, only dovecot.index and dovecot.index.log exist in a user's index directory, no dovecot.index.cache. However, all of the user's folders do have indexes, not just the inbox. That is the expected result, correct? And reading the mail spools? :) I have the source mail spools on NFS as well. It could be done pretty easily only for index files by modifying the sources. I guess another option should be added for this. Fair enough, I'll have a look at this if it does make a significant difference, although I'm trying to keep source changes minimal :) Depends on how mailboxes are accessed. If message contents are read only once then I guess it doesn't matter. Probably the worst offender here is SEARCH TEXT/BODY command. Understood... that's going to be nasty though, it's just a matter of degree :)
Re: [Dovecot] keeping indexes in tmpfs
Justin McAleer wrote: I have the source mail spools on NFS as well. Just asking - not looking for a flame war. I had a miserable time trying to get NFS working with just my simple LAN - I've had much better results via Samba with either SMBFS or CIFS. Off-topic - but can I ask why you're using NFS? -- Daniel
