Re: [Dovecot] Outlook (2010) -> Dovecot (IMAP) >10x slower with high network load and many folders
On Sat, Apr 7, 2012 at 3:16 AM, Willie Gillespie wrote: > On 4/6/2012 3:52 AM, Thomas von Eyben wrote: >> >> Test results: >> CLIENT-1 is having the problems when CLIENT-2 is using all the >> (100Mbps) bandwidth eg. copying files to MAIL-SRV. >> If I move CLIENT-1 to CLIENT-3 then almost all the delay is gone. >> NB.: I have not (yet) tested if the problem also exists when CLIENT-2 >> generates traffic to MAIL-SRV as opposed to OTHER-SRV (but I am >> expecting the same problems). > > > So the link between your 100 Mbps switch and the 1 Gbps switch is saturated > by CLIENT-2, so CLIENT-1 is just getting the leftovers? > > Since CLIENT-3 doesn't go through that 100 Mbps switch, it obviously doesn't > see that issue. Yes - that's my current "workaround" (perhaps also solution), I'm wondering if the performance is really expected to be _so_ bad when other users are utilizing the LAN. (You seem to indicate that what I am observing is expected and is "just" caused by [un-intended] semi-bad behavior from other users…) BR TvE
[Dovecot] Outlook (2010) -> Dovecot (IMAP) >10x slower with high network load and many folders
143) | |10.108 | Response: 4vlj OK I |IMAP: Response: 4vlj OK Idle completed. | |(49433) <-- (143) | |10.108 | Request: wh89 SELEC |IMAP: Request: wh89 SELECT "1_GROUPS.Adm" BR Thomas von Eyben
Re: [Dovecot] Live Mirror dovecot / OS X 10.6.4 (Timo Sirainen)
On Wed, Aug 25, 2010 at 4:27 PM, Eric Boltz (MMI/UPC) wrote: > > On Aug 25, 2010, at 10:15 AM, Timo Sirainen wrote: >> >> But if secondary server allowed changes, this is the difficult step to >> do correctly. For example lets say in first server: >> >> 1. It rsyncs user foo >> 2. User foo changes message A flag to \Seen >> 3. User foo deletes message B >> 4. User foo saves a new message C >> 5. The server crashes >> 6. Secondary server goes up, but 2-4 changes weren't resynced yet >> 7. User foo logs in and changes message D's flag to \Seen >> 8. Primary server goes back up >> 9. You rsync .. how? If you make primary server look exactly like >> secondary server, you message C gets lost. If you copy new files, now >> message A and message D gets duplicated, because their filename changed >> due to the flag change. Also message B becomes undeleted. >> >> Of course assuming this happens rarely enough, those aren't a huge >> problem, but the server move isn't always transparent to users and >> you'll get errors in Dovecot's logs. > > First off, thanks. > It will happen rarely (2-3x/year most likely base on prior power outages) and > if a couple users get a duplicate message or unread when read issue they can > file a complaint :) > The transfer wouldn't be transparent - I would force them to webmail on the > backup (maybe even force POP3?). > > Now to figure out where the virtual user data is...sigh > Would the "users" be the users in the Open Directory? If that's the case then you could probably "just" make the "backup" server an Open Directory Replica thus it would allways contain a (read only) copy of the user database… PS.: I am also thinking about how to make a "hot standby" OS X 10.6.x Server mail server ;-) - TvE
[Dovecot] maildirsize having incorrect content, how to recreate/correct?
Hi List, I have (otherwise successfull) migrated a server from cyrus to dovecot (Mac OS X Server 10.5.8 to 10.6.4 [dovecotd version to be 1.1.20apple0.5]). There are ca. 300+ users of which a very small handfull (ca. 1 %) are having reported a usage size that is very different to what 'du' reports. How can I rebuild the maildirsize and why might it be wrong in the first place(?) Will the maildirsize files be regenerated if deleted and when will this then happen ( at the next time of the user logging in or…) >From what I can read here: http://www.inter7.com/courierimap/README.maildirquota.html The maildirsize file contains (in linenumber > 1) "bytecount SPACE filecount" I also have one (perhaps more) user with one line having a negative value in maildirsize (-138204393 -2294) how can that happen / be corrected? Here's the info for one user with an much to high reporting of usage: sh-3.2# pwd /Volumes/RAID-06-low/Mail sh-3.2# cat 495827A6-7AF5-4017-9F07-67C0B04546EE/maildirsize 0S 281470373004731 4966 ### <- THIS LOOKS VERY WRONG 12113561 138 20047924 204 13553876 334 8064 1 8308 1 25240 1 26117 1 sh-3.2# du -hc 495827A6-7AF5-4017-9F07-67C0B04546EE 12M495827A6-7AF5-4017-9F07-67C0B04546EE/.Deleted Messages/cur 0B495827A6-7AF5-4017-9F07-67C0B04546EE/.Deleted Messages/new 0B495827A6-7AF5-4017-9F07-67C0B04546EE/.Deleted Messages/tmp 12M495827A6-7AF5-4017-9F07-67C0B04546EE/.Deleted Messages 0B495827A6-7AF5-4017-9F07-67C0B04546EE/.Drafts/cur 0B495827A6-7AF5-4017-9F07-67C0B04546EE/.Drafts/new 0B495827A6-7AF5-4017-9F07-67C0B04546EE/.Drafts/tmp 4.0K495827A6-7AF5-4017-9F07-67C0B04546EE/.Drafts 20M495827A6-7AF5-4017-9F07-67C0B04546EE/.Sent Messages/cur 0B495827A6-7AF5-4017-9F07-67C0B04546EE/.Sent Messages/new 0B495827A6-7AF5-4017-9F07-67C0B04546EE/.Sent Messages/tmp 20M495827A6-7AF5-4017-9F07-67C0B04546EE/.Sent Messages 14M495827A6-7AF5-4017-9F07-67C0B04546EE/.U&APg-nsket e-mail/cur 0B495827A6-7AF5-4017-9F07-67C0B04546EE/.U&APg-nsket e-mail/new 0B495827A6-7AF5-4017-9F07-67C0B04546EE/.U&APg-nsket e-mail/tmp 14M495827A6-7AF5-4017-9F07-67C0B04546EE/.U&APg-nsket e-mail 747M495827A6-7AF5-4017-9F07-67C0B04546EE/cur### <- WHEN COMPARING TO THIS 76K495827A6-7AF5-4017-9F07-67C0B04546EE/new 0B495827A6-7AF5-4017-9F07-67C0B04546EE/tmp 792M495827A6-7AF5-4017-9F07-67C0B04546EE 792Mtotal sh-3.2# ls -l total 352 drwx-- 7 jja mail 238 Aug 7 21:56 .Deleted Messages drwx-- 7 jja mail 238 Aug 7 21:56 .Drafts drwx-- 7 jja mail 238 Aug 7 21:56 .Sent Messages drwx-- 7 jja mail 238 Aug 7 21:56 .U&APg-nsket e-mail drwx-- 4966 jja mail 168844 Aug 7 21:56 cur ### <- AND WHEN COMPARING TO THIS -rw-r--r-- 1 jja mail 11 Aug 7 21:56 dovecot-keywords -rw--- 1 jja mail 108509 Aug 9 15:01 dovecot-uidlist -rw--- 1 jja mail 24808 Aug 9 14:26 dovecot.index -rw--- 1 jja mail 25288 Aug 9 15:01 dovecot.index.log -rw-r--r-- 1 jja mail 147 Aug 9 15:01 maildirsize drwx-- 6 jja mail 204 Aug 9 15:01 new -rw-r--r-- 1 jja mail 76 Aug 7 21:56 subscriptions drwx-- 2 jja mail 68 Aug 9 15:01 tmp - TvE
[Dovecot] Cyrus to Dovecot migration (OS X Ser ver): Backup + restore messages, live "st andby server" and delayed expunge and…
Hi List, I am very close to migrating from Cyrus to Dovecot (to be more precise from Mac OS X Server 10.5.8 to 10.6.4). The latter is reporting the dovecotd version to be 1.1.20apple0.5. All I have read about dovecot is extremely positive so I am exited to make the switch. BACKUP: BUT I would like to be sure that I can make a sound backup strategy. For Cyrus i used topicdesk's mailbfr (a script that stops the mailservice and then rsync's the mailstore to a backup location incrementing daily and restarting a complete backup weekly). This script is not yet ready for Dovecot, but from what I have read it should be as easy as "just" backing up the mail-data (/var/spool/imap/dovecot/mail in OS X), eg. with rsync. Our current setup is requiring ca. 11 hours for a full (200+ GB) backup (weekly) this is not good for uptime… RESTORE: Restore should be the same (well reverse) "just" restoring the files and making sure the get the correct permissions. What I am not sure about is the (cyrus specific) need for reconstructing the database, as I have read (on this list) it seems that dovecot is designed better and will "automatically" recognised the restored messages without the need to reconstruct any databases or stopping+restarting the service. Is this really true ,-)? NB.: For restores I plan to always restore to a specific subfolder for the user (eg RESTORED MAIL) as opposed to placing the mails within the folder hierachy LIVE BACKUP SERVER I have been told, that dovecot provides clever mechanisms for making it possible to synchronise the data to a "hot-spare" server. Both for being able to provide access to the data during breakdown or planned maintenance, but perhaps also to make backups easier (perhaps not needed?) DELAYED DELETION OF MESSAGES I believe that the feature is called "delayed expunge", a way of not deleting the messages until after an additional delay from the time the user deletes the message. Is this possible in dovecot? DOCUMENTATION Where would the best FAQ/KB for getting to know dovecot better be, perhaps there have even been written good books (I know old fashioned, but I really like the physical hands on a real book provides ;-) It's a lot of questions and I hope for good pointers to where I can find more documentation and good feedback from the list. BR Thomas von Eyben
