Re: [Courier-imap] Large Subfolder Problem
Am Dienstag, 13. Mai 2008 schrieb Dennis Gesker: I have a user who has consolidated a large number of messages (25970) into one folder. When I check the 'cur' directory or the subfolder all of the message appear to be there and intact. However, we can seem to open this folder using the mail client (Thunderbird). My spam folder grows once a month to a similar size until I start cleaning it up. I'm using KMail an it works. The synchronisation takes long time then (I'm using disconnected IMAP so KMail stores everything locally and has to synchronize) but nevertheless it works ok. Eike signature.asc Description: This is a digitally signed message part. - This SF.net email is sponsored by: Microsoft Defy all challenges. Microsoft(R) Visual Studio 2008. http://clk.atdmt.com/MRT/go/vse012070mrt/direct/01/___ Courier-imap mailing list Courier-imap@lists.sourceforge.net Unsubscribe: https://lists.sourceforge.net/lists/listinfo/courier-imap
Re: [Courier-imap] Large Subfolder Problem
And those of us with better than a TB of mail for more than 100K accounts serviced by a rack worth of load balanced servers and a HA NFS infrastructure would be SOL. True Maildir without all the indexing addins (like Cyrus started with) is NFS safe and scales. You take a hit up front, but you gain it back in the ability to have dozens of servers, where any server can handle any mailbox, including multiple servers accessing the box at the same time. (As it happens the IMAP client I am using now has 5 sessions up, each to a separate server the the LB and all accessing the same account.) We run courier *because* it uses true Maildir without any index based acceleration. That being said, I am working with thunderbird, in an account with 3 - 5 thousand messages per folder across a few dozen folders does well. The testbed install in a generic single CPU Opteron at 2Ghz, 1G RAM and a single 300G SATA drive. Last time I was getting complaints I spent most of a day pushing messages around with 35,000 messages per folder without issue. (Turns out the complaints were about an account with 230,000 messages in the inbox). Simon wrote: On 5/13/2008, Sam Stern ([EMAIL PROTECTED]) wrote: I've had this problem as well. Thunderbird starts choking when more than a few thousand messages are there. Outlook 2003 or 2007 can handle this load however -- given enough time to download the headers. When using courier-imap, yes, Ive seen this too... But one client, where some users have 20K+ message folders, but who switched to dovecot, do *not* have this problem, once dovecot has built its indexes. In fact, it takes less time for dovecot to index a 20k+ folder than it does for courier-imap to serve up a folder with 5k messages. Once the indexes are built - well, dovecot just leaves courier in the dust... sorry Sam, but it is true, and you have said more than once in the past that you have no intention of adding an indexing feature to courier-imap... why, I have no idea... And dovecot 1.1 is even considerably faster still. There are still some features that dovecot lacks (but those are being added fairly quickly), but even so, I'm migrating all of my clients to dovecot now and advising anyone I talk to to use it instead. - This SF.net email is sponsored by: Microsoft Defy all challenges. Microsoft(R) Visual Studio 2008. http://clk.atdmt.com/MRT/go/vse012070mrt/direct/01/ ___ Courier-imap mailing list Courier-imap@lists.sourceforge.net Unsubscribe: https://lists.sourceforge.net/lists/listinfo/courier-imap -- Christopher E. Brown [EMAIL PROTECTED] desk (907) 550-8393 cell (907) 632-8492 IP Engineer - ACS - This SF.net email is sponsored by: Microsoft Defy all challenges. Microsoft(R) Visual Studio 2008. http://clk.atdmt.com/MRT/go/vse012070mrt/direct/01/ ___ Courier-imap mailing list Courier-imap@lists.sourceforge.net Unsubscribe: https://lists.sourceforge.net/lists/listinfo/courier-imap
Re: [Courier-imap] Large Subfolder Problem
Dennis Gesker wrote: I have a user who has consolidated a large number of messages (25970) into one folder. When I check the 'cur' directory or the subfolder all of the message appear to be there and intact. However, we can seem to open this folder using the mail client (Thunderbird). Any hints? that's a lot of files in a single directory. this is mostly a filesystem problem. try # grep -m 1 ^Received: * and see how long it takes... you can split the folder on the console and tell the user to subscribe to the newly created folders. - This SF.net email is sponsored by: Microsoft Defy all challenges. Microsoft(R) Visual Studio 2008. http://clk.atdmt.com/MRT/go/vse012070mrt/direct/01/ ___ Courier-imap mailing list Courier-imap@lists.sourceforge.net Unsubscribe: https://lists.sourceforge.net/lists/listinfo/courier-imap
Re: [Courier-imap] Large Subfolder Problem
From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Dennis Gesker Sent: Tuesday, May 13, 2008 1:42 PM To: courier-imap@lists.sourceforge.net Subject: [Courier-imap] Large Subfolder Problem I have a user who has consolidated a large number of messages (25970) into one folder. When I check the 'cur' directory or the subfolder all of the message appear to be there and intact. However, we can seem to open this folder using the mail client (Thunderbird). Any hints? Thanks Dennis Hi Dennis, I've had this problem as well. Thunderbird starts choking when more than a few thousand messages are there. Outlook 2003 or 2007 can handle this load however -- given enough time to download the headers. Outlook 2007 handles this type of situation quite well actually (Outlook 2003 was a bit unstable when handling this many messages). The max I've ever had to clean up was a bit over 50k after a particularly nasty joe job. If outlook is not available, write a script to split the directory in 3k messages each. Just do a maildirmake on say .foldername.$count and move 3k to .foldername.$count new/ and iterate until done. DON'T start spawning directories off of Maildir/ (INBOX.) and don't forget to add the new folders to ~/Maildir/courierimapsubscribed . If the user does not want the messages and you can determine a pattern to apply you can write a script to simply delete the files (or move them about) while the user is not logged on and you have verified that no courier-imap or courier-pop instances are running under that user name. When done, also delete the two courier files (courierimapkeywords and courierimapuiddb) that hold (mostly) ephemeral data so they will be reconstructed. Another, rather aggravating, way of solving the problem is to set your timeout WAY up, make certain thunder bird does not store any messages, nor automatically check for new mail. I find that Thunderbird will then fetch a few thousand messages, which can then be dealt with. Compress the folder, Then repeat and wait, deal with the next few thousand, etc. This is a VERY annoying way to solve a mail bomb though. I've had thunderbird max the number of connections for that ip and netblock with repeated connections. So I suspect you might have to play with the config editor before trying this out. HTH Sam S. - This SF.net email is sponsored by: Microsoft Defy all challenges. Microsoft(R) Visual Studio 2008. http://clk.atdmt.com/MRT/go/vse012070mrt/direct/01/ ___ Courier-imap mailing list Courier-imap@lists.sourceforge.net Unsubscribe: https://lists.sourceforge.net/lists/listinfo/courier-imap
