Re: IMAP server with fast search
Response inline... --On Friday, September 10, 2004 11:30 -0700 Vadik [EMAIL PROTECTED] wrote: I run my own email server which support 5 accounts, but a few of the accounts have a lot of messages (4000 in the a single sub-folder is not uncommon), in addition to this I often need to run search for words in the body of the message. Such searches are extremely slow. I have setup with Maildir, and I used to run courier, but switched to dovecot http://packages.debian.org/testing/mail/dovecot-imapd (I don't really like courier folders system), as expected this had no effect on searching. Any recommendation of server with good searching? I've been thinking about a few: Cyrus: Also uses message per file storage, have some indexes, but I don't think these indexes are used for searching Depending on the version more or less are available, but ALL make available indexed subject, from, and to searches. As well as date based searched are all indexed. UW-IMAP: Having all messages in one file with improve search, but opening and manipulating such big file will slow down server. No indexing. dbmail: sounds like a good idea, but I am not sure how stable is the server. I also not sure if performance of using mysql 'like' for searching of message body is really big improvement. mysql like searches are no faster than a full file read when they start with a '%' (wildcard) -- that said mysql full text searches can be very fast. There is a nice packages for searching archives (e.g. lurker), which are extremely fast, so it would be reasonable to incorporate this search capability in to mail server, right? possibly, but you'd be on your own there. -- To UNSUBSCRIBE, email to [EMAIL PROTECTED] with a subject of unsubscribe. Trouble? Contact [EMAIL PROTECTED]
Re: IMAP server with fast search
--On Friday, September 10, 2004 20:20 -0300 Henrique de Moraes Holschuh [EMAIL PROTECTED] wrote: On Fri, 10 Sep 2004, Vadik wrote: I run my own email server which support 5 accounts, but a few of the accounts have a lot of messages (4000 in the a single sub-folder is not uncommon), in addition to this I often need to run search for words in [...] Any recommendation of server with good searching? Well, if you are willing to read the docs and setup something that is somewhat more complicated, you can use Cyrus. It isn't that bad, really :) It indexes everything (read the manpages on squat), and it can handle folders with 3+ messages easily. IF your IMAP client does not die a messly death with so many messages, that is :-) Oh, and it supports server-side searches and threading. Cyrus: Also uses message per file storage, have some indexes, but I don't think these indexes are used for searching See the squat indexer, it is included in the Debian packages. Just make sure to run squat often to update the indexes... Ahhh! I forgot about the squatter, yeah with that you get the body indexes if you want ot search on teh bodies of messages. There are some scripts to 'continuously' run squatter (really a set of cron scripts that cause it to run for about a minute or so then continue on...getting started and stopped every few minutes) But as I said in my previous post, all the other indexes are maintained, and newer versions also maintain a 'threading' index that smarter IMAP clients will take advantage of (Evolution, mulberrynot sure of what others, probably PINE heh) -- To UNSUBSCRIBE, email to [EMAIL PROTECTED] with a subject of unsubscribe. Trouble? Contact [EMAIL PROTECTED]
IMAP server with fast search
I run my own email server which support 5 accounts, but a few of the accounts have a lot of messages (4000 in the a single sub-folder is not uncommon), in addition to this I often need to run search for words in the body of the message. Such searches are extremely slow. I have setup with Maildir, and I used to run courier, but switched to dovecot http://packages.debian.org/testing/mail/dovecot-imapd (I don't really like courier folders system), as expected this had no effect on searching. Any recommendation of server with good searching? I've been thinking about a few: Cyrus: Also uses message per file storage, have some indexes, but I don't think these indexes are used for searching UW-IMAP: Having all messages in one file with improve search, but opening and manipulating such big file will slow down server. dbmail: sounds like a good idea, but I am not sure how stable is the server. I also not sure if performance of using mysql 'like' for searching of message body is really big improvement. There is a nice packages for searching archives (e.g. lurker), which are extremely fast, so it would be reasonable to incorporate this search capability in to mail server, right? Thanks for any recommendation/comments. -- To UNSUBSCRIBE, email to [EMAIL PROTECTED] with a subject of unsubscribe. Trouble? Contact [EMAIL PROTECTED]
Re: IMAP server with fast search
Vadik wrote: UW-IMAP: Having all messages in one file with improve search, but opening and manipulating such big file will slow down server. I can only agree with this part -- I have a few users with insanely large folder trees on an mbox-based UW-IMAP system, and it definitely makes the server eat RAM at a horrendous rate... but that's to be expected... I've been meaning to convert that box over to maildir to see if the performance goes up or down... Nate -- To UNSUBSCRIBE, email to [EMAIL PROTECTED] with a subject of unsubscribe. Trouble? Contact [EMAIL PROTECTED]
Re: IMAP server with fast search
Nate Duehr wrote: I can only agree with this part -- I have a few users with insanely large folder trees on an mbox-based UW-IMAP system, and it definitely makes the server eat RAM at a horrendous rate... but that's to be expected... I've been meaning to convert that box over to maildir to see if the performance goes up or down... I can tell you that it is fast for me to access these folders, and to move mail around these folders. But I never used mbox to start with, so I can not compare. -- To UNSUBSCRIBE, email to [EMAIL PROTECTED] with a subject of unsubscribe. Trouble? Contact [EMAIL PROTECTED]
Re: IMAP server with fast search
On Fri, 10 Sep 2004, Vadik wrote: I run my own email server which support 5 accounts, but a few of the accounts have a lot of messages (4000 in the a single sub-folder is not uncommon), in addition to this I often need to run search for words in [...] Any recommendation of server with good searching? Well, if you are willing to read the docs and setup something that is somewhat more complicated, you can use Cyrus. It indexes everything (read the manpages on squat), and it can handle folders with 3+ messages easily. IF your IMAP client does not die a messly death with so many messages, that is :-) Oh, and it supports server-side searches and threading. Cyrus: Also uses message per file storage, have some indexes, but I don't think these indexes are used for searching See the squat indexer, it is included in the Debian packages. Just make sure to run squat often to update the indexes... -- One disk to rule them all, One disk to find them. One disk to bring them all and in the darkness grind them. In the Land of Redmond where the shadows lie. -- The Silicon Valley Tarot Henrique Holschuh -- To UNSUBSCRIBE, email to [EMAIL PROTECTED] with a subject of unsubscribe. Trouble? Contact [EMAIL PROTECTED]
Re: IMAP server with fast search
Henrique de Moraes Holschuh wrote: On Fri, 10 Sep 2004, Vadik wrote: I run my own email server which support 5 accounts, but a few of the accounts have a lot of messages (4000 in the a single sub-folder is not uncommon), in addition to this I often need to run search for words in [...] Any recommendation of server with good searching? Well, if you are willing to read the docs and setup something that is somewhat more complicated, you can use Cyrus. Well, I did read documentation but I've missed any references to squat. The only reference I was able to find (now) is /usr/share/doc/cyrus21-doc/html/man/squatter.8.html and still be nothing on cyrus website. Anyway, this sounds really interesting. i was thinking about cyrus for a while, so now there is new reason to try it. Thanks, -- To UNSUBSCRIBE, email to [EMAIL PROTECTED] with a subject of unsubscribe. Trouble? Contact [EMAIL PROTECTED]
