Re: strange message in the cyrus log
Hi! deliver.db is just used to suppress duplicate delivery and for suppressing sieve vacation mails coming more often that configured (days setting). So I'd suggest to stop cyrus and just delete deliver.db (and deliver.db.NEW if existing) and start cyrus again. Best, Daniel On 06.12.2006 19:13, Eric Doutreleau wrote: i m using cyrus2.3.6 in an RHEL box and this evening i saw the folowing message in the cyrus log files Dec 6 18:49:44 pasargades lmtp[18170]: skiplist: checkpointed /var/lib/imap/deliver.db (1381 records, 126228 bytes) in 8 seconds Dec 6 18:49:49 pasargades lmtp[18166]: skiplist: recovered /var/lib/imap/deliver.db (1381 records, 126228 bytes) in 5 seconds Dec 6 18:49:57 pasargades lmtp[18169]: skiplist: checkpointed /var/lib/imap/deliver.db (1394 records, 127436 bytes) in 8 seconds Dec 6 18:50:02 pasargades lmtp[18673]: skiplist: recovered /var/lib/imap/deliver.db (1394 records, 127436 bytes) in 5 seconds Dec 6 18:50:13 pasargades lmtp[18167]: skiplist: checkpointed /var/lib/imap/deliver.db (1441 records, 131392 bytes) in 10 seconds Dec 6 18:50:18 pasargades lmtp[18169]: skiplist: recovered /var/lib/imap/deliver.db (1441 records, 131392 bytes) in 5 seconds Dec 6 18:51:13 pasargades lmtp[18666]: skiplist: checkpointed /var/lib/imap/deliver.db (2876 records, 263196 bytes) in 13 seconds Dec 6 18:51:22 pasargades lmtp[18673]: skiplist: recovered /var/lib/imap/deliver.db (2876 records, 263196 bytes) in 9 seconds Dec 6 18:51:36 pasargades lmtp[18170]: skiplist: checkpointed /var/lib/imap/deliver.db (2945 records, 270112 bytes) in 12 seconds Dec 6 18:51:45 pasargades lmtp[18169]: skiplist: recovered /var/lib/imap/deliver.db (2945 records, 270112 bytes) in 9 seconds Dec 6 18:52:03 pasargades lmtp[18167]: skiplist: checkpointed /var/lib/imap/deliver.db (3050 records, 279660 bytes) in 16 seconds Dec 6 18:52:13 pasargades lmtp[18673]: skiplist: recovered /var/lib/imap/deliver.db (3050 records, 279660 bytes) in 10 seconds Dec 6 18:53:59 pasargades lmtp[18666]: skiplist: checkpointed /var/lib/imap/deliver.db (5741 records, 532436 bytes) in 29 seconds Dec 6 18:54:14 pasargades lmtp[18673]: skiplist: recovered /var/lib/imap/deliver.db (5741 records, 532436 bytes) in 15 seconds Dec 6 18:54:51 pasargades lmtp[18170]: skiplist: checkpointed /var/lib/imap/deliver.db (5992 records, 556372 bytes) in 27 seconds Dec 6 18:55:08 pasargades lmtp[18169]: skiplist: recovered /var/lib/imap/deliver.db (5992 records, 556372 bytes) in 17 seconds Dec 6 18:55:45 pasargades lmtp[19599]: skiplist: checkpointed /var/lib/imap/deliver.db (6253 records, 580284 bytes) in 32 seconds Dec 6 18:56:05 pasargades lmtp[18169]: skiplist: recovered /var/lib/imap/deliver.db (6253 records, 580284 bytes) in 20 seconds Dec 6 18:56:33 pasargades lmtp[19182]: skiplist: checkpointed /var/lib/imap/deliver.db (6284 records, 583028 bytes) in 28 seconds Dec 6 18:56:53 pasargades lmtp[19599]: skiplist: recovered /var/lib/imap/deliver.db (6284 records, 583028 bytes) in 20 seconds as you can see there s a lot of checkpoint and recovery of the deliverd.db database i can see during these operation a deliver.db file and a deliver.db.NEW file. the problem is that during this operation the delivery of mail is stopped. Should i upgrade to 2.3.7 version and has anybody have alrady that problem? thanks in advance for any help Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Message contains invalid header
On 26.10.2006 23:57, Marten Lehmann wrote: exim. It can handle even emails with NUL characters and 8bit headers, but I guess all up2date MTAs (like postfix or sendmail) are capable of this. Well, that's a bad comparison between MTA and your mail storage! A MTA normally doesn't care about the body. It just has SMTP envelopes to work with. MAIL FROM, RCPT TO and DATA is all it really needs (I know that very simplified, it adds Received: lines and so on). If the message header or body in the DATA part is seriously broken it doesn't make much problems (in 99,9% of all cases). But your Cyrus IMAPd has to work with these headers! It has to be able to sort by date, search for message ID, index the body, search for any header field! So you cannot just ignore errors in Cyrus. But perhaps you could use a program in between your MTA and cyrus which corrects these problems automagically. But I don't really know of any scalable solution for that. procmail piping to a script or similar sounds very overhead for me, but I'm not sure here... Best, Daniel Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Webmail
Hi! I have tried squirrelmail and horde IMP. While squirrelmail is very easy to implement, I prefer IMP for it's superior feature list But it's a hell to configure it the first time with all it's thousand options because I found most of them having the wrong default in my opinion. Best, Daniel On 16.10.2006 13:57, [EMAIL PROTECTED] wrote: Hello everyone! I would realize a webmail system based on Cyrus IMAP. What can you suggest me? I've find out these different products that could be usefull for my purposes: 1) Squirremail 2) Horde-IMP 3) Openwebmail I have set Cyrus to work with ssaslauth authentication style and I would maintain it. I would use Horde because it seems there is a gorupware Horde-based that should be so cool. It could be fantastic if Horde could interface with MS Outlook to share contacts and other informaions. Does anyone have some experiences in that way? Thakns a lot in advance!!! Stefano C. Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: lmtp should give temporary failure for mailbox unknown
Hmmm, well, a non existent mailbox is no temprary failure, it's very permanent. okay, in this case it's a false error, but to make another error to circumvent that is not a smooth solution. Perhaps you might want to set soft_bounce = yes in postfix' main.cf until you have found the error. See: http://www.postfix.org/postconf.5.html#soft_bounce Best, Daniel On 11.10.2006 17:31, Ramprasad wrote: This is actually related to my previous question ... I just configured my cyrus server to accept mails directly from my remote postfix server over lmtp Everything seems to work fine but sometimes lmtp gives strange errors like to=X, orig_to=X, relay=202.162.229.40[202.162.229.40]:24, delay=0.26, delays=0.25/0/0/0.01, dsn=5.1.1, status=bounced (host 202.162.229.40[202.162.229.40] said: 550-Mailbox unknown. Either there is no mailbox associated with this 550-name or you do not have authorization to see it. 550 5.1.1 User unknown (in reply to RCPT TO command)) When actually the mailbox is valid. The same mail sent again reaches the mailbox without problems. The cyrus server is highly loaded most of the time. I want lmtp (over tcp) to give tempfail instead. I am already ensuring mbox exists at smtp level Thanks Ram Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: lmtp should give temporary failure for mailbox unknown
Therefore we should concentrate on finding the real cause(s) of the problem and try to solve them. Full acknowledge. That's why I wrote until you have found the error. But in the meanwhile, Ram possibly does not want to loose mails. And it's easier to set a well documented option in postfix than hacking a dangerous quick and dirty patch and recompile cyrus instead to give 4xx responses. I just fear that I cannot be of any help with debugging/fixing this bug. Sorry. Best, Daniel On 12.10.2006 13:46, Farzad FARID wrote: Hi, Daniel Eckl wrote: Hmmm, well, a non existent mailbox is no temprary failure, it's very permanent. okay, in this case it's a false error, but to make another error to circumvent that is not a smooth solution. Perhaps you might want to set soft_bounce = yes in postfix' main.cf until you have found the error. See: http://www.postfix.org/postconf.5.html#soft_bounce But in fact there are cases in a Cyrus Murder configuration when lmtpd returns a failure with a 5xx code because mupdate is simply not ready or temporarily unavailable. So simply setting soft bounces in Postfix is IMHO overkill and hides a misfeature in the Cyrus Imapd code. Therefore we should concentrate on finding the real cause(s) of the problem and try to solve them. I'll try to file a bug report by describing a reproducible test case for my setup. Ram, do you also use mupdate or any external source of information that could be the cause of the error lmtp gives you? Regards Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: export / import
Hi! Export / import sounds to me like backup/restore, just on different machines. http://cyrusimap.web.cmu.edu/twiki/bin/view/Cyrus/Backup This should get you somewhere. Best, Daniel On 10.10.2006 06:48, Joe Harvell wrote: I am about to get a new desktop PC at work, and I need to get my Cyrus IMAP database transferred over to the new machine. The problem is they take the old machine away first and then deliver the new one. So I have to make sure I have all the data I want to keep saved off somewhere. The new machine will come with Windows on it, and then I will wipe it and install Gentoo Linux. Since I am installing all the software on the new machine, I can make sure the version of Cyrus on the new machine is identical to that on the old machine. How do I get the Cyrus IMAP database transferred to the new machine? Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: lmtp rejecting mails for valid mailboxes
Hi! I don't seem to see lmtp here at all. Your MTA seems to reject these mails on SMTP layer. Most probably your MTA can not know which mailboxes cyrus has and that's why it rejects all mails, because local users are no system user, but by using cyrus, they are pure virtual. So the mails don't hit lmtp delivery to cyrus at all. You should use local_recipient_maps for all users which are in cyrus. These maps can reside in a file or in a mysql or in an ldap server and the program which creates new accounts could update this table automatically. In my case, this is webcyradm who does this for me in mysql. http://www.postfix.org/LOCAL_RECIPIENT_README.html Best, Daniel On 10.10.2006 16:01, Ramprasad wrote: I just configured my cyrus server to accept mails directly from my remote postfix server over lmtp Everything seems to work fine but sometimes lmtp gives strange errors like to=X, orig_to=X, relay=202.162.229.40[202.162.229.40]:24, delay=0.26, delays=0.25/0/0/0.01, dsn=5.1.1, status=bounced (host 202.162.229.40[202.162.229.40] said: 550-Mailbox unknown. Either there is no mailbox associated with this 550-name or you do not have authorization to see it. 550 5.1.1 User unknown (in reply to RCPT TO command)) When actually the mailbox is valid. The same mail sent again reaches the mailbox without problems. What could be the reason. The cyrus server is highly loaded most of the time could that be a reason. Anyway I dont want lmtp failures to bounce the mail , can I send a 450 instead of 550. Because I am already ensuring the mailbox exists before accepting the mail. How do I configure this on postfix or lmtp ? Thanks Ram Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: reconstruct
Craig White wrote: On Wed, 2006-09-20 at 23:51 -0400, Jorey Bump wrote: Sarah Walters wrote: Benjamin, I need to reconstruct everyone mailbox. But should I need to take the mail server down? or just have people close email and still allow incoming messages? Just queue the mail on your MTA (sendmail, postfix, exim, qmail, esoteric-server-of-your-choice). If they're not accessing the mail, it doesn't need to be delivered to their mailboxes anyway. So in short, yes, take it down. But leave your MTA up to accept mail. If you're using the patches to Cyrus to do recipient checking this will probably break though, so you might need to temporarily disable those checks and just accept all mail addressed to your domain whether the account exists or not. IMHO, this is worse than shutting down the MTA temporarily, which allows mail to be queued on the sender's MTA. If the process runs within a reasonable amount of time, you restart Cyrus, the MTA, collect/reject mail as remote MTAs retry, and prevent becoming a backscatter source. I must be a moron then because I just run reconstruct without shutting down anything. It's always seemed to work for me. Craig Hmmm yes, I want to second that. I have often restored accidentally deleted mail folders from tape, copied them back into the mailbox structure and reconstructed the folder. I never had any issue with that... Does anybody really know any drawback of reconstructing without downtime? Best, Daniel Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: reconstruct
Steve Huston wrote: On 9/21/06 5:04 AM, Daniel Eckl wrote: Hmmm yes, I want to second that. I have often restored accidentally deleted mail folders from tape, copied them back into the mailbox structure and reconstructed the folder. I never had any issue with that... [...] And since I can't tell from the filenames what a certain email contains, the end user can go through the new folder of however-many-hundred-mails to pick out the few they want, move them to where they want them, then delete the rest of the folder at their leisure. Yes, that's my preferred way also. Just restore a complete folder, name it e.g. RESTORED or similar, put it in the mailbox root and make a reconstruct online. Then th euser can decide what to do with it. I think as well that this should be safe. Sounds very logically. Best, Daniel Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: 5.1.1 User unknown bounces
Andrew Morgan wrote: On Sat, 9 Sep 2006, Dave McCracken wrote: On Saturday 09 September 2006 9:19 am, Kjetil Torgrim Homme wrote: On Fri, 2006-09-08 at 10:45 -0700, Andrew Morgan wrote: Otherwise, just let Sendmail queue the message and attempt to deliver the message to Cyrus. If the user does not exist, Cyrus will let Sendmail know during the LMTP handshake. DO NOT DO THIS! if your Sendmail accepts _all_ possible local parts during the SMTP transaction, you will be sending out lots of bogus bounces to addresses abused (joe-jobbed) as senders of spam. I second this emphatically. I discovered I was sending out thousands of bounce messages per day with this setup. My solution was to go into my sendmail.mc and define CYRUSV2_MAILER_FLAGS to be A@/:|mw. The default does not have the w flag. This flag tells sendmail to validate the user id on the local machine when it queues the mail for this mailer. Since I have a small set of valid users it was easy for me to define them all in /etc/passwd. I'd guess a larger site would want to set up something more complex. The key point is that sendmail still has the connection to the sender open when it selects the mailer. If it detects an error there it responds with an error status to the sending mailer. If no error is detected, sendmail will close the connection before actually invoking the mailer. At this point its only recourse is to send bounce mail. To my knowledge, Postfix does not support the socket map protocol for verifying a mailbox exists during the SMTP transaction. I guess the Postfix users are just screwed on this then. :) In our case, our campus mail relays (6 of them currently) accept mail for all domains on campus and perform RBL and spam tagging before relaying the messages to their final destinations. You'll have to live with the bounce messages coming from our domain. :P Andy Hi Andy! Hi Dave! I stated this in my last mail already: If the cyrus users are in a mysql database, then postfix with mysql support CAN verify if mailbox exists. cat /etc/postfix/mysql-mailboxes.cf # # mysql config file for local recipient maps lookups on postfix # comments are ok. # # the user name and password to log into the mysql server # hosts = unix:/var/lib/mysql/mysql.sock localhost hosts = unix:/var/lib/mysql/mysql.sock user = XXX password = XXX # the database name on the servers dbname = mail # the table name table = virtual select_field = alias where_field = alias Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: performance issue (imap spool on san)
As Mulberry is released freely now I tried it and I have to say, that neither configuration nor usage is intuitive in any way. I needed several tries to configure it for IMAPS and Auth'ed SMTPS. I really cannot use it, I have to search too long for every function and most are located that illogically, that I seem to be unable to remember them. And it misses a lot of features I use every day. Virtual folders, inline attachments (jpegs for example), forwarding emails attached, view attached emails, Drag and Drop support and so on and so forth. And a thunderbird with cached headers is multiple times faster in resorting and scrolling, not only over 3 MBit DSL Line, but even over LAN. It's fine that mulberry doesn't need to cache headers, but why isn't it able to do so? Loading on demand and then caching it would be the best of both worlds. So just implementing every IMAP feature available might be the best thing for the server and the protocol, but not for the user. You need a intuitive interface and nowadays it really has to look nice, too if a non-geek should use it. And to be honest, mulberry simply looks horrible... But it's nice, that everyone who doesn't care about looking and usability now has a suitable free IMAP client availiable. Best, Daniel Sebastian Hagedorn wrote: Hi, let me start by saying that I'm basically always on high-speed Internet connections and keep my mailboxes relatively small. So I haven't had bad experiences with Thunderbird in that regard. I still don't use it, but that's not the issue here. -- Daniel Eckl [EMAIL PROTECTED] is rumored to have mumbled on 26. Juli 2006 21:31:40 +0200 regarding Re: performance issue (imap spool on san): In a graphical client you want to be able to scroll through your whole message list without any delay. So I think there is no other chance but caching all header information of a folder. On low bandwith situations it seems to be impossible for me to do this on demand only. Well, you don't know Mulberry then. It has a GUI and is very adaptable to any kind of network situation and it doesn't cache anything! You do have to tweak it, however. It doesn't auto-configure, but there are *many* settings to play around with. Obviously that's both a blessing and a curse. I was searching for a full featured graphical IMAP client for a long time and tried everything and I have to say: Not only is thunderbird an IMAP client, it is the best graphical IMAP client I could find in the whole Linux and Windows world. Unfortunately that's not saying much ... it's just too bad that the only decent IMAP GUI client isn't developed further. I have hopes for Thunderbird 2, but I have a feeling that I will continue to use Mulberry for a long time ... -- Sebastian Hagedorn - RZKR-R1 (Flachbau), Zi. 18, Robert-Koch-Str. 10 Zentrum für angewandte Informatik - Universitätsweiter Service RRZK Universität zu Köln / Cologne University - Tel. +49-221-478-5587 Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: performance issue (imap spool on san)
Hi Scott! Thanks for your thoughts! I really appreciate reading your perspective! I might not have stated clearly enough, whos opinion I speak about. It was the opinion of about 20 very different users I evaluated Mulberry with and my opinion, too. This of course is not representative in any imaginable way and might and will not apply to you and many other people. Above all I think it does not apply top most of the mailing list members here which all more or less do administrate a major professional grade IMAP server named cyrus-imapd. But it could easily be the opinion of most users without technical background being used to clients like Outlook Express or Thunderbird. Yes I fully believe that I might find some or many of my missing features if I read the manual thoroughly. So perhaps the only problem which is a real one for me might be the lack of intuitive usability. All others might be just an aftereffect of that. It would really be nice if the (near or far) future would provide an improvement here. Virtual folders I used and use in thunderbird, kmail, IMP Webmail (Horde framework) and opera mail. Without that, mulberry is not unreasonable for everyone, that's just for people using IMAP the way I do. I don't have any clue how many people this might be. Because I used vfolders until now, I have less real folders and changing to mulberry would mean to create a lot of folders, moving and copying mails around, and many of the new folders will contain copies of mails already in other folders. Or as an alternative, starting the same searches manually over and over again. Both is not practicable either for me or for my mailbox quota. :) Inline viewing of attachments surely is a subject worth of discussion, but you will never get a definite answer. You have to make that configurable and depending on your major type of users you have to choose what's the default. With mulberry which is mostly choosen by geeks I think, I would choose disabled inline viewing by default. Drag and Drop from konqueror to mulberry somehow didn't work for me, but after your writign I don't want to blame mulberry here without further investigating that. So I just accept that it should work and there might be something broken in my KDE DnD functionality. :) Regarding the visual candy thing, you are correct, there will be people loving mulberrys interface style, but I cannot believe that this is more than a homeopathic attenuation. Just look at all the actual major interfaces out there (qt, gtk, windows xp/vista) to get a clue what seems to be wanted by the majority of normal PC users. I'm really sure that Mulberry would benefit from being ported to a nowadays widget style and follow one of the major usability guidelines people are used to. Regarding the single-threaded nature of mulberry I didn't run into problems with that so far, but thinking of small dial-in lines like GSM I could easily imagine that it's disturbing to wait for one mail to be sent and not being able to start writing the next one until it's done... So thanks again and have a lot of fun! Best, Daniel Scott Adkins wrote: --On Monday, September 11, 2006 2:14 PM +0200 Daniel Eckl [EMAIL PROTECTED] wrote: Everyone is entitled to their opinion and yours is certainly welcome. However, beauty is in the eye of the beholder... I have heard comments the cover pretty much the whole spectrum with regards to its usability and looks, and really, I don't see any particular opinion winning over the other. For the most part, opinions are based on how well that particular user loved a favorite e-mail client they previously used. And it misses a lot of features I use every day. Virtual folders, inline attachments (jpegs for example), forwarding emails attached, view attached emails, Drag and Drop support and so on and so forth. I must admit, I would love to see Virtual Folder support... however, is this implemented in the majority of IMAP clients out there? I am not sure that it is... so, to single out Mulberry for that is unreasonable. Is it a wish-list item? Certainly. Inline attachments are a long heated topic of debate here... of course there are features left to implement... however, Cyrus is one man and he has to prioritize what order of features should get implemented in. When Mulberry was not a free product, the features that were requested most and/or payed for were the features to get implemented first. Now that Cyrus is a one-man show (currently), it may be awhile before we see any new features get added... Forwarding as attachments is a function that already exists. Viewing attached e-mails exists, but maybe not the way you would like... If it can be viewed inline, Mulberry allows it... otherwise, you right-click and click view and it opens an external viewer... Drag and drop support is also implemented... though, without context in your complaint, I am not sure what you are expecting... I certainly can drag
Re: performance issue (imap spool on san)
Hi Sebastian! That's a good point! I just looked at the linux version and didn't thought that there could be major differences! Thanks a lot for this info! Best, Daniel Sebastian Hagedorn wrote: --On 11. September 2006 14:14:21 +0200 Daniel Eckl [EMAIL PROTECTED] wrote: And it misses a lot of features I use every day. Virtual folders, inline attachments (jpegs for example), forwarding emails attached, view attached emails, Drag and Drop support and so on and so forth. Scott already answered many points, but I wanted to mention that the Linux version is *by far* less polished than the Windows and OS X versions. Drag and drop is merely one example of that. The Linux Mulberry 3 release was fine, but version 4 never really made it out of beta. You may not care, but I wanted to state it for the record Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: performance issue (imap spool on san)
Well, I really don't know why you should feel insulted if that applies to you. If you don't take care of polished, skinnable widget style with bells and whistles and spinning activity indicators and shaded buttons and so on, because your preference is more to features and speed and such things than this is fully legitimate and it's the reason why we have such a big variety of software in the world. I call that superior, not insulting. Best, Daniel Joseph Brennan wrote: --On Monday, September 11, 2006 14:14 +0200 Daniel Eckl [EMAIL PROTECTED] wrote: But it's nice, that everyone who doesn't care about looking and usability now has a suitable free IMAP client availiable. It is possible to state your preference without insulting everyone else. Joseph Brennan Columbia University Information Technology Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: 5.1.1 User unknown bounces
We handle it through a mysql db which contains all account infos. Cyrus and postfix uses the database for IMAP and SMTP authentication, postfix (with mysql support) uses it to check if an address exists and to get the local user from the emailadress. This way we can handle forwarding and aliases, too, where multiple emailadresses point to one mailbox or multiple mailboxes or external emailadresses. This is made very similar to this approach: http://www.delouw.ch/linux/Postfix-Cyrus-Web-cyradm-HOWTO/html/index.html But I have to admit that I don't know if sendmail has such interfaces to mysql or ldap and how to use it, if they are existent. Best, Daniel [EMAIL PROTECTED] wrote: My effort to install Cyrus has been largely successful. I would expect to see a function to bounce email with a 5.1.1 User unknown error. But I haven't seen this function described or even acknowledged within Cyrus. As far as I understand, I need a hook for my MTA (Sendmail) to query. Does one of the /usr/cyrus/bin utilities provide this function? It seems easy enough to roll my own. How do other Cyrus administrators handle this requirement? Thanks, Jim Schueler Motor City Interactive Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: To list admins: Reply-to address
Just for the sake of completeness: Kjetil made me aware of the fact, that cyrus mailman does indeed put in List-Post header. No idea how I could have overseen that while searching for it. If thunderbird would have the needed functionality, it could provide the user with a List Reply Button. We will see this behavior in TB in version 3.0 which contains base changes allowing an extention to provide that feature. But these changes have been ported back to TB 1.5 unofficially: http://open.nit.ca/wiki/index.php?page=ReplyToListThunderbirdExtension For example a SuSE packager provides patched TB packages for SuSE 10.0 and SuSE 10.1: http://dev-loki.blogspot.com/2006/08/thunderbird-with-reply-to-list.html Thanks and best, Daniel Daniel Eckl wrote: Kjetil Torgrim Homme wrote: On Tue, 2006-09-05 at 14:14 +0200, Daniel Eckl wrote: Rudy Gevaert wrote: yes, this is desired. read http://www.unicom.com/pw/reply-to-harmful.html How do you reply to list in thunderbird? I had a look, it seems there is no support for it, not even an extension. Well, just assumed that thunderbird would be able to make use of that, you would need a List-Reply: header field added from the mailing list system. what is List-Reply? RFC 2369 specifies List-Post. But that's considered harmful as well. http://marc.merlins.org/netrants/listreplyto.txt I don't see any mention of List-Reply in the above text. it talks about the Reply to list function. So there is no solution which satisfies the lazy ones as well as the paranoid ones. No, I will neither say to which group I belong nor where you belong to. *g* in a MUA which has reply to list conveniently available (e.g. Ctrl+L in Evolution, f in Gnus, g in Mutt), there is no conflict between being lazy and paranoid. Correct, I think List-Post is the corresponding header to the List-Reply function I am speaking of. I burred too much with the term List-Reply: header field. Thanks for clarification. But if you don't see the term list-reply in http://marc.merlins.org/netrants/listreplyto.txt then your browser search function is seriously broken. A dedicated button for List Reply is a very elegant version of my wish of making that configurable. But to make this usable at all, cyrus mailman has to include this header field, so a list-reply function knows what's the adress of the list and which adresses are persons which are on To: line, too. At the moment, the MUA can support whatever it wants, it cannot know what's the list address. Best, Daniel Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: To list admins: Reply-to address
Rudy Gevaert wrote: yes, this is desired. read http://www.unicom.com/pw/reply-to-harmful.html How do you reply to list in thunderbird? Well, just assumed that thunderbird would be able to make use of that, you would need a List-Reply: header field added from the mailing list system. But that's considered harmful as well. http://marc.merlins.org/netrants/listreplyto.txt So there is no solution which satisfies the lazy ones as well as the paranoid ones. No, I will neither say to which group I belong nor where you belong to. *g* Choose your poison My opinion is: If reply-to and list-reply is considered harmful, that it should be a client side option if the client should obey it or not. That's the only way to satisfy everyone. The same this has been made with read confirmation requests in email headers. So why not with any other header which could be harmful? Best, Daniel Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: To list admins: Reply-to address
Kjetil Torgrim Homme wrote: On Tue, 2006-09-05 at 14:14 +0200, Daniel Eckl wrote: Rudy Gevaert wrote: yes, this is desired. read http://www.unicom.com/pw/reply-to-harmful.html How do you reply to list in thunderbird? I had a look, it seems there is no support for it, not even an extension. Well, just assumed that thunderbird would be able to make use of that, you would need a List-Reply: header field added from the mailing list system. what is List-Reply? RFC 2369 specifies List-Post. But that's considered harmful as well. http://marc.merlins.org/netrants/listreplyto.txt I don't see any mention of List-Reply in the above text. it talks about the Reply to list function. So there is no solution which satisfies the lazy ones as well as the paranoid ones. No, I will neither say to which group I belong nor where you belong to. *g* in a MUA which has reply to list conveniently available (e.g. Ctrl+L in Evolution, f in Gnus, g in Mutt), there is no conflict between being lazy and paranoid. Correct, I think List-Post is the corresponding header to the List-Reply function I am speaking of. I burred too much with the term List-Reply: header field. Thanks for clarification. But if you don't see the term list-reply in http://marc.merlins.org/netrants/listreplyto.txt then your browser search function is seriously broken. A dedicated button for List Reply is a very elegant version of my wish of making that configurable. But to make this usable at all, cyrus mailman has to include this header field, so a list-reply function knows what's the adress of the list and which adresses are persons which are on To: line, too. At the moment, the MUA can support whatever it wants, it cannot know what's the list address. Best, Daniel Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Command-line reconstruct different from cyradm reconstruct?
Possibly the IMAP command uses a quota reconstruct, too, while the command line reconstruct does not do that automatically. I'd try on command line if reconstruct -rf user.jpublic; quota -f user.jpublic does what you want. If quota -f does the trick and a lot of mailboxes have the problem, I'd do a quota -f user. Best, Daniel Chris St. Pierre wrote: I have a number of users with quotas that are set correctly, but Cyrus is confused about the amount of data they have. For instance: imap lq user.jpublic STORAGE 0/307200 (0%) If I run: # su - cyrus -c /usr/lib64/cyrus-imapd/reconstruct -rf user.jpublic nothing changes, and all remains as it was: imap lq user.jpublic STORAGE 0/307200 (0%) But if I run reconstruct from cyradm, it works fine: imap reconstruct user.jpublic imap lq user.jpublic STORAGE 23140/307200 (7.5325520833%) Two questions: 1. Why would this be? 2. I need to reconstruct several thousand mailboxes thusly. How can I script this? Cyrus::IMAP::Admin doesn't appear to have a reconstruct method, and piping a text file into cyradm doesn't work because of the password prompt. Other ideas? I'm using the RHEL4 package of Cyrus IMAP v2.2.12. Thanks! Chris St. Pierre Unix Systems Administrator Nebraska Wesleyan University Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
OT: Mulberry availiable again and for free
Sorry for being off-topic, but we had a discussion about that here some days ago. Mulberry is availiable again and it's for free for all three platforms. http://www.mulberrymail.com/ Have fun! Daniel Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: List Archives/Info is 404
Hi Kevin! This has been asked on the list multiple times (including me). Noone seems to know who can fix this. The original list archive is on http://lists.andrew.cmu.edu/pipermail/info-cyrus/ An archive mirror with a feature rich interface can be found here: http://news.gmane.org/gmane.mail.imap.cyrus or simple flat blog-like: http://blog.gmane.org/gmane.mail.imap.cyrus Hope that helps. But correct informations would definitely be much better... Best, Daniel Kevin Kruzich schrieb: These links, which go out with every email sent to this list, are 404. Maybe somebody can fix it. Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Outlook 2003 still crashing
We have the same setup with cyrus 2.2.12 w/ IMAP IDLE and Outlook 2003 SP2. We never had Outlook crashing (well, not more than normal with outlook *g*), neither with nor without any Outlook SP. I don't think that this is cyrus or IDLE related. But I don't have any clue, to be honest... Best, Daniel Alexander Kriegisch wrote: I am referring to a thread somebody else started in November 2005: Kenneth Murchison wrote (Wed Nov 16 20:23:28 EST 2005): Wil Cooley wrote: On Mon, 2005-11-14 at 08:01 -0500, Ken Murchison wrote: Grabbing a protocol dump when you experience the crash might be helpful. I'm seeing it with Office 2003 SP2 installed (didn't test w/o SP2). I'm looking at the protocol logs but for the life of me I cannot see anything going wrong. It sends IDLE requests and then just hangs up trying to do who-knows-what. Since I don't really understand IDLE and idled (other than the general idea of staying connected), I tried restarting with idled not starting in cyrus.conf, to no avail. Disable IDLE altogether in Cyrus. Outlook doesn't play well with others, except for Exchange. Well, Kenneth, we tried just that, but to no avail. The results are even worse than enabling IDLE, but decreasing the timeout. I am quoting my sys-admin here, I am not administering the server myself. We tried OL2003 without patches and with SP2. No difference in results, and we share the same symtoms mentioned in that older thread. Strangely, it seems to work with older OL2000. Regards Alexander Kriegisch Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Outlook 2003 still crashing
I understand. No, we don't have this either.
I have attached cyrus.conf and imapd.conf.
We are running Cyrus 2.2.12 on SuSE 10.0 on filesystem XFS
(HW: Dual Xeon 2GB RAM, SCSI RAID-5 0,5 TB capacity)
I had freezes up to 30 seconds with the same config running on
filesystem ext3, but this error was clearly on server side, the ext3
flushing behavior was so bad that it caused incredible iowait and huge
load and full server stalls.
Hope that helps
Best,
Daniel
Alexander Kriegisch wrote:
Daniel,
this is interesting. For clarification: OL2003 does not crash, but
rather stall forever, so I have to kill the process. Anyway, you don't
have those problems. Maybe it could help to compare the config files?
What do you think?
Alexander
Daniel Eckl wrote:
We have the same setup with cyrus 2.2.12 w/ IMAP IDLE and Outlook 2003
SP2.
We never had Outlook crashing (well, not more than normal with outlook
*g*), neither with nor without any Outlook SP.
I don't think that this is cyrus or IDLE related.
But I don't have any clue, to be honest...
Best,
Daniel
Alexander Kriegisch wrote:
I am referring to a thread somebody else started in November 2005:
Kenneth Murchison wrote (Wed Nov 16 20:23:28 EST 2005):
Wil Cooley wrote:
On Mon, 2005-11-14 at 08:01 -0500, Ken Murchison wrote:
Grabbing a protocol dump when you experience the crash might be
helpful.
I'm seeing it with Office 2003 SP2 installed (didn't test w/o
SP2). I'm
looking at the protocol logs but for the life of me I cannot see
anything going wrong. It sends IDLE requests and then just hangs up
trying to do who-knows-what. Since I don't really understand IDLE and
idled (other than the general idea of staying connected), I tried
restarting with idled not starting in cyrus.conf, to no avail.
Disable IDLE altogether in Cyrus. Outlook doesn't play well with
others, except for Exchange.
Well, Kenneth, we tried just that, but to no avail. The results are even
worse than enabling IDLE, but decreasing the timeout. I am quoting my
sys-admin here, I am not administering the server myself.
We tried OL2003 without patches and with SP2. No difference in results,
and we share the same symtoms mentioned in that older thread. Strangely,
it seems to work with older OL2000.
Regards
Alexander Kriegisch
Cyrus Home Page: http://asg.web.cmu.edu/cyrus
Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
# standard standalone server implementation
START {
# do not delete this entry!
recover cmd=ctl_cyrusdb -r
# this is only necessary if using idled for IMAP IDLE
idled cmd=idled
}
# UNIX sockets start with a slash and are put into /var/lib/imap/socket
SERVICES {
# add or remove based on preferences
imap cmd=imapd listen=imap prefork=10
imaps cmd=imapd -s listen=imaps prefork=10
pop3 cmd=pop3d listen=pop3 prefork=0
pop3s cmd=pop3d -s listen=pop3s prefork=0
sieve cmd=timsieved listen=sieve prefork=0
# at least one LMTP is required for delivery
lmtpunix cmd=lmtpd listen=/var/lib/imap/socket/lmtp prefork=20
# this is only necessary if using notifications
# notify cmd=notifyd listen=/var/lib/imap/socket/notify proto=udp
prefork=1
}
EVENTS {
# this is required
checkpointcmd=ctl_cyrusdb -c period=30
# this is only necessary if using duplicate delivery suppression
delprune cmd=cyr_expire -E 3 at=0400
# this is only necessary if caching TLS sessions
tlsprune cmd=tls_prune at=0400
# Uncomment the next entry, if you want to automatically remove
# old messages of EVERY user.
# This example calls ipurge every 60 minutes and ipurge will delete
# ALL messages older then 30 days.
# enter 'man 8 ipurge' for more details
# cleanup cmd=ipurge -d 30 -f period=60
}
configdirectory: /var/lib/imap
partition-default: /var/spool/imap
sievedir: /var/lib/sieve
admins: cyrus
allowanonymouslogin: no
autocreatequota: 1
reject8bit: no
munge8bit: no
quotawarn: 95
timeout: 30
poptimeout: 10
dracinterval: 0
drachost: localhost
sasl_pwcheck_method: saslauthd
allowplaintext: yes
sasl_mech_list: PLAIN
servername: XXX..XXX
altnamespace: yes
rfc_ignore_8bit: yes
duplicate_db: skiplist
duplicatesuppression: yes
lmtp_overquota_perm_failure: no
lmtp_downcase_rcpt: yes
flushseenstate: yes
postmaster: [EMAIL PROTECTED]
rfc3028_strict: no
singleinstancestore: yes
#
# if you want TLS, you have to generate certificates and keys
#
#tls_cert_file: /usr/ssl/certs/cert.pem
#tls_key_file: /usr/ssl/certs/skey.pem
#tls_ca_file: /usr/ssl/CA/CAcert.pem
#tls_ca_path: /usr/ssl/CA
tls_cert_file: /usr/ssl/certs/moonfish.nero.com.crt
tls_key_file: /usr/ssl/certs/moonfish.nero.com.key
tls_session_timeout: 1440
tlscache_db: skiplist
Cyrus Home Page: http://asg.web.cmu.edu/cyrus
Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu
List Archives/Info: http
Re: Outlook 2003 still crashing
Hi Wil! I use the binary packages from SuSE 10.0 (because I'm too lazy to keep up with security patches by myself *g*) It's very likely that I use options which are not supported by my cyrus version at all and it just ignores them. I googled the net and studied all mailing lists and how-tos and man pages and added everything which I assumed to be good. I easily might have hit a page referring to a newer and/or patched version I don't have. For myself I run linux on my workstation for many reasons, but I didn't have any stalls with outlook myself before switching to linux and all our users who use Outlook (about 250 approx) don't report problems like this one. We just have three known problems with outlook which all are absolutely client side: 1. when the pst archive outlook uses for caching opened imap objects goes up to 2GB, outlook goes mad (like not showing new imap objects in inbox). For this caching pst files one cannot use the newer pst file format which comes with outlook 2003 which overcomes this limitation; for cache pst it chooses old format automatically and unchangeable. Solution is to stop outlook, delete the cache pst and start outlook again (resulting in new fetching all headers for every folder you select :cry:) 2. sent items can not be stored on the server reliable. Local outlook rules which do this just disappear from time to time. Dunno why... Could be users fault, too, no clue here. 3. Under unknown circumstances, a client seems to put incredible IO load on the server for 5 minutes up to 30 minutes. With my actual setup (thanks to XFS), the server just handles this stress, but the problem is still there. I just can assume that this has to be an outlook client, because they are used the most. I might be wrong here, too. No clue either. Best, Daniel Wil Cooley schrieb: On Tue, 2006-08-15 at 14:16 +0200, Daniel Eckl wrote: I understand. No, we don't have this either. Curious; as the original initiator of the thread way back, I still see frequent stalls on Outlook 2003; they're definitely Outlook stalls too--the Cyrus server is not busy. In fact, it's an installation on my workstation, so I'm the only user. Ultimately, I gave up trying to stick with the organizational standard and installed Linux on my desktop (which I'd have preferred in the first place) and moved Windows into VMware. I set 'imapidlepoll: 0' in my imapd.conf, which is supposed to disable IDLE altogether, according to the man page, to no avail. I also disabled idled in cyrus.conf, likewise to no avail. I did not, however, recompile Cyrus to disable IMAP, which might be what Ken meant back then. I'm using the Fedora Extras RPMs, which are based on Simon Matter's; it's possible, I guess, that a patch is also causing a problem. Daniel, did you compile yours directly or is this a binary from SUSE? It seems like you have a few patches too, since some of that options aren't documented in my imapd.conf. I have attached cyrus.conf and imapd.conf. We are running Cyrus 2.2.12 on SuSE 10.0 on filesystem XFS (HW: Dual Xeon 2GB RAM, SCSI RAID-5 0,5 TB capacity) I had freezes up to 30 seconds with the same config running on filesystem ext3, but this error was clearly on server side, the ext3 flushing behavior was so bad that it caused incredible iowait and huge load and full server stalls. Not that it matters now since you've switched, but you were probably suffering from an undersized journal, see: http://nakedape.cc/wiki/PlatformNotes_2fLinuxNotes Wil Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
OT: dissapearing Outlook filter rules (was Re: Outlook 2003 still crashing)
Thanks for the explanation for the disappearing rule! I'd never hit on this one... This behavior is that illogical, I'd never thought of this At the moment we advise our users to move mails from local to server once a day. Works better than a disappearing rule. :-/ Best, Daniel Zachariah Mully schrieb: On Tue, 2006-08-15 at 19:05 +0200, Daniel Eckl wrote: For myself I run linux on my workstation for many reasons, but I didn't have any stalls with outlook myself before switching to linux and all our users who use Outlook (about 250 approx) don't report problems like this one. We have 50+ on O2k3 and don't have any the problems that you report Wil. 2. sent items can not be stored on the server reliable. Local outlook rules which do this just disappear from time to time. Dunno why... Could be users fault, too, no clue here. The problem is that if the rule fails once for any reason, it's automatically disabled. This has to be one of our biggest complaints from the users. Especially sales, who seem to excel at nothing but destroying their laptops, and losing the sent mail stored locally on them. Z Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Outlook 2003 still crashing
Hi Andrew and Wil! Thanks for the hints! While it doesn't affect my mailserver now since I've switched to XFS, it may help me and other list members in similar situations. Thank you very much! Best, Daniel Andrew Morgan schrieb: On Tue, 15 Aug 2006, Wil Cooley wrote: On Tue, 2006-08-15 at 14:16 +0200, Daniel Eckl wrote: I have attached cyrus.conf and imapd.conf. We are running Cyrus 2.2.12 on SuSE 10.0 on filesystem XFS (HW: Dual Xeon 2GB RAM, SCSI RAID-5 0,5 TB capacity) I had freezes up to 30 seconds with the same config running on filesystem ext3, but this error was clearly on server side, the ext3 flushing behavior was so bad that it caused incredible iowait and huge load and full server stalls. Not that it matters now since you've switched, but you were probably suffering from an undersized journal, see: http://nakedape.cc/wiki/PlatformNotes_2fLinuxNotes Or using the wrong I/O scheduler in the Linux 2.6 kernel... Make sure you use deadline instead of the anticipatory default I/O scheduler in 2.6. Andy Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Odd quota problem
Perhaps I didn't describe the max quota limit problem good enough: When your system is affected by this problem and you set a quota greater than 2 GB, it results in running mad. In this case it will report over quota way before 2GB. Setting quota back to 2GB (or some bytes below), the user will be able to use this 2GB w/o problems again. So your symptoms point exactly to this problem. In this case, the only way to have more space as 2GB is to remove quota like it has been suggested here already. Best, Daniel Karl Boyken schrieb: Thanks for everyone's ideas. I helped the guy move mail into local folders, and eventually, the problem disappeared. He still has a quota greater than 2 Gb, so that apparently wasn't the problem. Anyway, he's an outlier, and he is working on reducing his disk usage now, so, all is well, for the moment. Karl Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
LMTP invalid pointer error
Hi dear list members! Today I got a postmaster warning mail from my postfix which wanted to deliver a mail to cyrus with lmtp. Error response from LMTP was: *** glibc detected *** free(): invalid pointer: 0xb7d4e094 *** Full response below. Do I have to worry? Until now it didn't reappear... Is this a software problem or could it be because of bad RAM or something? Thanks for any hint. System: SuSE 10.0 cyrus 2.2.12 postfix 2.2.5 All packages unmodified from SuSE. Tanks and best regards, Daniel -- Unexpected response from /var/lib/imap/socket/lmtp[/var/lib/imap/socket/lmtp]. Transcript of session follows. Out: RSET In: 250 2.0.0 ok Out: MAIL FROM:[EMAIL PROTECTED] SIZE=1996 BODY=8BITMIME Out: RCPT TO:[EMAIL PROTECTED] Out: DATA In: 250 2.1.0 ok In: 250 2.1.5 ok In: 354 go ahead Out: . In: *** glibc detected *** free(): invalid pointer: 0xb7d4e094 *** Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Odd quota problem
Well, I know, older cyrus had a max quota of 2GB. I run 2.2.12 and I can make higher quotas, but I don't know if SuSE in evrsion 10.0 added a patch for allowing that or if this version should be able to do that natively... But perhaps this subject leads to a solution for you. Good luck! Daniel Karl Boyken schrieb: Thanks for the suggestion--something I should have thought of myself. I fixed quota, but everyone's mailbox was already in synch (except my own--long story). We're running 2.2.12. Karl have you tried fixing the quota cyr_quota -f user.username (The name for cyr_quota may be quota depending on your installation) also what version of Cyrus? -Patrick Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: High availability email server...
Well, as far as I know, the mailboxes.db and other databases are only opened and modified by the master process. But I'm not sure here. But as your assumption sounds correct and because this seems to work with cluster (and I fully believe you here, no question), your assumption regarding the DBs somewhat must be correct. Thanks! I would be glad if some list member who has in depth knowledge here could comment! Best, Daniel Andrew Morgan schrieb: On Tue, 1 Aug 2006, Daniel Eckl wrote: Well, I don't have cluster knowledge, and so of course I simply believe you that a good cluster system will never have file locking problems. I already stated this below! But how will the cluster affect application level database locking? That was my primary question and you didn't name this at all. A database file which is in use is practically always inconsistent until it's being closed by the database application. That's why databases can be corrupt after an application crash and have to be reconstructed. When you have two applications changing the same database file, you have a never ending fight, because every application thinks, the database is inconsistent, but it's just in use by another application. And every app will try to reconstruct it and so break it for the other app(s). It's like letting two cyrus master run on the same single node! It will break in my opinion. Can you shed some light on this subject? I think the point here is that the situation you describe already occurs all the time on a stand-alone Cyrus server. There are multiple imapd processes accessing the mailboxes.db database concurrently. If you are using Berkeley DB, it has an API to manage concurrent access. I assume the same is true of skiplist and the other backend formats. I don't know enough about the Berkeley DB internals to explain how it actually works, but it does. :) Andy Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Only some mailboxes don't accept incoming messages, no error in the logs for this?!
Last time I had such a problem, the recipient accidentially discarded all mails using a sieve rule. Could this apply to you, too? Can your customers set sieve rules? Perhaps they aren't discarded, but forwarded without storing locally? Best, Daniel Rustedt, Florian schrieb: Hello, i am pretty new to cyrus, so excuse my low expertise: We've set up a combination of postfix+sasl+mysql+cyrus. Transport is postfix-lmtp. It is running now flawlessly since about one year, but now, we've got a severe problem: Three of our customers can't get mails. The Mail is transported via postfix and via lmtp. Both logg an sent=ok, the lmtp-log only contains additionally some errors about missing sieve-files. However i got no sieve configured, so it should be not of interest. What can i look for now? Where could be the error? It seems, that postfix/lmtp delivers the mail and cyrus accepts it, without error. And then the Mail get's lost?! Of course, there is enough diskspace and no high load. Kind regards, Florian ** IMPORTANT: The contents of this email and any attachments are confidential. They are intended for the named recipient(s) only. If you have received this email in error, please notify the system manager or the sender immediately and do not disclose the contents to anyone or make copies thereof. *** eSafe scanned this email for viruses, vandals, and malicious content. *** ** Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: unable to login with cyradm
Hi Joe! Cyradm (or only your cyradm? Dunno...) might not be SSL capable. So either use port 143 to connect or if you have to user IMAPS Port 993, then you could establish an ssl tunnel with stunnel program. Best, Daniel Joe Harvell schrieb: Could someone *please* take a look at this? Joe Harvell wrote: I used cyradm a long time ago to set up two mailboxes, and now I need to use it again, but I can't login: I am running cyrus-imapd 2.2.12. I know that the latest 2.3 version supports TLS with cyradm. But I am not ready to upgrade. I just want to be able to run cyradm from the localhost. Here is what happens when I enter the cyradm command: [EMAIL PROTECTED] ~ $ cyradm --user cyrus --server localhost --port 993 IMAP Password: [EMAIL PROTECTED] ~ $ Here is my syslog: Jul 31 17:10:13 dingo master[18188]: about to exec /usr/lib/cyrus/imapd Jul 31 17:10:13 dingo imaps[18188]: executed Jul 31 17:10:13 dingo imaps[18188]: auxpropfunc error invalid parameter supplied Jul 31 17:10:13 dingo imaps[18188]: _sasl_plugin_load failed on sasl_auxprop_plug_init for plugin: ldapdb Jul 31 17:10:13 dingo imaps[18188]: sql_select option missing Jul 31 17:10:13 dingo imaps[18188]: auxpropfunc error no mechanism available Jul 31 17:10:13 dingo imaps[18188]: _sasl_plugin_load failed on sasl_auxprop_plug_init for plugin: sql Jul 31 17:10:13 dingo imaps[18188]: accepted connection Jul 31 17:10:13 dingo imaps[18188]: imaps TLS negotiation failed: localhost [127.0.0.1] Jul 31 17:10:13 dingo imaps[18188]: Fatal error: tls_start_servertls() failed Jul 31 17:10:13 dingo master[31124]: process 18188 exited, status 75 Jul 31 17:10:13 dingo master[31124]: service imaps pid 18188 in BUSY state: terminated abnormally And here is my imapd.conf: # $Header: /var/cvsroot/gentoo-x86/net-mail/cyrus-imapd/files/imapd.conf,v 1.5 2 004/08/27 06:02:45 langthang Exp $ # Don't forget to use chattr +S (if you are using ext[23]) # when you change these directories (read the docs). configdirectory:/var/imap partition-default: /var/spool/imap sievedir: /var/imap/sieve tls_ca_path:/etc/ssl/certs tls_cert_file: /etc/ssl/cyrus/dingo.x509.pem tls_key_file: /etc/ssl/cyrus/dingo.rsakeys.pem # Don't use an everyday user as admin. admins: cyrus hashimapspool: yes allowanonymouslogin:no allowplaintext: no # Allow renaming of top-level mailboxes. #allowusermoves: yes # Use this if sieve-scripts could be in ~user/.sieve. #sieveusehomedir: yes # Use saslauthd if you want to use pam for imap. # But be warned: login with DIGEST-MD5 or CRAM-MD5 # is not possible using pam. sasl_pwcheck_method:saslauthd servername: dingo.dogpad.net. ## This is a recommended authentication method if you ## emerge cyrus-sasl with 'postgres' or 'mysql' ## To use with mysql database uncomment those lines below. #sasl_pwcheck_method: auxprop #sasl_auxprop_plugin: sql ## possible values for sasl_auxprop_plugin 'mysql', 'pgsql', 'sqlite'. #sasl_sql_engine: mysql ## all possible values. #sasl_mech_list: LOGIN PLAIN CRAM-MD5 DIGEST-MD5 NTLM ## or limit to CRAM-MD5 only #sasl_mech_list: CRAM-MD5 ## change below to suit your setup. #sasl_sql_user: mailsqluser #sasl_sql_passwd: password #sasl_sql_database: mailsqldb #sasl_sql_hostnames: localhost #sasl_sql_select: SELECT clear FROM users WHERE email = '[EMAIL PROTECTED]' Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: unable to login with cyradm
addendum to my info: http://article.gmane.org/gmane.mail.imap.cyrus/824 http://article.gmane.org/gmane.mail.imap.cyrus/21264/ Best, Daniel Daniel Eckl schrieb: Hi Joe! Cyradm (or only your cyradm? Dunno...) might not be SSL capable. So either use port 143 to connect or if you have to user IMAPS Port 993, then you could establish an ssl tunnel with stunnel program. Best, Daniel Joe Harvell schrieb: Could someone *please* take a look at this? Joe Harvell wrote: I used cyradm a long time ago to set up two mailboxes, and now I need to use it again, but I can't login: I am running cyrus-imapd 2.2.12. I know that the latest 2.3 version supports TLS with cyradm. But I am not ready to upgrade. I just want to be able to run cyradm from the localhost. Here is what happens when I enter the cyradm command: [EMAIL PROTECTED] ~ $ cyradm --user cyrus --server localhost --port 993 IMAP Password: [EMAIL PROTECTED] ~ $ Here is my syslog: Jul 31 17:10:13 dingo master[18188]: about to exec /usr/lib/cyrus/imapd Jul 31 17:10:13 dingo imaps[18188]: executed Jul 31 17:10:13 dingo imaps[18188]: auxpropfunc error invalid parameter supplied Jul 31 17:10:13 dingo imaps[18188]: _sasl_plugin_load failed on sasl_auxprop_plug_init for plugin: ldapdb Jul 31 17:10:13 dingo imaps[18188]: sql_select option missing Jul 31 17:10:13 dingo imaps[18188]: auxpropfunc error no mechanism available Jul 31 17:10:13 dingo imaps[18188]: _sasl_plugin_load failed on sasl_auxprop_plug_init for plugin: sql Jul 31 17:10:13 dingo imaps[18188]: accepted connection Jul 31 17:10:13 dingo imaps[18188]: imaps TLS negotiation failed: localhost [127.0.0.1] Jul 31 17:10:13 dingo imaps[18188]: Fatal error: tls_start_servertls() failed Jul 31 17:10:13 dingo master[31124]: process 18188 exited, status 75 Jul 31 17:10:13 dingo master[31124]: service imaps pid 18188 in BUSY state: terminated abnormally And here is my imapd.conf: # $Header: /var/cvsroot/gentoo-x86/net-mail/cyrus-imapd/files/imapd.conf,v 1.5 2 004/08/27 06:02:45 langthang Exp $ # Don't forget to use chattr +S (if you are using ext[23]) # when you change these directories (read the docs). configdirectory:/var/imap partition-default: /var/spool/imap sievedir: /var/imap/sieve tls_ca_path:/etc/ssl/certs tls_cert_file: /etc/ssl/cyrus/dingo.x509.pem tls_key_file: /etc/ssl/cyrus/dingo.rsakeys.pem # Don't use an everyday user as admin. admins: cyrus hashimapspool: yes allowanonymouslogin:no allowplaintext: no # Allow renaming of top-level mailboxes. #allowusermoves: yes # Use this if sieve-scripts could be in ~user/.sieve. #sieveusehomedir: yes # Use saslauthd if you want to use pam for imap. # But be warned: login with DIGEST-MD5 or CRAM-MD5 # is not possible using pam. sasl_pwcheck_method:saslauthd servername: dingo.dogpad.net. ## This is a recommended authentication method if you ## emerge cyrus-sasl with 'postgres' or 'mysql' ## To use with mysql database uncomment those lines below. #sasl_pwcheck_method: auxprop #sasl_auxprop_plugin: sql ## possible values for sasl_auxprop_plugin 'mysql', 'pgsql', 'sqlite'. #sasl_sql_engine: mysql ## all possible values. #sasl_mech_list: LOGIN PLAIN CRAM-MD5 DIGEST-MD5 NTLM ## or limit to CRAM-MD5 only #sasl_mech_list: CRAM-MD5 ## change below to suit your setup. #sasl_sql_user: mailsqluser #sasl_sql_passwd: password #sasl_sql_database: mailsqldb #sasl_sql_hostnames: localhost #sasl_sql_select: SELECT clear FROM users WHERE email = '[EMAIL PROTECTED]' Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: AW: Re: Only some mailboxes don't accept incoming messages, no error in the logs for this?!
Arghhh... I was too fast. Your question was actually how he redelivered the mails, am I right? ... Sorry... Best, Daniel Daniel Eckl schrieb: He told that in the part you deleted from quote. He accidentially made some kind of °catch-all alias which catched away all the mails. He deleted the alias and the mailboxes worked again. I hope I understodd that correctly, though... Best, Daniel Rudy Gevaert schrieb: Rustedt, Florian wrote: So we killed this alias and redelivered all mails from the box to solve this problem. May I ask how you did this? Thanks in advance, Rudy Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: AW: Re: Only some mailboxes don't accept incoming messages, no error in the logs for this?!
He told that in the part you deleted from quote. He accidentially made some kind of °catch-all alias which catched away all the mails. He deleted the alias and the mailboxes worked again. I hope I understodd that correctly, though... Best, Daniel Rudy Gevaert schrieb: Rustedt, Florian wrote: So we killed this alias and redelivered all mails from the box to solve this problem. May I ask how you did this? Thanks in advance, Rudy Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: High availability email server...
quite well. And finally: Anyway, it has nothing to do with Cyrus, but if anyone does have another application that wants lots of small files on a clustered FS: http://web.caspur.it/Files/2005/01/10/1105354214692.pdf http://polyserve.com/pdf/Caspur_CS.pdf Kinda surprising, but it DOES have something to do with Cyrus. Caspur did their case study on cluster filesystems with their e-mail environment. It used Cyrus IMAP and some kind of SMTP (I think it was Postfix or something like that), since that was the e-mail environment they had. Polyserve came out as the big winner. It is very good reading. It is a good case where a clustering filesystem was specifically chosen to handle their Cyrus e-mail environment. Incidentally, for those who care, we are planning on migrating our own Cyrus environment out of Tru64 into RedHat running on Polyserve by the end of the year (hopefully). Scott --On Monday, July 31, 2006 8:05 AM -0500 Chris St. Pierre [EMAIL PROTECTED] wrote: One of the major problems you'd run into is /var/lib/imap, the config directory. It contains, among other things, a Berkeley DB of information about the mail store. GFS, Lustre, and other cluster filesystems do file-level locking; in order to properly read and write to the BDB backend, you'd need DB-level locking, which is not possible from a filesystem. If you tried putting /var/lib/imap on shared storage, you'd have data corruption and loss in no time. IMAP is also a stateful connection; depending on how you set up your cluster, some clients might not handle it gracefully (e.g., Pine). --On Saturday, July 29, 2006 12:40 PM +0200 Daniel Eckl [EMAIL PROTECTED] wrote: As already said in this thread: Cyrus cannot share its spool. No 2 cyrus instances can use the same spool, databases and lockfiles. For load balancing you can use a murder setup and for HA you can use replication. --On Friday, July 28, 2006 3:52 PM -0500 Rich Graves [EMAIL PROTECTED] wrote: Clustered filesystems don't make any sense for Cyrus, since the application itself doesn't allow simultaneous read/write. Just use a normal journaling filesystem and fail over by mounting the FS on the backup server. Consider replication such as DRDB or proprietary SAN replication if you feel you must physically mirror the storage. Anyway, it has nothing to do with Cyrus, but if anyone does have another application that wants lots of small files on a clustered FS: http://web.caspur.it/Files/2005/01/10/1105354214692.pdf http://polyserve.com/pdf/Caspur_CS.pdf Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: High availability email server...
Well, I don't have cluster knowledge, and so of course I simply believe you that a good cluster system will never have file locking problems. I already stated this below! But how will the cluster affect application level database locking? That was my primary question and you didn't name this at all. A database file which is in use is practically always inconsistent until it's being closed by the database application. That's why databases can be corrupt after an application crash and have to be reconstructed. When you have two applications changing the same database file, you have a never ending fight, because every application thinks, the database is inconsistent, but it's just in use by another application. And every app will try to reconstruct it and so break it for the other app(s). It's like letting two cyrus master run on the same single node! It will break in my opinion. Can you shed some light on this subject? Best, Daniel Dave McMurtrie schrieb: Daniel Eckl wrote: Hi Scott! Your statements cannot be correct by logical reasons. While on file locking level you are fully right, cyrus heavily depends on critical database access where you need application level database locking. As only one master process can lock the database, a second one either cannot lock the database or just crashes it with simultaneous write access. I didn't try it by myself for obvious reasons... If that didn't occur to you, then you had incredible luck, that there was no situation where both processes wanted to change the same db file simultaneously. Hi Daniel, Scott is not just lucky, he's using clustering technology that works. When using a cluster filesystem that works, the locking semantics across cluster nodes will be the same as those on a single node filesystem. What you say above is simply not correct. University of Pittsburgh is also running a 4-node active/active cluster using Veritas Cluster Filesystem and it works very well. The performance is incredible, and as Scott pointed out you don't need the complexity of murder or application-level replication. Using a cluster instead of Cyrus murder gives you both scalability and redundancy. The big tradeoff is that Veritas Cluster Filesystem costs money, while Cyrus does not. Thanks, Dave Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: cyrus force pop3 clients to leave messages on server
That's a good idea. But this may have an unwanted side effect: A pop3 client which is not configured to leave messages on server might ignore the possibility that messages on the server might be seen already. If the client doesn't compare fetched and unfetched mails with the UIDL command, it might always fetch all messages from the server over and over again, because it thinks it has deleted all fetched mails and all mails on server must be new. So would act al clients which don't use the UIDL command at all, because they miss the leave messages on server option at all. I think have a better idea (but without knowing the reason for the posters request, it might be unusable, I don't know): Use sieve script to copy all incoming messages to another folder. The POP3 clients keep fetching and truncating the INBOX but all messages are still on the server in another folder. In case some of them are needed again, one could use a webmail IMAP client to view them or copy some of them into the inbox to be fetched again. Best, Daniel former03 | Baltasar Cevc schrieb: If I'm not mistaken that's impossible due to the POP3 protocol restrictions, the messages are removed using the DELE command, and there's some command to get the numers of the messages and UUIDs. If this assumption is right, the only possibilities would be to prevent deletion using ACL (which would impact IMAP, too) or to insert a proxy that prevents the DELE command from being executed. Baltasar -- Baltasar Cevc _ former 03 gmbh _ infanteriestraße 19 haus 6 eg _ D-80797 muenchen _ http://www.former03.de Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: High availability email server...
Hi Michael! As already said in this thread: Cyrus cannot share its spool. No 2 cyrus instances can use the same spool, databases and lockfiles. For load balancing you can use a murder setup and for HA you can use replication. Best, Daniel Michael Menge schrieb: Hi, Quoting Pascal Gienger [EMAIL PROTECTED]: I would NEVER suggest to mount the cyrus mail spool via NFS, locking is important and for these crucial things I like to have a real block device with a real filesystem, so SANs are ok to me. does someone use lustre as cyrus mail spoll? Would it be possible to run cryus on 2 ore more systems with a shared spool for loadbalancing and HA with lustre? Michael Hi, Quoting Pascal Gienger [EMAIL PROTECTED]: I would NEVER suggest to mount the cyrus mail spool via NFS, locking is important and for these crucial things I like to have a real block device with a real filesystem, so SANs are ok to me. does someone use lustre as cyrus mail spoll? Would it be possible to run cryus on 2 ore more systems with a shared spool for loadbalancing and HA with lustre? Michael Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: duplicate suppression in murder
Well, I'm guessing here, because I never tried a murder setup. But as I understand: This feature suppresses duplicate mails to the _same mailbox_. So I do not see the sense in a duplicate database which spans over multiple backends. Du you want that if user A on one backend gets an email and then user B on another backend gets the same email, that it will be suppressed? I doubt that. So every murder backend has it's own deliver.db and everything works like in a single server cyrus system. Best, Daniel Vincent Fox schrieb: Can a murder setup also do duplicate suppression across the backends? I am in the process of setting up a first murder, and this question came up in a meeting. We know you can do duplicate suppression on a single server that info is easily found. I have googled and scanned the archives didn't see anything discussing duplicates in the context of multiple backends. Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: performance issue (imap spool on san)
Andrew Findlay schrieb: On Fri, Jul 28, 2006 at 12:18:12AM -0700, Nikola Milutinovic wrote: So, perhaps we could state that the desired behavior of any IMAP client would be to fetch only those message headers it nedds to and perhaps a bit more. In case of TB, that would transalte to fetching only headers that would be visible to the user and perhaps screenful of header up and down. It also helps if the clients ask for a limited set of headers from each message of interest. Yes, I want to second all these statements. That would be my prefered solution, too. By the way: I checked kmails behavior. It fetches the headers of all mails in a folder, too, but I think it uses just the limited set of headers and that's why it is so incredible fast compared to thunderbird. Disadvantage: It cannot show me if a mail has attachments, before I click on it and load it this way. But that might be no problem in most cases. So I think TB already would get a huge speed improvement by just implementing a limited header set query. Best, Daniel Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: performance issue (imap spool on san)
Hi Nikola! Say you have a GUI IMAP client XxX. Say you start it up and click on the INBOX. What would you desire/expect XxX to do? I would expect to see all mail headers in my inbox. Well, you cannot see _all_ of your headers when you have a big mailbox full of mails. You can only see a few of them, perhaps 20, or 50 or so. The client theoretically would be able to clarify, how many emails it can show to the user, depending on the height of the message list window. Then it could just fetch only the headers of the messages, which it can show you now. As soon as a user scrolls, it can fetch the next few headers. My opinion: That's fine in an Webmail Client or in a console based client, where you only can scroll line by line or page by page. I don't know what a graphical client should do, when a user drags the view with the vertical window slider and scrolls up to down to up in between 3 seconds. The client would have to try to get all headers in 3 seconds? Or should he just show n/a to the user until he stops? Very bad idea in my eyes. I often scroll through my whole mailbox searching for a specific date range or similar. I don't want to issue a search query because of that task, that would be very non-economical. So in my opinion: you cannot use this behavior in a graphical client. Well, I have to believe that mulberry can do that somehow, I cannot check that, this program and its vendor are non-existant anymore. But I know: The smaller your bandwith to the server is, the nastier would be the delay you have when you scroll through your folder searching for something. Best, Daniel Nikola Milutinovic schrieb: The first time you open a large IMAP folder is not very fast, I have to admit, but I didn't find any other comparable IMAP client without this problem. Perhaps there are some, but I didn't try them because of the lack of other basic email features. This is why they aren't IMAP clients. IMAP servers make all manner of searching, sorting, retrieval, and storage options completely available to the client, without having to download even all the headers. This is why Mulberry, Pine, Mutt, and Kmail are so much faster. If TBird would just do that instead of insisting on blindly attempting to download all the headers and performing all sorting and searching on the client. TBird and most of the others have their roots and brains seated back in the POP3 dark ages near as I can tell and that's how they treat all mail stores. IMAP allows the clients to easily ask for threaded views (unless you turn the index options off or something like that) from the server, as well as partial sets of headers in batch. This massively speeds things up when you're on a modem, or working with large mailboxes, or mailboxes you only occasionally open. I must say I'm a bit lost here. I have been using and administering Cyrus IMAP for years now, so I'm not really a new kid on the block. Say you have a GUI IMAP client XxX. Say you start it up and click on the INBOX. What would you desire/expect XxX to do? I would expect to see all mail headers in my inbox. So, how do you do that in XxX, other then fetching all mail headers? How do you do that in Pine and Mutt? Now, fetching it EVERY time, well, that would make me switch to another client. So, caching comes in. Of course, that introduces the issue of synchronization, not just for new mails, but also for mails deleted outside that client. I'm not sure how TB handles that. What is your modus operandi in Mutt or Pine for this? If I understand correctly, you just make IMAP queries to the server and display what you desire. Hmm, call me lazy, but I would mark such a feature in TB unwelcome. When I click on the INBOX, I expect to see it's contents. That is the semantics I'm used to, when I click on a folder. Is this semantic somehow confronted to the root philosophy of IMAP client/server? Furthermore, if TB is implementing those semantics in IMAP protocol in an undesirable fashion, what should it do to become desirable again? And don't get me wrong, there were a couple of features in TB that made me reach into my dictionary of less than favourable epitets. Like connection caching, which made my installation crash (it could have been my mistake in not applying some patches). For that matter, OE has a similar feature, which when turned on, made my IMAPD processes die (something like include this folder/account in sync on startup or something like that). That looked like a bug in the server, but never mind. I didn't quite understand the need for connection caching on a single IMAP account. It just opened up to 5 connections for each folder I opened. Well, at least it can be turned off. Nix. Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ:
Re: performance issue (imap spool on san)
My telnet client could do 'ls -lR /' when I log in, and cache it, but it doesn't :-) If your telnet client would need several minutes to show you all files in case you are searching for a file you don't exactly know its name, then you would definitely prefer that it would do so. Best, Daniel Am Donnerstag, 27. Juli 2006 14:45 schrieb Joseph Brennan: --On Thursday, July 27, 2006 2:58 -0700 Nikola Milutinovic [EMAIL PROTECTED] wrote: Say you have a GUI IMAP client XxX. Say you start it up and click on the INBOX. What would you desire/expect XxX to do? First I'd like it not to open inbox unless I do click on inbox (or unless I configured it to open inbox). That's a pop holdover. As if, what else would I be running a mail client for? Well, with imap I might be wanting to check some other folder. When opening inbox, a client is usually configured to list new messages. If so it really needs only to fetch headers of new messages. The rest do not matter unless the user wants to scroll back, and even then it might fetch only the next N messages back. Some clients actually open and cache headers of all subscribed folders. That does not scale on a system where users are advised to subscribe to many shared folders. My telnet client could do 'ls -lR /' when I log in, and cache it, but it doesn't :-) Joseph Brennan Columbia University Information Technology Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: performance issue (imap spool on san)
Hi Michael! Thunderbird is NOT an IMAP client. I don't want to start a flamewar, so I tell you that I write this email with a very polite temper in mind. Just to not set you up. But you have to admit, your saying is extremely provocative. Please can you explain your saying? Pine and Mutt both are console only applications and I think you simply cannot compare them to a graphical client like Thunderbird. An unix-unexperienced user will even simply fail to use them at all, because the text interface is so limited by console possibilities, that it cannot be intuitive in any way. In a graphical client you want to be able to scroll through your whole message list without any delay. So I think there is no other chance but caching all header information of a folder. On low bandwith situations it seems to be impossible for me to do this on demand only. I was searching for a full featured graphical IMAP client for a long time and tried everything and I have to say: Not only is thunderbird an IMAP client, it is the best graphical IMAP client I could find in the whole Linux and Windows world. It has the most complete feature set and the most intuitive interface for both Linux and Windows users. And it is way faster than every IMAP client with a comparable feature set. Kmail is extremely near to my wishes, it only lacks IMAP IDLE support. The first time you open a large IMAP folder is not very fast, I have to admit, but I didn't find any other comparable IMAP client without this problem. Perhaps there are some, but I didn't try them because of the lack of other basic email features. Anyway: I'd happily listen to other suggestions for full featured graphical IMAP clients which could be better than thunderbird. There surely are things in thunderbird which could be a lot better! I just need an alternative which I was not able to find yet. So regarding the performance problem of the original poster: When I'm on my LAN, I can initially open a folder with 6000 mails in it in about 30 seconds. I have a network throughput of about 900 KB/s. So network just isn't the bottleneck. (see below) After Thunderbird has this initial header download done, the folder opens without any delay. It just downloads headers of new emails, so if you don't get thousands of mails between two folder checks, there is no problem at all. I think that your storage backend might get into iowait issues. I had a much worse issue as you are describing. I had that with an extraordinary hardware (Dual Xeon and SCSI RAID-5 direct attached with an 64-bit ICP host raid adapter) but the wrong file system. With ext3 I had incredible iowait whenever a user's client downloaded all headers of a big folder. And after some seconds of high iowait, the machine even freezed up for several (up to 30!) seconds while having a lot harddisk write access. Load in this periods raised up to over 35!! Then with a much smaller temporary machine (single P4 with a SATA Hardware Raid-1 mirror) and reiserfs I had no lockups anymore, but still high iowait when a user downloaded all headers of a big folder and load increases to nearly 20. The download started rather fast but as iowait (and load) increased, it slowed down and all users got slow performance. But luckily the machine did not freeze anymore... Way better than before even though this hardware was a not nearly as good as the one before. Now I switched back to the first hardware platform (SCSI RAID-5) but now running on XFS. Now I have no iowait and performance issues anymore. Load is ridiculous low, most time below 0,1. IOwait is mostly zero and sometimes increases up to 3% and peaks to 5% for only one or two seconds. So I'd say you should check the load and iowait of your mail server when you try to open a big folder with thunderbird. I'd bet both is increasing fast and far until the machine nearly stalls and so you cannot get the whole folder. It's very good that you can prevent the problem with kmail. This shows that Thunderbird really has problems here, but you have to think of normal users. On the user's side there is a lot of Outlook, Outlook Express and Thunderbird which all will trigger the problem. I think it will be better to eliminate this problem instead of working around. You might find yourself in a situation where the server is in high usage by your users and it's very hard to replace and migrate mailboxes without long downtimes. Best, Daniel Michael Loftis schrieb: --On July 26, 2006 12:02:41 PM +0200 Rudy Gevaert [EMAIL PROTECTED] wrote: Hi, I've installed the latest cyrus release and I'm having trouble with large mailboxes. I was going to try if the 4Gig limit is gone and I'm filling up a mailbox with mails. If I open the mailbox trough mutt it gets loaded at a acceptable (lighting fast) speed. However when using thunderbird it gets very slow, I haven't been able to open the mailbox of 294M. This is a thunderbird problem, not a Cyrus problem. Thunderbird is NOT an
Re: performance issue (imap spool on san)
Hi David! All your points are fully correct. But changes nothing to my basic saying: It's plain wrong to say thunderbird is NOT an IMAP client. It might be a very bad IMAP client regarding this one feature, but it IS an IMAP client. It's fully RFC compliant, it does not matter if it uses all IMAP features or not. And for nearly all users, only graphical clients are usable at all. So for nearly all users, Thunderbird is the best availiable IMAP client. Only some very few console based IMAP clients are better in at least one feature: Fetching headers on demand. I just want to have this stated. To be provocative and exaggerating just isn't netiquette and if the said statement is plain wrong, it's really bad and has to be corrected. Even lynx is a web browser, although it cannot do some very basic things everyone expects a web browser to be capable of. So I hope everyone can agree with my statement and this subject can be closed now. Best, Daniel David Lang schrieb: On Wed, 26 Jul 2006, Daniel Eckl wrote: Hi Michael! Thunderbird is NOT an IMAP client. I don't want to start a flamewar, so I tell you that I write this email with a very polite temper in mind. Just to not set you up. But you have to admit, your saying is extremely provocative. Please can you explain your saying? Pine and Mutt both are console only applications and I think you simply cannot compare them to a graphical client like Thunderbird. An unix-unexperienced user will even simply fail to use them at all, because the text interface is so limited by console possibilities, that it cannot be intuitive in any way. In a graphical client you want to be able to scroll through your whole message list without any delay. So I think there is no other chance but caching all header information of a folder. On low bandwith situations it seems to be impossible for me to do this on demand only. it has nothing to do with being graphical or not. the key is how it manages the mail. a 'true' imap client realizes that the server holds all the info and it can query individual pieces as needed (headers, flags, including sorting, searching, threading, etc) a pop3 client that knows some IMAP uses the IMAP commands to fetch the data, but it stores it locally, just like it stores pop3 messages, and all actions (including searching, threading, etc) take place against the local copy of the messages. since pop3 is such a simple protocol many mail clients start with support for it and then add IMAP support by substatuting IMAP commands for the POP3 commands, but otherwise operates exactly the same. This is what Thunderbird does. unfortunantly there isn't a true IMAP client that's graphical available to my knowledge (which is why I still use pine) I was searching for a full featured graphical IMAP client for a long time and tried everything and I have to say: Not only is thunderbird an IMAP client, it is the best graphical IMAP client I could find in the whole Linux and Windows world. It has the most complete feature set and the most intuitive interface for both Linux and Windows users. And it is way faster than every IMAP client with a comparable feature set. Kmail is extremely near to my wishes, it only lacks IMAP IDLE support. there are a lot of IMAP features that it doesn't use, not just IDLE. The first time you open a large IMAP folder is not very fast, I have to admit, but I didn't find any other comparable IMAP client without this problem. Perhaps there are some, but I didn't try them because of the lack of other basic email features. with pine it takes the same time for me to open a folder with 10 messages in it as one with 10,000 messages in it, becouse it doesn't care how many messages are there and only fetches what it needs to, when it needs to. it does take longer to sort or thread a large mailbox, but that's server-side processing, which can be greatly assisted by caches, etc on the server (depending on your IMAP server software) Anyway: I'd happily listen to other suggestions for full featured graphical IMAP clients which could be better than thunderbird. There surely are things in thunderbird which could be a lot better! I just need an alternative which I was not able to find yet. nobody is saying that there's an available graphical IMAP client that's better then thunderbird, they are saying that there isn't a real graphical IMAP client period. all of them that are available, including thunderbird, are not makeing proper use of IMAP, and as a result they all suffer the same performance problems when you open a folder with lots of new messages. So regarding the performance problem of the original poster: When I'm on my LAN, I can initially open a folder with 6000 mails in it in about 30 seconds. I have a network throughput of about 900 KB/s. So network just isn't the bottleneck. (see below) After Thunderbird has this initial header download done
Re: performance issue (imap spool on san)
Hi Sebastian! I just can (and so I will) believe your statements about mulberry, because it's dead and my users and I cannot get or use it legally anywhere. So it has disqualified itself. Sadly, I want to add. I heared a lot good things about this one, and I could imagine that this one could have become my alternative to thunderbird. Best, Daniel Sebastian Hagedorn schrieb: Hi, let me start by saying that I'm basically always on high-speed Internet connections and keep my mailboxes relatively small. So I haven't had bad experiences with Thunderbird in that regard. I still don't use it, but that's not the issue here. -- Daniel Eckl [EMAIL PROTECTED] is rumored to have mumbled on 26. Juli 2006 21:31:40 +0200 regarding Re: performance issue (imap spool on san): In a graphical client you want to be able to scroll through your whole message list without any delay. So I think there is no other chance but caching all header information of a folder. On low bandwith situations it seems to be impossible for me to do this on demand only. Well, you don't know Mulberry then. It has a GUI and is very adaptable to any kind of network situation and it doesn't cache anything! You do have to tweak it, however. It doesn't auto-configure, but there are *many* settings to play around with. Obviously that's both a blessing and a curse. I was searching for a full featured graphical IMAP client for a long time and tried everything and I have to say: Not only is thunderbird an IMAP client, it is the best graphical IMAP client I could find in the whole Linux and Windows world. Unfortunately that's not saying much ... it's just too bad that the only decent IMAP GUI client isn't developed further. I have hopes for Thunderbird 2, but I have a feeling that I will continue to use Mulberry for a long time ... -- Sebastian Hagedorn - RZKR-R1 (Flachbau), Zi. 18, Robert-Koch-Str. 10 Zentrum für angewandte Informatik - Universitätsweiter Service RRZK Universität zu Köln / Cologne University - Tel. +49-221-478-5587 Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: trashed databases after disk full situation
Ah, didn't realize that the output is flat file db. Thank you very much for poining this one out! I'll put info-cyrus on CC for others who might be interested. Thanks, Daniel Adam Stephens schrieb: On Sat, 22 Jul 2006, Daniel Eckl wrote: Thanks! The code looks promising, but how can I use this to recover? I couldn't try yet, but it just seems to output the key-value pairs to stdout, or did I read wrong? What would be the step for recover from a broken skiplist? The output should be a valid DB in 'flat' format. So: skiplist.py corrupted.seen seen.txt cvt_cyrusdb /path/seen.txt flat /path/repaired.seen skiplist cheers, Adam. Adam Stephens Network Specialist - Email DNS [EMAIL PROTECTED] Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: trashed databases after disk full situation
Hi! Recently I switched over to another mail host running the same software (cyrus 2.2.12) and there was one broken seen database, too with a similar error message. I didn't find any possibility to recover this db. I had to delete it, too. I think skiplist is one of the most reliable databases, with berkeley db I always has locking problems like these as you mentioned, slow service startup and a lot of general fuss... But can anyone shed light on how to recover a crashed skiplist file? @Simon I thought about searching the mailing list archives, too, but got major problems: The link below every mail http://asg.web.cmu.edu/cyrus/mailing-list.html just gives 404. The web/http links on http://cyrusimap.web.cmu.edu/lists.html#archives gives 404 either. So there seem to be no archives I know of. Is there an archive mirror anywhere? It's kinda demoralizing to get an RTFM when the manual is gone for good... Thanks, Daniel Rodrigo Ventura schrieb: Hello all, I'm experiencing serious problems whenever there is an accidental disk full situation. I see two kinds of messages in syslog: the first one concerns the seen database, for instance: Jul 21 09:39:54 omni imap[1133]: DBERROR: skiplist recovery /etc/imap/user/m/mflorencio.seen: ADD at 1FB0 exists Jul 21 09:39:54 omni imap[1133]: DBERROR: opening /etc/imap/user/m/mflorencio.seen: cyrusdb error what happens is that all mails become unreadable forever... I have to delete rge seen database. the second one is, for instance: Jul 21 10:47:07 omni lmtpunix[27618]: DBERROR db3: 5 lockers what does it mean? is it possible to be expurious lock files? Please advise. The cyrus version is 2.2.13 configured with ./configure --prefix=/usr/local/cyrus --with-duplicate-db=skiplist --with-sasl=/usr/local/cyrus --without-snmp Can I switch the database backends to more realiable ones? Cheers, Rodrigo Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: trashed databases after disk full situation
Thanks! Interesting way to recover. :) Best, Daniel Simon Matter schrieb: Hi! Recently I switched over to another mail host running the same software (cyrus 2.2.12) and there was one broken seen database, too with a similar error message. I didn't find any possibility to recover this db. I had to delete it, too. % From http://article.gmane.org/gmane.mail.imap.cyrus/18840 We have also seen skiplist corruption in seen databases. I don't have a recovery tool, but I have been able to manually recover seen db's to the point of corruption so that at least most of the users mails are in the correct 'read' state. Typically, you will see errors like: DBERROR: skiplist recovery /usr/local/imap/user/k/kdelaney.seen: 0D2C should be ADD or DELETE If you truncate the file at this point, it should fix the problem, and the users mail read state will be valid upto the point of corruption. To do this, convert the hex to decimal (above would be 1372) and use the dd command: dd if=kdelaney.seen of=kdelaney.seen.fixed bs=1 count=1372 replace the corrupted .seen file with the fixed one and have user log in and should be ok. Seems to work on the couple I have tried it on. % I think skiplist is one of the most reliable databases, with berkeley db I always has locking problems like these as you mentioned, slow service startup and a lot of general fuss... But can anyone shed light on how to recover a crashed skiplist file? @Simon I thought about searching the mailing list archives, too, but got major problems: The link below every mail http://asg.web.cmu.edu/cyrus/mailing-list.html just gives 404. The web/http links on http://cyrusimap.web.cmu.edu/lists.html#archives gives 404 either. So there seem to be no archives I know of. Is there an archive mirror anywhere? It's kinda demoralizing to get an RTFM when the manual is gone for good... Make it google and RTFM :) http://lists.andrew.cmu.edu/pipermail/info-cyrus/ Cheers, Simon Thanks, Daniel Rodrigo Ventura schrieb: Hello all, I'm experiencing serious problems whenever there is an accidental disk full situation. I see two kinds of messages in syslog: the first one concerns the seen database, for instance: Jul 21 09:39:54 omni imap[1133]: DBERROR: skiplist recovery /etc/imap/user/m/mflorencio.seen: ADD at 1FB0 exists Jul 21 09:39:54 omni imap[1133]: DBERROR: opening /etc/imap/user/m/mflorencio.seen: cyrusdb error what happens is that all mails become unreadable forever... I have to delete rge seen database. the second one is, for instance: Jul 21 10:47:07 omni lmtpunix[27618]: DBERROR db3: 5 lockers what does it mean? is it possible to be expurious lock files? Please advise. The cyrus version is 2.2.13 configured with ./configure --prefix=/usr/local/cyrus --with-duplicate-db=skiplist --with-sasl=/usr/local/cyrus --without-snmp Can I switch the database backends to more realiable ones? Cheers, Rodrigo Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: trashed databases after disk full situation
Thanks! The code looks promising, but how can I use this to recover? I couldn't try yet, but it just seems to output the key-value pairs to stdout, or did I read wrong? What would be the step for recover from a broken skiplist? Thanks, Daniel Adam Stephens schrieb: On Fri, 21 Jul 2006, Wesley Craig wrote: The skiplist recovery question is frequently asked: http://www.google.com/search?q=%22skiplist+recovery%22+site%3Acmu.edu+dd and answered. While converting hex to decimal and dd are easy, having a tool included would be nice. I have had some success fixing seen databases with this: http://oss.netfarm.it/download/skiplist.py it's not my tool, though; I don't know much about it other than what you can see in the code. It converts broken skiplist files into flat files. cheers, Adam. Adam Stephens Network Specialist - Email DNS [EMAIL PROTECTED] Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Mailstore filesystem
I had this setup with ext3 before and I had severe problems with extreme load through high iowait and the system hangs for up to 20 seconds while the filesystem flushed unwritten data to disk. This was on a SCSI hardware RAID 5. At the moment I have a temporary machine running the same system with reiserfs. While I still have the problem of occasional high load, the system now never freezes or hangs, just slowes down. (I had questioned that on the mailing list twice, but didn't get any answer at all) The temp machine has a SATA hardware RAID-1 I think this is because reiserfs is better handling a lot of small files, while ext3 performes better with a few big files. Second advantage from reiserfs is that I don't need to wait for a filesystem scan when I made a kernel update. I now want to switch bak to the original machine with SCSI Raid-5 and I think I will choose XFS this time. It should have all the advantages which reiserfs has, too. I would be very glad to hear the comments from the list on this subject. Best, Daniel Søren Schimkat schrieb: Hi guys I'm about to migrate from Solaris with Sendmail / uw to Redhat Enterprise Linux with Postfix / Cyrus. Everything seems to work just fine, but one unsolved question remains: Which filesystem should I choose? I really would like to use ext3 .. because it's works great and seems rock solid, but i'm scareed shitless of inode starvation. Any thoughts on that one? Which filesystem would you recomend? Regards Søren Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Mailstore filesystem
At this time I didn't change the scheduler. In fact, I actually learned about it a few days ago... So it was SuSE 9.3 default (might be vanilla default, don't know) What would you recommend for cyrus? (or for ext3 running cyrus)? And are there prefered scheduler for other fs, too, especially reiser and xfs? Thanks, Daniel Wes Craig schrieb: On Jul 3, 2006, at 9:44 AM, Daniel Eckl wrote: I had this setup with ext3 before and I had severe problems with extreme load through high iowait and the system hangs for up to 20 seconds while the filesystem flushed unwritten data to disk. This was on a SCSI hardware RAID 5. Which IO scheduler were you using? :wes Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Mailstore filesystem
Well, I was surprised about the problem... I have only about 250 mailboxes on that server. But it's used extensively, because some users have over 200 folders and an incredible mail count (mailboxes over 2 GB of size). I assume, my problem comes from Outlooks scanning all headers of a big folder, because the load and IO increase comes with a lot of disk activity (high bi/bo in vmstat). But it has to be only one or two clients, because in the main usage time there is mostly no problem and disk io is moderate to low... I cannot identify the triggering client and/or the action it starts Thanks for your suggestions, I will try if that makes a difference and report to the list for the archives! Thanks, Daniel Wesley Craig schrieb: On 03 Jul 2006, at 11:35, Daniel Eckl wrote: At this time I didn't change the scheduler. In fact, I actually learned about it a few days ago... So it was SuSE 9.3 default (might be vanilla default, don't know) I think anticipatory is the default IO scheduler for SuSE 9.3 (from Google). What would you recommend for cyrus? (or for ext3 running cyrus)? And are there prefered scheduler for other fs, too, especially reiser and xfs? It would probably depend on your setup. Given the problem you describe, tho, I would think that deadline would improve your performance. The 2.6 kernel has many tunable parameters. If you're pushing a server at all near its limits, you probably need to become an expert in performance tuning. Or buy more hardware :) :wes Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Quota Report Script
Hi David! I attached my script. I run it with cron as user cyrus every day at 5 a.m. Every user which is over the quota warning level will get a warning mail. And for every user which gets a mail, the script prints out username and quota to stdout, so cron will send a mail to the cyrus user. You have to route the mails to cyrus user to you and you are fine. Hope that helps or at least I hope that gives you some ideas. Best, Daniel David E. Meier schrieb: Hello List, before I start reinventing the wheel I wonder if someone has already a script that reports all user quotas. Thanks, Dave. Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html quota_watchdog.sh Description: application/shellscript Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Quota Report Script
I got a notice, that the attachment has been blocked. But I got my own mail from the list including the attachment... So I just make the offer that I will sent this script to everyone interested. Just contact me. Sorry and thanks, Daniel Daniel Eckl schrieb: Hi David! I attached my script. I run it with cron as user cyrus every day at 5 a.m. Every user which is over the quota warning level will get a warning mail. And for every user which gets a mail, the script prints out username and quota to stdout, so cron will send a mail to the cyrus user. You have to route the mails to cyrus user to you and you are fine. Hope that helps or at least I hope that gives you some ideas. Best, Daniel David E. Meier schrieb: Hello List, before I start reinventing the wheel I wonder if someone has already a script that reports all user quotas. Thanks, Dave. Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
cyrus.cache not working for me?
Dear list members, when I connect a new IMAP client to my mailbox, it logically fetches all headers of a folder I open. My problem is, that this initial header fetch takes very long in my opinion (nearly 10 minutes for about 6000 mails) and while the client is fetching, there is a lot of disk activity, iowait goes up to 90-98% and load goes up to sometimes 10-15(!) depending if the server is under more normal usage load or idling. I thought, that the file cyrus.cache keeps all headers of mails there were already fetched by a client. So when I have that mailbox in another client (e.g. at work and now want to connect from home), then cyrus imapd should just take the header informations requested from the client out of the cyrus.cache file and everything should be fast and smooth... So is my cyrus.cache broken in all my folders? Is the function broken which should use this file? Or is there a limit, so cyrus.cache only holds the e.g. 300 last fetched message headers? I really need help here. I have a lot of mailboxes with a lot of mails in some folders and Outlook seems to fetch all headers again from time to time and I get an overlaoded server once or twice a day... Thank you very much for any hint or help! Best regards, Daniel Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: How to backup cyrus-imapd without stopping service
Uuuuhh *run and hide* http://asg.web.cmu.edu/cyrus/imapd/install-FAQ.html#nfs ;) Best, Daniel Seiichirou Hiraoka schrieb am 23.06.2006 14:35: Hi, I'm using Cyrus-IMAPD 2.2.10 on two solaris9 hosts - One is main and another is backup - and using rsync (*1) to sync two host's /var/imap every day. Two host mount (share) /var/spool/imap via NFS. (*1) run as following on backup /opt/sfw/bin/rsync -a --delete --rsync-path=/opt/sfw/bin/rsync main:/var/imap/ /var/imap/ Usualy, only main host's imapd is running and backup host's imapd is not running. I run imapd on backup manually in case I want to use by test. The composition is following. main backup +-++-+ | Local Disk || Local Disk | | /var/imap || /var/imap | +-++-+ | NFS | NFS ++ |NFS Server /var/spool/imap | ++ Well, I have a trouble and question. Yesterday, I want to test on backup so I run imapd. Then, error message output continues to /var/log/imapd.log as following. - Jun 22 22:01:12 solomon2 ctl_cyrusdb[25123]: [ID 854764 local6.error] DBERROR: error listing log files: No such file or directory - Jun 22 22:01:12 solomon2 ctl_cyrusdb[25123]: [ID 686478 local6.error] DBERROR: archive /var/imap/db: cyrusdb error I think the reason, the file in /var/imap/ is broken because of rsync timing of execution. So I want to know the better (or recommend) way to backup Cyrus-IMAPD /var/imap files to other host without stop service. Please tell me how to achieve it. Best regards, - flathill Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Looking for a *good* X based GUI IMAP client for Cyrus IMAP ...
Well there is a special IMAP command for making use of SQUAT. It's IMAP SEARCH. In this case the server searches for mail and by doing that, it makes extensive use of the SQUAT index if availiable. If a client doesn't make use of IMAP SEARCH, but rather download all mail bodys to search locally, then of course you make no use of your server side SQUAT index. But I really cannot imagine that TB should do that this way and only on Win32... Best, Daniel Chris Hilts schrieb am 13.06.2006 23:16: Greg A. Woods wrote: The report about Thunderbird on Windoze not using the squat index is interesting though I think that's a flawed report. It's my understanding that the SQUAT index is used behind the scenes, automatically, by Cyrus if it is available. There's no special IMAP request for a SQUAT search, so there's no reason Cyrus has any idea that it's Thunderbird and not SquirrelMail or Evolution doing the search. Probably the user sitting in front of the keyboard going gee, this search is slow. -- Chris Hilts [EMAIL PROTECTED] Say it with flowers -- Send them a triffid! Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: deliver.db
Hi! That's the duplicate delivery database. http://cyrusimap.web.cmu.edu/twiki/bin/view/Cyrus/DuplicateDeliveryExplained Best, Daniel Sujit Choudhury schrieb am 14.06.2006 11:01: We recently had some problem with deliver.db which stopped e-mail being delivered and stopped lmptd. I would like to know what is the function of deliver.db. Many thanks Sujit Choudhury University of Westminster Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Win Thunderbird doesn't use SQUAT index
Are you sure? I think that shouldn't be possible because of the same codebase Could you use wireshark (=ethereal) to trace this query? Best, Daniel Ole Hoppe schrieb: Hello, after setting up Cyrus 2.2.12/Postfix 2.2.5/Fetchmail 6.2.5.2 http://6.2.5.2 on a SUSE Linux 10.0 box, and activating squatter to create full-text search index in cyrus.conf, index has been created and one can search now about 2GB of mail within seconds - fantastic! Unfortunately this only works with Thunderbird 1.5.0.4 http://1.5.0.4 from Linux client, trying the same from Windows XP SP2 client (also TB 1.5.0.4 http://1.5.0.4) search takes ages and SQUAT index is obviously not used. Any hint for making Win TB use SQUAT index would be greatly appreciated! Kindly, Ole Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Looking for a *good* X based GUI IMAP client for Cyrus IMAP ...
Daniel O'Connor schrieb: On Sunday 11 June 2006 03:30, Marc G. Fournier wrote: growing tired of pine after many years, am trying to find a good client ... just installed balsa, but for the life of me, I can't get it to display all of my 'sub-folders', only my INBOX ... So, is there a *good* GUI client that ppl are more commonly using? It has to work under FreeBSD ... The least sucky email client I have tried so far is KMail. Yes, that's my opinion, too. I just use thunderbird, because of it's IMAP IDLE support. That's the only feature I miss in kmail. Best, Daniel Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Sieve script question
Would you like to explain the problem and your solution for the archives? Thank you! Best, Daniel Lars Schimmer schrieb am 01.06.2006 10:31: Kjetil Torgrim Homme wrote: On Tue, 2006-05-30 at 14:48 +0200, Lars Schimmer wrote: But if the person bonsai send a email to all, this email get sorted into the ALL folder AND into the bonsai folder. Doesn't the stop rule stop the execution of the script for this email? yes, stop stops execution of the script. How can I change the script for a email to be sort in only one folder? the problem must be elsewhere. double check which script is activated, what other rules may match, etc. Ok, it works now. It was really another problem ;-) Thx so far. MfG, Lars Schimmer -- - TU Graz, Institut für ComputerGraphik WissensVisualisierung Tel: +43 316 873-5405 E-Mail: [EMAIL PROTECTED] Fax: +43 316 873-5402 PGP-Key-ID: 0x4A9B1723 Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: strange delays in connecting to POP3 server
Hi Igor! Sounds to me like a DNS timeout issue. You might want to check your resolver configuration. I don't understand the sentence This delays appears accidentally, without any system.. I hope this doesn't render my answer useless. :) Best, Daniel Igor Belikov schrieb am 30.05.2006 09:51: Hello info-cyrus, I'm migrate mail server to new hardware under new OS. Migration was from cyrus 2.2.12 + sasl 2.1.20 under SuSE Linux v9.1 (kernel 2.6.15.4-smp) to cyrus 2.3.3 + sasl 2.1.21 under SuSE Linux 10.0 OSS (original kernel from SuSE). In both cases cyrus compiled from sources, in both cases was applied two patches (patch that allow to store crypted passwords and patch that allow 8bit headers). In new installation our clients notice large delays during connection to POP3 server. This delays appears accidentally, without any system. Are anybody can help me deal with this problem? Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
No IMAP IDLE event for decreasing RECENT mail count?
Hi! I am running cyrus v2.2.12 on SuSE 10.0 with IMAP IDLE extension. Generally this works great, when new messages arrive (RECENT count increases) or when messages get expunged, IMAP IDLE correctly notifies the client. But sadly, IMAP IDLE does not notify the client if RECENT count decreases. Background is that I want to use an IDLE aware mail checker (mail-notification, http://www.nongnu.org/mailnotify/). If this biff tool sees new messages, it notifies correctly. But when I check mails with my thunderbird, mail-notification is not being notified by IMAP IDLE that now there are no recent mails anymore. Only if a new mail arrives or if I delete a mail from the watched mailbox, the client get's a notification from IMAP IDLE and updates to the correct RECENT mail count. The only other IMAP server (well, more or less *g*) where I could test that, is dovecot. If a second client selects a mailbox which is watched by another idling client, Dovecot notified the idling client with: * 1 FETCH (FLAGS (\Seen \Recent)) The client then breaks idling and updates the status and everything works fine. I couldn't find anything how to achieve this in cyrus. Does anyone has hints for me? Thanks, Daniel Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
