Re: Data format error: : Mailbox doesn't exist
Casper wrote: Sebastian Haas wrote: Hello list, I have a very strange problem using Postfix and Cyrus together. If I send an mail with more then one local recipient, Cyrus fails to deliver the mail, only the first recipient will get the mail. Postfix generates a bounce message. This is the returned message (looks similar to the logs): [EMAIL PROTECTED]: data format error. Command output: : Mailbox does not exist [EMAIL PROTECTED]: data format error. Command output: : Mailbox does not exist Log output: Nov 9 08:01:44 mailserver postfix/pipe[10522]: D1EA8BCCE: to=[EMAIL PROTECTED], relay=cyrus, delay=1, status=bounced (data format error. Command output: : Mailbox does not exist ) Nov 9 08:01:44 mailserver postfix/pipe[10522]: D1EA8BCCE: to=[EMAIL PROTECTED], relay=cyrus, delay=1, status=bounced (data format error. Command output: : Mailbox does not exist ) If I send the mail itemized it is delivered right to each recipient. Postfix delivers message to Cyrus via a Unix type socket to lmtpd. My Cyrus version: v2.1.18-IPv6-Debian-2.1.18-1 The box runs on Linux Kernel 2.6.4 What could be the problem? Did you need any additional information? This problem looks like you have created the mailbox but NOT the mailbox/INBOX. cm [EMAIL PROTECTED] creates the mailbox cm [EMAIL PROTECTED] creates the mailbox INBOX Alternative for the above cm user/[EMAIL PROTECTED] cm user/olle/[EMAIL PROTECTED] That is right there is no seperated INBOX mailbox, but why does it work if I send the mail to each recipient seperatley? Is it needed to add the domain at the end of the command? I don't do that. -- Mit freundlichen Gruessen/Best Regards, Sebastian Haas Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Set quota
On Tue, 2005-11-08 at 16:58 +0100, Alexander Dalloz wrote: Am Di, den 08.11.2005 schrieb Craig White um 14:38: I haven't a clue what features are included in FC-3 - that is why I suggested checking out the README to see if feature was included. Myself, I use RHEL CentOS for servers (never Fedora) and never use RHEL/CentOS cyrus-imapd because of the tremendous autocreate packages in Simon's RPM's (thanks Simon btw) I actually created an RFE in bugzilla.redhat.com to incorporate either more of the autocreate stuff or use Simon's RPM's and it was tossed into the next release category which is what I presumed never happened category (e.g. RH's laggard adoption of openldap advances). Craig There is no need for an RFE. The Fedora Core / Fedora Extras (FC4) packages of Cyrus-IMAPd are based (~99%) on Simon's great work and include the autocreate patches already. They, the patches, are just not that up to date as those Simon's latest RPM incorporate. Yes, it was clear that the RHEL/Fedora cyrus-imapd were taken from invoca-ch (Simon) but they weren't the same as that which you can download and build from Simon's web site. I think I did the RFE on FC-3 which was long before FC-4 and RHEL-4 came out and specifically wanted autosieve and some of the others and I know they weren't included in RHEL-4 version. I don't use Fedora for servers (CentOS or RHEL) so I wouldn't know where they are on the FC-4 cyrus- imapd but my guess is that they didn't change. So I have given up on RHEL cyrus-imapd packages and just use Simon's and the autocreate stuff is great - excepting of course, what Aleksandar's (note not Alexander Dalloz) admonition that when I had an issue with ldap lookups of aliases, it created a new mailbox when it should have aliased to a real account...it is fragile and you have to watch out. The autosieve and the autosubscribe features in Simon's packages are worth straying from RHEL/Fedora packages. As for OP - I don't recall if autocreatequota is part of Fedora's packages, which is why I recommended checking the readme. The nasty thing about directives in imapd.conf is that they seem to be silently ignored if not applicable so there's no log created if the feature is requested in imapd.conf but not part of package. At least with my packages and those derived from them, you can determine most build options. Just check /usr/share/doc/cyrus-imapd-[version]/README.buildoptions. Of course it doesn't tell you exactly which versions of patches have been applied. Regards, Simon Craig Craig -- This message has been scanned for viruses and dangerous content by MailScanner, and is believed to be clean. Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
I/O Errors
Hello all, Since I upgraded Cyrus-imap to v2.2.12, I'm experiencing a lot of I/O errors, due to the number of open files. Here is a short exceprt of what I can read in imapd.log : [...] Nov 8 16:15:53 mailup pop3[281152]: IOERROR: opening /var/spool/imap/user/lafitte/cyrus.index: Too many open files Nov 8 16:15:53 mailup pop3[281152]: Unable to lock maildrop for lafitte: System I/O error [...] Nov 8 16:41:40 mailup imap[267212]: IOERROR: opening /var/spool/imap/user/debast/Trash/cyrus.cache: Too many open files [...] Nov 8 16:41:56 mailup imap[267212]: IOERROR: opening /var/imap/user/d/debast.seen: Too many open files Nov 8 16:41:56 mailup imap[267212]: DBERROR: error fetching txn cyrusdb error Nov 8 16:41:56 mailup imap[267212]: Could not open seen state for debast (System I/O error) Nov 8 16:41:56 mailup imap[267212]: IOERROR: creating /var/spool/imap/user/debast/cyrus.index.NEW: Too many open files [...] Nov 8 16:42:20 mailup imap[267212]: IOERROR: opening /var/spool/imap/user/waguet/cyrus.index: Too many open files [...] I've got about one such error in every minute, and all goes ok for the rest of the time. I checked about my system settings. It does not seem to be a problem of a global max number of open files as no other process reports such errors. It appears I may tune a maximum number of open files authorized per process, but before tweaking that, which appears uneasy to me, I was wondering whether there may be an error in my configuration. I have got about 1000 concurrent users, on a total of 2000 users. I had no such problems before upgrading. I kept the same configuration except that I changed from BerkeleyDB to skiplist for all databases (except for seendb which still uses flat) Has anyone already encountered that ? Any idea ? Any hint would be greatly appreciated Thank you very much in advance Pascal Mouret -- Pascal Mouret DSII - Direction du Système d'Information et de l'Informatique Université de Provence - 3, place Victor Hugo - 13331 Marseille cedex 3 Tél: 04 91 10 64 02E-mail: [EMAIL PROTECTED] Fax: 04 91 08 35 00 ou [EMAIL PROTECTED] (Ligne d'assistance (interne) : 04 91 10 85 55 / 04 42 95 34 54) Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Non interactive SIEVE filters installation
I'm setting a new email server, with cyrus IMAP and SIEVE. I will add in bulk a few hundred mail accounts. I've managed to modify a PERL script that creates the accounts and needed folders to my needs. Now I'm in need to also create in bulk the sieve filters for clasiffing SPAM and mails suspected to have viruses. As far as I've found sieve filters must be set for each user, by the USer. I want to install an initial filter as the system manager for each user or a sort of global filter. Any help will be appreciated. Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Data format error: : Mailbox doesn't exist
It looks like you are using my Debian packages, no? Please read the docs in /usr/share/doc/cyrus21-common/, they explain everything. I'd guess that your postfix cyrus transport is that broken crap using the pipe transport and the deliver/cyrdeliver script that comes in /etc/postfix/master.cf by default? If it is, switch to direct lmtp delivery from postfix to Cyrus. If you still can't get it to work, file a bug in the Debian BTS (use the reportbug package and reportbug command). Make sure to include the full postfix configuration (master.cf and main.cf), because there is where the problem is. -- One disk to rule them all, One disk to find them. One disk to bring them all and in the darkness grind them. In the Land of Redmond where the shadows lie. -- The Silicon Valley Tarot Henrique Holschuh Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Data format error: : Mailbox doesn't exist
Henrique de Moraes Holschuh wrote: It looks like you are using my Debian packages, no? Please read the docs in /usr/share/doc/cyrus21-common/, they explain everything. I'd guess that your postfix cyrus transport is that broken crap using the pipe transport and the deliver/cyrdeliver script that comes in /etc/postfix/master.cf by default? If it is, switch to direct lmtp delivery from postfix to Cyrus. If you still can't get it to work, file a bug in the Debian BTS (use the reportbug package and reportbug command). Make sure to include the full postfix configuration (master.cf and main.cf), because there is where the problem is. Thanks, that fixed my problem. -- Mit freundlichen Gruessen/Best Regards, Sebastian Haas Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: improving concurrency/performance (fwd)
This guy is having a problem with cyrus-imap and ext3 - when multiple processes are attempting to write to the one filesystem (but not the one file), performance drops to next to nothing when only five processes are writing. An strace shows most of the time is being spent in fdatasync and fsync. Actually, the thread just got off topic quickly -- I'm running this on reiserfs, not ext3. ...And I've got it mounted with data=writeback, too. But thanks for the info, Andrew. John -- John Madden UNIX Systems Engineer Ivy Tech Community College of Indiana [EMAIL PROTECTED] Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Non interactive SIEVE filters installation
Andres tarallo [EMAIL PROTECTED] wrote: Now I'm in need to also create in bulk the sieve filters for clasiffing SPAM and mails suspected to have viruses. As far as I've found sieve filters must be set for each user, by the USer. I want to install an initial filter as the system manager for each user or a sort of global filter. If you use sendmail, a milter is a good way to apply systemwide rules like rejecting or tagging. Rejecting in particular is done much more efficiently at the MTA stage. Joseph Brennan Columbia University Information Technology Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Munge8bit option for .spec file
Hello All, I've attached .spec file of my cyrus-imapd on SLES9. Could someone tell me whatto change there so I can build it with "munge8bit option"? Best Regards, Leon Kolchinsky cyrus-imapd.spec Description: cyrus-imapd.spec Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: improving concurrency/performance
Quoting John Madden [EMAIL PROTECTED]: The disks are quite fast. bonnie++, for example, shows writes at over 300MB/s. What I'm finding though is that the processes aren't ever pegging them out -- nothing ever goes into iowait. The bottleneck is elsewhere... John This might seem dumb, but are there any issues with name resolution? Could DNS queries be slowing things down? David Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Non interactive SIEVE filters installation
On Wed, 2005-11-09 at 10:04 -0300, Andres tarallo wrote: I'm setting a new email server, with cyrus IMAP and SIEVE. I will add in bulk a few hundred mail accounts. I've managed to modify a PERL script that creates the accounts and needed folders to my needs. Now I'm in need to also create in bulk the sieve filters for clasiffing SPAM and mails suspected to have viruses. As far as I've found sieve filters must be set for each user, by the USer. I want to install an initial filter as the system manager for each user or a sort of global filter. Any help will be appreciated. - depending upon which version of cyrus-imapd and which 'auto' features are included, it can be simple... http://email.uoa.gr/projects/cyrus/ with autocreatesieve features, a pre-existing sieve file or sieve.bc file can be incorporated by a user upon mailbox creation. Craig -- This message has been scanned for viruses and dangerous content by MailScanner, and is believed to be clean. Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: improving concurrency/performance
This might seem dumb, but are there any issues with name resolution? Could DNS queries be slowing things down? Nah, it's a good thought, but this is with an already-established session running from localhost. Based on the strace, I can guess that this is definitely something disk-based and that I'm just going to have to deal with it from that angle. John -- John Madden UNIX Systems Engineer Ivy Tech Community College of Indiana [EMAIL PROTECTED] Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: I/O Errors
On Wed, 9 Nov 2005, Pascal Mouret wrote: Hello all, Since I upgraded Cyrus-imap to v2.2.12, I'm experiencing a lot of I/O errors, due to the number of open files. Here is a short exceprt of what I can read in imapd.log : [...] Nov 8 16:15:53 mailup pop3[281152]: IOERROR: opening /var/spool/imap/user/lafitte/cyrus.index: Too many open files Nov 8 16:15:53 mailup pop3[281152]: Unable to lock maildrop for lafitte: System I/O error [...] Nov 8 16:41:40 mailup imap[267212]: IOERROR: opening /var/spool/imap/user/debast/Trash/cyrus.cache: Too many open files [...] Nov 8 16:41:56 mailup imap[267212]: IOERROR: opening /var/imap/user/d/debast.seen: Too many open files Nov 8 16:41:56 mailup imap[267212]: DBERROR: error fetching txn cyrusdb error Nov 8 16:41:56 mailup imap[267212]: Could not open seen state for debast (System I/O error) Nov 8 16:41:56 mailup imap[267212]: IOERROR: creating /var/spool/imap/user/debast/cyrus.index.NEW: Too many open files [...] Nov 8 16:42:20 mailup imap[267212]: IOERROR: opening /var/spool/imap/user/waguet/cyrus.index: Too many open files [...] I've got about one such error in every minute, and all goes ok for the rest of the time. I checked about my system settings. It does not seem to be a problem of a global max number of open files as no other process reports such errors. It appears I may tune a maximum number of open files authorized per process, but before tweaking that, which appears uneasy to me, I was wondering whether there may be an error in my configuration. I have got about 1000 concurrent users, on a total of 2000 users. I had no such problems before upgrading. I kept the same configuration except that I changed from BerkeleyDB to skiplist for all databases (except for seendb which still uses flat) Has anyone already encountered that ? Any idea ? Any hint would be greatly appreciated Thank you very much in advance Pascal Mouret I crank up the resource limits for cyrus in the init script for it, as follows: # Crank up the file limits ulimit -n 209702 ulimit -u 2048 Obviously, I've already increased the system-wide limit to accomodate this. My system has about half the number of concurrent users as yours. Here is what I see for open file usage: cyrus-be1:/proc/sys/fs# cat file-nr 19560 0 205988 My limit of overkill probably, but I'd rather play it safe. Andy Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: improving concurrency/performance (fwd)
John Madden wrote: This guy is having a problem with cyrus-imap and ext3 - when multiple processes are attempting to write to the one filesystem (but not the one file), performance drops to next to nothing when only five processes are writing. An strace shows most of the time is being spent in fdatasync and fsync. Actually, the thread just got off topic quickly -- I'm running this on reiserfs, not ext3. ...And I've got it mounted with data=writeback, too. But thanks for the info, Andrew. John I'll bet that the fakesync preload library will make diference for you. -- Sergio Bruder Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Frequent DBERROR DB4
Hello: We have a Cyrus IMAPD server version 2.1.12 running on a RH 8 server. All is working find up until last week, now we are getting increasing errors as follows: Nov 7 22:36:33 antar lmtpd[1057]: DBERROR db4: 50 lockers The number before lockers keeps going higher and higher until eventually the server stops receiving pop and imap connections. After a restart of the server, it starts over again. My question is, how can I stop these, and why after a reboot does it reset down to 1 again? I have read a bit in the archives and it seems that this has something to do with Berkley DB and that updating to newest version of Cyrus should fix this, is this correct? If so, what are the necessary steps to install the latest version, preserving the existing system, users, messages, etc. In addition, previous version was not installed with the RPM, can you let me know where to find the RPM for RH8? Any light you can shed is appreciated. Regards, Steve -- ShipMail Now 30% Faster Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
RE: Frequent DBERROR DB4
Hello: But, can these cause the server to eventually stop responding? POP and IMAP connections are no longer possible, and after a restart it comes back. So the next question is, should I consider an upgrade, and if so, what steps should I consider? What should I backup prior to installing? Am I able to use the rpm? Thanks, Steve -Original Message- From: Marcelo H. Terres [mailto:[EMAIL PROTECTED] Sent: Wednesday, November 09, 2005 2:25 PM To: Stephen Conway Subject: Re: Frequent DBERROR DB4 http://asg.web.cmu.edu/cyrus/download/imapd/faq.html Q: I'm getting messages in imapd.log like: Sep 11 17:23:55 ogg lmtpd[773]: DBERROR db3: 16 lockers Sep 11 17:23:55 ogg lmtpd[1409]: DBERROR db3: 17 lockers Sep 11 17:23:56 ogg lmtpd[1508]: DBERROR db3: 9 lockers Sep 11 17:23:56 ogg lmtpd[776]: DBERROR db3: 9 lockers What's wrong? A: Nothing is wrong. These messages are logged whenever Berkeley db encounters lock contention, but isn't necessarily a problem by themselves. This is especially likely when you have an empty or small duplicate delivery database and are receiving a large volume of e-mail. Berkeley db 4.0 has a bug where the number of lockers isn't decremented properly, causing this number to be unreliable. [] 2005/11/9, Stephen Conway [EMAIL PROTECTED]: Hello: We have a Cyrus IMAPD server version 2.1.12 running on a RH 8 server. All is working find up until last week, now we are getting increasing errors as follows: Nov 7 22:36:33 antar lmtpd[1057]: DBERROR db4: 50 lockers The number before lockers keeps going higher and higher until eventually the server stops receiving pop and imap connections. After a restart of the server, it starts over again. My question is, how can I stop these, and why after a reboot does it reset down to 1 again? I have read a bit in the archives and it seems that this has something to do with Berkley DB and that updating to newest version of Cyrus should fix this, is this correct? If so, what are the necessary steps to install the latest version, preserving the existing system, users, messages, etc. In addition, previous version was not installed with the RPM, can you let me know where to find the RPM for RH8? Any light you can shed is appreciated. Regards, Steve -- ShipMail Now 30% Faster Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html -- Marcelo H. Terres [EMAIL PROTECTED] -- ShipMail Now 30% Faster Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
RE: Frequent DBERROR DB4
On Wed, 9 Nov 2005, Stephen Conway wrote: Hello: But, can these cause the server to eventually stop responding? POP and IMAP Not unless the locker number continues to grow. connections are no longer possible, and after a restart it comes back. So the next question is, should I consider an upgrade, and if so, what steps should I consider? What should I backup prior to installing? Am I able to use the rpm? Upgrade cyrus will fix your problem. -Igor Thanks, Steve -Original Message- From: Marcelo H. Terres [mailto:[EMAIL PROTECTED] Sent: Wednesday, November 09, 2005 2:25 PM To: Stephen Conway Subject: Re: Frequent DBERROR DB4 http://asg.web.cmu.edu/cyrus/download/imapd/faq.html Q: I'm getting messages in imapd.log like: Sep 11 17:23:55 ogg lmtpd[773]: DBERROR db3: 16 lockers Sep 11 17:23:55 ogg lmtpd[1409]: DBERROR db3: 17 lockers Sep 11 17:23:56 ogg lmtpd[1508]: DBERROR db3: 9 lockers Sep 11 17:23:56 ogg lmtpd[776]: DBERROR db3: 9 lockers What's wrong? A: Nothing is wrong. These messages are logged whenever Berkeley db encounters lock contention, but isn't necessarily a problem by themselves. This is especially likely when you have an empty or small duplicate delivery database and are receiving a large volume of e-mail. Berkeley db 4.0 has a bug where the number of lockers isn't decremented properly, causing this number to be unreliable. [] 2005/11/9, Stephen Conway [EMAIL PROTECTED]: Hello: We have a Cyrus IMAPD server version 2.1.12 running on a RH 8 server. All is working find up until last week, now we are getting increasing errors as follows: Nov 7 22:36:33 antar lmtpd[1057]: DBERROR db4: 50 lockers The number before lockers keeps going higher and higher until eventually the server stops receiving pop and imap connections. After a restart of the server, it starts over again. My question is, how can I stop these, and why after a reboot does it reset down to 1 again? I have read a bit in the archives and it seems that this has something to do with Berkley DB and that updating to newest version of Cyrus should fix this, is this correct? If so, what are the necessary steps to install the latest version, preserving the existing system, users, messages, etc. In addition, previous version was not installed with the RPM, can you let me know where to find the RPM for RH8? Any light you can shed is appreciated. Regards, Steve -- ShipMail Now 30% Faster Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html -- Marcelo H. Terres [EMAIL PROTECTED] -- Igor Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Set quota
Am Mi, den 09.11.2005 schrieb Simon Matter um 9:11: At least with my packages and those derived from them, you can determine most build options. Just check /usr/share/doc/cyrus-imapd-[version]/README.buildoptions. Of course it doesn't tell you exactly which versions of patches have been applied. Regards, Simon For Fedora Cyrus-IMAPd packages the CVS public readable (Core and Extras). For example to easily read the .spec file and checking which patches are applied: http://cvs.fedora.redhat.com/viewcvs/rpms/cyrus-imapd/FC-4/cyrus-imapd.spec?root=extrasrev=1.5view=markup The CVS directory above contains the patch files. Alexander -- Alexander Dalloz | Enger, Germany | GPG http://pgp.mit.edu 0xB366A773 legal statement: http://www.uni-x.org/legal.html Fedora Core 2 GNU/Linux on Athlon with kernel 2.6.11-1.35_FC2smp Serendipity 21:32:16 up 11 days, 19:32, load average: 0.48, 0.41, 0.31 signature.asc Description: Dies ist ein digital signierter Nachrichtenteil Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
RE: Frequent DBERROR DB4
Hello Igor: The locker number does indeed continue to grow, in the 500s one time even into the 1000s. My next problem is this, I have it installed 2.1.12 from the tar source, what steps should I take to install the new version? Should I download the source, or is it possible for me to use the rpm on RH8? I saw the readme from the rpms and it said not to install it if you have previously tried to install from source. What should I backup prior to trying to install either the source or the rpm? Thanks, Steve -Original Message- From: Igor Brezac [mailto:[EMAIL PROTECTED] Sent: Wednesday, November 09, 2005 3:25 PM To: Stephen Conway Cc: info-cyrus@lists.andrew.cmu.edu Subject: RE: Frequent DBERROR DB4 On Wed, 9 Nov 2005, Stephen Conway wrote: Hello: But, can these cause the server to eventually stop responding? POP and IMAP Not unless the locker number continues to grow. connections are no longer possible, and after a restart it comes back. So the next question is, should I consider an upgrade, and if so, what steps should I consider? What should I backup prior to installing? Am I able to use the rpm? Upgrade cyrus will fix your problem. -Igor Thanks, Steve -Original Message- From: Marcelo H. Terres [mailto:[EMAIL PROTECTED] Sent: Wednesday, November 09, 2005 2:25 PM To: Stephen Conway Subject: Re: Frequent DBERROR DB4 http://asg.web.cmu.edu/cyrus/download/imapd/faq.html Q: I'm getting messages in imapd.log like: Sep 11 17:23:55 ogg lmtpd[773]: DBERROR db3: 16 lockers Sep 11 17:23:55 ogg lmtpd[1409]: DBERROR db3: 17 lockers Sep 11 17:23:56 ogg lmtpd[1508]: DBERROR db3: 9 lockers Sep 11 17:23:56 ogg lmtpd[776]: DBERROR db3: 9 lockers What's wrong? A: Nothing is wrong. These messages are logged whenever Berkeley db encounters lock contention, but isn't necessarily a problem by themselves. This is especially likely when you have an empty or small duplicate delivery database and are receiving a large volume of e-mail. Berkeley db 4.0 has a bug where the number of lockers isn't decremented properly, causing this number to be unreliable. [] 2005/11/9, Stephen Conway [EMAIL PROTECTED]: Hello: We have a Cyrus IMAPD server version 2.1.12 running on a RH 8 server. All is working find up until last week, now we are getting increasing errors as follows: Nov 7 22:36:33 antar lmtpd[1057]: DBERROR db4: 50 lockers The number before lockers keeps going higher and higher until eventually the server stops receiving pop and imap connections. After a restart of the server, it starts over again. My question is, how can I stop these, and why after a reboot does it reset down to 1 again? I have read a bit in the archives and it seems that this has something to do with Berkley DB and that updating to newest version of Cyrus should fix this, is this correct? If so, what are the necessary steps to install the latest version, preserving the existing system, users, messages, etc. In addition, previous version was not installed with the RPM, can you let me know where to find the RPM for RH8? Any light you can shed is appreciated. Regards, Steve -- ShipMail Now 30% Faster Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html -- Marcelo H. Terres [EMAIL PROTECTED] -- Igor -- ShipMail Now 30% Faster Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Munge8bit option for .spec file
[EMAIL PROTECTED] wrote: I've attached .spec file of my cyrus-imapd on SLES9. Could someone tell me what to change there so I can build it with munge8bit option? AFAIK it requires patching cyrus-imapd sources. I think you can extract the patch from source RPM available at http://www.invoca.ch/pub/packages/cyrus-imapd/ and see the required modifications of *.spec file. The page is mentioned at cyrus wiki: http://acs-wiki.andrew.cmu.edu/twiki/bin/view/Cyrus/ExternalLinks Simon Matter's Cyrus RPMs -- [en: Andrew] Andrzej Adam Filip : [EMAIL PROTECTED] : [EMAIL PROTECTED] http://anfi.homeunix.net/ Netcraft Site Rank: 487901 All that is necessary for the triumph of evil is that good men do nothing -- Edmund Burke, 18th century Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Frequent DBERROR DB4
Am Mi, den 09.11.2005 schrieb Stephen Conway um 19:45: We have a Cyrus IMAPD server version 2.1.12 running on a RH 8 server. All [...] In addition, previous version was not installed with the RPM, can you let me know where to find the RPM for RH8? Steve Don't you think it is more than time to install a current and security maintained distribution release (together with a current Cyrus-IMAPd without security flaws)? RH8 is EOL since quite some time. Testing both MX hosts for domain wlnet.com shows you must run even older releases - Sendmail 8.10.2 indicates RH 6.2! *sick* The nmap output is a real horror show. I am always astonished when people are that airy. Alexander -- Alexander Dalloz | Enger, Germany | GPG http://pgp.mit.edu 0xB366A773 legal statement: http://www.uni-x.org/legal.html Fedora Core 2 GNU/Linux on Athlon with kernel 2.6.11-1.35_FC2smp Serendipity 22:40:03 up 11 days, 20:40, load average: 0.21, 0.25, 0.23 signature.asc Description: Dies ist ein digital signierter Nachrichtenteil Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
RE: Frequent DBERROR DB4
On Wed, 9 Nov 2005, Stephen Conway wrote: Hello Igor: The locker number does indeed continue to grow, in the 500s one time even into the 1000s. My next problem is this, I have it installed 2.1.12 from the tar source, what steps should I take to install the new version? Should I download the source, or is it possible for me to use the rpm on RH8? I saw the readme from the rpms and it said not to install it if you have previously tried to install from source. What should I backup prior to trying to install either the source or the rpm? If you do not change berkeley api, the upgraded cyrus imapd should just work (this does not mean you should not backup) I install everything from sources. -Igor Thanks, Steve -Original Message- From: Igor Brezac [mailto:[EMAIL PROTECTED] Sent: Wednesday, November 09, 2005 3:25 PM To: Stephen Conway Cc: info-cyrus@lists.andrew.cmu.edu Subject: RE: Frequent DBERROR DB4 On Wed, 9 Nov 2005, Stephen Conway wrote: Hello: But, can these cause the server to eventually stop responding? POP and IMAP Not unless the locker number continues to grow. connections are no longer possible, and after a restart it comes back. So the next question is, should I consider an upgrade, and if so, what steps should I consider? What should I backup prior to installing? Am I able to use the rpm? Upgrade cyrus will fix your problem. -Igor Thanks, Steve -Original Message- From: Marcelo H. Terres [mailto:[EMAIL PROTECTED] Sent: Wednesday, November 09, 2005 2:25 PM To: Stephen Conway Subject: Re: Frequent DBERROR DB4 http://asg.web.cmu.edu/cyrus/download/imapd/faq.html Q: I'm getting messages in imapd.log like: Sep 11 17:23:55 ogg lmtpd[773]: DBERROR db3: 16 lockers Sep 11 17:23:55 ogg lmtpd[1409]: DBERROR db3: 17 lockers Sep 11 17:23:56 ogg lmtpd[1508]: DBERROR db3: 9 lockers Sep 11 17:23:56 ogg lmtpd[776]: DBERROR db3: 9 lockers What's wrong? A: Nothing is wrong. These messages are logged whenever Berkeley db encounters lock contention, but isn't necessarily a problem by themselves. This is especially likely when you have an empty or small duplicate delivery database and are receiving a large volume of e-mail. Berkeley db 4.0 has a bug where the number of lockers isn't decremented properly, causing this number to be unreliable. [] 2005/11/9, Stephen Conway [EMAIL PROTECTED]: Hello: We have a Cyrus IMAPD server version 2.1.12 running on a RH 8 server. All is working find up until last week, now we are getting increasing errors as follows: Nov 7 22:36:33 antar lmtpd[1057]: DBERROR db4: 50 lockers The number before lockers keeps going higher and higher until eventually the server stops receiving pop and imap connections. After a restart of the server, it starts over again. My question is, how can I stop these, and why after a reboot does it reset down to 1 again? I have read a bit in the archives and it seems that this has something to do with Berkley DB and that updating to newest version of Cyrus should fix this, is this correct? If so, what are the necessary steps to install the latest version, preserving the existing system, users, messages, etc. In addition, previous version was not installed with the RPM, can you let me know where to find the RPM for RH8? Any light you can shed is appreciated. Regards, Steve -- ShipMail Now 30% Faster Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html -- Marcelo H. Terres [EMAIL PROTECTED] -- Igor Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: improving concurrency/performance (fwd)
This guy is having a problem with cyrus-imap and ext3 - when multiple processes are attempting to write to the one filesystem (but not the one file), performance drops to next to nothing when only five processes are writing. An strace shows most of the time is being spent in fdatasync and fsync. Actually, the thread just got off topic quickly -- I'm running this on reiserfs, not ext3. ...And I've got it mounted with data=writeback, too. But thanks for the info, Andrew. Sorry, my confusion. But it might be worth asking the reiserfs guys. My experience has been that if you are fsync'ing files, then even modern disks only get around 10 fsync's per second (because not only does the file data get writen out, but typically the inode, the directory entry, the free block table and maybe even all the directory entries up to root). Journalling can help, because the commited data is writen sequentially to the journal, rather than being scattered all over the disk, but the journalled operations still need to be applied to the filesystem sooner or later. -- Andrew McNamara, Senior Developer, Object Craft http://www.object-craft.com.au/ Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: improving concurrency/performance (fwd)
Yes, on ext3, an fsync() syncs the entire filesystem. It has to, because all the metadata for each file is shared - it's just a string of journallable blocks. Similar story with the data, in ordered mode. So effectively, fsync()ing five files one time each is performing 25 fsync()s. One fix (which makes the application specific to ext3 in ordered-data or journalled-data mode) is to perform a single fsync(), with the understanding that this has the side-effect of fsyncing all the other files. That's an ugly solution and is rather hard to do if the workload consists of five separate processes! So I'd recommending mounting the filesystem with the `-o data=writeback' mode. This way, each fsync(fd) will sync fd's data only. That's much better than the default data-ordered mode, wherein a single fsync() will sync all the other file's data too. In data=writeback mode it is still the case that fsync(fd) will sync the other file's metadata, but that's a single linear write to the journal and the additional cost should be low. Bottom line: please try data=writeback, let me know. Does this mean that those of us using XFS should run some testing as well? thanks, joshua Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
