delivery failures
Dear All, We are using Cyrus 1.6.24 with Exim. We had hoped to deliver using lmtp to benefit from single message delivery and SIEVE. However we have a serious problem, described below, which has meant that we have had to stop delivering this way for the moment. I have not been able to pin down the problem properly so it is difficult to describe. I hope that if I give enough details the symptoms will ring a bell with someone. We have 15000 active users and every day we have several messages delivered to the wrong people. What is happening is that the header from one message is being attached to the body of another. In one case a message being delivered to a long list of recipients was failing with the message in imapd.log Feb 14 10:38:57 mat.bath.ac.uk deliver[11551]: markdelivered: dbm_store: Bad fil e number The MTA reported 2001-02-14 10:38:57 14SzKm-000303-00 == [EMAIL PROTECTED] T=local_deliver y_cyrus_lmtp defer (-1): LMTP connection closed after end of data On a subsequent attempt to deliver the messages a few copies were delivered and then the MTA reported 2001-02-14 10:51:57 14SzKm-000303-00 == [EMAIL PROTECTED] T=local_delivery _cyrus_lmtp defer (-1): LMTP error after end of data: 451 4.3.0 System I/O error Entries in the log file at this time are Feb 14 10:51:56 mat.bath.ac.uk deliver[24432]: markdelivered: dbm_store: Bad fil e number Feb 14 10:51:56 mat.bath.ac.uk deliver[24432]: couldn't create stage directory: /mail/ad/stage./: File exists Feb 14 10:51:56 mat.bath.ac.uk deliver[24432]: IOERROR: creating message file /m ail/ad/stage./: File exists Feb 14 10:51:56 mat.bath.ac.uk deliver[24432]: couldn't create stage directory: /mail/ad/stage./: File exists Feb 14 10:51:56 mat.bath.ac.uk deliver[24432]: IOERROR: creating message file /m ail/ad/stage./: File exists Feb 14 10:51:56 mat.bath.ac.uk deliver[24432]: couldn't create stage directory: /mail/ad/stage./: File exists Feb 14 10:51:56 mat.bath.ac.uk deliver[24432]: IOERROR: creating message file /m ail/ad/stage./: File exists It is the header from this message which became attached to the body of another message, which then got delivered to the wrong recipients. As you can see I am not sure what is going on here so any suggestions for further investigation would be welcome. --- P Christie [EMAIL PROTECTED]
cyrus imapd delay
when trying to connect to the imap server there is 15 seconds delay. I
have tried 3 times.all connections had 15 seconds delay. I have checked
network connections during delay. Network connection is okay. after
connection established cyrus waits for some delay before giving "OK
helios Cyrus IMAP4 v.2.0.11 prompt.
below I have attached an strace output from mutt client.
the same occurs with "telnet host 143" also.
Also only after this much delay, imapd.log has been written.
strace output:
12:54:58 execve("/usr/local/bin/mutt", ["mutt"], [/* 34 vars */]) = 0
...
12:54:58 socket(PF_INET, SOCK_DGRAM, IPPROTO_IP) = 4
12:54:58 connect(4, {sin_family=AF_INET, sin_port=htons(53),
sin_addr=inet_addr("192.168.6.254")}}, 16) = 0
12:54:58 send(4, "\'\315\1\0\0\1\0\0\0\0\0\0\6helios\5local\6ankara"...,
48, 0) = 48
12:54:58 time(NULL) = 982580098
12:54:58 poll([{fd=4, events=POLLIN, revents=POLLIN}], 1, 5000) = 1
12:54:58 recvfrom(4,
"\'\315\205\200\0\1\0\1\0\1\0\1\6helios\5local\6ankara"..., 1024, 0,
{sin_family=AF_INET, sin_port=htons(53), sin_a$...
12:54:58 close(4) = 0
12:54:58 write(1, "\rConnecting to helios... \33["..., 34) = 34
12:54:58 socket(PF_INET, SOCK_STREAM, IPPROTO_IP) = 4
12:54:58 connect(4, {sin_family=AF_INET, sin_port=htons(143),
sin_addr=inet_addr("192.168.6.17")}}, 16) = 0
--12:54:58 read(4, "* OK helios Cyrus IMAP4 v2.0.11 "..., 1024) = 46
12:55:13 write(4, "a CAPABILITY\r\n", 18) = 18
12:55:13 read(4, "* CAPABILITY IMAP4 IMAP4rev1 ACL"..., 1024) = 178
12:55:13 write(1, "\rPassword for oguz@helios: ", 27) = 27
...
12:55:17 write(1, "\rLogging in...\33[K", 17) = 17
12:55:17 write(4, "a0001 LOGIN \"oguz\" \"h1u2n3@ta\"\r\n", 32) = 32
12:55:17 read(4, "a0001 OK User logged in\r\n", 1024) = 25
12:55:17 write(4, "a0002 LIST \"\" \"\"\r\n", 18) = 18
begin:vcard
n:YILMAZ;Oguz
tel;work:+90.312.4467800
x-mozilla-html:FALSE
url:oguz.ieee.metu.edu.tr
org:Gantek
adr:;;Kizkulesi Sok 42-2 GOP ;ANKARA;;;TURKIYE
version:2.1
email;internet:[EMAIL PROTECTED]
title:System Support Engineer
x-mozilla-cpt:;-15776
fn:Oguz YILMAZ
end:vcard
cyrus 1.6.24 and Outlook SR1 connect problem
The standard Outlookup 2000 works fine with our cyrus server but the SR1 release (9.0.0.3821) can not connect to our server. It seems to be in the USER sequence but I'am not sure. Does anyone know whats the problem is?? We want to start with imap and cyrus on Linux for production. Which version is the best one to start with? Your's sincerly, Roger Boussen Systemadministrator Audax AI B.V. the Netherlands business address: email: [EMAIL PROTECTED] tel. : +31 161 457847 fax. : +31 161 45 private address: [EMAIL PROTECTED] == The information contained in this communication is confidential and may be legally privileged. It is intended solely for the use of the individual or entity to whom it is addressed and others authorised to receive it. If you are not intended recipient you are hereby notified that any disclosure, copying, distribution or taking any action in reliance on the contents of this information is strictly prohibited and may be unlawful. Audax is neither liable for the proper and complete transmission of the information contained in this communication nor for any delay in its receipt. ==
Re: Migrating 12,000 students
On Monday, February 19, 2001 12:01:19 PM +0100 Marco Pirovano [EMAIL PROTECTED] wrote: +-- | Hello, | I have to migrate about 12,000 students from a POP3 view to a IMAP view. | Both POP3 server and IMAP server reside on the same machine. | Now they use Eudora as POP3 client, and in the future they will use a | webmail program, probably IMP. | | I've two big questions: | | 1) For a not short time, we will have both POP3 and IMAP users, | so how can I configure sendmail to manage this situation ? | We run sendmail 8.11.2 and procmail 3.15. As cyrus supports both imap and pop3 this isn't really a problem, just use formail and deliver to copy the mail from the usual mailboxes into cyrus, you users can continue using pop3 until the webmail comes online. Configuring sendmail to use deliver or lmtp isn't particularly hard. The biggest problem is the time it takes to convert 12000 mailboxes but I guess that you are planning to do the change this summer when traffic is low. | 2) Is there a way to convert Eudora mailboxes to IMAP folders ? No idea I'm afraid. /Michael -- This space intentionally left non-blank.
problem with Cyrus and Outlook 2000-SR
The normal Outlook 2000 release works fine but the SR1 release cannot log in to the system. The SR1 release had something to do with security issues. I'am running Cyrus 1.6.24 on Linux What do I have to do to get this version of Outlook to work well? What's the best version of Cyrus to use on Linux to support 700 mailusers? I have to install imap from scratch we are now using Sendmail on Linux and Mercury and Pegasus on Novell. Your's sincerly, Roger Boussen Systemadministrator Audax AI B.V. the Netherlands business address: email: [EMAIL PROTECTED] tel. : +31 161 457847 fax. : +31 161 45 private address: [EMAIL PROTECTED] == The information contained in this communication is confidential and may be legally privileged. It is intended solely for the use of the individual or entity to whom it is addressed and others authorised to receive it. If you are not intended recipient you are hereby notified that any disclosure, copying, distribution or taking any action in reliance on the contents of this information is strictly prohibited and may be unlawful. Audax is neither liable for the proper and complete transmission of the information contained in this communication nor for any delay in its receipt. ==
Re: What a BITCH!
It wasn't a perfect install, but after reading docs provided with the tarball, I was able to install and set it up in under an hour... Just the usual library/config problems with open source building on Solaris (very minor)... I surely can't complain about something that is GIVEN away for FREE and WORKS flawlessly Thanks to all who have provided this software/docs/patches over the years that I have used it Eric On Mon, 19 Feb 2001, Mika Tuupola wrote: Date: Mon, 19 Feb 2001 14:09:19 +0200 (EET) From: Mika Tuupola [EMAIL PROTECTED] To: [EMAIL PROTECTED] Subject: Re: What a BITCH! On Sun, 18 Feb 2001, dglynn wrote: Yes sir, do I feel happy! Well, through the pain and suffering follows cyrus imap and sendmail! I finally configured them both and my mail server is up and running! That was THE BIGGEST BITCH to get working though and I've really had to do a lot of hacking and thread reading to get it just right. Oh well, can't agree with this. I was warned in sun-managers about Cyrus might be a bit tricky to install but I personally found it pretty straight forward. All the info I had was the readme files and the webpages. Maybe Cyrus was not the easiest to install, but it was not too hard anyway. -- Eric Wisti[EMAIL PROTECTED] --- From a Sun Microsystems bug report (#4102680): "Workaround: don't pound on the mouse like a wild monkey." ---
Re: Questions,fixes,problems: Cyrus 2.0.9, NetBSD 1.5 [LONG]
On Fri, Feb 16, 2001 at 02:47:08PM +1100, Grant Beattie wrote: Feb 16 14:33:58 wombat perl[3212]: [ID 516856 auth.error] unable to dlopen /opt/local/cyrus/lib/sasl/libdigestmd5.so: ld.so.1: perl: fatal: relocation error: file /opt/local/cyrus/lib/sasl/libdigestmd5.so: symbol __eprintf: referenced symbol not found What compiler did you use? On AIX I get similar errors if I try to mix code compiled with gcc and with xlc. Try linking libdigestmd5.so against libgcc.a directly. Gabor -- Gabor Gombas Eotvos Lorand University E-mail: [EMAIL PROTECTED]Hungary
Re: Problem with Cyradm
I had a similar problem - perl libraries wer installed in /usr/pkg/lib. I added an include directive to the cyradm script. Hope this helps. johnh... On Mon, 19 Feb 2001, Bevan Christians wrote: Date: Mon, 19 Feb 2001 11:33:35 +0200 From: Bevan Christians [EMAIL PROTECTED] To: "Info-Cyrus (E-mail)" [EMAIL PROTECTED] Subject: Problem with Cyradm Hi, I have a problem with cyradm, was wondering if anyone knew what causes this, I have no perl knowledge. /*** / [cyrus@cuchulainn bin]$ ./cyradm localhost Can't locate Cyrus/IMAP/Shell.pm in @INC (@INC contains: /usr/lib/perl5/5.6.0/i386-linux /usr/lib/perl5/5.6.0 /usr/lib/perl5/site_perl/5.6.0/i386-linux /usr/lib/perl5/site_perl/5.6.0 /usr/lib/perl5/site_perl .). BEGIN failed--compilation aborted. \*** ***/ Thanx Bevan
Re: zero-fork delivery?
Right you are; running Sendmail/deliver/lmtpd is an extremely
inefficient way to deliver mail. Long message follows.
* Normal configuration
The way I normally expect people to configure Cyrus is to have their
MTA talk LMTP directly to lmtpd. Smarter MTAs will reuse the
connection. For instance, during a queue run Sendmail will only open
one LMTP connection (= 1 lmtpd process) and shove as much mail down it
as possible.
You can see how to configure Sendmail and LMTP in the
cyrus/doc/cyrusv2.mc file.
* Default Sendmail inefficiences
By default, Sendmail runs in DeliveryMode=background. When the load
gets very large, it turns out that just the Sendmail fork() plus the
lmtpd fork() for each message (the default thing Sendmail tries first)
is quite expensive. Here's a scenario:
mx.andrew.cmu.edu accepts a message and attempts delivery to
cyrus.andrew.cmu.edu.
- sendmail LISTENER fork()s a sendmail process to talk SMTP to mx.andrew.
- sendmail SMTP gets EHLO, MAIL FROM: and fork()s
- sendmail SMTP2 gets RCPT TO:, RCPT TO:, ..., DATA.
- sendmail SMTP2 fork()s for delivery attempt
- sendmail SMTP3 attempts to connect to /var/imap/socket/lmtpd
- cyrus MASTER fork()s
- cyrus CHILD exec()s lmtpd, lmtpd accepts the connection
- SMTP3 - CHILD talk LMTP to deliver the message.
(Note that this is still considerably better than using "deliver".)
Sendmail 8.12 should reduce the number of forks considerably.
* Our solution
Since our volume of mail is large enough that interactive delivery
(described above) pounds on the machine, we run Sendmail in
DeliverMode=queue, as in:
/usr/sbin/sendmail -O DeliveryMode=q -O QueueDirectory=/var/spool/mqueue/fast -bd -q1m
All messages are placed into the queue and delivery is attempted by a
queue run every minute. Every five minutes, any message older than
five minutes in /var/spool/mqueue/fast is moved to
/var/spool/mqueue/slow. This is done using the "re-mqueue.pl" script
distributed with Sendmail (though using "qtool.pl" is probably a
better idea).
Every 1/2 hour, a different sendmail tries to deliver
/var/spool/mqueue/slow. (It mostly contains messages for users who
are over quota.)
This way, an LMTP is fork()d for each queue run (1 per minute + 1 per
1/2 hour) and the amount of forking Sendmail does when attempting to
deliver the message is greatly reduced.
* Don't run an MTA on the Cyrus server
Using LMTP over TCP and LMTP AUTH, you can completely avoid running an
MTA on your Cyrus server. When we finish the next round of upgrades,
we'll hopefully be doing this. This way you only pay for the cost of
the lmtpd but not queue manangement.
* Other possibilities
Postfix may make much smarter use of LMTP connection caching so that
messages can be tried immediately without running the system into the
ground.
* Future work for Cyrus
lmtpd could stick around after one client disconnects and listen for
another client; in fact, the "master" architecture was designed to
make this possible, but I haven't done the work in lmtpd to make it
clean up when one client disconnects.
Larry
From: Simon Josefsson [EMAIL PROTECTED]
Date: 16 Feb 2001 22:41:43 +0100
I'm using sendmail 8.11.2 and cyrus imapd 2.0.11, currently using
"deliver" as the delivery agent. This forks two processes ("deliver"
and "lmtpd") for incoming mail, right? (assuming prefork=0) As far as
I can tell sendmail doesn't keep the LMTP connection up between
incoming connections either.
Switching to FEATURE(local_lmtp) in sendmail seem to make sendmail use
"mail.local" instead. It doesn't seem to reduce fork()s. Am I
misstaken?
It doesn't seem very difficult to achieve zero-fork delivery. Without
investigating it further, it feels as if it might reduce load on a
busy system. Opinions?
Re: Questions,fixes,problems: Cyrus 2.0.9, NetBSD 1.5 [LONG]
Lawrence Greenfield [EMAIL PROTECTED] wrote:
Berkeley DB 3 on NetBSD (and similarly in FreeBSD) is installed as:
/usr/pkg/lib/libdb3.a and /usr/pkg/include/db3/*.h so as not to
conflict with the "native" db in NetBSD.
I'm not sure how I'm suppose to deal with this; I could be chasing db
files all around eternity. I'd welcome patches.
Ok i just compiled 2.0.11 on netbsd 1.5. All I had to do was s/db-3/db3 in
configure. so all that needs to be done is to stick in (yet) another test for
db3, i.e. '-ldb3' in configure.in just before or after the test for db-3. the
script picks up the include files ok (/usr/pkg/include/db3) once i specify
--with-dbdir=/usr/pkg so no changes there, just the library check.
Sometimes mismatched db libraries cause crashes. The documentation
could also say to compile libsasl without db support
(--with-dblib=none).
Yes, this seems to work, however I had to patch utils/sasldblistusers.c as
follows:
--- sasldblistusers.c.orig Thu Feb 15 13:44:03 2001
+++ sasldblistusers.c Thu Feb 15 13:44:41 2001
@@ -309,7 +309,7 @@
#else
-int listusers(listcb_t *cb)
+int listusers(const char *path, listcb_t *cb)
{
fprintf(stderr,"Unsupported DB format");
exit(1);
For imapd I had to do CPPFLAGS="-I/usr/include/krb5
-I/usr/include/openssl" before running configure to pick up include
files. However some of the Makefiles under perl/ didn't "inherit"
these CPPFLAGS, so I had to add the includes to the "INC" hash key
in Makefile.PL as these seem to be (post-configure) generated
Makefiles
If there are generic fixes for these problems, I'd love to have them.
(I don't really have time to chase this down right now.)
I'll have a look at this, should just be a few Makefile tweaks.
- libwrap wasn't detected, even though it exists and works!
/usr/lib/libwrap.a, /usr/lib/libwrap.so* and /usr/include/tcpd.h
are there ok. passing --with-libwrap=/usr doesn't work either.
I think the next release will fix this.
Ok, I haven't tried this yet as master can now bind services to specific IPs.
I thought there was a way of making Netscape check multiple folders.
Not that I'm aware of..
Regards,
--
Cillian
failure:prot layer failure
:01C098E5] I am trying to get my imapd working but when I do the imtest -m login -p imap localhost I get the following error C: C01 CAPABILITY failure: prot layer failuremy imapd.conf isconfigdi rectory: /var/imappartition-default: /var/spool/imapadmins: cyrus rootsrvtab: /var/imap/srvtaballowanonymouslogin: nosasl_pass wd_check: shadow Anyone have any ideas? Thanx Get Your Private, Free E-mail from MSN Hotm ail at http://www.hotmail.com.
Re: 2.0.11 spuriously links master with libwrap
Date: Wed, 07 Feb 2001 19:19:19 -0500 From: Bitt Faulk [EMAIL PROTECTED] The master/Makefile links master with libwrap, and it doesn't need it. On my OpenBSD system, this actually causes runtime linking errors, as libwrap expects deny_severity and allow_severity to be supplied to it. The only place those symbols exist is in master/service.o, but that's not linked in my master, only by the imap/* clients. Turns out that it's more than just master that gets messed up. It's about half of the binaries created. So I created a patch against 2.0.11 w/ the rlim-patch that Larry posted earlier today. It looks like my patch works fine without Larry's, but you should definitely apply his patch as well. [... patch deleted ...] I've applied this patch. Thanks! Larry
Re: Questions,fixes,problems: Cyrus 2.0.9, NetBSD 1.5 [LONG]
Lawrence Greenfield [EMAIL PROTECTED] wrote: - With plaintext login [using pwcheck], cyradm asks for the password twice: first "Please enter your password:" then "IMAP Password:" - any reason why? I'm not sure. Has anyone else run across this? Can anyone else solve this? On closer investigation, it seems cyradm tries to use PLAIN auth, but because PLAIN is only available when SSL/TLS is in use (which cyradm doesn't use) this mechanism fails, so it falls back to the IMAP login method (as my setup has no other authentication methods enabled). Thus, the first password prompt is asked by the SASL PLAIN plugin (which fails) and the second prompt by cyradm (or rather, Cyrus::IMAP::Shell) which succeeds. Either enabling SSL/TLS support in cyradm or disabling attempts to use PLAIN when SSL/TLS is not being used, should fix this 'duplicate' password prompt. Or at least that's my understanding.. Regards, -- Cillian
