what is the "stage." directory for?
Hello, in my setup with cyrus 2.2.12 I have a directory named "/stage.". It includes files like 8801-1161887510-0 8802-1161887656-0 8807-1161887123-0 8808-1161887204-0 8809-1161887238-0 8810-1161887139-0 8811-1161887596-0 8812-1161887667-0 8838-1173199589-0 8852-1161887124-0 8925-1161898745-0 9073-1161684396-0 9078-1161684092-0 9086-1161684072-0 909-1162808438-0 9097-1161684063-0 9104-1161684064-0 9109-1161685066-0 9120-1161685680-0 913-1162810100-0 9372-1161685682-1 945-1164642075-0 946-116281075966-1164642072-0 which contain complete messages including headers. Most of them are several months old, but there are also files from today. What are they used for? Is it safe to delete them (shutting down cyrus first)? Regards Marten Lehmann Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Problem with "."
On Wed, 2007-03-07 at 08:46 -0300, Fabio Silva wrote: > Hi all, i have a mailserver with postfix + cyrus and openldap > > I have problem with user that must have their username in this format > "user.name" with "." > In postfix i set the > recipient_delimiter = . > > And i can receive mails, but cyrus deliver this mail to user "user" > not to user "user.name" > How can i solve it? Don't set the recipient_delimiter to '.' Z -- Zachariah Mully Director, Systems and Networks SmartBrief, Inc. [EMAIL PROTECTED] p: 202-737-5500 f: 202-737-7577 Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
POP3 Timeouts?
I am having a problem where long POP transactions are being closed by the server. I turned on per-user debugging, but didn't actually see the problem until I ran a packet sniffer(wireshark) on the server. The transaction goes as follows: 1) Client connects/auths 2) Client lists mailbox contents and retrieves messages in order 3) Client requests a large message, server send the message 4) Client issues the dele command, server issues a TCP RST (client obliges with a Fin,Ack effectively closing the connection) No errors are present in the log and the per user debugging makes it look as though the client never issued a dele/quit. This appears to be the POP timeout as increasing the timeout allowed the download of larger messages. Is this the way the POP timeout is supposed to work? I would assume as long as data is continuously being requested by the client the timeout would not be counting. Is the timeout counter instead based on the time between commands issued by the client?. I am using Cyrus 2.3.1 Thanks, -Blake Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: BerkeleyDB problems, converting away
On Wed, 7 Mar 2007, Tuomas Toropainen wrote: [EMAIL PROTECTED] wrote: These are not real errors, see: Yes they are, look at the numbers :( I converted deliver.db and tls_sessions.db databases to skiplist. Conversion took about 3 seconds and everything seems to be working fine. One mysterious thing is this berkeleydb log file that appears every time cyrus is started. Any ideas what causes it or if I should be worried? /var/lib/cyrus/db/log.01: Berkeley DB (Log, version 8, native byte-order) Even though you are not using any Berkeley DB databases, I think Cyrus still initializes the Berkeley DB environment during startup. Andy Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: restoration of mailboxes
On Wed, 7 Mar 2007, Sebastian Reitenbach wrote: Hi list, I have to restore a users mailbox with some subfolders. Because of a crash of the client, maybe the half of the inbox, and maybe subfolders are gone. The mails are gone in random order, so I have no clue which of these many mails are gone. Is it save, when I restore the NNN. files from backup, and run a reconstruct -r user.mailboxname. Is this safe to do this while cyrusd is running, or do I have to stop it? Are the flags, e.g. read, flagged, ... of all the mails in the mailbox affected by running reconstruct, or only the ones that are new from the backup? I do restores with Cyrus running all the time. If a user is accessing the mailbox while you are restoring it, they will probably notice some odd behavior though. I don't know what happens to the message flags. Andy Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Problems with Thunderbird and saving emails to sent-folders
tarjei wrote: Hi, Many of my users are having problems saving sent emails to the sent folder in Thunderbird. This is a known problem in Thunderbird and partly documented here: https://bugzilla.mozilla.org/show_bug.cgi?id=206408 What I am wondering about is if anyone can give me some advice on how to configure cyrus and /or thunderbird to reduce the impact of the bug. Here is my guess: The connection is being closed by a NAT device between the client and server. TB will ping the server every 29 minutes to avoid getting timed out by the server after a minimum of 30 minutes, but the NAT device flushes the connection quicker than 29 minutes and TB doesn't handle it gracefully. -- Kenneth Murchison Systems Programmer Project Cyrus Developer/Maintainer Carnegie Mellon University Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Username different from mailbox
Hi Patrick, > - an inofficial cyrus patch or Well, I hope it will become part of the codebase as soon as it has been found to work properly. But in practice, it is going to take some time until that version will make it into package repositories. Ok, sounds like that story is back to me. ;-(( But ... > - an imap/pop3 proxy server (perdition) Nobody had brought this up before. Thanks! Sounds like it might even be the short term solution for us. Regards, Torsten Original-Nachricht Datum: Wed, 07 Mar 2007 14:21:22 +0100 Von: Patrick Kranz <[EMAIL PROTECTED]> An: info-cyrus@lists.andrew.cmu.edu CC: Betreff: Re: Username different from mailbox > Hi Torsten, hi list, > > first of all thanks for the many answers and thanks to torsten for > making my question clear :) > > so far, two possible solutions have been mentioned here: > > - an inofficial cyrus patch or > - an imap/pop3 proxy server (perdition) > > i had no chance to talk to my customer yet but i guess the proxy server > will be the solution of our choice because i still can use the updates > for the cyrus server provided by the distributor without the need to > recompile it by hand every time there is an update. > i have investigated a little and found out, that perdition actually > supports ldap, so it is possible to still keep all relevant data in the > ldap-dit. > > if anyone is interessted in the final setup and if it worked, don't > hesitate to mail me but i think in the matter of this mailing list this > case is closed :) > > thanks for your help. > > best regards, > patrick > > > Torsten Schlabach schrieb: > > Hi Patrick, hi all others, > > > > This is *not* an MTA issue at all as soon as we discuss the IMAP user > > logging in rather than the MTA delivering mail! > > > > This has been discussed indeed several times already and every time it > > came up, there were several people answering that they have no problem > > with that all. Yet unfortunately, they weren't talking about what was > > asked and what you need. (As long as I didn't get it wrong.) > > > > It is crucial in this discussion to distingish between two things: > > > > 1. Teach the MTA (Exim, Postfix, doesn't really matter) that mail for > > [EMAIL PROTECTED] has to go to fillinwhatyoulike / [EMAIL PROTECTED] Yes, > > this is a > > no-brainer. So we discuss SMTP here, which isn't really a subject for > > Cyrus IMAPd at all. And it's not what you're asking if I get it right. > > > > 2. In IMAP a user uses a name to identify himself against Cyrus IMAPd. > > The respective data is flowing right from the MUA (not the MTA) to > > port 143. Note: No Exim / Postfix / qmail in the game. > > > > Cyrus itself is indeed built on the assumtion that whatever name you > > use to authenticate *is* the name of the mailbox you want to see. > > > > It is impossible to use any tricks in the LDAP backend to solve this. > > You will be able to make LDAP lookup the credentials for userb if he > > logs into Cyrus as usera (if you do whatever mapping in LDAP) but this > > will always result in a "no mailbox with that name error" as Cyrus > > IMAPd will authenticate correctly, but look for the wrong mailbox name. > > > > The only way to solve your (and my) problem will be a canon_user SASL > > plugin, which does not yet exist. > > > > Well, sort of ... > > > > Howard Chu was so kind to write one which he provided to me as patch. > > Due to a lack of time and maybe ability I was yet unable to make it > > work for me. But I definitely trust him that when he says he had this > > working for him, that the problem is with me and not with his code. > > > > So in case you are ready to compile your stuff from source, I will > > happliy share the patch with you and I would be extremely thankfull if > > you could help me with some hints on how to properly install that. > > > > Regards, > > Torsten > > > > > > Jorey Bump schrieb: > >> Patrick Kranz wrote: > >> > >>> Now I have a customer, who needs the scenario that the usernames for > >>> Cyrus differ from the mailbox and mailaddress respectivly. For > >>> example [EMAIL PROTECTED] should be able to login with the > >>> username someOtherUsername. This need arises from an integration > >>> with other software-packages. Is there any possibility to make this > >>> work? > >> > >> > >> Yes, this is no different from any other alias or virtual setup that > >> offers multiple addresses to individual users. You would handle this > >> in the MTA. For example, I use virtual_alias_maps with Postfix, and > >> map all addresses to the corresponding cyrus IMAP user: > >> > >> [EMAIL PROTECTED]admin > >> [EMAIL PROTECTED]admin > >> [EMAIL PROTECTED]admin > >> [EMAIL PROTECTED]bob > >> [EMAIL PROTECTED]bob > >> > >> You can also use the aliases file and other approaches. > >> > >> > >> > >> > >> Cyrus Home Page: http://cyrusimap.web.cmu.edu/ > >> Cyrus Wiki/FAQ
Re: Username different from mailbox
Hi Torsten, hi list, first of all thanks for the many answers and thanks to torsten for making my question clear :) so far, two possible solutions have been mentioned here: - an inofficial cyrus patch or - an imap/pop3 proxy server (perdition) i had no chance to talk to my customer yet but i guess the proxy server will be the solution of our choice because i still can use the updates for the cyrus server provided by the distributor without the need to recompile it by hand every time there is an update. i have investigated a little and found out, that perdition actually supports ldap, so it is possible to still keep all relevant data in the ldap-dit. if anyone is interessted in the final setup and if it worked, don't hesitate to mail me but i think in the matter of this mailing list this case is closed :) thanks for your help. best regards, patrick Torsten Schlabach schrieb: Hi Patrick, hi all others, This is *not* an MTA issue at all as soon as we discuss the IMAP user logging in rather than the MTA delivering mail! This has been discussed indeed several times already and every time it came up, there were several people answering that they have no problem with that all. Yet unfortunately, they weren't talking about what was asked and what you need. (As long as I didn't get it wrong.) It is crucial in this discussion to distingish between two things: 1. Teach the MTA (Exim, Postfix, doesn't really matter) that mail for [EMAIL PROTECTED] has to go to fillinwhatyoulike / [EMAIL PROTECTED] Yes, this is a no-brainer. So we discuss SMTP here, which isn't really a subject for Cyrus IMAPd at all. And it's not what you're asking if I get it right. 2. In IMAP a user uses a name to identify himself against Cyrus IMAPd. The respective data is flowing right from the MUA (not the MTA) to port 143. Note: No Exim / Postfix / qmail in the game. Cyrus itself is indeed built on the assumtion that whatever name you use to authenticate *is* the name of the mailbox you want to see. It is impossible to use any tricks in the LDAP backend to solve this. You will be able to make LDAP lookup the credentials for userb if he logs into Cyrus as usera (if you do whatever mapping in LDAP) but this will always result in a "no mailbox with that name error" as Cyrus IMAPd will authenticate correctly, but look for the wrong mailbox name. The only way to solve your (and my) problem will be a canon_user SASL plugin, which does not yet exist. Well, sort of ... Howard Chu was so kind to write one which he provided to me as patch. Due to a lack of time and maybe ability I was yet unable to make it work for me. But I definitely trust him that when he says he had this working for him, that the problem is with me and not with his code. So in case you are ready to compile your stuff from source, I will happliy share the patch with you and I would be extremely thankfull if you could help me with some hints on how to properly install that. Regards, Torsten Jorey Bump schrieb: Patrick Kranz wrote: Now I have a customer, who needs the scenario that the usernames for Cyrus differ from the mailbox and mailaddress respectivly. For example [EMAIL PROTECTED] should be able to login with the username someOtherUsername. This need arises from an integration with other software-packages. Is there any possibility to make this work? Yes, this is no different from any other alias or virtual setup that offers multiple addresses to individual users. You would handle this in the MTA. For example, I use virtual_alias_maps with Postfix, and map all addresses to the corresponding cyrus IMAP user: [EMAIL PROTECTED]admin [EMAIL PROTECTED]admin [EMAIL PROTECTED]admin [EMAIL PROTECTED]bob [EMAIL PROTECTED]bob You can also use the aliases file and other approaches. Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html -- Epper & Kranz GbR Oliver Epper, Patrick Kranz EK IT-Solutions Südring 37 54634 Bitburg Tel: +49 (0)6561 951614 Fax: +49 (0)6561 12425 Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
sasl-mech weirdness and unified murder
Hi! If I have on the 'remote' backend a line such as sasl_mech_list: DIGEST-MD5, PLAIN, LOGIN in /etc/imapd.conf, all proxy operations fail with a message such as: Server(s) unavailable to complete operation and in the 'frontend' log: Mar 7 15:08:04 m2cn1t imap[21585]: Doing a peer verify Mar 7 15:08:04 m2cn1t imap[21585]: Doing a peer verify Mar 7 15:08:04 m2cn1t imap[21585]: received server certificate Mar 7 15:08:04 m2cn1t imap[21585]: starttls: TLSv1 with cipher AES256-SHA (256/256 bits new) no authenti cation Mar 7 15:08:04 m2cn1t imap[21585]: couldn't authenticate to backend server: no mechanism available and in the 'backend' log: Mar 7 15:08:04 m2cn2t imap[31010]: executed Mar 7 15:08:04 m2cn2t imap[27757]: starttls: TLSv1 with cipher AES256-SHA (256/256 bits new) no authenti cation However, if I have a line such as sasl_mech_list: DIGEST-MD5 everything works perfectly, there's nothing special in the frontend log, in the backend log: Mar 7 15:09:20 m2cn2t imap[341]: executed Mar 7 15:09:21 m2cn2t imap[336]: login: m2cn1t.mappi.helsinki.fi [128.214.205.51] cyrus DIGEST-MD5 User logged in What is going on? It even appears that plain text logins to the 'frontend' /do/ work, even while they aren't mentioned anywhere in the config file. --Janne -- Janne Peltonen <[EMAIL PROTECTED]> Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Slow lmtpd
On Tue, 2007-03-06 at 08:57 -0500, John Madden wrote: > Are you connecting to lmtpd over TCP or something? I haven't seen this > behavior with Postfix and a UNIX socket, at least. But still, I'd > rather have Postfix defer the connection than have huge IO wait > queues. ...If nothing else, think about what that's doing to your IMAP > clients. :) Yep, TCP. I should have mentioned that. > Ah, it sounds here like you're connecting multiple SMTP frontends to a > single lmtpd backend? Sorry if I missed that earlier. FWIW, I'd stick > postfix on this box to handle the incoming mail and do all that over > SMTP, then deliver over LMTP to Cyrus locally and over a unix socket. > SMTP ought to prove more reliable than LMTP over a network, IMO. This > has the added benefit of only having to tweak one Postfix install for > its delivery to lmtpd! Hmm, I never thought of having two "layers" of MTAs like this. I'll add it to the list of things to try. > I think you'd be better off with smaller disk sets for different I/O > patterns. Like a 2-disk RAID-1 for /var/lib/imap and the rest striped > for /var/spool/imap, etc. Either way, you want to separate not just on > LVM, but on the physical spindles doing the work. I could try that for later systems (changing the raid config on the current one is not possible without moving everything to another machine). The thing about this solution that I don't like is that /var/lib/imap is only ~300MB here, so it would waste a lot of disk space. But then, maybe that's a small price I'd have to pay. Thanks, Andre Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Slow lmtpd
On Tue, 2007-03-06 at 13:11 +0100, [EMAIL PROTECTED] wrote: > You should always limit your MTA(s) (Postfix) LMTP clients to match the > max number at your LMTP Server (Cyrus). Be sure to use a separate > transport for lmtp and use the lmtp_connection_cache and maybe raise > the max_use value. With this even small numbers of LMTP clients (<5) > will be able to saturate your Cyrus I/O so no need to get in trouble > with many hundreds LMTPs waiting for I/O slots. > I would start with 2 LMTP client connections per MTA and see what > happens. As said if you don't have long running sieve scripts this > should be enough to get near the max transferrate your Cyrus can handle. Thanks, I'll try that. I'm currently using lower values values for both the concurrency limit and the lmtpd process limit. At least the load average is lower now, and even if delivery may take some more time, it's less pain for the imap/pop3 users. Andre Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Slow lmtpd
On Tue, 2007-03-06 at 15:00 +1100, Rob Mueller wrote: > Yep, there's obviously a 2 sided limit here. > > Too few lmtpds and postfix won't be able to deliver incoming mail fast > enough, and thus the mail queue on the postfix side will build up. I'll try some config tweaking here... I guess it'll take some experimenting and time to find the best combination. > I guess the questions then is, in normal operating conditions when you're > not flushing a postfix queue: > 1. Is the cyrus server overloaded? > 2. Does the postfix queue build up at all, or is delivering to lmtp fast > enough? In general the problem starts when postfix flushes the queue, and then it's kind of a snowball effect because cyrus can't recover. I've lowered my lmtpd process limit and also the concurrency limit in postfix. Let's see how this goes... Thanks for all the help Andre Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Problem with "."
Hi all, i have a mailserver with postfix + cyrus and openldap I have problem with user that must have their username in this format "user.name" with "." In postfix i set the recipient_delimiter = . And i can receive mails, but cyrus deliver this mail to user "user" not to user "user.name" How can i solve it? Regards, -- Fabio S. Silva Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: BerkeleyDB problems, converting away
[EMAIL PROTECTED] wrote: These are not real errors, see: Yes they are, look at the numbers :( I converted deliver.db and tls_sessions.db databases to skiplist. Conversion took about 3 seconds and everything seems to be working fine. One mysterious thing is this berkeleydb log file that appears every time cyrus is started. Any ideas what causes it or if I should be worried? /var/lib/cyrus/db/log.01: Berkeley DB (Log, version 8, native byte-order) There should be no more berkeleydb databases in use, /etc/imapd.conf: duplicate_db: skiplist tlscache_db: skiplist annotation_db: skiplist mboxlist_db: skiplist ptscache_db: skiplist quota_db: quotalegacy seenstate_db: skiplist subscription_db: flat (what is ptscache_db? I didn't convert it because I couldn't find it, just added it to imapd.conf) Thanks Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
restoration of mailboxes
Hi list, I have to restore a users mailbox with some subfolders. Because of a crash of the client, maybe the half of the inbox, and maybe subfolders are gone. The mails are gone in random order, so I have no clue which of these many mails are gone. Is it save, when I restore the NNN. files from backup, and run a reconstruct -r user.mailboxname. Is this safe to do this while cyrusd is running, or do I have to stop it? Are the flags, e.g. read, flagged, ... of all the mails in the mailbox affected by running reconstruct, or only the ones that are new from the backup? kind regards Sebastian Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
