problems with the DELETED hierarchy
i m using cyrus 2.3.16 i have the following line in the cyrus.conf delprunecmd="cyr_expire -E 1 -D 30 -X 30" at=0400 but on my deleted hierarchy there are some mailboxes with mails than are 2 years old how is this possible? thanks in advance for any help Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: what is the DELETED directory in spool
Le 24/05/2010 19:38, Adam Tauno Williams a écrit : > On Mon, 2010-05-24 at 19:23 +0200, Eric Doutreleau wrote: > > I describe the delayed expunge feature in some detail in the Cyrus > chapter of WMOGAG: > <http://docs.opengroupware.org/Members/whitemice/wmogag/file_view> > >> i didn't understand how it works >> for example i have a user >> i run /usr/lib/cyrus-imapd/cyr_expire -v -E 1 -X 1 -D 1 -p user.huang_yi >> and i got >> Expunging deleted messages in mailboxes older than 1 days >> Expunged 0 out of 0 messages from 0 mailboxes >> Removing deleted mailboxes older than 1 days >> Removed 0 deleted mailboxes >> this user hasn't logged since a long time then he can't have deleted >> item less than one day older >> in the Deleted repertoire he has 178M of mail >> but as u can see nothing was deleted > > The -p option is "Only find mailboxes starting with this prefix." It > could be that DELETED.user.huang_yi [if that folder exists] doesn't > match the pattern of starting with "user.huang_yu" > > It looks like that is true > > sardine.mormail.com> lm DELETED.user.wcreswel* > DELETED.user.wcreswel.4B950AAB (\HasNoChildren) > DELETED.user.wcreswel.SPAM.4B950AAB (\HasNoChildren) > DELETED.user.wcreswel.sent-mail.4B950AAB (\HasNoChildren) > > - yet - > > /usr/lib/cyrus-imapd/cyr_expire -v -E 1 -X 1 -D 1 -p user.wcreswel > Expunging deleted messages in mailboxes older than 1 days > > Expunged 0 out of 0 messages from 0 mailboxes > Removing deleted mailboxes older than 1 days > Removed 0 deleted mailboxes > > - you need to include the proper prefix - > > $ /usr/lib/cyrus-imapd/cyr_expire -v -E 1 -X 1 -D 1 -p > DELETED.user.wcreswel > Expunging deleted messages in mailboxes older than 1 days > > Expunged 0 out of 0 messages from 0 mailboxes > Removing deleted mailboxes older than 1 days > Removing: DELETED.user.wcreswel.4B950AAB > Removing: DELETED.user.wcreswel.SPAM.4B950AAB > Removing: DELETED.user.wcreswel.sent-mail.4B950AAB > Removed 3 deleted mailboxes > > - the DELETED isn't assumed. > > I suppose I should add that to my documentation. > > And please don't top-post. > >> Could it be out of >> sync item what cyrus has "forgotten"? >> Le 24/05/2010 17:30, pablo ponce a écrit : >>> Hi, >>> See cyr_expire with option -X: http://linux.die.net/man/8/cyr_expire >>> El 24/05/2010 16:38, Eric Doutreleau escribió: >>>> i m using cyrus 2.3.16 >>>> and in each spool on the same level as the user directory i have a >>>> directory whose name is DELETED. >>>> i am wondering what is this directory? >>>> it contains a mailbox hierarchy with some mails which are very old >>>> can i smoothly delete it? thank you very much Adam for the explanation. It was really clear. sorry for the top-post. we had in our company a really stupid policy Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: what is the DELETED directory in spool
well i didn't understand how it works for example i have a user i run /usr/lib/cyrus-imapd/cyr_expire -v -E 1 -X 1 -D 1 -p user.huang_yi and i got Expunging deleted messages in mailboxes older than 1 days Expunged 0 out of 0 messages from 0 mailboxes Removing deleted mailboxes older than 1 days Removed 0 deleted mailboxes this user hasn't logged since a long time then he can't have deleted item less than one day older in the Deleted repertoire he has 178M of mail but as u can see nothing was deleted Could it be out of sync item what cyrus has "forgotten"? Le 24/05/2010 17:30, pablo ponce a écrit : > Hi, > > See cyr_expire with option -X: http://linux.die.net/man/8/cyr_expire > > > El 24/05/2010 16:38, Eric Doutreleau escribió: >> i m using cyrus 2.3.16 >> and in each spool on the same level as the user directory i have a >> directory whose name is DELETED. >> i am wondering what is this directory? >> it contains a mailbox hierarchy with some mails which are very old >> can i smoothly delete it? >> >> Cyrus Home Page: http://cyrusimap.web.cmu.edu/ >> Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki >> List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html > > > > > Cyrus Home Page: http://cyrusimap.web.cmu.edu/ > Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki > List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
what is the DELETED directory in spool
i m using cyrus 2.3.16 and in each spool on the same level as the user directory i have a directory whose name is DELETED. i am wondering what is this directory? it contains a mailbox hierarchy with some mails which are very old can i smoothly delete it? Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: bootstrapping replication
thanks for the advice gfor the bail out i hadn't the same number of partition in the master and in the replica. then i have another question i have 13 partitions on the master server. can i have only one on the replica or should i have the same number of partition? Le 10/05/2010 18:01, Wesley Craig a écrit : > On 10 May 2010, at 08:31, Eric Doutreleau wrote: >> /usr/lib/cyrus-imapd/sync_client -v -m user.doutrele >> >> i got >> >> MAILBOXES user.doutrele >> Error from do_mailboxes(): bailing out! >> >> the replica server is empty. Should i put him in sync with the master >> bedore starting replications? > > Depending on load, I'd advise pre-sync-ing all of your users & shared > mailboxes prior to starting rolling replication, e.g.: > > sync_client -luv user1 user2 ... > sync_client -lmv shared.mailbox1 shared.mailbox2 ... > > Then start rolling replication. This will prevent rolling replication > from getting so far behind that it thrashes. Mailboxes will still not be > entirely in sync at this point, so insert user and mailbox events into > the rolling replication log: > > cyr_synclog -u user > > Regarding the bail out, take a look at the logs on both the backend and > the replica. > > :wes Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
bootstrapping replication
Hi I have a working imap server which run the cyrus imapd 2.3.13 version I would like to setup replication to a new server. i have carefully follow the instruction in the install-replication. i have setup the sync_server and i can connect to it. the sync user is administrator on the remote server it can create mailboxes but when i run on the master /usr/lib/cyrus-imapd/sync_client -v -m user.doutrele i got MAILBOXES user.doutrele Error from do_mailboxes(): bailing out! the replica server is empty. Should i put him in sync with the master bedore starting replications? Thanks in advance for any help Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: lots of corruption of delived.db file
Well the problem is that during the recovery the delivery from my postfix servers is stopped. and it can be very annoying when the recover last around one hour users are complaning that mail didn't be delivered in time Andrew Morgan a écrit : > What makes you think the log messages indicate corruption? Those are > pretty standard messages if you log at DEBUG level. > > Andy > > On Tue, 13 Mar 2007, Eric Doutreleau wrote: > >> Peter P. Benac a écrit : >>> I have seen it. Just curious did you update your system lately. I >>> updated >>> mine yesterday for the new Timezone changes and have had trouble >>> since then. >>> Nothing like waiting till the last minute, but I had to do it. >>> >>> Regards, >>> Pete >>> >>> Peter P. Benac, CCNA >>> Emacolet Networking Services, Inc >>> Providing Network and Systems Project Management and Installation >>> and Web >>> Hosting. >>> Phone: 919-618-2557 >>> Web: http://www.emacolet.com >>> Need quick reliable Systems or Network Management advice visit >>> http://www.nmsusers.org >>> >>> To have principles... >>> First have courage.. With principles comes integrity!!! >>> -Original Message- >>> From: [EMAIL PROTECTED] >>> [mailto:[EMAIL PROTECTED] On Behalf Of Eric >>> Doutreleau >>> Sent: Monday, March 12, 2007 10:43 >>> To: info-cyrus@lists.andrew.cmu.edu >>> Subject: lots of corruption of delived.db file >>> >>> I'm using cyrus2.3.8 on a RHEL4 machine and from time to time i got >>> massive >>> corruption of deliverd.db file >>> >>> for example today >>> >>> Mar 12 15:27:13 pasargades lmtp[31407]: skiplist: checkpointed >>> /var/lib/imap/deliver.db (1282 records, 123104 bytes) in 5 seconds >>> Mar 12 >>> 15:27:18 pasargades lmtp[30946]: skiplist: recovered >>> /var/lib/imap/deliver.db (1282 records, 123104 bytes) in 5 seconds >>> Mar 12 >>> 15:27:24 pasargades lmtp[30948]: skiplist: checkpointed >>> /var/lib/imap/deliver.db (1289 records, 123800 bytes) in 6 seconds >>> Mar 12 >>> 15:27:28 pasargades lmtp[31407]: skiplist: recovered >>> /var/lib/imap/deliver.db (1289 records, 123800 bytes) in 4 seconds >>> Mar 12 >>> 15:27:35 pasargades lmtp[30981]: skiplist: checkpointed >>> /var/lib/imap/deliver.db (1300 records, 124788 bytes) in 7 seconds >>> Mar 12 >>> 15:27:40 pasargades lmtp[31677]: skiplist: recovered >>> /var/lib/imap/deliver.db (1300 records, 124788 bytes) in 5 seconds >>> Mar 12 >>> 15:28:20 pasargades lmtp[31679]: skiplist: checkpointed >>> /var/lib/imap/deliver.db (2541 records, 244756 bytes) in 11 seconds >>> Mar 12 >>> 15:28:26 pasargades lmtp[31675]: skiplist: recovered >>> /var/lib/imap/deliver.db (2541 records, 244756 bytes) in 6 seconds >>> Mar 12 >>> 15:28:38 pasargades lmtp[30947]: skiplist: checkpointed >>> /var/lib/imap/deliver.db (2578 records, 248632 bytes) in 11 seconds >>> Mar 12 >>> 15:28:45 pasargades lmtp[30951]: skiplist: recovered >>> /var/lib/imap/deliver.db (2578 records, 248632 bytes) in 7 seconds >>> Mar 12 >>> 15:29:01 pasargades lmtp[31676]: skiplist: checkpointed >>> /var/lib/imap/deliver.db (2622 records, 253440 bytes) in 15 seconds >>> Mar 12 >>> 15:29:08 pasargades lmtp[31678]: skiplist: recovered >>> /var/lib/imap/deliver.db (2622 records, 253440 bytes) in 7 seconds >>> Mar 12 >>> 15:29:22 pasargades lmtp[31462]: skiplist: checkpointed >>> /var/lib/imap/deliver.db (2699 records, 260880 bytes) in 12 seconds >>> Mar 12 >>> 15:29:31 pasargades lmtp[31678]: skiplist: recovered >>> /var/lib/imap/deliver.db (2699 records, 260880 bytes) in 9 seconds >>> Mar 12 >>> 15:29:43 pasargades lmtp[30952]: skiplist: checkpointed >>> /var/lib/imap/deliver.db (2706 records, 261556 bytes) in 12 seconds >>> Mar 12 >>> 15:29:49 pasargades lmtp[31679]: skiplist: recovered >>> /var/lib/imap/deliver.db (2706 records, 261556 bytes) in 6 seconds >>> Mar 12 >>> 15:30:03 pasargades lmtp[30950]: skiplist: checkpointed >>> /var/lib/imap/deliver.db (2720 records, 263040 bytes) in 14 seconds >>> Mar 12 >>> 15:30:11 pasargades lmtp[30981]: skiplist: recovered >>> /var/lib/imap/deliver.db (2720 records, 263040 bytes) in 8 seconds >>> >>> cyrus recover by itself but the problem is that whe
Re: lots of corruption of delived.db file
Peter P. Benac a écrit : I have seen it. Just curious did you update your system lately. I updated mine yesterday for the new Timezone changes and have had trouble since then. Nothing like waiting till the last minute, but I had to do it. Regards, Pete Peter P. Benac, CCNA Emacolet Networking Services, Inc Providing Network and Systems Project Management and Installation and Web Hosting. Phone: 919-618-2557 Web: http://www.emacolet.com Need quick reliable Systems or Network Management advice visit http://www.nmsusers.org To have principles... First have courage.. With principles comes integrity!!! -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Eric Doutreleau Sent: Monday, March 12, 2007 10:43 To: info-cyrus@lists.andrew.cmu.edu Subject: lots of corruption of delived.db file I'm using cyrus2.3.8 on a RHEL4 machine and from time to time i got massive corruption of deliverd.db file for example today Mar 12 15:27:13 pasargades lmtp[31407]: skiplist: checkpointed /var/lib/imap/deliver.db (1282 records, 123104 bytes) in 5 seconds Mar 12 15:27:18 pasargades lmtp[30946]: skiplist: recovered /var/lib/imap/deliver.db (1282 records, 123104 bytes) in 5 seconds Mar 12 15:27:24 pasargades lmtp[30948]: skiplist: checkpointed /var/lib/imap/deliver.db (1289 records, 123800 bytes) in 6 seconds Mar 12 15:27:28 pasargades lmtp[31407]: skiplist: recovered /var/lib/imap/deliver.db (1289 records, 123800 bytes) in 4 seconds Mar 12 15:27:35 pasargades lmtp[30981]: skiplist: checkpointed /var/lib/imap/deliver.db (1300 records, 124788 bytes) in 7 seconds Mar 12 15:27:40 pasargades lmtp[31677]: skiplist: recovered /var/lib/imap/deliver.db (1300 records, 124788 bytes) in 5 seconds Mar 12 15:28:20 pasargades lmtp[31679]: skiplist: checkpointed /var/lib/imap/deliver.db (2541 records, 244756 bytes) in 11 seconds Mar 12 15:28:26 pasargades lmtp[31675]: skiplist: recovered /var/lib/imap/deliver.db (2541 records, 244756 bytes) in 6 seconds Mar 12 15:28:38 pasargades lmtp[30947]: skiplist: checkpointed /var/lib/imap/deliver.db (2578 records, 248632 bytes) in 11 seconds Mar 12 15:28:45 pasargades lmtp[30951]: skiplist: recovered /var/lib/imap/deliver.db (2578 records, 248632 bytes) in 7 seconds Mar 12 15:29:01 pasargades lmtp[31676]: skiplist: checkpointed /var/lib/imap/deliver.db (2622 records, 253440 bytes) in 15 seconds Mar 12 15:29:08 pasargades lmtp[31678]: skiplist: recovered /var/lib/imap/deliver.db (2622 records, 253440 bytes) in 7 seconds Mar 12 15:29:22 pasargades lmtp[31462]: skiplist: checkpointed /var/lib/imap/deliver.db (2699 records, 260880 bytes) in 12 seconds Mar 12 15:29:31 pasargades lmtp[31678]: skiplist: recovered /var/lib/imap/deliver.db (2699 records, 260880 bytes) in 9 seconds Mar 12 15:29:43 pasargades lmtp[30952]: skiplist: checkpointed /var/lib/imap/deliver.db (2706 records, 261556 bytes) in 12 seconds Mar 12 15:29:49 pasargades lmtp[31679]: skiplist: recovered /var/lib/imap/deliver.db (2706 records, 261556 bytes) in 6 seconds Mar 12 15:30:03 pasargades lmtp[30950]: skiplist: checkpointed /var/lib/imap/deliver.db (2720 records, 263040 bytes) in 14 seconds Mar 12 15:30:11 pasargades lmtp[30981]: skiplist: recovered /var/lib/imap/deliver.db (2720 records, 263040 bytes) in 8 seconds cyrus recover by itself but the problem is that when the deliver.db grows it take about one hour to recover and the delivery of mail is stopped. Has someone already seen that and have an idea on how to solve the problem. thank in advance for any help Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html No i didn't update my timezone. I always had these kind of problem but the intensity is variable Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
lots of corruption of delived.db file
I'm using cyrus2.3.8 on a RHEL4 machine and from time to time i got massive corruption of deliverd.db file for example today Mar 12 15:27:13 pasargades lmtp[31407]: skiplist: checkpointed /var/lib/imap/deliver.db (1282 records, 123104 bytes) in 5 seconds Mar 12 15:27:18 pasargades lmtp[30946]: skiplist: recovered /var/lib/imap/deliver.db (1282 records, 123104 bytes) in 5 seconds Mar 12 15:27:24 pasargades lmtp[30948]: skiplist: checkpointed /var/lib/imap/deliver.db (1289 records, 123800 bytes) in 6 seconds Mar 12 15:27:28 pasargades lmtp[31407]: skiplist: recovered /var/lib/imap/deliver.db (1289 records, 123800 bytes) in 4 seconds Mar 12 15:27:35 pasargades lmtp[30981]: skiplist: checkpointed /var/lib/imap/deliver.db (1300 records, 124788 bytes) in 7 seconds Mar 12 15:27:40 pasargades lmtp[31677]: skiplist: recovered /var/lib/imap/deliver.db (1300 records, 124788 bytes) in 5 seconds Mar 12 15:28:20 pasargades lmtp[31679]: skiplist: checkpointed /var/lib/imap/deliver.db (2541 records, 244756 bytes) in 11 seconds Mar 12 15:28:26 pasargades lmtp[31675]: skiplist: recovered /var/lib/imap/deliver.db (2541 records, 244756 bytes) in 6 seconds Mar 12 15:28:38 pasargades lmtp[30947]: skiplist: checkpointed /var/lib/imap/deliver.db (2578 records, 248632 bytes) in 11 seconds Mar 12 15:28:45 pasargades lmtp[30951]: skiplist: recovered /var/lib/imap/deliver.db (2578 records, 248632 bytes) in 7 seconds Mar 12 15:29:01 pasargades lmtp[31676]: skiplist: checkpointed /var/lib/imap/deliver.db (2622 records, 253440 bytes) in 15 seconds Mar 12 15:29:08 pasargades lmtp[31678]: skiplist: recovered /var/lib/imap/deliver.db (2622 records, 253440 bytes) in 7 seconds Mar 12 15:29:22 pasargades lmtp[31462]: skiplist: checkpointed /var/lib/imap/deliver.db (2699 records, 260880 bytes) in 12 seconds Mar 12 15:29:31 pasargades lmtp[31678]: skiplist: recovered /var/lib/imap/deliver.db (2699 records, 260880 bytes) in 9 seconds Mar 12 15:29:43 pasargades lmtp[30952]: skiplist: checkpointed /var/lib/imap/deliver.db (2706 records, 261556 bytes) in 12 seconds Mar 12 15:29:49 pasargades lmtp[31679]: skiplist: recovered /var/lib/imap/deliver.db (2706 records, 261556 bytes) in 6 seconds Mar 12 15:30:03 pasargades lmtp[30950]: skiplist: checkpointed /var/lib/imap/deliver.db (2720 records, 263040 bytes) in 14 seconds Mar 12 15:30:11 pasargades lmtp[30981]: skiplist: recovered /var/lib/imap/deliver.db (2720 records, 263040 bytes) in 8 seconds cyrus recover by itself but the problem is that when the deliver.db grows it take about one hour to recover and the delivery of mail is stopped. Has someone already seen that and have an idea on how to solve the problem. thank in advance for any help Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: strange message in the cyrus log
Daniel Eckl a écrit : Hi! deliver.db is just used to suppress duplicate delivery and for suppressing sieve vacation mails coming more often that configured ("days" setting). So I'd suggest to stop cyrus and just delete deliver.db (and deliver.db.NEW if existing) and start cyrus again. Best, Daniel On 06.12.2006 19:13, Eric Doutreleau wrote: i m using cyrus2.3.6 in an RHEL box and this evening i saw the folowing message in the cyrus log files Dec 6 18:49:44 pasargades lmtp[18170]: skiplist: checkpointed /var/lib/imap/deliver.db (1381 records, 126228 bytes) in 8 seconds Dec 6 18:49:49 pasargades lmtp[18166]: skiplist: recovered /var/lib/imap/deliver.db (1381 records, 126228 bytes) in 5 seconds Dec 6 18:49:57 pasargades lmtp[18169]: skiplist: checkpointed /var/lib/imap/deliver.db (1394 records, 127436 bytes) in 8 seconds Dec 6 18:50:02 pasargades lmtp[18673]: skiplist: recovered /var/lib/imap/deliver.db (1394 records, 127436 bytes) in 5 seconds Dec 6 18:50:13 pasargades lmtp[18167]: skiplist: checkpointed /var/lib/imap/deliver.db (1441 records, 131392 bytes) in 10 seconds Dec 6 18:50:18 pasargades lmtp[18169]: skiplist: recovered /var/lib/imap/deliver.db (1441 records, 131392 bytes) in 5 seconds Dec 6 18:51:13 pasargades lmtp[18666]: skiplist: checkpointed /var/lib/imap/deliver.db (2876 records, 263196 bytes) in 13 seconds Dec 6 18:51:22 pasargades lmtp[18673]: skiplist: recovered /var/lib/imap/deliver.db (2876 records, 263196 bytes) in 9 seconds Dec 6 18:51:36 pasargades lmtp[18170]: skiplist: checkpointed /var/lib/imap/deliver.db (2945 records, 270112 bytes) in 12 seconds Dec 6 18:51:45 pasargades lmtp[18169]: skiplist: recovered /var/lib/imap/deliver.db (2945 records, 270112 bytes) in 9 seconds Dec 6 18:52:03 pasargades lmtp[18167]: skiplist: checkpointed /var/lib/imap/deliver.db (3050 records, 279660 bytes) in 16 seconds Dec 6 18:52:13 pasargades lmtp[18673]: skiplist: recovered /var/lib/imap/deliver.db (3050 records, 279660 bytes) in 10 seconds Dec 6 18:53:59 pasargades lmtp[18666]: skiplist: checkpointed /var/lib/imap/deliver.db (5741 records, 532436 bytes) in 29 seconds Dec 6 18:54:14 pasargades lmtp[18673]: skiplist: recovered /var/lib/imap/deliver.db (5741 records, 532436 bytes) in 15 seconds Dec 6 18:54:51 pasargades lmtp[18170]: skiplist: checkpointed /var/lib/imap/deliver.db (5992 records, 556372 bytes) in 27 seconds Dec 6 18:55:08 pasargades lmtp[18169]: skiplist: recovered /var/lib/imap/deliver.db (5992 records, 556372 bytes) in 17 seconds Dec 6 18:55:45 pasargades lmtp[19599]: skiplist: checkpointed /var/lib/imap/deliver.db (6253 records, 580284 bytes) in 32 seconds Dec 6 18:56:05 pasargades lmtp[18169]: skiplist: recovered /var/lib/imap/deliver.db (6253 records, 580284 bytes) in 20 seconds Dec 6 18:56:33 pasargades lmtp[19182]: skiplist: checkpointed /var/lib/imap/deliver.db (6284 records, 583028 bytes) in 28 seconds Dec 6 18:56:53 pasargades lmtp[19599]: skiplist: recovered /var/lib/imap/deliver.db (6284 records, 583028 bytes) in 20 seconds as you can see there s a lot of checkpoint and recovery of the deliverd.db database i can see during these operation a deliver.db file and a deliver.db.NEW file. the problem is that during this operation the delivery of mail is stopped. Should i upgrade to 2.3.7 version and has anybody have alrady that problem? thanks in advance for any help Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html well that s just i do but the corruption is very fast to happened sometimes and i m not always on the mail server to do that. Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
strange message in the cyrus log
i m using cyrus2.3.6 in an RHEL box and this evening i saw the folowing message in the cyrus log files Dec 6 18:49:44 pasargades lmtp[18170]: skiplist: checkpointed /var/lib/imap/deliver.db (1381 records, 126228 bytes) in 8 seconds Dec 6 18:49:49 pasargades lmtp[18166]: skiplist: recovered /var/lib/imap/deliver.db (1381 records, 126228 bytes) in 5 seconds Dec 6 18:49:57 pasargades lmtp[18169]: skiplist: checkpointed /var/lib/imap/deliver.db (1394 records, 127436 bytes) in 8 seconds Dec 6 18:50:02 pasargades lmtp[18673]: skiplist: recovered /var/lib/imap/deliver.db (1394 records, 127436 bytes) in 5 seconds Dec 6 18:50:13 pasargades lmtp[18167]: skiplist: checkpointed /var/lib/imap/deliver.db (1441 records, 131392 bytes) in 10 seconds Dec 6 18:50:18 pasargades lmtp[18169]: skiplist: recovered /var/lib/imap/deliver.db (1441 records, 131392 bytes) in 5 seconds Dec 6 18:51:13 pasargades lmtp[18666]: skiplist: checkpointed /var/lib/imap/deliver.db (2876 records, 263196 bytes) in 13 seconds Dec 6 18:51:22 pasargades lmtp[18673]: skiplist: recovered /var/lib/imap/deliver.db (2876 records, 263196 bytes) in 9 seconds Dec 6 18:51:36 pasargades lmtp[18170]: skiplist: checkpointed /var/lib/imap/deliver.db (2945 records, 270112 bytes) in 12 seconds Dec 6 18:51:45 pasargades lmtp[18169]: skiplist: recovered /var/lib/imap/deliver.db (2945 records, 270112 bytes) in 9 seconds Dec 6 18:52:03 pasargades lmtp[18167]: skiplist: checkpointed /var/lib/imap/deliver.db (3050 records, 279660 bytes) in 16 seconds Dec 6 18:52:13 pasargades lmtp[18673]: skiplist: recovered /var/lib/imap/deliver.db (3050 records, 279660 bytes) in 10 seconds Dec 6 18:53:59 pasargades lmtp[18666]: skiplist: checkpointed /var/lib/imap/deliver.db (5741 records, 532436 bytes) in 29 seconds Dec 6 18:54:14 pasargades lmtp[18673]: skiplist: recovered /var/lib/imap/deliver.db (5741 records, 532436 bytes) in 15 seconds Dec 6 18:54:51 pasargades lmtp[18170]: skiplist: checkpointed /var/lib/imap/deliver.db (5992 records, 556372 bytes) in 27 seconds Dec 6 18:55:08 pasargades lmtp[18169]: skiplist: recovered /var/lib/imap/deliver.db (5992 records, 556372 bytes) in 17 seconds Dec 6 18:55:45 pasargades lmtp[19599]: skiplist: checkpointed /var/lib/imap/deliver.db (6253 records, 580284 bytes) in 32 seconds Dec 6 18:56:05 pasargades lmtp[18169]: skiplist: recovered /var/lib/imap/deliver.db (6253 records, 580284 bytes) in 20 seconds Dec 6 18:56:33 pasargades lmtp[19182]: skiplist: checkpointed /var/lib/imap/deliver.db (6284 records, 583028 bytes) in 28 seconds Dec 6 18:56:53 pasargades lmtp[19599]: skiplist: recovered /var/lib/imap/deliver.db (6284 records, 583028 bytes) in 20 seconds as you can see there s a lot of checkpoint and recovery of the deliverd.db database i can see during these operation a deliver.db file and a deliver.db.NEW file. the problem is that during this operation the delivery of mail is stopped. Should i upgrade to 2.3.7 version and has anybody have alrady that problem? thanks in advance for any help Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
problem with this message lmtpd signaled to death by 11
hi i m using cyrus2.3.6 on a RHEL4 server the mail is delivered from a postfix server via lmtp from time to time i got that kind of message on the postfix side Nov 3 08:32:12 sodome postfix/lmtp[30982]: 021B618D6F6: to=<[EMAIL PROTECTED] nt-evry.fr>, orig_to=<[EMAIL PROTECTED]>, relay=molure.int-evry.fr[157.15 9.10.18], delay=418045, status=deferred (lost connection with molure.int-evry.fr [157.159.10.18] while sending end of data -- message may be sent more than once) on the cyrus side i got this message Nov 3 08:32:00 pasargades lmtp[27525]: dupelim: eliminated duplicate message to forum_eq id <[EMAIL PROTECTED]> (redirect) Nov 3 08:32:00 pasargades last message repeated 97 times Nov 3 08:32:01 pasargades master[22291]: process 27525 exited, signaled to deat h by 11 the forum_eq user has a huge sieve filter that redirects the mail to 111 persons and the effect of all that is that some of this users received several times the same mail. Does someone know how to solve this problem? thanks in advance for any help Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: sieveshell -a -u doesn't work as it should (bug?)
Rudy Gevaert a écrit : Andreas Winkelmann wrote: Ok, please remove the "LOGIN" Mechanism from sasl_mech_list. # Authentication configuration sasl_pwcheck_method: saslauthd sasl_mech_list: PLAIN LOGIN "LOGIN" is not able to do authorization (-a cyrus -u user). Only PLAIN and DIGEST-MD5 can do that. Because you use saslauthd, you are bound to PLAIN. I would guess, the first time you type the Password "LOGIN" is used, the second time "PLAIN". Thanks your advice provided the solution! Rudy i have the same problem than u but when i remove the LOGIN mechanism windows users can't logged anymore :( is there a way to remove the LOGIN mechanism only for sieve connection? Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
what is the best way to migrate
Well we re planning to change our old cyrus imap server to a brand new one and we re wondering what would be the best way to do that. our old server is based on a cyrus 2.2.10 and we will migrate to a 2.3.6 version. we have to copy the mailboxes from an old disks to new ones with a different partition layout we move from 26 partiton to 4 partitions. we would love to keep the state of messages in our users folders and to minimize the downtine. what is the best way to migrate? Thanks in advance for any help Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
problem with ltmp and cyrus (lmtp read timeout)
Hi i have two server that are running postfix 2.1.4 and one cyrus imap server that is running 2.2.8 version and from time to time i got the infamous lmtp read timeout for lmtp delivery. on the same time on the cyrus server i got the following messages Sep 20 16:53:06 molure lmtp[12356]: DBERROR db4: 167 lockers Sep 20 17:07:45 molure lmtp[13569]: DBERROR db4: 161 lockers Sep 20 17:07:45 molure lmtp[13568]: DBERROR db4: 164 lockers Sep 20 17:07:45 molure lmtp[13569]: DBERROR db4: 164 lockers Sep 20 17:07:46 molure lmtp[13580]: DBERROR db4: 165 lockers the number can increase more and i see more than 600 lockers. here is the format i use for the database CONFIG_DB_DUPLICATE=berkeley CONFIG_DB_MBOX=skiplist CONFIG_DB_SEEN=skiplist CONFIG_DB_SUBS=flat CONFIG_DB_TLS=berkeley CONFIG_DB_ANNOTATION=skiplist CONFIG_DB_SIEVE=2.2.3 It seems to me that the verification of duplicate delivery is a bit too long for certain mail. I have seen that some people on the liste had that kind of problem but never seen a solution posted. Does someone knows how to adress that problem? Thanks in advance for any help P.S the DB4 version is 4.2.52 --- Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
problem with cyrus and DB4
hi i m using cyrus2.2.8 and berkeley DB 4.2.52 on a Fedora core 2 machine and i have the following problem. i always got the message in my cyrus logfile Aug 23 04:36:14 molure lmtp[29038]: DBERROR db4: 1326 lockers with the number increasing and not really decreasing. I have seen in the archive of the list that there s a bug with some version of the db4 library and that the number is not reliable. is the bug still present in db4? Worse from time to time i got the following error Aug 23 04:55:25 molure lmtp[29514]: DBERROR db4: Logging region out of memory; you may need to increase its size Aug 23 04:55:25 molure lmtp[29514]: DBERROR: opening /var/lib/imap/deliver.db: Cannot allocate memory Aug 23 04:55:25 molure lmtp[29514]: DBERROR: opening /var/lib/imap/deliver.db: cyrusdb error and the delivery doesn't work anymore. I just restart cyrus and it s ok. Should i delete too the deliver.db database? Here is my DB_CONFIG file set_cachesize 0 8192000 1 set_lg_regionmax 2097152 set_lg_bsize 2097152 is it ok? Thanks in advance for any help --- Cyrus Home Page: http://asg.web.cmu.edu/cyrus Cyrus Wiki/FAQ: http://cyruswiki.andrew.cmu.edu List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Trafficaccounting in a mysql db ?
On Mon, 24 Mar 2003, Christian Schulte wrote: Hi I'm interesting to test that fonctionnality. My boss keep bugging me to have some sort of statistics about the use of cyrus imap server. > Hello, > > I wrote a patch which enables one to do traffic logging into a mysql > database. (mainly lib/prot.c lib/prot.h) The table in which that happens > could look something like: > > CREATE TABLE cyrus_accounting ( >id int(11) NOT NULL auto_increment, >login varchar(128) NOT NULL default '', >service > enum('IMAP','POP','OTHER','FILESYSTEM','BACKEND','LMTP','DELIVER','LMTP_FILESYSTEM','LMTP_TEMP','LMTP_SHUTDOWN','SHUTDOWN') > > NOT NULL default 'OTHER', >bytes double NOT NULL default '0', >type enum('IN','OUT') NOT NULL default 'UNSPECIFIED', >connect_time datetime default NULL, >disconnect_time datetime NOT NULL default '-00-00 00:00:00', >PRIMARY KEY (id), >KEY stamp (connect_time), >KEY login (login) > ) TYPE=InnoDB; > > If anybody has interest in that I could post the patch. I would have to > do some changes to make everything configurable in the imapd.conf file > first so that I cannot post the patch unchanged for now and wanted to > ask first. > > --Christian-- > > -- Eric Doutreleau I.N.T | Tel : +33 (0) 160764687 9 rue Charles Fourier | Fax : +33 (0) 160764321 91011 Evry France | email : [EMAIL PROTECTED]
Re: ctl_cyrusdb -r takes too long
On Sat, 14 Dec 2002, Jatin Nansi wrote: Hi Have you checked if the checkpoint are really done. I had that kind of problem twice and each time the ctl_cyrusdb -r take long because it was several days the checkpoint wasn't made. I didn ' solve the problem but i never got it again. I have made a script wich periodically check if the checkpoint is done. If not the cyrus-imapd is restart the night after. As the checkpoint is not made for less than a day it take less than an hour to restart. I think this problem is not related to cyrus but moreover of the db3 database. It s kind of database corruption that prevet the checkpoint to be made. > Hi, > > This is for cyrus gurus and for record: > > --- > Dec 13 20:10:21 mail3 master[4574]: process started > Dec 13 20:10:21 mail3 master[4575]: about to exec /usr/cyrus/bin/ctl_cyrusdb > Dec 13 20:10:21 mail3 ctl_cyrusdb[4575]: recovering cyrus databases > Dec 14 06:15:11 mail3 ctl_cyrusdb[4575]: done recovering cyrus databases > Dec 14 06:15:11 mail3 master[4574]: ready for work > Dec 14 06:15:11 mail3 master[4979]: about to exec /usr/cyrus/bin/ctl_cyrusdb > Dec 14 06:15:11 mail3 master[4982]: about to exec /usr/cyrus/bin/imapd > Dec 14 06:15:11 mail3 master[4983]: about to exec /usr/cyrus/bin/imapd > Dec 14 06:15:11 mail3 master[4984]: about to exec /usr/cyrus/bin/lmtpd > Dec 14 06:15:11 mail3 master[4985]: about to exec /usr/cyrus/bin/lmtpd > Dec 14 06:15:11 mail3 master[4981]: about to exec /usr/cyrus/bin/tls_prune > Dec 14 06:15:11 mail3 master[4980]: about to exec /usr/cyrus/bin/ctl_deliver > Dec 14 06:15:11 mail3 ctl_cyrusdb[4979]: checkpointing cyrus databases > Dec 14 06:15:11 mail3 lmtpunix[4985]: executed > Dec 14 06:15:11 mail3 lmtp[4984]: executed > Dec 14 06:15:11 mail3 tls_prune[4981]: mydelete: starting txn 2147483653 > --- > > Will ctl_cyrusdb -r take 10 hours ? I dread the day when the system will > need downtime again. > > This is on a decent 2 x P3 1 GHz with 100 GB scsi raid and 1 GB RAM, > about 2000 users, 50 MB per user. > > I really need reboot times to be between 5 to 10 minutes, as against 10 > hours. I will set the checkpoint period to 5 minutes as per the FAQ, but > are there any other pointers ? > > Jatin > > > > > Jatin Nansi wrote: > > > Hi, > > > > I have a cyrus IMAP system here which is taking way too long to start > > up, stopping just at ctl_cyrusdb -r. There does not seem to be any > > activity going on, but ctl_cyrusdb just doesnot exit. > > > > I am running cyrus-imapd-2.1.8 on a redhat 7.3 system. The backend > > database is DB3. > > > > I need some directions on what could be wrong and where ? Is it normal > > for ctl_cyrusdb -r to take as much as 1 hr (and still running) to > > finish ? > > > > Jatin > > > > > -- Eric Doutreleau I.N.T | Tel : +33 (0) 160764687 9 rue Charles Fourier | Fax : +33 (0) 160764321 91011 Evry France | email : [EMAIL PROTECTED]
Re: informing users about quotas
On Mon, 10 Feb 2003, John Alton Tamplin wrote: Hi Thanks for your answer I m interested by your code to test it and perhaps use it :) > [EMAIL PROTECTED] wrote: > > >What is your custom delivery program? > >I'm interested in that kind of solution but i didn't found yet a deliver > >program for postfix that use lmtp and can add the ignorequota option. > > > It is a small perl program that uses Net::LMTP (hacked to support > authentication and the ignorequota option), which also does things like > strip nulls and reformat envelope from addresses that contain quotes. > I'll be happy to send it and the patches to Net::LMTP if you are > interested. Beware since it uses a TCP socket rather than a Unix socket > authentication is required and performance is slightly impacted. It > also has code to proxy the LMTP connection to multiple destination mail > servers, which we used along with perdition to transition accounts one > at a time. > > -- Eric Doutreleau I.N.T | Tel : +33 (0) 160764687 9 rue Charles Fourier | Fax : +33 (0) 160764321 91011 Evry France | email : [EMAIL PROTECTED]
Re: informing users about quotas
On Thu, 6 Feb 2003, John A. Tamplin wrote: > Quoting Hans Wilmer <[EMAIL PROTECTED]>: > > > how can users securely be informed about their quota usage? > > > > It seems to be left to the clients to ignore or to not ignore the > > warnings from cyrus. Unfortunately, the mozilla client ignores the > > warnings, and incoming mail would be silently rejected once the user > > is over quota. > > > > Is there a tool (for cyrus 1.5.x as comes with Debian Woody) that > > could be run by cron to send the users who are about to reach their > > quota limit a warning message? > > What we do is run a perl script that parses the output of quota and sends email > to everyone over quota. Our custom delivery program recognizes the from address > (our help desk) and sets the ignorequota option on the LMTP connection so the > mail is delivered regardless. > > Even before we had that running, the users who were over quota noticed pretty > quickly they weren't getting mail and called the help desk :). > > What is your custom delivery program? I'm interested in that kind of solution but i didn't found yet a deliver program for postfix that use lmtp and can add the ignorequota option. -- Eric Doutreleau I.N.T | Tel : +33 (0) 160764687 9 rue Charles Fourier | Fax : +33 (0) 160764321 91011 Evry France | email : [EMAIL PROTECTED]
problem with checkpoint of databases
Hi i m using the following cyrus version name : Cyrus IMAPD version: v2.1.5 2002/06/24 19:13:27 vendor : Project Cyrus support-url: http://asg.web.cmu.edu/cyrus os : Linux os-version : 2.4.18-5 environment: Cyrus SASL 2.1.5 Sleepycat Software: Berkeley DB 3.3.11: (July 12, 2001) OpenSSL 0.9.6b [engine] 9 Jul 2001 CMU Sieve 2.2 TCP Wrappers lock = flock auth = unix idle = poll mboxlist.db = db3 subs.db = flat seen.db = flat duplicate.db = db3-nosync tls.db = db3-nosync and i have from time to time big problems with checkpoint Indeed for a reason i can't determine the process ctl_cyrusdb -c never finish. As this process is launched every 30 minutes i got several dozens of that process before becoming aware of that problem. But the worse happens when i have to restart the server. Indeed as the checkpoint didn't succeed there were a lot of file named log.000xxx and the server become unavailable a long time waiting for the command ctl_cyrusdb -r to finish. it takes around one hour per day of failure of checkpointing to restart. -Is there a way to speedup that process? -will the changing the format of the database help to solve that problem? -what could cause the checkpoint to fail? Thanks in advance for any help. -- Eric Doutreleau I.N.T | Tel : +33 (0) 160764687 9 rue Charles Fourier | Fax : +33 (0) 160764321 91011 Evry France | email : [EMAIL PROTECTED]
Re: problems with authentification on sieveshell
On Fri, 15 Mar 2002, Eric Doutreleau wrote: Well i just discovered my mistake i should have launch sieveshell with the -u option > > hi > > I have problem with authentification with sieveshell > > Here is my configuration > linux redhat-7.2 > cyrus-imapd-2.0.16 > cyrus-sasl-1.5.24 > openldap-2.0.21 > nss_ldap-172 ( from redhat which contains pam-ldap) > > I have configured the imapd server to use pam and pam to > use ldap for authentification. > > Here is my imapd.conf file > configdirectory: /var/imap > partition-default: /var/spool/imap > admins: cyrus > allowanonymouslogin: no > > # To use the PAM for authentication (but not /etc/passwd or shadow), > change > # the following line to specify "pam" instead of "sasldb". > sasl_pwcheck_method: pam > > sievedir: /var/sieve > sieveusehomedir: no > > sendmail: /usr/sbin/sendmail > sasl_mech_list: PLAIN > > Here is my /usr/lib/sasl/Cyrus.conf file > pwcheck_method:pam > sasl_mech_list: PLAIN > > > when i launch imtest > imtest -u doutrele -a doutrele localhost > C: C01 CAPABILITY > S: * OK molure2.int-evry.fr Cyrus IMAP4 v2.0.16 server ready > S: * CAPABILITY IMAP4 IMAP4rev1 ACL QUOTA LITERAL+ NAMESPACE UIDPLUS ID > NO_ATOMIC_RENAME UNSELECT MULTIAPPEND SORT THREAD=ORDEREDSUBJECT > THREAD=REFERENCES IDLE X-NETSCAPE > S: C01 OK Completed > C: L01 LOGIN doutrele {8} > + go ahead > C: > L01 OK User logged in > Authenticated. > Security strength factor: 0 > > And it work quite well > > But when i use sieveshell i got the error > sieveshell -a doutrele -r PLAIN molure2 > connecting to molure2 > Please enter your password: > unable to connect to server: Authentication error at /usr/bin/sieveshell > line 149, line 1. > > When i telnet to the port 2000 > Trying 127.0.0.1... > Connected to localhost. > Escape character is '^]'. > "IMPLEMENTATION" "Cyrus timsieved v1.0.0" > "SASL" "PLAIN LOGIN" > "SIEVE" "fileinto reject envelope vacation imapflags notify subaddress > regex" > OK > > > I have seen through the mailling that people had the same problem as me > but i never see someone who find the solution > > > Thanks in advance for any help > > -- Eric Doutreleau I.N.T | Tel : +33 (0) 160764687 9 rue Charles Fourier | Fax : +33 (0) 160764321 91011 Evry France | email : [EMAIL PROTECTED]
problems with authentification on sieveshell
hi I have problem with authentification with sieveshell Here is my configuration linux redhat-7.2 cyrus-imapd-2.0.16 cyrus-sasl-1.5.24 openldap-2.0.21 nss_ldap-172 ( from redhat which contains pam-ldap) I have configured the imapd server to use pam and pam to use ldap for authentification. Here is my imapd.conf file configdirectory: /var/imap partition-default: /var/spool/imap admins: cyrus allowanonymouslogin: no # To use the PAM for authentication (but not /etc/passwd or shadow), change # the following line to specify "pam" instead of "sasldb". sasl_pwcheck_method: pam sievedir: /var/sieve sieveusehomedir: no sendmail: /usr/sbin/sendmail sasl_mech_list: PLAIN Here is my /usr/lib/sasl/Cyrus.conf file pwcheck_method:pam sasl_mech_list: PLAIN when i launch imtest imtest -u doutrele -a doutrele localhost C: C01 CAPABILITY S: * OK molure2.int-evry.fr Cyrus IMAP4 v2.0.16 server ready S: * CAPABILITY IMAP4 IMAP4rev1 ACL QUOTA LITERAL+ NAMESPACE UIDPLUS ID NO_ATOMIC_RENAME UNSELECT MULTIAPPEND SORT THREAD=ORDEREDSUBJECT THREAD=REFERENCES IDLE X-NETSCAPE S: C01 OK Completed C: L01 LOGIN doutrele {8} + go ahead C: L01 OK User logged in Authenticated. Security strength factor: 0 And it work quite well But when i use sieveshell i got the error sieveshell -a doutrele -r PLAIN molure2 connecting to molure2 Please enter your password: unable to connect to server: Authentication error at /usr/bin/sieveshell line 149, line 1. When i telnet to the port 2000 Trying 127.0.0.1... Connected to localhost. Escape character is '^]'. "IMPLEMENTATION" "Cyrus timsieved v1.0.0" "SASL" "PLAIN LOGIN" "SIEVE" "fileinto reject envelope vacation imapflags notify subaddress regex" OK I have seen through the mailling that people had the same problem as me but i never see someone who find the solution Thanks in advance for any help -- Eric Doutreleau I.N.T | Tel : +33 (0) 160764687 9 rue Charles Fourier | Fax : +33 (0) 160764321 91011 Evry France | email : [EMAIL PROTECTED]