RE: Sieve: Vacation not working (solved)
Well, I tried to enable this same feature this evening in sendmail, but ran into some problems. Forgive me as I am complete novice when it comes to enabling this feature in sendmail. I enabled this in my sendmail.cf, then got the following error: unknown mailer cyrusv2 I had a feeling this would happen, what exactly do I need to do to enable this mailer within sendmail? Thanks all. David Gottschalk UTS Email team david.gottsch...@emory.edu -Original Message- From: info-cyrus-bounces+dgottsc=emory@lists.andrew.cmu.edu [mailto:info-cyrus-bounces+dgottsc=emory@lists.andrew.cmu.edu] On Behalf Of Garry Sent: Wednesday, May 27, 2009 3:45 PM To: info-cyrus@lists.andrew.cmu.edu Subject: Re: Sieve: Vacation not working (solved) Well, found another post on this ... seems to be that depending on the way the MTA does the local delivery causes vacation (and only vacation) to work or not... Originally, I had this in my .mc file: define(`confLOCAL_MAILER', `cyrus')dnl ifdef(`CYRUS_MAILER_ARGS',, `define(`CYRUS_MAILER_ARGS', `deliver -e -f $f -m $h -- $u')') dnl MAILER(`cyrus')dnl After replacing this with: define(`confLOCAL_MAILER',`cyrusv2')dnl define(`CYRUSV2_MAILER_ARGS',`FILE /var/lib/imap/socket/lmtp')dnl MAILER(cyrusv2)dnl I finally got vacation replies from Cyrus ... -garry Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html This e-mail message (including any attachments) is for the sole use of the intended recipient(s) and may contain confidential and privileged information. If the reader of this message is not the intended recipient, you are hereby notified that any dissemination, distribution or copying of this message (including any attachments) is strictly prohibited. If you have received this message in error, please contact the sender by reply e-mail message and destroy all copies of the original message (including attachments). Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Can't connect to timsieved (2.3.14)
I seem to have worked around my earlier problem. For some reason, the Cyrus::SIEVE::managesieve Perl package didn't get properly compiled/installed when I first built Cyrus 2.3.14. I remade and installed this package and the "sieveshell" script, and sieveshell works for me now. And, using sieveshell, I am able to contact my mail server and manipulate Sieve scripts on it. So, my original, immediate problem appears to be solved. Sorry it was such a bizarre problem that no one else out there seemed to have any idea what to say about it. The bug may, in fact, be in "sieve-connect", not in the Cyrus code. But I'm still suspicious of a situation where sieve-connect may have done something which caused a timsieved process to crash mysteriously -- something which no client should be able to do to a server process. But whatever . . . . -- Rich Wales / ri...@richw.org / ri...@stanford.edu Wikipedia: http://en.wikipedia.org/wiki/User:Richwales Facebook: http://www.new.facebook.com/profile.php?id=206680 Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Can't connect to timsieved (2.3.14)
I'm still having this problem, though it appears to be intermittent. I was able, just now, to do "sivtest -v localhost" on my Cyrus server, and authenticate, and issue a Managesieve command (listscripts) and get a valid reply. But "sieve-connect --debug localhost" still fails with "no line read, connection dropped?" right after the AUTHENTICATE command. And when I tried "sivtest -v localhost" again, it failed right after saying "Asking for capabilities again since they might have changed" -- sometimes spewing out some unprintable garbage before complaining of some sort of SASL problem -- sometimes simply saying "failure: prot layer failure". This worked fine before I upgraded to Cyrus 2.3.14. Is something known to be broken in 2.3.14? Has anyone else out there ever seen anything like this? What should I try next? I'm stuck here and would be very grateful for any help. -- Rich Wales / ri...@richw.org / ri...@stanford.edu Wikipedia: http://en.wikipedia.org/wiki/User:Richwales Facebook: http://www.new.facebook.com/profile.php?id=206680 Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Painful performance on mupdate push (how long does yours take?)
On Wed, 27 May 2009, Michael Bacon wrote: > The first attempt was with skiplist, but I switched over to BDB to see if it > would do any better. If you don't mind, how many mailboxes do you have, and > how long does an initial push generally take, if you've had to do one > recently? We have about 170k mailboxes in total, split between 2 backends. The last time I had to do the initial push was several years ago when we converted our first standalone Cyrus server into a backend. There were probably fewer mailboxes at that time. I remember it taking around 30 minutes? My memory is kinda vague on this, sorry. Berkeley DB was quite a bit faster. Andy Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
RE: Sieve: Vacation not working (solved)
Good news! I'm thinking that is the same issue I have. I will be trying it out today off hours, and report what I find. David Gottschalk UTS Email team david.gottsch...@emory.edu -Original Message- From: info-cyrus-bounces+dgottsc=emory@lists.andrew.cmu.edu [mailto:info-cyrus-bounces+dgottsc=emory@lists.andrew.cmu.edu] On Behalf Of Garry Sent: Wednesday, May 27, 2009 3:45 PM To: info-cyrus@lists.andrew.cmu.edu Subject: Re: Sieve: Vacation not working (solved) Well, found another post on this ... seems to be that depending on the way the MTA does the local delivery causes vacation (and only vacation) to work or not... Originally, I had this in my .mc file: define(`confLOCAL_MAILER', `cyrus')dnl ifdef(`CYRUS_MAILER_ARGS',, `define(`CYRUS_MAILER_ARGS', `deliver -e -f $f -m $h -- $u')') dnl MAILER(`cyrus')dnl After replacing this with: define(`confLOCAL_MAILER',`cyrusv2')dnl define(`CYRUSV2_MAILER_ARGS',`FILE /var/lib/imap/socket/lmtp')dnl MAILER(cyrusv2)dnl I finally got vacation replies from Cyrus ... -garry Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html This e-mail message (including any attachments) is for the sole use of the intended recipient(s) and may contain confidential and privileged information. If the reader of this message is not the intended recipient, you are hereby notified that any dissemination, distribution or copying of this message (including any attachments) is strictly prohibited. If you have received this message in error, please contact the sender by reply e-mail message and destroy all copies of the original message (including attachments). Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Sieve: Vacation not working (solved)
Well, found another post on this ... seems to be that depending on the way the MTA does the local delivery causes vacation (and only vacation) to work or not... Originally, I had this in my .mc file: define(`confLOCAL_MAILER', `cyrus')dnl ifdef(`CYRUS_MAILER_ARGS',, `define(`CYRUS_MAILER_ARGS', `deliver -e -f $f -m $h -- $u')') dnl MAILER(`cyrus')dnl After replacing this with: define(`confLOCAL_MAILER',`cyrusv2')dnl define(`CYRUSV2_MAILER_ARGS',`FILE /var/lib/imap/socket/lmtp')dnl MAILER(cyrusv2)dnl I finally got vacation replies from Cyrus ... -garry Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Painful performance on mupdate push (how long does yours take?)
The first attempt was with skiplist, but I switched over to BDB to see if it would do any better. If you don't mind, how many mailboxes do you have, and how long does an initial push generally take, if you've had to do one recently? Thanks, Michael Bacon ITS Messaging UNC Chapel Hill --On May 27, 2009 9:21:36 AM -0700 Andrew Morgan wrote: > On Tue, 26 May 2009, Michael Bacon wrote: > >> We're in the last stages of getting off of our old single-server mail >> system into a murder environment, and we're currently at the point >> where the single old backend gets starts pushing its mb database to >> the mupdate server, so that we can move the main DNS pointer to the >> front-ends and start moving mailboxes over to other servers. >> >> Last Friday night, I tried that push for the first time, thinking it >> would take 10-20 minutes, tops (for an 850k line mailbox database, or >> about 75 MB). 3.5 hours later, it finally completed, and a subsequent >> ctl_mboxlist -m hung indefinitely, with neither side doing anything >> (as per truss). >> >> Since this was originally a push to a non-global Solaris zone >> connecting to a ZFS file system over the "local loopback" interface >> that Sun has for its zones, I tried to see if the problem went away by >> connecting to a vanilla Solaris install on UFS. Nope, still syncing >> on the order of 30-40k per minute. I tried shutting off the GSSAPI >> security layer (max SASL layer set to 0), same performance issue. >> Since all of this was on Sun CoolThreads hardware, I spent the last >> part of this afternoon trying to run it on an old school sparc box, >> but didn't get it running before I left for the day. >> >> Surely this isn't the kind of performance I should expect, right? For >> large sites, how long does an initial mboxlist push to the MUPDATE >> server usually take, and for how many lines? And is anyone else >> running a murder on Sun CoolThreads (Tx000, T5x20) server hardware? > > Which database format are you using for mailboxes.db? I found that > skiplist was very slow for writes compared to Berkeley DB. However this > push is only rarely done so it was still worth avoiding the hassle of > Berkeley DB. > > Andy Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Sieve: Vacation not working
On Wed, 27 May 2009, Garry wrote: > Can someone please clarify what process' job it is to generate the mail > by calling sendmail? Is it lmtpd which I assumed? I really need to stop > wasting time on looking at the wrong places and got to move on to more > important work ... lmtpd processes sieve scripts as messages are given to it, including sending vacation notices and reject emails. Andy Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Sieve: Vacation not working
Carsten Hoeger wrote: > On Wed, May 27, Garry wrote: > > >>> Also, the logfile created by this line: >>> [..] >>> doesn't show up right away either ... >>> >>> >> Actually, I just noticed that timsieved of course isn't even the process >> responsible for doing any filtering, but only for doing the back-end >> script stuff ... so I added the "-D" to the lmtpd line, which I _assume_ >> (please correct me if I'm wrong) is the process that actually should be >> doing the sieve checking and processing ... anyway, there was no sign >> that lmtpd attempted to do any sendmail interaction ... >> > > AFAIR the Mail headers must contain the addresses you specified in the > vacation rules. Did you check that? > Yes ... > Also keep in mind, that vacation mail is not sent, when sender and recipient > are the same. > No, tried sending from a multitude of different places, like GMX and GMail, my own servers, etc ... Can someone please clarify what process' job it is to generate the mail by calling sendmail? Is it lmtpd which I assumed? I really need to stop wasting time on looking at the wrong places and got to move on to more important work ... Tnx, -garry Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Painful performance on mupdate push (how long does yours take?)
On Tue, 26 May 2009, Michael Bacon wrote: > We're in the last stages of getting off of our old single-server mail > system into a murder environment, and we're currently at the point > where the single old backend gets starts pushing its mb database to > the mupdate server, so that we can move the main DNS pointer to the > front-ends and start moving mailboxes over to other servers. > > Last Friday night, I tried that push for the first time, thinking it > would take 10-20 minutes, tops (for an 850k line mailbox database, or > about 75 MB). 3.5 hours later, it finally completed, and a subsequent > ctl_mboxlist -m hung indefinitely, with neither side doing anything > (as per truss). > > Since this was originally a push to a non-global Solaris zone > connecting to a ZFS file system over the "local loopback" interface > that Sun has for its zones, I tried to see if the problem went away by > connecting to a vanilla Solaris install on UFS. Nope, still syncing > on the order of 30-40k per minute. I tried shutting off the GSSAPI > security layer (max SASL layer set to 0), same performance issue. > Since all of this was on Sun CoolThreads hardware, I spent the last > part of this afternoon trying to run it on an old school sparc box, > but didn't get it running before I left for the day. > > Surely this isn't the kind of performance I should expect, right? For > large sites, how long does an initial mboxlist push to the MUPDATE > server usually take, and for how many lines? And is anyone else > running a murder on Sun CoolThreads (Tx000, T5x20) server hardware? Which database format are you using for mailboxes.db? I found that skiplist was very slow for writes compared to Berkeley DB. However this push is only rarely done so it was still worth avoiding the hassle of Berkeley DB. Andy Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Sieve: Vacation not working
On Wed, 2009-05-27 at 16:35 +0200, Carsten Hoeger wrote: > On Wed, May 27, Garry wrote: > > > Also, the logfile created by this line: > > > [..] > > > doesn't show up right away either ... > > Actually, I just noticed that timsieved of course isn't even the process > > responsible for doing any filtering, but only for doing the back-end > > script stuff ... so I added the "-D" to the lmtpd line, which I _assume_ > > (please correct me if I'm wrong) is the process that actually should be > > doing the sieve checking and processing ... anyway, there was no sign > > that lmtpd attempted to do any sendmail interaction ... > AFAIR the Mail headers must contain the addresses you specified in the > vacation rules. Did you check that? His [custom] delivery mech is rewriting/inserting a Return-Path: to *himself* for *every* message. So when this message arrives in his INBOX the Return-Path will not be the sender (me) or even the list, but his address (the destination). That will break just about everything. > Also keep in mind, that vacation mail is not sent, when sender and recipient > are the same. Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Sieve: Vacation not working
On Wed, May 27, Garry wrote: > > Also, the logfile created by this line: > > [..] > > doesn't show up right away either ... > > > Actually, I just noticed that timsieved of course isn't even the process > responsible for doing any filtering, but only for doing the back-end > script stuff ... so I added the "-D" to the lmtpd line, which I _assume_ > (please correct me if I'm wrong) is the process that actually should be > doing the sieve checking and processing ... anyway, there was no sign > that lmtpd attempted to do any sendmail interaction ... AFAIR the Mail headers must contain the addresses you specified in the vacation rules. Did you check that? Also keep in mind, that vacation mail is not sent, when sender and recipient are the same. -- With best regards, Carsten Hoeger pgplHmVSCKyux.pgp Description: PGP signature Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Sieve: Vacation not working
> Also, the logfile created by this line: > [..] > doesn't show up right away either ... > Actually, I just noticed that timsieved of course isn't even the process responsible for doing any filtering, but only for doing the back-end script stuff ... so I added the "-D" to the lmtpd line, which I _assume_ (please correct me if I'm wrong) is the process that actually should be doing the sieve checking and processing ... anyway, there was no sign that lmtpd attempted to do any sendmail interaction ... Help, anybody? Tnx, -garry Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: [PATCH] closedir missing in timsieved
> On Tue, May 26, 2009 at 1:47 AM, Thomas Cataldo > wrote: >> Hello, >> >> While writing a sieve client lib for the minig (minig.org) webmail >> project, I triggered a bug in the LISTSCRIPTS implementation in cyrus >> 2.2 from debian etch. The directory seems to remain unclosed and this >> is a problem when prefork > 0 is set on timsieved. >> >> The attached patch should fix it. >> > > Same patch needed on 2.3 cvs : Hi, Looks like there is another closedir() missing. I posted the patch to https://bugzilla.andrew.cmu.edu/show_bug.cgi?id=3159 Regards, Simon Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html
Re: Sieve: Vacation not working
Adam Tauno Williams wrote: > On Tue, 2009-05-26 at 09:21 -0400, Gottschalk, David wrote: > >> See, I'm using this entirely custom deliver script in .procmailrc, and >> I think that is my problem. I think if Sieve doesn't get a proper from >> address, it will not reply. The question is how do you know if this is >> occurring? >> > > Sendmail has been able to perform LMTP delivery (no "deliver" required) > for a long time. > > >> You might try different configuration options of that. I've seen searching >> the web that some people had vacation reply issues with different >> configurations of the Cyrus mailer(s). >> >>> How do you hand off mail from Sendmail to Cyrus? I'm thinking that could be >>> my issue, maybe yours too. >>> >> I'm using the cyrus feature >> define(`confLOCAL_MAILER', `cyrus')dnl >> ifdef(`CYRUS_MAILER_ARGS',, >> `define(`CYRUS_MAILER_ARGS', `deliver -e -f $f -m $h -- $u')') >> in the mc file, and as the regular sorting seems to work (moving certain >> mails to other folders e.g.), as well as storing incoming mail in the >> appropriate inboxes, I assume the Cyrus interface as such should be >> working fine, as well as the Sieve call ... what puzzles me is that I >> don't even see Sieve attempt to deliever anything, at least not locally >> - plus I can't seem to find any config file that would contain >> definitions about what to do with mails generated by Sieve (like, e.g., >> what Mailserver to use) >> > > This is specified in imapd.conf via the "sendmail" directive. > Yes, found that in the meantime ... anyway, still no success ... according to the mail log, it's not being called, at least there are still no messages from it ... I enabled the debugging_command, using strace to get some infos on whether it is even trying to call sendmail ... from what I can tell, it doesn't even attempt to do anything ... is the vacation line valid the way it is in the script? Also, the logfile created by this line: debug_command: /usr/bin/strace -tt -f -s256 -o /tmp/strace.cyrus.%s.%d -p %2$d <&- 2>&1 & doesn't show up right away either ... Isn't there any way to make timsieved more verbose about what it's (not) doing and why? Tnx, -garry Cyrus Home Page: http://cyrusimap.web.cmu.edu/ Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html