RE: Sieve: Vacation not working (solved)

2009-05-27 Thread Gottschalk, David
Well, I tried to enable this same feature this evening in sendmail, but ran 
into some problems. Forgive me as I am complete novice when it comes to 
enabling this feature in sendmail. I enabled this in my sendmail.cf, then got 
the following error:

unknown mailer cyrusv2

I had a feeling this would happen, what exactly do I need to do to enable this 
mailer within sendmail?

Thanks all.

David Gottschalk
UTS Email team
david.gottsch...@emory.edu


-Original Message-
From: info-cyrus-bounces+dgottsc=emory@lists.andrew.cmu.edu 
[mailto:info-cyrus-bounces+dgottsc=emory@lists.andrew.cmu.edu] On Behalf Of 
Garry
Sent: Wednesday, May 27, 2009 3:45 PM
To: info-cyrus@lists.andrew.cmu.edu
Subject: Re: Sieve: Vacation not working (solved)

Well, found another post on this ... seems to be that depending on the
way the MTA does the local delivery causes vacation (and only vacation)
to work or not...

Originally, I had this in my .mc file:

define(`confLOCAL_MAILER', `cyrus')dnl
ifdef(`CYRUS_MAILER_ARGS',,
 `define(`CYRUS_MAILER_ARGS', `deliver -e -f $f -m $h -- $u')')
dnl MAILER(`cyrus')dnl

After replacing this with:

define(`confLOCAL_MAILER',`cyrusv2')dnl
define(`CYRUSV2_MAILER_ARGS',`FILE /var/lib/imap/socket/lmtp')dnl
MAILER(cyrusv2)dnl

I finally got vacation replies from Cyrus ...

-garry

Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html

This e-mail message (including any attachments) is for the sole use of
the intended recipient(s) and may contain confidential and privileged
information.  If the reader of this message is not the intended
recipient, you are hereby notified that any dissemination, distribution
or copying of this message (including any attachments) is strictly
prohibited.

If you have received this message in error, please contact
the sender by reply e-mail message and destroy all copies of the
original message (including attachments).

Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html


Re: Can't connect to timsieved (2.3.14)

2009-05-27 Thread Rich Wales
I seem to have worked around my earlier problem.

For some reason, the Cyrus::SIEVE::managesieve Perl package didn't get
properly compiled/installed when I first built Cyrus 2.3.14.  I remade
and installed this package and the "sieveshell" script, and sieveshell
works for me now.  And, using sieveshell, I am able to contact my mail
server and manipulate Sieve scripts on it.

So, my original, immediate problem appears to be solved.  Sorry it was
such a bizarre problem that no one else out there seemed to have any
idea what to say about it.

The bug may, in fact, be in "sieve-connect", not in the Cyrus code.
But I'm still suspicious of a situation where sieve-connect may have
done something which caused a timsieved process to crash mysteriously
-- something which no client should be able to do to a server process.
But whatever . . . .

-- 
Rich Wales  /  ri...@richw.org  /  ri...@stanford.edu
Wikipedia:  http://en.wikipedia.org/wiki/User:Richwales
Facebook:   http://www.new.facebook.com/profile.php?id=206680

Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html


Re: Can't connect to timsieved (2.3.14)

2009-05-27 Thread Rich Wales
I'm still having this problem, though it appears to be intermittent.

I was able, just now, to do "sivtest -v localhost" on my Cyrus server,
and authenticate, and issue a Managesieve command (listscripts) and
get a valid reply.

But "sieve-connect --debug localhost" still fails with "no line read,
connection dropped?" right after the AUTHENTICATE command.  And when
I tried "sivtest -v localhost" again, it failed right after saying
"Asking for capabilities again since they might have changed" --
sometimes spewing out some unprintable garbage before complaining
of some sort of SASL problem -- sometimes simply saying "failure:
prot layer failure".

This worked fine before I upgraded to Cyrus 2.3.14.  Is something
known to be broken in 2.3.14?  Has anyone else out there ever seen
anything like this?  What should I try next?  I'm stuck here and
would be very grateful for any help.

-- 
Rich Wales  /  ri...@richw.org  /  ri...@stanford.edu
Wikipedia:  http://en.wikipedia.org/wiki/User:Richwales
Facebook:   http://www.new.facebook.com/profile.php?id=206680

Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html


Re: Painful performance on mupdate push (how long does yours take?)

2009-05-27 Thread Andrew Morgan
On Wed, 27 May 2009, Michael Bacon wrote:

> The first attempt was with skiplist, but I switched over to BDB to see if it 
> would do any better.  If you don't mind, how many mailboxes do you have, and 
> how long does an initial push generally take, if you've had to do one 
> recently?

We have about 170k mailboxes in total, split between 2 backends.  The last 
time I had to do the initial push was several years ago when we converted 
our first standalone Cyrus server into a backend.  There were probably 
fewer mailboxes at that time.

I remember it taking around 30 minutes?  My memory is kinda vague on this, 
sorry.  Berkeley DB was quite a bit faster.

Andy

Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html


RE: Sieve: Vacation not working (solved)

2009-05-27 Thread Gottschalk, David
Good news!

I'm thinking that is the same issue I have.

I will be trying it out today off hours, and report what I find.

David Gottschalk
UTS Email team
david.gottsch...@emory.edu


-Original Message-
From: info-cyrus-bounces+dgottsc=emory@lists.andrew.cmu.edu 
[mailto:info-cyrus-bounces+dgottsc=emory@lists.andrew.cmu.edu] On Behalf Of 
Garry
Sent: Wednesday, May 27, 2009 3:45 PM
To: info-cyrus@lists.andrew.cmu.edu
Subject: Re: Sieve: Vacation not working (solved)

Well, found another post on this ... seems to be that depending on the
way the MTA does the local delivery causes vacation (and only vacation)
to work or not...

Originally, I had this in my .mc file:

define(`confLOCAL_MAILER', `cyrus')dnl
ifdef(`CYRUS_MAILER_ARGS',,
 `define(`CYRUS_MAILER_ARGS', `deliver -e -f $f -m $h -- $u')')
dnl MAILER(`cyrus')dnl

After replacing this with:

define(`confLOCAL_MAILER',`cyrusv2')dnl
define(`CYRUSV2_MAILER_ARGS',`FILE /var/lib/imap/socket/lmtp')dnl
MAILER(cyrusv2)dnl

I finally got vacation replies from Cyrus ...

-garry

Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html

This e-mail message (including any attachments) is for the sole use of
the intended recipient(s) and may contain confidential and privileged
information.  If the reader of this message is not the intended
recipient, you are hereby notified that any dissemination, distribution
or copying of this message (including any attachments) is strictly
prohibited.

If you have received this message in error, please contact
the sender by reply e-mail message and destroy all copies of the
original message (including attachments).

Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html


Re: Sieve: Vacation not working (solved)

2009-05-27 Thread Garry
Well, found another post on this ... seems to be that depending on the
way the MTA does the local delivery causes vacation (and only vacation)
to work or not...

Originally, I had this in my .mc file:

define(`confLOCAL_MAILER', `cyrus')dnl
ifdef(`CYRUS_MAILER_ARGS',,
 `define(`CYRUS_MAILER_ARGS', `deliver -e -f $f -m $h -- $u')')
dnl MAILER(`cyrus')dnl

After replacing this with:

define(`confLOCAL_MAILER',`cyrusv2')dnl
define(`CYRUSV2_MAILER_ARGS',`FILE /var/lib/imap/socket/lmtp')dnl
MAILER(cyrusv2)dnl

I finally got vacation replies from Cyrus ...

-garry

Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html


Re: Painful performance on mupdate push (how long does yours take?)

2009-05-27 Thread Michael Bacon
The first attempt was with skiplist, but I switched over to BDB to see if 
it would do any better.  If you don't mind, how many mailboxes do you have, 
and how long does an initial push generally take, if you've had to do one 
recently?

Thanks,
Michael Bacon
ITS Messaging
UNC Chapel Hill

--On May 27, 2009 9:21:36 AM -0700 Andrew Morgan  wrote:

> On Tue, 26 May 2009, Michael Bacon wrote:
>
>> We're in the last stages of getting off of our old single-server mail
>> system into a murder environment, and we're currently at the point
>> where the single old backend gets starts pushing its mb database to
>> the mupdate server, so that we can move the main DNS pointer to the
>> front-ends and start moving mailboxes over to other servers.
>>
>> Last Friday night, I tried that push for the first time, thinking it
>> would take 10-20 minutes, tops (for an 850k line mailbox database, or
>> about 75 MB).  3.5 hours later, it finally completed, and a subsequent
>> ctl_mboxlist -m hung indefinitely, with neither side doing anything
>> (as per truss).
>>
>> Since this was originally a push to a non-global Solaris zone
>> connecting to a ZFS file system over the "local loopback" interface
>> that Sun has for its zones, I tried to see if the problem went away by
>> connecting to a vanilla Solaris install on UFS.  Nope, still syncing
>> on the order of 30-40k per minute.  I tried shutting off the GSSAPI
>> security layer (max SASL layer set to 0), same performance issue.
>> Since all of this was on Sun CoolThreads hardware, I spent the last
>> part of this afternoon trying to run it on an old school sparc box,
>> but didn't get it running before I left for the day.
>>
>> Surely this isn't the kind of performance I should expect, right?  For
>> large sites, how long does an initial mboxlist push to the MUPDATE
>> server usually take, and for how many lines?  And is anyone else
>> running a murder on Sun CoolThreads (Tx000, T5x20) server hardware?
>
> Which database format are you using for mailboxes.db?  I found that
> skiplist was very slow for writes compared to Berkeley DB.  However this
> push is only rarely done so it was still worth avoiding the hassle of
> Berkeley DB.
>
>   Andy





Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html


Re: Sieve: Vacation not working

2009-05-27 Thread Andrew Morgan
On Wed, 27 May 2009, Garry wrote:

> Can someone please clarify what process' job it is to generate the mail
> by calling sendmail? Is it lmtpd which I assumed? I really need to stop
> wasting time on looking at the wrong places and got to move on to more
> important work ...

lmtpd processes sieve scripts as messages are given to it, including 
sending vacation notices and reject emails.

Andy

Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html


Re: Sieve: Vacation not working

2009-05-27 Thread Garry
Carsten Hoeger wrote:
> On Wed, May 27, Garry wrote:
>
>   
>>> Also, the logfile created by this line:
>>> [..]
>>> doesn't show up right away either ...
>>>   
>>>   
>> Actually, I just noticed that timsieved of course isn't even the process
>> responsible for doing any filtering, but only for doing the back-end
>> script stuff ... so I added the "-D" to the lmtpd line, which I _assume_
>> (please correct me if I'm wrong) is the process that actually should be
>> doing the sieve checking and processing ... anyway, there was no sign
>> that lmtpd attempted to do any sendmail interaction ...
>> 
>
> AFAIR the Mail headers must contain the addresses you specified in the
> vacation rules. Did you check that?
>   
Yes ...
> Also keep in mind, that vacation mail is not sent, when sender and recipient
> are the same.
>   
No, tried sending from a multitude of different places, like GMX and
GMail, my own servers, etc ...

Can someone please clarify what process' job it is to generate the mail
by calling sendmail? Is it lmtpd which I assumed? I really need to stop
wasting time on looking at the wrong places and got to move on to more
important work ...

Tnx, -garry

Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html


Re: Painful performance on mupdate push (how long does yours take?)

2009-05-27 Thread Andrew Morgan
On Tue, 26 May 2009, Michael Bacon wrote:

> We're in the last stages of getting off of our old single-server mail
> system into a murder environment, and we're currently at the point
> where the single old backend gets starts pushing its mb database to
> the mupdate server, so that we can move the main DNS pointer to the
> front-ends and start moving mailboxes over to other servers.
>
> Last Friday night, I tried that push for the first time, thinking it
> would take 10-20 minutes, tops (for an 850k line mailbox database, or
> about 75 MB).  3.5 hours later, it finally completed, and a subsequent
> ctl_mboxlist -m hung indefinitely, with neither side doing anything
> (as per truss).
>
> Since this was originally a push to a non-global Solaris zone
> connecting to a ZFS file system over the "local loopback" interface
> that Sun has for its zones, I tried to see if the problem went away by
> connecting to a vanilla Solaris install on UFS.  Nope, still syncing
> on the order of 30-40k per minute.  I tried shutting off the GSSAPI
> security layer (max SASL layer set to 0), same performance issue.
> Since all of this was on Sun CoolThreads hardware, I spent the last
> part of this afternoon trying to run it on an old school sparc box,
> but didn't get it running before I left for the day.
>
> Surely this isn't the kind of performance I should expect, right?  For
> large sites, how long does an initial mboxlist push to the MUPDATE
> server usually take, and for how many lines?  And is anyone else
> running a murder on Sun CoolThreads (Tx000, T5x20) server hardware?

Which database format are you using for mailboxes.db?  I found that 
skiplist was very slow for writes compared to Berkeley DB.  However this 
push is only rarely done so it was still worth avoiding the hassle of 
Berkeley DB.

Andy

Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html


Re: Sieve: Vacation not working

2009-05-27 Thread Adam Tauno Williams
On Wed, 2009-05-27 at 16:35 +0200, Carsten Hoeger wrote:
> On Wed, May 27, Garry wrote:
> > > Also, the logfile created by this line:
> > > [..]
> > > doesn't show up right away either ...
> > Actually, I just noticed that timsieved of course isn't even the process
> > responsible for doing any filtering, but only for doing the back-end
> > script stuff ... so I added the "-D" to the lmtpd line, which I _assume_
> > (please correct me if I'm wrong) is the process that actually should be
> > doing the sieve checking and processing ... anyway, there was no sign
> > that lmtpd attempted to do any sendmail interaction ...
> AFAIR the Mail headers must contain the addresses you specified in the
> vacation rules. Did you check that?

His [custom] delivery mech is rewriting/inserting a Return-Path: to
*himself* for *every* message.   So when this message arrives in his
INBOX the Return-Path will not be the sender (me) or even the list, but
his address (the destination).  That will break just about everything.

> Also keep in mind, that vacation mail is not sent, when sender and recipient
> are the same.



Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html


Re: Sieve: Vacation not working

2009-05-27 Thread Carsten Hoeger
On Wed, May 27, Garry wrote:

> > Also, the logfile created by this line:
> > [..]
> > doesn't show up right away either ...
> >   
> Actually, I just noticed that timsieved of course isn't even the process
> responsible for doing any filtering, but only for doing the back-end
> script stuff ... so I added the "-D" to the lmtpd line, which I _assume_
> (please correct me if I'm wrong) is the process that actually should be
> doing the sieve checking and processing ... anyway, there was no sign
> that lmtpd attempted to do any sendmail interaction ...

AFAIR the Mail headers must contain the addresses you specified in the
vacation rules. Did you check that?

Also keep in mind, that vacation mail is not sent, when sender and recipient
are the same.

-- 
With best regards,

Carsten Hoeger


pgplHmVSCKyux.pgp
Description: PGP signature

Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html

Re: Sieve: Vacation not working

2009-05-27 Thread Garry

> Also, the logfile created by this line:
> [..]
> doesn't show up right away either ...
>   
Actually, I just noticed that timsieved of course isn't even the process
responsible for doing any filtering, but only for doing the back-end
script stuff ... so I added the "-D" to the lmtpd line, which I _assume_
(please correct me if I'm wrong) is the process that actually should be
doing the sieve checking and processing ... anyway, there was no sign
that lmtpd attempted to do any sendmail interaction ...

Help, anybody?

Tnx, -garry

Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html


Re: [PATCH] closedir missing in timsieved

2009-05-27 Thread Simon Matter
> On Tue, May 26, 2009 at 1:47 AM, Thomas Cataldo
>  wrote:
>> Hello,
>>
>> While writing a sieve client lib for the minig (minig.org) webmail
>> project, I triggered a bug in the LISTSCRIPTS implementation in cyrus
>> 2.2 from debian etch. The directory seems to remain unclosed and this
>> is a problem when prefork > 0 is set on timsieved.
>>
>> The attached patch should fix it.
>>
>
> Same patch needed on 2.3 cvs :

Hi,

Looks like there is another closedir() missing. I posted the patch to
https://bugzilla.andrew.cmu.edu/show_bug.cgi?id=3159

Regards,
Simon



Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html


Re: Sieve: Vacation not working

2009-05-27 Thread Garry
Adam Tauno Williams wrote:
> On Tue, 2009-05-26 at 09:21 -0400, Gottschalk, David wrote:
>   
>> See, I'm using this entirely custom deliver script in .procmailrc, and
>> I think that is my problem. I think if Sieve doesn't get a proper from
>> address, it will not reply. The question is how do you know if this is
>> occurring?
>> 
>
> Sendmail has been able to perform LMTP delivery (no "deliver" required)
> for a long time.
>
>   
>> You might try different configuration options of that. I've seen searching 
>> the web that some people had vacation reply issues with different 
>> configurations of the Cyrus mailer(s).
>> 
>>> How do you hand off mail from Sendmail to Cyrus? I'm thinking that could be 
>>> my issue, maybe yours too.
>>>   
>> I'm using the cyrus feature
>> define(`confLOCAL_MAILER', `cyrus')dnl
>> ifdef(`CYRUS_MAILER_ARGS',,
>> `define(`CYRUS_MAILER_ARGS', `deliver -e -f $f -m $h -- $u')')
>> in the mc file, and as the regular sorting seems to work (moving certain
>> mails to other folders e.g.), as well as storing incoming mail in the
>> appropriate inboxes, I assume the Cyrus interface as such should be
>> working fine, as well as the Sieve call ... what puzzles me is that I
>> don't even see Sieve attempt to deliever anything, at least not locally
>> - plus I can't seem to find any config file that would contain
>> definitions about what to do with mails generated by Sieve (like, e.g.,
>> what Mailserver to use)
>> 
>
> This is specified in imapd.conf via the "sendmail" directive.
>   
Yes, found that in the meantime ... anyway, still no success ...
according to the mail log, it's not being called, at least there are
still no messages from it ... I enabled the debugging_command, using
strace to get some infos on whether it is even trying to call sendmail
... from what I can tell, it doesn't even attempt to do anything ... is
the vacation line valid the way it is in the script?

Also, the logfile created by this line:

debug_command: /usr/bin/strace -tt -f -s256 -o /tmp/strace.cyrus.%s.%d
-p %2$d <&- 2>&1 &

doesn't show up right away either ...

Isn't there any way to make timsieved more verbose about what it's (not)
doing and why?

Tnx, -garry

Cyrus Home Page: http://cyrusimap.web.cmu.edu/
Cyrus Wiki/FAQ: http://cyrusimap.web.cmu.edu/twiki
List Archives/Info: http://asg.web.cmu.edu/cyrus/mailing-list.html