Re: [Dovecot] deliver command

2009-09-04 Thread Noel Butler
On Fri, 2009-09-04 at 15:05 -0400, Timo Sirainen wrote:

> Shutting down Dovecot doesn't shut down deliver, since it's called by
> Postfix.
> 


However,  if you use its SASL, that's not entirely true if you're
relying on normal message injection methods (smtpd), postfix will bail.

/etc/rc.d/rc.dovecot stop
Stopping dovecot POP3/IMAP daemon...  Done.
Stopping IMAP Proxy...  Done.

telnet 10.10.0.10 25
Trying 10.10.0.10...
Connected to mx3.
Escape character is '^]'.
Connection closed by foreign host.

postfix/smtpd[386]: fatal: no SASL authentication mechanisms

But this I feel is (if it can be really called an error at all)
postfix's failure, not Dovecots.




Re: [Dovecot] deliver command

2009-09-04 Thread AMP Admin
Omg!  I found the following in the config!!!  I commented it out and it's
working great!  Thank you so much!
plugin {
  # 10MB quota limit
  quota = dirsize:user
  quota_rule = *:storage=10M
}

Regards, 

-Team AMP 
http://www.ampprod.com 

== CONFIDENTIALITY NOTICE ==
NOTICE: This e-mail message and all attachments transmitted with it may
contain legally privileged and confidential information intended solely for
the use of the addressee. If the reader of this message is not the intended
recipient, you are hereby notified that any reading, dissemination,
distribution, copying, or other use of this message or its attachments is
strictly prohibited. If you have received this message in error, please
notify the sender immediately and delete this message from your system.
Thank you.


-Original Message-
From: dovecot-bounces+admin=ampprod@dovecot.org
[mailto:dovecot-bounces+admin=ampprod@dovecot.org] On Behalf Of Timo
Sirainen
Sent: Friday, September 04, 2009 3:02 PM
To: Dovecot Mailing List
Subject: Re: [Dovecot] deliver command

On Fri, 2009-09-04 at 14:22 -0500, AMP Admin wrote:
> I put nice in there but I'm still getting this from top...
> 
> 
>   PID USER  PR  NI  VIRT  RES  SHR S %CPU %MEMTIME+  COMMAND
> 13594 vmail 26  10  3816 2392 1088 D 14.6  0.1   0:00.54 deliver
> 13585 vmail 26  10 17212 7756 1144 D 10.9  0.2   0:00.60 deliver

I think you've configured something badly. If I had to guess, you're using
dirsize quota. http://wiki.dovecot.org/Quota/Dirsize

> > It probably shouldn't be. See what it's doing with e.g. strace?
> > http://wiki.dovecot.org/Debugging/ProcessTracing
> > 
> > Also show your dovecot -n output.




Re: [Dovecot] deliver command

2009-09-04 Thread Mel Flynn
On Friday 04 September 2009 22:02:15 Timo Sirainen wrote:
> On Fri, 2009-09-04 at 14:22 -0500, AMP Admin wrote:
> > I put nice in there but I'm still getting this from top...
> >
> >
> >   PID USER  PR  NI  VIRT  RES  SHR S %CPU %MEMTIME+  COMMAND
> > 13594 vmail 26  10  3816 2392 1088 D 14.6  0.1   0:00.54 deliver
> > 13585 vmail 26  10 17212 7756 1144 D 10.9  0.2   0:00.60 deliver
>
> I think you've configured something badly.

I'm wondering why "sending a newsletter" in previous mail, should have 
anything to do with postfix+deliver. Are you sending an internal newsletter? 
Normally, a newsletter goes outwards and should not call deliver at all, but 
smtp(8) over tcp.
-- 
Mel


Re: [Dovecot] deliver command

2009-09-04 Thread Timo Sirainen
On Fri, 2009-09-04 at 14:22 -0500, AMP Admin wrote:
> I put nice in there but I'm still getting this from top...
> 
> 
>   PID USER  PR  NI  VIRT  RES  SHR S %CPU %MEMTIME+  COMMAND
> 13594 vmail 26  10  3816 2392 1088 D 14.6  0.1   0:00.54 deliver
> 13585 vmail 26  10 17212 7756 1144 D 10.9  0.2   0:00.60 deliver

I think you've configured something badly. If I had to guess, you're
using dirsize quota. http://wiki.dovecot.org/Quota/Dirsize

> > It probably shouldn't be. See what it's doing with e.g. strace?
> > http://wiki.dovecot.org/Debugging/ProcessTracing
> > 
> > Also show your dovecot -n output.



signature.asc
Description: This is a digitally signed message part


Re: [Dovecot] deliver command

2009-09-04 Thread AMP Admin
I put nice in there but I'm still getting this from top...


  PID USER  PR  NI  VIRT  RES  SHR S %CPU %MEMTIME+  COMMAND
13594 vmail 26  10  3816 2392 1088 D 14.6  0.1   0:00.54 deliver
13585 vmail 26  10 17212 7756 1144 D 10.9  0.2   0:00.60 deliver
13560 vmail 26  10  3824 2488 1144 D  9.3  0.1   0:00.88 deliver
13584 vmail 26  10 17212 7756 1144 R  8.3  0.2   0:00.65 deliver
13601 vmail 26  10  3816 2392 1088 D  8.3  0.1   0:00.25 deliver
13580 vmail 26  10  3824 2460 1124 D  7.0  0.1   0:00.50 deliver
13587 vmail 26  10  3824 2464 1124 D  6.6  0.1   0:00.49 deliver
13574 vmail 26  10 17212 7756 1144 D  5.0  0.2   0:00.77 deliver
13586 vmail 26  10  3816 2396 1088 D  5.0  0.1   0:00.42 deliver
13592 vmail 26  10  3824 2460 1124 D  5.0  0.1   0:00.48 deliver
13595 vmail 26  10  3816 2392 1084 D  4.6  0.1   0:00.17 deliver
13559 vmail 26  10  3816 2388 1084 R  3.3  0.1   0:00.65 deliver
13571 vmail 26  10  3824 2472 1136 D  3.3  0.1   0:00.66 deliver
11483 postfix   15   0 17060  10m 1620 D  3.0  0.3   0:04.08 qmgr
13558 vmail 26  10  3824 2484 1144 D  3.0  0.1   0:00.91 deliver
13575 vmail 26  10  3824 2476 1136 D  2.7  0.1   0:00.63 deliver
13593 vmail 26  10  3816 2396 1084 D  2.3  0.1   0:00.11 deliver


-Original Message-
From: dovecot-bounces+admin=ampprod@dovecot.org
[mailto:dovecot-bounces+admin=ampprod@dovecot.org] On Behalf Of Timo
Sirainen
Sent: Friday, September 04, 2009 2:05 PM
To: Dovecot Mailing List
Subject: Re: [Dovecot] deliver command

Shutting down Dovecot doesn't shut down deliver, since it's called by
Postfix.

On Fri, 2009-09-04 at 13:42 -0500, AMP Admin wrote:
> What if I turn off dovecot just while the newsletter is going out?  it 
> uses postfix to send so it shouldn't hurt anything, right?
> 
> Regards,
> 
> -Team AMP
> http://www.ampprod.com
> 
> == CONFIDENTIALITY NOTICE ==
> NOTICE: This e-mail message and all attachments transmitted with it 
> may contain legally privileged and confidential information intended 
> solely for the use of the addressee. If the reader of this message is 
> not the intended recipient, you are hereby notified that any reading, 
> dissemination, distribution, copying, or other use of this message or 
> its attachments is strictly prohibited. If you have received this 
> message in error, please notify the sender immediately and delete this
message from your system.
> Thank you.
> 
> 
> -Original Message-
> From: dovecot-bounces+admin=ampprod@dovecot.org
> [mailto:dovecot-bounces+admin=ampprod@dovecot.org] On Behalf Of 
> Timo Sirainen
> Sent: Friday, September 04, 2009 12:50 PM
> To: Dovecot Mailing List
> Subject: Re: [Dovecot] deliver command
> 
> On Fri, 2009-09-04 at 12:41 -0500, AMP Admin wrote:
> > It seems deliver is taking up a lot of cpu.
> 
> It probably shouldn't be. See what it's doing with e.g. strace?
> http://wiki.dovecot.org/Debugging/ProcessTracing
> 
> Also show your dovecot -n output.
> 
> > Is there a way to throttle just the delivery command? 
> 
> Run "nice deliver" instead?
> 
> 



Re: [Dovecot] deliver command

2009-09-04 Thread Timo Sirainen
Shutting down Dovecot doesn't shut down deliver, since it's called by
Postfix.

On Fri, 2009-09-04 at 13:42 -0500, AMP Admin wrote:
> What if I turn off dovecot just while the newsletter is going out?  it uses
> postfix to send so it shouldn't hurt anything, right?
> 
> Regards, 
> 
> -Team AMP 
> http://www.ampprod.com 
> 
> == CONFIDENTIALITY NOTICE ==
> NOTICE: This e-mail message and all attachments transmitted with it may
> contain legally privileged and confidential information intended solely for
> the use of the addressee. If the reader of this message is not the intended
> recipient, you are hereby notified that any reading, dissemination,
> distribution, copying, or other use of this message or its attachments is
> strictly prohibited. If you have received this message in error, please
> notify the sender immediately and delete this message from your system.
> Thank you.
> 
> 
> -Original Message-
> From: dovecot-bounces+admin=ampprod@dovecot.org
> [mailto:dovecot-bounces+admin=ampprod@dovecot.org] On Behalf Of Timo
> Sirainen
> Sent: Friday, September 04, 2009 12:50 PM
> To: Dovecot Mailing List
> Subject: Re: [Dovecot] deliver command
> 
> On Fri, 2009-09-04 at 12:41 -0500, AMP Admin wrote:
> > It seems deliver is taking up a lot of cpu.
> 
> It probably shouldn't be. See what it's doing with e.g. strace?
> http://wiki.dovecot.org/Debugging/ProcessTracing
> 
> Also show your dovecot -n output.
> 
> > Is there a way to throttle just the delivery command? 
> 
> Run "nice deliver" instead?
> 
> 


signature.asc
Description: This is a digitally signed message part


Re: [Dovecot] deliver command

2009-09-04 Thread AMP Admin
What if I turn off dovecot just while the newsletter is going out?  it uses
postfix to send so it shouldn't hurt anything, right?

Regards, 

-Team AMP 
http://www.ampprod.com 

== CONFIDENTIALITY NOTICE ==
NOTICE: This e-mail message and all attachments transmitted with it may
contain legally privileged and confidential information intended solely for
the use of the addressee. If the reader of this message is not the intended
recipient, you are hereby notified that any reading, dissemination,
distribution, copying, or other use of this message or its attachments is
strictly prohibited. If you have received this message in error, please
notify the sender immediately and delete this message from your system.
Thank you.


-Original Message-
From: dovecot-bounces+admin=ampprod@dovecot.org
[mailto:dovecot-bounces+admin=ampprod@dovecot.org] On Behalf Of Timo
Sirainen
Sent: Friday, September 04, 2009 12:50 PM
To: Dovecot Mailing List
Subject: Re: [Dovecot] deliver command

On Fri, 2009-09-04 at 12:41 -0500, AMP Admin wrote:
> It seems deliver is taking up a lot of cpu.

It probably shouldn't be. See what it's doing with e.g. strace?
http://wiki.dovecot.org/Debugging/ProcessTracing

Also show your dovecot -n output.

> Is there a way to throttle just the delivery command? 

Run "nice deliver" instead?




[Dovecot] Automatic fd limit changing

2009-09-04 Thread Timo Sirainen
I just realized that Dovecot should probably be doing something
different with how it handles fd limits. The way it currently works is:

1. It checks some settings and warns at startup if fd limit is lower
than what master process might need.

2. For login processes it calculates how many fds are needed and then
either increases or decreases it.

So it's automatically and silently increasing fd limit for some
processes, but not for others. Should it just automatically increase the
limits to all processes when necessary, or never increase and just warn
that the limit is too low?



signature.asc
Description: This is a digitally signed message part


Re: [Dovecot] offlineimap with dovecot: file-time is one hour in the future

2009-09-04 Thread Timo Sirainen
On Fri, 2009-09-04 at 19:18 +0200, Dieter Faulbaum wrote:
> I use offlineimap to sync my remote IMAP-server with my local
> IMAP-server (maildir format).
> But I don't understand this behavior:
> every new mail in the INBOX has a file-date which is one hour in the
> future.

Message's INTERNALDATE is stored in file's mtime.

> Is this 'normal'? Is this a problem of offlineimap?
> I tried this debugging (for dovecot):
> mail_executable = /usr/lib/dovecot/rawlog /usr/lib/dovecot/imap
> and this (for offlineimap):
> offlineimap -d imap,maildir,thread -l ~/offlineimap.log
> 
> But I can't find any helpful information in these files, which shows me
> what went wrong.

My guess is that offlineimap adds INTERNALDATE timestamp to APPEND
commands and there's some timezone related issue.


signature.asc
Description: This is a digitally signed message part


Re: [Dovecot] deliver command

2009-09-04 Thread Timo Sirainen
On Fri, 2009-09-04 at 12:41 -0500, AMP Admin wrote:
> It seems deliver is taking up a lot of cpu.

It probably shouldn't be. See what it's doing with e.g. strace?
http://wiki.dovecot.org/Debugging/ProcessTracing

Also show your dovecot -n output.

> Is there a way to throttle just the delivery command? 

Run "nice deliver" instead?



signature.asc
Description: This is a digitally signed message part


[Dovecot] deliver command

2009-09-04 Thread AMP Admin
It seems deliver is taking up a lot of cpu.  Is there a way to throttle just
the delivery command? 



[Dovecot] offlineimap with dovecot: file-time is one hour in the future

2009-09-04 Thread Dieter Faulbaum

I use offlineimap to sync my remote IMAP-server with my local
IMAP-server (maildir format).
But I don't understand this behavior:
every new mail in the INBOX has a file-date which is one hour in the
future.
Is this 'normal'? Is this a problem of offlineimap?
I tried this debugging (for dovecot):
mail_executable = /usr/lib/dovecot/rawlog /usr/lib/dovecot/imap
and this (for offlineimap):
offlineimap -d imap,maildir,thread -l ~/offlineimap.log

But I can't find any helpful information in these files, which shows me
what went wrong.

Has anyone a better technique or a hint how to find out what caused this
(little) problem?

-- 

Dieter Faulbaum


Re: [Dovecot] v2.0 configuration parsing

2009-09-04 Thread Charles Marcus
On 9/3/2009 4:43 PM, Timo Sirainen wrote:
>> The difference between dovecot -n and postconf -n is that dovecot -n
>> doesn't show settings that have been explicitly set to defaults.

> doveconf -N now does that, while doveconf -n works like before.

wow - Timo, you are amazing, no doubt about it.

Thanks... :)

-- 

Best regards,

Charles


Re: [Dovecot] imap and pop3 benchmark

2009-09-04 Thread Ronald Johnson

Thomas G. Lau wrote:

Dear All,

does anyone got any program which could benchmark imap and pop3 in 
terms of message per second?


Check out MStone:

http://mstone.sourceforge.net/

and ImapTest:

http://www.imapwiki.org/ImapTest

Cheers,
Ron



Re: [Dovecot] quota-dirsize and mailbox rules

2009-09-04 Thread Thanos Chatziathanassiou

O/H Timo Sirainen έγραψε:

On Fri, 2009-08-21 at 16:05 +0300, Thanos Chatziathanassiou wrote:
  
I noticed that the dirsize backend for quota didn't support any rules 
and figured it should be easy enough to add ``ignore'' at least.
Using mbox storage and only tested with that, but it seems to work as 
expected for the time being.
I'm attaching a relatively small patch for quota-dirsize.c against 
dovecot-1.1.18 just in case anyone's interested.



The only problem with that is that it should be checking the full
mailbox name instead of just the file name. So there are two issues
here:

1. If you're ignoring "foo/bar", your patch currently looks up only to
see if "bar" is ignored.
  
I've done that but now I stumbled upon a (logical) problem. Supposing 
user has ``very/deep/path/to/mbox_file''.

If the rules specify ``path/to/mbox_file'', should it be ignored or not ?
I currently only match ``very/deep/path/to/mbox_file'' exactly only.
I originally meant to ignore only standard mboxes, like ``INBOX'' 
(because my MTA already checks this), ``Trash'', ``Ham'' and ``Spam'' 
(because a cronjob expires the former and auto-learns as ham/spam from 
the latters)
But what if the user moves these to e.g. ``Uninteresting/Trash'', 
``SpamFilter/Ham'' and ``SpamFilter/Spam''.

2. Namespace prefixes need to be used. So for example if you're using
namespace { prefix = INBOX/ } and you see a file "foo", you should look
for rule "INBOX/foo".
  
I'm afraid I lack some understanding of namespaces to do this. I read 
http://wiki.dovecot.org/Namespaces but still can't get it...






smime.p7s
Description: S/MIME Cryptographic Signature


Re: [Dovecot] IMAP timeout problem

2009-09-04 Thread Ken A

Vasantha Narayan wrote:

Hello,

We are running dovecot 1.1.2 on a Solaris 10 box.  We have been
running the same configuration for about a year without a problem.
We have a different cert for POP and IMAP.

Recently we made two changes.  The cert for IMAP expired and we had
to install a new one.  We applied some patches to the SAN disks that
hosts the mail partition.  These changes were made over a weekend and
the system was rebooted. 



Do you have any baseline benchmarks for your SAN?
What does vmstat 2 or iostat -c 2 say about i/o wait?

Ken

 There were no errors in the logs and

everything worked fine until the following Monday morning when IMAP
connections increased.   When IMAP ports started getting hammered in
the morning, IMAP clients started getting "IMAP time out" errors.
When this error occurs, IMAP freezes and IMAP clients such as,
Thunderbird and Squirrelmail  are not able to connect to the IMAP
server (both IMAP and IMAPS).   We cannot get a telnet connection to
the IMAP port or a openssl connection to the IMAPS port.  Kill -HUP
of the dovecot server solves the problem.  But again, when the usage
increases, the problem surfaces again.  There is no problem with POP
or POPS.  It continues to function normally while IMAP times out and
freezes two or three times a day.

Any clue where the problem might be?  The debug log does not have any
useful pointers.

Thanks.

Vasantha





--
Ken Anderson
Pacific Internet - http://www.pacific.net


Re: [Dovecot] External auth database process

2009-09-04 Thread Frank Elsner
On Fri, 4 Sep 2009 13:51:48 +0100 Aaron Roberts wrote:
> Hi,
> Is it possible to call a completely external process to authenticate users in 
> dovecot?

Yes, take a look at http://wiki.dovecot.org/AuthDatabase/CheckPassword


--Frank Elsner


[Dovecot] External auth database process

2009-09-04 Thread Aaron Roberts
Hi,
Is it possible to call a completely external process to authenticate users in 
dovecot?

I am trying to setup a transparent pop3 proxy that will lookup users from a 
couple of different pop3 servers, authenticate to 1 of them, take a copy of the 
password and a timestamp and client IP upon success, then proxy to the 
appropriate end server.

I was hoping I would be able to do something along the lines of:

dovecot.conf:

passdb external
args = /usr/scripts/dovecot_auth.pl %u %w

The perl script would then carry out the various tasks and return the host and 
destuser for proxying.

Thanks in advance,
Aaron