[Dovecot] dovecot Mstone benchmark

2008-10-08 Thread Mathieu Kretchner
Hello all,

I would like to bench imap with mstone but the only thing I see is imap
command read login logout banner but there is no write.

So I can't stress as well as with imaptest.

Does anyone have a dovecot.wld or a special configuration to test with
mstone ?

Thanks
begin:vcard
fn:Mathieu Kretchner
n:Kretchner;Mathieu
org:INRIA;Syslog
adr;dom:;;2004 route des lucioles - BP93;Sophia Antipolis;;06902 CEDEX
email;internet:[EMAIL PROTECTED]
tel;work:04 92 38 76 67
x-mozilla-html:FALSE
version:2.1
end:vcard



Re: [Dovecot] client certs with godaddy ssl cert

2008-10-08 Thread Harondel J. Sibble


On 29 Sep 2008 at 8:40, Rainer Frey (Inxmail GmbH) wrote:

 What is important: you can not self-sign each client certificate, but you
 need 
 a CA with a self-signed root instead. I think you understand that already,
 just noting that for completeness.
 
 Then you simply configure Dovecot as described in 
 http://wiki.dovecot.org/SSL/DovecotConfiguration

Followed those directions, enabled the client side certificate checking, but 
no go.
 
 Then configure client cert verification as described in the last section of
 above mentioned wiki page.
 ssl_ca_file is used for client cert verification only, and does not need to
 cover the server certificate. 

Done, I have the following enabled.

auth default {
  # Space separated list of wanted authentication mechanisms:
  #   plain login digest-md5 cram-md5 ntlm rpa apop anonymous gssapi
  mechanisms = plain
  ssl_require_client_cert = yes

ssl_ca_file = /etc/pki/dovecot/certs/dovecot-clientcerts
ssl_verify_client_cert = yes
verbose_ssl = yes
ssl_require_client_cert = yes

Logs don't show anything of any interest, on the client side (windows mobile 
5 phone running Web IS's Flexmail4.

When I asked their tech support about using a client cert, I got this

Greetings and thank you for contacting us.

It should be using the certs which the PDA has installed.  Is the cert
installed (in the device settings  System  Certificates

We appreciate having the opportunity to help and service you. Please let
us know if there is anything more we can do.

I've verified that my root ca is installed on the pda and the personal cert 
is also installed.

The following is all I see on the connection attempt from the pda

Oct  8 01:00:55 myserver dovecot: Dovecot v1.0.7 starting up
Oct  8 01:01:51 myserver dovecot: imap-login: Disconnected: method=PLAIN, 
rip=10.12.13.14, lip=10.12.13.14, TLS

At this point the client device is stuck asking to confirm account 
credentials

-- 
Harondel J. Sibble 
Sibble Computer Consulting
Creating solutions for the small business and home computer user.
[EMAIL PROTECTED] (use pgp keyid 0x3AD5C11D) http://www.pdscc.com
(604) 739-3709 (voice/fax)  (604) 686-2253 (pager)



[Dovecot] Something weird happening...

2008-10-08 Thread Claudio Prono
Hi to all,

I use Dovecot dovecot11-1.1.3-5.1 from OpenSuSE 11, when i send a mail
from the logs i read:

Oct  8 10:36:31 mail postfix/pipe[17934]: A360A851:
to=[EMAIL PROTECTED], relay=dovecot, delay=0.22,
delays=0.18/0/0/0.04, dsn=4.3.0, status=deferred (temporary failure.
Command output: Can't open log file /var/log/dovecot-err.log: Permission
denied )

But, log files seems ok:

-rw--- 1 777 root  56 Oct  8 10:35 dovecot-err.log
-rw--- 1 777 root 302 Oct  8 10:35 dovecot-inf.log

Also processess seems right:

root 17965  0.0  0.0   2052   584 ?Ss   10:35   0:00
/usr/sbin/dovecot
root 17966  0.0  0.2   8564  2172 ?S10:35   0:00
dovecot-auth
root 17967  0.0  0.2   8564  2356 ?S10:35   0:00
dovecot-auth -w
dovecot  17969  0.0  0.1   3476  1572 ?S10:36   0:00 pop3-login
dovecot  17970  0.0  0.1   3476  1572 ?S10:36   0:00 pop3-login
dovecot  17971  0.0  0.1   3476  1572 ?S10:36   0:00 pop3-login
dovecot  17972  0.0  0.1   3484  1584 ?S10:36   0:00 imap-login
dovecot  17973  0.0  0.1   3484  1584 ?S10:36   0:00 imap-login
dovecot  17974  0.0  0.1   3484  1584 ?S10:36   0:00 imap-login

Here is my config:

log_path: /var/log/dovecot-err.log
info_log_path: /var/log/dovecot-inf.log
protocols: imap pop3
ssl_disable: yes
disable_plaintext_auth: no
login_dir: /var/run/dovecot/login
login_executable(default): /usr/lib/dovecot/imap-login
login_executable(imap): /usr/lib/dovecot/imap-login
login_executable(pop3): /usr/lib/dovecot/pop3-login
first_valid_uid: 51
last_valid_uid: 51
mail_location: maildir:/var/mail/virtual/[EMAIL PROTECTED]
mail_executable(default): /usr/lib/dovecot/imap
mail_executable(imap): /usr/lib/dovecot/imap
mail_executable(pop3): /usr/lib/dovecot/pop3
mail_plugins(default): quota imap_quota
mail_plugins(imap): quota imap_quota
mail_plugins(pop3): quota
mail_plugin_dir(default): /usr/lib64/dovecot/modules/imap
mail_plugin_dir(imap): /usr/lib64/dovecot/modules/imap
mail_plugin_dir(pop3): /usr/lib64/dovecot/modules/pop3
pop3_uidl_format(default):
pop3_uidl_format(imap):
pop3_uidl_format(pop3): %Mf
auth default:
  passdb:
driver: pam
  passdb:
driver: sql
args: /etc/dovecot/dovecot-mysql.conf
  userdb:
driver: passwd
  userdb:
driver: sql
args: /etc/dovecot/dovecot-mysql.conf
  socket:
type: listen
master:
  path: /var/run/dovecot/auth-master
  mode: 384
plugin:
  quota: maildir
  quota_warning: storage=80%% /usr/local/bin/quota-warning.sh 80


So, what can be the problem?

Thanks,

Claudio Prono.


-- 

Claudio Prono
Systems Development @ Atpss.net Srl, Divisione Implementazione Sistemi
Via San Bernardino, 17 - 10137 Torino (TO) - IT
Tel +39-011.32.72.100  Fax +39-011.32.46.497
PGP Fingerprint: 75C2 4049 E23D 2FBF A65F  40DB EA5C 11AC C2B0 3647
Disclaimer: http://atpss.net/disclaimer
 



Re: [Dovecot] Cyrus MailDir to Dovecot mbox

2008-10-08 Thread Steinar Bang
 CJ Keist [EMAIL PROTECTED]:

 Anyone out there know of a tool that can convert a Cyrus MailDir format
 to Dovecot mbox?  I have a user that I need to move over from a mail
 server running cyrus using MailDir format.  At first I told him to setup
 second account with Thunderbird to our mail server and then use
 Thunderbird to move the messages over.  But he has over 100K messages so
 not as easy to do.

From server to server sync'ing, there's imapsync, which avoids having to
pull the messages over manually.
http://wiki.dovecot.org/Migration

I used it to pull around 30-40k messages from a cyrus imapd to a dovecot
on a different machine (my dovecot used maildir, not mbox, but that
shouldn't make any difference).

The UIDs aren't preserved, but everything else seems to be.  My MUA
(Gnus with the nnimap backend) uses custom flags to store state and all
of that state was preserved.

Losing the UIDs in Gnus' case, only meant that the cached article
information was useless, and that I would have to freshly download
everything I wanted cached.  And it also turned out to be mostly
irrelevant, since the folder structure changed with dovecot.  The only
folder for which I could have preserved cached information would have
been the INBOX.



[Dovecot] Auth Issues - Urgent - Help!

2008-10-08 Thread David Cunningham


After a few hours of running, I get tons of the following errors in my logs:

dovecot: Oct 08 07:41:50 Error: auth(default):  
ldap([EMAIL PROTECTED],x.x.x.x): Request queue is full


I removed the username and IP, obviously.

Any idea how to stop this?

I have about 5 Thousand users using horde that login ever 1-5 minutes  
to refresh their page.  I assume it is a setting, but I am confused as  
to why it doesn't happen almost right away.  It seems to take some  
time to build up.


Please help!  This is taking my webmail system down hourly.





Re: [Dovecot] Initial support for shared mailboxes

2008-10-08 Thread Sascha Wilde
Timo Sirainen [EMAIL PROTECTED] writes:
 On Sep 30, 2008, at 6:08 PM, Sascha Wilde wrote:
[...]
 So I guess what is needed is a new userdb backend which is explicitly
 runs an arbitrary external program to get the user data (instead of
 caching the passdb results).

 Right. Perhaps the passdb checkpassword code could be used as userdb
 too, just with an added extra variable specifying if it's a passdb or
 a userdb lookup.

I just started to work on this feature and for testing purpose I wrote a
very simple dummy checkpassword program.  But I have a problem setting
the UID and GID:

I'm using:

userdb_uid=12345
userdb_gid=12345
EXTRA=userdb_uid userdb_gid
export userdb_uid userdb_gid EXTRA

according to http://wiki.dovecot.org/PasswordDatabase/CheckPassword but
then I get an internal login failure.  From the dovecot log:

Oct 08 12:42:02 burlywood3 info dovecot[3804]: auth(default): prefetch([EMAIL 
PROTECTED],192.168.11.254): success
Oct 08 12:42:02 burlywood3 info dovecot[3804]: auth(default): master out: 
USER[EMAIL PROTECTED] home=/kolab/var/dovecot/spool/[EMAIL 
PROTECTED]/home uid=0   gid=0   uid=19415 gid=19415
Oct 08 12:42:02 burlywood3 error dovecot[3804]: uid specified multiple times 
for [EMAIL PROTECTED]

So am I missing something or is this dovecot extension currently broken?

cheers
sascha
-- 
Sascha Wilde  OpenPGP key: 4BB86568
http://www.intevation.de/~wilde/  http://www.intevation.de/
Intevation GmbH, Neuer Graben 17, 49074 Osnabrück; AG Osnabrück, HR B 18998
Geschäftsführer:   Frank Koormann,  Bernhard Reiter,  Dr. Jan-Oliver Wagner


pgpVpA0AkZ0jp.pgp
Description: PGP signature


Re: [Dovecot] Something weird happening...

2008-10-08 Thread Elisamuel Resto
On Wed, 08 Oct 2008 10:44:25 +0200, Claudio Prono wrote:
 Hi to all,
 
 I use Dovecot dovecot11-1.1.3-5.1 from OpenSuSE 11, when i send a mail
 from the logs i read:
 
 Oct  8 10:36:31 mail postfix/pipe[17934]: A360A851:
 to=[EMAIL PROTECTED], relay=dovecot, delay=0.22,
 delays=0.18/0/0/0.04, dsn=4.3.0, status=deferred (temporary failure.
 Command output: Can't open log file /var/log/dovecot-err.log: Permission
 denied )
 
 But, log files seems ok:
 
 -rw--- 1 777 root  56 Oct  8 10:35 dovecot-err.log
 -rw--- 1 777 root 302 Oct  8 10:35 dovecot-inf.log

According to the below output, the above output is wrong. User with UID 777 does
not exist, hence, the Permission denied.

You should chown dovecot /var/log/dovecot-*.log

 Also processess seems right:
 
 root 17965  0.0  0.0   2052   584 ?Ss   10:35   0:00
 /usr/sbin/dovecot
 root 17966  0.0  0.2   8564  2172 ?S10:35   0:00
 dovecot-auth
 root 17967  0.0  0.2   8564  2356 ?S10:35   0:00
 dovecot-auth -w
 dovecot  17969  0.0  0.1   3476  1572 ?S10:36   0:00 pop3-login
 dovecot  17970  0.0  0.1   3476  1572 ?S10:36   0:00 pop3-login
 dovecot  17971  0.0  0.1   3476  1572 ?S10:36   0:00 pop3-login
 dovecot  17972  0.0  0.1   3484  1584 ?S10:36   0:00 imap-login
 dovecot  17973  0.0  0.1   3484  1584 ?S10:36   0:00 imap-login
 dovecot  17974  0.0  0.1   3484  1584 ?S10:36   0:00 imap-login
 

-- 
Elisamuel Resto  | GPG: 18615F19
[EMAIL PROTECTED] | Source Mage GNU/Linux Tome Lead
http://simplysam.us/ | http://www.sourcemage.org/


signature.asc
Description: PGP signature


Re: [Dovecot] Something weird happening...

2008-10-08 Thread Claudio Prono
Very strange, i have tryied to chmod 666 all log files, like that:

-rw-rw-rw- 1 root root  681 Oct  8 11:08 dovecot-err.log
-rw-rw-rw- 1 root root 1039 Oct  8 11:02 dovecot-inf.log

(Is terrible i know, but only a test)

Now i have another error (written in log of dovecot!)

deliver([EMAIL PROTECTED]): Oct 08 11:08:20 Error: Can't connect to
auth server at /var/run/dovecot/auth-master: Permission denied

Seems all a problem of user running dovecot...is not root? Dunno why...
In config there isn't nothing to do so.

Any suggestion?

Thank you,

Claudio.



Claudio Prono ha scritto:
 Sorry, mine error. I have tried to make readable and writeble to all the
 files, so i have do wrongly chown 777 files. Now is fixed, but still
 recieve error:

 -rw--- 1 root root 224 Oct  8 10:57 dovecot-err.log
 -rw--- 1 root root 888 Oct  8 10:57 dovecot-inf.log

 The log is:

 Oct  8 10:57:28 mail postfix/smtpd[18296]: C878485F:
 client=localhost[127.0.0.1]
 Oct  8 10:57:28 mail postfix/cleanup[18288]: C878485F:
 message-id=[EMAIL PROTECTED]
 Oct  8 10:57:28 mail postfix/qmgr[3303]: C878485F:
 from=[EMAIL PROTECTED], size=1310, nrcpt=1 (queue active)
 Oct  8 10:57:28 mail postfix/smtpd[18296]: disconnect from
 localhost[127.0.0.1]
 Oct  8 10:57:28 mail postfix/pipe[18290]: 8E90385E:
 to=[EMAIL PROTECTED], relay=dspam, delay=0.39,
 delays=0.1/0.01/0/0.28, dsn=2.0.0, status=sent (delivered via dspam service)
 Oct  8 10:57:28 mail postfix/qmgr[3303]: 8E90385E: removed
 Oct  8 10:57:29 mail postfix/pipe[18298]: C878485F:
 to=[EMAIL PROTECTED], relay=dovecot, delay=0.23,
 delays=0.17/0.01/0/0.05, dsn=4.3.0, status=deferred (temporary failure.
 Command output: Can't open log file /var/log/dovecot-err.log: Permission
 denied )


 What can be?



 Elisamuel Resto ha scritto:
   
 On Wed, 08 Oct 2008 10:44:25 +0200, Claudio Prono wrote:
   
 
 Hi to all,

 I use Dovecot dovecot11-1.1.3-5.1 from OpenSuSE 11, when i send a mail
 from the logs i read:

 Oct  8 10:36:31 mail postfix/pipe[17934]: A360A851:
 to=[EMAIL PROTECTED], relay=dovecot, delay=0.22,
 delays=0.18/0/0/0.04, dsn=4.3.0, status=deferred (temporary failure.
 Command output: Can't open log file /var/log/dovecot-err.log: Permission
 denied )

 But, log files seems ok:

 -rw--- 1 777 root  56 Oct  8 10:35 dovecot-err.log
 -rw--- 1 777 root 302 Oct  8 10:35 dovecot-inf.log
 
   
 According to the below output, the above output is wrong. User with UID 777 
 does
 not exist, hence, the Permission denied.

 You should chown dovecot /var/log/dovecot-*.log

   
 
 Also processess seems right:

 root 17965  0.0  0.0   2052   584 ?Ss   10:35   0:00
 /usr/sbin/dovecot
 root 17966  0.0  0.2   8564  2172 ?S10:35   0:00
 dovecot-auth
 root 17967  0.0  0.2   8564  2356 ?S10:35   0:00
 dovecot-auth -w
 dovecot  17969  0.0  0.1   3476  1572 ?S10:36   0:00 pop3-login
 dovecot  17970  0.0  0.1   3476  1572 ?S10:36   0:00 pop3-login
 dovecot  17971  0.0  0.1   3476  1572 ?S10:36   0:00 pop3-login
 dovecot  17972  0.0  0.1   3484  1584 ?S10:36   0:00 imap-login
 dovecot  17973  0.0  0.1   3484  1584 ?S10:36   0:00 imap-login
 dovecot  17974  0.0  0.1   3484  1584 ?S10:36   0:00 imap-login

 
   
   
 

   

-- 

Claudio Prono
Systems Development @ Atpss.net Srl, Divisione Implementazione Sistemi
Via San Bernardino, 17 - 10137 Torino (TO) - IT
Tel +39-011.32.72.100  Fax +39-011.32.46.497
PGP Fingerprint: 75C2 4049 E23D 2FBF A65F  40DB EA5C 11AC C2B0 3647
Disclaimer: http://atpss.net/disclaimer
 



Re: [Dovecot] Auth Issues - Urgent - Help!

2008-10-08 Thread Jurvis LaSalle


On Oct 8, 2008, at 8:01 AM, David Cunningham wrote:



After a few hours of running, I get tons of the following errors in  
my logs:


dovecot: Oct 08 07:41:50 Error: auth(default):  
ldap([EMAIL PROTECTED],x.x.x.x): Request queue is full


I removed the username and IP, obviously.

Any idea how to stop this?

I have about 5 Thousand users using horde that login ever 1-5  
minutes to refresh their page.  I assume it is a setting, but I am  
confused as to why it doesn't happen almost right away.  It seems to  
take some time to build up.


Please help!  This is taking my webmail system down hourly.



dovecot -n?

Hunch is login_max_processes_count is too low.
http://wiki.dovecot.org/LoginProcess

hth,
JL

smime.p7s
Description: S/MIME cryptographic signature


Re: [Dovecot] sieve multi-line parser bug

2008-10-08 Thread info

Hello Timo,

Thanks for the reply

It was accidentally split when sending the mail. The actual lines are  
only 2:


1) From: 
=?iso-8859-1?Q?Cotiatododia=20-=20O=20Jornal=20de=20Not=EDcias=20a=20Se?=
2)=?iso-8859-1?Q?rvi=E7o=20de=20Cotia=20e=20Regi=E3o=2E?= 
[EMAIL PROTECTED]


(also attached)


Timo Sirainen wrote:

On Tue, 2008-10-07 at 14:38 -0300, info wrote:

  

When a message header is split along several lines, it seems only the
first one is parsed by sieve.

The following header:

From:
=?iso-8859-1?Q?Cotiatododia=20-=20O=20Jornal=20de=20Not=EDcias=20a=20Se?=
=?iso-8859-1?Q?rvi=E7o=20de=20Cotia=20e=20Regi=E3o=2E?=
[EMAIL PROTECTED]



Is that really correct? Was there no space or tab before the =?iso.. ?
Or was the line just accidentally split when sending the mail? If the
above really is correct, then the header is broken and Dovecot is doing
the right thing..

  


From: =?iso-8859-1?Q?Cotiatododia=20-=20O=20Jornal=20de=20Not=EDcias=20a=20Se?=
=?iso-8859-1?Q?rvi=E7o=20de=20Cotia=20e=20Regi=E3o=2E?= [EMAIL 
PROTECTED]


Re: [Dovecot] Something weird happening...

2008-10-08 Thread Claudio Prono
Sorry, mine error. I have tried to make readable and writeble to all the
files, so i have do wrongly chown 777 files. Now is fixed, but still
recieve error:

-rw--- 1 root root 224 Oct  8 10:57 dovecot-err.log
-rw--- 1 root root 888 Oct  8 10:57 dovecot-inf.log

The log is:

Oct  8 10:57:28 mail postfix/smtpd[18296]: C878485F:
client=localhost[127.0.0.1]
Oct  8 10:57:28 mail postfix/cleanup[18288]: C878485F:
message-id=[EMAIL PROTECTED]
Oct  8 10:57:28 mail postfix/qmgr[3303]: C878485F:
from=[EMAIL PROTECTED], size=1310, nrcpt=1 (queue active)
Oct  8 10:57:28 mail postfix/smtpd[18296]: disconnect from
localhost[127.0.0.1]
Oct  8 10:57:28 mail postfix/pipe[18290]: 8E90385E:
to=[EMAIL PROTECTED], relay=dspam, delay=0.39,
delays=0.1/0.01/0/0.28, dsn=2.0.0, status=sent (delivered via dspam service)
Oct  8 10:57:28 mail postfix/qmgr[3303]: 8E90385E: removed
Oct  8 10:57:29 mail postfix/pipe[18298]: C878485F:
to=[EMAIL PROTECTED], relay=dovecot, delay=0.23,
delays=0.17/0.01/0/0.05, dsn=4.3.0, status=deferred (temporary failure.
Command output: Can't open log file /var/log/dovecot-err.log: Permission
denied )


What can be?



Elisamuel Resto ha scritto:
 On Wed, 08 Oct 2008 10:44:25 +0200, Claudio Prono wrote:
   
 Hi to all,

 I use Dovecot dovecot11-1.1.3-5.1 from OpenSuSE 11, when i send a mail
 from the logs i read:

 Oct  8 10:36:31 mail postfix/pipe[17934]: A360A851:
 to=[EMAIL PROTECTED], relay=dovecot, delay=0.22,
 delays=0.18/0/0/0.04, dsn=4.3.0, status=deferred (temporary failure.
 Command output: Can't open log file /var/log/dovecot-err.log: Permission
 denied )

 But, log files seems ok:

 -rw--- 1 777 root  56 Oct  8 10:35 dovecot-err.log
 -rw--- 1 777 root 302 Oct  8 10:35 dovecot-inf.log
 

 According to the below output, the above output is wrong. User with UID 777 
 does
 not exist, hence, the Permission denied.

 You should chown dovecot /var/log/dovecot-*.log

   
 Also processess seems right:

 root 17965  0.0  0.0   2052   584 ?Ss   10:35   0:00
 /usr/sbin/dovecot
 root 17966  0.0  0.2   8564  2172 ?S10:35   0:00
 dovecot-auth
 root 17967  0.0  0.2   8564  2356 ?S10:35   0:00
 dovecot-auth -w
 dovecot  17969  0.0  0.1   3476  1572 ?S10:36   0:00 pop3-login
 dovecot  17970  0.0  0.1   3476  1572 ?S10:36   0:00 pop3-login
 dovecot  17971  0.0  0.1   3476  1572 ?S10:36   0:00 pop3-login
 dovecot  17972  0.0  0.1   3484  1584 ?S10:36   0:00 imap-login
 dovecot  17973  0.0  0.1   3484  1584 ?S10:36   0:00 imap-login
 dovecot  17974  0.0  0.1   3484  1584 ?S10:36   0:00 imap-login

 

   

-- 

Claudio Prono
Systems Development @ Atpss.net Srl, Divisione Implementazione Sistemi
Via San Bernardino, 17 - 10137 Torino (TO) - IT
Tel +39-011.32.72.100  Fax +39-011.32.46.497
PGP Fingerprint: 75C2 4049 E23D 2FBF A65F  40DB EA5C 11AC C2B0 3647
Disclaimer: http://atpss.net/disclaimer
 



Re: [Dovecot] Auth Issues - Urgent - Help!

2008-10-08 Thread David Cunningham

Here is my dovecot -n:

# 1.1.3: /etc/dovecot.conf
log_path: /var/log/dovecot
info_log_path: /var/log/dovecot-info
login_dir: /var/run/dovecot/login
login_executable(default): /usr/libexec/dovecot/imap-login
login_executable(imap): /usr/libexec/dovecot/imap-login
login_executable(pop3): /usr/libexec/dovecot/pop3-login
login_greeting: MECnet Mail System, Authorized Use Only, Please Log In.
login_process_per_connection: no
login_process_size: 1024
login_max_processes_count: 1024
login_max_connections: 1024
max_mail_processes: 5
verbose_proctitle: yes
first_valid_uid: 50
mail_uid: 93
mail_gid: 12
mail_location: maildir:/var/spool/maildirs/%d/%n/Maildir
mail_executable(default): /usr/libexec/dovecot/imap
mail_executable(imap): /usr/libexec/dovecot/imap
mail_executable(pop3): /usr/libexec/dovecot/pop3
mail_process_size: 1024
mail_plugins(default): quota imap_quota
mail_plugins(imap): quota imap_quota
mail_plugins(pop3):
mail_plugin_dir(default): /usr/lib64/dovecot/imap
mail_plugin_dir(imap): /usr/lib64/dovecot/imap
mail_plugin_dir(pop3): /usr/lib64/dovecot/pop3
namespace:
  type: private
  prefix: INBOX.
  inbox: yes
  list: yes
  subscriptions: yes
auth default:
  verbose: yes
  passdb:
driver: ldap
args: /etc/dovecot-ldap.conf
plugin:
  quota: maildir



My buddy and I found

#define DB_LDAP_MAX_QUEUE_SIZE 1024

in the db-ldap.h file in the source.

We believe we hitting this threshold for some reason.  So, we are  
looking to increase this to 8192.  However, when trying to build the  
RPM source from atrpms, I get this:


# rpmbuild -ba dovecot.spec
error: line 1: Unknown tag: %bcond_without inotify

Any help?

Dave

Quoting Jurvis LaSalle [EMAIL PROTECTED]:



On Oct 8, 2008, at 8:01 AM, David Cunningham wrote:



After a few hours of running, I get tons of the following errors in  
  my logs:


dovecot: Oct 08 07:41:50 Error: auth(default):
ldap([EMAIL PROTECTED],x.x.x.x): Request queue is full


I removed the username and IP, obviously.

Any idea how to stop this?

I have about 5 Thousand users using horde that login ever 1-5
minutes to refresh their page.  I assume it is a setting, but I am   
 confused as to why it doesn't happen almost right away.  It seems   
to  take some time to build up.


Please help!  This is taking my webmail system down hourly.



dovecot -n?

Hunch is login_max_processes_count is too low.
http://wiki.dovecot.org/LoginProcess

hth,
JL






Re: [Dovecot] shared mailboxes in 1.2 question

2008-10-08 Thread Sascha Wilde
Timo Sirainen [EMAIL PROTECTED] writes:
 On Oct 6, 2008, at 7:24 PM, Robert Schetterer wrote:
 users after imap search, otherwise you always need some admin (
 perhaps
 with shell permissions ) for editing subcriptions and acls which not

 Actually the SUBSCRIBE IMAP command is enough to make the mailboxes
 visible, no admin/shell access needed.

This doesn't work for me.

Actually the whole new shared namespaces feature doesn't work as
expected for me.  Using this namespace configuration:

namespace shared {
  separator = /
  # %%u gets expanded to the remote user. Instead of %%u you can
  # also use %%n and %%d.
  prefix = users/%%u/
  location = 
Maildir:/kolab/var/dovecot/spool/%%u/maildir:INDEX=/kolab/var/dovecot/spool/%u/maildir/shared_idx
  #location = Maildir:/kolab/var/dovecot/spool/%%u/maildir
  subscriptions = no
}

I get errors when using list:

l002 list  *
* LIST (\HasChildren) / INBOX
* LIST (\HasNoChildren) / INBOX/Calendar
* LIST (\HasNoChildren) / INBOX/Contacts
* LIST (\HasNoChildren) / INBOX/Journal
* LIST (\HasNoChildren) / INBOX/Notes
* LIST (\HasNoChildren) / INBOX/Tasks
* LIST (\HasNoChildren) / INBOX/bla
l002 NO Unknown internal list error

And cant subscribe or select an existing mailbox of another user:

s001 subscribe users/[EMAIL PROTECTED]/INBOX/blablabla
s001 NO Invalid mailbox name: users/[EMAIL PROTECTED]/INBOX/blablabla

FWIW referencing an non existent mailbox causes an different error:

s002 subscribe users/[EMAIL PROTECTED]/blablabla
s002 NO [TRYCREATE] Mailbox doesn't exist: users/[EMAIL PROTECTED]/blablabla

s102 select users/[EMAIL PROTECTED]/INBOX/blablabla
* OK [CLOSED]
s102 NO Invalid mailbox name

 And IMAP ACL commands are (at least partially) already implemented by
 Kolab people.

Yes, look at http://hg.intevation.de/kolab/dovecot-1.2_acl-branch as
announced...  ;-)

cheers
sascha
-- 
Sascha Wilde  OpenPGP key: 4BB86568
http://www.intevation.de/~wilde/  http://www.intevation.de/
Intevation GmbH, Neuer Graben 17, 49074 Osnabrück; AG Osnabrück, HR B 18998
Geschäftsführer:   Frank Koormann,  Bernhard Reiter,  Dr. Jan-Oliver Wagner


pgp5uXO78u9OK.pgp
Description: PGP signature


Re: [Dovecot] shared mailboxes in 1.2 question

2008-10-08 Thread Timo Sirainen

On Oct 8, 2008, at 5:33 PM, Sascha Wilde wrote:


s002 subscribe users/[EMAIL PROTECTED]/blablabla
s002 NO [TRYCREATE] Mailbox doesn't exist: users/[EMAIL PROTECTED]/ 
blablabla


I think this should have worked, I'll look into it.


s102 select users/[EMAIL PROTECTED]/INBOX/blablabla
* OK [CLOSED]
s102 NO Invalid mailbox name


Assuming INBOX/ is the namespace prefix, you should have used users/[EMAIL PROTECTED] 
/blablabla here too. Does that work?




PGP.sig
Description: This is a digitally signed message part


Re: [Dovecot] Auth Issues - Urgent - Help!

2008-10-08 Thread Jakob Hirsch

David Cunningham wrote:

I have about 5 Thousand users using horde that login ever 1-5 minutes to 
refresh their page.  I assume it is a setting, but I am confused as to 


This may not related to the real reason of your problem, but I recommend 
 up-imapproxy (http://www.imapproxy.org/) for such setups, which caches 
connections (and therefore logins). You could try to enable dovecot's 
auth_cache instead.




Re: [Dovecot] Auth Issues - Urgent - Help!

2008-10-08 Thread Oli Schacher
David Cunningham schrieb:

 I have about 5 Thousand users using horde that login ever 1-5 
 minutes to refresh their page.  

Imapproxy can be configured to cache connections only for a defined
amount of time, eg. close connections not used for more than a few
minutes. Setting is cache_expiration_time in imapproxy.conf.

Remember: Horde creates a new imap connection for every page click,
imapproxy heavily reduces this login/logout noise.

If your 5k users are  all using webmail *simultaneously* I don't know
how the proxy will perform.









Re: [Dovecot] shared mailboxes in 1.2 question

2008-10-08 Thread Sascha Wilde
Timo Sirainen [EMAIL PROTECTED] writes:

 On Oct 8, 2008, at 5:33 PM, Sascha Wilde wrote:

 s002 subscribe users/[EMAIL PROTECTED]/blablabla
 s002 NO [TRYCREATE] Mailbox doesn't exist: users/[EMAIL PROTECTED]/
 blablabla

 I think this should have worked, I'll look into it.

IMO the other one:
 s001 subscribe users/[EMAIL PROTECTED]/INBOX/blablabla
should have worked.

Or is the default namespace prefix INBOX/ instead of empty?
Furthermore, please notice the different error: when the mailbox exists
dovecot claims Invalid mailbox name otherwise it says [TRYCREATE]
Mailbox doesn't exist which is indeed true.

 s102 select users/[EMAIL PROTECTED]/INBOX/blablabla
 * OK [CLOSED]
 s102 NO Invalid mailbox name

 Assuming INBOX/ is the namespace prefix,

see above, I assume the namespace prefix is empty.
From the configuration:

namespace private {
   separator = /

   # Prefix required to access this namespace. This needs to be different for
   # all namespaces. For example Public/.
   #prefix = 

   inbox = yes
}

so prefix is not set, which means, it is set to the default.  (Which I
believe to be empty, the comments suggest that, too).

cheers
sascha
-- 
Sascha Wilde  OpenPGP key: 4BB86568
http://www.intevation.de/~wilde/  http://www.intevation.de/
Intevation GmbH, Neuer Graben 17, 49074 Osnabrück; AG Osnabrück, HR B 18998
Geschäftsführer:   Frank Koormann,  Bernhard Reiter,  Dr. Jan-Oliver Wagner


pgpt9TMxiCH7X.pgp
Description: PGP signature


[Dovecot] Dovecot-sieve processing optimizations

2008-10-08 Thread Roderick A. Anderson
I'm working at the next part of the virtual domains mail server.  I'm 
moving this account ([EMAIL PROTECTED] is a forwarder) which has a bunch 
of procmail rules to file into folders.


My question is if it is more efficient is use?

if  {
   ...
} elsif {
   ...
} elsif {
   ...
}
else

This seems to be the way many of the example scripts do it but I found 
at least one that used


if {
   ...
}

if {
   ...
}

Which is more procmail like and for me reads easier.

If not here where should I ask?


Thanks,
Rod
--



Re: [Dovecot] Dovecot-sieve processing optimizations

2008-10-08 Thread Seth Mattinen
Roderick A. Anderson wrote:
 I'm working at the next part of the virtual domains mail server.  I'm
 moving this account ([EMAIL PROTECTED] is a forwarder) which has a bunch
 of procmail rules to file into folders.
 
 My question is if it is more efficient is use?
 
 if  {
...
 } elsif {
...
 } elsif {
...
 }
 else
 
 This seems to be the way many of the example scripts do it but I found
 at least one that used
 
 if {
...
 }
 
 if {
...
 }
 
 Which is more procmail like and for me reads easier.
 
 If not here where should I ask?
 

Well, both accomplish different things. In the first example, one and
only one of the conditions will be executed. In the second one, more
than one could possibly be executed.

I've never looked at Sieve's code, but the first will stop at the first
matching condition. In the second case, because you could make it do
more than one thing, it must check each condition.

~Seth


Re: [Dovecot] Dovecot-sieve processing optimizations

2008-10-08 Thread Eduardo M KALINOWSKI
Seth Mattinen escreveu:
 Roderick A. Anderson wrote:
   
 I'm working at the next part of the virtual domains mail server.  I'm
 moving this account ([EMAIL PROTECTED] is a forwarder) which has a bunch
 of procmail rules to file into folders.

 My question is if it is more efficient is use?

 if  {
...
 } elsif {
...
 } elsif {
...
 }
 else

 This seems to be the way many of the example scripts do it but I found
 at least one that used

 if {
...
 }

 if {
...
 }

 Which is more procmail like and for me reads easier.

 If not here where should I ask?

 

 Well, both accomplish different things. In the first example, one and
 only one of the conditions will be executed. In the second one, more
 than one could possibly be executed.

 I've never looked at Sieve's code, but the first will stop at the first
 matching condition. In the second case, because you could make it do
 more than one thing, it must check each condition.
   

If in each if you put a finish statement (or whatever is used to stop
processing the file), then the second one can be more efficient, since
it does not have to continue checking the file to see if there are
further conditions after the if/elseif/.../else block.

But in practice I doubt there is a practical difference between both.
You should use the one that is more readable for you.

-- 
Eduardo M Kalinowski
[EMAIL PROTECTED]



Re: [Dovecot] Auth Issues - Urgent - Help!

2008-10-08 Thread David Cunningham


Unfortantely, it just happened again!  sigh

I am going to implement my increased queue change and see what happens.

Dave

Quoting Jurvis LaSalle [EMAIL PROTECTED]:



On Oct 8, 2008, at 8:01 AM, David Cunningham wrote:



After a few hours of running, I get tons of the following errors in  
  my logs:


dovecot: Oct 08 07:41:50 Error: auth(default):
ldap([EMAIL PROTECTED],x.x.x.x): Request queue is full


I removed the username and IP, obviously.

Any idea how to stop this?

I have about 5 Thousand users using horde that login ever 1-5
minutes to refresh their page.  I assume it is a setting, but I am   
 confused as to why it doesn't happen almost right away.  It seems   
to  take some time to build up.


Please help!  This is taking my webmail system down hourly.



dovecot -n?

Hunch is login_max_processes_count is too low.
http://wiki.dovecot.org/LoginProcess

hth,
JL






Re: [Dovecot] Disabling global content_filter with an empty filter specified with an access table

2008-10-08 Thread Diego Liziero
On Wed, Oct 8, 2008 at 7:36 PM, mouss [EMAIL PROTECTED] wrote:

 an alternative is

 content_filter =
 smtpd_sender_restrictions =
check_sender_access hash:/etc/postfix/sender_ok
check_sender_access pcre:/etc/postfix/filter

 == dsn_ok
   OK

 == filter
 /./ FILTER filter:[1.2.3.4]:10024

 where filter:[1.2.3 is what you used to put in content_filter.

Yes, that's what I was thinking when I wrote workaround in my first mail:

On Wed, Oct 8, 2008 at 5:08 PM, Diego Liziero [EMAIL PROTECTED] wrote:
[..]
I think that this solution is more readable than the only workaround I
can imagine now (that is disabling global filtering and enabling it in
a pcre table for everything except that particular case).

So it's a bit less readable, I've to remember to disable sender
restrictions in the content filter return transport to avoid filter
loops, there will be one more line for each mail in the log stating
that the filter is triggered, but apart from that it should work as I
need.

Thank you to everyone that helped me,
tomorrow I'm going to test both methods.

Regards,
Diego.


Re: [Dovecot] shared mailboxes in 1.2 question

2008-10-08 Thread Timo Sirainen
On Wed, 2008-10-08 at 17:39 +0200, Sascha Wilde wrote:
 Timo Sirainen [EMAIL PROTECTED] writes:
 
  On Oct 8, 2008, at 5:33 PM, Sascha Wilde wrote:
 
  s002 subscribe users/[EMAIL PROTECTED]/blablabla
  s002 NO [TRYCREATE] Mailbox doesn't exist: users/[EMAIL PROTECTED]/
  blablabla
 
  I think this should have worked, I'll look into it.
 
 IMO the other one:
  s001 subscribe users/[EMAIL PROTECTED]/INBOX/blablabla
 should have worked.
 
 Or is the default namespace prefix INBOX/ instead of empty?
 Furthermore, please notice the different error: when the mailbox exists
 dovecot claims Invalid mailbox name otherwise it says [TRYCREATE]
 Mailbox doesn't exist which is indeed true.

Fixed: http://hg.dovecot.org/dovecot-1.2/rev/c465b10a76fd



signature.asc
Description: This is a digitally signed message part


Re: [Dovecot] Auth Issues - Urgent - Help!

2008-10-08 Thread Timo Sirainen
On Wed, 2008-10-08 at 10:48 -0400, David Cunningham wrote:
 I agree.  In fact, I may have found a DNS issue that may have been  
 causing login sessions to hang and thus reach max too quickly.  The  
 last few hours have been stable.  So, I am keeping my fingers crossed.
 
 I have also recompiled dovecot and changed the setting in db-ldap.h  
 that reads:
 
 #define DB_LDAP_MAX_QUEUE_SIZE 1024
 
 to
 
 #define DB_LDAP_MAX_QUEUE_SIZE 8192

If you're getting more than 1024 requests queued, something's wrong or
you have hundreds or logins per second. Which one is it? (5000 users
logging in once per minute is still only 83/sec)

The queue keeps increasing if the LDAP server isn't replying to old
requests. So have you looked at the LDAP server side if it's running too
slow?

Anyway two things you could do here:

1) Enable auth cache with large enough size so Dovecot doesn't consult
LDAP server nearly as much.

2) Increase the number of auth processes (auth { .. count=5 }), so that
you'll use more connections and hopefully the LDAP server likes that
better than one connection sending lots of requests. Or maybe not.



signature.asc
Description: This is a digitally signed message part


Re: [Dovecot] Something weird happening...

2008-10-08 Thread Timo Sirainen
On Wed, 2008-10-08 at 11:12 +0200, Claudio Prono wrote:
 Very strange, i have tryied to chmod 666 all log files, like that:
 
 -rw-rw-rw- 1 root root  681 Oct  8 11:08 dovecot-err.log
 -rw-rw-rw- 1 root root 1039 Oct  8 11:02 dovecot-inf.log
 
 (Is terrible i know, but only a test)
 
 Now i have another error (written in log of dovecot!)
 
 deliver([EMAIL PROTECTED]): Oct 08 11:08:20 Error: Can't connect to
 auth server at /var/run/dovecot/auth-master: Permission denied
 
 Seems all a problem of user running dovecot...is not root? Dunno why...
 In config there isn't nothing to do so.

deliver isn't normally run as root, unless you've made it setuid-root.
So the log files and the auth-master socket need to be writable by the
user who runs deliver (as defined in Postfix's master.cf).

(Of course the user running deliver also needs to have access to all
users' mails. If you're using system users you'll need to make deliver
setuid-root.)



signature.asc
Description: This is a digitally signed message part


Re: [Dovecot] Auth Issues - Urgent - Help!

2008-10-08 Thread David Cunningham

Thank you, I will try the caching.

Dave

Quoting Timo Sirainen [EMAIL PROTECTED]:


On Wed, 2008-10-08 at 10:48 -0400, David Cunningham wrote:

I agree.  In fact, I may have found a DNS issue that may have been
causing login sessions to hang and thus reach max too quickly.  The
last few hours have been stable.  So, I am keeping my fingers crossed.

I have also recompiled dovecot and changed the setting in db-ldap.h
that reads:

#define DB_LDAP_MAX_QUEUE_SIZE 1024

to

#define DB_LDAP_MAX_QUEUE_SIZE 8192


If you're getting more than 1024 requests queued, something's wrong or
you have hundreds or logins per second. Which one is it? (5000 users
logging in once per minute is still only 83/sec)

The queue keeps increasing if the LDAP server isn't replying to old
requests. So have you looked at the LDAP server side if it's running too
slow?

Anyway two things you could do here:

1) Enable auth cache with large enough size so Dovecot doesn't consult
LDAP server nearly as much.

2) Increase the number of auth processes (auth { .. count=5 }), so that
you'll use more connections and hopefully the LDAP server likes that
better than one connection sending lots of requests. Or maybe not.








Re: [Dovecot] sieve multi-line parser bug

2008-10-08 Thread Timo Sirainen
On Wed, 2008-10-08 at 07:29 -0300, info wrote:
 Hello Timo,
 
 Thanks for the reply
 
 It was accidentally split when sending the mail. The actual lines are  
 only 2:
 
 1) From: 
 =?iso-8859-1?Q?Cotiatododia=20-=20O=20Jornal=20de=20Not=EDcias=20a=20Se?=

OK, Cotiatododia is already in the first line, so the problem isn't
about reading multi-line. What Dovecot version do you use?



signature.asc
Description: This is a digitally signed message part


Re: [Dovecot] Cyrus MailDir to Dovecot mbox

2008-10-08 Thread Timo Sirainen
On Tue, 2008-10-07 at 15:02 -0600, CJ Keist wrote:
 -BEGIN PGP SIGNED MESSAGE-
 Hash: SHA1
 
 Timo,
 Thanks.  The cyrus2dovecot looks to have worked.  So if I understand
 the process I now just move the MailDir folder that was created to the
 users home directory on our mail server.  I will try the dovecot convert
 plugin.  Just make sure I'm doing this correct in the config file:

If you do it only once, you don't need to use convert plugin. There's
also a convert-tool binary included.

 mail_location = mbox:~/:INBOX=/userM/mail/%u
 protocol imap {
   mail_plugins = convert
 }
 plugin {
   convert_mail = Maildir:~/Maildir:INBOX=/userM/mail/%u
 }
 
 Is this correct? The example on the website only shows how to convert
 from mbox to MailDir.

That looks also correct.



signature.asc
Description: This is a digitally signed message part


Re: [Dovecot] Dovecot-sieve processing optimizations

2008-10-08 Thread Roderick A. Anderson

Eduardo M KALINOWSKI wrote:

Seth Mattinen escreveu:


snip /

Seth, Eduardo;

Thanks.

Seth,

As I read your post -- slap went my hand to my forehead.  I knew that! 
That was the subconsciouses reason I asked I'm sure.  :-)


Eduardo,

You're right.  What I'm doing, currently, isn't all that complicated. 
In fact mail sieve will make it easier, simpler, and cleaner to do.  I 
only once really got into doing anything complex using procmail and I'm 
not using it now.



Again thanks to you both,
Rod
--



Well, both accomplish different things. In the first example, one and
only one of the conditions will be executed. In the second one, more
than one could possibly be executed.

I've never looked at Sieve's code, but the first will stop at the first
matching condition. In the second case, because you could make it do
more than one thing, it must check each condition.
  


If in each if you put a finish statement (or whatever is used to stop
processing the file), then the second one can be more efficient, since
it does not have to continue checking the file to see if there are
further conditions after the if/elseif/.../else block.

But in practice I doubt there is a practical difference between both.
You should use the one that is more readable for you.





Re: [Dovecot] postfix/dovecot/mysql quotas not working, default dovecot.conf does.

2008-10-08 Thread Timo Sirainen
On Tue, 2008-10-07 at 20:03 -0400, [EMAIL PROTECTED] wrote:
 I've been testing using telnet and getquotaroot. when I define the 
 quota in dovecot.conf
quota = dirsize

Note that dirsize is superslow with maildir. quota=maildir is much
better.

 user_query = \
 SELECT 1015 as uid, 105 as gid, '/var/spool/mail/%d/%n' as home, \
 'maildir:/var/spool/mail/%d/%n/Maildir' as mail, \
 'dirsize' as quota, \

There's no need to duplicate quota here. It's already in plugin
section.

 concat('*:storage=', quota, 'B') as quota_rule, \

Looks correct. A bit simpler would be concat('*:bytes=',quota)

Enable auth_debug=yes and mail_debug=yes and look at the logs. It should
show quota_rule being sent as part of master out line.



signature.asc
Description: This is a digitally signed message part


Re: [Dovecot] Initial support for shared mailboxes

2008-10-08 Thread Timo Sirainen
On Wed, 2008-10-08 at 12:54 +0200, Sascha Wilde wrote:
 I just started to work on this feature and for testing purpose I wrote a
 very simple dummy checkpassword program.  But I have a problem setting
 the UID and GID:
 
 I'm using:
 
 userdb_uid=12345
 userdb_gid=12345
 EXTRA=userdb_uid userdb_gid
 export userdb_uid userdb_gid EXTRA
 
 according to http://wiki.dovecot.org/PasswordDatabase/CheckPassword but

I guess it worked more or less accidentally at some point. Changed now
so it should really work:
http://hg.dovecot.org/dovecot-1.2/rev/a38778911fa9



signature.asc
Description: This is a digitally signed message part


Re: [Dovecot] 1.1.4 and trouble over NFS

2008-10-08 Thread Timo Sirainen
On Tue, 2008-10-07 at 22:19 +0200, Igor Colombi wrote:
 Timo Sirainen wrote:
  On Oct 7, 2008, at 9:57 PM, Igor Colombi wrote:
 
  Hello, I have some trouble with the current setup (it's a testing 
  environment):
 
  2 server with Dovecot 1.1.4 from source (OS Debian testing 2.6.26) 
  (name: exim and exim2)
  1 NFS server (OS Debian testing 2.6.26)
 
  I use NFS v.4, indexes shared over NFS. The relavant part of Dovecot 
  configuration:
 
  Or probably also running imaptest (http://imapwiki.org/ImapTest) on 
  both machines? Could you run http://www.dovecot.org/tools/nfstest.c 
  and tell me what it outputs?
 
 Hello, this is the output of nftest on exim2 (client) vs exim (the other 
 client)
 
 
 ./nfstest 192.168.0.70 50 /mnt/nfs1/pippo/pluto

That looks correct. So either something's changed in Dovecot since I
last tested it with NFS, or something's changed in Linux kernel. Or
there's something else weird going on.

I don't really have any good suggestions for solutions and I don't
really have time to debug NFS problems right now.. Or you could of
course always try if disabling NFS attribute cache fixes things, but
that'll most likely also make your performance a lot worse.


signature.asc
Description: This is a digitally signed message part


Re: [Dovecot] Lots of assertion PANICs in error log

2008-10-08 Thread Brian Hayden

Timo Sirainen wrote:

I also get the occasional error of Next message unexpectedly lost from ...
for some users.



I've added some debugging code to my code to figure out why this is
happening. Unfortunately I've been reading my mails over a week without
it happening..
  


We've been seeing this for a few users also with both 1.1.3 and 1.1.4. 
When it happens, the user can still see the mail in all clients EXCEPT 
Outlook, where it shows up as some permeation of blank headers/good 
body, no body/good headers, etc.


This has only happened to mbox users, same as others who've reported it. 
It is reproducible for a given message; if the user logs out of Outlook 
and back in, it still shows up malformed. But: using pine or mutt to 
bounce the message results in a message that does NOT trigger the 
problem for the bounce recipient.


Any thoughts, Timo? We're hesitating to go live with the 1.1x series for 
this reason. We could just convert affected folks to Maildir, but we're 
not really ready for that conversion on a large scale yet.


-Brian


Re: [Dovecot] Auth Issues - Urgent - Help!

2008-10-08 Thread David Cunningham


Simply changing auth_cache_size to a non-zero number enables caching, correct?

How big is too big?

Where does it cache it?

Here is what I set:

auth_cache_size = 1048576

I was hoping for 1GB worth of cache.

I have 16GB of memory on the system, so memory is not an issue if it  
stores it in memory as opposed to disk.


Dave

Quoting David Cunningham [EMAIL PROTECTED]:


Thank you, I will try the caching.

Dave

Quoting Timo Sirainen [EMAIL PROTECTED]:


On Wed, 2008-10-08 at 10:48 -0400, David Cunningham wrote:

I agree.  In fact, I may have found a DNS issue that may have been
causing login sessions to hang and thus reach max too quickly.  The
last few hours have been stable.  So, I am keeping my fingers crossed.

I have also recompiled dovecot and changed the setting in db-ldap.h
that reads:

#define DB_LDAP_MAX_QUEUE_SIZE 1024

to

#define DB_LDAP_MAX_QUEUE_SIZE 8192


If you're getting more than 1024 requests queued, something's wrong or
you have hundreds or logins per second. Which one is it? (5000 users
logging in once per minute is still only 83/sec)

The queue keeps increasing if the LDAP server isn't replying to old
requests. So have you looked at the LDAP server side if it's running too
slow?

Anyway two things you could do here:

1) Enable auth cache with large enough size so Dovecot doesn't consult
LDAP server nearly as much.

2) Increase the number of auth processes (auth { .. count=5 }), so that
you'll use more connections and hopefully the LDAP server likes that
better than one connection sending lots of requests. Or maybe not.








Re: [Dovecot] Auth Issues - Urgent - Help!

2008-10-08 Thread Timo Sirainen
On Wed, 2008-10-08 at 16:13 -0400, David Cunningham wrote:
 Simply changing auth_cache_size to a non-zero number enables caching, correct?
 
 How big is too big?

If it uses up too much of your memory. Although you'll probably also
need to change auth_process_size then, because by default it kills the
process if it grows larger than 256 MB. You could also disable it by
setting it to 0.

 Where does it cache it?
 
 Here is what I set:
 
 auth_cache_size = 1048576
 
 I was hoping for 1GB worth of cache.

I think you could do with a lot less :) I think a single user takes
maybe 50-100 bytes normally. Even with 200 bytes your 5000 users would
fit into 1 MB. Of course negative hits are also cached, so the rest of
the memory would go to them. I'd decrease it to 10 MB or so :)

Also you might want to increase auth_cache_ttl from the default hour.



signature.asc
Description: This is a digitally signed message part


Re: [Dovecot] postfix/dovecot/mysql quotas not working, default dovecot.conf does.

2008-10-08 Thread dovecot

(and oops forgot to get my last post on the list)
Hmm, I pulled a cleaner log file and got this:

Oct  8 16:44:51 webmail dovecot: auth(default): new auth connection: pid=14573
Oct  8 16:44:55 webmail dovecot: auth(default): client in: 
AUTH^I1^IPLAIN^Iservice=imap^Isecured^Ilip=127.0.0.1^Irip=127.0.0.1^Ilport=143^Irport=50346^Iresp=hidden
Oct  8 16:44:55 webmail dovecot: auth-worker(default): 
sql([EMAIL PROTECTED],127.0.0.1): query: SELECT username, domain, 
password FROM mailbox WHERE username = '[EMAIL PROTECTED]' AND 
domain = 'example.com' AND active = '1'
Oct  8 16:44:55 webmail dovecot: auth(default): client out: 
[EMAIL PROTECTED]
Oct  8 16:44:55 webmail dovecot: auth(default): master in: 
REQUEST^I28^I14248^I1
Oct  8 16:44:55 webmail dovecot: auth(default): 
passwd([EMAIL PROTECTED],127.0.0.1): lookup
Oct  8 16:44:55 webmail dovecot: auth(default): 
passwd([EMAIL PROTECTED],127.0.0.1): unknown user
Oct  8 16:44:55 webmail dovecot: auth-worker(default): 
sql([EMAIL PROTECTED],127.0.0.1): SELECT 1015 as uid, 105 as gid, 
'/var/spool/mail/example.com/test111' as home, 
'maildir:/var/spool/mail/example.com/test111/Maildir' as mail, 
concat('maildir:storage=', quota) as quota, concat('*:storage=', 
quota, '') as quota_rule, FROM mailbox WHERE username = 
'[EMAIL PROTECTED]' AND domain = 'example.com' and active = '1'
Oct  8 16:44:55 webmail dovecot: auth-worker(default): 
sql([EMAIL PROTECTED],127.0.0.1): User query failed: You have an 
error in your SQL syntax; check the manual that corresponds to your 
MySQL server version for the right syntax to use near 'FROM mailbox 
WHERE username = '[EMAIL PROTECTED]' AND domain = 'exampl' at line 1
Oct  8 16:44:55 webmail dovecot: auth(default): master out: 
[EMAIL PROTECTED]
Oct  8 16:44:55 webmail dovecot: imap-login: Login: 
user=[EMAIL PROTECTED], method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, secured
Oct  8 16:44:55 webmail dovecot: IMAP([EMAIL PROTECTED]): Loading 
modules from directory: /usr/local/lib/dovecot/imap
Oct  8 16:44:55 webmail dovecot: IMAP([EMAIL PROTECTED]): Module 
loaded: /usr/local/lib/dovecot/imap/lib10_quota_plugin.so
Oct  8 16:44:55 webmail dovecot: IMAP([EMAIL PROTECTED]): Module 
loaded: /usr/local/lib/dovecot/imap/lib11_imap_quota_plugin.so
Oct  8 16:44:55 webmail dovecot: IMAP([EMAIL PROTECTED]): Effective 
uid=1015, gid=105, home=
Oct  8 16:44:55 webmail dovecot: IMAP([EMAIL PROTECTED]): Quota 
root: name=storage=10240 backend=maildir args=
Oct  8 16:44:55 webmail dovecot: IMAP([EMAIL PROTECTED]): Quota 
rule: root=storage=10240 mailbox=* bytes=104857600 (0%) messages=0 (0%)
Oct  8 16:44:55 webmail dovecot: IMAP([EMAIL PROTECTED]): Quota 
warning: bytes=99614720 (95%) messages=0 (0%) 
command=/usr/local/sbin/quota_notify 95
Oct  8 16:44:55 webmail dovecot: IMAP([EMAIL PROTECTED]): Quota 
warning: bytes=83886080 (80%) messages=0 (0%) 
command=/usr/local/sbin/quota_notify 80
Oct  8 16:44:55 webmail dovecot: IMAP([EMAIL PROTECTED]): maildir: 
data=/var/spool/mail/example.com/test111/Maildir
Oct  8 16:44:55 webmail dovecot: IMAP([EMAIL PROTECTED]): 
maildir++: root=/var/spool/mail/example.com/test111/Maildir, index=, 
control=, inbox=/var/spool/mail/example.com/test111/Maildir



I see a sql error in there, but it doesn't make any sense. Why would 
it hack off the last part of the domain? (domain names have been 
changed to protect the innocent, it was truncated at 9 characters)


rick


At 04:29 PM 10/8/2008, Rick Steeves wrote:

At 03:27 PM 10/8/2008, Timo Sirainen wrote:

Note that dirsize is superslow with maildir. quota=maildir is much
better.


Yeah, I knew that, but was trying the simplest option. I've now 
switched everything over to maildir.



 concat('*:storage=', quota, 'B') as quota_rule, \

Looks correct. A bit simpler would be concat('*:bytes=',quota)

Enable auth_debug=yes and mail_debug=yes and look at the logs. It should
show quota_rule being sent as part of master out line.


I enabled both of those. in /var/log/maillog I'm don't see a master line.
Here's the log files:

Oct  8 16:30:32 webmail dovecot: IMAP([EMAIL PROTECTED]): Module 
loaded: /usr/local/lib/dovecot/imap/lib10_quota_plugin.so
Oct  8 16:30:32 webmail dovecot: IMAP([EMAIL PROTECTED]): Module 
loaded: /usr/local/lib/dovecot/imap/lib11_imap_quota_plugin.so
Oct  8 16:30:32 webmail dovecot: IMAP([EMAIL PROTECTED]): 
Effective uid=1015, gid=105, home=
Oct  8 16:30:32 webmail dovecot: IMAP([EMAIL PROTECTED]): Quota 
root: name=storage=10240 backend=maildir args=
Oct  8 16:30:32 webmail dovecot: IMAP([EMAIL PROTECTED]): Quota 
rule: root=storage=10240 mailbox=* bytes=104857600 (0%) messages=0 (0%)
Oct  8 16:30:32 webmail dovecot: IMAP([EMAIL PROTECTED]): Quota 
warning: bytes=99614720 (95%) messages=0 (0%) 
command=/usr/local/sbin/quota_notify 95
Oct  8 16:30:32 webmail dovecot: IMAP([EMAIL PROTECTED]): Quota 
warning: bytes=83886080 (80%) messages=0 (0%) 
command=/usr/local/sbin/quota_notify 80
Oct  8 16:30:32 webmail dovecot: IMAP([EMAIL PROTECTED]): 

Re: [Dovecot] postfix/dovecot/mysql quotas not working, default dovecot.conf does.

2008-10-08 Thread Timo Sirainen
On Wed, 2008-10-08 at 16:52 -0400, [EMAIL PROTECTED] wrote:
 'maildir:/var/spool/mail/example.com/test111/Maildir' as mail, 
 concat('maildir:storage=', quota) as quota, concat('*:storage=', 
 quota, '') as quota_rule, FROM mailbox WHERE username = 

You've a comma between quota_rule and FROM.

 sql([EMAIL PROTECTED],127.0.0.1): User query failed: You have an 
 error in your SQL syntax; check the manual that corresponds to your 
 MySQL server version for the right syntax to use near 'FROM mailbox 
 WHERE username = '[EMAIL PROTECTED]' AND domain = 'exampl' at line 1
 Oct  8 16:44:55 webmail dovecot: auth(default): master out: 
 [EMAIL PROTECTED]

Since the primary userdb failed, Dovecot continued by trying the second
one which is static userdb. It's not really a very safe secondary
choice, since this can happen any time the SQL server is down..

(plus see my other mail I replied to privately)



signature.asc
Description: This is a digitally signed message part


Re: [Dovecot] Auth Issues - Urgent - Help!

2008-10-08 Thread Timo Sirainen
On Wed, 2008-10-08 at 08:01 -0400, David Cunningham wrote:
 After a few hours of running, I get tons of the following errors in my logs:
 
 dovecot: Oct 08 07:41:50 Error: auth(default):  
 ldap([EMAIL PROTECTED],x.x.x.x): Request queue is full

BTW. I improved this error message slightly to also tell how many
seconds old data is in the queue.
http://hg.dovecot.org/dovecot-1.1/rev/0329dc4df5ed

I guess you're using auth binds? If you weren't, I think it wouldn't be
possible to fill the queue.



signature.asc
Description: This is a digitally signed message part


Re: [Dovecot] postfix/dovecot/mysql quotas not working, default dovecot.conf does.

2008-10-08 Thread dovecot

dovecot-sql.conf:
driver = mysql
connect = host=localhost dbname=postfix user=postfix password=postfix
default_pass_scheme = MD5-CRYPT
password_query = \
  SELECT username, domain, password \
  FROM mailbox WHERE username = '%u' AND domain = '%d' AND active = '1'
user_query = \
   SELECT 1015 as uid, 105 as gid, '/var/spool/mail/%d/%n' as home, \
   'maildir:/var/spool/mail/%d/%n/Maildir' as mail, \
   concat('*:storage=', quota, 'B') as quota_rule, \
FROM mailbox WHERE username = '%u' AND domain = '%d' and active = '1'

dovecot.conf
  quota = maildir
  quota_rule = *:storage=102400
  quota_warning = storage=95%% /usr/local/sbin/quota_notify 95
  quota_warning2 = storage=80%% /usr/local/sbin/quota_notify 80

Telnet:
Connected to 127.0.0.1.
Escape character is '^]'.
* OK Dovecot ready.
. login [EMAIL PROTECTED] Test111
. OK Logged in.
. getquotaroot inbox
* QUOTAROOT inbox 
* QUOTA  (STORAGE 67 102400)
. OK Getquotaroot completed.

Quota still shows what's in dovecot.conf

/var/log/maillog
Oct  8 17:16:23 webmail dovecot: auth(default): client in: 
AUTH^I1^IPLAIN^Iservice=imap^Isecured^Ilip=127.0.0.1^Irip=127.0.0.1^Ilport=143^Irport=49601^Iresp=hidden
Oct  8 17:16:23 webmail dovecot: auth-worker(default): 
sql([EMAIL PROTECTED],127.0.0.1): query: SELECT username, domain, 
password FROM mailbox WHERE username = '[EMAIL PROTECTED]' AND 
domain = 'example.com' AND active = '1'
Oct  8 17:16:23 webmail dovecot: auth(default): client out: 
[EMAIL PROTECTED]
Oct  8 17:16:23 webmail dovecot: auth(default): master in: 
REQUEST^I11^I23281^I1
Oct  8 17:16:23 webmail dovecot: auth(default): 
passwd([EMAIL PROTECTED],127.0.0.1): lookup
Oct  8 17:16:23 webmail dovecot: auth(default): 
passwd([EMAIL PROTECTED],127.0.0.1): unknown user
Oct  8 17:16:23 webmail dovecot: auth-worker(default): 
sql([EMAIL PROTECTED],127.0.0.1): SELECT 1015 as uid, 105 as gid, 
'/var/spool/mail/example.com/test111' as home, 
'maildir:/var/spool/mail/example.com/test111/Maildir' as mail, 
concat('*:storage=', quota, 'B') as quota_rule, FROM mailbox WHERE 
username = '[EMAIL PROTECTED]' AND domain = 'example.com' and active = '1'
Oct  8 17:16:23 webmail dovecot: auth-worker(default): 
sql([EMAIL PROTECTED],127.0.0.1): User query failed: You have an 
error in your SQL syntax; check the manual that corresponds to your 
MySQL server version for the right syntax to use near 'FROM mailbox 
WHERE username = '[EMAIL PROTECTED]' AND domain = 'example.c' at line 1
Oct  8 17:16:23 webmail dovecot: auth(default): master out: 
[EMAIL PROTECTED]
Oct  8 17:16:23 webmail dovecot: IMAP([EMAIL PROTECTED]): Loading 
modules from directory: /usr/local/lib/dovecot/imap
Oct  8 17:16:23 webmail dovecot: IMAP([EMAIL PROTECTED]): Module 
loaded: /usr/local/lib/dovecot/imap/lib10_quota_plugin.so
Oct  8 17:16:23 webmail dovecot: IMAP([EMAIL PROTECTED]): Module 
loaded: /usr/local/lib/dovecot/imap/lib11_imap_quota_plugin.so
Oct  8 17:16:23 webmail dovecot: IMAP([EMAIL PROTECTED]): Effective 
uid=1015, gid=105, home=
Oct  8 17:16:23 webmail dovecot: IMAP([EMAIL PROTECTED]): Quota 
root: name= backend=maildir args=
Oct  8 17:16:23 webmail dovecot: IMAP([EMAIL PROTECTED]): Quota 
rule: root= mailbox=* bytes=104857600 (0%) messages=0 (0%)
Oct  8 17:16:23 webmail dovecot: IMAP([EMAIL PROTECTED]): Quota 
warning: bytes=99614720 (95%) messages=0 (0%) 
command=/usr/local/sbin/quota_notify 95
Oct  8 17:16:23 webmail dovecot: IMAP([EMAIL PROTECTED]): Quota 
warning: bytes=83886080 (80%) messages=0 (0%) 
command=/usr/local/sbin/quota_notify 80
Oct  8 17:16:23 webmail dovecot: IMAP([EMAIL PROTECTED]): maildir: 
data=/var/spool/mail/example.com/test111/Maildir
Oct  8 17:16:23 webmail dovecot: IMAP([EMAIL PROTECTED]): 
maildir++: root=/var/spool/mail/example.com/test111/Maildir, index=, 
control=, inbox=/var/spool/mail/example.com/test111/Maildir
Oct  8 17:16:23 webmail dovecot: imap-login: Login: 
user=[EMAIL PROTECTED], method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, secured



It looks like the error is in all likelihood here:
'/var/spool/mail/example.com/test111' as home, 
'maildir:/var/spool/mail/example.com/test111/Maildir' as mail, 
concat('*:storage=', quota, 'B') as quota_rule, FROM mailbox WHERE 
username = '[EMAIL PROTECTED]' AND domain = 'example.com' and active = '1'
Oct  8 17:16:23 webmail dovecot: auth-worker(default): 
sql([EMAIL PROTECTED],127.0.0.1): User query failed: You have an 
error in your SQL syntax; check the manual that corresponds to your 
MySQL server version for the right syntax to use near 'FROM mailbox 
WHERE username = '[EMAIL PROTECTED]' AND domain = 'example.c' at line 1


What's interesting is that it's not truncated in the line above it

wt?

Rick


At 04:46 PM 10/8/2008, Timo Sirainen wrote:

On Wed, 2008-10-08 at 16:29 -0400, [EMAIL PROTECTED] wrote:
 Enable auth_debug=yes and mail_debug=yes and look at the logs. It should
 show quota_rule being sent as part of master out line.

 I enabled both of those. in /var/log/maillog I'm don't see a 

Re: [Dovecot] Something weird happening...

2008-10-08 Thread Bill Cole

Claudio Prono wrote:

Very strange, i have tryied to chmod 666 all log files, like that:

-rw-rw-rw- 1 root root  681 Oct  8 11:08 dovecot-err.log
-rw-rw-rw- 1 root root 1039 Oct  8 11:02 dovecot-inf.log

(Is terrible i know, but only a test)


I think you should follow the suggestion already provided:

 You should chown dovecot /var/log/dovecot-*.log



Now i have another error (written in log of dovecot!)

deliver([EMAIL PROTECTED]): Oct 08 11:08:20 Error: Can't connect to
auth server at /var/run/dovecot/auth-master: Permission denied

Seems all a problem of user running dovecot...is not root? Dunno why...
In config there isn't nothing to do so.

Any suggestion?


The auth-master permission problem is different, but the configuration you 
provided does not give enough information to identify a certain solution. It 
does imply that you have not followed the relevant documentation for using 
the LDA:


http://wiki.dovecot.org/LDA
http://wiki.dovecot.org/LDA/Postfix

You need to make sure that whatever user you are running *deliver* as (which 
is a function of your postfix config) has read/write access to the master 
socket, which has its user, group, and permissions set by the dovecot config.




Re: [Dovecot] shared mailboxes in 1.2 question

2008-10-08 Thread Robert Schetterer
Sascha Wilde schrieb:
 Timo Sirainen [EMAIL PROTECTED] writes:
 On Oct 6, 2008, at 7:24 PM, Robert Schetterer wrote:
 users after imap search, otherwise you always need some admin (
 perhaps
 with shell permissions ) for editing subcriptions and acls which not
 Actually the SUBSCRIBE IMAP command is enough to make the mailboxes
 visible, no admin/shell access needed.
 
 This doesn't work for me.
 
 Actually the whole new shared namespaces feature doesn't work as
 expected for me.  Using this namespace configuration:
 
 namespace shared {
   separator = /
   # %%u gets expanded to the remote user. Instead of %%u you can
   # also use %%n and %%d.
   prefix = users/%%u/
   location = 
 Maildir:/kolab/var/dovecot/spool/%%u/maildir:INDEX=/kolab/var/dovecot/spool/%u/maildir/shared_idx
   #location = Maildir:/kolab/var/dovecot/spool/%%u/maildir
   subscriptions = no
 }
 
 I get errors when using list:
 
 l002 list  *
 * LIST (\HasChildren) / INBOX
 * LIST (\HasNoChildren) / INBOX/Calendar
 * LIST (\HasNoChildren) / INBOX/Contacts
 * LIST (\HasNoChildren) / INBOX/Journal
 * LIST (\HasNoChildren) / INBOX/Notes
 * LIST (\HasNoChildren) / INBOX/Tasks
 * LIST (\HasNoChildren) / INBOX/bla
 l002 NO Unknown internal list error
 
 And cant subscribe or select an existing mailbox of another user:
 
 s001 subscribe users/[EMAIL PROTECTED]/INBOX/blablabla
 s001 NO Invalid mailbox name: users/[EMAIL PROTECTED]/INBOX/blablabla
 
 FWIW referencing an non existent mailbox causes an different error:
 
 s002 subscribe users/[EMAIL PROTECTED]/blablabla
 s002 NO [TRYCREATE] Mailbox doesn't exist: users/[EMAIL PROTECTED]/blablabla
 
 s102 select users/[EMAIL PROTECTED]/INBOX/blablabla
 * OK [CLOSED]
 s102 NO Invalid mailbox name
 
 And IMAP ACL commands are (at least partially) already implemented by
 Kolab people.
 
 Yes, look at http://hg.intevation.de/kolab/dovecot-1.2_acl-branch as
 announced...  ;-)
 
 cheers
 sascha

Hi Sascha,
why you need an extra branch for that ?
why not just code into dovecot directly
or is it ment as temp split and later merge ?

-- 
Best Regards

MfG Robert Schetterer

Germany/Munich/Bavaria


[Dovecot] Folders within folders?

2008-10-08 Thread ed beers
I'm trying to migrate my emails from an existing server (University of 
Washington IMAP toolkit) to dovecot.  My clients are all using Thunderbird.


I'm moving to a new Ubuntu based server (old one was Centos4) and 
selected dovecot solely because it was the default option.  I'm not 
committed to it if it isn't the right tool for my application.


My existing server allows hierarchical folders and these are used to 
organize 20 years worth of carefully sorted emails. 

I can create a new folders on the dovecot server but Thunderbird 
doesn't  allow me to create new sub-folders within them.  I think T-bird 
is configured OK since this works on the old server.


Is this a dovecot limitation or have I configured it incorrectly?




Re: [Dovecot] Folders within folders?

2008-10-08 Thread Curtis Maloney

ed beers wrote:
I'm trying to migrate my emails from an existing server (University of 
Washington IMAP toolkit) to dovecot.  My clients are all using Thunderbird.


I'm moving to a new Ubuntu based server (old one was Centos4) and 
selected dovecot solely because it was the default option.  I'm not 
committed to it if it isn't the right tool for my application.


I very much doubt Dovecot is not the right tool for the job, if IMAP is what 
you're after :)


My existing server allows hierarchical folders and these are used to 
organize 20 years worth of carefully sorted emails.
I can create a new folders on the dovecot server but Thunderbird 
doesn't  allow me to create new sub-folders within them.  I think T-bird 
is configured OK since this works on the old server.


Is this a dovecot limitation or have I configured it incorrectly?


This is a mail store limitation, somewhat.

If you've opted for mbox, things can be tricky.  I've found for one server I 
use I have to create folders with a trailing / in order to be able to create 
sub-folders in them.  However, they then can not contain messages as well.


Maildir does not suffer this limitation, as it doesn't use a hierarchy of 
filesystem directories to denote mail folders.  Each folder is its own 
directory.


--
Curtis Maloney
[EMAIL PROTECTED]



Re: [Dovecot] Folders within folders?

2008-10-08 Thread Brian Hayden

On Oct 8 2008, ed beers wrote:

I'm trying to migrate my emails from an existing server (University of 
Washington IMAP toolkit) to dovecot.  My clients are all using Thunderbird.


I'm moving to a new Ubuntu based server (old one was Centos4) and 
selected dovecot solely because it was the default option.  I'm not 
committed to it if it isn't the right tool for my application.


My existing server allows hierarchical folders and these are used to 
organize 20 years worth of carefully sorted emails. 

I can create a new folders on the dovecot server but Thunderbird 
doesn't  allow me to create new sub-folders within them.  I think T-bird 
is configured OK since this works on the old server.


Is this a dovecot limitation or have I configured it incorrectly?


You have something configured incorrectly. Dovecot allows creating folders 
within folders out of the box (as does any non-idiotic IMAP server). I'd 
double-check the Thunderbird config for your test Dovecot account against 
one that you know will create subfolders on your UW server. They worked 
exactly the same when we tested this functionality during our conversion 
from UW.


--
Brian Hayden
UMN OIT Internet Services