[Dovecot] Request queue is full
Hello all, Today I had problems on one of the servers. Dovecot stopped working and I got lots of "Request queue is full" on logs. Aug 14 16:49:45 mailserver03 dovecot: auth(default): ldap([EMAIL PROTECTED]): Request queue is full Aug 14 16:49:45 mailserver03 dovecot: auth(default): ldap([EMAIL PROTECTED]): Request queue is full Aug 14 16:49:45 mailserver03 dovecot: auth(default): ldap([EMAIL PROTECTED],10.0.3.1): Request queue is full Only after a restart on dovecot daemon the services worked again. Does anyone know how can I fix this problem? The server were with about 900 imap connections and 300 pop3 connections. # 1.1.1: /etc/dovecot//dovecot.conf syslog_facility: local1 protocols: imap pop3 ssl_disable: yes disable_plaintext_auth: no shutdown_clients: no login_dir: /usr//var/run/dovecot/login login_executable(default): /usr//libexec/dovecot/imap-login login_executable(imap): /usr//libexec/dovecot/imap-login login_executable(pop3): /usr//libexec/dovecot/pop3-login login_process_per_connection: no login_greeting_capability(default): yes login_greeting_capability(imap): yes login_greeting_capability(pop3): no login_process_size: 128 login_processes_count: 30 login_max_processes_count: 1024 login_max_connections: 512 max_mail_processes: 10240 mail_max_userip_connections(default): 20 mail_max_userip_connections(imap): 20 mail_max_userip_connections(pop3): 10 mail_uid: 1033 mail_gid: 1033 mail_location: maildir:%h/Maildir mail_executable(default): /usr//libexec/dovecot/imap mail_executable(imap): /usr//libexec/dovecot/imap mail_executable(pop3): /usr//libexec/dovecot/pop3 mail_plugins(default): quota imap_quota autocreate mail_plugins(imap): quota imap_quota autocreate mail_plugins(pop3): quota mail_plugin_dir(default): /usr//lib/dovecot/imap mail_plugin_dir(imap): /usr//lib/dovecot/imap mail_plugin_dir(pop3): /usr//lib/dovecot/pop3 pop3_no_flag_updates(default): no pop3_no_flag_updates(imap): no pop3_no_flag_updates(pop3): yes pop3_uidl_format(default): %08Xu%08Xv pop3_uidl_format(imap): %08Xu%08Xv pop3_uidl_format(pop3): %f pop3_client_workarounds(default): pop3_client_workarounds(imap): pop3_client_workarounds(pop3): outlook-no-nuls namespace: type: private prefix: INBOX. inbox: yes list: yes subscriptions: yes auth default: mechanisms: plain login passdb: driver: ldap args: /etc/dovecot/dovecot-ldap.conf userdb: driver: prefetch userdb: driver: ldap args: /etc/dovecot/dovecot-ldap.conf socket: type: listen master: path: /var/run/dovecot/auth-master mode: 438 plugin: quota: maildir quota_rule: *:bytes=10240 quota_rule2: *:messages=3 quota_rule3: Trash:bytes=10%% autocreate: SPAM.E Spam autocreate2: SPAM.Marcar Spam autocreate3: SPAM autocreate4: SPAM.Desmarcar Spam []s, Raphael Costa <>
Re: [Dovecot] IMAP Panic
On Sat, 2008-07-12 at 02:05 +0300, Timo Sirainen wrote:
> On Fri, 2008-07-11 at 13:43 -0300, Raphael Bittencourt S. Costa wrote:
> > Helo all,
> >
> > One of the users is havings problems when he tries to open .Sent folder.
> > Only after I deleted dovecot-uidlist, dovecot.index.cache
> > and dovecot.index.log the user could open the folder. Any idea?
>
> Could you send me the dovecot.index and dovecot.index.log the next time
> it happens? It'll make fixing this a bit easier. Those files don't
> contain anything sensitive about messages, just flags and some internal
> metadata.
>
I made a backup before deleting, all files are attached.
[]s
Raphael Costa
dovecot.index
Description: Binary data
dovecot.index.cache
Description: Binary data
[EMAIL PROTECTED]@ maildir !ËE 0 T $ °³DH [EMAIL PROTECTED]@ EH cache ([EMAIL PROTECTED] T $ °³DH [EMAIL PROTECTED]@ EH ([EMAIL PROTECTED] , [EMAIL PROTECTED]@ ÷EHíq+A÷EHðEHpB.Í 0
[EMAIL PROTECTED]@[EMAIL PROTECTED]@ EH H [EMAIL PROTECTED] [EMAIL PROTECTED]@ EH ¼ [EMAIL PROTECTED]@[EMAIL PROTECTED] [EMAIL PROTECTED]@ EH L
[EMAIL PROTECTED] [EMAIL PROTECTED]@ EH
([EMAIL PROTECTED]
l [EMAIL PROTECTED]@ »FHíq+A»FHK¤EH
0 [EMAIL PROTECTED]@[EMAIL PROTECTED]
[EMAIL PROTECTED]@[EMAIL PROTECTED] [EMAIL PROTECTED]@ »FHíq+A»FH
FH
[EMAIL PROTECTED]@
FHíq+A
FH
FHlï4Í [EMAIL PROTECTED]@ FHíq+AFH
FHlï4 [EMAIL PROTECTED]@ $ $ FHíq+AFH
FHlï4wØlHv_U9Y [EMAIL PROTECTED]@ EH ([EMAIL PROTECTED] [EMAIL PROTECTED] [EMAIL PROTECTED]@ $ $ ØlHíq+AØlHwØlH÷U9ØlH+þkÑ 0 [EMAIL PROTECTED]@[EMAIL PROTECTED] [EMAIL PROTECTED] [EMAIL PROTECTED],mH÷U9ØlH+þkÑ [EMAIL PROTECTED]< Í [EMAIL PROTECTED],mHíq+A,mH,mHPØlH+þkÑ Í [EMAIL PROTECTED] [EMAIL PROTECTED],mHíq+A,mH,mHÿ,mHý¦´ [EMAIL PROTECTED]
[EMAIL PROTECTED],mHíq+A,mH,mHÿ,mHý¦´ [EMAIL PROTECTED]
[EMAIL PROTECTED],mHíq+A,mH,mHÿ,mHý¦´ [EMAIL PROTECTED]
[EMAIL PROTECTED],mHíq+A,mH,mH ò,mHý¦´ Í [EMAIL PROTECTED]@ $ $ ,mHíq+A,mH,mH/,mHUJ U [EMAIL PROTECTED]@ $ $ ,mHíq+A,mH,mH/,mHUJ U [EMAIL PROTECTED] [EMAIL PROTECTED],mHíq+A,mH,mH/-mHOW [EMAIL PROTECTED] [EMAIL PROTECTED] ([EMAIL PROTECTED] H [EMAIL PROTECTED] [EMAIL PROTECTED] 0
[EMAIL PROTECTED]
3 V1170940299 N12
10 W10312338 :1212523593.M615980P18405.mailserver03,S=10180101:2,S
12 :1215114502.M951394P5053.mailserver03,S=2795122,W=2831447:2,S
[Dovecot] IMAP Panic
Helo all, One of the users is havings problems when he tries to open .Sent folder. Only after I deleted dovecot-uidlist, dovecot.index.cache and dovecot.index.log the user could open the folder. Any idea? Squirrel: Query: SORT (TO) ISO-8859-1 ALL dovecot.log: Jul 11 13:23:01 mailserver03 dovecot: imap-login: Login: user=<[EMAIL PROTECTED]>, method=PLAIN, rip=10.0.4.2, lip=10.0.149.3 Jul 11 13:23:03 mailserver03 dovecot: Panic: IMAP([EMAIL PROTECTED]): file index-sort-string.c: line 537 (index_sort_add_ids_range): assertion failed: (left_sort_id < right_sort_id) Jul 11 13:23:03 mailserver03 dovecot: IMAP([EMAIL PROTECTED]): Raw backtrace: imap [0x4833d0] -> imap [0x483433] -> imap [0x482b16] -> imap(index_sort_list_finish_string+0xda1) [0x451eb1] -> imap(index_storage_search_next_nonblock+0x425) [0x44ebe5] -> imap(mailbox_search_next+0x21) [0x455ab1] -> imap(imap_sort+0xd6) [0x4208f6] -> imap(cmd_sort+0x2d7) [0x419c47] -> imap(cmd_uid+0x52) [0x41a692] -> imap [0x41b05c] -> imap [0x41b112] -> imap [0x41b8bf] -> imap(client_input+0x63) [0x41bae3] -> imap(io_loop_handler_run+0xf8) [0x489cc8] -> imap(io_loop_run+0x1d) [0x4891bd] -> imap(main+0x3ca) [0x422f2a] -> /lib64/libc.so.6(__libc_start_main+0xf4) [0x2b797d759154] -> imap [0x4158e9] Jul 11 13:23:47 mailserver03 dovecot: imap-login: Login: user=<[EMAIL PROTECTED]>, method=PLAIN, rip=10.0.4.2, lip=10.0.149.3 Jul 11 13:23:50 mailserver03 dovecot: Panic: IMAP([EMAIL PROTECTED]): file index-sort-string.c: line 537 (index_sort_add_ids_range): assertion failed: (left_sort_id < right_sort_id) Jul 11 13:23:50 mailserver03 dovecot: IMAP([EMAIL PROTECTED]): Raw backtrace: imap [0x4833d0] -> imap [0x483433] -> imap [0x482b16] -> imap(index_sort_list_finish_string+0xda1) [0x451eb1] -> imap(index_storage_search_next_nonblock+0x425) [0x44ebe5] -> imap(mailbox_search_next+0x21) [0x455ab1] -> imap(imap_sort+0xd6) [0x4208f6] -> imap(cmd_sort+0x2d7) [0x419c47] -> imap(cmd_uid+0x52) [0x41a692] -> imap [0x41b05c] -> imap [0x41b112] -> imap [0x41b8bf] -> imap(client_input+0x63) [0x41bae3] -> imap(io_loop_handler_run+0xf8) [0x489cc8] -> imap(io_loop_run+0x1d) [0x4891bd] -> imap(main+0x3ca) [0x422f2a] -> /lib64/libc.so.6(__libc_start_main+0xf4) [0x2b2e94286154] -> imap [0x4158e9] dovecot -n # 1.1.1: /etc/dovecot//dovecot.conf syslog_facility: local1 protocols: imap pop3 ssl_disable: yes disable_plaintext_auth: no shutdown_clients: no login_dir: /usr//var/run/dovecot/login login_executable(default): /usr//libexec/dovecot/imap-login login_executable(imap): /usr//libexec/dovecot/imap-login login_executable(pop3): /usr//libexec/dovecot/pop3-login login_process_per_connection: no login_greeting_capability(default): yes login_greeting_capability(imap): yes login_greeting_capability(pop3): no login_process_size: 128 login_processes_count: 30 login_max_processes_count: 1024 login_max_connections: 512 max_mail_processes: 10240 mail_max_userip_connections(default): 20 mail_max_userip_connections(imap): 20 mail_max_userip_connections(pop3): 10 mail_uid: 1033 mail_gid: 1033 mail_location: maildir:%h/Maildir mail_executable(default): /usr//libexec/dovecot/imap mail_executable(imap): /usr//libexec/dovecot/imap mail_executable(pop3): /usr//libexec/dovecot/pop3 mail_plugins(default): quota imap_quota autocreate mail_plugins(imap): quota imap_quota autocreate mail_plugins(pop3): quota mail_plugin_dir(default): /usr//lib/dovecot/imap mail_plugin_dir(imap): /usr//lib/dovecot/imap mail_plugin_dir(pop3): /usr//lib/dovecot/pop3 pop3_no_flag_updates(default): no pop3_no_flag_updates(imap): no pop3_no_flag_updates(pop3): yes pop3_uidl_format(default): %08Xu%08Xv pop3_uidl_format(imap): %08Xu%08Xv pop3_uidl_format(pop3): %f pop3_client_workarounds(default): pop3_client_workarounds(imap): pop3_client_workarounds(pop3): outlook-no-nuls namespace: type: private prefix: INBOX. inbox: yes list: yes subscriptions: yes auth default: mechanisms: plain login passdb: driver: ldap args: /etc/dovecot/dovecot-ldap.conf userdb: driver: prefetch userdb: driver: ldap args: /etc/dovecot/dovecot-ldap.conf socket: type: listen master: path: /var/run/dovecot/auth-master mode: 438 plugin: quota: maildir quota_rule: *:bytes=10240 quota_rule2: *:messages=3 quota_rule3: Trash:bytes=10%% autocreate: SPAM.E Spam autocreate2: SPAM []s, Raphael Costa
Re: [Dovecot] 1 week after full migration to 1.1v
On Tue, 2008-06-24 at 15:20 +0100, Ed W wrote: > Hi > > Sounds like you know what you are doing! > No, sounds like I'm thinking what I'm doing. :-D I really need more information to get more from the structure. > >> - can I assume you have given some thought to > >> tuning your file system which handles the spool files? > >> > >> > > The server uses xfs for maildir partition and so on, it uses > > noatime,nodiratime,nobarrier,logbufs=8. > > > I guess you have read around a little on XFS + maildir? There was some > discussion a while back that showed it could sometimes get a little slow > without some tweaking - I think the logbugs param you used was mentioned > as the solution? That's right. > Since you are IO constrainted did you try some > benchmarks on other filesystems? > No. I used reiserfs before and I had many problems with it. The guy that was in charge before me tried xfs and showed me lots of good things about xfs. So, I decided to try it too. And backup is a problem here, so an security filesystem is very important for not losing mail. > Good luck > > Ed W
Re: [Dovecot] 1 week after full migration to 1.1v
On Tue, 2008-06-24 at 11:44 +0100, Ed W wrote: > Raphael Bittencourt S. Costa wrote: > > Ehlo all, > > > > I've been working on a migration of about 240K users from one server > > with qmail, courier imap, maildrop and ldap to postfix, dovecot, lda > > +sieve. Before the migration the server and the storage were always on > > high load. > > > > > > It almost doesn't seem enough of a drop...! Really? The load of the qmail server were always on 120, but if something happens, like suddenly increase of mail deliver the server load jumps to 800. With postfix+dovecot the highest load I got was 35. > Have you benchmarked the > various apps a little? No, only dovecotxCourier. > Postfix syncs disks like crazy to prevent mail > loss in case of disaster Postfix queue is on local disk, and iostat only shows 6% of utilization. > - can I assume you have given some thought to > tuning your file system which handles the spool files? > The server uses xfs for maildir partition and so on, it uses noatime,nodiratime,nobarrier,logbufs=8. > Good luck > > Ed W
Re: [Dovecot] 1 week after full migration to 1.1v
Joe, On Mon, 2008-06-23 at 22:58 +0800, Joe Wong wrote: > Hi Raphael, > > Can you also share the figures on the average mailbox size This is very hard to know... Because it depends on the hosting package, now every new mail account is created with 1,5G. > and number of > cocurrent users in peak hour before and after migration? The concurrent users doesnt change after the migration. Its about 820 concurrent imap users and 400 concurrent pop3 users. > What is your > hardware configuration (CPU / MEMORY / DISK TYPE )? Server is a Dell PE 1950, dual xeon(5160), 4G, 2x146SAS and the storage is Hitachi AMS 500, with 41x146G Fiber 15K. > - Joe > > - Original Message - > From: "Raphael Bittencourt S. Costa" <[EMAIL PROTECTED]> > To: "dovecot" > Sent: Monday, June 23, 2008 10:36 PM > Subject: [Dovecot] 1 week after full migration to 1.1v > > > > Ehlo all, > > > > I've been working on a migration of about 240K users from one server > > with qmail, courier imap, maildrop and ldap to postfix, dovecot, lda > > +sieve. Before the migration the server and the storage were always on > > high load. > > > > > > Before migration: > > > > Storage IOPs = 4600 > > Read average = 2800 > > Write average = 1800 > > > > Storage CPU (Raid5) > > Crl0 = 50% > > Crl1 = 50% > > > > Server Load = 120 > > %user = 35 > > %system = 60 > > %iowait = 5 > > %idle = 0 > > > > After migration: > > > > Storage IOPs = 3000 > > Read average = 1200 > > Write average = 1800 > > > > Storage CPU (Raid5) > > Crl0 = 40% > > Crl1 = 40% > > > > Server Load = 25 > > %user = 10 > > %system = 27 > > %iowait = 40 > > %idle = 23 > > > > And now the server responds so quickly to any imap command. > > > > > > Dovecot is now the default imap/pop server here, Thanks Timo. > > > > > > []s, > > > > Raphael Costa > > > > > > > > > > >
[Dovecot] 1 week after full migration to 1.1v
Ehlo all, I've been working on a migration of about 240K users from one server with qmail, courier imap, maildrop and ldap to postfix, dovecot, lda +sieve. Before the migration the server and the storage were always on high load. Before migration: Storage IOPs = 4600 Read average = 2800 Write average = 1800 Storage CPU (Raid5) Crl0 = 50% Crl1 = 50% Server Load = 120 %user = 35 %system = 60 %iowait = 5 %idle = 0 After migration: Storage IOPs = 3000 Read average = 1200 Write average = 1800 Storage CPU (Raid5) Crl0 = 40% Crl1 = 40% Server Load = 25 %user = 10 %system = 27 %iowait = 40 %idle = 23 And now the server responds so quickly to any imap command. Dovecot is now the default imap/pop server here, Thanks Timo. []s, Raphael Costa
Re: [Dovecot] Dovecot 1.1rc9 strange messages
On Fri, 2008-06-13 at 01:57 +0300, Timo Sirainen wrote: > There's no Dovecot v1.0 used anywhere? How did you get these > dovecot-uidlist files created? Did you use a Courier migration script > or > rename them manually? I used courier migration script. > > These error messages can happen only when Dovecot reads version 1 > format > of the dovecot-uidlist file. This format is created by Dovecot v1.0 > and > Courier. After Dovecot v1.1 has updated the file it's in version 3 > format and this error message can't happen anymore. > Ok. I will monitor the logs files after the full migration is done. :-) > So apparently some versions of Courier can also update the > courierimapuiddb by appending new entries instead of rewriting the > file > and updating the next-uid field in the header line? What Courier > version > were you using before? The version is courier-imap-3.0.8-1. Thanks Timo. Raphael Costa
[Dovecot] Dovecot 1.1rc9 strange messages
Helo all, I'm working on a migration from qmail+courier+maildrop to postfix +dovecot1.1+lda and today the logs has too many strange messages like this: Jun 12 10:51:22 mailserver03 dovecot: IMAP([EMAIL PROTECTED]): Broken file /data/services/dominios/xx.com.br/m/ma/mapel//Maildir/.Sent/dovecot-uidlist line 29: UID larger than next_uid (535 >= 535) Jun 12 10:51:26 mailserver03 dovecot: POP3([EMAIL PROTECTED]): Broken file /data/services/dominios/bx.com.br/n/no/nordeste//Maildir/dovecot-uidlist line 2: UID larger than next_uid (12 >= 12) Should I worry about this? Why dovecot-uidlist is getting broken? []s, Raphael Costa
Re: [Dovecot] Expire plugin isn't working
Could you send your configuration? Because on my server the imap still doesn't start dict process, On Fri, 2008-04-25 at 02:18 +0200, Anders wrote: > Raphael Bittencourt S. Costa wrote: > > It's still not working. The dict is called only by expire-tool. > > > > I see the db change as mails are moved around, but I still did not > manage to get expire-tool to delete any mail. I guess it uses the > current time of day for the action, not a message timestamp, so I will > actually have to way a few days to see it work? > > Cheers > Anders. > > []s, Raphael Costa
Re: [Dovecot] Expire plugin isn't working
On Fri, 2008-04-25 at 02:57 +0300, Timo Sirainen wrote: > You mean the dict db isn't even created by expire plugin? Yes. > It was created > in my tests (and expire_altmove also worked in my previous tests). > What > configuration are you using? dovecot -n # 1.1.rc4: /etc/dovecot//dovecot.conf syslog_facility: local1 protocols: imap pop3 ssl_disable: yes disable_plaintext_auth: no shutdown_clients: no login_dir: /usr//var/run/dovecot/login login_executable(default): /usr//libexec/dovecot/imap-login login_executable(imap): /usr//libexec/dovecot/imap-login login_executable(pop3): /usr//libexec/dovecot/pop3-login login_process_per_connection: no login_greeting_capability(default): yes login_greeting_capability(imap): yes login_greeting_capability(pop3): no login_process_size: 128 login_processes_count: 30 login_max_processes_count: 1024 login_max_connections: 512 max_mail_processes: 10240 mail_max_userip_connections(default): 20 mail_max_userip_connections(imap): 20 mail_max_userip_connections(pop3): 10 mail_uid: 1033 mail_gid: 1033 mail_location: maildir:%h/Maildir mail_executable(default): /usr//libexec/dovecot/imap mail_executable(imap): /usr//libexec/dovecot/imap mail_executable(pop3): /usr//libexec/dovecot/pop3 mail_plugins(default): quota imap_quota autocreate expire mail_plugins(imap): quota imap_quota autocreate expire mail_plugins(pop3): quota mail_plugin_dir(default): /usr//lib/dovecot/imap mail_plugin_dir(imap): /usr//lib/dovecot/imap mail_plugin_dir(pop3): /usr//lib/dovecot/pop3 pop3_no_flag_updates(default): no pop3_no_flag_updates(imap): no pop3_no_flag_updates(pop3): yes pop3_uidl_format(default): %08Xu%08Xv pop3_uidl_format(imap): %08Xu%08Xv pop3_uidl_format(pop3): %f pop3_client_workarounds(default): pop3_client_workarounds(imap): pop3_client_workarounds(pop3): outlook-no-nuls namespace: type: private prefix: INBOX. inbox: yes list: yes subscriptions: yes auth default: mechanisms: plain login cache_size: 20480 cache_ttl: 300 cache_negative_ttl: 0 passdb: driver: ldap args: /etc/dovecot/dovecot-ldap.conf userdb: driver: prefetch userdb: driver: ldap args: /etc/dovecot/dovecot-ldap.conf socket: type: listen master: path: /var/run/dovecot/auth-master mode: 438 plugin: quota: maildir quota_rule: *:bytes=10240 quota_rule2: *:messages=3 autocreate: SPAM.E Spam autocreate2: SPAM.Marcar Spam autocreate3: SPAM autocreate4: SPAM.Desmarcar Spam expire: Trash 1 SPAM 10 SPAM/* 10 Sent 30 expire_dict: proxy::expire auth_socket_path: /var/run/dovecot/auth-master dict: expire: db:/usr/lib/dovecot/expidb/expire.db
Re: [Dovecot] Expire plugin isn't working
Timo, It's still not working. The dict is called only by expire-tool. On Fri, 2008-04-25 at 00:53 +0300, Timo Sirainen wrote: > On Wed, 2008-04-16 at 10:49 +0200, Anders wrote: > > Raphael Bittencourt S. Costa wrote: > > > > > I followed the wiki to configured the expire plugin on dovecot-1.1rc4 > > > and it isn't working. No error messages on logs or on the execution of > > > "dovecot --exec-mail ext /usr/libexec/dovecot/expire-tool". > > > > Same problem for me. The expire plugin is in fact active, as I get an > > error when intentionally malforming the expire= configuration line. > > > > After observing my install for a bit, though, I have come to the > > understanding that the expire plugin never really does anything. The proxy > > db is only created when the expire-tool is run at night, and never touched > > during the day. > > This should fix it: http://hg.dovecot.org/dovecot-1.1/rev/e1fe3d080314 > []s, Raphael Costa
[Dovecot] Expire plugin isn't working
Hello all, I followed the wiki to configured the expire plugin on dovecot-1.1rc4 and it isn't working. No error messages on logs or on the execution of "dovecot --exec-mail ext /usr/libexec/dovecot/expire-tool". mailserver02:~ # dovecot -n # 1.1.rc4: /etc/dovecot//dovecot.conf syslog_facility: local1 protocols: imap pop3 ssl_disable: yes disable_plaintext_auth: no shutdown_clients: no login_dir: /usr//var/run/dovecot/login login_executable(default): /usr//libexec/dovecot/imap-login login_executable(imap): /usr//libexec/dovecot/imap-login login_executable(pop3): /usr//libexec/dovecot/pop3-login login_process_per_connection: no login_greeting_capability(default): yes login_greeting_capability(imap): yes login_greeting_capability(pop3): no login_process_size: 128 login_processes_count: 30 login_max_processes_count: 1024 login_max_connections: 512 max_mail_processes: 10240 mail_max_userip_connections(default): 20 mail_max_userip_connections(imap): 20 mail_max_userip_connections(pop3): 10 mail_uid: 1033 mail_gid: 1033 mail_location: maildir:%h/Maildir mail_executable(default): /usr//libexec/dovecot/imap mail_executable(imap): /usr//libexec/dovecot/imap mail_executable(pop3): /usr//libexec/dovecot/pop3 mail_plugins(default): expire quota imap_quota autocreate mail_plugins(imap): expire quota imap_quota autocreate mail_plugins(pop3): quota mail_plugin_dir(default): /usr//lib/dovecot/imap mail_plugin_dir(imap): /usr//lib/dovecot/imap mail_plugin_dir(pop3): /usr//lib/dovecot/pop3 pop3_no_flag_updates(default): no pop3_no_flag_updates(imap): no pop3_no_flag_updates(pop3): yes pop3_uidl_format(default): %08Xu%08Xv pop3_uidl_format(imap): %08Xu%08Xv pop3_uidl_format(pop3): %f pop3_client_workarounds(default): pop3_client_workarounds(imap): pop3_client_workarounds(pop3): outlook-no-nuls namespace: type: private prefix: INBOX. inbox: yes list: yes subscriptions: yes auth default: mechanisms: plain login cache_size: 20480 cache_ttl: 300 cache_negative_ttl: 0 passdb: driver: ldap args: /etc/dovecot/dovecot-ldap.conf userdb: driver: prefetch userdb: driver: ldap args: /etc/dovecot/dovecot-ldap.conf socket: type: listen master: path: /var/run/dovecot/auth-master mode: 438 plugin: quota: maildir quota_rule: *:bytes=10240 quota_rule2: *:messages=3 autocreate: SPAM.E Spam autocreate2: SPAM.Marcar Spam autocreate3: SPAM autocreate4: SPAM.Desmarcar Spam expire: Trash 1 SPAM 10 SPAM/* 10 Sent 30 expire_dict: proxy::expire auth_socket_path: /var/run/dovecot/auth-master dict: expire: db:/usr/lib/dovecot/expidb/expire.db
Re: [Dovecot] Strange dmesg messages
On Tue, 2008-04-08 at 00:16 +0300, Uldis Pakuls wrote: > Charles Marcus wrote: > > On 4/7/2008, Raphael Bittencourt S. Costa ([EMAIL PROTECTED]) > > wrote: > >> Using dnotify dovecot's performance was very bad. The system consumes > >> 90% of cpu with just a few imap process running (about 30 process). > >> The performance using --with-notify=none was the same as using inotify, > >> so it could be the solution for me. > > > > dnotify has been deprecated for a long time, and inotify has been > > recommended to be used instead for just as long... > > > You are using SLES10 - isn't ? Yes. > Have you contacted SuSE developers about > this inotify problem? Not yet. > Even if there is something wrong with dovecot it > MUST NOT cause kernel level crash, just return error to dovecot... I will try RedHat ES5. Unfornately I have to use Suse or RedHat to have a better support on problems with the storage from Hitachi.
Re: [Dovecot] Strange dmesg messages
On Sat, 2008-04-05 at 14:22 +0300, Uldis Pakuls wrote: > donotify is more resource expensive - inotify allows monitoring of > both > files and directories via a single open fd. > so before you try --with-notify=none, try --with-notify=dnotify Using dnotify dovecot's performance was very bad. The system consumes 90% of cpu with just a few imap process running (about 30 process). The performance using --with-notify=none was the same as using inotify, so it could be the solution for me. Raphael Costa
Re: [Dovecot] Strange dmesg messages
The problem still remains after I removed hdlm driver.
I've tested on Suse10 with kernel 2.6.16.21-0.8-smp x86_64 and
2.6.16.27-0.9-smp x86_64, with and without hdlm driver. What kernel
version do you use on your suse servers?
What is the impact on performance if I compile using --with-notify=none?
If I couldn't solve this, I'll problably try Debian.
Code: f0 ff 4d 20 0f 94 c0 31 db 84 c0 74 54 48 8b 5d 28 f0 ff 4b
RIP {sys_inotify_rm_watch+280} RSP
CR2: 0020
<1>Unable to handle kernel NULL pointer dereference at 0020
RIP:
{sys_inotify_rm_watch+280}
PGD 11a947067 PUD 11716f067 PMD 0
Oops: 0002 [127] SMP
last sysfs
file: /devices/pci:00/:00:1c.0/:04:00.0/:05:00.0/power/state
CPU 3
Modules linked in: ipv6 bonding button battery ac apparmor aamatch_pcre
ext3 jbd loop usbhid shpchp ide_cd cdrom hw_random pci_hotplug ehci_hcd
uhci_hcd bnx2 usbcore reiserfs dm_snapshot edd dm_mod fan thermal
processor lpfc scsi_transport_fc sg megaraid_sas piix sd_mod scsi_mod
ide_disk ide_core
Pid: 6753, comm: imap Not tainted 2.6.16.27-0.9-smp #1
RIP: 0010:[] {sys_inotify_rm_watch
+280}
RSP: 0018:810119a13f38 EFLAGS: 00010202
RAX: RBX: 8101189a4af8 RCX:
RDX: RSI: 0001 RDI: 810117d6f958
RBP: R08: 000500fe R09: 00027f70
R10: R11: 0206 R12: 8101189a4ac0
R13: 810117d6f958 R14: 810117d6f750 R15: 810119fd5c80
FS: 2ad47d849ae0() GS:81012b00aa40()
knlGS:
CS: 0010 DS: ES: CR0: 8005003b
CR2: 0020 CR3: 000119d2d000 CR4: 06e0
Process imap (pid: 6753, threadinfo 810119a12000, task
810129d8c0c0)
Stack: 00012d6a86c0 8017b6f3 005e4ee0
005db860
005e4e40
005e4c90
7fff2d6b08d0 8010a7be
Call Trace: {sys_read+69}
{system_call+126}
Code: f0 ff 4d 20 0f 94 c0 31 db 84 c0 74 54 48 8b 5d 28 f0 ff 4b
RIP {sys_inotify_rm_watch+280} RSP
CR2: 0020
On Fri, 2008-04-04 at 01:56 +0300, Uldis Pakuls wrote:
> Raphael Bittencourt S. Costa wrote:
> > I moved the maildir location from Hitachi's storage to local sas disk
> > and got the same erro using imaptest. Debug doesn't show any usable
> > information. :-(
> >
> > Any ideas?
> >
> >
> To trace your problem you need to debug kernel... as it is kernel level
> crash.
> Try ask for help in kernel.org newsgroups.
>
> from your logs:
> Pid: 24319, comm: imap Tainted: P U 2.6.16.21-0.8-smp #1
>
> this line means - kernel is "tainted":
> P - A module with a Proprietary license has been loaded
> U - An Unsupported module has been loaded, i.e. a module which is not
> supported by Novell (SuSE specific flag)
>
> [ see:
> https://secure-support.novell.com/KanisaPlatform/Publishing/250/3582750_f.SAL_Public.html
> ]
>
> Try unload propertary and unsupported modules ; then run imaptest again.
>
>
Re: [Dovecot] Strange dmesg messages
Uldis, I'll do it right now and make more tests. Thanks, On Fri, 2008-04-04 at 01:56 +0300, Uldis Pakuls wrote: > Raphael Bittencourt S. Costa wrote: > > I moved the maildir location from Hitachi's storage to local sas disk > > and got the same erro using imaptest. Debug doesn't show any usable > > information. :-( > > > > Any ideas? > > > > > To trace your problem you need to debug kernel... as it is kernel level > crash. > Try ask for help in kernel.org newsgroups. > > from your logs: > Pid: 24319, comm: imap Tainted: P U 2.6.16.21-0.8-smp #1 > > this line means - kernel is "tainted": > P - A module with a Proprietary license has been loaded > U - An Unsupported module has been loaded, i.e. a module which is not > supported by Novell (SuSE specific flag) > > [ see: > https://secure-support.novell.com/KanisaPlatform/Publishing/250/3582750_f.SAL_Public.html > ] > > Try unload propertary and unsupported modules ; then run imaptest again. > > Raphael Costa
Re: [Dovecot] Strange dmesg messages
That is true, it was a considence. I got an error after that. Now I'm lost. :-| What more tests can I do to know where the problem is? I want do more tests before recompile dovecot with --with-notify. On Thu, 2008-04-03 at 23:41 +0300, Timo Sirainen wrote: > On Thu, 2008-04-03 at 16:55 -0300, Raphael Bittencourt S. Costa wrote: > > The erro stops when I uncomment > > > > mail_max_userip_connections = 10 > > > > does it make any sence? > > The default is 10, so commenting or uncommenting it should make no > difference at all.
Re: [Dovecot] Strange dmesg messages
The erro stops when I uncomment
mail_max_userip_connections = 10
does it make any sence?
On Thu, 2008-04-03 at 16:34 -0300, Raphael Bittencourt S. Costa wrote:
> I moved the maildir location from Hitachi's storage to local sas disk
> and got the same erro using imaptest. Debug doesn't show any usable
> information. :-(
>
> Any ideas?
>
>
>
> On Thu, 2008-04-03 at 19:01 +0300, Uldis Pakuls wrote:
>
> > Raphael Bittencourt S. Costa wrote:
> > > On Thu, 2008-04-03 at 09:25 +0300, Uldis Pakuls wrote:
> > >
> > >
> > >> Raphael Bittencourt S. Costa wrote:
> > >>
> > >>> Guys,
> > >>>
> > >>> I'm getting strange messages on my new server with dovecot-1.1rc4 + lda
> > >>> + sieve + ldap + postfix + suse10. This server is in production since
> > >>> monday, and worked fine until today. The only thing I had changed was
> > >>> dovecot from 1.1rc3 to 1.1rc4. I already enabled mail_debug, but I got
> > >>> any erros after that.
> > >>>
> > >>> Does anyone have any idea of what is happening?
> > >>>
> > >>> Unable to handle kernel NULL pointer dereference at 0020
> > >>> RIP:
> > >>> {sys_inotify_rm_watch+280}
> > >>>
> > >>>
> > >> It is a kernel level crash in function sys_inotify_rm_watch.;
> > >>
> > >> */*/fs/inotify_user.c - inotify support for userspace/*/*
> > >>
> > >> I don't think its dovecot's fault. Have you installed any vendor
> > >> specific/propertary storage drivers?
> > >>
> > >>
> > >
> > > Just using Hitachi's HDLM for multipath and failover.
> > >
> > >
> > It's looks like problem with storage drivers (kernel modules) ; crash
> > after attempt to free inotify data.
> > As workaroud I may sugest to use difrenet notify method. (configure
> > option "--with-notify=")
> >
> > Uldis
> >
> > p.s.
> > I have 9 production servers running different versions of SuSE linux and
> > never have such a problem.
> > Something like this I got only once: after adding LSI pseudo raid
> > adapter useing LSI propertary drivers./**/*/*/
> >
> > /*/*
Atenciosamente,
Raphael Bittencourt S. Costa
Engenharia
---
ALOG Data Centers do Brasil
Excelência em Projetos de Hosting
R Voluntários da Pátria 360 - RJ -
CEP 22270-010
Telefone: 21 3083-3364 - Fax: 21
3083-3300 http://www.alog.com.br
<>
signature.asc
Description: This is a digitally signed message part
Re: [Dovecot] Strange dmesg messages
I moved the maildir location from Hitachi's storage to local sas disk
and got the same erro using imaptest. Debug doesn't show any usable
information. :-(
Any ideas?
On Thu, 2008-04-03 at 19:01 +0300, Uldis Pakuls wrote:
> Raphael Bittencourt S. Costa wrote:
> > On Thu, 2008-04-03 at 09:25 +0300, Uldis Pakuls wrote:
> >
> >
> >> Raphael Bittencourt S. Costa wrote:
> >>
> >>> Guys,
> >>>
> >>> I'm getting strange messages on my new server with dovecot-1.1rc4 + lda
> >>> + sieve + ldap + postfix + suse10. This server is in production since
> >>> monday, and worked fine until today. The only thing I had changed was
> >>> dovecot from 1.1rc3 to 1.1rc4. I already enabled mail_debug, but I got
> >>> any erros after that.
> >>>
> >>> Does anyone have any idea of what is happening?
> >>>
> >>> Unable to handle kernel NULL pointer dereference at 0020
> >>> RIP:
> >>> {sys_inotify_rm_watch+280}
> >>>
> >>>
> >> It is a kernel level crash in function sys_inotify_rm_watch.;
> >>
> >> */*/fs/inotify_user.c - inotify support for userspace/*/*
> >>
> >> I don't think its dovecot's fault. Have you installed any vendor
> >> specific/propertary storage drivers?
> >>
> >>
> >
> > Just using Hitachi's HDLM for multipath and failover.
> >
> >
> It's looks like problem with storage drivers (kernel modules) ; crash
> after attempt to free inotify data.
> As workaroud I may sugest to use difrenet notify method. (configure
> option "--with-notify=")
>
> Uldis
>
> p.s.
> I have 9 production servers running different versions of SuSE linux and
> never have such a problem.
> Something like this I got only once: after adding LSI pseudo raid
> adapter useing LSI propertary drivers./**/*/*/
>
> /*/*
Re: [Dovecot] Strange dmesg messages
On Thu, 2008-04-03 at 09:25 +0300, Uldis Pakuls wrote:
> Raphael Bittencourt S. Costa wrote:
> > Guys,
> >
> > I'm getting strange messages on my new server with dovecot-1.1rc4 + lda
> > + sieve + ldap + postfix + suse10. This server is in production since
> > monday, and worked fine until today. The only thing I had changed was
> > dovecot from 1.1rc3 to 1.1rc4. I already enabled mail_debug, but I got
> > any erros after that.
> >
> > Does anyone have any idea of what is happening?
> >
> > Unable to handle kernel NULL pointer dereference at 0020
> > RIP:
> > {sys_inotify_rm_watch+280}
> >
>
> It is a kernel level crash in function sys_inotify_rm_watch.;
>
> */*/fs/inotify_user.c - inotify support for userspace/*/*
>
> I don't think its dovecot's fault. Have you installed any vendor
> specific/propertary storage drivers?
>
Just using Hitachi's HDLM for multipath and failover.
> Uldis
[Dovecot] Strange dmesg messages
Guys,
I'm getting strange messages on my new server with dovecot-1.1rc4 + lda
+ sieve + ldap + postfix + suse10. This server is in production since
monday, and worked fine until today. The only thing I had changed was
dovecot from 1.1rc3 to 1.1rc4. I already enabled mail_debug, but I got
any erros after that.
Does anyone have any idea of what is happening?
Unable to handle kernel NULL pointer dereference at 0020
RIP:
{sys_inotify_rm_watch+280}
PGD 1107f0067 PUD 1154c8067 PMD 0
Oops: 0002 [1] SMP
last sysfs file: /block/sda/size
CPU 2
Modules linked in: iptable_filter ip_tables x_tables nls_utf8 joydev st
sr_mod ipv6 bonding button battery ac raid0 xfs_quota ext3 jbd loop
sddlmfdrv ehci_hcd uhci_hcd hw_random usbcore shpchp ide_cd cdrom
pci_hotplug bnx2 sddlmadrv xfs exportfs dm_snapshot edd dm_mod fan
thermal processor lpfc scsi_transport_fc sg megaraid_sas piix sd_mod
scsi_mod ide_disk ide_core
Pid: 24319, comm: imap Tainted: P U 2.6.16.21-0.8-smp #1
RIP: 0010:[] {sys_inotify_rm_watch
+280}
RSP: 0018:810112abbf38 EFLAGS: 00010202
RAX: RBX: 81008bd57cf8 RCX:
RDX: RSI: 0001 RDI: 8100360627b8
RBP: R08: db6a R09: 051ae25c
R10: 47f3f600 R11: 0213 R12: 81008bd57cc0
R13: 8100360627b8 R14: 8100360625b0 R15: 810121f7c580
FS: 2b90b22a5ae0() GS:81012bd6b340()
knlGS:
CS: 0010 DS: ES: CR0: 8005003b
CR2: 0020 CR3: 00010adca000 CR4: 06e0
Process imap (pid: 24319, threadinfo 810112aba000, task
810026b107d0)
Stack: 0001f8c42d10 8017b3d3 0001
005ff680
006027a0
005e0420
78c4af20 8010a7be
Call Trace: {sys_read+69}
{system_call+126}
And dovecot's log only shows:
Apr 2 18:09:16 mailserver02 dovecot: POP3(paulo.faria@): Disconnected:
Logged out top=0/0, retr=1/2248, del=0/495, size=2406763
2
Apr 2 18:09:20 mailserver02 deliver(everson.todoroki@):
msgid=<[EMAIL PROTECTED]>: saved m
ail to INBOX
Apr 2 18:09:20 mailserver02 dovecot: child 24319 (imap) killed with
signal 9
Apr 2 18:09:21 mailserver02 dovecot: pop3-login: Login:
user=, method=PLAIN, rip=10.0.3.2, lip=10.0.149.2
Apr 2 18:09:21 mailserver02 deliver(everson.todoroki@):
msgid=<[EMAIL PROTECTED]>: saved m
ail to INBOX
Apr 2 18:09:23 mailserver02 dovecot: pop3-login: Login:
user=, method=PLAIN, rip=10.0.3.2, lip=10.0.149.
2
mailserver02:~ # dovecot -n
# 1.1.rc4: /etc/dovecot//dovecot.conf
syslog_facility: local1
protocols: imap pop3
ssl_disable: yes
disable_plaintext_auth: no
shutdown_clients: no
login_dir: /usr//var/run/dovecot/login
login_executable(default): /usr//libexec/dovecot/imap-login
login_executable(imap): /usr//libexec/dovecot/imap-login
login_executable(pop3): /usr//libexec/dovecot/pop3-login
login_process_per_connection: no
login_greeting_capability(default): yes
login_greeting_capability(imap): yes
login_greeting_capability(pop3): no
login_process_size: 128
login_processes_count: 30
login_max_processes_count: 1024
login_max_connections: 512
max_mail_processes: 10240
mail_uid: 1033
mail_gid: 1033
mail_location: maildir:%h/Maildir
mail_debug: yes
mail_executable(default): /usr//libexec/dovecot/imap
mail_executable(imap): /usr//libexec/dovecot/imap
mail_executable(pop3): /usr//libexec/dovecot/pop3
mail_plugins(default): quota imap_quota autocreate
mail_plugins(imap): quota imap_quota autocreate
mail_plugins(pop3): quota
mail_plugin_dir(default): /usr//lib/dovecot/imap
mail_plugin_dir(imap): /usr//lib/dovecot/imap
mail_plugin_dir(pop3): /usr//lib/dovecot/pop3
maildir_copy_with_hardlinks = yes
pop3_uidl_format(default): %08Xu%08Xv
pop3_uidl_format(imap): %08Xu%08Xv
pop3_uidl_format(pop3): %f
pop3_client_workarounds(default):
pop3_client_workarounds(imap):
pop3_client_workarounds(pop3): outlook-no-nuls
namespace:
type: private
prefix: INBOX.
inbox: yes
list: yes
subscriptions: yes
auth default:
mechanisms: plain login
cache_size: 20480
cache_ttl: 300
cache_negative_ttl: 0
passdb:
driver: ldap
args: /etc/dovecot/dovecot-ldap.conf
userdb:
driver: prefetch
userdb:
driver: ldap
args: /etc/dovecot/dovecot-ldap.conf
socket:
type: listen
master:
path: /var/run/dovecot/auth-master
mode: 438
plugin:
quota: maildir
quota_rule: *:bytes=10240
quota_rule2: *:messages=3
autocreate: SPAM.E Spam
autocreate2: SPAM.Marcar Spam
autocreate3: SPAM
autocreate4: SPAM.Desmarcar Spam
[]s,
Raphael Costa
Re: [Dovecot] 1.1beta14 cache bug ?
It worked on 1.1rc1. Thanks Timo, Raphael Costa On Thu, 2008-02-21 at 15:59 +0200, Timo Sirainen wrote: > On Tue, 2008-01-22 at 14:20 -0200, Raphael Bittencourt S. Costa wrote: > > After enable auth_cache_size = 20480 and auth_cache_ttl = 0, dovecot > > stops working for users that are in cache. See the log bellow: > > This fixes some issues with proxy_maybe: > http://hg.dovecot.org/dovecot-1.1/rev/27b7b6c34961 > > Does it help to this problem? I also added code to make cache hit lines > show what they had cached: > > http://hg.dovecot.org/dovecot-1.1/rev/6127a0501e72 > http://hg.dovecot.org/dovecot-1.1/rev/e0debdcd2e10 >
Re: [Dovecot] Put existing mails (in Maildir) through sieve filter?
Andreas, You can write a shell script to do this for you. cd ~/Maildir/cur for i in *; do /usr/local/libexec/dovecot/deliver -d user < $i; rm -f $i; echo "Message $i"; done On Thu, 2008-02-21 at 16:40 +0100, Andreas Ntaflos wrote: > Hello list, > > the scenario: A user has about 30k mails in his Maildir (all in INBOX) and > needs to apply filtering. Provided he writes a working .dovecot.sieve script, > is there a way to put all those already delivered mails through Dovecot's LDA > and thus have the sieve filter rules applied? Or is there any other way to > apply sieve rules to already delivered mails? > > TIA > > Andreas []s, Raphael Costa
Re: [Dovecot] 1.1beta14 cache bug ?
Timo, Follows dovecot -n: protocols: imap pop3 ssl_disable: yes disable_plaintext_auth: no shutdown_clients: no login_dir: /usr/local/var/run/dovecot/login login_executable(default): /usr/local/libexec/dovecot/imap-login login_executable(imap): /usr/local/libexec/dovecot/imap-login login_executable(pop3): /usr/local/libexec/dovecot/pop3-login login_process_per_connection: no login_greeting_capability(default): yes login_greeting_capability(imap): yes login_greeting_capability(pop3): no login_process_size: 128 login_processes_count: 30 login_max_processes_count: 1024 login_max_connections: 512 max_mail_processes: 10240 mail_uid: 1033 mail_gid: 1033 mail_location: maildir:%h/Maildir mail_debug: yes mail_executable(default): /usr/local/libexec/dovecot/imap mail_executable(imap): /usr/local/libexec/dovecot/imap mail_executable(pop3): /usr/local/libexec/dovecot/pop3 mail_plugins(default): quota imap_quota mail_plugins(imap): quota imap_quota mail_plugins(pop3): quota mail_plugin_dir(default): /usr/local/lib/dovecot/imap mail_plugin_dir(imap): /usr/local/lib/dovecot/imap mail_plugin_dir(pop3): /usr/local/lib/dovecot/pop3 pop3_uidl_format(default): %08Xu%08Xv pop3_uidl_format(imap): %08Xu%08Xv pop3_uidl_format(pop3): %f pop3_client_workarounds(default): pop3_client_workarounds(imap): pop3_client_workarounds(pop3): outlook-no-nuls namespace: type: private prefix: INBOX. inbox: yes list: yes subscriptions: yes auth default: mechanisms: plain login cache_ttl: 0 cache_negative_ttl: 0 verbose: yes debug: yes passdb: driver: ldap args: /etc/dovecot/dovecot-ldap.conf userdb: driver: prefetch userdb: driver: ldap args: /etc/dovecot/dovecot-ldap.conf socket: type: listen master: path: /var/run/dovecot/auth-master mode: 438 plugin: quota: maildir quota_rule: *:bytes=10240 On Thu, 2008-01-31 at 17:58 +0200, Timo Sirainen wrote: > On Thu, 2008-01-31 at 17:55 +0200, Timo Sirainen wrote: > > On Thu, 2008-01-31 at 13:42 -0200, Raphael Bittencourt S. Costa wrote: > > > Here is dovecot-ldap.conf: > > .. > > > pass_attrs = > > > uid=user,userPassword=password,mailMessageStore=userdb_home,qmailUID=userdb_uid,qmailGID=userdb_gid,mailQuotaSize=userdb_quota_rule=*:bytes,qmailUID=proxy_maybe,mailHostAddress=host > > > > This doesn't have "proxy". > > Whops, it does. I didn't notice it first because it wasn't visible in my > window (would have had to scroll horizontally). I'll see if I can > reproduce this. > []s, Raphael Costa
Re: [Dovecot] 1.1beta14 cache bug ?
Timo, Here is dovecot-ldap.conf: uris = ldap://10.0.x.x:389/ dn = cn=, o=xxx dnpass = sasl_bind = no auth_bind = yes ldap_version = 2 base = ou=%d,ou=accounts,o= deref = never scope = onelevel pass_attrs = uid=user,userPassword=password,mailMessageStore=userdb_home,qmailUID=userdb_uid,qmailGID=userdb_gid,mailQuotaSize=userdb_quota_rule=*:bytes,qmailUID=proxy_maybe,mailHostAddress=host pass_filter = (&(objectClass=qmailUser)(mail=% u)(!(accountStatus=disabled))) user_attrs = mailMessageStore=home,qmailUID=uid,qmailGID=gid,mailQuotaSize=quota_rule=*:bytes user_filter = (&(objectClass=qmailUser)(mail=% u)(!(accountStatus=disabled))) On Thu, 2008-01-31 at 17:15 +0200, Timo Sirainen wrote: > On Tue, 2008-01-22 at 14:20 -0200, Raphael Bittencourt S. Costa wrote: > > After enable auth_cache_size = 20480 and auth_cache_ttl = 0, dovecot > > stops working for users that are in cache. See the log bellow: > > Show your dovecot-ldap.conf? It seems cache key contains wrong > information. > []s, Raphael Costa
[Dovecot] 1.1beta14 cache bug ?
Helo all, After enable auth_cache_size = 20480 and auth_cache_ttl = 0, dovecot stops working for users that are in cache. See the log bellow: 1 - POP3 session OK jan 22 14:02:59 mailserver--03 dovecot: auth(default): client in: AUTH 1 PLAIN service=pop3lip=10.0.149.3 rip=10.0.2.2 resp= Jan 22 14:02:59 mailserver--03 dovecot: auth(default): cache([EMAIL PROTECTED],10.0.2.2): miss Jan 22 14:02:59 mailserver--03 dovecot: auth(default): ldap([EMAIL PROTECTED],10.0.2.2): bind search: base=ou=.com.br,ou=accounts,o=comMail filter=(&(objectClass=qmailUser)([EMAIL PROTECTED])(!(accountStatus=disabled))) Jan 22 14:02:59 mailserver--03 dovecot: auth(default): ldap([EMAIL PROTECTED],10.0.2.2): result: mailMessageStore(userdb_home)=/data/services/dominios/.com.br/t/te/teste2/ mailHostAddress(host)=10.0.149.3 mailQuotaSize(userdb_quota_rule=*:bytes)=2048576000 uid(user)[EMAIL PROTECTED] qmailGID(userdb_gid)=1033 qmailUID(proxy_maybe)=1033 Jan 22 14:02:59 mailserver--03 dovecot: auth(default): client out: OK 1 [EMAIL PROTECTED] Jan 22 14:02:59 mailserver--03 dovecot: auth(default): master in: REQUEST 1 30851 Jan 22 14:02:59 mailserver--03 dovecot: auth(default): prefetch([EMAIL PROTECTED],10.0.2.2): success Jan 22 14:02:59 mailserver--03 dovecot: auth(default): master out: USER 1 [EMAIL PROTECTED] home=/data/services/dominios/.com.br/t/te/teste2/ quota_rule=*:bytes=2048576000 gid=1033 Jan 22 14:02:59 mailserver--03 dovecot: pop3-login: Login: user=<[EMAIL PROTECTED]>, method=PLAIN, rip=10.0.2.2, lip=10.0.149.3 Jan 22 14:02:59 mailserver--03 dovecot: auth(default): new auth connection: pid=3085 Jan 22 14:02:59 mailserver--03 dovecot: POP3([EMAIL PROTECTED]): Loading modules from directory: /usr/local/lib/dovecot/pop3 Jan 22 14:02:59 mailserver--03 dovecot: POP3([EMAIL PROTECTED]): Module loaded: /usr/local/lib/dovecot/pop3/lib10_quota_plugin.so Jan 22 14:02:59 mailserver--03 dovecot: POP3([EMAIL PROTECTED]): Effective uid=1033, gid=1033 Jan 22 14:02:59 mailserver--03 dovecot: POP3([EMAIL PROTECTED]): Quota root: name= backend=maildir args= Jan 22 14:02:59 mailserver--03 dovecot: POP3([EMAIL PROTECTED]): Quota rule: root= mailbox= bytes=2048576000 messages=0 Jan 22 14:02:59 mailserver--03 dovecot: POP3([EMAIL PROTECTED]): Namespace: type=private, prefix=INBOX., sep=, inbox=yes, hidden=no, list=yes, subscriptions=yes Jan 22 14:02:59 mailserver--03 dovecot: POP3([EMAIL PROTECTED]): maildir: data=/data/services/dominios/.com.br/t/te/teste2//Maildir Jan 22 14:02:59 mailserver--03 dovecot: POP3([EMAIL PROTECTED]): maildir++: root=/data/services/dominios/.com.br/t/te/teste2//Maildir, index=, control=, inbox=/data/services/dominios/.com.br/t/te/teste2//Maildir Jan 22 14:03:02 mailserver--03 dovecot: POP3([EMAIL PROTECTED]): Disconnected: Logged out top=0/0, retr=0/0, del=0/3012, size=534868620 2 - POP3 session fail Jan 22 14:03:08 mailserver--03 dovecot: auth(default): client in: AUTH 1 PLAIN service=pop3lip=10.0.149.3 rip=10.0.2.2 resp= Jan 22 14:03:08 mailserver--03 dovecot: auth(default): cache([EMAIL PROTECTED],10.0.2.2): hit Jan 22 14:03:08 mailserver--03 dovecot: auth(default): client out: OK 1 [EMAIL PROTECTED] host=10.0.149.3 proxy pass= Jan 22 14:03:08 mailserver--03 dovecot: pop3-login: Login: user=<[EMAIL PROTECTED]>, method=PLAIN, rip=10.0.2.2, lip=10.0.149.3 Jan 22 14:03:08 mailserver--03 dovecot: auth(default): new auth connection: pid=3078 server01:~# telnet 10.0.145.3 110 Trying 10.0.145.3... Connected to 10.0.145.3. Escape character is '^]'. +OK Dovecot ready. user [EMAIL PROTECTED] +OK pass 123mudar +OK Logged in. Connection closed by foreign host. Is it a bug on cache? []s, Raphael Costa
Re: [Dovecot] Maildrop script to sieve
On Sat, 2008-01-19 at 13:06 +0100, mouss wrote:
> maildrop scripts are way too flexible to write a general conversion
> program. Unless your scripts have a specific structure and logic, you
> should continue delivering with maildrop. you can build maildrop
> without
> authlib (I have this running on one system).
>
> if the scripts have a common "logic", show few of them and we'll see
> if
> it is feasible to convert them.
>
The scripts are written by squirrel's plugin. See an example:
###TO_ '' [EMAIL PROTECTED] '' INBOX.Abuse '' m '' on '' off '' '' Contains
if (/^(To|Cc):[EMAIL PROTECTED]/:h)
{
to "$MAILDIR/.Abuse"
}
[]s
Raphael Costa
[Dovecot] Maildrop script to sieve
Hi, I'm working on a system that have about 350K e-mail users and 100k users that uses maildrop scripts to make filters on their delivery. So, changing scripts by hand can't be a choice. I "googled" so much and I wasn't able to find any script that converts maildrop scripts to sieve. Does anyone knows where can I find it? By the way, does anyone uses dovecot-1.1-beta on a production system with sieve+maildir+lda? Thanks, Raphael Costa
Re: [Dovecot] Quota 1.1 problem
Solved. I changed the user_attrs and could set user quota. user_attrs = mailMessageStore=home,qmailUID=uid,qmailGID=gid,mailQuotaSize=quota_rule=*:bytes On Wed, 2008-01-16 at 17:52 -0200, Raphael Bittencourt S. Costa wrote: > Helo all, > > I'm trying to use Dovecot v1.1.beta13 lda with ldap. I made a tons of > change in configurations but still can't set quota from ldap. See > below: > > Log: > Jan 16 17:37:09 mailserver-03 dovecot: auth(default): > userdb([EMAIL PROTECTED],127.0.0.1): Invalid GID value '*:bytes=1033' > > > dovecot-ldap.conf: > user_attrs = > mailMessageStore=home,qmailUID=uid,qmailGID=gid,mailQuotaSize=quota_rule=*:bytes=%$ > > ldap: > dn: cn=teste,ou=xxx.com.br,ou=accounts > mailHostAddress: 10.0.149.3 > userPassword:: e1NIQX1kNXFTUFdteTRISjBleEdYVzZocFNkNFdjRGM9 > mailQuotaSize: 10485760 > deliveryMode: nombox > objectClass: top > objectClass: person > objectClass: organizationalPerson > objectClass: inetOrgPerson > objectClass: qmailUser > accountStatus: active > cn: teste > qmailGID: 1033 > qmailUID: 1033 > mail: [EMAIL PROTECTED] > mailMessageStore: /data/services/dominios/xxx.com.br/t/te/teste/ > uid: [EMAIL PROTECTED] > sn: teste > mailHost: mailserver03.xxx.com.br > > []s, > > Raphael Costa Atenciosamente, Raphael Bittencourt S. Costa Engenharia --- ALOG Data Centers do Brasil Excelência em Projetos de Hosting R Voluntários da Pátria 360 - RJ - CEP 22270-010 Telefone: 21 3083-3364 - Fax: 21 3083-3300 http://www.alog.com.br <> signature.asc Description: This is a digitally signed message part
[Dovecot] Quota 1.1 problem
Helo all, I'm trying to use Dovecot v1.1.beta13 lda with ldap. I made a tons of change in configurations but still can't set quota from ldap. See below: Log: Jan 16 17:37:09 mailserver-03 dovecot: auth(default): userdb([EMAIL PROTECTED],127.0.0.1): Invalid GID value '*:bytes=1033' dovecot-ldap.conf: user_attrs = mailMessageStore=home,qmailUID=uid,qmailGID=gid,mailQuotaSize=quota_rule=*:bytes=%$ ldap: dn: cn=teste,ou=xxx.com.br,ou=accounts mailHostAddress: 10.0.149.3 userPassword:: e1NIQX1kNXFTUFdteTRISjBleEdYVzZocFNkNFdjRGM9 mailQuotaSize: 10485760 deliveryMode: nombox objectClass: top objectClass: person objectClass: organizationalPerson objectClass: inetOrgPerson objectClass: qmailUser accountStatus: active cn: teste qmailGID: 1033 qmailUID: 1033 mail: [EMAIL PROTECTED] mailMessageStore: /data/services/dominios/xxx.com.br/t/te/teste/ uid: [EMAIL PROTECTED] sn: teste mailHost: mailserver03.xxx.com.br []s, Raphael Costa
[Dovecot] Dovecot problem
Helo all, Yesterday dovecot began droping connections and there is nothing conclusive in the log file, just the messagens below: Sep 2 11:43:57 relay01 dovecot: pop3-login: Disconnected: Inactivity: method=PLAIN, rip=200.152.100.77, lip=10.0.3.1 Sep 2 11:44:02 relay01 dovecot: pop3-login: Disconnected: Inactivity: method=PLAIN, rip=200.204.69.20, lip=10.0.3.1 Sep 2 11:44:19 relay01 dovecot: pop3-login: Disconnected: Inactivity: method=PLAIN, rip=201.20.236.248, lip=10.0.3.1 Sep 2 11:44:21 relay01 dovecot: pop3-login: Disconnected: Inactivity: method=PLAIN, rip=201.83.2.206, lip=10.0.3.1 Sep 2 11:44:24 relay01 dovecot: pop3-login: Disconnected: Inactivity: method=PLAIN, rip=200.158.0.143, lip=10.0.3.1 Sep 2 11:44:25 relay01 dovecot: pop3-login: Disconnected: Inactivity: method=PLAIN, rip=201.52.200.131, lip=10.0.3.1 Sep 2 11:44:26 relay01 dovecot: pop3-login: Disconnected: Inactivity: method=PLAIN, rip=201.53.20.53, lip=10.0.3.1, TLS Sep 2 11:44:35 relay01 dovecot: pop3-login: Disconnected: Inactivity: method=PLAIN, rip=201.0.90.117, lip=10.0.3.1 Sep 2 11:44:41 relay01 dovecot: pop3-login: Disconnected: Inactivity: method=PLAIN, rip=189.33.173.226, lip=10.0.3.1 Sep 2 11:44:45 relay01 dovecot: pop3-login: Disconnected: Inactivity: method=PLAIN, rip=201.82.135.42, lip=10.0.3.1 Sep 2 11:45:03 relay01 dovecot: pop3-login: Disconnected: Inactivity: method=PLAIN, rip=201.19.218.250, lip=10.0.3.1 Sep 2 11:45:04 relay01 dovecot: pop3-login: Disconnected: Inactivity: method=PLAIN, rip=201.83.2.206, lip=10.0.3.1 Sep 2 11:45:05 relay01 dovecot: pop3-login: Disconnected: Inactivity: method=PLAIN, rip=201.81.250.119, lip=10.0.3.1 Sep 2 11:45:21 relay01 dovecot: pop3-login: Disconnected: Inactivity: method=PLAIN, rip=200.171.100.233, lip=10.0.3.1 Sep 2 11:45:23 relay01 dovecot: pop3-login: Disconnected: Inactivity: method=PLAIN, rip=64.233.182.131, lip=10.0.3.1 Sep 2 11:45:27 relay01 dovecot: pop3-login: Disconnected: Inactivity: method=PLAIN, rip=201.43.185.179, lip=10.0.3.1 Sep 2 11:45:40 relay01 dovecot: pop3-login: Disconnected: Inactivity: method=PLAIN, rip=200.161.155.35, lip=10.0.3.1 Sep 2 11:45:41 relay01 dovecot: pop3-login: Disconnected: Inactivity: method=PLAIN, rip=201.62.149.20, lip=10.0.3.1 Sep 2 11:45:43 relay01 dovecot: pop3-login: Disconnected: Inactivity: method=PLAIN, rip=201.83.43.154, lip=10.0.3.1 Sep 2 11:45:47 relay01 dovecot: pop3-login: Disconnected: Inactivity: method=PLAIN, rip=134.171.76.5, lip=10.0.3.1 Sep 2 11:45:49 relay01 dovecot: pop3-login: Disconnected: Inactivity: method=PLAIN, rip=201.92.248.84, lip=10.0.3.1 Sep 2 11:45:55 relay01 dovecot: pop3-login: Disconnected: Inactivity: method=PLAIN, rip=201.21.114.120, lip=10.0.3.1 Sep 2 11:45:57 relay01 dovecot: pop3-login: Disconnected: Inactivity: method=PLAIN, rip=200.229.107.85, lip=10.0.3.1 Sep 2 11:46:04 relay01 dovecot: pop3-login: Disconnected: Inactivity: method=PLAIN, rip=200.204.69.20, lip=10.0.3.1 Sep 2 11:46:04 relay01 dovecot: pop3-login: Disconnected: Inactivity: method=PLAIN, rip=201.53.83.146, lip=10.0.3.1 Sep 2 11:46:05 relay01 dovecot: pop3-login: Disconnected: Inactivity: method=PLAIN, rip=200.152.100.77, lip=10.0.3.1 Sep 2 11:46:35 relay01 dovecot: pop3-login: Disconnected: Inactivity: method=PLAIN, rip=201.95.95.108, lip=10.0.3.1 Sep 2 11:46:35 relay01 dovecot: pop3-login: Disconnected: Inactivity: method=PLAIN, rip=201.0.90.117, lip=10.0.3.1 Sep 2 11:46:35 relay01 dovecot: pop3-login: Disconnected: Inactivity: method=PLAIN, rip=200.159.87.122, lip=10.0.3.1 Sep 2 11:46:40 relay01 dovecot: pop3-login: Disconnected: Inactivity: method=PLAIN, rip=83.131.211.245, lip=10.0.3.1 Sep 2 11:46:41 relay01 dovecot: pop3-login: Disconnected: Inactivity: method=PLAIN, rip=201.6.61.147, lip=10.0.3.1 Sep 2 11:47:13 relay01 dovecot: pop3-login: Disconnected: Inactivity: method=PLAIN, rip=201.1.153.202, lip=10.0.3.1 Sep 2 11:47:38 relay01 dovecot: pop3-login: Disconnected: Inactivity: method=PLAIN, rip=189.0.252.144, lip=10.0.3.1 Sep 2 11:47:39 relay01 dovecot: pop3-login: Disconnected: Inactivity: method=PLAIN, rip=201.20.236.248, lip=10.0.3.1 Sep 2 11:47:47 relay01 dovecot: pop3-login: Disconnected: Inactivity: method=PLAIN, rip=134.171.76.5, lip=10.0.3.1 Sep 2 11:47:51 relay01 dovecot: pop3-login: Disconnected: Inactivity: method=PLAIN, rip=201.12.103.67, lip=10.0.3.1 After restart, everything just back working. Any ideia? Raphael Costa
Re: [Dovecot] Dovecot IMAP/POP3 Proxy with LDAP
I made some progress, but it still don't connect to the server. See below: Aug 17 09:22:29 bastion01 dovecot: auth(default): client in: AUTH 1 PLAIN service=POP3lip=10.0.2.1rip=10.0.1.1 resp=AHJhcGhhZWwuY29zdGFAYmlnaG9zdxsdC5jb20uYnIAMTIzcXdl Aug 17 09:22:29 bastion01 dovecot: auth(default): ldap([EMAIL PROTECTED],10.0.1.1): bind search: base=ou=.com.br,ou=accounts,o=comMail filter=(&(objectClass=qmailUser)([EMAIL PROTECTED])(accountStatus=active)) Aug 17 09:22:29 bastion01 dovecot: auth(default): ldap([EMAIL PROTECTED],10.0.1.1): result: qmailUID(proxy)=1033 mailHost(host)=mailserver-01..com.br uid(user)[EMAIL PROTECTED] Aug 17 09:22:29 bastion01 dovecot: auth(default): ldap([EMAIL PROTECTED],10.0.1.1): bind: dn=cn=raphael.costa,ou=.com.br,ou=accounts,o=comMail Aug 17 09:22:29 bastion01 dovecot: auth(default): client out: OK 1 [EMAIL PROTECTED] proxy host=mailserver-01..com.br pass= Aug 17 09:22:29 bastion01 dovecot: auth(default): master in: REQUEST 1 18709 1 Aug 17 09:22:29 bastion01 dovecot: auth(default): Master request 18709.1 not found Aug 17 09:22:29 bastion01 dovecot: auth(default): master out: NOTFOUND 1 Aug 17 09:22:29 bastion01 dovecot: pop3-login: Internal login failure: user=<[EMAIL PROTECTED]>, method=PLAIN, rip=10.0.1.1, lip=10.0.2.1 any idea? On Thu, 2007-08-16 at 18:58 -0300, Raphael Bittencourt S. Costa wrote: > Hello all, > > I'm having problems to make Dovecot proxy work, I configured it > following dovecot's site. See my test below: > > It accepts login and password and then closes the connection. > > bastion01:~/build# telnet localhost 110 > Trying 127.0.0.1... > Connected to localhost. > Escape character is '^]'. > +OK Dovecot ready. > user [EMAIL PROTECTED] > +OK > pass xx > +OK Logged in. > Connection closed by foreign host. > > > See that it get the host information but still try to access the mbox > locally. > > Aug 16 16:22:36 bastion01 dovecot: auth(default): > ldap([EMAIL PROTECTED],127.0.0.1): bind: > dn=cn=raphael.costa,ou=.com.br,ou=accounts,o=comMail > Aug 16 16:22:36 bastion01 dovecot: auth(default): client out: OK > 2 [EMAIL PROTECTED] > host=mailserver-01..com.br > Aug 16 16:22:36 bastion01 dovecot: auth(default): master in: REQUEST > 1 38942 > > Aug 16 16:22:36 bastion01 dovecot: POP3([EMAIL PROTECTED]): > maildir: access(/dev/null/Maildir, rwx): failed: Not a directory > Aug 16 16:22:36 bastion01 dovecot: POP3([EMAIL PROTECTED]): > maildir: couldn't find root dir > Aug 16 16:22:36 bastion01 dovecot: POP3([EMAIL PROTECTED]): > mbox: root: access(/dev/null/mail, rwx) failed: Not a directory > Aug 16 16:22:36 bastion01 dovecot: POP3([EMAIL PROTECTED]): > mbox: root: access(/dev/null/Mail, rwx) failed: Not a directory > Aug 16 16:22:36 bastion01 dovecot: POP3([EMAIL PROTECTED]): > mbox: checking if we are chrooted: > Aug 16 16:22:36 bastion01 dovecot: POP3([EMAIL PROTECTED]): > mbox autodetect: data= > Aug 16 16:22:36 bastion01 dovecot: POP3([EMAIL PROTECTED]): > mbox autodetect: has .imap/: stat(/.imap) failed: No such file or > directory > Aug 16 16:22:36 bastion01 dovecot: POP3([EMAIL PROTECTED]): > mbox autodetect: has inbox: stat(/inbox) failed: No such file or > directory > Aug 16 16:22:36 bastion01 dovecot: POP3([EMAIL PROTECTED]): > mbox autodetect: has mbox: stat(/mbox) failed: No such file or > directory > Aug 16 16:22:36 bastion01 dovecot: POP3([EMAIL PROTECTED]): > mbox: root mail directory not found > > > > My dovecot-ldap.conf: > pass_attrs = > uid=user,userPassword=password,mailMessageStore=userdb_home,qmailUID=userdb_uid,qmailGID=userdb_gid,proxy,mailHost=host > > > What am I doing wrong? > > > Raphael Costa
[Dovecot] Dovecot IMAP/POP3 Proxy with LDAP
Hello all, I'm having problems to make Dovecot proxy work, I configured it following dovecot's site. See my test below: It accepts login and password and then closes the connection. bastion01:~/build# telnet localhost 110 Trying 127.0.0.1... Connected to localhost. Escape character is '^]'. +OK Dovecot ready. user [EMAIL PROTECTED] +OK pass xx +OK Logged in. Connection closed by foreign host. See that it get the host information but still try to access the mbox locally. Aug 16 16:22:36 bastion01 dovecot: auth(default): ldap([EMAIL PROTECTED],127.0.0.1): bind: dn=cn=raphael.costa,ou=.com.br,ou=accounts,o=comMail Aug 16 16:22:36 bastion01 dovecot: auth(default): client out: OK 2 [EMAIL PROTECTED] host=mailserver-01..com.br Aug 16 16:22:36 bastion01 dovecot: auth(default): master in: REQUEST 1 38942 Aug 16 16:22:36 bastion01 dovecot: POP3([EMAIL PROTECTED]): maildir: access(/dev/null/Maildir, rwx): failed: Not a directory Aug 16 16:22:36 bastion01 dovecot: POP3([EMAIL PROTECTED]): maildir: couldn't find root dir Aug 16 16:22:36 bastion01 dovecot: POP3([EMAIL PROTECTED]): mbox: root: access(/dev/null/mail, rwx) failed: Not a directory Aug 16 16:22:36 bastion01 dovecot: POP3([EMAIL PROTECTED]): mbox: root: access(/dev/null/Mail, rwx) failed: Not a directory Aug 16 16:22:36 bastion01 dovecot: POP3([EMAIL PROTECTED]): mbox: checking if we are chrooted: Aug 16 16:22:36 bastion01 dovecot: POP3([EMAIL PROTECTED]): mbox autodetect: data= Aug 16 16:22:36 bastion01 dovecot: POP3([EMAIL PROTECTED]): mbox autodetect: has .imap/: stat(/.imap) failed: No such file or directory Aug 16 16:22:36 bastion01 dovecot: POP3([EMAIL PROTECTED]): mbox autodetect: has inbox: stat(/inbox) failed: No such file or directory Aug 16 16:22:36 bastion01 dovecot: POP3([EMAIL PROTECTED]): mbox autodetect: has mbox: stat(/mbox) failed: No such file or directory Aug 16 16:22:36 bastion01 dovecot: POP3([EMAIL PROTECTED]): mbox: root mail directory not found My dovecot-ldap.conf: pass_attrs = uid=user,userPassword=password,mailMessageStore=userdb_home,qmailUID=userdb_uid,qmailGID=userdb_gid,proxy,mailHost=host What am I doing wrong? Raphael Costa
