Re: [Dovecot] v2.0.rc3 released
On Tue, Jul 20, 2010 at 11:57 PM, Timo Sirainen wrote: > http://dovecot.org/releases/2.0/rc/dovecot-2.0.rc3.tar.gz > http://dovecot.org/releases/2.0/rc/dovecot-2.0.rc3.tar.gz.sig > > A lot of dsync fixes. I think I've fixed now all of the bugs ever > reported about dsync and I'm hopeful that it's now stable. All the rest > of Dovecot looks pretty good too. Maybe v2.0.0 will be out next week. > > I've tried compiling this one on FreeBSD-8. I was running RC2 which had compiled successfully. mail# gcc -v Using built-in specs. Target: i386-undermydesk-freebsd Configured with: FreeBSD/i386 system compiler Thread model: posix gcc version 4.2.1 20070719 [FreeBSD] mv -f .deps/mountpoint.Tpo .deps/mountpoint.Plo /bin/sh ../../libtool --tag=CC--mode=compile gcc -DHAVE_CONFIG_H -I. -I../.. -std=gnu99 -g -O2 -Wall -W -Wmissing-prototypes -Wmissing-d eclarations -Wpointer-arith -Wchar-subscripts -Wformat=2 -Wbad-function-cast -Wstrict-aliasing=2 -MT network.lo -MD -MP -MF .deps/network.Tpo -c -o network.lo network.c libtool: compile: gcc -DHAVE_CONFIG_H -I. -I../.. -std=gnu99 -g -O2 -Wall -W -Wmissing-prototypes -Wmissing-declarations -Wpointer-arith -Wchar- subscripts -Wformat=2 -Wbad-function-cast -Wstrict-aliasing=2 -MT network.lo -MD -MP -MF .deps/network.Tpo -c network.c -fPIC -DPIC -o .libs/net work.o network.c:166: error: duplicate 'static' *** Error code 1 Stop in /usr/home/wash/Tools/Dovecot/dovecot-2.0/dovecot-2.0.rc3/src/lib. *** Error code 1 Stop in /usr/home/wash/Tools/Dovecot/dovecot-2.0/dovecot-2.0.rc3/src/lib. *** Error code 1 Stop in /usr/home/wash/Tools/Dovecot/dovecot-2.0/dovecot-2.0.rc3/src. *** Error code 1 Stop in /usr/home/wash/Tools/Dovecot/dovecot-2.0/dovecot-2.0.rc3. *** Error code 1 Stop in /usr/home/wash/Tools/Dovecot/dovecot-2.0/dovecot-2.0.rc3. -- Best regards, Odhiambo WASHINGTON, Nairobi,KE +254733744121/+254722743223 _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ _ "If you have nothing good to say about someone, just shut up!." -- Lucky Dube
Re: [Dovecot] namespaces
On 07/19/2010 07:09 PM jorge martinez wrote: > Hello, i have an issue with vpopmail, this created a sub folder named "0" > and all the new users created inside this folder into the domain folder. > > Weel i don understand why vpopmail do that, but i want to know if the option > in dovecot.conf namespaces i can make it to search the Maildir in both > directories. name domain/user & name domain/0/name user. Why? Directory hashing? Or a programing error in the vpopmail code‽ Why do you want to complicate simple things with namespaces? Somewhere in your mysql database is the value …domain/0/name stored. Use that value as user's home. Then set your mail_location to maildir:~/Maildir You may also have a look at: * http://wiki.dovecot.org/UserDatabase * http://wiki.dovecot.org/VirtualUsers/Home * http://wiki.dovecot.org/AuthDatabase/VPopMail#VPopMail_.2B-_MySQL Regards, Pascal -- The trapper recommends today: decade.1020...@localdomain.org
Re: [Dovecot] v2.0.rc3 released
On Tue, Jul 20, 2010 at 4:10 PM, Timo Sirainen wrote: > On 21.7.2010, at 0.07, Brandon Lamb wrote: > >> Hey do you also want reports on ANY errors/output from dsync? > > I was hoping they'd all be gone in rc3. > >> I have a >> couple mailboxes that I kept getting errors about virtual and/or >> physical sizes and indexes being corrupt but I just assumed it was a >> warning or ignorable? If you consider that a bug let me know > > Were you using NFS? I doubt those are dsync bugs but rather generic index > corruption problems and such that dsync just brings to surface because it > goes through all mails. At one point I was using nfs yes, and also have only been using dovecot lda for 1-2 years so probably lots of old mail with missing/wrong sizes (maildir)
Re: [Dovecot] v2.0.rc3 released
On 21.7.2010, at 0.07, Brandon Lamb wrote: > Hey do you also want reports on ANY errors/output from dsync? I was hoping they'd all be gone in rc3. > I have a > couple mailboxes that I kept getting errors about virtual and/or > physical sizes and indexes being corrupt but I just assumed it was a > warning or ignorable? If you consider that a bug let me know Were you using NFS? I doubt those are dsync bugs but rather generic index corruption problems and such that dsync just brings to surface because it goes through all mails.
Re: [Dovecot] v2.0.rc3 released
On Tue, Jul 20, 2010 at 1:57 PM, Timo Sirainen wrote: > http://dovecot.org/releases/2.0/rc/dovecot-2.0.rc3.tar.gz > http://dovecot.org/releases/2.0/rc/dovecot-2.0.rc3.tar.gz.sig > > A lot of dsync fixes. I think I've fixed now all of the bugs ever > reported about dsync and I'm hopeful that it's now stable. All the rest > of Dovecot looks pretty good too. Maybe v2.0.0 will be out next week. > > Changes since rc2: > > * Single-dbox is now called "sdbox" instead of "dbox". > "dbox" will stay as an alias for it for now. > > + Added mail_temp_dir setting, used by deliver and lmtp for creating > temporary mail files. Default is /tmp. > + doveadm: Added "director map" command to list user -> host mappings. > - imap: Fixed checking if list=children namespace has children. > - director: If all login processes died, director stopped reading > proxy-notify input and caused future login processes to hang > - mail_log plugin configuration was broken > - Using more than 2 plugins could have caused broken behavior > - mdbox: Race condition fixes related to copying and purging > - dsync: Lots of fixes Hey do you also want reports on ANY errors/output from dsync? I have a couple mailboxes that I kept getting errors about virtual and/or physical sizes and indexes being corrupt but I just assumed it was a warning or ignorable? If you consider that a bug let me know
[Dovecot] imap core dumping on signal 10
We are just trying to bring up a new server and chose to use Dovecot rather than the uw-imap from our previous servers. At this point I am just testing with some throw away accounts using squirrelmail. I can load my inbox, but then the imap connection is lost. I presume you need some real information to get your teeth into, so this is going to get a little long. I'll give you three things below: 1. a piece of /var/adm/dovecot.log, 2. the output of `dovecot -n`, and then 3. the full gdb trace back on the core file. I'm hoping that, aside from there being a bug that causes core dumps, we might have a straightforward misconfiguration that we could fix and have a working installation. All info at end. -- --- Chris Hoogendyk - O__ Systems Administrator c/ /'_ --- Biology & Geology Departments (*) \(*) -- 140 Morrill Science Center ~~ - University of Massachusetts, Amherst --- Erdös 4 --- following is the complete log of the connection --- Jul 20 17:34:05 imladris dovecot: [ID 583609 local2.info] auth(default): client in: AUTH1PLAIN service=imapsecured lip=127.0.0.1 rip=127.0.0.1 lport=993 rport=65462 resp=AGNocmlzaG8AMG5XMHJEPyE= Jul 20 17:34:05 imladris dovecot: [ID 583609 local2.info] auth(default): shadow(chrisho,127.0.0.1): lookup Jul 20 17:34:05 imladris dovecot: [ID 583609 local2.info] auth(default): client out: OK 1 user=chrisho Jul 20 17:34:05 imladris dovecot: [ID 583609 local2.info] auth(default): master in: REQUEST 1 22961 1 Jul 20 17:34:05 imladris dovecot: [ID 583609 local2.info] auth(default): passwd(chrisho,127.0.0.1): lookup Jul 20 17:34:05 imladris dovecot: [ID 583609 local2.info] auth(default): master out: USER 1 chrisho system_groups_user=chrisho uid=2295 gid=102 home=/u1/home/bio/hoogendyk Jul 20 17:34:05 imladris dovecot: [ID 583609 local2.info] imap-login: Login: user=, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, TLS Jul 20 17:34:05 imladris dovecot: [ID 583609 local2.info] IMAP(chrisho): Effective uid=2295, gid=102, home=/u1/home/bio/hoogendyk Jul 20 17:34:05 imladris dovecot: [ID 583609 local2.info] IMAP(chrisho): mbox: data=~/mail:INBOX=/var/mail/chrisho Jul 20 17:34:05 imladris dovecot: [ID 583609 local2.info] IMAP(chrisho): fs: root=/u1/home/bio/hoogendyk/mail, index=, control=, inbox=/var/mail/chrisho Jul 20 17:34:05 imladris dovecot: [ID 583609 local2.info] IMAP(chrisho): Disconnected: Logged out bytes=44/697 Jul 20 17:34:05 imladris dovecot: [ID 583609 local2.info] auth(default): new auth connection: pid=22968 Jul 20 17:34:06 imladris dovecot: [ID 583609 local2.info] auth(default): client in: AUTH1 PLAIN service=imapsecured lip=127.0.0.1 rip=127.0.0.1 lport=993 rport=65465 resp=AGNocmlzaG8AMG5XMHJEPyE= Jul 20 17:34:06 imladris dovecot: [ID 583609 local2.info] auth(default): shadow(chrisho,127.0.0.1): lookup Jul 20 17:34:06 imladris dovecot: [ID 583609 local2.info] auth(default): client out: OK 1 user=chrisho Jul 20 17:34:06 imladris dovecot: [ID 583609 local2.info] auth(default): master in: REQUEST 2 22959 1 Jul 20 17:34:06 imladris dovecot: [ID 583609 local2.info] auth(default): passwd(chrisho,127.0.0.1): lookup Jul 20 17:34:06 imladris dovecot: [ID 583609 local2.info] auth(default): master out: USER 2 chrisho system_groups_user=chrisho uid=2295 gid=102 home=/u1/home/bio/hoogendyk Jul 20 17:34:06 imladris dovecot: [ID 583609 local2.info] imap-login: Login: user=, method=PLAIN, rip=127.0.0.1, lip=127.0.0.1, TLS Jul 20 17:34:06 imladris dovecot: [ID 583609 local2.info] IMAP(chrisho): Effective uid=2295, gid=102, home=/u1/home/bio/hoogendyk Jul 20 17:34:06 imladris dovecot: [ID 583609 local2.info] IMAP(chrisho): mbox: data=~/mail:INBOX=/var/mail/chrisho Jul 20 17:34:06 imladris dovecot: [ID 583609 local2.info] IMAP(chrisho): fs: root=/u1/home/bio/hoogendyk/mail, index=, control=, inbox=/var/mail/chrisho Jul 20 17:34:06 imladris dovecot: [ID 583609 local2.info] IMAP(chrisho): Namespace : Using permissions from /u1/home/bio/hoogendyk/mail: mode=0700 gid=-1 Jul 20 17:34:06 imladris dovecot: [ID 583609 local2.info] auth(default): new auth connection: pid=22970 Jul 20 17:34:06 imladris dovecot: [ID 583609 local2.info] IMAP(chrisho): Disconnected: Logged out bytes=386/1304 Jul 20 17:34:07 imladris dovecot: [ID 583609 local2.info] auth(default): client in: AUTH1 PLAIN service=imapsecured lip=127.0.0.1 rip=127.0.0.1 lport=993 rport=65467 resp=AGNocmlzaG8AMG5XMHJEPyE= Jul 20 17:34:07 imladris dovecot: [ID 583609 local2.info] auth(default): shadow(chrisho,127.0.0.1): lookup Jul 20 17:34:07 imladris dovecot: [ID 583609 local2.info] auth(default): client out: OK 1 user=chrisho Jul 20 17:34:07 imladris dovecot: [ID 583609 l
Re: [Dovecot] Sieve Installation
On 07/20/2010 10:43 PM Carsten Laun-De Lellis wrote: > Hallo > > Ich habe ein Problem bei der Installation von Sieve: > > Konfiguration: Opensuse 11.2 64bit, dovecot 1.2.9, postfix, amavis, > spamassassin. > > Wenn ich versucht dovecot sieve zu übersetzen bekomme ich immer folgende > Fehlermeldung. > > Making all in libsieve > make[1]: Entering directory `/download/dovecot-sieve-1.1.8/src/libsieve' > /bin/sh ../../libtool --tag=CC --mode=compile gcc -DHAVE_CONFIG_H -I. > -I../.. -I -I/src/lib -I../../src -g -O2 -DENABLE_REGEX -MT addr.lo -MD > -MP -MF .deps/addr.Tpo -c -o addr.lo addr.c > libtool: compile: gcc -DHAVE_CONFIG_H -I. -I../.. -I -I/src/lib > -I../../src -g -O2 -DENABLE_REGEX -MT addr.lo -MD -MP -MF .deps/addr.Tpo > -c addr.c -fPIC -DPIC -o .libs/addr.o > In file included from addr.y:35: > ../../src/xmalloc.h:19:17: error: lib.h: No such file or directory > make[1]: *** [addr.lo] Error 1 > make[1]: Leaving directory `/download/dovecot-sieve-1.1.8/src/libsieve' > make: *** [all-recursive] Error 1 > > > Wäre echt toll, wenn mir jemand einen Tipp geben könnte. Write in English language please. Seven months ago Sieve 0.1.14 was released for Dovecot 1.2.9. Is the package dovecot12-devel installed on your System? That package contains also /usr/include/dovecot/src/lib/lib.h Then cd into the sieve source dir and run ./configure --with-dovecot=/usr/include/dovecot … Regards, Pascal -- The trapper recommends today: http://kopfkrebs.de/mitarbeiter/mitarbeiter_der_woche.html
[Dovecot] v2.0.rc3 released
http://dovecot.org/releases/2.0/rc/dovecot-2.0.rc3.tar.gz http://dovecot.org/releases/2.0/rc/dovecot-2.0.rc3.tar.gz.sig A lot of dsync fixes. I think I've fixed now all of the bugs ever reported about dsync and I'm hopeful that it's now stable. All the rest of Dovecot looks pretty good too. Maybe v2.0.0 will be out next week. Changes since rc2: * Single-dbox is now called "sdbox" instead of "dbox". "dbox" will stay as an alias for it for now. + Added mail_temp_dir setting, used by deliver and lmtp for creating temporary mail files. Default is /tmp. + doveadm: Added "director map" command to list user -> host mappings. - imap: Fixed checking if list=children namespace has children. - director: If all login processes died, director stopped reading proxy-notify input and caused future login processes to hang - mail_log plugin configuration was broken - Using more than 2 plugins could have caused broken behavior - mdbox: Race condition fixes related to copying and purging - dsync: Lots of fixes
[Dovecot] Sieve Installation
Hallo Ich habe ein Problem bei der Installation von Sieve: Konfiguration: Opensuse 11.2 64bit, dovecot 1.2.9, postfix, amavis, spamassassin. Wenn ich versucht dovecot sieve zu übersetzen bekomme ich immer folgende Fehlermeldung. Making all in libsieve make[1]: Entering directory `/download/dovecot-sieve-1.1.8/src/libsieve' /bin/sh ../../libtool --tag=CC --mode=compile gcc -DHAVE_CONFIG_H -I. -I../.. -I -I/src/lib -I../../src -g -O2 -DENABLE_REGEX -MT addr.lo -MD -MP -MF .deps/addr.Tpo -c -o addr.lo addr.c libtool: compile: gcc -DHAVE_CONFIG_H -I. -I../.. -I -I/src/lib -I../../src -g -O2 -DENABLE_REGEX -MT addr.lo -MD -MP -MF .deps/addr.Tpo -c addr.c -fPIC -DPIC -o .libs/addr.o In file included from addr.y:35: ../../src/xmalloc.h:19:17: error: lib.h: No such file or directory make[1]: *** [addr.lo] Error 1 make[1]: Leaving directory `/download/dovecot-sieve-1.1.8/src/libsieve' make: *** [all-recursive] Error 1 Wäre echt toll, wenn mir jemand einen Tipp geben könnte. Mit freundlichem Gruß Carsten Laun-De Lellis Dipl.-Ing. Elektrotechnik Certified Information Systems Auditor (CISA) Hauptstrasse 13 D-67705 Trippstadt Phone: +49 (6306) 992140 Mobile: +49 (151) 27530865 email: carsten.laun-delel...@delellis.net
[Dovecot] Sieve Installation
Hallo Versuche unter OpenSuse11.2, 64bit sieve zu installieren. Konfig: OpensSuse 11.2, dovecot 1.2.9, postfix , spamassassin, amavis, mysql Wenn ich versucht dovecot sieve zu übersetzen bekomme ich immer folgende Fehlermeldung: Mit freundlichem Gruß Carsten Laun-De Lellis Dipl.-Ing. Elektrotechnik Certified Information Systems Auditor (CISA) Hauptstrasse 13 D-67705 Trippstadt Phone: +49 (6306) 992140 Mobile: +49 (151) 27530865 email: carsten.laun-delel...@delellis.net
Re: [Dovecot] Login process connection routing
Timo, > -Original Message- > From: Timo Sirainen [mailto:t...@iki.fi] > > Dovecot lets kernel assign it. Whichever process grabs it first, handles > it. Makes sense. > You probably have too many login processes. process_min_avail should be > set to about the same as the number of CPU cores. Ahh, OK - that's good guidance, I didn't remember hearing that. I had just left the old setting in place from when we were forking off a process per session, where it made sense as more of a prefork. > Since there are two > processes handling most of the connections, do you also happen to have 2 > cores? :) Two cores with HT (looks like four), but yes ;) Thanks! -Brad
Re: [Dovecot] Doveadm director flush/remove
Timo, > -Original Message- > From: Timo Sirainen [mailto:t...@iki.fi] > > Did several fixes related to this in different parts of code. Now it > should work? :) No more crashes! But it still does fail eventually: [r...@cc-popmap7 ~]# doveadm director map doveadm(root): Error: User listing returned failure doveadm(root): Error: user listing failed Jul 20 11:15:04 cc-popmap7 dovecot: auth: Error: getpwent() failed: No such file or directory This might just be an artifact of our environment, I'm not sure. Dumping users to a file and then feeding that back in works great. -Brad
Re: [Dovecot] [dovecot] Dovecot Migration so far
On Tue, 2010-07-20 at 10:55 -0700, Mark Moseley wrote: > 1. Jul 20 12:17:30 imap-login: Info: Internal login failure (auth > failed, 1 attempts): user=, method=PLAIN, > rip=x.x.x.x, lip=192.168.152.37, mpid=0, TLS This is Info message, so it should be accompanied with Error/Fatal/Panic. Most likely this one: > 2. Jul 20 12:17:41 auth: Error: Master requested auth for nonexisting > client 16380 What happens is: 1. imap/pop3-login process authenticates user via auth process successfully and forwards the connection to imap/pop3 process. 2. imap/pop3 process asks auth process to verify that the user is authenticated and asks for userdb info. [Somewhere before this imap/pop3-login either died or for some reason disconnected from auth process.] 3. Auth process notices that the login process is gone and fails with this error. It shouldn't be happening, so it's a bug. What kind of service settings do you have? Could you post "doveconf -n service" output? > 3. Just a single instance of: Jul 20 09:40:38 > imap(usern...@mailbox.com): Warning: /path/to/Maildir/dovecot-uidlist: > Duplicate file entry at line 23: > 1279633198.H285683P32723.servername,S=13870:2,ad (uid 669 -> 670) Probably because of NFS caching.
Re: [Dovecot] [dovecot] Dovecot Migration so far
On Wed, Jul 7, 2010 at 12:22 PM, Timo Sirainen wrote: > On Wed, 2010-07-07 at 10:19 -0700, Mark Moseley wrote: >> On Wed, Jul 7, 2010 at 8:08 AM, Timo Sirainen wrote: >> > On Fri, 2010-04-02 at 11:35 -0700, Mark Moseley wrote: >> >> Apr 02 13:25:24 imap(m...@box): Error: >> >> creat(/var/tmp/Indexes/14/75/m...@box/dovecot.mailbox.log) failed: No >> >> such file or directory >> > >> > Finally fixed: http://hg.dovecot.org/dovecot-2.0/rev/6571b3a9c44f >> >> Is that revision pre-rc1 or contained in it? > > It's post-rc1. I fixed it a few minutes before sending the mail. Looks good. I haven't seen any yet. >> I've been running beta5 for a while and not been seeing those. The >> closest thing I get now is "Error: FETCH for mailbox INBOX UID 4322 >> failed to read message input: Stale NFS file handle", but that's >> obviously not Dovecot's fault. > > You should be running the new director I think. :) I've only got one instance of this error so far and none of the 'got too little data' errors. I've been overwhelmingly happy with just running things on NFS so far. Usually my mail users (and there's millions of them) go berserk over mail issues but there's been an almost disconcerting quiet regarding IMAP ever since we moved to Dovecot. The only oddities I've found in my logs so far since upgrading to rc2 (or at least I didn't notice before rc2) are these. These are all just very minor (between them, maybe 10-15 mentions in 250k lines of logs). 1. Jul 20 12:17:30 imap-login: Info: Internal login failure (auth failed, 1 attempts): user=, method=PLAIN, rip=x.x.x.x, lip=192.168.152.37, mpid=0, TLS 2. Jul 20 12:17:41 auth: Error: Master requested auth for nonexisting client 16380 3. Just a single instance of: Jul 20 09:40:38 imap(usern...@mailbox.com): Warning: /path/to/Maildir/dovecot-uidlist: Duplicate file entry at line 23: 1279633198.H285683P32723.servername,S=13870:2,ad (uid 669 -> 670) In both cases, there's only a few of each, in the space of 250k lines of logs, so very rare, but slightly puzzling. I'm guessing in #2, the process must've died/gotten killed. Looking at the source for #1, I have no clue (nor do we use SASL -- everything is using mysql for auth). #3 might be chalked up to just using NFS?
Re: [Dovecot] Dovecot v2.0.rc2 (875598cd7e26): Core dump upon client login
Am 20.07.2010 um 18:22 schrieb Timo Sirainen: > http://hg.dovecot.org/dovecot-2.0/rev/5b3202a069fa fixes everything? Looks good so far, no crashes, flags working again. Thanks for tracking this down Timo.
Re: [Dovecot] Login process connection routing
On Tue, 2010-07-20 at 09:57 -0700, Brandon Davidson wrote:
> Timo,
>
> Just out of curiosity, how are incoming connections routed to login
> processes when run with:
> service imap-login { service_count = 0 }
>
> I've been playing with this on our test director, and the process connection
> counts look somewhat unbalanced. I'm wondering if there are any performance
> issues with having a single process handle so many connections. It seems
> fine (system load is actually lower than with service_count = 1), but I
> thought I'd ask.
Dovecot lets kernel assign it. Whichever process grabs it first, handles
it.
> /usr/sbin/dovecot
> \_ dovecot/imap-login
> \_ dovecot/imap-login [1 connections (1 TLS)]
> \_ dovecot/imap-login
> \_ dovecot/imap-login [5 connections (5 TLS)]
> \_ dovecot/imap-login [1 connections (1 TLS)]
> \_ dovecot/imap-login [4 connections (4 TLS)]
> \_ dovecot/imap-login [1 connections (1 TLS)]
> \_ dovecot/imap-login [1 connections (1 TLS)]
> \_ dovecot/imap-login [315 connections (315 TLS)]
> \_ dovecot/imap-login [63 connections (63 TLS)]
> \_ dovecot/imap-login [12 connections (12 TLS)]
> \_ dovecot/imap-login
> \_ dovecot/imap-login [10 connections (10 TLS)]
> \_ dovecot/imap-login [2 connections (2 TLS)]
> \_ dovecot/imap-login [370 connections (370 TLS)]
> \_ dovecot/imap-login [24 connections (24 TLS)]
You probably have too many login processes. process_min_avail should be
set to about the same as the number of CPU cores. Since there are two
processes handling most of the connections, do you also happen to have 2
cores? :)
[Dovecot] Login process connection routing
Timo,
Just out of curiosity, how are incoming connections routed to login
processes when run with:
service imap-login { service_count = 0 }
I've been playing with this on our test director, and the process connection
counts look somewhat unbalanced. I'm wondering if there are any performance
issues with having a single process handle so many connections. It seems
fine (system load is actually lower than with service_count = 1), but I
thought I'd ask.
/usr/sbin/dovecot
\_ dovecot/imap-login
\_ dovecot/imap-login [1 connections (1 TLS)]
\_ dovecot/imap-login
\_ dovecot/imap-login [5 connections (5 TLS)]
\_ dovecot/imap-login [1 connections (1 TLS)]
\_ dovecot/imap-login [4 connections (4 TLS)]
\_ dovecot/imap-login [1 connections (1 TLS)]
\_ dovecot/imap-login [1 connections (1 TLS)]
\_ dovecot/imap-login [315 connections (315 TLS)]
\_ dovecot/imap-login [63 connections (63 TLS)]
\_ dovecot/imap-login [12 connections (12 TLS)]
\_ dovecot/imap-login
\_ dovecot/imap-login [10 connections (10 TLS)]
\_ dovecot/imap-login [2 connections (2 TLS)]
\_ dovecot/imap-login [370 connections (370 TLS)]
\_ dovecot/imap-login [24 connections (24 TLS)]
-Brad
Re: [Dovecot] Mbox corruption - Inbox beginning with 'FFrom' or 'FrFrom'
On Tue, 2010-07-20 at 08:42 -0400, Erik Kratzenberg wrote:
> I experienced this today with my own IMAP folder, so maybe being able to
> offer a more specific order of events will help. Also not sure if I
> previously mentioned that this is occasionally happening with IMAP
> folders even though it's much more common under POP3.
>
> 1) I had just cleaned out my Junk folder.
> 2) Two messages were received without error.
So basically what POP3 clients usually do, delete everything. Does the
mailbox have the "FOLDER INTERNAL DATA" message at the beginning?
> 3) I marked the folder as read in Thunderbird.
> 4) I restarted Thunderbird
> 5) The next delivery attempt to that mailbox (using dovecot deliver)
> failed:
>
> save failed to Junk: Mailbox isn't a valid mbox file
>
> The odd thing is that the delivery *did* succeed because that message is
> in there.
Or maybe you just got two of those same messages? :) I don't think it
could have written it after giving this error.
> The very first message header is the one that was corrupted
> which always seems to be the case. Does "deliver" read/write the entire
> mbox file or just append the new message to the end?
deliver first checks that the mbox file is valid by reading and
verifying the From_-line at the beginning of the file. If it's ok, then
it appends to end of file. The corruption most likely happened during
the expunge, not in deliver.
Hmm. See what it logs with attached patch?
diff -r f8c14abf52b4 src/lib-storage/index/mbox/mbox-sync.c
--- a/src/lib-storage/index/mbox/mbox-sync.c Wed Jul 14 13:53:34 2010 +0100
+++ b/src/lib-storage/index/mbox/mbox-sync.c Tue Jul 20 17:42:47 2010 +0100
@@ -1487,6 +1487,21 @@
sync_ctx->errors = FALSE;
}
+static void mbox_verify(struct mbox_sync_context *sync_ctx, int state)
+{
+ char buf[100];
+ int ret;
+
+ if ((ret = pread(sync_ctx->write_fd, buf, sizeof(buf), 0)) < 0) {
+ mbox_set_syscall_error(sync_ctx->mbox, "pread()");
+ return;
+ }
+ if (ret == 0)
+ return;
+ if (ret < 5 || strncmp(buf, "From ", 5) != 0)
+ i_error("mbox got corrupted, state=%d", state);
+}
+
static int mbox_sync_do(struct mbox_sync_context *sync_ctx,
enum mbox_sync_flags flags)
{
@@ -1496,6 +1511,8 @@
unsigned int i;
int ret, partial;
+ mbox_verify(sync_ctx, 0);
+
st = i_stream_stat(sync_ctx->file_input, FALSE);
if (st == NULL) {
mbox_set_syscall_error(sync_ctx->mbox, "i_stream_stat()");
@@ -1558,8 +1575,10 @@
partial = FALSE;
}
+ mbox_verify(sync_ctx, 1);
if (mbox_sync_handle_eof_updates(sync_ctx, &mail_ctx) < 0)
return -1;
+ mbox_verify(sync_ctx, 2);
/* only syncs left should be just appends (and their updates)
which weren't synced yet for some reason (crash). we'll just
@@ -1572,11 +1591,13 @@
/* Rewrite uid_last in X-IMAPbase header if we've seen it
(ie. the file isn't empty) */
ret = mbox_rewrite_base_uid_last(sync_ctx);
+ mbox_verify(sync_ctx, 3);
}
if (mbox_sync_update_index_header(sync_ctx) < 0)
return -1;
+ mbox_verify(sync_ctx, 4);
return 0;
}
Re: [Dovecot] Dovecot v2.0.rc2 (875598cd7e26): Core dump upon client login
On Tue, 2010-07-20 at 16:34 +0200, Thomas Leuxner wrote: > On Tue, Jul 20, 2010 at 03:02:32PM +0100, Timo Sirainen wrote: > > I found one bug, but I don't think it should cause the problem you're > > seeing..: http://hg.dovecot.org/dovecot-2.0/rev/5179e8f41cf4 > > > > Even more interesting. It seems this patch prevents crashing the INBOX, > but it still would crash on a public namespace with ACLs. As a side > effect it seems to break mail read flags, flags don't change for mails. > Tested with several > mailboxes. http://hg.dovecot.org/dovecot-2.0/rev/5b3202a069fa fixes everything?
Re: [Dovecot] Dinamic 'mail_location' for each user
Hello, I understand your argument, although it's not good for me :) > But you can do that yourself when storing the path to database. Build a > script that hashes the username path in a way you want, and store that. I wouldn't like to do this. I have a lot of users and I can't to migrate everything at once. So I can't to make big changes in my code. > I'm still not sure if you mean what I thought you mean. If you mean that > % variables would be expanded when they're coming out of userdb then no, > it would not be accepted. It would break people's setup who actually > have % characters in paths. You understand correctly, sorry for my poor English. Anyway, we know that things changes in new versions. Otherwise, would never be released new variables. I understand your point, but ask you think about it, so it can be useful for many people. Thanks -- []'s Thiago Henrique Network Administration Digirati Networks K8 Networks
Re: [Dovecot] Dovecot v2.0.rc2 (875598cd7e26): Core dump upon client login
On Tue, Jul 20, 2010 at 03:02:32PM +0100, Timo Sirainen wrote: > I found one bug, but I don't think it should cause the problem you're > seeing..: http://hg.dovecot.org/dovecot-2.0/rev/5179e8f41cf4 > Even more interesting. It seems this patch prevents crashing the INBOX, but it still would crash on a public namespace with ACLs. As a side effect it seems to break mail read flags, flags don't change for mails. Tested with several mailboxes. Regards Thomas
Re: [Dovecot] Dovecot v2.0.rc2 (875598cd7e26): Core dump upon client login
On Tue, Jul 20, 2010 at 03:02:32PM +0100, Timo Sirainen wrote: > I found one bug, but I don't think it should cause the problem you're > seeing..: http://hg.dovecot.org/dovecot-2.0/rev/5179e8f41cf4 Interesting. With this is does not crash on the INBOX (Global ACL) but on specific mailbox/folder ACLs.
Re: [Dovecot] Doveadm director flush/remove
On Tue, 2010-07-20 at 06:56 -0700, Brandon Davidson wrote: > Timo, > > On 7/19/10 9:38 AM, "Timo Sirainen" wrote: > > > > http://hg.dovecot.org/dovecot-2.0/rev/f178792fb820 fixes it? > > It makes it further before crashing. Trace attached. > > I still wonder why it's timing out in the first place. Didn't you change it > to reset the timeout as long as it's still getting data from the userdb? Did several fixes related to this in different parts of code. Now it should work? :)
Re: [Dovecot] Dovecot v2.0.rc2 (875598cd7e26): Core dump upon client login
On Tue, Jul 20, 2010 at 02:56:44PM +0100, Timo Sirainen wrote: > How are you compiling Dovecot? What gcc version? Do you give any special > parameters? gcc (Debian 4.3.2-1.1) 4.3.2 Using 'dpkg-buildpackage -j4' with standard distro values and pulling sources from Stephan's repo.
Re: [Dovecot] Dovecot v2.0.rc2 (875598cd7e26): Core dump upon client login
On Tue, 2010-07-20 at 14:56 +0100, Timo Sirainen wrote: > On Tue, 2010-07-20 at 09:10 +0200, Thomas Leuxner wrote: > > On Mon, Jul 19, 2010 at 07:53:49PM +0100, Timo Sirainen wrote: > > > But .. I don't really get it. I guess it has to be related to > > > http://hg.dovecot.org/dovecot-2.0/rev/6b66aad2a997 change. Does > > > reverting that fix it? > > > > Reverting this commit fixes it. > > How are you compiling Dovecot? What gcc version? Do you give any special > parameters? I found one bug, but I don't think it should cause the problem you're seeing..: http://hg.dovecot.org/dovecot-2.0/rev/5179e8f41cf4
Re: [Dovecot] About Logging
Oh, sorry i forgot to mentioned I am testing you v2.0 version since beta releases. I am gonna start using it in a production envoriment. It will be couple servers balanced with ldirectord writing in same storage. We are having some trouble, but it is going well. Great Work =] []'sf.rique On Tue, Jul 20, 2010 at 10:49 AM, Timo Sirainen wrote: > Kind of a bloaty feature.. v2.0 has a separate log process, maybe it > could be configured some day to do some filtering internally. > > On Tue, 2010-07-20 at 10:43 -0300, Henrique Fernandes wrote: > > But still, you don't think it wil be implemented on dovecot code ? > > > > I will look for syslog to handle it. > > > > When i find the answer i post it here. > > > > []'sf.rique > > > > > > On Tue, Jul 20, 2010 at 10:36 AM, Timo Sirainen wrote: > > > > > On Tue, 2010-07-20 at 09:44 -0300, Henrique Fernandes wrote: > > > > It is possible to make dovecot do not log any request from a > determined > > > > host? > > > > > > Log to syslog and configure it to filter out those lines you don't > like. > > > I think syslog-ng at least supports that.. > > > > > > > > > > > >
Re: [Dovecot] Dovecot v2.0.rc2 (875598cd7e26): Core dump upon client login
On Tue, 2010-07-20 at 09:10 +0200, Thomas Leuxner wrote: > On Mon, Jul 19, 2010 at 07:53:49PM +0100, Timo Sirainen wrote: > > But .. I don't really get it. I guess it has to be related to > > http://hg.dovecot.org/dovecot-2.0/rev/6b66aad2a997 change. Does > > reverting that fix it? > > Reverting this commit fixes it. How are you compiling Dovecot? What gcc version? Do you give any special parameters?
Re: [Dovecot] Doveadm director flush/remove
Timo, On 7/19/10 9:38 AM, "Timo Sirainen" wrote: > > http://hg.dovecot.org/dovecot-2.0/rev/f178792fb820 fixes it? It makes it further before crashing. Trace attached. I still wonder why it's timing out in the first place. Didn't you change it to reset the timeout as long as it's still getting data from the userdb? -Brad auth-worker-gdb_2.txt Description: Binary data
Re: [Dovecot] About Logging
Kind of a bloaty feature.. v2.0 has a separate log process, maybe it could be configured some day to do some filtering internally. On Tue, 2010-07-20 at 10:43 -0300, Henrique Fernandes wrote: > But still, you don't think it wil be implemented on dovecot code ? > > I will look for syslog to handle it. > > When i find the answer i post it here. > > []'sf.rique > > > On Tue, Jul 20, 2010 at 10:36 AM, Timo Sirainen wrote: > > > On Tue, 2010-07-20 at 09:44 -0300, Henrique Fernandes wrote: > > > It is possible to make dovecot do not log any request from a determined > > > host? > > > > Log to syslog and configure it to filter out those lines you don't like. > > I think syslog-ng at least supports that.. > > > > > >
Re: [Dovecot] About Logging
But still, you don't think it wil be implemented on dovecot code ? I will look for syslog to handle it. When i find the answer i post it here. []'sf.rique On Tue, Jul 20, 2010 at 10:36 AM, Timo Sirainen wrote: > On Tue, 2010-07-20 at 09:44 -0300, Henrique Fernandes wrote: > > It is possible to make dovecot do not log any request from a determined > > host? > > Log to syslog and configure it to filter out those lines you don't like. > I think syslog-ng at least supports that.. > > >
Re: [Dovecot] About Logging
On Tue, 2010-07-20 at 09:44 -0300, Henrique Fernandes wrote: > It is possible to make dovecot do not log any request from a determined > host? Log to syslog and configure it to filter out those lines you don't like. I think syslog-ng at least supports that..
[Dovecot] About Logging
It is possible to make dovecot do not log any request from a determined host? Because, we gonna use ldirectord for foward request and etc and the ldirectord makes an connecting every 2 seconds to find out if the server is ok, and also make a login in imap and pop3 to check this service as well. Is there any how to make dovecot do not log entries for a determined host ? The logs get too many info that we don need! Any ideias ? Thanks! * *i have sent a msg like this, but i got no answer i thought i might have not deliver into the mailist! I am sorry if it already have it!* *[]'sf.rique
Re: [Dovecot] Mbox corruption - Inbox beginning with 'FFrom' or 'FrFrom'
I experienced this today with my own IMAP folder, so maybe being able to offer a more specific order of events will help. Also not sure if I previously mentioned that this is occasionally happening with IMAP folders even though it's much more common under POP3. 1) I had just cleaned out my Junk folder. 2) Two messages were received without error. 3) I marked the folder as read in Thunderbird. 4) I restarted Thunderbird 5) The next delivery attempt to that mailbox (using dovecot deliver) failed: save failed to Junk: Mailbox isn't a valid mbox file The odd thing is that the delivery *did* succeed because that message is in there. The very first message header is the one that was corrupted which always seems to be the case. Does "deliver" read/write the entire mbox file or just append the new message to the end? On 06/08/10 11:24, Erik Kratzenberg wrote: We've had situations where the same user will have their mailbox corrupted 2 or 3 times a day. We're not using filesystem quotas and nothing but Dovecot is writing to these mailboxes. We've been pushing people to switch to IMAP which seems to be the only solution so far. That's decreased the number of reports we're getting, but they're definitely still coming in. On 05/25/10 15:10, Timo Sirainen wrote: On Fri, 2010-05-07 at 15:03 -0400, Erik Kratzenberg wrote: -Dovecot.log : Mar 29 11:00:06 Error: POP3(user_login): > > Couldn't init INBOX: Mailbox isn't a valid mbox > > -The mailbox start with either 'FFrom or 'FrFrom' It's happening several times a day, sometimes to the same mailbox. How often does the same user get the error? We also noticed some other storage and assertion errors around the same time the corruption occurs which may or may not be related: Mar 26 14:49:36 dovecot: Panic: POP3(u...@home.com): file mbox-sync.c: line 1314 (mbox_sync_handle_eof_updates): assertion failed: (offset == 0|| offset> 31) There's a good chance this is related. Mar 24 15:21:59 dovecot: POP3(u...@home.com): Cached message offset 2 is invalid for mbox file /usr/boxes/mailbox Are you using filesystem quota for users? That might explain this. Otherwise, the above shouldn't be happening if Dovecot is the only software writing to the mbox files.. I'm not sure if "mail_debug=yes" will give us any additional info, but I'm turning that on now. No, that won't log anything useful.
Re: [Dovecot] about variables
On 07/20/2010 11:31 AM, Arne K. Haje wrote:
Tirsdag 20. juli 2010 09.31.51 skrev alex :
Hi
In http://wiki.dovecot.org/Variables I found:
%s service imap, pop3, smtp, deliver
and that can be use in userdb and SQL query string.
How exactly can I use %s in the query string if I want for ex to disable
a service (just one service - ex pop3) for a specific user.
Alex
While I've not tried it, I guess you could do something like this in the SQL
query;
".. AND service=('%s' OR 'all')"
You could set the default value of service column to 'all', but set it to
'imap' for users that can only use that service.
Arne
How about
"...AND %s in (services)"
and the services column will be something like 'imap,pop3,smtp,deliver'
=> "...AND %s in (imap,pop3,smtp,deliver)"
For the user that do not have , let say imap, the services will be
(pop3,smtp,deliver)
Further more : the postfix server use the dovecot auth. It is possible
for an account to disable the smtp auth (the user won't be able to send
any emails but will be able to receive an read )?
Alex
Re: [Dovecot] Problem with hard links in lda - please help
On Tue, 2010-07-20 at 12:53 +0200, Fabio Ferrari wrote: > >> deliver -p -d > >> deliver -p -d > >> ... > >> deliver -p -d I noticed one thing: The created file's permissions must be the same as the destination maildir's. So typically the file needs to be 0600 mode. Also all of the users must have the same UID.
Re: [Dovecot] Problem with hard links in lda - please help
> On 20.7.2010, at 11.03, Fabio Ferrari wrote: > >> deliver -p -d >> deliver -p -d >> ... >> deliver -p -d > > This is how it should be done. The file was exactly the same between all > the calls? Did you try running this manually from command line instead of > via MTA? Do you have maildir_copy_with_hardlinks=yes? > > The answer is: yes. I called it via command line, the 'diff' command shows no differences between the two destination files (correctly delivered in the 'new' directory in the two maildirs) and I have the maildir_copy_with_hardlinks=yes line in the /usr/local/etc/dovecot.conf file. Has anyone tested this function or it is a non-existing feature and the documentation about hardlinks means something else from what I mean? Fabio Ferrari
Re: [Dovecot] Problem with hard links in lda - please help
On 20.7.2010, at 11.03, Fabio Ferrari wrote: > deliver -p -d > deliver -p -d > ... > deliver -p -d This is how it should be done. The file was exactly the same between all the calls? Did you try running this manually from command line instead of via MTA? Do you have maildir_copy_with_hardlinks=yes?
Re: [Dovecot] Unknown column username in where clause
Timo Sirainen wrote on 20.07.2010:
> On 19.7.2010, at 22.59, Daniel Luttermann wrote:
>> The queries uses only "userid" instead of "username" so I think if one
>> sql field were missing it should report that "userid" could not be
>> found because the query is "FROM users WHERE userid = '%u'".
>>
>> I've not select "username" in any sql select so I wonder where does
>> this name come from.
> There's actually a default query.. Hmm. Maybe it should be made
> empty, since probably no one wants to use it.
hmm, I've nothing read about that - but it's OK because the examples
in the wiki creates tables with the field "username" instead of
"userid" which I've used so the default query should then match...
>> password_query = SELECT userid AS user, password, \
>> home AS userdb_home, uid AS userdb_uid, gid AS userdb_gid, \
>> concat('*:bytes=', quota_bytes) as userdb_quota_rule \
>> FROM users WHERE userid = '%u'
> You must also have a user_query for LDA/LMTP.
OK, it seems to be working if I add this in dovecot-sql.conf.ext too:
user_query = SELECT home, uid, gid, \
concat('*:bytes=', quota_bytes) as quota_rule \
FROM users WHERE userid = '%u'
--
Daniel
Re: [Dovecot] Problem with hard links in lda - please help
Yes, I tried in many ways, the deliver -p -d -d is only one of the ways I tried to hardlink a message. I tried even to do deliver -p -d deliver -p -d ... deliver -p -d but all commands have the same result, that is the message is copied and not hardlinked. The question is, do I have a way to make hardlinks for the same message with dovecot lda or I have to write my own script that hardlinks the file in the correct directories bypassing lda? thank in advance for the answer Fabio Ferrari > On Fri, 2010-07-16 at 15:44 +0200, Fabio Ferrari wrote: > >> I'm trying to enable hardlinks for messages sent to mutiple users. (I >> need >> this because I have mailing lists with 5000 users used many times a >> day). >> >> I've read that, to do this, I have to write a script that uses the >> /usr/local/libexec/dovecot/deliver >> command in this way: >> deliver -p -d -d > > You can't give more than -d parameter. deliver can deliver a mail only > to a single user at a time. > > The important part is that your MTA calls a script (that you need to > create) that gets multiple users as parameters, and then you can call > deliver -p for each one of them separately. I don't think MTA can call > the delivery script with 5000 parameters, so there must be some > duplication always. > > Also mailing lists often send separate mails to users. If this is > happening, hard linking can't be done because the mails are different. > >
Re: [Dovecot] about variables
Tirsdag 20. juli 2010 09.31.51 skrev alex :
> Hi
>
> In http://wiki.dovecot.org/Variables I found:
>%s service imap, pop3, smtp, deliver
> and that can be use in userdb and SQL query string.
>
> How exactly can I use %s in the query string if I want for ex to disable
> a service (just one service - ex pop3) for a specific user.
>
> Alex
While I've not tried it, I guess you could do something like this in the SQL
query;
".. AND service=('%s' OR 'all')"
You could set the default value of service column to 'all', but set it to
'imap' for users that can only use that service.
Arne
--
Arne K. Haaje | www.drlinux.no
T: 69 51 15 52 | M: 92 88 44 66
[Dovecot] about variables
Hi In http://wiki.dovecot.org/Variables I found: %s service imap, pop3, smtp, deliver and that can be use in userdb and SQL query string. How exactly can I use %s in the query string if I want for ex to disable a service (just one service - ex pop3) for a specific user. Alex
Re: [Dovecot] Dovecot v2.0.rc2 (875598cd7e26): Core dump upon client login
On Mon, Jul 19, 2010 at 07:53:49PM +0100, Timo Sirainen wrote: > But .. I don't really get it. I guess it has to be related to > http://hg.dovecot.org/dovecot-2.0/rev/6b66aad2a997 change. Does > reverting that fix it? Reverting this commit fixes it.
