Re: [Dovecot] Per User Quotas
Hi Peter, please insert 1024M in the description field in active directory. Greetings And of course, I put in a users description field in Active Directory *:bytes=%1024 When I log in as that user, and check the quota, I'm still seeing 512 MB Very strange.
Re: [Dovecot] 2.0 config info for dovecot-dict-sql.conf?
On Thu, Oct 15, 2009 at 10:15 PM, PGNet Dev wrote: > is the v1.2+ info there valid/correct for 2.0+? hm. just realized ... The /dictionary/ quota backend supports both *storage* and *messages* quota limits. The current quota is kept in a dictionary. The available dictionaries are: * MySQL (v1.0+) * PostgreSQL (v1.1.2+) * Flat file (v1.2.alpha3+) _NOT_ sqlite3? yet?
[Dovecot] 2.0 config info for dovecot-dict-sql.conf?
reading, /usr/local/share/doc/dovecot/wiki/Quota.Dict.txt refers to config, e.g. dovecot-dict-sql.conf, for, "v1.2 +" is the v1.2+ info there valid/correct for 2.0+?
Re: [Dovecot] @2.0, Fatal error (Expecting '=') in trash plugin config
On Thu, Oct 15, 2009 at 10:00 PM, Timo Sirainen wrote: > Hmm. Or maybe the extension could be changed from .conf to something else. I > guess it would make it clearer if *.conf were the actually included config > files and everything else had a different extension. But what could that > be?.. trash.dat trash.param ?
Re: [Dovecot] @2.0, Fatal error (Expecting '=') in trash plugin config
On Oct 16, 2009, at 12:58 AM, Timo Sirainen wrote: On Oct 16, 2009, at 12:32 AM, PGNet Dev wrote: cat /data/mail/Conf/dovecot/conf.d/trash.conf 1 Spam 2 Trash 3 Sent 3 Sent Messages Don't put it into conf.d/ directory. It gets included by dovecot.conf, and that just doesn't work. Hmm. Or maybe the extension could be changed from .conf to something else. I guess it would make it clearer if *.conf were the actually included config files and everything else had a different extension. But what could that be?..
Re: [Dovecot] @2.0, Fatal error (Expecting '=') in trash plugin config
On Thu, Oct 15, 2009 at 9:58 PM, Timo Sirainen wrote: > On Oct 16, 2009, at 12:32 AM, PGNet Dev wrote: > >> cat /data/mail/Conf/dovecot/conf.d/trash.conf >> 1 Spam >> 2 Trash >> 3 Sent >> 3 Sent Messages > > Don't put it into conf.d/ directory. It gets included by dovecot.conf, and > that just doesn't work. noted, for future as well. thanks.
Re: [Dovecot] @2.0, Fatal error (Expecting '=') in trash plugin config
On Oct 16, 2009, at 12:32 AM, PGNet Dev wrote: cat /data/mail/Conf/dovecot/conf.d/trash.conf 1 Spam 2 Trash 3 Sent 3 Sent Messages Don't put it into conf.d/ directory. It gets included by dovecot.conf, and that just doesn't work.
[Dovecot] @2.0, Fatal error (Expecting '=') in trash plugin config
i've setup trash plugin as,
grep trash imap.conf
mail_plugins = autocreate fts fts_squat fts_solr imap_quota
quota trash zlib
cat plugin.conf
plugin {
...
trash = /data/mail/Conf/dovecot/conf.d/trash.conf
}
cat /data/mail/Conf/dovecot/conf.d/trash.conf
1 Spam
2 Trash
3 Sent
3 Sent Messages
but, @
dovecot -n
# 2.0.alpha1: /data/mail/Conf/dovecot/dovecot.conf
doveconf: Fatal: Error in configuration file
/data/mail/Conf/dovecot/conf.d/trash.conf line 1: Expecting '='
bug, or change frp, v1.x in config/parsing?
[Dovecot] migrate courier to dovecot script - questions about directory structure
Hi all, Im in the process of moving about 7000 users across from courier to dovecot. Both Maildir setups. The migration script works a treat, but I need a slight change to it. Couriers directory structure looks ike this: /home/vmail///cur/ /home/vmail///new/ /home/vmail///tmp/ /home/vmail///maildirsize /home/vmail///courier* etc.. Dovecot looks like this: /home/vmail///Maildir/cur/ /home/vmail///Maildir/new/ /home/vmail///Maildir/tmp/ So the issue is, there is an additional Maildir directory in the structure. Now the migration script works fine, however when the migration is completed, I have to manually add the Maildir directory into the structure, which is going to take a little too long :) Is there something in the script that can add this ? Is there a way to perhaps use the script to add the Maildir part ? My initial plan was to copy the entire /home/vmail//* across to the dovecot server and run the migration script. However, without the Maildir directory in the structure it won't work. Has anyone run into this issue ? How did you solve it ? -- Regards Ross fatboy:/tmp# dovecot --version 1.0.15 fatboy:/tmp# dovecot -n # 1.0.15: /etc/dovecot/dovecot.conf log_timestamp: %Y-%m-%d %H:%M:%S protocols: imap imaps pop3 pop3s disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable(default): /usr/lib/dovecot/imap-login login_executable(imap): /usr/lib/dovecot/imap-login login_executable(pop3): /usr/lib/dovecot/pop3-login mail_privileged_group: mail mail_location: maildir:/var/vmail/%Ld/%Ln/Maildir mail_executable(default): /usr/lib/dovecot/imap mail_executable(imap): /usr/lib/dovecot/imap mail_executable(pop3): /usr/lib/dovecot/pop3 mail_plugins(default): quota imap_quota mail_plugins(imap): quota imap_quota mail_plugins(pop3): quota mail_plugin_dir(default): /usr/lib/dovecot/modules/imap mail_plugin_dir(imap): /usr/lib/dovecot/modules/imap mail_plugin_dir(pop3): /usr/lib/dovecot/modules/pop3 pop3_uidl_format(default): pop3_uidl_format(imap): pop3_uidl_format(pop3): %08Xu%08Xv namespace: type: private separator: . prefix: INBOX. inbox: yes auth default: mechanisms: plain login passdb: driver: sql args: /etc/dovecot/dovecot-sql.conf userdb: driver: passwd userdb: driver: static args: uid=5000 gid=5000 home=/var/vmail/%d/%n allow_all_users=yes socket: type: listen client: path: /var/spool/postfix/private/auth mode: 432 user: postfix group: postfix master: path: /var/run/dovecot/auth-master mode: 384 user: vmail plugin: quota: maildir:storage=51200
Re: [Dovecot] Panic when using QRESYNC
On Fri, 2009-10-09 at 20:37 -0400, Timo Sirainen wrote: > On Fri, 2009-10-09 at 12:56 -0600, Michael M. Slusarz wrote: > > Oct 9 12:49:30 bigworm EXT(slusarz): : > > /home/slusarz/Maildir/dovecot.index.log: Transaction log changed > > unexpectedly, can't get modseq > > I'll still need to get this fixed. Fixed: http://hg.dovecot.org/dovecot-1.2/rev/d55146fea954 signature.asc Description: This is a digitally signed message part
Re: [Dovecot] pop3-login process
Hi, Thank you for your answer! Oh, I see. I'll upgrade it! Thank you so much. Regards, --- Timo Sirainen wrote: > On Thu, 2009-10-15 at 21:11 -0400, Timo Sirainen > wrote: > > On Fri, 2009-10-16 at 09:58 +0900, > ogu...@yahoo.co.jp wrote: > > > dovecot-auth: Login process has too old (125s) > requests, > > > killing it. > > > > Do you have anything else in logs? This shouldn't > be happening. I've > > never seen it happen before.. > > Oh no. You're using Dovecot v0.99.x. That's an > incredibly old version, > upgrade! > > -- GyaO! - Anime, Dramas, Movies, and Music videos [FREE] http://pr.mail.yahoo.co.jp/gyao/
Re: [Dovecot] Expire plugin in chkpw-wrapper.sh script
On Thu, 2009-10-15 at 14:32 -0500, Jose Luis Marin Perez wrote:
> I'm trying to extend the configuration of vchkpw-wrapper.sh script by adding
> the expire plugin as follows:
..
> /usr/local/sbin/dovecot --exec-mail ext
> /usr/local/libexec/dovecot/expire-tool --test
The problem is that vchkpw-wrapper.sh is now run only when user is
authenticating. expire-tool doesn't authenticate, it only does userdb
lookup. So you'll need to have the script run for userdb lookups too:
passdb checkpassword {
..
}
userdb prefetch {
}
userdb checkpassword {
args = /usr/local/bin/userdb.sh
}
Then create /usr/local/bin/userdb.sh which does more or less what the
vchkpw-wrapper.sh does, except since it doesn't call vchkpw itself,
it'll need to get the username from $USER instead of $VPOPUSER.
http://wiki.dovecot.org/AuthDatabase/CheckPassword#Checkpassword_as_userdb
explains this extension.
signature.asc
Description: This is a digitally signed message part
Re: [Dovecot] pop3-login process
On Thu, 2009-10-15 at 21:11 -0400, Timo Sirainen wrote: > On Fri, 2009-10-16 at 09:58 +0900, ogu...@yahoo.co.jp wrote: > > dovecot-auth: Login process has too old (125s) requests, > > killing it. > > Do you have anything else in logs? This shouldn't be happening. I've > never seen it happen before.. Oh no. You're using Dovecot v0.99.x. That's an incredibly old version, upgrade! signature.asc Description: This is a digitally signed message part
Re: [Dovecot] pop3-login process
On Fri, 2009-10-16 at 09:58 +0900, ogu...@yahoo.co.jp wrote: > dovecot-auth: Login process has too old (125s) requests, > killing it. Do you have anything else in logs? This shouldn't be happening. I've never seen it happen before.. signature.asc Description: This is a digitally signed message part
Re: [Dovecot] Expire plugin: wrong mailbox separators in database?
http://hg.dovecot.org/dovecot-1.2/rev/00757d350812 probably helps? signature.asc Description: This is a digitally signed message part
Re: [Dovecot] pop3-login process
Hi, Thank you for the reply. I've changed it which you suggested to me. It works well. Can I ask you one more thing? Is there any parameter to check the time of login processes? - dovecot-auth: Login process has too old (125s) requests, killing it. - Regards, --- Timo Sirainen wrote: > On Thu, 2009-10-15 at 09:49 +0900, > ogu...@yahoo.co.jp wrote: > > So it means like this? > > A established connection = A pop3-login process > > It should be about that. > > > I'm having a strange phenomenon that there are > 5000 > > established > > connections, but pop3-login processes are more > than 5000. > > How much more? Anyway, with that many connections > you should probably > switch to running login_process_per_connection=no. > http://wiki.dovecot.org/LoginProcess > > -- GyaO! - Anime, Dramas, Movies, and Music videos [FREE] http://pr.mail.yahoo.co.jp/gyao/
Re: [Dovecot] Error (IMHO) with --with-doc option
On Tue, 2009-09-29 at 11:59 +0200, Jacek Osiecki wrote: > When you run ./configure --with-docs=no, Makefile does not build docs > anymore, but... installs them anyway :) It caused some troubles because > rpmbuild complained about documents moved to /usr/share/doc/dovecot > > I have created a small patch that fixes this - hope it doesn't introduce any > mess: > > diff -Nur 2/Makefile.in 1/Makefile.in > --- 2/Makefile.in 2009-09-29 00:17:22.0 +0200 > +++ 1/Makefile.in 2009-09-29 00:17:38.0 +0200 > @@ -75,7 +75,7 @@ > distclean-recursive maintainer-clean-recursive > ETAGS = etags > CTAGS = ctags > -DIST_SUBDIRS = src doc > +DIST_SUBDIRS = $(SUBDIRS) Makefile.in changes aren't permanent. I guess you could have added the line to Makefile.am, but that anyway causes dovecot*example.conf files not to get installed. I added a patch now that makes .txt files not get installed, but I couldn't get it not to create the share/doc/ directory: http://hg.dovecot.org/dovecot-1.2/rev/5763caa55b57 signature.asc Description: This is a digitally signed message part
Re: [Dovecot] Questions regarding dbox migration
On Thu, 2009-10-15 at 20:16 -0400, Charles Marcus wrote: > On 10/15/2009, Timo Sirainen (t...@iki.fi) wrote: > > The default is 2 MB, and whoever sets it larger deserves what they get > > (for better or worse). > > Just for clarification... what happens when a single message is larger > than 2MB? Is it stored just as a single dbox file all by itself? Yes. signature.asc Description: This is a digitally signed message part
Re: [Dovecot] master:Error @2.0 TLS login, "Too large auth data_size sent"
On Thu, Oct 15, 2009 at 5:34 PM, Pascal Volk wrote: > This messages is logged, because you've enabled mail_debug. In a few > commits, this messages will be: > a) Prefixed with 'Debug' > b) optional send to debug_log_path = /path/to/debug.log thanks, that'll be useful.
Re: [Dovecot] dovecot 1.2.6 fails to build with openssl < 0.9.8
On Wed, 2009-10-07 at 10:51 +0100, Paul Howarth wrote: > Which leads to: > http://hg.dovecot.org/dovecot-1.2/rev/4add5c3f13ea > > Actually the fix looks slightly wrong to me, and it'll dereference a > NULL pointer in t_strdup_printf with openssl < 0.9.8. The setting of > comp_str to NULL if HAVE_SSL_COMPRESSION is not set should be changed > to setting comp_str to "" I believe. Right. Thanks. Fixed properly now: http://hg.dovecot.org/dovecot-1.2/rev/0aa7357761a5 Although at least with Linux it wouldn't have crashed but instead just added "(null)" text. signature.asc Description: This is a digitally signed message part
Re: [Dovecot] is it possible to fetch messages for multiple users using a single account?
On Wed, 2009-10-07 at 19:31 +0100, Tony Smith wrote: > It seems getmail supports multidrop retriever which might fit the > bill. However I could not figure out how to set up an account that can > be used to fetch all messages for all virtual accounts. Is it possible > at all? If I really wanted this, I'd set use master user logins. You still need to log in separately to each account, but you can use the same password. http://wiki.dovecot.org/Authentication/MasterUsers It would also be possible with v1.2 to share all users' mailboxes to a single user, but that seems much more dangerous. signature.asc Description: This is a digitally signed message part
Re: [Dovecot] master:Error @2.0 TLS login, "Too large auth data_size sent"
On 10/16/2009 02:23 AM PGNet Dev wrote:
> fyi, so far, so good. logged in, with no problems. user's folders
> autocreated as specified,
> …
> one question re: logs (below). the
>
> Info: Namespace : Permission lookup failed from
> /data/mail/Domains/my.domain.com/Accounts/testuser/Trash
>
> messages are labeled as "Info", but say "failed". Are these a
> problem? Seems like the folders were created, and with correct
> permissions, after all ... 'fail' becuase there's a check _before_
> they're created?.
>
src/lib-storage/mailbox-list.c:369
} else if (list->mail_set->mail_debug) {
i_info("Namespace %s: Permission lookup failed from %s",
list->ns->prefix, path);
This messages is logged, because you've enabled mail_debug. In a few
commits, this messages will be:
a) Prefixed with 'Debug'
b) optional send to debug_log_path = /path/to/debug.log
Regards,
Pascal
--
The trapper recommends today: beeffeed.0928...@localdomain.org
Re: [Dovecot] master:Error @2.0 TLS login, "Too large auth data_size sent"
fyi, so far, so good. logged in, with no problems. user's folders autocreated as specified, cd /data/mail/Domains/my.domain.com/Accounts/testuser ls -al total 56 drwx-- 9 vmail vmail 4096 2009-10-15 10:16 ./ drwx-- 3 vmail vmail 4096 2009-10-15 06:38 ../ drwx-- 2 vmail vmail 4096 2009-10-15 06:38 cur/ -rw--- 1 vmail vmail 220 2009-10-15 10:16 dovecot.index.log -rw-r--r-- 1 vmail vmail 600 2009-10-15 10:16 dovecot.mailbox.log -rw--- 1 vmail vmail 51 2009-10-15 10:16 dovecot-uidlist -rw--- 1 vmail vmail8 2009-10-15 10:16 dovecot-uidvalidity -rw--- 1 vmail vmail0 2009-10-15 10:16 dovecot-uidvalidity.4ad758e5 drwx-- 5 vmail vmail 4096 2009-10-15 10:16 Drafts/ drwx-- 2 vmail vmail 4096 2009-10-15 06:38 new/ drwx-- 5 vmail vmail 4096 2009-10-15 10:16 Spam/ -rw--- 1 vmail vmail 34 2009-10-15 10:16 subscriptions drwx-- 5 vmail vmail 4096 2009-10-15 10:16 Templates/ drwx-- 2 vmail vmail 4096 2009-10-15 06:38 tmp/ drwx-- 5 vmail vmail 4096 2009-10-15 10:16 Trash/ one question re: logs (below). the Info: Namespace : Permission lookup failed from /data/mail/Domains/my.domain.com/Accounts/testuser/Trash messages are labeled as "Info", but say "failed". Are these a problem? Seems like the folders were created, and with correct permissions, after all ... 'fail' becuase there's a check _before_ they're created?. Oct 15 10:16:15 imap-login: Info: Login: user=, method=PLAIN, rip=192.168.1.4, lip=192.168.1.14, TLS Oct 15 10:16:15 IMAP(testu...@my.domain.com): Info: Loading modules from directory: /usr/local/lib/dovecot Oct 15 10:16:15 IMAP(testu...@my.domain.com): Info: Module loaded: /usr/local/lib/dovecot/lib10_quota_plugin.so Oct 15 10:16:15 IMAP(testu...@my.domain.com): Info: Module loaded: /usr/local/lib/dovecot/lib11_imap_quota_plugin.so Oct 15 10:16:15 IMAP(testu...@my.domain.com): Info: Module loaded: /usr/local/lib/dovecot/lib20_autocreate_plugin.so Oct 15 10:16:15 IMAP(testu...@my.domain.com): Info: Module loaded: /usr/local/lib/dovecot/lib20_fts_plugin.so Oct 15 10:16:15 IMAP(testu...@my.domain.com): Info: Module loaded: /usr/local/lib/dovecot/lib20_zlib_plugin.so Oct 15 10:16:15 IMAP(testu...@my.domain.com): Info: Module loaded: /usr/local/lib/dovecot/lib21_fts_solr_plugin.so Oct 15 10:16:15 IMAP(testu...@my.domain.com): Info: Module loaded: /usr/local/lib/dovecot/lib21_fts_squat_plugin.so Oct 15 10:16:15 IMAP(testu...@my.domain.com): Info: Effective uid=1001, gid=1000, home=/data/mail/Domains/my.domain.com/Accounts/testuser Oct 15 10:16:15 IMAP(testu...@my.domain.com): Info: Quota root: name=storage=10240 backend=maildir args= Oct 15 10:16:15 IMAP(testu...@my.domain.com): Info: Namespace: type=private, prefix=, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=yes Oct 15 10:16:15 IMAP(testu...@my.domain.com): Info: fs: root=/data/mail/Domains/my.domain.com/Accounts/testuser, index=, control=, inbox=/data/mail/Domains/my.domain.com/Accounts/testuser Oct 15 10:16:15 IMAP(testu...@my.domain.com): Info: Namespace: type=public, prefix=Public/, sep=/, inbox=no, hidden=no, list=yes, subscriptions=yes Oct 15 10:16:15 IMAP(testu...@my.domain.com): Info: maildir++: root=/data/mail/MailStore/Dovecot/Domains/my.domain.com/Public, index=, control=, inbox= Oct 15 10:16:15 IMAP(testu...@my.domain.com): Info: Namespace: type=shared, prefix=Shared/, sep=/, inbox=no, hidden=no, list=yes, subscriptions=yes Oct 15 10:16:15 IMAP(testu...@my.domain.com): Info: maildir++: root=/data/mail/MailStore/Dovecot/Domains/my.domain.com/Shared, index=, control=, inbox= Oct 15 10:16:15 IMAP(testu...@my.domain.com): Info: Namespace : Permission lookup failed from /data/mail/Domains/my.domain.com/Accounts/testuser/Trash Oct 15 10:16:15 IMAP(testu...@my.domain.com): Info: Namespace : Using permissions from /data/mail/Domains/my.domain.com/Accounts/testuser: mode=0700 gid=-1 Oct 15 10:16:15 IMAP(testu...@my.domain.com): Info: Namespace : Permission lookup failed from /data/mail/Domains/my.domain.com/Accounts/testuser/Trash Oct 15 10:16:15 IMAP(testu...@my.domain.com): Info: Namespace : Using permissions from /data/mail/Domains/my.domain.com/Accounts/testuser: mode=0700 gid=-1 Oct 15 10:16:15 IMAP(testu...@my.domain.com): Info: Namespace : Permission lookup failed from /data/mail/Domains/my.domain.com/Accounts/testuser/Spam Oct 15 10:16:15 IMAP(testu...@my.domain.com): Info: Namespace : Using permissions from /data/mail/Domains/my.domain.com/Accounts/testuser: mode=0700 gid=-1 Oct 15 10:16:15 IMAP(testu...@my.domain.com): Info: Namespace : Permission lookup failed from /data/mail/Domains/my.domain.com/Accounts/testuser/Spam Oct 15 10:16:15 IMAP(testu...@my.domain.com): Info: Namespace : Using permissions from /data/mail/Domains/my.domain.com/Accounts/testuser: mode=0700 gid=-1 Oct 15 10:16:15 IMAP(testu...@my.domain.com): Info: Name
Re: [Dovecot] Questions regarding dbox migration
On 10/15/2009, Timo Sirainen (t...@iki.fi) wrote: > The default is 2 MB, and whoever sets it larger deserves what they get > (for better or worse). Just for clarification... what happens when a single message is larger than 2MB? Is it stored just as a single dbox file all by itself?
Re: [Dovecot] 1.2.6 Spurious pread()/stream errors/index corruption
after ensuring that the main dovecot binaries were not linked against mysqlclient and applying this patch from 2.0: http://hg.dovecot.org/dovecot-2.0/rev/910059d94bbc all problems were fixed in 32 & 64bit x86 linux On Thu, 15 Oct 2009 18:59:50 -0400, Timo Sirainen wrote: > On Thu, 2009-10-15 at 23:45 +0100, Paul Freeman wrote: >> //#define HAVE_PREAD 1 >> #define PREAD_BROKEN >> //#define PREAD_WRAPPERS >> >> nm dovecot|grep pread >> U my_pread@@libmysqlclient_16 > > Oh! libmysqlclient messes this up. Why is your dovecot binary (and other > binaries) linked against libmysqlclient? That's not normal. > > I did fix this in v2.0 though, the patch probably applies to v1.2 too: > http://hg.dovecot.org/dovecot-2.0/rev/910059d94bbc
Re: [Dovecot] Fatal: chdir( ) failed: Permission denied
On Fri, 2009-10-09 at 20:02 +0300, Vallo Kallaste wrote: > On Fri, Oct 09, 2009 at 12:14:25PM -0400, Timo Sirainen > wrote: > > > >Oct 9 16:43:49 jura dovecot: dovecot: Fatal: chdir(/a/home/mina) > > >failed: Permission denied (euid=1118 > > >0(mina) egid=11332(devel) missing +x perm: /a/home) > > > > Oh, right, this happens before execing imap. Hmm. Well, > > mail_drop_priv_before_exec=yes probably helps you. I'll have to > > figure out if I should change something here.. > > > Just FYI, the problem remains after turning the > mail_drop_priv_before_exec=yes flag on. Right, I looked at the code wrong. I think I won't change this in v1.x because it might break something, but you could move ret = chdir(full_home_dir); in src/master/mail-process.c just before: client_process_exec(set->mail_executable, title); and then it should work with mail_drop_priv_before_exec=yes. I'll get this fixed properly in v2.0. signature.asc Description: This is a digitally signed message part
Re: [Dovecot] master:Error @2.0 TLS login, "Too large auth data_size sent"
On Thu, Oct 15, 2009 at 4:52 PM, Timo Sirainen wrote: > On Thu, 2009-10-15 at 16:32 -0700, PGNet Dev wrote: >> #0 0x7f9d752a5133 in maildir_quota_namespace_added >> (quota=0x62fe30, ns=0x630270) at quota-maildir.c:786 > > Well, kind of a stupid fix but it's probably good enough. A better one > would be a lot more trouble. > http://hg.dovecot.org/dovecot-2.0/rev/646a7173ad3d will see if anything crops ups downstream as a result. thx.
Re: [Dovecot] Dovecot inactive after an intermittent connection with LDAP
On Sun, 2009-10-11 at 21:57 +0700, Thu Nguyen wrote: > [root ~]# dovecot -n > # 1.1.14: /etc/dovecot.conf I'd suggest first upgrading. There are at least two related LDAP bugs fixed since 1.1.4: * src/auth/db-ldap.c: ldap: If first request is over 60 seconds old while a new request comes, reconnect. [f28d0ec6ec09] * src/auth/db-ldap.c: ldap: Fixed hang when >128 requests were sent at once. Based on patch by Marek Miska. [9954461eda42] signature.asc Description: This is a digitally signed message part
Re: [Dovecot] virtual Folder Plugin with "." Separator: [NONEXISTENT] Mailbox doesn't exist
On Sun, 2009-10-11 at 21:35 +0200, Elmar Weber wrote:
> mail_location = maildir:~/.maildir
>
> namespace private {
>prefix = virtual.
>separator = .
>location = virtual:~/.maildir/.virtual
> }
The main problem I see here is that by placing virtual namespace to
".virtual" directory under maildir, it's visible as a regular mailbox
called "virtual". See if all your problems go away simply by renaming
".virtual" to "virtual".
signature.asc
Description: This is a digitally signed message part
Re: [Dovecot] Missing folders
On Thu, 2009-10-15 at 08:04 +0100, John Moorhouse wrote: > I've recently had a oops with the system I was running dovecot on so > have had to move it to a new machine, I've been able to retrieve the > mbox files from the old machine, built the new machine and over wrote > the new mbox files with the old one in maildir, connecting to the server > via imap woeks but I can only see the mail in the inbox from the old > mbox files, emails in sub directories (the sub directories arn't there), > is there some command I need to run to get it to pass the mbox file to > find the folders or it there another file I need to transfer form the > old machine. If you only copied mails from /var/mail/* then those are only INBOXes. The others are probably in users' ~/mail/ directory. > (I'm assuming that all the emails for a user, including those in > subfolders are within the single mbox file, particularly as I'm is very > large) They're not. There's one mbox file per folder. signature.asc Description: This is a digitally signed message part
Re: [Dovecot] master:Error @2.0 TLS login, "Too large auth data_size sent"
On Thu, 2009-10-15 at 16:32 -0700, PGNet Dev wrote: > #0 0x7f9d752a5133 in maildir_quota_namespace_added > (quota=0x62fe30, ns=0x630270) at quota-maildir.c:786 Well, kind of a stupid fix but it's probably good enough. A better one would be a lot more trouble. http://hg.dovecot.org/dovecot-2.0/rev/646a7173ad3d signature.asc Description: This is a digitally signed message part
Re: [Dovecot] master:Error @2.0 TLS login, "Too large auth data_size sent"
On Thu, Oct 15, 2009 at 4:21 PM, PGNet Dev wrote: > SOFTCORELIMIT="0" -> SOFTCORELIMIT="1" argh! --- SOFTCORELIMIT="0" -> SOFTCORELIMIT="1" +++ --- SOFTCORELIMIT="0" -> SOFTCORELIMIT="unlimted"
Re: [Dovecot] Expire plugin in chkpw-wrapper.sh script
Stop sending the same mail every few hours. On Thu, 2009-10-15 at 18:14 -0500, Jose Luis Marin Perez wrote: > Dear Timo, > > I'm trying to extend the configuration of vchkpw-wrapper.sh script by adding > the expire plugin as follows: > > #!/bin/bash > > DOMAIN=`echo $VPOPUSER|sed s/^.*@//` > > if [ "$DOMAIN" = "operaciones.qnet.com.pe" ]; then > export USERDB_AUTOCREATE=INBOX.Spam > export USERDB_AUTOSUBSCRIBE=INBOX.Spam > export USERDB_EXPIRE="INBOX.Spam 1 INBOX.Spam.* 1" > export USERDB_EXPIRE_DICT="proxy::expire" > export EXTRA="USERDB_AUTOCREATE USERDB_AUTOSUBSCRIBE USERDB_EXPIRE > USERDB_EXPIRE_DICT" > fi > > unset USER > exec $* > > In the database no problem > > mysql> select * from expires; > +---+--+ > | mailbox | expire_stamp | > +---+--+ > | jma...@operaciones.qnet.com.pe/INBOX.Spam | 1255701608 | > +---+--+ > 1 row in set (0.00 sec) > > But when you run the command > > /usr/local/sbin/dovecot --exec-mail ext > /usr/local/libexec/dovecot/expire-tool --test > > Displays the following message > > Fatal: expire and expire_altmove settings not set > > That may be happening? > > Thanks > > Jose Luis > > dovecot -n > > # 1.1.16: /usr/local/etc/dovecot.conf > # OS: Linux 2.6.9-67.0.15.plus.c4smp i686 CentOS release 4.6 (Final) > log_path: /var/log/dovecot.log > listen: *:10143 > ssl_listen: *:10943 > disable_plaintext_auth: no > login_dir: /usr/local/var/run/dovecot/login > login_executable: /usr/local/libexec/dovecot/imap-login > first_valid_uid: 89 > last_valid_uid: 89 > first_valid_gid: 89 > last_valid_gid: 89 > mail_uid: 89 > mail_gid: 89 > mail_location: maildir:~/Maildir > mail_debug: yes > mail_plugins: quota imap_quota expire mail_log autocreate > namespace: > type: private > separator: . > prefix: INBOX. > inbox: yes > list: yes > subscriptions: yes > auth default: > debug: yes > passdb: > driver: checkpassword > args: /usr/vpopmail/bin/vchkpw /usr/local/bin/vchkpw-wrapper.sh > userdb: > driver: prefetch > args: uid=89 gid=89 home=/usr/vpopmail/domains/%d/%u > userdb: > driver: vpopmail > socket: > type: listen > master: > path: /usr/local/var/run/dovecot/auth-master > mode: 384 > user: vpopmail > group: vchkpw > plugin: > quota: maildir > quota_rule: ?:storage=0 > quota_rule2: Trash:ignore > expire_dict: proxy::expire > mail_log_events: delete undelete expunge copy mailbox_delete > mail_log_group_events: > mail_log_fields: uid box msgid size > dict: > expire: mysql:/usr/local/etc/dovecot-dict-expire.conf > > > _ > Discover the new Windows Vista > http://search.msn.com/results.aspx?q=windows+vista&mkt=en-US&form=QBRE signature.asc Description: This is a digitally signed message part
Re: [Dovecot] master:Error @2.0 TLS login, "Too large auth data_size sent"
limit coredumpsize unlimited
cd /data/mail/Domains/my.domain.com/Accounts/testuser
service dovecot-custom restart
Oct 15 09:23:37 master: Info: Dovecot v2.0.alpha1 starting up
login with TBird,
Oct 15 09:25:12 master: Error: service(imap): child 6626 killed with
signal 11 (core dumped)
Oct 15 09:25:12 mx kernel: imap[6626]: segfault at 0 ip
7f9d752a5133 sp 7fffe2288c50 error 4 in
lib10_quota_plugin.so[7f9d7529b000+e000]
gdb /usr/local/libexec/dovecot/imap ./core
(gdb) bt full
#0 0x7f9d752a5133 in maildir_quota_namespace_added
(quota=0x62fe30, ns=0x630270) at quota-maildir.c:786
No locals.
#1 0x7f9d752a1283 in quota_add_user_namespace (quota=0x62fe30,
ns=0x630270) at quota.c:575
backends =
path = 0x61fa30 "/data/mail/Domains/my.domain.com/Accounts/testuser"
path2 =
i = 0
j = 8
#2 0x7f9d752a5900 in quota_mailbox_list_created (list=0x630348)
at quota-storage.c:569
qlist =
quota = (struct quota *) 0x7f9d752a785f
root = (struct quota_root *) 0x630270
#3 0x7f9d760c2d75 in mailbox_list_create (driver=, ns=0x630270, set=0x7fffe2288df0, flags=,
error_r=0x7fffe2288ed8) at mailbox-list.c:180
list =
path =
idx = 2
__PRETTY_FUNCTION__ = "mailbox_list_create"
#4 0x7f9d760bfa46 in mail_storage_create (ns=0x630270,
driver=0x61f820 "maildir", flags=,
error_r=0x7fffe2288ed8) at mail-storage.c:271
storage_class = (struct mail_storage *) 0x7f9d76349be0
storage =
list_set = {layout = 0x61f876 "fs", root_dir = 0x61f828
"/data/mail/Domains/my.domain.com/Accounts/testuser", index_dir = 0x0,
control_dir = 0x0, alt_dir = 0x0,
inbox_path = 0x61f828
"/data/mail/Domains/my.domain.com/Accounts/testuser",
subscription_fname = 0x7f9d76134e06 "subscriptions", dir_guid_fname =
0x7f9d76131e6c "dovecot-dir-guid",
maildir_name = 0x0, mailbox_dir_name = 0x0}
data = 0x63c5a8
"maildir:/data/mail/Domains/my.domain.com/Accounts/testuser:LAYOUT=fs"
p =
__PRETTY_FUNCTION__ = "mail_storage_create"
#5 0x7f9d760badb4 in mail_namespaces_init (user=0x63b2f8,
error_r=0x7fffe2289000) at mail-namespace.c:130
mail_set = (const struct mail_storage_settings *) 0x63bbe0
namespaces = (struct mail_namespace *) 0x0
ns =
ns_p = (struct mail_namespace **) 0x7fffe2288ee8
inbox_set =
error =
driver =
location_source =
i = 0
count = 3
__PRETTY_FUNCTION__ = "mail_namespaces_init"
#6 0x7f9d760c4bae in mail_storage_service_init_post
(service=0x627370, input=0x7fffe2288fc0, home=0x7fffe228aef4
"/data/mail/Domains/my.domain.com/Accounts/testuser",
user_set=0x629428, setuid_root=false, flags=17,
mail_user_r=0x7fffe2289020, error_r=0x7fffe2289000) at
mail-storage-service.c:395
mail_set = (const struct mail_storage_settings *) 0x6294b8
mail_user = (struct mail_user *) 0x63b2f8
#7 0x7f9d760c5a20 in mail_storage_service_init_user
(service=0x627370, _input=, set_roots=, flags=17) at mail-storage-service.c:596
_data_stack_cur_id = 2
user =
#8 0x00417d07 in main (argc=1, argv=0x7fffe22891e8,
envp=0x7fffe22891f8) at main.c:217
---Type to continue, or q to quit---
set_roots = {0x61e980, 0x0}
service_flags =
storage_service_flags = 17
input = {module = 0x41b2b7 "imap", service = 0x41b2b7 "imap",
username = 0x7fffe228aecd "testu...@my.domain.com", local_ip = {family
= 2, u = {ip6 = {in6_u = {
u6_addr8 = "¬\036\vj", '\0' , u6_addr16 =
{7852, 27147, 0, 0, 0, 0, 0, 0}, u6_addr32 = {1779113644, 0, 0, 0}}},
ip4 = {s_addr = 1779113644}}}, remote_ip = {family = 2, u = {ip6 = {
in6_u = {u6_addr8 = "¬\036\v\006", '\0' ,
u6_addr16 = {7852, 1547, 0, 0, 0, 0, 0, 0}, u6_addr32 = {101392044, 0,
0, 0}}}, ip4 = {s_addr = 101392044
mail_user =
set =
dump_capability = false
value =
c =
(gdb)
Re: [Dovecot] master:Error @2.0 TLS login, "Too large auth data_size sent"
On Thu, Oct 15, 2009 at 4:15 PM, Brandon Davidson wrote: >> how do i enable coredumps? on opensuse, SOFTCORELIMIT="0" -> SOFTCORELIMIT="1" in /etc/sysconfig/ulimit is good for persist across restarts AND, limit coredumpsize unlimited works for in-session -- as long as i remember to do it in the RIGHT console window. argh.
Re: [Dovecot] master:Error @2.0 TLS login, "Too large auth data_size sent"
On Thu, 2009-10-15 at 16:09 -0700, PGNet Dev wrote:
> > Run "ulimit -c unlimited" before starting
> > dovecot, then it should write core file to user's home directory.
> > http://dovecot.org/bugreport.html
>
> * Dovecot must have been started without core dump size limit
> being too low. Run ulimit -c unlimited before starting Dovecot.
>
> hm, already @ unlimited,
>
> bash -c ulimit
> unlimited
>
> ah, tcsh-ism,
>
> limit coredumpsize
> coredumpsize 0 kbytes
> limit coredumpsize unlimited
> coredumpsize unlimited
If you start Dovecot via "service", it probably overrides the ulimit in
some script. Make sure you see:
cat /proc/`pidof dovecot`/limits|grep core
Max core file sizeunlimitedunlimitedbytes
Easiest probably just to start dovecot with:
ulimit -c unlimited
dovecot
> in master.conf
> ...
> service imap {
> protocol = imap
> executable= gdbhelper
> /usr/local/libexec/dovecot/imap
> ...
Well, with gdbhelper you won't ever get a core. I can't actually even
remember how gdbhelper is supposed to work. Just don't use it.
> * Set mail_drop_priv_before_exec = yes in config file.
This is no longer necessary at all with Linux.
signature.asc
Description: This is a digitally signed message part
Re: [Dovecot] master:Error @2.0 TLS login, "Too large auth data_size sent"
On Red Hat based distros, do: echo 'DAEMON_COREFILE_LIMIT="unlimited"' >> /etc/sysconfig/dovecot && service dovecot restart Might be worth putting in the wiki if it's not there already? -Brad > -Original Message- > ==> /var/log/dovecot/dovecot.log <== > Oct 15 09:07:33 master: Info: Dovecot v2.0.alpha1 starting up (core > dumps disabled) > > how do i enable coredumps?
Re: [Dovecot] Problem with mbox and quota with 1.2 version
On Sat, 2009-10-10 at 19:43 +0300, Ντελάκης Δημήτριος wrote: > plugin: > quota_warning: storage=5%% /usr/local/bin/quota-warning.sh 95 > quota: dirsize:user > quota_rule: ?:storage=10M Use quota_rule = *:storage=10M instead of '?'. It probably doesn't matter, but '*' makes it anyway clearer. > I still my mbox fills with e-mail >10M You need to start using Dovecot deliver and enable quota for it too. http://wiki.dovecot.org/LDA signature.asc Description: This is a digitally signed message part
[Dovecot] Expire plugin in chkpw-wrapper.sh script
Dear Timo, I'm trying to extend the configuration of vchkpw-wrapper.sh script by adding the expire plugin as follows: #!/bin/bash DOMAIN=`echo $VPOPUSER|sed s/^.*@//` if [ "$DOMAIN" = "operaciones.qnet.com.pe" ]; then export USERDB_AUTOCREATE=INBOX.Spam export USERDB_AUTOSUBSCRIBE=INBOX.Spam export USERDB_EXPIRE="INBOX.Spam 1 INBOX.Spam.* 1" export USERDB_EXPIRE_DICT="proxy::expire" export EXTRA="USERDB_AUTOCREATE USERDB_AUTOSUBSCRIBE USERDB_EXPIRE USERDB_EXPIRE_DICT" fi unset USER exec $* In the database no problem mysql> select * from expires; +---+--+ | mailbox | expire_stamp | +---+--+ | jma...@operaciones.qnet.com.pe/INBOX.Spam | 1255701608 | +---+--+ 1 row in set (0.00 sec) But when you run the command /usr/local/sbin/dovecot --exec-mail ext /usr/local/libexec/dovecot/expire-tool --test Displays the following message Fatal: expire and expire_altmove settings not set That may be happening? Thanks Jose Luis dovecot -n # 1.1.16: /usr/local/etc/dovecot.conf # OS: Linux 2.6.9-67.0.15.plus.c4smp i686 CentOS release 4.6 (Final) log_path: /var/log/dovecot.log listen: *:10143 ssl_listen: *:10943 disable_plaintext_auth: no login_dir: /usr/local/var/run/dovecot/login login_executable: /usr/local/libexec/dovecot/imap-login first_valid_uid: 89 last_valid_uid: 89 first_valid_gid: 89 last_valid_gid: 89 mail_uid: 89 mail_gid: 89 mail_location: maildir:~/Maildir mail_debug: yes mail_plugins: quota imap_quota expire mail_log autocreate namespace: type: private separator: . prefix: INBOX. inbox: yes list: yes subscriptions: yes auth default: debug: yes passdb: driver: checkpassword args: /usr/vpopmail/bin/vchkpw /usr/local/bin/vchkpw-wrapper.sh userdb: driver: prefetch args: uid=89 gid=89 home=/usr/vpopmail/domains/%d/%u userdb: driver: vpopmail socket: type: listen master: path: /usr/local/var/run/dovecot/auth-master mode: 384 user: vpopmail group: vchkpw plugin: quota: maildir quota_rule: ?:storage=0 quota_rule2: Trash:ignore expire_dict: proxy::expire mail_log_events: delete undelete expunge copy mailbox_delete mail_log_group_events: mail_log_fields: uid box msgid size dict: expire: mysql:/usr/local/etc/dovecot-dict-expire.conf _ Discover the new Windows Vista http://search.msn.com/results.aspx?q=windows+vista&mkt=en-US&form=QBRE
Re: [Dovecot] Error: NO Mailbox is locked
On Tue, 2009-10-13 at 14:55 +0200, Giovanni Mancuso wrote: > i migrate an imap server from courier-imap to dovecot 1.1.13. After the > migration i have often this error in imap communication: > > * NO Mailbox is locked, will abort in 122 seconds > * NO Mailbox is locked, will abort in 92 seconds Anything in Dovecot's error logs (http://wiki.dovecot.org/Logging)? How large are these maildirs where it happens? signature.asc Description: This is a digitally signed message part
Re: [Dovecot] Dovecot lock problem
On Tue, 2009-10-13 at 11:37 -0700, Simon Gao wrote: > We have a few users experiencing locking problem. When starting > Thunderbird, there is no new emails in Inbox. Dovecot createa a lock file > /var/spool/mail/.lock. It never completes openning Inbox. If closing > the mail client, the open imap session does not get closed, nor the lock > file get deleted. What is the process doing? Check with "strace -p "? How large is the user's mailbox? > Here are the errors in log: > > dovecot: Oct 13 11:18:35 Warning: IMAP(user1): Our dotlock file > /var/mail/user1.lock was deleted (kept it 88 secs) > dovecot: Oct 13 11:18:35 Error: IMAP(user1): file_dotlock_delete() > failed with mbox file /var/mail/user1: No such file or directory I'd guess this is a huge mbox (or your disk I/O is very slow) and Dovecot takes a long time trying to read it. mbox_very_dirty_syncs=yes may be helpful. signature.asc Description: This is a digitally signed message part
Re: [Dovecot] master:Error @2.0 TLS login, "Too large auth data_size sent"
easier said than done ...
On Thu, Oct 15, 2009 at 2:51 PM, PGNet Dev wrote:
> yes. will post in a moment ...
service dovecot-custom stop
rm -rf /usr/local/etc/mail/dovecot
rm -rf /usr/local/include/dovecot
rm -rf /usr/local/lib/dovecot
rm -rf /usr/local/libexec/dovecot
rm -rf /usr/local/share/doc/dovecot
rm -f /usr/local/sbin/dovecot*
cd /usr/local/src/dovecot-2.0
rm config.cache
hg pull
hg update
hg log | head -n 7
changeset: 10074:1d2d55d9779e
branch: HEAD
tag: tip
user:Timo Sirainen
date:Thu Oct 15 16:18:58 2009 -0400
summary: example-config: Updated listen setting's comment.
make distclean
./autogen.sh
./configure ...
make
make install
> Run "ulimit -c unlimited" before starting
> dovecot, then it should write core file to user's home directory.
> http://dovecot.org/bugreport.html
* Dovecot must have been started without core dump size limit
being too low. Run ulimit -c unlimited before starting Dovecot.
hm, already @ unlimited,
bash -c ulimit
unlimited
ah, tcsh-ism,
limit coredumpsize
coredumpsize 0 kbytes
limit coredumpsize unlimited
coredumpsize unlimited
in master.conf
...
service imap {
protocol = imap
executable= gdbhelper
/usr/local/libexec/dovecot/imap
...
* Set mail_drop_priv_before_exec = yes in config file.
ok, so where's this go now? if in mail.conf,
dovecot -n
# 2.0.alpha1: /data/mail/Conf/dovecot/dovecot.conf
doveconf: Fatal: Error in configuration file
/data/mail/Conf/dovecot/conf.d/mail.conf line 21: Unknown setting:
mail_drop_priv_before_exec
* Linux: Make sure /proc/sys/kernel/core_pattern contains a proper
value. By giving an absolute path to it (e.g. /var/core/%p) the users
don't need a home directory.
cat /proc/sys/kernel/core_pattern
core
but @ startup,
tail -f /var/log/{dove*/dove*,messages}
==> /var/log/dovecot/dovecot.log <==
Oct 15 09:07:33 master: Info: Dovecot v2.0.alpha1 starting up (core
dumps disabled)
how do i enable coredumps?
Re: [Dovecot] v2.0.alpha1 released
On Thu, 2009-10-15 at 23:56 +0100, Ed W wrote: > I'm currently having problems with my vpn when using a UK "Three" SIM. > I haven't fully investigated, but I *think* it's because the IP changes > regularly even while the connection is up and in progress? I think this > setup is rare, but exists (on some broadband connections also > apparently?). I actually think that in this situation all the tcp > connections *should* die...? Not necessarily. Laptops don't kill existing WiFi connections when RJ45 is plugged into them. Perhaps mobile phones can also use 3G for some connections and when WiFi shows up starts using them for the new connections. Why should it kill any existing connections in those situations? As for IP changing in 3G-only traffic.. Is it that much different from the above? I wouldn't ever want existing connections to be killed. > I think the main cases to optimise for are a) mobile users behind a NAT, > b) users possibly leaving one desktop machine on broadband, but checking > the same account via a mobile device (same login). I think this coverst > the 90% situation? I think including only username in the hash works nicely for just about everyone. I now committed the code: http://hg.dovecot.org/dovecot-1.2/rev/373b22cbabac signature.asc Description: This is a digitally signed message part
Re: [Dovecot] 1.2.6 Spurious pread()/stream errors/index corruption
Great I'm not going MAD! :) I'll get to work! On Thu, 15 Oct 2009 18:59:50 -0400, Timo Sirainen wrote: > On Thu, 2009-10-15 at 23:45 +0100, Paul Freeman wrote: >> //#define HAVE_PREAD 1 >> #define PREAD_BROKEN >> //#define PREAD_WRAPPERS >> >> nm dovecot|grep pread >> U my_pread@@libmysqlclient_16 > > Oh! libmysqlclient messes this up. Why is your dovecot binary (and other > binaries) linked against libmysqlclient? That's not normal. > > I did fix this in v2.0 though, the patch probably applies to v1.2 too: > http://hg.dovecot.org/dovecot-2.0/rev/910059d94bbc
Re: [Dovecot] 1.2.6 Spurious pread()/stream errors/index corruption
On Thu, 2009-10-15 at 23:45 +0100, Paul Freeman wrote: > //#define HAVE_PREAD 1 > #define PREAD_BROKEN > //#define PREAD_WRAPPERS > > nm dovecot|grep pread > U my_pread@@libmysqlclient_16 Oh! libmysqlclient messes this up. Why is your dovecot binary (and other binaries) linked against libmysqlclient? That's not normal. I did fix this in v2.0 though, the patch probably applies to v1.2 too: http://hg.dovecot.org/dovecot-2.0/rev/910059d94bbc signature.asc Description: This is a digitally signed message part
Re: [Dovecot] v2.0.alpha1 released
Timo Sirainen wrote: On Wed, 2009-10-14 at 00:14 +0100, Ed W wrote: next_still_here_sending_timestamp = imap_idle_notify_interval - (time(NULL) + crc32(username)) % imap_idle_notify_interval; The username CRC32 is there to avoid network/load spikes when all the processes try to send the "Still here" at the same time. Just to kick this around a bit - I guess it's possible for one username to be logged in on three different computers (eg I have several laptops with identical config and sometimes several of them are on at once). On the other hand my original idea was to compromise on "hashing" by IP address, this is obviously wrong in the sense that frequently multiple users are behind large NAT ranges, especially if they are on some sort of WAN connection And it's especially bad if Dovecot is run behind proxy and doesn't know anyone's IP address. I think under the most useful scenario of 3G/wifi networks, it's practically a given that there is a NAT involved... However, I guess for maximum polish it would be optimal to hash based on both username and ip address? This would appear to be useful in your algorithm above anyway though? I'm just wondering if some mobile networks can give you different IPs for different connections, like when you open first connection in area X and then move around to area Y and open another connection it gives you a new IP, but still keeps the old connections working? In that situation adding IP to the hash wouldn't be a good idea. I'm currently having problems with my vpn when using a UK "Three" SIM. I haven't fully investigated, but I *think* it's because the IP changes regularly even while the connection is up and in progress? I think this setup is rare, but exists (on some broadband connections also apparently?). I actually think that in this situation all the tcp connections *should* die...? One of the problems I have been having is that with Thunderbird, assuming the IP *is* changing (not tested), it seems like my end of the link is continuing as though the connection is alive and the far end is obviously treating me as a new connection and the end result is a bunch of errors "server is not an IMAP4 server". So my (unfounded) guess is that if the IP changes on you quietly, then actually the TCP connection will eventually fall apart and this is not a problem worth tracking on the dovecot side? I think the main cases to optimise for are a) mobile users behind a NAT, b) users possibly leaving one desktop machine on broadband, but checking the same account via a mobile device (same login). I think this coverst the 90% situation? Ed W
Re: [Dovecot] MailDIR and expire plugin
On Thu, 15 Oct 2009 18:10:58 -0400 Timo Sirainen wrote: > On Thu, 2009-10-15 at 06:10 -0400, Jerry wrote: > > All of the mailboxes on this system are in MailDIR format. None of > > the users delete mail off of the server after POPing their accounts. > > This is the present setting: > > > > expire = Trash 7 Spam 30 > > expire_dict = proxy::expire > > > > Is that correct for MailDIR style mailboxes? > > Hmm. Maybe I misunderstood what you mean. What exactly is it that you > want? You have only POP3 users, which only have their INBOX? So they > don't really have any Trash or Spam folders? And you just want to > delete old mails from their INBOX? In that case, use something like: > > expire = INBOX 30 Now that makes more sense. I thought it might be something like that; however, I could not find any definitive documentation on it. -- Jerry |=== ges...@yahoo.com|=== |=== |=== | To get something clean, one has to get something dirty. To get something dirty, one does not have to get anything clean.
Re: [Dovecot] 1.2.6 Spurious pread()/stream errors/index corruption
#define HAVE_PREAD 1 /* #undef PREAD_BROKEN */ #define PREAD_WRAPPERS /**/ nm dovecot|grep pread U my_pread@@libmysqlclient_16 //#define HAVE_PREAD 1 #define PREAD_BROKEN //#define PREAD_WRAPPERS nm dovecot|grep pread U my_pread@@libmysqlclient_16 On Thu, 15 Oct 2009 18:02:02 -0400, Timo Sirainen wrote: > On Thu, 2009-10-15 at 21:08 +0100, Paul Freeman wrote: >> in both builds file offset bits is 64, with config.h: >> >> config.h check... >> /* Define to 1 if you have the `pread' function. */ >> /* Defint if pread/pwrite implementation is broken */ >> #define PREAD_BROKEN 1 >> /* Define if pread/pwrite needs _XOPEN_SOURCE 500 */ > > This is with Linux defaults: > > ~/cvs/dovecot-1.2% grep PREAD config.h > #define HAVE_PREAD 1 > /* #undef PREAD_BROKEN */ > #define PREAD_WRAPPERS /**/ > > ~/cvs/dovecot-1.2/src/master% nm dovecot|grep pread > 080685a0 T my_pread > U pread64@@GLIBC_2.1 > > This is with pread() disabled: > > ~/cvs/dovecot-1.2/% grep PREAD config.h > //#define HAVE_PREAD 1 > #define PREAD_BROKEN > //#define PREAD_WRAPPERS /**/ > > ~/cvs/dovecot-1.2/src/master% nm dovecot|grep pread > 0806ade0 T my_pread > > Note how there's no pread64@@GLIBC_2.1 symbol at all. What about in your > binaries?
Re: [Dovecot] Questions regarding dbox migration
On Fri, 2009-10-16 at 00:24 +0200, Mikkel wrote: > > It doesn't matter what the user's full mailbox size is. It matters how > > many of these max. ~2 MB dbox files have expunged messages. Typically > > users would expunge only new mails, so typically there would be only a > > single file that needs to be recreated. > > > > That way it seems pretty clever. But if the number of messages in each > mdbox file (we are talking about multi-dox and not single-dbox right?) > is configurable via mdbox_rotate_size (ranging from 1 to infinity I > guess) then how can you assume that each file is no more than ~2 MB? The default is 2 MB, and whoever sets it larger deserves what they get (for better or worse). > >> dovecot: Oct 01 15:13:57 Error: IMAP(another_acco...@domain): > Corrupted > >> transaction log file /local/another_homedir/Maildir/dovecot.index.log > >> seq 229: duplicate transaction log sequence (229) (sync_offset=32860) > > > Anyway do you think that dovecot would be able to recover from that kind > of error without loss of information if dbox/mdbox where used instead of > Maildir? Well, it marks it corrupted so it loses some state. But I guess I could change the code to not mark it corrupted but instead just fail. Then it wouldn't lose anything. signature.asc Description: This is a digitally signed message part
Re: [Dovecot] Questions regarding dbox migration
Timo Sirainen skrev: > On Thu, 2009-10-15 at 10:55 +0200, Mikkel wrote: >> Some users would have mailboxes a several hundred megabytes and having >> to recreate thousands of these every night because of a single mail >> getting expunged a day could result in a huge performance hit. > > It doesn't matter what the user's full mailbox size is. It matters how > many of these max. ~2 MB dbox files have expunged messages. Typically > users would expunge only new mails, so typically there would be only a > single file that needs to be recreated. > That way it seems pretty clever. But if the number of messages in each mdbox file (we are talking about multi-dox and not single-dbox right?) is configurable via mdbox_rotate_size (ranging from 1 to infinity I guess) then how can you assume that each file is no more than ~2 MB? >> dovecot: Oct 01 15:13:57 Error: IMAP(another_acco...@domain): Corrupted >> transaction log file /local/another_homedir/Maildir/dovecot.index.log >> seq 229: duplicate transaction log sequence (229) (sync_offset=32860) > > Hmm. This means that Dovecot thought that dovecot.index.log file was > rotated, but when it reopened it it actually had the same sequence > number in the header. What NFS server are you using? One possible reason > for this is if file's inode number suddenly changes. I'm using a NAS appliance (Sun S7410) that is basically just a modified Solaris 10 NFS server on x86 hardware (AMD). The system has had some stability issues and therefore it's difficult to tell whether that specific error happened during normal operation or if it's just a special case. The client also runs Solaris 10 but this is the Sparc version. Solaris uses NFSv4 as default (and I haven't changed this). Anyway do you think that dovecot would be able to recover from that kind of error without loss of information if dbox/mdbox where used instead of Maildir? Regards, Mikkel
Re: [Dovecot] Another 1.2.5 imap panic
Timo Sirainen wrote: >> The panic was >>> Oct 03 13:34:20 IMAP 6067 134.225.1.46 : Panic: file >>> istream-raw-mbox.c: line 578 (istream_raw_mbox_get_body_size): assertion >>> failed: (rstream->body_offset != (uoff_t)-1) > > So it has only happened twice now in total? I've seen this before but > I'm not really sure how it can happen. I guess something strange in mbox > file causes it. But finding its cause is probably a lot of trouble, so > for now I'll just ignore it. :) > Just twice in over 1.5 million logins by over 14,000 users since the beginning of October, occurring within 12 hours of each other (but different users) at a weekend when things are supposed to be less busy... Recreating the mbox files may be just about possible (I can retrieve the last backup plus the mail deliveries since then, then plus try to do the same deletes/purges as suggested in the logs) but as you say, probably not worth it :) Best Wishes, Chris -- --+---+---+---+---+---+---+---+---+---+---+---+---+---+---+---+---+---+- Christopher Wakelin, c.d.wake...@reading.ac.uk IT Services Centre, The University of Reading, Tel: +44 (0)118 378 8439 Whiteknights, Reading, RG6 2AF, UK Fax: +44 (0)118 975 3094
Re: [Dovecot] v2.0.alpha1 released
On Wed, 2009-10-14 at 00:14 +0100, Ed W wrote: > > next_still_here_sending_timestamp = imap_idle_notify_interval - > > (time(NULL) + crc32(username)) % imap_idle_notify_interval; > > > > The username CRC32 is there to avoid network/load spikes when all the > > processes try to send the "Still here" at the same time. > > > Just to kick this around a bit - I guess it's possible for one username > to be logged in on three different computers (eg I have several laptops > with identical config and sometimes several of them are on at once). On > the other hand my original idea was to compromise on "hashing" by IP > address, this is obviously wrong in the sense that frequently multiple > users are behind large NAT ranges, especially if they are on some sort > of WAN connection And it's especially bad if Dovecot is run behind proxy and doesn't know anyone's IP address. > However, I guess for maximum polish it would be optimal to hash based on > both username and ip address? This would appear to be useful in your > algorithm above anyway though? I'm just wondering if some mobile networks can give you different IPs for different connections, like when you open first connection in area X and then move around to area Y and open another connection it gives you a new IP, but still keeps the old connections working? In that situation adding IP to the hash wouldn't be a good idea. signature.asc Description: This is a digitally signed message part
Re: [Dovecot] MailDIR and expire plugin
On Thu, 2009-10-15 at 06:10 -0400, Jerry wrote: > All of the mailboxes on this system are in MailDIR format. None of > the users delete mail off of the server after POPing their accounts. > This is the present setting: > > expire = Trash 7 Spam 30 > expire_dict = proxy::expire > > Is that correct for MailDIR style mailboxes? Hmm. Maybe I misunderstood what you mean. What exactly is it that you want? You have only POP3 users, which only have their INBOX? So they don't really have any Trash or Spam folders? And you just want to delete old mails from their INBOX? In that case, use something like: expire = INBOX 30 signature.asc Description: This is a digitally signed message part
Re: [Dovecot] Dovecot 1.2.6 segfault in imap_fetch_begin
On Thu, 2009-10-15 at 18:05 -0400, Timo Sirainen wrote: > On Thu, 2009-10-15 at 13:06 -0700, Brandon Davidson wrote: > > Yes, we've got a pool of servers with Maildir on NFS with quotas > > enabled. Occasionally the users will run out of space and the indexes > > will get corrupted or out of sync. Our Helpdesk staff will increase > > their quota or help them delete things, and Dovecot logs a stream of " > > Expunged message reappeared" and "Duplicate file entry" messages as it > > straightens things out. This is a fairly common occurrence given the > > size of our user base, so I'm assuming this is the root cause... but > > this is the first time I've seen Dovecot crash as a result. > > Well, none of that should be happening.. Oh, actually, that's about dovecot-uidlist files. They don't like much if writing fails. Although I'm still not sure if those types of errors should be happening.. signature.asc Description: This is a digitally signed message part
Re: [Dovecot] Dovecot 1.2.6 segfault in imap_fetch_begin
On Thu, 2009-10-15 at 13:06 -0700, Brandon Davidson wrote: > Yes, we've got a pool of servers with Maildir on NFS with quotas > enabled. Occasionally the users will run out of space and the indexes > will get corrupted or out of sync. Our Helpdesk staff will increase > their quota or help them delete things, and Dovecot logs a stream of " > Expunged message reappeared" and "Duplicate file entry" messages as it > straightens things out. This is a fairly common occurrence given the > size of our user base, so I'm assuming this is the root cause... but > this is the first time I've seen Dovecot crash as a result. Well, none of that should be happening.. I guess I'll try some day again how random write failures to indexes will behave and if I can reproduce any of this. I last tried that with v1.0 or v1.1 and fixed all the related bugs. signature.asc Description: This is a digitally signed message part
Re: [Dovecot] 1.2.6 Spurious pread()/stream errors/index corruption
On Thu, 2009-10-15 at 21:08 +0100, Paul Freeman wrote: > in both builds file offset bits is 64, with config.h: > > config.h check... > /* Define to 1 if you have the `pread' function. */ > /* Defint if pread/pwrite implementation is broken */ > #define PREAD_BROKEN 1 > /* Define if pread/pwrite needs _XOPEN_SOURCE 500 */ This is with Linux defaults: ~/cvs/dovecot-1.2% grep PREAD config.h #define HAVE_PREAD 1 /* #undef PREAD_BROKEN */ #define PREAD_WRAPPERS /**/ ~/cvs/dovecot-1.2/src/master% nm dovecot|grep pread 080685a0 T my_pread U pread64@@GLIBC_2.1 This is with pread() disabled: ~/cvs/dovecot-1.2/% grep PREAD config.h //#define HAVE_PREAD 1 #define PREAD_BROKEN //#define PREAD_WRAPPERS /**/ ~/cvs/dovecot-1.2/src/master% nm dovecot|grep pread 0806ade0 T my_pread Note how there's no pread64@@GLIBC_2.1 symbol at all. What about in your binaries? signature.asc Description: This is a digitally signed message part
Re: [Dovecot] Another 1.2.5 imap panic
On Thu, 2009-10-15 at 21:14 +0100, Chris Wakelin wrote: > Hi Timo, > > While we're on the subject of panics and segfaults before 1.2.7, did you > get a chance to look at this one? It's not happened since those two > users, so it's not at all important except perhaps for tidiness! > > The panic was > > Oct 03 13:34:20 IMAP 6067 134.225.1.46 : Panic: file > > istream-raw-mbox.c: line 578 (istream_raw_mbox_get_body_size): assertion > > failed: (rstream->body_offset != (uoff_t)-1) So it has only happened twice now in total? I've seen this before but I'm not really sure how it can happen. I guess something strange in mbox file causes it. But finding its cause is probably a lot of trouble, so for now I'll just ignore it. :) signature.asc Description: This is a digitally signed message part
Re: [Dovecot] master:Error @2.0 TLS login, "Too large auth data_size sent"
On Thu, Oct 15, 2009 at 2:46 PM, Timo Sirainen wrote: > you didn't recompile/reinstall all binaries. hrm. though i did ... that's what the "reboot system, clean house, re-pull and re-build all ..." was about. trying again ... > Can you get gdb backtrace? Run "ulimit -c unlimited" before starting > dovecot, then it should write core file to user's home directory. > http://dovecot.org/bugreport.html yes. will post in a moment ...
Re: [Dovecot] Per User Quotas
On Thu, 2009-10-15 at 16:15 -0500, Peter Fraser wrote: > When I log in as that user, and check the quota, I'm still seeing 512 MB > > Very strange. auth_debug=yes, mail_debug=yes makes Dovecot log exactly what it's doing. No point in guessing what the problem is. signature.asc Description: This is a digitally signed message part
Re: [Dovecot] master:Error @2.0 TLS login, "Too large auth data_size sent"
On Thu, 2009-10-15 at 14:40 -0700, PGNet Dev wrote: > On Thu, Oct 15, 2009 at 2:10 PM, PGNet Dev > wrote: > > I'm rewriting this part of the code anyway. Maybe it works afterwards. > > hm ... i was able to keep reproducing what i saw before. but, things > change a bit if i reboot system, clean house, re-pull and re-build > all ... Oh, right, it most likely was because of http://hg.dovecot.org/dovecot-2.0/rev/aa30fc7d771a and you didn't recompile/reinstall all binaries. > inbox=/data/mail/MailStore/Dovecot/Domains/my.domain.com/Accounts/testuser > Oct 15 07:30:46 master: Error: service(imap): child 9653 killed with > signal 11 (core dumps disabled) Can you get gdb backtrace? Run "ulimit -c unlimited" before starting dovecot, then it should write core file to user's home directory. http://dovecot.org/bugreport.html signature.asc Description: This is a digitally signed message part
Re: [Dovecot] master:Error @2.0 TLS login, "Too large auth data_size sent"
On Thu, Oct 15, 2009 at 2:10 PM, PGNet Dev wrote: > I'm rewriting this part of the code anyway. Maybe it works afterwards. hm ... i was able to keep reproducing what i saw before. but, things change a bit if i reboot system, clean house, re-pull and re-build all ... service dovecot-custom restart ps ax | grep dovecot 9628 pts/2S<+0:00 tail -f /var/log/dovecot/dovecot.log /var/log/messages 9682 ?S /var/log/dovecot/dovecot.log <== Oct 15 07:30:46 master: Warning: Killed with signal 15 (by pid=9672 uid=0 code=kill) Oct 15 07:30:46 master: Info: Dovecot v2.0.alpha1 starting up (core dumps disabled) Oct 15 07:30:46 imap-login: Info: Login: user=, method=PLAIN, rip=192.168.1.4, lip=192.168.1.14, TLS Oct 15 07:30:46 IMAP(testu...@my.domain.com): Info: Loading modules from directory: /usr/local/lib/dovecot Oct 15 07:30:46 IMAP(testu...@my.domain.com): Info: Module loaded: /usr/local/lib/dovecot/lib10_quota_plugin.so Oct 15 07:30:46 IMAP(testu...@my.domain.com): Info: Module loaded: /usr/local/lib/dovecot/lib11_imap_quota_plugin.so Oct 15 07:30:46 IMAP(testu...@my.domain.com): Info: Module loaded: /usr/local/lib/dovecot/lib20_autocreate_plugin.so Oct 15 07:30:46 IMAP(testu...@my.domain.com): Info: Module loaded: /usr/local/lib/dovecot/lib20_fts_plugin.so Oct 15 07:30:46 IMAP(testu...@my.domain.com): Info: Module loaded: /usr/local/lib/dovecot/lib20_zlib_plugin.so Oct 15 07:30:46 IMAP(testu...@my.domain.com): Info: Module loaded: /usr/local/lib/dovecot/lib21_fts_solr_plugin.so Oct 15 07:30:46 IMAP(testu...@my.domain.com): Info: Module loaded: /usr/local/lib/dovecot/lib21_fts_squat_plugin.so Oct 15 07:30:46 IMAP(testu...@my.domain.com): Info: Effective uid=1001, gid=1000, home=/data/mail/MailStore/Dovecot/Domains/my.domain.com/Accounts/testuser Oct 15 07:30:46 IMAP(testu...@my.domain.com): Info: Quota root: name=storage=10240 backend=maildir args= Oct 15 07:30:46 IMAP(testu...@my.domain.com): Info: Namespace: type=private, prefix=, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=yes Oct 15 07:30:46 IMAP(testu...@my.domain.com): Info: fs: root=/data/mail/MailStore/Dovecot/Domains/my.domain.com/Accounts/testuser, index=, control=, inbox=/data/mail/MailStore/Dovecot/Domains/my.domain.com/Accounts/testuser Oct 15 07:30:46 master: Error: service(imap): child 9653 killed with signal 11 (core dumps disabled) ==> /var/log/messages <== Oct 15 07:30:46 mx kernel: imap[9653]: segfault at 0 ip 7f8239440133 sp 7fff4fd3ee10 error 4 in lib10_quota_plugin.so[7f8239436000+e000] ps ax | grep dovecot 9619 ?S
Re: [Dovecot] Per User Quotas
Ok thanks I tried your config. Just edited to my my setup.
This is what I now have
dovecot.conf
---
passdb ldap {
args = /usr/local/etc/dovecot-ldap.conf
}
userdb ldap {
args = /usr/local/etc/dovecot-ldap-userdb.conf
}
userdb static {
args = uid=1002 gid=1002 home=/home/vmail/%u allow_all_users=yes
}
---
dovecot-ldap.conf
---
hosts = 192.168.0.97 192.168.0.76
base = dc=atlas,dc=local
auth_bind = yes
auth_bind_userdn = atlas\%u
#auth_bind_userdn = atlas\%u
user_filter = (&(objectClass=person)(cn=%u))
user_attrs = homeDirectory=home=/home/vmail/%u,description=quota_rule=*:bytes=%$
--
dovecot-ldap-userdb.conf
---
hosts = 192.168.0.97 192.168.0.76
base = dc=atlas,dc=local
ldap_version = 3
auth_bind = no
dn = atlas\user
dnpass = password
user_filter = (&(objectClass=person)(userprincipalname...@atlas.local))
user_attrs = description=quota_rule=*:bytes=%$
And of course, I put in a users description field in Active Directory
*:bytes=%1024
When I log in as that user, and check the quota, I'm still seeing 512 MB
Very strange.
Re: [Dovecot] master:Error @2.0 TLS login, "Too large auth data_size sent"
On Thu, Oct 15, 2009 at 2:02 PM, Timo Sirainen wrote: >> Oct 15 11:22:35 master: Error: service(imap-login): Too large auth >> data_size sent > > Every time? at the moment, yes. unfortunately, i can't tell you with which recent update it appeared -- or it i had simply not noticed due to other warning/errors. > I can't really think of why, but I'm rewriting this part of > the code anyway. Maybe it works afterwards. ok. i'll keep an eye on hg ...
Re: [Dovecot] master:Error @2.0 TLS login, "Too large auth data_size sent"
On Thu, 2009-10-15 at 13:45 -0700, PGNet Dev wrote: > @ LOGIN via Tbird ... > > Oct 15 11:22:35 master: Error: service(imap-login): Too large auth > data_size sent Every time? I can't really think of why, but I'm rewriting this part of the code anyway. Maybe it works afterwards. signature.asc Description: This is a digitally signed message part
[Dovecot] master:Error @2.0 TLS login, "Too large auth data_size sent"
fyi, hg log | head -n 7 | grep changeset changeset: 10074:1d2d55d9779e @ LOGIN via Tbird ... Oct 15 11:22:35 master: Error: service(imap-login): Too large auth data_size sent Oct 15 11:22:35 imap-login: Info: Disconnected: Shutting down (auth failed, 1 attempts): user=, method=PLAIN, rip=192.168.1.4, lip=192.168.1.14, TLS
Re: [Dovecot] Another 1.2.5 imap panic
Hi Timo, While we're on the subject of panics and segfaults before 1.2.7, did you get a chance to look at this one? It's not happened since those two users, so it's not at all important except perhaps for tidiness! The panic was > Oct 03 13:34:20 IMAP 6067 134.225.1.46 : Panic: file > istream-raw-mbox.c: line 578 (istream_raw_mbox_get_body_size): assertion > failed: (rstream->body_offset != (uoff_t)-1) Best Wishes, Chris Chris Wakelin wrote: > > Chris Wakelin wrote: >> We've had another random imap process crash. This is with the original >> 1.2.5 imap (I haven't applied the patch for two processes creating an >> index simultaneously): >> >> Backtrace: > > Sorry, wrong binary again (it *was* rather late at night!). Here's the > proper backtrace > >> #0 0xff21fe78 in _libc_kill () from /usr/lib/libc.so.1 >> #1 0xff1b5a3c in abort () from /usr/lib/libc.so.1 >> #2 0xbe258 in default_fatal_finish (type=LOG_TYPE_PANIC, status=0) at >> failures.c:160 >> #3 0xbeb14 in i_internal_fatal_handler (type=LOG_TYPE_PANIC, status=0, >> fmt=0x0, args=0xffbee9c8) at failures.c:440 >> #4 0xbe414 in i_panic (format=0xe29b8 "file %s: line %d (%s): assertion >> failed: (%s)") at failures.c:207 >> #5 0x5a238 in istream_raw_mbox_get_body_size (stream=0x12a250, >> expected_body_size=18446744073709551615) at istream-raw-mbox.c:621 >> #6 0x5a4d8 in istream_raw_mbox_next (stream=0x12a250, >> expected_body_size=18428424857071839939) at istream-raw-mbox.c:665 >> #7 0x5a7a0 in istream_raw_mbox_seek (stream=0x0, offset=523301) at >> istream-raw-mbox.c:704 >> #8 0x5ae58 in mbox_file_seek (mbox=0x1272a8, view=0x127c60, seq=17, >> deleted_r=0xffbeebb7) at mbox-file.c:177 >> #9 0x5c7d8 in mbox_mail_seek (mail=0x12be80) at mbox-mail.c:85 >> #10 0x5cd74 in mbox_mail_init_stream (mail=0x12be80) at mbox-mail.c:276 >> #11 0x5cea4 in mbox_mail_get_stream (_mail=0x128e24, hdr_size=0x0, >> body_size=0x0, stream_r=0xffbeed8c) at mbox-mail.c:318 >> #12 0x79354 in mail_get_stream (mail=0x0, hdr_size=0x0, body_size=0x0, >> stream_r=0xffbeed8c) at mail.c:168 >> #13 0x6a958 in index_mail_set_seq (_mail=0x12be80, seq=17) at >> index-mail.c:1326 >> #14 0x5ced0 in mbox_mail_set_seq (_mail=0x12be80, seq=17) at mbox-mail.c:329 >> #15 0x79034 in mail_set_seq (mail=0x12be80, seq=17) at mail.c:29 >> #16 0x6f864 in index_storage_search_next_nonblock (_ctx=0x12a070, >> mail=0x12be80, tryagain_r=0xffbeefcf) at index-search.c:1296 >> #17 0x7f1a0 in mailbox_search_next_nonblock (ctx=0x12a070, mail=0x12be80, >> tryagain_r=0xffbeefcf) at mail-storage.c:770 >> #18 0x7f154 in mailbox_search_next (ctx=0x12a070, mail=0x12be80) at >> mail-storage.c:759 >> #19 0x2598c in fetch_and_copy (client=0x11e8d8, destbox=0x1272a8, >> t=0x128c98, search_args=0x1, src_uidset_r=0xffbef0f4, >> copy_count_r=0xffbef0f0) >> at cmd-copy.c:56 >> #20 0x25c24 in cmd_copy (cmd=0x11eb60) at cmd-copy.c:145 >> #21 0x2d064 in client_command_input (cmd=0x11eb60) at client.c:611 >> #22 0x2cf08 in client_command_input (cmd=0x11eb60) at client.c:660 >> #23 0x2d0ec in client_handle_next_command (client=0x11e8d8, >> remove_io_r=0xffbef2d7) at client.c:701 >> #24 0x2d1e0 in client_handle_input (client=0x11e8d8) at client.c:713 >> #25 0x2d318 in client_input (client=0x11e8d8) at client.c:752 >> #26 0xc7ea4 in io_loop_handler_run (ioloop=0x11b370) at ioloop-poll.c:203 >> #27 0xc7694 in io_loop_run (ioloop=0x11b370) at ioloop.c:335 >> #28 0x36e34 in main (argc=1119232, argv=0xffbef51c, envp=0xffbef52c) at >> main.c:327 > > I've had another crash since with a different user but what looks like > exactly the same backtrace (except for stream numbers etc.). > > Best Wishes, > Chris > -- --+---+---+---+---+---+---+---+---+---+---+---+---+---+---+---+---+---+- Christopher Wakelin, c.d.wake...@reading.ac.uk IT Services Centre, The University of Reading, Tel: +44 (0)118 378 8439 Whiteknights, Reading, RG6 2AF, UK Fax: +44 (0)118 975 3094
Re: [Dovecot] 1.2.6 Spurious pread()/stream errors/index corruption
OK I'm still getting the same errors, so just as a test I tried the same process on an x86_32 build host, it's binaries now give a different error, one which I have also seen mentioned before I think: banshee-x86-32 / # /NOC4/dovecot/sbin/dovecot -F Error: Missing auth section for server default Fatal: Invalid configuration in /NOC4/etc/dovecot/dovecot.conf - I do notice this though, with x86_64 binaries strace shows calls to pread() with x86_32 binaries strace shows calls to pread64() this looks round the wrong way? hmm in both builds file offset bits is 64, with config.h: config.h check... /* Define to 1 if you have the `pread' function. */ /* Defint if pread/pwrite implementation is broken */ #define PREAD_BROKEN 1 /* Define if pread/pwrite needs _XOPEN_SOURCE 500 */ On Thu, 15 Oct 2009 15:33:47 -0400, Timo Sirainen wrote: > On Thu, 2009-10-15 at 20:30 +0100, Paul Freeman wrote: >> banshee-x86-64 dovecot-1.2.6 # grep -i pread config.h >> /* Define to 1 if you have the `pread' function. */ >> /* #undef HAVE_PREAD */ >> /* Defint if pread/pwrite implementation is broken */ >> /* #undef PREAD_BROKEN */ >> /* Define if pread/pwrite needs _XOPEN_SOURCE 500 */ >> #define PREAD_WRAPPERS /**/ >> >> i'll give PREAD_BROKEN a try now > > And remove PREAD_WRAPPERS if that doesn't work. It shouldn't matter > though.
Re: [Dovecot] Per User Quotas
Hi Peter,
this is my working dovecot-configuration:
Dovecot 1.2.4
dovecot.conf (extract)
--
username_translation: @_._
passdb:
driver: ldap
args: /etc/dovecot-ldap.conf
userdb:
driver: ldap
args: /etc/dovecot-ldap-userdb.conf
userdb:
driver: static
args: uid=500 gid=500 home=/home/vmail/%Lu allow_all_users=yes
dovecot-ldap.conf
---
hosts = 1.2.3.4 1.2.3.5
base = DC=first,DC=bank,DC=com
ldap_version = 3
auth_bind = yes
auth_bind_userdn = %...@first.bank.com
user_filter = (&(objectClass=person)(cn=%u))
user_attrs =
homeDirectory=home=/home/vmail/%Lu,description=quota_rule=*:bytes=%$
dovecot-ldap-userdb.conf
---
hosts = 1.2.3.4 1.2.3.5
base = DC=first,DC=bank,DC=com
ldap_version = 3
auth_bind = no
dn =first\domain-user
dnpass = password
user_filter = (&(objectClass=person)(userprincipalname...@first.bank.com))
user_attrs = description=quota_rule=*:bytes=%$
Peter Fraser schrieb:
OK this is what I now have.
In dovecot.conf I put:
userdb ldap {
args = /usr/local/etc/dovecot-ldap.conf
}
In dovecot-ldap.conf:
hosts = 192.168.1.97
base = dc=atlas,dc=local
auth_bind = yes
scope = subtree
auth_bind_userdn = atlas\%u
user_filter = (&(objectClass=mailUser)(mail=%u))
default_pass_scheme = CRYPT
pass_filter = (&(objectclass=person)(uid=%u))
pass_attrs = userPassword=password
user_attrs = streetAddress=quota_rule=*:storage=%$M
,=uid=uid,=gid=gid,=home=/home/vmail/%u
And the quota in street address of AD
When I fire up thunderbird now, I see sending login information for a
long time before it comes up and even when it does, I still see the
general quota.
On Thu, Oct 15, 2009 at 12:40 PM, Timo Sirainen wrote:
On Thu, 2009-10-15 at 19:36 +0200, thedoghousemailcom wrote:
Hi Peter + Timo,
I think the solution is the right order in dovecot.conf:
"userdb ldap" should stand in front of "userdb static".
Well, if that's done then userdb static is used only when user isn't
found from ldap. And I guess that should normally never happen..
Re: [Dovecot] Dovecot 1.2.6 segfault in imap_fetch_begin
Hi Timo, > -Original Message- > From: Timo Sirainen [mailto:t...@iki.fi] > > This just shouldn't be happening. Are you using NFS? Anyway this should > replace the crash with a nicer error message: > http://hg.dovecot.org/dovecot-1.2/rev/6c6460531514 Yes, we've got a pool of servers with Maildir on NFS with quotas enabled. Occasionally the users will run out of space and the indexes will get corrupted or out of sync. Our Helpdesk staff will increase their quota or help them delete things, and Dovecot logs a stream of " Expunged message reappeared" and "Duplicate file entry" messages as it straightens things out. This is a fairly common occurrence given the size of our user base, so I'm assuming this is the root cause... but this is the first time I've seen Dovecot crash as a result. -Brad
Re: [Dovecot] Dovecot 1.2.6 segfault in imap_fetch_begin
On Wed, 2009-10-14 at 17:51 -0700, Brandon Davidson wrote: > Thanks! As always, you're one step ahead of us with the bug fixes! I've > got one more for you that just popped up. I'm guessing that it's also > due to expunging causing sequence numbers to mixed up, and one of the > existing patches will fix it? No, not really. > The error from the logs is: > Panic: file mail-transaction-log-view.c: line 108 > (mail_transaction_log_view_set): assertion failed: (min_file_seq <= > max_file_seq) This just shouldn't be happening. Are you using NFS? Anyway this should replace the crash with a nicer error message: http://hg.dovecot.org/dovecot-1.2/rev/6c6460531514 signature.asc Description: This is a digitally signed message part
Re: [Dovecot] v2.0.alpha1 released
On 10/13/2009 05:00 PM Odhiambo Washington wrote: > > On my FreeBSD 7.2-STABLE: > > … > mbox-from.c:240: error: wrong type argument to unary minus > … Timo has provided a few patches and fixed some issues. Since the changeset http://hg.dovecot.org/dovecot-2.0/rev/5147503f4123 Dovecot v2.0.alpha1 compiles and runs on FreeBSD 7.2. :-) Regards, Pascal -- The trapper recommends today: cafebabe.0928...@localdomain.org
Re: [Dovecot] Per User Quotas
Here they are mail# dovecot -n # 1.1.16: /usr/local/etc/dovecot.conf # OS: FreeBSD 7.2-RELEASE-p1 i386 protocols: imaps pop3s imap ssl_cert_file: /usr/local/etc/dovecot/ssl/certs/dovecot.pem ssl_key_file: /usr/local/etc/dovecot/ssl/private/dovecot.pem ssl_cipher_list: ALL:!ADH!LOW:!SSLv2:!EXP:+HIGH:+MEDIUM disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable(default): /usr/local/libexec/dovecot/imap-login login_executable(imap): /usr/local/libexec/dovecot/imap-login login_executable(pop3): /usr/local/libexec/dovecot/pop3-login login_greeting: POP3 Server ready. verbose_proctitle: yes first_valid_gid: 0 mail_access_groups: mail mail_location: maildir:~/Maildir mail_debug: yes mail_executable(default): /usr/local/libexec/dovecot/imap mail_executable(imap): /usr/local/libexec/dovecot/imap mail_executable(pop3): /usr/local/libexec/dovecot/pop3 mail_plugins(default): quota imap_quota mail_plugins(imap): quota imap_quota mail_plugins(pop3): quota mail_plugin_dir(default): /usr/local/lib/dovecot/imap mail_plugin_dir(imap): /usr/local/lib/dovecot/imap mail_plugin_dir(pop3): /usr/local/lib/dovecot/pop3 imap_client_workarounds(default): delay-newmail outlook-idle netscape-eoh tb-extra-mailbox-sep imap_client_workarounds(imap): delay-newmail outlook-idle netscape-eoh tb-extra-mailbox-sep imap_client_workarounds(pop3): pop3_client_workarounds(default): pop3_client_workarounds(imap): pop3_client_workarounds(pop3): outlook-no-nuls oe-ns-eoh auth default: username_format: %Lu debug: yes passdb: driver: pam passdb: driver: ldap args: /usr/local/etc/dovecot-ldap.conf userdb: driver: ldap args: /usr/local/etc/dovecot-ldap.conf userdb: driver: passwd plugin: quota: maildir quota2: maildir:user quota quota_rule: *:storage=512M quota_rule2: Trash:storage=10M quota_rule3: SPAM:ignore Maillog Below Oct 15 14:44:22 mail dovecot: dovecot v1.1.16 starting up Oct 15 14:44:23 mail dovecot: auth(default): new auth connection: pid=27040 Oct 15 14:44:23 mail dovecot: auth(default): new auth connection: pid=27038 Oct 15 14:44:23 mail dovecot: auth(default): new auth connection: pid=27039 Oct 15 14:44:23 mail dovecot: auth(default): new auth connection: pid=27041 Oct 15 14:44:23 mail dovecot: auth(default): new auth connection: pid=27042 Oct 15 14:44:23 mail dovecot: auth(default): new auth connection: pid=27043 Oct 15 14:45:43 mail dovecot: auth(default): new auth connection: pid=27048 Oct 15 14:45:45 mail dovecot: auth(default): client in: AUTH1 PLAIN service=imapsecured lip=192.168.1.80 rip=192.168.1. Oct 15 14:45:45 mail dovecot: auth(default): client out: CONT 1 Oct 15 14:45:45 mail dovecot: auth(default): client in: CONT Oct 15 14:45:45 mail dovecot: auth-worker(default): pam(peter.fraser,192.168.1.112): lookup service=dovecot Oct 15 14:45:45 mail dovecot: auth-worker(default): pam(peter.fraser,192.168.1.112): #1/1 style=1 msg=Password: Oct 15 14:45:45 mail dovecot: auth-worker(default): pam(peter.fraser,192.168.1.112): pam_authenticate() failed: authentication error (password Oct 15 14:45:45 mail dovecot: auth(default): client out: OK 1 user=peter.fraser Oct 15 14:45:45 mail dovecot: auth(default): master in: REQUEST 1 27043 1 Oct 15 14:45:45 mail dovecot: auth(default): ldap(peter.fraser,192.168.1.112): user search: base=dc=atlas,dc=local scope=subtree filter=(&(obj Oct 15 14:47:28 mail postfix/scache[26993]: statistics: start interval Oct 15 14:44:08 On Thu, Oct 15, 2009 at 2:25 PM, Timo Sirainen wrote: > On Thu, 2009-10-15 at 14:11 -0500, Peter Fraser wrote: >> user_attrs = streetAddress=quota_rule=*:storage=%$M >> ,=uid=uid,=gid=gid,=home=/home/vmail/%u > > The =uid=uid part looks wrong. Should be more like =uid=1000, =gid=1000. > > Anyway.. Post again dovecot -n output and also logs with auth_debug=yes > and mail_debug=yes. > >
Re: [Dovecot] MailDIR and expire plugin
On Thu, 15 Oct 2009 15:22:46 -0400 Timo Sirainen wrote: > On Thu, 2009-10-15 at 14:36 -0400, Jerry wrote: > > > > It doesn't appear correct; > > > > > > Why? > > > > > > Anyway, the important part is what does your namespace > > > configuration look like? Post your dovecot -n output. > > > > OK! > > > > # 1.2.4: /usr/local/etc/dovecot.conf > .. > > Everything looks correct. Doesn't it work? Maybe I am looking at it wrong. I have checked the SQL entries, and nothing is ever entered into them. Shouldn't there be or does that not occur until after the number of days, in my case 7, occurs? I have this entered into CRON, and I checked and it being run. @midnight /usr/local/sbin/dovecot --exec-mail ext /usr/local/libexec/dovecot/expire-tool I have used the "test" mode also; without any output. -- Jerry |=== ges...@yahoo.com|=== |=== |=== | A political man can have as his aim the realization of freedom, but he has no means to realize it other than through violence. Jean Paul Sartre
Re: [Dovecot] @2.0 IMAP login, Error: ...//lib20_fts_plugin.so: undefined symbol: fts_next_hook_mailbox_allocated
On Mon, 2009-10-12 at 21:15 -0700, PGNet Dev wrote: > Oct 12 21:07:16 IMAP(testu...@my.domain.com): Error: > dlopen(/usr/local/lib/dovecot/lib20_fts_plugin.so) failed: > /usr/local/lib/dovecot/lib20_fts_plugin.so: undefined symbol: > fts_next_hook_mailbox_allocated Fixed: http://hg.dovecot.org/dovecot-2.0/rev/5cb810c55b4a signature.asc Description: This is a digitally signed message part
[Dovecot] Expire plugin in chkpw-wrapper.sh script
Dear Sirs, I'm trying to extend the configuration of vchkpw-wrapper.sh script by adding the expire plugin as follows: #!/bin/bash DOMAIN=`echo $VPOPUSER|sed s/^.*@//` if [ "$DOMAIN" = "operaciones.qnet.com.pe" ]; then export USERDB_AUTOCREATE=INBOX.Spam export USERDB_AUTOSUBSCRIBE=INBOX.Spam export USERDB_EXPIRE="INBOX.Spam 1 INBOX.Spam.* 1" export USERDB_EXPIRE_DICT="proxy::expire" export EXTRA="USERDB_AUTOCREATE USERDB_AUTOSUBSCRIBE USERDB_EXPIRE USERDB_EXPIRE_DICT" fi unset USER exec $* In the database no problem mysql> select * from expires; +---+--+ | mailbox | expire_stamp | +---+--+ | jma...@operaciones.qnet.com.pe/INBOX.Spam | 1255701608 | +---+--+ 1 row in set (0.00 sec) But when you run the command /usr/local/sbin/dovecot --exec-mail ext /usr/local/libexec/dovecot/expire-tool --test Displays the following message Fatal: expire and expire_altmove settings not set That may be happening? Thanks Jose Luis _ Explore the seven wonders of the world http://search.msn.com/results.aspx?q=7+wonders+world&mkt=en-US&form=QBRE
Re: [Dovecot] 1.2.6 Spurious pread()/stream errors/index corruption
On Thu, 2009-10-15 at 20:22 +0100, Paul Freeman wrote: > OK it seems that pread(), for whatever reason is still used even with with > HAVE_PREAD undefined, I also removed the pread ac from configure.in and > rebuilt configure just to make sure it was not defined anywhere else. "grep -i pread config.h" after configure. That's the important part. But I guess if undefining HAVE_PREAD isn't working, try adding to config.h: #define PREAD_BROKEN signature.asc Description: This is a digitally signed message part
Re: [Dovecot] Per User Quotas
On Thu, 2009-10-15 at 14:11 -0500, Peter Fraser wrote: > user_attrs = streetAddress=quota_rule=*:storage=%$M > ,=uid=uid,=gid=gid,=home=/home/vmail/%u The =uid=uid part looks wrong. Should be more like =uid=1000, =gid=1000. Anyway.. Post again dovecot -n output and also logs with auth_debug=yes and mail_debug=yes. signature.asc Description: This is a digitally signed message part
Re: [Dovecot] 1.2.6 Spurious pread()/stream errors/index corruption
OK it seems that pread(), for whatever reason is still used even with with
HAVE_PREAD undefined, I also removed the pread ac from configure.in and
rebuilt configure just to make sure it was not defined anywhere else.
a quick snippet from strace...
open("/NOC4/etc/dovecot/dovecot.conf", O_RDONLY) = 4
fstat(4, {st_mode=S_IFREG|0644, st_size=7333, ...}) = 0
pread(4, "## Dovecot configuration file\n\nba"..., 4096, 0) = 4096
pread(4, " = no\n pop3_enable_last "..., 4067, 4096) = 3237
write(2, "\7"..., 1)= 1
write(2, "Unexpected eof found when reading"..., 63Unexpected eof found
when reading file 'UNOPENED' (Errcode: -1)) = 63
write(2, "\n"..., 1
)= 1
write(2, "Panic: file istream-file.c: line "..., 89Panic: file
istream-file.c: line 80 (i_stream_file_read): assertion failed: (errno !=
0)
) = 89
actual output
Unexpected eof found when reading file 'UNOPENED' (Errcode: -1)
Panic: file istream-file.c: line 80 (i_stream_file_read): assertion
failed: (errno != 0)
Error: Raw backtrace: /NOC4/dovecot/sbin/dovecot [0x41d10e] ->
/NOC4/dovecot/sbin/dovecot(default_error_handler+0) [0x41d18a] ->
/NOC4/dovecot/sbin/dovecot(i_fatal+0) [0x41d402] ->
/NOC4/dovecot/sbin/dovecot [0x421901] ->
/NOC4/dovecot/sbin/dovecot(i_stream_read+0x8b) [0x42045b] ->
/NOC4/dovecot/sbin/dovecot(i_stream_read_next_line+0x29) [0x420edb] ->
/NOC4/dovecot/sbin/dovecot [0x41a715] ->
/NOC4/dovecot/sbin/dovecot(settings_read+0x40) [0x41a7ba] ->
/NOC4/dovecot/sbin/dovecot(master_settings_read+0xb1) [0x418413] ->
/NOC4/dovecot/sbin/dovecot(main+0x32c) [0x41540a] ->
/lib/libc.so.6(__libc_start_main+0xe6) [0x2aedb29455c6] ->
/NOC4/dovecot/sbin/dovecot [0x40b0a9]
Aborted
On Thu, 15 Oct 2009 13:38:22 -0400, Timo Sirainen wrote:
> On Thu, 2009-10-15 at 10:06 +0100, Paul Freeman wrote:
>> (some previous posts indicated this might be todo with 64bit file
offsets
>> so we've played around with disable-largefile and setting
>> _FILE_OFFSET_BITS
>> manually but without any success)
>
> If your OS is 64bit, you can't disable 64bit file offsets. But yes, your
> problems clearly points to pread() being broken for some reason. The
> easiest way to see if that's the only thing broken is to comment out
> HAVE_PREAD from config.h after configure and recompile.
Re: [Dovecot] MailDIR and expire plugin
On Thu, 2009-10-15 at 14:36 -0400, Jerry wrote: > > > It doesn't appear correct; > > > > Why? > > > > Anyway, the important part is what does your namespace configuration > > look like? Post your dovecot -n output. > > OK! > > # 1.2.4: /usr/local/etc/dovecot.conf .. Everything looks correct. Doesn't it work? signature.asc Description: This is a digitally signed message part
Re: [Dovecot] Per User Quotas
OK this is what I now have.
In dovecot.conf I put:
userdb ldap {
args = /usr/local/etc/dovecot-ldap.conf
}
In dovecot-ldap.conf:
hosts = 192.168.1.97
base = dc=atlas,dc=local
auth_bind = yes
scope = subtree
auth_bind_userdn = atlas\%u
user_filter = (&(objectClass=mailUser)(mail=%u))
default_pass_scheme = CRYPT
pass_filter = (&(objectclass=person)(uid=%u))
pass_attrs = userPassword=password
user_attrs = streetAddress=quota_rule=*:storage=%$M
,=uid=uid,=gid=gid,=home=/home/vmail/%u
And the quota in street address of AD
When I fire up thunderbird now, I see sending login information for a
long time before it comes up and even when it does, I still see the
general quota.
On Thu, Oct 15, 2009 at 12:40 PM, Timo Sirainen wrote:
> On Thu, 2009-10-15 at 19:36 +0200, thedoghousemailcom wrote:
>> Hi Peter + Timo,
>>
>> I think the solution is the right order in dovecot.conf:
>>
>> "userdb ldap" should stand in front of "userdb static".
>
> Well, if that's done then userdb static is used only when user isn't
> found from ldap. And I guess that should normally never happen..
>
Re: [Dovecot] MailDIR and expire plugin
On Thu, 15 Oct 2009 13:33:01 -0400 Timo Sirainen wrote: > On Thu, 2009-10-15 at 06:10 -0400, Jerry wrote: > > All of the mailboxes on this system are in MailDIR format. None of > > the users delete mail off of the server after POPing their accounts. > > This is the present setting: > > > > expire = Trash 7 Spam 30 > > expire_dict = proxy::expire > > > > Is that correct for MailDIR style mailboxes? > > The configuration is the same for maildir and everything else. > > > It doesn't appear correct; > > Why? > > Anyway, the important part is what does your namespace configuration > look like? Post your dovecot -n output. OK! # 1.2.4: /usr/local/etc/dovecot.conf # OS: FreeBSD 7.2-STABLE i386 ufs log_path: /usr/home/gerard/dovecot.log info_log_path: /usr/home/gerard/dovecot.log protocols: pop3 pop3s managesieve listen(default): * listen(pop3): * listen(managesieve): localhost:2000 disable_plaintext_auth: no login_dir: /var/run/dovecot/login login_executable(default): /usr/local/libexec/dovecot/pop3-login login_executable(pop3): /usr/local/libexec/dovecot/pop3-login login_executable(managesieve): /usr/local/libexec/dovecot/managesieve-login login_greeting: Greetings From Seibercom.net verbose_proctitle: yes first_valid_uid: 1000 first_valid_gid: 1000 mail_privileged_group: mail mail_location: maildir:/var/mail/vhost/%d/%n mail_executable(default): /usr/local/libexec/dovecot/pop3 mail_executable(pop3): /usr/local/libexec/dovecot/pop3 mail_executable(managesieve): /usr/local/libexec/dovecot/managesieve mail_plugins(default): expire mail_plugins(pop3): expire mail_plugins(managesieve): mail_plugin_dir(default): /usr/local/lib/dovecot/pop3 mail_plugin_dir(pop3): /usr/local/lib/dovecot/pop3 mail_plugin_dir(managesieve): /usr/local/lib/dovecot/managesieve pop3_client_workarounds(default): outlook-no-nuls oe-ns-eoh pop3_client_workarounds(pop3): outlook-no-nuls oe-ns-eoh pop3_client_workarounds(managesieve): dict_db_config: /usr/local/etc/dovecot-db.conf managesieve_logout_format(default): bytes=%i/%o managesieve_logout_format(pop3): bytes=%i/%o managesieve_logout_format(managesieve): bytes ( in=%i : out=%o ) lda: postmaster_address: postmas...@seibercom.net mail_plugins: expire sieve: /usr/local/etc/dovecot/sieve/gerard.sieve sieve_global_path: /usr/local/etc/dovecot/sieve/gerard.sieve sendmail_path: /usr/sbin/sendmail auth default: mechanisms: plain login cram-md5 digest-md5 username_chars: abcdefghijklmnopqrstuvwxyzabcdefghijklmnopqrstuvwxyz01234567890...@+ username_format: %Lu passdb: driver: sql args: /usr/local/etc/dovecot-sql.conf userdb: driver: sql args: /usr/local/etc/dovecot-sql.conf socket: type: listen client: path: /var/run/dovecot/auth-client mode: 438 master: path: /var/run/dovecot/auth-master mode: 438 plugin: expire: Trash 7 Spam 30 expire_dict: proxy::expire dict: expire: mysql:/usr/local/etc/dovecot-dict-expire.conf
Re: [Dovecot] Questions regarding dbox migration
On Thu, 2009-10-15 at 10:55 +0200, Mikkel wrote: > > In any case if there are expunged messages, files containing them would > > be recreated (nightly or something). That'll unfragment the files. > > > > It would be nice if this recreation interval (nightly, weekly, monthly?) > was made tunable. It's actually left up to sysadmin to run "doveadm purge -a" from cronjob. > Some users would have mailboxes a several hundred megabytes and having > to recreate thousands of these every night because of a single mail > getting expunged a day could result in a huge performance hit. It doesn't matter what the user's full mailbox size is. It matters how many of these max. ~2 MB dbox files have expunged messages. Typically users would expunge only new mails, so typically there would be only a single file that needs to be recreated. > The errors I get are like these two: > > dovecot: Oct 01 15:13:05 Error: POP3(acco...@domain): Transaction log > file /local/account_homedir/Maildir/dovecot.index.log: marked corrupted This alone isn't an error, just says that error happened earlier. > dovecot: Oct 01 15:13:57 Error: IMAP(another_acco...@domain): Corrupted > transaction log file /local/another_homedir/Maildir/dovecot.index.log > seq 229: duplicate transaction log sequence (229) (sync_offset=32860) Hmm. This means that Dovecot thought that dovecot.index.log file was rotated, but when it reopened it it actually had the same sequence number in the header. What NFS server are you using? One possible reason for this is if file's inode number suddenly changes. signature.asc Description: This is a digitally signed message part
Re: [Dovecot] "multiple quota roots" complains
On Thu, 2009-10-15 at 13:56 -0400, Timo Sirainen wrote: > On Tue, 2009-10-13 at 23:00 +0400, Kostik wrote: > > Hello. > > > > Actually it is a problem for me. > > > > Introduction: > > If dovecot LDA save failed to mbox (not enough disk space, for example), > > it does not do rollback. Then my mailbox was corrupted. Last message is > > dropped in the middle of headers(body, attachments, etc). > > That shouldn't be happening, even if you're not using quota plugin at > all. What does Dovecot log in that situation? Or what does your MTA log? Does it say deliver crashed? Because that's the only reason I can think of that it would leave the mbox corrupted. Post your dovecot -n output also? signature.asc Description: This is a digitally signed message part
Re: [Dovecot] "multiple quota roots" complains
On Tue, 2009-10-13 at 23:00 +0400, Kostik wrote: > Hello. > > Actually it is a problem for me. > > Introduction: > If dovecot LDA save failed to mbox (not enough disk space, for example), > it does not do rollback. Then my mailbox was corrupted. Last message is > dropped in the middle of headers(body, attachments, etc). That shouldn't be happening, even if you're not using quota plugin at all. What does Dovecot log in that situation? > If user receives message which is over FS quota but under dirsize > quota, then "dirsize quota plugin" say: "OK". But "fs quota plugin" > say: "stat((null)) failed: Bad address". And LDA tries to deliver > message to mbox: save failed, no rollback, mbox corrupted. The stat((null)) should be fixed by this: http://hg.dovecot.org/dovecot-2.0/rev/14eeed133d57 signature.asc Description: This is a digitally signed message part
Re: [Dovecot] Per User Quotas
On Thu, 2009-10-15 at 19:36 +0200, thedoghousemailcom wrote: > Hi Peter + Timo, > > I think the solution is the right order in dovecot.conf: > > "userdb ldap" should stand in front of "userdb static". Well, if that's done then userdb static is used only when user isn't found from ldap. And I guess that should normally never happen.. signature.asc Description: This is a digitally signed message part
Re: [Dovecot] Per User Quotas
On Thu, 2009-10-15 at 12:31 -0500, Peter Fraser wrote: > Ok I see, so can I get per-user quotas going and still use userdb > static? No. That means all users have the same static configuration. > or do I have to change to userdb ldap? Yes. signature.asc Description: This is a digitally signed message part
Re: [Dovecot] 1.2.6 Spurious pread()/stream errors/index corruption
On Thu, 2009-10-15 at 10:06 +0100, Paul Freeman wrote: > (some previous posts indicated this might be todo with 64bit file offsets > so we've played around with disable-largefile and setting _FILE_OFFSET_BITS > manually but without any success) If your OS is 64bit, you can't disable 64bit file offsets. But yes, your problems clearly points to pread() being broken for some reason. The easiest way to see if that's the only thing broken is to comment out HAVE_PREAD from config.h after configure and recompile. signature.asc Description: This is a digitally signed message part
Re: [Dovecot] Per User Quotas
Hi Peter + Timo, I think the solution is the right order in dovecot.conf: "userdb ldap" should stand in front of "userdb static". Greetings Timo Sirainen schrieb: On Wed, 2009-10-14 at 21:18 -0500, Peter Fraser wrote: userdb: driver: static args: uid=1002 gid=1002 home=/home/vmail/%u allow_all_users=yes This catches all userdb lookups. userdb: driver: passwd args: blocking=yes This is never used. You probably want to comment it out. user_attrs = homeDirectory=/home/vmail/%u,uidNumber=1002,gidNumber=1002,streetAddress=quota_rule=*:storage=%$M These aren't used, because you're using userdb static instead of userdb ldap.
Re: [Dovecot] MailDIR and expire plugin
On Thu, 2009-10-15 at 06:10 -0400, Jerry wrote: > All of the mailboxes on this system are in MailDIR format. None of > the users delete mail off of the server after POPing their accounts. > This is the present setting: > > expire = Trash 7 Spam 30 > expire_dict = proxy::expire > > Is that correct for MailDIR style mailboxes? The configuration is the same for maildir and everything else. > It doesn't appear correct; Why? Anyway, the important part is what does your namespace configuration look like? Post your dovecot -n output. signature.asc Description: This is a digitally signed message part
Re: [Dovecot] Per User Quotas
Ok I see, so can I get per-user quotas going and still use userdb static? or do I have to change to userdb ldap? On Thu, Oct 15, 2009 at 11:30 AM, Timo Sirainen wrote: > On Wed, 2009-10-14 at 21:18 -0500, Peter Fraser wrote: >> userdb: >> driver: static >> args: uid=1002 gid=1002 home=/home/vmail/%u allow_all_users=yes > > This catches all userdb lookups. > >> userdb: >> driver: passwd >> args: blocking=yes > > This is never used. You probably want to comment it out. > >> user_attrs = >> homeDirectory=/home/vmail/%u,uidNumber=1002,gidNumber=1002,streetAddress=quota_rule=*:storage=%$M > > These aren't used, because you're using userdb static instead of userdb > ldap. >
Re: [Dovecot] Expire issue
On Thu, 2009-10-15 at 15:50 +0200, Emmanuel Gonzalez wrote: > Hello guys, > I'm trying to configure de expire plug in, all the configuration seems > to be right but when I launch > > # /opt/dovecot/sbin/dovecot --exec-mail ext > /opt/dovecot/libexec/dovecot/expire-tool --test > Error: userdb(u...@mydomain.it) didn't return uid What Dovecot version? I think I fixed this already. signature.asc Description: This is a digitally signed message part
Re: [Dovecot] Deliver - can't connect to .../auth-master
On Thu, 2009-10-15 at 15:42 +0100, i...@brightbooks.co.uk wrote: > Deliver. We're using virtual users so, if I am understanding correctly, > Deliver needs to fetch this information from /var/run/dovecot/auth-master. > The trouble is that Deliver doesn't seem to have the correct privileges to > do so. Whenever Getmail tries to pass the mail to Deliver, the line: > > Oct 15 15:21:04 Domain deliver(u...@domain.com): Can't connect to auth > server at /var/run/dovecot/auth-master: No such file or directory It doesn't say "permission denied", it says "no such file or directory". Did you check that it really exists in that exact same directory? > So far I've tried: > # - Changing the privileges of the whole /var/run/dovecot/ folder, It's +rx by everyone by default already, so there's no need to change it. > # - I tried setting the location of auth-master to /home/manager/dovecot > in the dovecot-postfix.conf config files (and the dovecot.conf config, > just in case), so I could control access to it, and its permissions, more > closely. Again, no luck. The log file still shows that it is trying to > access it through /var/run/dovecot ~ not sure why (I even went to the > lengths of doing a search for /var/run/dovecot in the config files, to > make sure I hadn't missed a rogue mention; nothing). Interestingly the > file auth-master is created in the correct folder I've configured, but the > log results still stay the same. You didn't say what exactly you changed, so I've no idea what you did. Post your dovecot -n output. signature.asc Description: This is a digitally signed message part
Re: [Dovecot] FS Quota broken for delivering BIG message
On Thu, 2009-10-15 at 14:06 +0400, Kostik wrote: > write_full(/var/virtual/home/I/I/koc/.temp.pigeon01.8822.64dfacc7e57d71b4) > failed: Disk quota exceeded > stat(/tmp/Dovecot Delivery Mail) failed: Disk quota exceeded > from=<>, msgid=: save failed to INBOX: BUG: Unknown internal error I guess the only nice way to handle this is to just let it use memory as much as it needs in this situation: http://hg.dovecot.org/dovecot-1.2/rev/a8254e6d5ada signature.asc Description: This is a digitally signed message part
Re: [Dovecot] pop3-login: Fatal: io_loop_handle_add: epoll_ctl(1, 5):
I seem to have run into the same issue on two of our 12 Dovecot servers this morning: Oct 15 03:41:51 oh-popmap5p dovecot: dovecot: child 7529 (login) returned error 89 (Fatal failure) Oct 15 03:41:51 oh-popmap5p dovecot: dovecot: child 7532 (login) returned error 89 (Fatal failure) Oct 15 03:41:51 oh-popmap5p dovecot: dovecot: Temporary failure in creating login processes, slowing down for now Oct 15 03:41:51 oh-popmap5p dovecot: dovecot: Temporary failure in creating login processes, slowing down for now Oct 15 03:41:51 oh-popmap5p dovecot: imap-login: Fatal: io_loop_handle_add: epoll_ctl(1, 5): Operation not permitted Oct 15 03:41:51 oh-popmap5p dovecot: dovecot: Created login processes successfully, unstalling Oct 15 03:41:51 oh-popmap5p dovecot: pop3-login: Fatal: io_loop_handle_add: epoll_ctl(1, 5): Operation not permitted Oct 15 03:41:51 oh-popmap5p dovecot: dovecot: Created login processes successfully, unstalling Oct 15 03:41:52 oh-popmap5p dovecot: dovecot: child 7576 (login) returned error 89 (Fatal failure) Oct 15 03:41:52 oh-popmap5p dovecot: dovecot: Temporary failure in creating login processes, slowing down for now All 12 of our servers are running Dovecot 1.2.6, and all of them were upgraded from 1.2.4 and restarted at Oct 13 04:00 by a cron job that updates packages from our internal Yum repo. Only two of the servers encountered this issue. We run two separate master processes on each host - one for IMAP, one for POP3. The IMAP service runs with a significantly increased login_max_processes_count, and continued to serve user requests. The POP3 service hit the max login process limit and stopped accepting new connections, which triggered our alerting system. For what it's worth, I was able to kill -HUP the master processes on both machines and things seemed to return to normal. I also took the precaution of killing off the pop3 login processes to get new connections accepted. Timo, is there any more information I could gather about this issue? We've got a fairly large pool of machines, and odds are it will crop up again if we wait long enough. Thanks, -Brad
Re: [Dovecot] Autocreate plugin for some domains
Dear Timo, I'm trying to extend the configuration of vchkpw-wrapper.sh script by adding the expire plugin as follows: #!/bin/bash DOMAIN=`echo $VPOPUSER|sed s/^.*@//` if [ "$DOMAIN" = "operaciones.qnet.com.pe" ]; then export USERDB_AUTOCREATE=INBOX.Spam export USERDB_AUTOSUBSCRIBE=INBOX.Spam export USERDB_EXPIRE="INBOX.Spam 1 INBOX.Spam.* 1" export USERDB_EXPIRE_DICT="proxy::expire" export EXTRA="USERDB_AUTOCREATE USERDB_AUTOSUBSCRIBE USERDB_EXPIRE USERDB_EXPIRE_DICT" set > /tmp/environment fi unset USER exec $* In the database no problem mysql> select * from expires; +---+--+ | mailbox | expire_stamp | +---+--+ | jma...@operaciones.qnet.com.pe/INBOX.Spam | 1255701608 | +---+--+ 1 row in set (0.00 sec) But when you run the command /usr/local/sbin/dovecot --exec-mail ext /usr/local/libexec/dovecot/expire-tool --test Displays the following message Fatal: expire and expire_altmove settings not set That may be happening? Thanks Jose Luis > From: t...@iki.fi > To: jolumape...@hotmail.com > Date: Wed, 14 Oct 2009 17:37:25 -0400 > CC: dovecot@dovecot.org > Subject: Re: [Dovecot] Autocreate plugin for some domains > > On Wed, 2009-10-14 at 16:33 -0500, Jose Luis Marin Perez wrote: > > working correctly, just wanted to ask if I use the variable VPOPUSER not > > bring trouble? > > Anything that works is fine. > _ News, entertainment and everything you care about at Live.com. Get it now! http://www.live.com/getstarted.aspx
Re: [Dovecot] Per User Quotas
On Wed, 2009-10-14 at 21:18 -0500, Peter Fraser wrote: > userdb: > driver: static > args: uid=1002 gid=1002 home=/home/vmail/%u allow_all_users=yes This catches all userdb lookups. > userdb: > driver: passwd > args: blocking=yes This is never used. You probably want to comment it out. > user_attrs = > homeDirectory=/home/vmail/%u,uidNumber=1002,gidNumber=1002,streetAddress=quota_rule=*:storage=%$M These aren't used, because you're using userdb static instead of userdb ldap. signature.asc Description: This is a digitally signed message part
Re: [Dovecot] Dovecot deliver with AD LDAP userdb
On Wed, 2009-10-14 at 16:00 -0400, Mark Schaub wrote: > user_filter = > (&(objectclass=person)(|(sAMAccountName=%n)(mail...@sau24.org)(othermailbox...@sau24.org))) My LDAP knowledge isn't that great, but does | accept more than one parameter? Try changing this to: user_filter = (&(objectclass=person)(|(sAMAccountName=%n)(|(mail...@sau24.org)(othermailbox...@sau24.org Other than that, I don't really have much ideas. Does the same filter work with e.g. ldapsearch? signature.asc Description: This is a digitally signed message part
[Dovecot] Deliver - can't connect to .../auth-master
Dovecot version 1.1.11 Hi all, I'm having real trouble getting Getmail, which is configured to pick up mail from my ISPs mailhost, to put the mail in our local Maildirs, through Deliver. We're using virtual users so, if I am understanding correctly, Deliver needs to fetch this information from /var/run/dovecot/auth-master. The trouble is that Deliver doesn't seem to have the correct privileges to do so. Whenever Getmail tries to pass the mail to Deliver, the line: Oct 15 15:21:04 Domain deliver(u...@domain.com): Can't connect to auth server at /var/run/dovecot/auth-master: No such file or directory appears in the Mail.err log. So far I've tried: # - Changing the privileges of the whole /var/run/dovecot/ folder, and its sub folders. I understand that this is only a workaround, as Dovecot changes the privileges back on restart, however it doesn't seem to work anyway. It changes the log result from 'No such file or directory' to 'Permission denied' (and sometimes 'Connection refused'). # - I tried setting the location of auth-master to /home/manager/dovecot in the dovecot-postfix.conf config files (and the dovecot.conf config, just in case), so I could control access to it, and its permissions, more closely. Again, no luck. The log file still shows that it is trying to access it through /var/run/dovecot ~ not sure why (I even went to the lengths of doing a search for /var/run/dovecot in the config files, to make sure I hadn't missed a rogue mention; nothing). Interestingly the file auth-master is created in the correct folder I've configured, but the log results still stay the same. Thanks in advance for any help getting this up and running.
[Dovecot] Missing folders
I've recently had a oops with the system I was running dovecot on so have had to move it to a new machine, I've been able to retrieve the mbox files from the old machine, built the new machine and over wrote the new mbox files with the old one in maildir, connecting to the server via imap woeks but I can only see the mail in the inbox from the old mbox files, emails in sub directories (the sub directories arn't there), is there some command I need to run to get it to pass the mbox file to find the folders or it there another file I need to transfer form the old machine. (I'm assuming that all the emails for a user, including those in subfolders are within the single mbox file, particularly as I'm is very large) Thanks John
Re: [Dovecot] Dovecot deliver with AD LDAP userdb
> My question is this: is there something wrong with my configuration or > can Dovecot only query certain fields in the user_attr string? Just as a clarification, I mean to ask if Dovecot can only query certain fields in the user_filter string. Thanks, ~ Mark -- This message has been scanned for viruses and dangerous content by MailScanner, and is believed to be clean.
