Sieve vacation and srs
Hi, is this already fixed? https://www.dovecot.org/pipermail/dovecot/2017-July/108688.html If so, which version of Dovecot includes fix for this? Thanks for info. azur
Panic: file dict-fs.c:
Hi, Am I doing something wrong here, or is this an actual problem? I am trying to get the top level of a public Mailbox to be an actual mailbox, instead of just storing subfolders. I get what looks to be an identical error when running doveadm acl recalc as well doveadm acl debug Departments2/IT doveadm(root): Info: Mailbox 'IT' is in namespace 'Departments2/' doveadm(root): Info: Mailbox path: /mail/Departments2/.IT doveadm(root): Info: Per-user private flags in mailbox: \Seen doveadm(root): Info: User root has rights: lookup read write write-seen write-deleted insert post expunge doveadm(root): Info: Mailbox found from dovecot-acl-list doveadm(root): Info: Mailbox is in public namespace doveadm(root): Info: Mailbox Departments2/IT is visible in LIST doveadm acl debug Departments2 doveadm(root): Info: Mailbox '' is in namespace 'Departments2/' doveadm(root): Info: Mailbox path: /mail/Departments2 doveadm(root): Info: Per-user private flags in mailbox: \Seen doveadm(root): Info: User root has rights: lookup read write write-seen write-deleted insert post expunge doveadm(root): Error: Mailbox not found from dovecot-acl-list, rebuilding doveadm(root): Panic: file dict-fs.c: line 127 (fs_dict_iterate_init): assertion failed: ((flags & DICT_ITERATE_FLAG_RECURSE) == 0) doveadm(root): Error: Raw backtrace: /usr/local/lib/dovecot/libdovecot.so.0(+0x9a954) [0x7f36a1627954] -> /usr/local/lib/dovecot/libdovecot.so.0(+0x9a9d9) [0x7f36a16279d9] -> /usr/local/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f36a15bc9a0] -> /usr/local/lib/dovecot/libdovecot.so.0(+0x30438) [0x7f36a15bd438] -> /usr/local/lib/dovecot/libdovecot.so.0(dict_iterate_init_multiple+0x74) [0x7f36a15f3bf4] -> /usr/local/lib/dovecot/libdovecot.so.0(dict_iterate_init+0x19) [0x7f36a15f3c69] -> /usr/local/lib/dovecot/lib01_acl_plugin.so(acl_lookup_dict_rebuild+0x392) [0x7f36a0de1ab2] -> /usr/local/lib/dovecot/lib01_acl_plugin.so(+0xa695) [0x7f36a0ddf695] -> /usr/local/lib/dovecot/lib01_acl_plugin.so(acl_backend_vfile_acllist_rebuild+0xd) [0x7f36a0ddf7cd] -> /usr/local/lib/dovecot/doveadm/lib10_doveadm_acl_plugin.so(+0x2552) [0x7f36a07b4552] -> /usr/local/lib/dovecot/doveadm/lib10_doveadm_acl_plugin.so(+0x27ff) [0x7f36a07b47ff] -> doveadm(+0x2a14d) [0x5624042e714d] -> doveadm(+0x2ac20) [0x5624042e7c20] -> doveadm(doveadm_cmd_ver2_to_mail_cmd_wrapper+0x22a) [0x5624042e89ea] -> doveadm(doveadm_cmd_run_ver2+0x515) [0x5624042f7125] -> doveadm(doveadm_cmd_try_run_ver2+0x37) [0x5624042f7177] -> doveadm(main+0x1ca) [0x5624042d85ba] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf1) [0x7f36a120e2b1] -> doveadm(_start+0x2a) [0x5624042d897a] Aborted -- Bob Miller Cell: 867-334-7117 Office: 867-633-3760 www.computerisms.ca
Re: Very high load
Hi Aki,
thank you very much for your reply.
What do you mean with "triggering maildir scans"?
Here is dovecot -n output:
# 2.0.9: /etc/dovecot/dovecot.conf
# OS: Linux 2.6.32-642.15.1.el6.x86_64 x86_64 CentOS release 6.9 (Final)
auth_mechanisms = plain login digest-md5 cram-md5
debug_log_path = /var/log/dovecot.log
disable_plaintext_auth = no
first_valid_gid = 89
first_valid_uid = 89
mail_gid = 89
mail_location = maildir:/var/spool/domains
mail_uid = 89
managesieve_notify_capability = mailto
managesieve_sieve_capability = fileinto reject envelope encoded-character
vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy
include variables body enotify environment mailbox date imapflags notify
mbox_write_locks = fcntl
namespace {
inbox = yes
location =
prefix = INBOX.
separator = .
type = private
}
passdb {
args = /etc/dovecot/dovecot-sql.conf.ext
driver = sql
}
passdb {
args = /etc/dovecot/dovecot-sql-crypt.conf.ext
driver = sql
}
plugin {
sieve = ~/.dovecot.sieve
sieve_dir = ~/sieve
sieve_extensions = +notify +imapflags
sieve_max_script_size = 1M
}
protocols = imap pop3 lmtp sieve
ssl_cert =
> Il 21 settembre 2017 alle 11.13 Aki Tuomi ha
> scritto:
>
> On 21.09.2017 00:56, absolutely_f...@libero.it wrote:
>
> > >
> > Hi,
> >
> > I am using dovecot 2.0.9 (official CentOS rpm), I am experiencing
> > very high load issue.
> >
> > I think it is something related to my storage (/var/spool is about
> > 3 TB and it is almost full).
> >
> > I noticed those kind of messages in /var/log/maillog:
> >
> > Warning: Maildir: Scanning
> > /var/spool/pop/domains/domain.it/username/Maildir/cur took 100 seconds
> > (14281 readdir()s, 0 rename()s to cur/)
> > Maybe you have just too much load on your server. Also you seem to
> > be
> > triggering maildir scans which are expensive.
> >
> > >
> Also the version you are running is from 2011, so it's ... rather dated.
> You should probably update your system to centos7 which at least has
> 2.2.10, which is still rather old, but less so.
> >
>
> > >
> > Warning: Maildir /var/spool/pop/domains/domain.it/username/Maildir:
> > Synchronization took 103 seconds (0 new msgs, 0 flag change attempts, 0
> > expunge attempts)
> >
> > I wondering if there is something to try, at configuration level,
> > to "mitigate" this..
> >
> > I use Maildir format, MTA is postfix, I have many users (> 1)
> > with pop3/imap/webmail access. Physical server with 8 GB RAM and two CPU
> > (Intel(R) Pentium(R) D CPU 3.00GHz)
> >
> > This is my dovecot's conf:
> >
> > please use doveconf -n
> >
> > >
> Aki
>
librmb: Mail storage on RADOS with Dovecot
Hi ceph-ers, The email below was posted on the ceph mailinglist yesterday by Wido den Hollander. I guess this could be interesting for user here as well. MJ Forwarded Message Subject: [ceph-users] librmb: Mail storage on RADOS with Dovecot Date: Thu, 21 Sep 2017 10:40:03 +0200 (CEST) From: Wido den Hollander To: ceph-us...@ceph.com Hi, A tracker issue has been out there for a while: http://tracker.ceph.com/issues/12430 Storing e-mail in RADOS with Dovecot, the IMAP/POP3/LDA server with a huge marketshare. It took a while, but last year Deutsche Telekom took on the heavy work and started a project to develop librmb: LibRadosMailBox Together with Deutsche Telekom and Tallence GmbH (DE) this project came to life. First, the Github link: https://github.com/ceph-dovecot/dovecot-ceph-plugin I am not going to repeat everything which is on Github, put a short summary: - CephFS is used for storing Mailbox Indexes - E-Mails are stored directly as RADOS objects - It's a Dovecot plugin We would like everybody to test librmb and report back issues on Github so that further development can be done. It's not finalized yet, but all the help is welcome to make librmb the best solution for storing your e-mails on Ceph with Dovecot. Danny Al-Gaaf has written a small blogpost about it and a presentation: - https://dalgaaf.github.io/CephMeetUpBerlin20170918-librmb/ - http://blog.bisect.de/2017/09/ceph-meetup-berlin-followup-librmb.html To get a idea of the scale: 4,7PB of RAW storage over 1.200 OSDs is the final goal (last slide in presentation). That will provide roughly 1,2PB of usable storage capacity for storing e-mail, a lot of e-mail. To see this project finally go into the Open Source world excites me a lot :-) A very, very big thanks to Deutsche Telekom for funding this awesome project! A big thanks as well to Tallence as they did an awesome job in developing librmb in such a short time. Wido
Re: Bug#876364: dovecot-sieve: Just discovered imap_sieve/sieve_imapsieve is not set up to work with virtual mailboxes.
Hi! Thanks for your report, we'll look into it. Aki On 21.09.2017 14:47, Apollon Oikonomopoulos wrote: > Control: tags -1 + moreinfo upstream > > [Forwarding this to the Dovecot mailing list, just in case someone can help] > > Hi, > > Thanks for the report! See my comments inline. > > On 11:56 Thu 21 Sep , Thurgood Angelou wrote: >> Package: dovecot-core >> Version: 1:2.2.32-2 >> >> I've just discovered a bug where the sieve plugin (especially IMAP) >> will not work with a virtual mailbox. I recently found this out when >> testing a virtual mailbox setup and I use imap_sieve for SPAM >> filtering so to lose that would be painful. >> >> This is what is reported in dovecot's debug log... >> >> Sep 21 10:53:01 imap(perso...@othersider92.com): Panic: file >> mail-index-map.c: line 549 (mail_index_map_lookup_seq_range): assertion >> failed: (first_uid > 0) >> Sep 21 10:53:01 imap(perso...@othersider92.com): Error: Raw backtrace: >> /usr/lib/dovecot/libdovecot.so.0(+0x9f0a2) [0x7f4226fd50a2] -> >> /usr/lib/dovecot/libdovecot.so.0(+0x9f19a) [0x7f4226fd519a] -> >> /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f4226f65cf8] -> >> /usr/lib/dovecot/libdovecot-storage.so.0(mail_index_map_lookup_seq_range+0x120) >> [0x7f422733dae0] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0xe8d1d) >> [0x7f422734cd1d] -> >> /usr/lib/dovecot/libdovecot-storage.so.0(mail_index_lookup_seq+0xf) >> [0x7f4227350e9f] -> >> /usr/lib/dovecot/modules/lib20_virtual_plugin.so(+0x82aa) [0x7f422678a2aa] >> -> /usr/lib/dovecot/modules/lib95_imap_sieve_plugin.so(+0x708c) >> [0x7f422657d08c] -> >> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_transaction_commit_get_changes+0x52) >> [0x7f42272adca2] -> dovecot/imap(+0x10084) [0x556502adb084] -> >> dovecot/imap(command_exec+0x5c) [0x556502ae7d9c] -> dovecot/imap(+0x1b322) >> [0x556502ae6322] -> dovecot/imap(+0x1b3bc) [0x556502ae63bc] -> >> dovecot/imap(client_handle_input >> +0x18d) [0x556502ae677d] -> dovecot/imap(client_input+0xac) >> [0x556502ae6ccc] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x52) >> [0x7f4226fea742] -> >> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x12e) >> [0x7f4226febd8e] -> >> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x36) [0x7f4226fea7d6] >> -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7f4226fea988] -> >> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f4226f70353] >> -> dovecot/imap(main+0x329) [0x556502ad9139] -> >> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf1) [0x7f4226bb92e1] -> >> dovecot/imap(_start+0x2a) [0x556502ad92ca] > After mixing in the debug symbols, this backtrace becomes: > > /usr/lib/dovecot/libdovecot.so.0(+0x9f0a2) [0x7f4226fd50a2] > default_fatal_finish at ./src/lib/failures.c:195 > /usr/lib/dovecot/libdovecot.so.0(+0x9f19a) [0x7f4226fd519a] > ?? at ./src/lib/failures.c:670 > /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f4226f65cf8] > i_fatal at ./src/lib/failures.c:280 > /usr/lib/dovecot/libdovecot-storage.so.0(mail_index_map_lookup_seq_range+0x120) > [0x7f422733dae0] > mail_index_map_lookup_seq_range at ./src/lib-index/mail-index-map.c:550 > /usr/lib/dovecot/libdovecot-storage.so.0(+0xe8d1d) [0x7f422734cd1d] > tview_lookup_seq_range at > ./src/lib-index/mail-index-transaction-view.c:178 > /usr/lib/dovecot/libdovecot-storage.so.0(mail_index_lookup_seq+0xf) > [0x7f4227350e9f] > mail_index_lookup_seq at ./src/lib-index/mail-index-view.c:522 > /usr/lib/dovecot/modules/lib20_virtual_plugin.so(+0x82aa) [0x7f422678a2aa] > virtual_mail_set_uid at ./src/plugins/virtual/virtual-mail.c:213 > > /usr/lib/dovecot/modules/lib95_imap_sieve_plugin.so(+0x708c) [0x7f422657d08c] > imap_sieve_mailbox_transaction_run at > ./pigeonhole/src/plugins/imapsieve/imap-sieve-storage.c:752 (inlined by: > imap_sieve_mailbox_transaction_commit at > ./pigeonhole/src/plugins/imapsieve/imap-sieve-storage.c:807) > /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_transaction_commit_get_changes+0x52) > [0x7f42272adca2] > mailbox_transaction_commit_get_changes at > ./src/lib-storage/mail-storage.c:2083 > dovecot/imap(+0x10084) [0x556502adb084] > cmd_copy_full at ./src/imap/cmd-copy.c:146 > dovecot/imap(command_exec+0x5c) [0x556502ae7d9c] > command_exec at ./src/imap/imap-commands.c:200 > dovecot/imap(+0x1b322) [0x556502ae6322] > client_command_input at ./src/imap/imap-client.c:1088 > dovecot/imap(+0x1b3bc) [0x556502ae63bc] > client_command_input at ./src/imap/imap-client.c:1150 > dovecot/imap(client_handle_input+0x18d) [0x556502ae677d] > client_handle_input at ./src/imap/imap-client.c:1203 > dovecot/imap(client_input+0xac) [0x556502ae6ccc] > client_input at ./src/imap/imap-client.c:1249 > /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x52) [0x7f4226fea742] > io_loop_call_io at ./src/lib/ioloop.c:600 > /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run
