Bug in logging in debug mode

2018-11-28 Thread Xavier
Hello,

This is dovecot 2.3.4 (0ecbaf23d)

If you set "mail_debug = yes" in 10.logging.conf, there's a bug in
logging, which breaks log parsers :

> 2018-11-29 00Debug: :41:57 lda(xavier): Effective uid=501, gid=20, 
> home=/home/xavier
   
Regards,

Xavier

-- 
Xavier Humbert - sysadmin & network engineer


Re: Dovecot crash

2018-11-28 Thread JCA
Thanks. Assuming that the IMAP mail directory for the account affected is
under /home/xyz/mail, are you talking about the contents of the index
directory, excluding the log file therein?

On Wed, Nov 28, 2018 at 2:29 PM Thomas Durand  wrote:

> Hi,
>
> I had the similar messages after an upgrade then downgrade. I was able to
> fix by removing all indexes files.
>
> Thomas
>
> > Le 28 nov. 2018 à 22:02, JCA <1.41...@gmail.com> a écrit :
> >
> >   This happening when my Thunderbird client is trying to establish a
> connection with a Dovecot server. Some background first:
> >
> >   1) I am running Thunderbird 6.20.1 from a Linux client.
> >   2) Other clients (e.g. Maildroid in my Android phone) do not have any
> issues.
> >   3) The Dovecot software is version 2.2.9, running in a Linux server.
> >   4) This may be the root of the problem: at some point, the Dovecot
> software  was changed to  version 2.3.1, and the reverted to 2.2.9. The
> crash started to appear when this reversion took place.
> >
> >   My guess is that upgrading to 2.3.1 will eliminate this problem.
> However, in  case that does not solve the problem, I would be grateful if
> anybody could throw some light into exactly what is going on here, and
> whether it can be fixed even without the need of upgrading to 2.3.1.
> >
> >   What follows are the traces generated by Dovecot  2.2.9 when a
> connection is attempted from Thunderbird, with usernames and IP addresses
> disguised for privacy, and some blank lines inserted for readability:
> >
> > Nov 28 13:36:20 imap-login: Info: Login: user=, method=PLAIN,
> rip=xxx.yyy.z
> > zz.154, lip=aaa.bbb.ccc.7, mpid=29245, TLS, session=
> >
> > Nov 28 13:36:20 imap(xyz): Panic: file mail-index-sync-keywords.c: line
> 227 (key
> > words_update_records): assertion failed: (data_offset >= sizeof(struct
> mail_index_record))
> >
> > Nov 28 13:36:20 imap(xyz): Error: Raw backtrace:
> /usr/lib/dovecot/libdovecot.so.
> > 0(+0x65626) [0xb75ae626] -> /usr/lib/dovecot/libdovecot.so.0(+0x6569f)
> [0xb75ae6
> > 9f] -> /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0xb756180e] ->
> /usr/lib/dove
> > cot/libdovecot-storage.so.0(mail_index_sync_keywords+0x707) [0xb76cb6b7]
> -> /usr
> > /lib/dovecot/libdovecot-storage.so.0(mail_index_sync_record+0xf7)
> [0xb76cc167] -
> > > /usr/lib/dovecot/libdovecot-storage.so.0(mail_index_sync_map+0x2a4)
> [0xb76cd22
> > 4] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_index_map+0x57c)
> [0xb76bcb9c
> > ] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0xb7c2a) [0xb76b7c2a] ->
> /usr/lib
> > /dovecot/libdovecot-storage.so.0(+0xb7daa) [0xb76b7daa] ->
> /usr/lib/dovecot/libd
> > ovecot-storage.so.0(mail_index_open+0x114) [0xb76b7f54] ->
> /usr/lib/dovecot/libd
> > ovecot-storage.so.0(index_storage_mailbox_open+0xab) [0xb76a808b] ->
> /usr/lib/do
> > vecot/libdovecot-storage.so.0(+0x5a481) [0xb765a481] ->
> /usr/lib/dovecot/libdove
> > cot-storage.so.0(+0x5a6f2) [0xb765a6f2] ->
> /usr/lib/dovecot/libdovecot-storage.s
> > o.0(+0x7a017) [0xb767a017] ->
> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_o
> > pen+0x26) [0xb767a1d6] -> dovecot/imap(client_open_save_dest_box+0x79)
> [0x805dca
> > 9] -> dovecot/imap() [0x8052678] -> dovecot/imap(command_exec+0x32)
> [0x805d7a2]
> > -> dovecot/imap() [0x805c746] -> dovecot/imap() [0x805c820] ->
> dovecot/imap(clie
> > nt_handle_input+0x125) [0x805cad5] -> dovecot/imap(client_input+0x71)
> [0x805ce91
> > ] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x42) [0xb75c1292]
> -> /usr
> > /lib/dovecot/libdovecot.so.0(io_loop_handler_run+0xdb) [0xb75c22cb] ->
> /usr/lib/
> > dovecot/libdovecot.so.0(io_loop_run+0x48) [0xb75c0cd8] ->
> /usr/lib/dovecot/libdo
> > vecot.so.0(master_service_run+0x2d) [0xb756728d] ->
> dovecot/imap(main+0x2bf) [0x
> > 8066fef] -> /lib/libc.so.6(__libc_start_main+0xe6) [0xb73cfdb6]
> >
> > Nov 28 13:36:20 imap(xyz): Fatal: master: service(imap): child 29245
> killed with
> >  signal 6 (core dumps disabled)
> >
> > Nov 28 13:36:20 imap-login: Info: Login: user=, method=PLAIN,
> rip=xxx.yyy.z
> > zz.154, lip=aaa.bbb.ccc.7, mpid=29247, TLS, session=
> >
> > Nov 28 13:36:21 imap(xyz): Panic: file mail-index-sync-keywords.c: line
> 227 (key
> > words_update_records): assertion failed: (data_offset >= sizeof(struct
> mail_inde
> > x_record))
> >
> > Nov 28 13:36:21 imap(xyz): Error: Raw backtrace:
> /usr/lib/dovecot/libdovecot.so.
> > 0(+0x65626) [0xb7757626] -> /usr/lib/dovecot/libdovecot.so.0(+0x6569f)
> [0xb77576
> > 9f] -> /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0xb770a80e] ->
> /usr/lib/dove
> > cot/libdovecot-storage.so.0(mail_index_sync_keywords+0x707) [0xb78746b7]
> -> /usr
> > /lib/dovecot/libdovecot-storage.so.0(mail_index_sync_record+0xf7)
> [0xb7875167] -
> > > /usr/lib/dovecot/libdovecot-storage.so.0(mail_index_sync_map+0x2a4)
> [0xb787622
> > 4] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_index_map+0x57c)
> [0xb7865b9c
> > ] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0xb7c2a) [0xb7860c2a] ->
> 

Re: Dovecot crash

2018-11-28 Thread Thomas Durand
Hi,

I had the similar messages after an upgrade then downgrade. I was able to fix 
by removing all indexes files. 

Thomas 

> Le 28 nov. 2018 à 22:02, JCA <1.41...@gmail.com> a écrit :
> 
>   This happening when my Thunderbird client is trying to establish a 
> connection with a Dovecot server. Some background first:
> 
>   1) I am running Thunderbird 6.20.1 from a Linux client.
>   2) Other clients (e.g. Maildroid in my Android phone) do not have any  
> issues.
>   3) The Dovecot software is version 2.2.9, running in a Linux server.
>   4) This may be the root of the problem: at some point, the Dovecot software 
>  was changed to  version 2.3.1, and the reverted to 2.2.9. The crash 
> started to appear when this reversion took place.
> 
>   My guess is that upgrading to 2.3.1 will eliminate this problem. However, 
> in  case that does not solve the problem, I would be grateful if anybody 
> could throw some light into exactly what is going on here, and whether it can 
> be fixed even without the need of upgrading to 2.3.1.
> 
>   What follows are the traces generated by Dovecot  2.2.9 when a connection 
> is attempted from Thunderbird, with usernames and IP addresses disguised for 
> privacy, and some blank lines inserted for readability:
> 
> Nov 28 13:36:20 imap-login: Info: Login: user=, method=PLAIN, 
> rip=xxx.yyy.z
> zz.154, lip=aaa.bbb.ccc.7, mpid=29245, TLS, session=
> 
> Nov 28 13:36:20 imap(xyz): Panic: file mail-index-sync-keywords.c: line 227 
> (key
> words_update_records): assertion failed: (data_offset >= sizeof(struct 
> mail_index_record))
> 
> Nov 28 13:36:20 imap(xyz): Error: Raw backtrace: 
> /usr/lib/dovecot/libdovecot.so.
> 0(+0x65626) [0xb75ae626] -> /usr/lib/dovecot/libdovecot.so.0(+0x6569f) 
> [0xb75ae6
> 9f] -> /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0xb756180e] -> 
> /usr/lib/dove
> cot/libdovecot-storage.so.0(mail_index_sync_keywords+0x707) [0xb76cb6b7] -> 
> /usr
> /lib/dovecot/libdovecot-storage.so.0(mail_index_sync_record+0xf7) 
> [0xb76cc167] -
> > /usr/lib/dovecot/libdovecot-storage.so.0(mail_index_sync_map+0x2a4) 
> > [0xb76cd22
> 4] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_index_map+0x57c) 
> [0xb76bcb9c
> ] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0xb7c2a) [0xb76b7c2a] -> 
> /usr/lib
> /dovecot/libdovecot-storage.so.0(+0xb7daa) [0xb76b7daa] -> 
> /usr/lib/dovecot/libd
> ovecot-storage.so.0(mail_index_open+0x114) [0xb76b7f54] -> 
> /usr/lib/dovecot/libd
> ovecot-storage.so.0(index_storage_mailbox_open+0xab) [0xb76a808b] -> 
> /usr/lib/do
> vecot/libdovecot-storage.so.0(+0x5a481) [0xb765a481] -> 
> /usr/lib/dovecot/libdove
> cot-storage.so.0(+0x5a6f2) [0xb765a6f2] -> 
> /usr/lib/dovecot/libdovecot-storage.s
> o.0(+0x7a017) [0xb767a017] -> 
> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_o
> pen+0x26) [0xb767a1d6] -> dovecot/imap(client_open_save_dest_box+0x79) 
> [0x805dca
> 9] -> dovecot/imap() [0x8052678] -> dovecot/imap(command_exec+0x32) 
> [0x805d7a2]
> -> dovecot/imap() [0x805c746] -> dovecot/imap() [0x805c820] -> 
> dovecot/imap(clie
> nt_handle_input+0x125) [0x805cad5] -> dovecot/imap(client_input+0x71) 
> [0x805ce91
> ] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x42) [0xb75c1292] -> 
> /usr
> /lib/dovecot/libdovecot.so.0(io_loop_handler_run+0xdb) [0xb75c22cb] -> 
> /usr/lib/
> dovecot/libdovecot.so.0(io_loop_run+0x48) [0xb75c0cd8] -> 
> /usr/lib/dovecot/libdo
> vecot.so.0(master_service_run+0x2d) [0xb756728d] -> dovecot/imap(main+0x2bf) 
> [0x
> 8066fef] -> /lib/libc.so.6(__libc_start_main+0xe6) [0xb73cfdb6]
> 
> Nov 28 13:36:20 imap(xyz): Fatal: master: service(imap): child 29245 killed 
> with
>  signal 6 (core dumps disabled)
> 
> Nov 28 13:36:20 imap-login: Info: Login: user=, method=PLAIN, 
> rip=xxx.yyy.z
> zz.154, lip=aaa.bbb.ccc.7, mpid=29247, TLS, session=
> 
> Nov 28 13:36:21 imap(xyz): Panic: file mail-index-sync-keywords.c: line 227 
> (key
> words_update_records): assertion failed: (data_offset >= sizeof(struct 
> mail_inde
> x_record))
> 
> Nov 28 13:36:21 imap(xyz): Error: Raw backtrace: 
> /usr/lib/dovecot/libdovecot.so.
> 0(+0x65626) [0xb7757626] -> /usr/lib/dovecot/libdovecot.so.0(+0x6569f) 
> [0xb77576
> 9f] -> /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0xb770a80e] -> 
> /usr/lib/dove
> cot/libdovecot-storage.so.0(mail_index_sync_keywords+0x707) [0xb78746b7] -> 
> /usr
> /lib/dovecot/libdovecot-storage.so.0(mail_index_sync_record+0xf7) 
> [0xb7875167] -
> > /usr/lib/dovecot/libdovecot-storage.so.0(mail_index_sync_map+0x2a4) 
> > [0xb787622
> 4] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_index_map+0x57c) 
> [0xb7865b9c
> ] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0xb7c2a) [0xb7860c2a] -> 
> /usr/lib
> /dovecot/libdovecot-storage.so.0(+0xb7daa) [0xb7860daa] -> 
> /usr/lib/dovecot/libd
> ovecot-storage.so.0(mail_index_open+0x114) [0xb7860f54] -> 
> /usr/lib/dovecot/libd
> ovecot-storage.so.0(index_storage_mailbox_open+0xab) [0xb785108b] -> 
> /usr/lib/do
> vecot/libdovecot-storage.so.0(+0x5a481) 

Dovecot crash

2018-11-28 Thread JCA
  This happening when my Thunderbird client is trying to establish a
connection with a Dovecot server. Some background first:

  1) I am running Thunderbird 6.20.1 from a Linux client.
  2) Other clients (e.g. Maildroid in my Android phone) do not have any
issues.
  3) The Dovecot software is version 2.2.9, running in a Linux server.
  4) This may be the root of the problem: at some point, the Dovecot
software  was changed to  version 2.3.1, and the reverted to 2.2.9. The
crash started to appear when this reversion took place.

  My guess is that upgrading to 2.3.1 will eliminate this problem. However,
in  case that does not solve the problem, I would be grateful if anybody
could throw some light into exactly what is going on here, and whether it
can be fixed even without the need of upgrading to 2.3.1.

  What follows are the traces generated by Dovecot  2.2.9 when a connection
is attempted from Thunderbird, with usernames and IP addresses disguised
for privacy, and some blank lines inserted for readability:

Nov 28 13:36:20 imap-login: Info: Login: user=, method=PLAIN,
rip=xxx.yyy.z
zz.154, lip=aaa.bbb.ccc.7, mpid=29245, TLS, session=

Nov 28 13:36:20 imap(xyz): Panic: file mail-index-sync-keywords.c: line 227
(key
words_update_records): assertion failed: (data_offset >= sizeof(struct
mail_index_record))

Nov 28 13:36:20 imap(xyz): Error: Raw backtrace:
/usr/lib/dovecot/libdovecot.so.
0(+0x65626) [0xb75ae626] -> /usr/lib/dovecot/libdovecot.so.0(+0x6569f)
[0xb75ae6
9f] -> /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0xb756180e] ->
/usr/lib/dove
cot/libdovecot-storage.so.0(mail_index_sync_keywords+0x707) [0xb76cb6b7] ->
/usr
/lib/dovecot/libdovecot-storage.so.0(mail_index_sync_record+0xf7)
[0xb76cc167] -
> /usr/lib/dovecot/libdovecot-storage.so.0(mail_index_sync_map+0x2a4)
[0xb76cd22
4] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_index_map+0x57c)
[0xb76bcb9c
] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0xb7c2a) [0xb76b7c2a] ->
/usr/lib
/dovecot/libdovecot-storage.so.0(+0xb7daa) [0xb76b7daa] ->
/usr/lib/dovecot/libd
ovecot-storage.so.0(mail_index_open+0x114) [0xb76b7f54] ->
/usr/lib/dovecot/libd
ovecot-storage.so.0(index_storage_mailbox_open+0xab) [0xb76a808b] ->
/usr/lib/do
vecot/libdovecot-storage.so.0(+0x5a481) [0xb765a481] ->
/usr/lib/dovecot/libdove
cot-storage.so.0(+0x5a6f2) [0xb765a6f2] ->
/usr/lib/dovecot/libdovecot-storage.s
o.0(+0x7a017) [0xb767a017] ->
/usr/lib/dovecot/libdovecot-storage.so.0(mailbox_o
pen+0x26) [0xb767a1d6] -> dovecot/imap(client_open_save_dest_box+0x79)
[0x805dca
9] -> dovecot/imap() [0x8052678] -> dovecot/imap(command_exec+0x32)
[0x805d7a2]
-> dovecot/imap() [0x805c746] -> dovecot/imap() [0x805c820] ->
dovecot/imap(clie
nt_handle_input+0x125) [0x805cad5] -> dovecot/imap(client_input+0x71)
[0x805ce91
] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x42) [0xb75c1292] ->
/usr
/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0xdb) [0xb75c22cb] ->
/usr/lib/
dovecot/libdovecot.so.0(io_loop_run+0x48) [0xb75c0cd8] ->
/usr/lib/dovecot/libdo
vecot.so.0(master_service_run+0x2d) [0xb756728d] ->
dovecot/imap(main+0x2bf) [0x
8066fef] -> /lib/libc.so.6(__libc_start_main+0xe6) [0xb73cfdb6]

Nov 28 13:36:20 imap(xyz): Fatal: master: service(imap): child 29245 killed
with
 signal 6 (core dumps disabled)

Nov 28 13:36:20 imap-login: Info: Login: user=, method=PLAIN,
rip=xxx.yyy.z
zz.154, lip=aaa.bbb.ccc.7, mpid=29247, TLS, session=

Nov 28 13:36:21 imap(xyz): Panic: file mail-index-sync-keywords.c: line 227
(key
words_update_records): assertion failed: (data_offset >= sizeof(struct
mail_inde
x_record))

Nov 28 13:36:21 imap(xyz): Error: Raw backtrace:
/usr/lib/dovecot/libdovecot.so.
0(+0x65626) [0xb7757626] -> /usr/lib/dovecot/libdovecot.so.0(+0x6569f)
[0xb77576
9f] -> /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0xb770a80e] ->
/usr/lib/dove
cot/libdovecot-storage.so.0(mail_index_sync_keywords+0x707) [0xb78746b7] ->
/usr
/lib/dovecot/libdovecot-storage.so.0(mail_index_sync_record+0xf7)
[0xb7875167] -
> /usr/lib/dovecot/libdovecot-storage.so.0(mail_index_sync_map+0x2a4)
[0xb787622
4] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_index_map+0x57c)
[0xb7865b9c
] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0xb7c2a) [0xb7860c2a] ->
/usr/lib
/dovecot/libdovecot-storage.so.0(+0xb7daa) [0xb7860daa] ->
/usr/lib/dovecot/libd
ovecot-storage.so.0(mail_index_open+0x114) [0xb7860f54] ->
/usr/lib/dovecot/libd
ovecot-storage.so.0(index_storage_mailbox_open+0xab) [0xb785108b] ->
/usr/lib/do
vecot/libdovecot-storage.so.0(+0x5a481) [0xb7803481] ->
/usr/lib/dovecot/libdove
cot-storage.so.0(+0x5a6f2) [0xb78036f2] ->
/usr/lib/dovecot/libdovecot-storage.s
o.0(+0x7a017) [0xb7823017] ->
/usr/lib/dovecot/libdovecot-storage.so.0(mailbox_o
pen+0x26) [0xb78231d6] -> dovecot/imap(client_open_save_dest_box+0x79)
[0x805dca
9] -> dovecot/imap() [0x8052678] -> dovecot/imap(command_exec+0x32)
[0x805d7a2]
-> dovecot/imap() [0x805c746] -> dovecot/imap() [0x805c820] ->
dovecot/imap(clie
nt_handle_input+0x125) 

Re: Error logs with virtual folder after upgrading to 2.3.4

2018-11-28 Thread Aki Tuomi
If you are using systemd, you might want to create

/etc/systemd/system/service.dovecot.d/override.conf

with 

ProtectSystem=no

if you want writable /etc directory.

> On 28 November 2018 at 18:49 Maria Arrea  wrote:
> 
> 
> Since I upgraded to 2.3.4 I have lots of line in logs like these:
> 
> Nov 28 17:35:48 buzalum_rhel7 dovecot: 
> imap(iniramgon@mydomain): Error: 
> unlink(/etc/dovecot/virtual/dovecot-acl-list) failed: Read-only file system 
> (in acl-backend-vfile-acllist.c:338)
> Nov 28 17:35:48 buzalum_rhel7 dovecot: 
> imap(iniramgon@mydomain): Error: dovecot-acl-list creation 
> failed: safe_mkstemp(/etc/dovecot/virtual/.temp.buzalum_rhel7.6469.) failed: 
> Read-only file system
> 
> These lines did not happen with Dovecot 2.3.2.1. doveconf -n output below. I 
> have also tested to create an emty file with userid entrega in 
> /etc/dovecot/virtual/ and works, so it does not seem a problem with 
> permissions. Any idea about this problem?
> 
> 
> # OS: Linux 3.10.0-862.14.4.el7.x86_64 x86_64 Red Hat Enterprise Linux Server 
> release 7.5 (Maipo) xfs
> # Hostname: buzalum_rhel7
> auth_cache_negative_ttl = 10 secs
> auth_cache_size = 10 M
> auth_cache_ttl = 2 mins
> auth_master_user_separator = *
> auth_mechanisms = plain login
> auth_worker_max_count = 90
> base_dir = /var/run/dovecot/
> default_client_limit = 8192
> default_process_limit = 4500
> disable_plaintext_auth = no
> imap_capability = +XLIST
> imap_client_workarounds = tb-extra-mailbox-sep delay-newmail tb-lsub-flags
> imap_id_log = *
> lda_mailbox_autocreate = yes
> lda_mailbox_autosubscribe = yes
> mail_fsync = never
> mail_gid = entrega
> mail_home = /buzones/mydomain/%2.26Hn/%2.200Hn/%n/home_usuario/
> mail_location = 
> mdbox:/buzones/mydomain/%2.26Hn/%2.200Hn/%n:INDEX=/indices_dovecot/indices/%2.26Hn/%2.200Hn/%n:ALT=/buzones/alternativo/mydomain/%2.26Hn/%2.200Hn/%n
> mail_log_prefix = "%s(%u)<%{session}>: "
> mail_max_userip_connections = 15000
> mail_plugins = " virtual zlib quota acl mail_log notify"
> mail_uid = entrega
> managesieve_notify_capability = mailto
> managesieve_sieve_capability = fileinto reject envelope encoded-character 
> vacation subaddress comparator-i;ascii-numeric relational regex imap4flags 
> copy include variables body enotify environment mailbox date
> mdbox_rotate_interval = 1 days
> mdbox_rotate_size = 60 M
> namespace {
> inbox = yes
> location =
> mailbox Drafts {
> auto = subscribe
> special_use = \Drafts
> }
> mailbox SPAM {
> auto = subscribe
> special_use = \Junk
> }
> mailbox Sent {
> auto = subscribe
> special_use = \Sent
> }
> mailbox Trash {
> auto = subscribe
> special_use = \Trash
> }
> prefix =
> type = private
> }
> namespace {
> list = yes
> location = 
> mdbox:/buzones/mydomain/%%2.26Hn/%%2.200Hu/%%n:ALT=/buzones/alternativo/mydomain/%%2.26Hn/%%2.200Hn/%%n:INDEX=/indices_dovecot/indices/%%2.26Hn/%%2.200Hn/%%n:INDEXPVT=~/mdbox/carpeta_compartida/%%u
> prefix = carpeta_compartida/%%u/
> separator = /
> subscriptions = no
> type = shared
> }
> namespace {
> list = yes
> location = 
> virtual:/etc/dovecot/virtual:INDEX=~/mdbox/virtual:CONTROL=~/mdbox/virtual
> prefix = Carpetas_virtuales/
> separator = /
> }
> passdb {
> args = /etc/dovecot/deny
> deny = yes
> driver = passwd-file
> }
> passdb {
> args = /etc/dovecot/dovecot-ldap.conf
> driver = ldap
> }
> plugin {
> acl = vfile
> acl_shared_dict = file:/buzones/mydomain/acls_compartidas.db
> lda_mailbox_autosubscribe = yes
> mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename
> mail_log_fields = uid box msgid size subject from
> quota = dict:Cuota de usuario::file:/buzones/cuotas/%n
> quota_rule2 = Trash:storage=+10%%
> quota_warning = storage=90%% aviso_cuota 90 %u
> sieve = /buzones/mydomain/%2.26Hn/%2.200Hn/%n/home_usuario/dovecot.sieve
> sieve_dir = /buzones/mydomain/%2.26Hn/%2.200Hn/%n/home_usuario/sieve/
> zlib_save = gz
> zlib_save_level = 9
> }
> pop3_no_flag_updates = yes
> protocols = pop3 imap sieve
> service anvil {
> client_limit = 8504
> }
> service auth {
> client_limit = 12000
> unix_listener auth-master {
> user = entrega
> }
> unix_listener auth-userdb {
> user = entrega
> }
> user = root
> }
> service aviso_cuota {
> executable = script /usr/local/bin/quota-warning.sh
> unix_listener aviso_cuota {
> mode = 0666
> }
> user = entrega
> }
> service config {
> process_min_avail = 1
> }
> service imap-login {
> executable = /usr/libexec/dovecot/imap-login
> group = dovenull
> process_limit = 8000
> process_min_avail = 1
> vsz_limit = 1 G
> }
> service imap {
> executable = /usr/libexec/dovecot/imap
> process_limit = 8000
> }
> service managesieve-login {
> executable = /usr/libexec/dovecot/managesieve-login
> inet_listener sieve {
> port = 2000
> }
> process_limit = 8000
> vsz_limit = 1 G
> }
> service managesieve {
> executable = /usr/libexec/dovecot/managesieve
> process_limit = 8000
> }
> service pop3-login {
> executable = /usr/libexec/dovecot/pop3-login
> process_limit = 8000
> process_min_avail 

Re: [2.3.4] Segmentation faults

2018-11-28 Thread Timo Sirainen
See https://dovecot.org/bugreport.html#coredumps

Without a backtrace it's not really possible to figure out where it's crashing.

> On 28 Nov 2018, at 13.20, Joan Moreau  wrote:
> 
> Where to get that ?
> 
>  
> On 2018-11-27 08:50, Aki Tuomi wrote:
> 
>> It's still missing core dump (or bt full from it)
>> 
>> Aki
>> 
>> On 27.11.2018 8.39, Joan Moreau wrote:
>>> Thank you Aki
>>> 
>>> here the requested data (below)
>>> 
>>> Please not as well that we have numerous subfolders (>50) and pretty big 
>>> mailbox sizes (>20G)
>>> 
>>> Bug appears mostly in auth process and index-worker
>>> 
>>> 
>>> 
>>> dovecot -n :
>>> 
>>> # 2.4.devel (de42b54aa): /etc/dovecot/dovecot.conf
>>> # Pigeonhole version 0.6.devel (65909cfa)
>>> # OS: Linux 4.19.4-arch1-1-ARCH x86_64 ext4
>>> # Hostname: gjserver
>>> base_dir = /run/dovecot
>>> default_login_user = dovecot
>>> default_vsz_limit = 16 G
>>> disable_plaintext_auth = no
>>> listen = *
>>> log_path = /var/log/mail/dovecot.log
>>> mail_gid = mail
>>> mail_location = mdbox:/data/mail/%d/%n:ALT=/data/mail/archives/%d/%n
>>> mail_plugins = fts fts_squat
>>> mail_uid = mailusers
>>> managesieve_notify_capability = mailto
>>> managesieve_sieve_capability = fileinto reject envelope encoded-character 
>>> vacation subaddress comparator-i;ascii-numeric relational regex imap4flags 
>>> copy include variables body enotify environment mailbox date index ihave 
>>> duplicate mime foreverypart extracttext
>>> mdbox_rotate_size = 24 M
>>> 
>>> (...)
>>> 
>>> passdb {
>>> args = /etc/dovecot/dovecot-sql.conf
>>> driver = sql
>>> }
>>> (the rest default values)
>>> 
>>>  
>>> 
>>> 
>>> On 2018-11-25 08:08, Aki Tuomi wrote:
>>> 
>>>  
>>> On 25 November 2018 at 06:29 Joan Moreau < j...@grosjo.net 
>>> > wrote:
>>>  
>>>  
>>> Hi
>>>  
>>> THis is the lines I have in my dmesg (see below)
>>>  
>>> In dovecot log , I see:
>>>  
>>> Nov 25 04:26:47 auth-worker: Error: double free or corruption (fasttop)
>>>  
>>> What do to about it ?
>>>  
>>> Using lastest 2.3.4 version
>>>  
>>> Thank you
>>>  
>>> 
>>>  
>>> [132932.169265] Code: 00 00 00 00 00 00 00 00 00 00 80 00 00 00 00 00 00
>>> 00 21 00 00 00 00 00 00 00 02 00 00 00 00 00 00 00 20 aa 36 f5 7a 7f 00
>>> 00 <40> 24 3d f5 7a 7f 00 00 21 80 00 00 00 00 00 00 00 94 16 d6 ee 55
>>> [134031.969596] auth[27031]: segfault at 55e509612c30 ip
>>> 55e509612c30 sp 7ffeb96dee48 error 15
>>> [134031.969603] Code: 00 00 00 00 00 00 00 00 00 00 80 00 00 00 00 00 00
>>> 00 21 00 00 00 00 00 00 00 02 00 00 00 00 00 00 00 20 3a d3 e4 ef 7f 00
>>> 00 <40> b4 d9 e4 ef 7f 00 00 21 80 00 00 00 00 00 00 00 04 5f 09 e5 55
>>> [134081.497871] doveadm[28930]: segfault at 7ffe4a16efc8 ip
>>> 7f393841013e sp 7ffe4a16efc0 error 6 in
>>> libdovecot.so.0.0.0[7f3938363000+e2000]
>>> [134081.497876] Code: 7d be e9 68 ff ff ff e8 10 4c f5 ff 41 57 41 89 cf
>>> 41 56 49 89 f6 41 55 41 89 fd 31 ff 41 54 55 44 89 c5 53 89 d3 48 83 ec
>>> 58 <4c> 89 4c 24 08 64 48 8b 04 25 28 00 00 00 48 89 44 24 48 31 c0 e8
>>> [134084.145731] doveadm[29186]: segfault at 7fff1cfdbff8 ip
>>> 7f4376e32ffb sp 7fff1cfdc000 error 6 in
>>> libdovecot.so.0.0.0[7f4376d86000+e2000]
>>> [134084.145735] Code: ff 66 0f 1f 44 00 00 e9 9d dc f6 ff 0f 1f 00 48 83
>>> ec 08 48 83 3d 14 16 0b 00 00 0f 85 d2 76 f6 ff 31 f6 48 8d 3d 05 16 0b
>>> 00  00 54 f5 ff 85 c0 0f 88 e4 76 f6 ff 48 83 c4 08 e9 69 dc f6 ff
>>> [135453.211242] indexer-worker[2539]: segfault at 7ffec3ba4ff8 ip
>>> 7ffec43fdcff sp 7ffec3ba5000 error 6
>>> [135453.211245] Code: 95 4c 89 f7 48 89 75 d0 e8 5e fc ff ff 48 8b 75 d0
>>> e9 56 ff ff ff 0f 1f 44 00 00 55 48 89 e5 41 57 41 56 41 55 41 54 49 89
>>> f4 <53> 48 83 ec 08 48 85 ff 0f 84 b3 00 00 00 48 89 fb 4c 8d 35 69 c3
>>> [135453.730250] indexer-worker[9236]: segfault at 7fffed921ff8 ip
>>> 7fb7c9c4f5b1 sp 7fffed922000 error 6 in
>>> libdovecot.so.0.0.0[7fb7c9ba2000+e2000]
>>> [135453.730256] Code: 2e 0f 1f 84 00 00 00 00 00 41 57 4d 89 cf 41 56 41
>>> 89 fe 41 55 49 89 f5 41 54 41 89 d4 55 89 cd 53 48 83 ec 08 4c 8b 4c 24
>>> 40  6a fb ff ff 85 c0 7e 4f 48 8b 05 7f f9 0a 00 be 38 00 00 00 48
>>> [135796.171575] auth[11121]: segfault at 555f8645cc30 ip
>>> 555f8645cc30 sp 7ffcbb510868 error 15
>>> [135796.171586] Code: 00 00 00 00 00 00 00 00 00 00 80 00 00 00 00 00 00
>>> 00 21 00 00 00 00 00 00 00 02 00 00 00 00 00 00 00 20 ba ed 38 b7 7f 00
>>> 00 <40> 34 f4 38 b7 7f 00 00 21 80 00 00 00 00 00 00 00 a4 43 86 5f 55
>>> [136710.562003] auth[17828]: segfault at 563443604c30 ip
>>> 563443604c30 sp 7ffc1aa8b498 error 15
>>> [136710.562013] Code: 00 00 00 00 00 00 00 00 00 00 80 00 00 00 00 00 00
>>> 00 21 00 00 00 00 00 00 00 02 00 00 00 00 00 00 00 20 fa 48 da d5 7f 00
>>> 00 <40> 74 4f da d5 7f 00 00 21 80 00 00 00 00 00 00 00 24 5e 43 34 56
>>> [138331.686718] auth[31046]: segfault at 55b27bc63c30 ip
>>> 55b27bc63c30 sp 7ffd5d5b9298 error 15
>>> [138331.686721] Code: 00 00 00 00 

Error logs with virtual folder after upgrading to 2.3.4

2018-11-28 Thread Maria Arrea
Since I upgraded to 2.3.4 I have lots of line in logs like these:

 

Nov 28 17:35:48 buzalum_rhel7 dovecot: imap(iniramgon@mydomain): Error: unlink(/etc/dovecot/virtual/dovecot-acl-list) failed: Read-only file system (in acl-backend-vfile-acllist.c:338)


Nov 28 17:35:48 buzalum_rhel7 dovecot: imap(iniramgon@mydomain): Error: dovecot-acl-list creation failed: safe_mkstemp(/etc/dovecot/virtual/.temp.buzalum_rhel7.6469.) failed: Read-only file system

 

These lines did not happen with Dovecot 2.3.2.1. doveconf -n output below. I have also tested to create an emty file with userid entrega in /etc/dovecot/virtual/ and works, so it does not seem a problem with permissions. Any idea about this problem?

 



# OS: Linux 3.10.0-862.14.4.el7.x86_64 x86_64 Red Hat Enterprise Linux Server release 7.5 (Maipo) xfs
# Hostname: buzalum_rhel7
auth_cache_negative_ttl = 10 secs
auth_cache_size = 10 M
auth_cache_ttl = 2 mins
auth_master_user_separator = *
auth_mechanisms = plain login
auth_worker_max_count = 90
base_dir = /var/run/dovecot/
default_client_limit = 8192
default_process_limit = 4500
disable_plaintext_auth = no
imap_capability = +XLIST
imap_client_workarounds = tb-extra-mailbox-sep delay-newmail tb-lsub-flags
imap_id_log = *
lda_mailbox_autocreate = yes
lda_mailbox_autosubscribe = yes
mail_fsync = never
mail_gid = entrega
mail_home = /buzones/mydomain/%2.26Hn/%2.200Hn/%n/home_usuario/
mail_location = mdbox:/buzones/mydomain/%2.26Hn/%2.200Hn/%n:INDEX=/indices_dovecot/indices/%2.26Hn/%2.200Hn/%n:ALT=/buzones/alternativo/mydomain/%2.26Hn/%2.200Hn/%n
mail_log_prefix = "%s(%u)<%{session}>: "
mail_max_userip_connections = 15000
mail_plugins = " virtual zlib quota acl mail_log notify"
mail_uid = entrega
managesieve_notify_capability = mailto
managesieve_sieve_capability = fileinto reject envelope encoded-character vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy include variables body enotify environment mailbox date
mdbox_rotate_interval = 1 days
mdbox_rotate_size = 60 M
namespace {
  inbox = yes
  location =
  mailbox Drafts {
    auto = subscribe
    special_use = \Drafts
  }
  mailbox SPAM {
    auto = subscribe
    special_use = \Junk
  }
  mailbox Sent {
    auto = subscribe
    special_use = \Sent
  }
  mailbox Trash {
    auto = subscribe
    special_use = \Trash
  }
  prefix =
  type = private
}
namespace {
  list = yes
  location = mdbox:/buzones/mydomain/%%2.26Hn/%%2.200Hu/%%n:ALT=/buzones/alternativo/mydomain/%%2.26Hn/%%2.200Hn/%%n:INDEX=/indices_dovecot/indices/%%2.26Hn/%%2.200Hn/%%n:INDEXPVT=~/mdbox/carpeta_compartida/%%u
  prefix = carpeta_compartida/%%u/
  separator = /
  subscriptions = no
  type = shared
}
namespace {
  list = yes
  location = virtual:/etc/dovecot/virtual:INDEX=~/mdbox/virtual:CONTROL=~/mdbox/virtual
  prefix = Carpetas_virtuales/
  separator = /
}
passdb {
  args = /etc/dovecot/deny
  deny = yes
  driver = passwd-file
}
passdb {
  args = /etc/dovecot/dovecot-ldap.conf
  driver = ldap
}
plugin {
  acl = vfile
  acl_shared_dict = file:/buzones/mydomain/acls_compartidas.db
  lda_mailbox_autosubscribe = yes
  mail_log_events = delete undelete expunge copy mailbox_delete mailbox_rename
  mail_log_fields = uid box msgid size subject from
  quota = dict:Cuota de usuario::file:/buzones/cuotas/%n
  quota_rule2 = Trash:storage=+10%%
  quota_warning = storage=90%% aviso_cuota 90 %u
  sieve = /buzones/mydomain/%2.26Hn/%2.200Hn/%n/home_usuario/dovecot.sieve
  sieve_dir = /buzones/mydomain/%2.26Hn/%2.200Hn/%n/home_usuario/sieve/
  zlib_save = gz
  zlib_save_level = 9
}
pop3_no_flag_updates = yes
protocols = pop3 imap sieve
service anvil {
  client_limit = 8504
}
service auth {
  client_limit = 12000
  unix_listener auth-master {
    user = entrega
  }
  unix_listener auth-userdb {
    user = entrega
  }
  user = root
}
service aviso_cuota {
  executable = script /usr/local/bin/quota-warning.sh
  unix_listener aviso_cuota {
    mode = 0666
  }
  user = entrega
}
service config {
  process_min_avail = 1
}
service imap-login {
  executable = /usr/libexec/dovecot/imap-login
  group = dovenull
  process_limit = 8000
  process_min_avail = 1
  vsz_limit = 1 G
}
service imap {
  executable = /usr/libexec/dovecot/imap
  process_limit = 8000
}
service managesieve-login {
  executable = /usr/libexec/dovecot/managesieve-login
  inet_listener sieve {
    port = 2000
  }
  process_limit = 8000
  vsz_limit = 1 G
}
service managesieve {
  executable = /usr/libexec/dovecot/managesieve
  process_limit = 8000
}
service pop3-login {
  executable = /usr/libexec/dovecot/pop3-login
  process_limit = 8000
  process_min_avail = 1
  vsz_limit = 1 G
}
service pop3 {
  executable = /usr/libexec/dovecot/pop3
  process_limit = 8000
}
service stats {
  fifo_listener stats-mail {
    mode = 0600
    user = entrega
  }
}
ssl_ca = XXX
ssl_cert = XXX
ssl_dh = # hidden, use -P to show it
ssl_key = # hidden, use -P to show it
userdb {
  driver = passwd
}
userdb {
  args = 

Re: [2.3.4] Segmentation faults

2018-11-28 Thread Joan Moreau

Where to get that ?

On 2018-11-27 08:50, Aki Tuomi wrote:

It's still missing core dump (or bt full from it) 


Aki

On 27.11.2018 8.39, Joan Moreau wrote: 

Thank you Aki 

here the requested data (below) 

Please not as well that we have numerous subfolders (>50) and pretty big mailbox sizes (>20G) 

Bug appears mostly in auth process and index-worker 

dovecot -n : 


# 2.4.devel (de42b54aa): /etc/dovecot/dovecot.conf
# Pigeonhole version 0.6.devel (65909cfa)
# OS: Linux 4.19.4-arch1-1-ARCH x86_64 ext4
# Hostname: gjserver
base_dir = /run/dovecot
default_login_user = dovecot
default_vsz_limit = 16 G
disable_plaintext_auth = no
listen = *
log_path = /var/log/mail/dovecot.log
mail_gid = mail
mail_location = mdbox:/data/mail/%d/%n:ALT=/data/mail/archives/%d/%n
mail_plugins = fts fts_squat
mail_uid = mailusers
managesieve_notify_capability = mailto
managesieve_sieve_capability = fileinto reject envelope encoded-character 
vacation subaddress comparator-i;ascii-numeric relational regex imap4flags copy 
include variables body enotify environment mailbox date index ihave duplicate 
mime foreverypart extracttext
mdbox_rotate_size = 24 M 

(...) 


passdb {
args = /etc/dovecot/dovecot-sql.conf
driver = sql
}
(the rest default values)

On 2018-11-25 08:08, Aki Tuomi wrote: 

On 25 November 2018 at 06:29 Joan Moreau < j...@grosjo.net> wrote: 

Hi 

THis is the lines I have in my dmesg (see below) 

In dovecot log , I see: 

Nov 25 04:26:47 auth-worker: Error: double free or corruption (fasttop) 

What do to about it ? 

Using lastest 2.3.4 version 

Thank you 

 

[132932.169265] Code: 00 00 00 00 00 00 00 00 00 00 80 00 00 00 00 00 00 
00 21 00 00 00 00 00 00 00 02 00 00 00 00 00 00 00 20 aa 36 f5 7a 7f 00 
00 <40> 24 3d f5 7a 7f 00 00 21 80 00 00 00 00 00 00 00 94 16 d6 ee 55 
[134031.969596] auth[27031]: segfault at 55e509612c30 ip 
55e509612c30 sp 7ffeb96dee48 error 15 
[134031.969603] Code: 00 00 00 00 00 00 00 00 00 00 80 00 00 00 00 00 00 
00 21 00 00 00 00 00 00 00 02 00 00 00 00 00 00 00 20 3a d3 e4 ef 7f 00 
00 <40> b4 d9 e4 ef 7f 00 00 21 80 00 00 00 00 00 00 00 04 5f 09 e5 55 
[134081.497871] doveadm[28930]: segfault at 7ffe4a16efc8 ip 
7f393841013e sp 7ffe4a16efc0 error 6 in 
libdovecot.so.0.0.0[7f3938363000+e2000] 
[134081.497876] Code: 7d be e9 68 ff ff ff e8 10 4c f5 ff 41 57 41 89 cf 
41 56 49 89 f6 41 55 41 89 fd 31 ff 41 54 55 44 89 c5 53 89 d3 48 83 ec 
58 <4c> 89 4c 24 08 64 48 8b 04 25 28 00 00 00 48 89 44 24 48 31 c0 e8 
[134084.145731] doveadm[29186]: segfault at 7fff1cfdbff8 ip 
7f4376e32ffb sp 7fff1cfdc000 error 6 in 
libdovecot.so.0.0.0[7f4376d86000+e2000] 
[134084.145735] Code: ff 66 0f 1f 44 00 00 e9 9d dc f6 ff 0f 1f 00 48 83 
ec 08 48 83 3d 14 16 0b 00 00 0f 85 d2 76 f6 ff 31 f6 48 8d 3d 05 16 0b 
00  00 54 f5 ff 85 c0 0f 88 e4 76 f6 ff 48 83 c4 08 e9 69 dc f6 ff 
[135453.211242] indexer-worker[2539]: segfault at 7ffec3ba4ff8 ip 
7ffec43fdcff sp 7ffec3ba5000 error 6 
[135453.211245] Code: 95 4c 89 f7 48 89 75 d0 e8 5e fc ff ff 48 8b 75 d0 
e9 56 ff ff ff 0f 1f 44 00 00 55 48 89 e5 41 57 41 56 41 55 41 54 49 89 
f4 <53> 48 83 ec 08 48 85 ff 0f 84 b3 00 00 00 48 89 fb 4c 8d 35 69 c3 
[135453.730250] indexer-worker[9236]: segfault at 7fffed921ff8 ip 
7fb7c9c4f5b1 sp 7fffed922000 error 6 in 
libdovecot.so.0.0.0[7fb7c9ba2000+e2000] 
[135453.730256] Code: 2e 0f 1f 84 00 00 00 00 00 41 57 4d 89 cf 41 56 41 
89 fe 41 55 49 89 f5 41 54 41 89 d4 55 89 cd 53 48 83 ec 08 4c 8b 4c 24 
40  6a fb ff ff 85 c0 7e 4f 48 8b 05 7f f9 0a 00 be 38 00 00 00 48 
[135796.171575] auth[11121]: segfault at 555f8645cc30 ip 
555f8645cc30 sp 7ffcbb510868 error 15 
[135796.171586] Code: 00 00 00 00 00 00 00 00 00 00 80 00 00 00 00 00 00 
00 21 00 00 00 00 00 00 00 02 00 00 00 00 00 00 00 20 ba ed 38 b7 7f 00 
00 <40> 34 f4 38 b7 7f 00 00 21 80 00 00 00 00 00 00 00 a4 43 86 5f 55 
[136710.562003] auth[17828]: segfault at 563443604c30 ip 
563443604c30 sp 7ffc1aa8b498 error 15 
[136710.562013] Code: 00 00 00 00 00 00 00 00 00 00 80 00 00 00 00 00 00 
00 21 00 00 00 00 00 00 00 02 00 00 00 00 00 00 00 20 fa 48 da d5 7f 00 
00 <40> 74 4f da d5 7f 00 00 21 80 00 00 00 00 00 00 00 24 5e 43 34 56 
[138331.686718] auth[31046]: segfault at 55b27bc63c30 ip 
55b27bc63c30 sp 7ffd5d5b9298 error 15 
[138331.686721] Code: 00 00 00 00 00 00 00 00 00 00 80 00 00 00 00 00 00 
00 21 00 00 00 00 00 00 00 02 00 00 00 00 00 00 00 20 9a 08 17 cd 7f 00 
00 <40> 14 0f 17 cd 7f 00 00 21 80 00 00 00 00 00 00 00 14 c4 7b b2 55 
[138521.070485] auth[32481]: segfault at 556e05197c30 ip 
556e05197c30 sp 7ffe87217c08 error 15 
[138521.070487] Code: 00 00 00 00 00 00 00 00 00 00 80 00 00 00 00 00 00 
00 21 00 00 00 00 00 00 00 02 00 00 00 00 00 00 00 20 aa a7 20 3c 7f 00 
00 <40> 24 ae 20 3c 7f 00 00 21 80 00 00 00 00 00 00 00 54 17 05 6e 55 
[138782.544700] auth[2408]: segfault at 5570d3e46c30 ip 5570d3e46c30 
sp 7ffc9118a5e8 error 15 
[138782.544709] Code: