Re: Strange index error on NFS after upgrade to CentOS 7 from 6

2020-08-25 Thread Alessio Cecchi

Il 25/08/20 16:27, Aki Tuomi ha scritto:

On 25/08/2020 16:43 Alessio Cecchi  wrote:


Hi,
  
  I'm running 3 Dovecot director and 6 Dovecot backend on CentOS 6 and Dovecot 2.3.10, with Maildir shared on NFSv3 (on NetApp).
  
  Since CentOS 6 will be EOL on November I started to upgrade to CentOS 7 the first Dovecot backend.
  
  But after Director start to direct users on new CentOS 7 server some errors, for any users, come up, an example:
  
  Aug 21 14:56:41 Error: imap(ales...@cecchi.it) session=<11sBlmKtj1qelGW/>: Mailbox INBOX: Broken or unexpectedly changed file /home/vmail/domains/cecchi.it/alessio/Maildir/dovecot-uidlist line 18664: Invalid data: - re-reading from beginning

  Aug 21 14:56:41 Error: imap(ales...@cecchi.it) session=<11sBlmKtj1qelGW/>: 
Mailbox INBOX: Broken file 
/home/vmail/domains/cecchi.it/alessio/Maildir/dovecot-uidlist line 18664: Invalid 
data:
  
  Consequently to the error the user see the synchronization of his mailbox again.
  
  The Dovecot version and configuration is the same that in CentOS 6, also the mount parameters are the same, so I suspect that could be some difference in the NFS client implementation on CentOS 7.
  
  This the entry on fstab:
  
  192.168.1.2:/vmail0 /mnt/vmail0 nfs rw,nfsvers=3,noatime,nodiratime,_netdev,nordirplus 0 0

  # Bind for vmail0
  /mnt/vmail0/domains /home/vmail/domains none 
x-systemd.requires=/mnt/vmail0,x-systemd.automount,bind 0 0
  
  In the archive of this list I found a similar issue but without a solutions:
  
  https://dovecot.org/pipermail/dovecot/2018-October/113207.html
  
  Do you have any suggestions?

  Thanks

--
Alessio Cecchi
Postmaster @ http://www.qboxmail.it
https://www.linkedin.com/in/alessice

What versions are you running mixed?

Aki


Hi Aki,

the only mixed version is CentOS version on Dovecot backend:

CentoS 6 backend:

# dovecot -n
# 2.3.10 (0da0eff44): /etc/dovecot/dovecot.conf
# Pigeonhole version 0.5.10 (bf8ef1c2)
# OS: Linux 2.6.32-754.29.2.el6.x86_64 x86_64 CentOS release 6.10 (Final)

Centos 7 backend:

# dovecot -n
# 2.3.10 (0da0eff44): /etc/dovecot/dovecot.conf
# Pigeonhole version 0.5.10 (bf8ef1c2)
# OS: Linux 3.10.0-1127.18.2.el7.x86_64 x86_64 CentOS Linux release 
7.8.2003 (Core)


and also the dovecot configuration is the same (was copied via rsync):

$ diff dovecot-a-cos6.txt dovecot-a-cos7.txt
3,4c3,4
< # OS: Linux 2.6.32-754.29.2.el6.x86_64 x86_64 CentOS release 6.10 (Final)
< # Hostname: pop01
---
> # OS: Linux 3.10.0-1127.18.2.el7.x86_64 x86_64 CentOS Linux release 
7.8.2003 (Core)

> # Hostname: pop02
126c126
< import_environment = TZ CORE_OUTOFMEM CORE_ERROR
---
> import_environment = TZ CORE_OUTOFMEM CORE_ERROR LISTEN_PID LISTEN_FDS

I have noticed this, a user have the "Indalid data" error on Centos 7, I 
moved him to Centos 6, with doveadm director move, and the "Invalid 
data" error come again also on Centos 6 but only one time, like if the 
dovecot-uidlist file was wrong and need to be fixed, but after the "fix" 
executed from Dovecot in Centos 6 the file become fine.


Instead, on Centos 7 the "Invalid data" error comes multiple time.

Thanks

--
Alessio Cecchi
Postmaster @ http://www.qboxmail.it
https://www.linkedin.com/in/alessice



Strange index error on NFS after upgrade to CentOS 7 from 6

2020-08-25 Thread Alessio Cecchi

Hi,

I'm running 3 Dovecot director and 6 Dovecot backend on CentOS 6 and 
Dovecot 2.3.10, with Maildir shared on NFSv3 (on NetApp).


Since CentOS 6 will be EOL on November I started to upgrade to CentOS 7 
the first Dovecot backend.


But after Director start to direct users on new CentOS 7 server some 
errors, for any users, come up, an example:


Aug 21 14:56:41 Error: imap(ales...@cecchi.it) 
session=<11sBlmKtj1qelGW/>: Mailbox INBOX: Broken or unexpectedly 
changed file 
/home/vmail/domains/cecchi.it/alessio/Maildir/dovecot-uidlist line 
18664: Invalid data:  - re-reading from beginning
Aug 21 14:56:41 Error: imap(ales...@cecchi.it) 
session=<11sBlmKtj1qelGW/>: Mailbox INBOX: Broken file 
/home/vmail/domains/cecchi.it/alessio/Maildir/dovecot-uidlist line 
18664: Invalid data:


Consequently to the error the user see the synchronization of his 
mailbox again.


The Dovecot version and configuration is the same that in CentOS 6, also 
the mount parameters are the same, so I suspect that could be some 
difference in the NFS client implementation on CentOS 7.


This the entry on fstab:

192.168.1.2:/vmail0 /mnt/vmail0 nfs 
rw,nfsvers=3,noatime,nodiratime,_netdev,nordirplus    0    0

# Bind for vmail0
/mnt/vmail0/domains /home/vmail/domains none 
x-systemd.requires=/mnt/vmail0,x-systemd.automount,bind 0 0


In the archive of this list I found a similar issue but without a solutions:

https://dovecot.org/pipermail/dovecot/2018-October/113207.html

Do you have any suggestions?
Thanks

--
Alessio Cecchi
Postmaster @ http://www.qboxmail.it
https://www.linkedin.com/in/alessice



Re: Dovecot search message problem

2020-08-25 Thread Claudio Junior
Hi all

I think I solved the problem by changing the treatment of plugins in the
dovecot configuration.
The global definition of the mail_plugins parameter was not being loaded
within protocol sessions. I added the load in all the blocks where the
sessions are defined.
Now I ask, is it necessary to add in all sessions, better to say, the fts
fts_solr plugins would not only be necessary in the imap protocol? This is
a question to ensure less memory usage.
Below is my current configuration:

root@server01:~# doveconf -n
# 2.3.4.1 (f79e8e7e4): /etc/dovecot/dovecot.conf
# Pigeonhole version 0.5.4 ()
# OS: Linux 4.19.0-10-amd64 x86_64 Debian 10.5
# Hostname: server01.example1.com
auth_mechanisms = plain login
disable_plaintext_auth = no
doveadm_password = # hidden, use -P to show it
doveadm_port = 2727
listen = *,[::]
log_timestamp = "%Y-%m-%d %H:%M:%S "
mail_debug = yes
mail_max_userip_connections = 100
mail_plugins = " notify replication fts fts_solr"
mail_privileged_group = vmail
namespace inbox {
  inbox = yes
  location =
  mailbox Drafts {
auto = no
special_use = \Drafts
  }
  mailbox Junk {
auto = subscribe
autoexpunge = 60 days
special_use = \Junk
  }
  mailbox Sent {
auto = no
special_use = \Sent
  }
  mailbox "Sent Messages" {
auto = no
special_use = \Sent
  }
  mailbox Trash {
auto = subscribe
autoexpunge = 60 days
special_use = \Trash
  }
  prefix =
}
passdb {
  args = /etc/dovecot/dovecot-sql.conf
  driver = sql
}
plugin {
  fts = solr
  fts_solr = url=http://localhost:8983/solr/dovecot/
  mail_replica = tcp:xxx.xxx.xxx.3:2727
  quota = dict:user::file:/var/vmail/%d/%n/.quotausage
  sieve = /var/vmail/%d/%n/.sieve
  sieve_max_redirects = 25
}
protocols = imap pop3
service aggregator {
  fifo_listener replication-notify-fifo {
group = root
mode = 0660
user = vmail
  }
  unix_listener replication-notify {
group = root
mode = 0660
user = vmail
  }
}
service auth {
  unix_listener /var/spool/postfix/private/auth {
group = postfix
mode = 0660
user = postfix
  }
  unix_listener auth-userdb {
group = vmail
mode = 0600
user = vmail
  }
  user = root
}
service doveadm {
  inet_listener {
port = 2727
  }
  user = vmail
}
service imap-login {
  client_limit = 1000
  process_limit = 512
}
service lmtp {
  unix_listener /var/spool/postfix/private/dovecot-lmtp {
group = postfix
mode = 0600
user = postfix
  }
}
service replicator {
  process_min_avail = 1
  unix_listener replicator-doveadm {
group = root
mode = 0660
user = vmail
  }
}
service stats {
  unix_listener stats-reader {
group = vmail
mode = 0660
user = vmail
  }
  unix_listener stats-writer {
group = vmail
mode = 0660
user = vmail
  }
}
ssl_ca = 
escreveu:

> Hi
>
> I have a dovecot installed on debian 10 using solr to have a better search
> speed in emails.
> I am observing after an upgrade of the debian dovecot package the error
> below:
>
> Aug 25 00:33:45 server01 dovecot: 
> imap(usern...@example.com)<24104>:
> Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(+0xdb62b)
> [0x7f0faeaeb62b] -> /usr/lib/dovecot/libdovecot.so.0(+0xdb6c1)
> [0x7f0faeaeb6c1] -> /usr/lib/dovecot/libdovecot.so.0(+0x4a149)
> [0x7f0faea5a149] -> /usr/lib/dovecot/libdovecot.so.0(+0x474ac)
> [0x7f0faea574ac] ->
> /usr/lib/dovecot/libdovecot.so.0(message_parser_parse_next_block+0x104)
> [0x7f0faead3844] ->
> /usr/lib/dovecot/libdovecot.so.0(message_search_msg+0xa8) [0x7f0faead5df8]
> -> /usr/lib/dovecot/libdovecot-storage.so.0(+0xcf89e) [0x7f0faec6e89e] ->
> /usr/lib/dovecot/libdovecot-storage.so.0(mail_search_args_foreach+0x45)
> [0x7f0faebf0445] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0xd0774)
> [0x7f0faec6f774] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0xd1a68)
> [0x7f0faec70a68] ->
> /usr/lib/dovecot/libdovecot-storage.so.0(index_storage_search_next_nonblock+0x61)
> [0x7f0faec710e1] ->
> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_search_next_nonblock+0x28)
> [0x7f0faebf9e58] -> dovecot/imap(+0x2691f) [0x55a43cada91f] ->
> dovecot/imap(command_exec+0x70) [0x55a43cad3d80] -> dovecot/imap(+0x25ed2)
> [0x55a43cad9ed2] ->
> /usr/lib/dovecot/libdovecot.so.0(io_loop_handle_timeouts+0x111)
> [0x7f0faeb018f1] ->
> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0xd0)
> [0x7f0faeb03070] ->
> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x4c) [0x7f0faeb01b7c]
> -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x40) [0x7f0faeb01ce0] ->
> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f0faea820d3]
> -> dovecot/imap(main+0x325) [0x55a43cac4bf5] ->
> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xeb) [0x7f0fae86809b] ->
> dovecot/imap(_start+0x2a) [0x55a43cac4d8a]
> Aug 25 00:33:45 server01 dovecot: 
> imap(usern...@example.com)<24104>:
> Fatal: master: service(imap): child 24104 killed with signal 6 (core dumped)
>
> The package versions are:
> ii  dovecot-core  

Panic with namespace

2020-08-25 Thread Kostya Vasilyev

Hi,
I was trying to configure a namespace like this:
10-mail.conf
namespace inbox {
prefix = "iNBox."
inbox = yes
}

And when a client connected, I got the panic below. Dovecot version is 2.3.4.1
(f79e8e7e4) on Debian 10.

Aug 25 16:18:27 kman dovecot: imap(kman@...)<20082>: Panic:
file mailbox-list-maildir-iter.c: line 511 (maildir_list_iter_next
): assertion failed: ((ctx->info.flags & MAILBOX_NOCHILDREN) != 0)
Aug 25 16:18:27 kman dovecot: imap(kman@...)<20082>: Error: 
Raw
backtrace: /usr/lib/dovecot/libdovecot.so.0(+0xdb62b) [0x7f659
9d9962b] -> /usr/lib/dovecot/libdovecot.so.0(+0xdb6c1) [0x7f6599d996c1] ->
/usr/lib/dovecot/libdovecot.so.0(+0x4a149) [0x7f6599d08149] -> /usr/lib/dov
ecot/libdovecot-storage.so.0(+0x45b6e) [0x7f6599e92b6e] ->
/usr/lib/dovecot/libdovecot-storage.so.0(mailbox_list_index_sync+0x1dc)
[0x7f6599f08c6c] ->
/usr/lib/dovecot/libdovecot-storage.so.0(mailbox_list_index_refresh_force+0xfb)
[0x7f6599f0ac3b] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0xb9274
) [0x7f6599f06274] -> /usr/lib/dovecot/libdovecot-storage.so.0(+0xb9467)
[0x7f6599f06467] -> /usr/lib/dovecot/libdovecot-storage.so.0(mailbox_exists+0
x68) [0x7f6599ea70e8] ->
/usr/lib/dovecot/libdovecot-storage.so.0(mailbox_list_mailbox+0x1f6)
[0x7f6599eb6126] -> /usr/lib/dovecot/libdovecot-storage.
so.0(mailbox_list_iter_init_namespaces+0x208) [0x7f6599f0be08] ->
dovecot/imap(cmd_list_full+0x60e) [0x5654c07d02de] ->
dovecot/imap(command_exec+0x70
) [0x5654c07d9d80] -> dovecot/imap(+0x1e3f2) [0x5654c07d83f2] ->
dovecot/imap(+0x1e494) [0x5654c07d8494] ->
dovecot/imap(client_handle_input+0x1b5) [0
x5654c07d8845] -> dovecot/imap(client_input+0x7e) [0x5654c07d8d6e] ->
/usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x6f) [0x7f6599dafadf] -> /usr/
lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x136) [0x7f6599db10d6]
-> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x4c) [0x7f65
99dafb7c] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x40) [0x7f6599dafce0]
-> /usr/lib/dovecot/libdovecot.so.0(master_service_run+0x13) [0x7f659
9d300d3] -> dovecot/imap(main+0x325) [0x5654c07cabf5] ->
/lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xeb) [0x7f6599b1b09b] ->
dovecot/imap(_sta
rt+0x2a) [0x5654c07cad8a]

-- K


Re: unsupported auth mechanism

2020-08-25 Thread absolutely_free
Thank you!
I really appreciate your help



> Il 24/08/2020 18:37 Josef 'Jeff' Sipek  ha 
> scritto:
> 
>  
> On Mon, Aug 24, 2020 at 17:11:04 +0200, absolutely_f...@libero.it wrote:
> > Hi,
> > 
> > last friday I upgraded from dovecot-2.3.10.1_2 to dovecot-2.3.11.3 
> > (FreeBSD).
> > 
> > Since then, I started having some issues with some customers.
> > 
> > The log I see is like:
> > 
> > pop3-login: Disconnected (tried to use unsupported auth mechanism): 
> > user=, method=USER, rip=x,y,x,z, lip=x,y,w,z, 
> > session=
> > 
> > While, before upgrade, same user logged succesfully:
> > 
> > pop3-login: Login: user=, method=PLAIN, rip=x,y,x,z, 
> > lip=x,y,w,z, mpid=62876, session=
> 
> The only thing that comes to mind is the pop3 issue where an auth attempt
> after a failed auth attempt would always fail.  I'm not sure why the client
> that's having issues is failing the first attempt (unless it tries an
> unsupported mechanism first, and then tries to fall back to PLAIN).  Anyway,
> there is a fix on the master branch.
> 
> https://github.com/dovecot/core/commit/d0ea7f9f4530878a40ae0275cf0c36d3ff9111fc
> 
> You can try to patch the 2.3.11.3 code with it and see if that helps.
> 2.3.12 and 2.3.11.4 (if there is one) will have this fix.
> 
> Jeff.
> 
> -- 
> mainframe, n.:
>   An obsolete device still used by thousands of obsolete companies serving
>   billions of obsolete customers and making huge obsolete profits for their
>   obsolete shareholders. And this year's run twice as fast as last year's.


Re: Strange index error on NFS after upgrade to CentOS 7 from 6

2020-08-25 Thread Aki Tuomi


> On 25/08/2020 16:43 Alessio Cecchi  wrote:
> 
> 
> Hi,
>  
>  I'm running 3 Dovecot director and 6 Dovecot backend on CentOS 6 and Dovecot 
> 2.3.10, with Maildir shared on NFSv3 (on NetApp).
>  
>  Since CentOS 6 will be EOL on November I started to upgrade to CentOS 7 the 
> first Dovecot backend.
>  
>  But after Director start to direct users on new CentOS 7 server some errors, 
> for any users, come up, an example:
>  
>  Aug 21 14:56:41 Error: imap(ales...@cecchi.it) session=<11sBlmKtj1qelGW/>: 
> Mailbox INBOX: Broken or unexpectedly changed file 
> /home/vmail/domains/cecchi.it/alessio/Maildir/dovecot-uidlist line 18664: 
> Invalid data: - re-reading from beginning
>  Aug 21 14:56:41 Error: imap(ales...@cecchi.it) session=<11sBlmKtj1qelGW/>: 
> Mailbox INBOX: Broken file 
> /home/vmail/domains/cecchi.it/alessio/Maildir/dovecot-uidlist line 18664: 
> Invalid data:
>  
>  Consequently to the error the user see the synchronization of his mailbox 
> again.
>  
>  The Dovecot version and configuration is the same that in CentOS 6, also the 
> mount parameters are the same, so I suspect that could be some difference in 
> the NFS client implementation on CentOS 7.
>  
>  This the entry on fstab:
>  
>  192.168.1.2:/vmail0 /mnt/vmail0 nfs 
> rw,nfsvers=3,noatime,nodiratime,_netdev,nordirplus 0 0
>  # Bind for vmail0
>  /mnt/vmail0/domains /home/vmail/domains none 
> x-systemd.requires=/mnt/vmail0,x-systemd.automount,bind 0 0
>  
>  In the archive of this list I found a similar issue but without a solutions:
>  
>  https://dovecot.org/pipermail/dovecot/2018-October/113207.html
>  
>  Do you have any suggestions?
>  Thanks
> 
> -- 
> Alessio Cecchi
> Postmaster @ http://www.qboxmail.it
> https://www.linkedin.com/in/alessice

What versions are you running mixed?

Aki


Re: zlib errors after upgrading

2020-08-25 Thread Aki Tuomi


> On 25/08/2020 14:35 Robert Nowotny  wrote:
> 
> 
> I get ZLIB Errors after dovecot upgrade from 2.3.10.1 to 2.3.11.3
> 
> 
>  Aug 21 15:27:34 lxc-imap dovecot: imap(acsida)<63870>: Error: 
> Mailbox Sent: UID=40826: 
> read(zlib(/home/vmail/virtualmailboxes/acsida/storage/m.2409)) failed: 
> read(/home/vmail/virtualmailboxes/acsida/storage/m.2409) failed: Broken pipe 
> (FETCH BODY[])
>  
>  many of those entries
>  
>  after installing2.3.10.1 those files are still broken - but new files are 
> working again.
> 
>  anything I can tweak or do ? 
>  
>

Hi!

Is it possible your mdbox file is corrupted? Can you share doveconf -n?

Aki


zlib errors after upgrading

2020-08-25 Thread Robert Nowotny

I get ZLIB Errors after dovecot upgrade from 2.3.10.1 to 2.3.11.3

Aug 21 15:27:34 lxc-imap dovecot: imap(acsida)<63870>: Error: 
Mailbox Sent: UID=40826: 
read(zlib(/home/vmail/virtualmailboxes/acsida/storage/m.2409)) failed: 
read(/home/vmail/virtualmailboxes/acsida/storage/m.2409) failed: Broken 
pipe (FETCH BODY[])


many of those entries

after installing 2.3.10.1 those files are still broken - but new files 
are working again.


anything I can tweak or do ?



smime.p7s
Description: S/MIME Cryptographic Signature