mail_location for doveadm?

2021-11-04 Thread Grant Keller
Hello,
I am working on getting doveadm commands working from a director to a
backend server and I am hitting a bit of a roadblock. We use a homebrew
hashing algorithm for mail_location, which we set for users in postlogin
scripts. Works fine except I get the following when I run doveadm on a
user:
#  doveadm -D expunge -u gvk mailbox INBOX.Trash SENTBEFORE 1-Jan-2021Debug: 
Loading modules from directory: /usr/lib64/dovecot/doveadm
Debug: Skipping module doveadm_acl_plugin, because dlopen() failed: 
/usr/lib64/dovecot/doveadm/lib10_doveadm_acl_plugin.so: undefined symbol: 
acl_user_module (this is usually intentional, so just ignore this message)
Debug: Skipping module doveadm_expire_plugin, because dlopen() failed: 
/usr/lib64/dovecot/doveadm/lib10_doveadm_expire_plugin.so: undefined symbol: 
expire_set_deinit (this is usually intentional, so just ignore this message)
Debug: Skipping module doveadm_quota_plugin, because dlopen() failed: 
/usr/lib64/dovecot/doveadm/lib10_doveadm_quota_plugin.so: undefined symbol: 
quota_user_module (this is usually intentional, so just ignore this message)
Debug: Skipping module doveadm_fts_lucene_plugin, because dlopen() failed: 
/usr/lib64/dovecot/doveadm/lib20_doveadm_fts_lucene_plugin.so: undefined 
symbol: lucene_index_iter_deinit (this is usually intentional, so just ignore 
this message)
Debug: Skipping module doveadm_fts_plugin, because dlopen() failed: 
/usr/lib64/dovecot/doveadm/lib20_doveadm_fts_plugin.so: undefined symbol: 
fts_user_get_language_list (this is usually intentional, so just ignore this 
message)
Debug: Skipping module doveadm_mail_crypt_plugin, because dlopen() failed: 
/usr/lib64/dovecot/doveadm/libdoveadm_mail_crypt_plugin.so: undefined symbol: 
mail_crypt_box_get_pvt_digests (this is usually intentional, so just ignore 
this message)
doveadm(gvk): Debug: auth-master: passdb lookup(gvk): Started passdb lookup
doveadm(gvk): Debug: auth-master: conn unix:/var/run/dovecot/director-userdb: 
Connecting
doveadm(gvk): Debug: auth-master: conn unix:/var/run/dovecot/director-userdb 
(pid=21984,uid=0): Client connected (fd=11)
doveadm(gvk): Debug: auth-master: passdb lookup(gvk): auth PASS input: user=gvk 
proxy=y proxy_refresh=450 host=c.lab.imapd.sonic.net hostip=184.23.168.77
doveadm(gvk): Debug: auth-master: passdb lookup(gvk): Finished passdb lookup 
(user=gvk proxy=y proxy_refresh=450 host=c.lab.imapd.sonic.net 
hostip=184.23.168.77)
doveadm(gvk): Error: remote(c.lab.imapd.sonic.net:1842): mail_location not set 
and autodetection failed: Mail storage autodetection failed with 
home=/home2/22/25/gvk
doveadm(gvk): Debug: auth-master: conn unix:/var/run/dovecot/director-userdb 
(pid=21984,uid=0): Disconnected: Connection closed (fd=11)

I don't see anything like a doveadm-postlogin service in the
documentation, so how would I go about making this work.


Grant Keller
System Operations
grant.kel...@sonic.com


Re: Recovering deleted messages?

2021-11-04 Thread Benny Pedersen

On 2021-11-05 00:52, Sean McBride wrote:


He was using Thunderbird.  Do you happen to know if it has the
features necessary to attempt what you describe?


only tool i know works is aid4mail, easy to google, but imho thunderbird 
can drag and drop from one accound to another, it aswall can as a buildt 
in feature move to another account via mouse menu, pick the source 
folder, and use mouse to move mails over to another folder on another 
account, this works on the client side always


on the server side people say dovecot dsync, i just miss to know whole 
config of dovecot to use this, it seems a am not alone, so far i have 
solved most with imapsync, but that does not work for pop clients data


in the future possible disable pop after this


Re: Recovering deleted messages?

2021-11-04 Thread Sean McBride
On Thu, 4 Nov 2021 16:21:55 -0700, Shaun Johnson said:

>If the user who did this accidentally still has the POP client
>installed, and said mail client supports multiple accounts - including
>IMAP accounts, the simplest way IMO would be to have him set up a second
>account as an IMAP account, turn off 'sync' for the POP3 account, then
>just drag the messages from the POP3 account inbox over to the IMAP
>account INBOX (then delete the POP3 account).

He was using Thunderbird.  Do you happen to know if it has the features 
necessary to attempt what you describe?

Thanks,

Sean




Re: Recovering deleted messages?

2021-11-04 Thread Shaun Johnson
On Thu, 4 Nov 2021 19:01:03 -0400
"Sean McBride"  wrote:

> Hi all,
> 
> I've run postfix and dovecot for years, but they have been so
> trouble-free that I've never really learned in-depth how they work. :)
> 
> But now I have a user who accidentally used a POP client, and it
> deleted all his email.  He told me this only days later, and it's now
> been days later still, and so of course he has sent and received
> email since.  I have backups of course, but it is a feasible thing to
> 'merge' the deleted emails from the backup into his current mailboxes?
> 
> I couldn't find any FAQ for such a scenario, so thought I'd ask
> here...
> 
> Thanks,
> 
> Sean
> 
> 

If the user who did this accidentally still has the POP client
installed, and said mail client supports multiple accounts - including
IMAP accounts, the simplest way IMO would be to have him set up a second
account as an IMAP account, turn off 'sync' for the POP3 account, then
just drag the messages from the POP3 account inbox over to the IMAP
account INBOX (then delete the POP3 account).

 - Shaun


-- 
"Catch the Magic of Linux..."
www.linuxmagic.com

Shaun Johnson
Development Services - LinuxMagic Inc.

A Wizard IT Company - For More Info http://www.wizard.ca
"LinuxMagic" is a Registered TradeMark of Wizard Tower TechnoServices
Ltd.

604-682-0300 Beautiful British Columbia, Canada

This email and any electronic data contained are confidential 
and intended solely for the use of the individual or entity 
to which they are addressed. Please note that any views or 
opinions presented in this email are solely those of the author 
and are not intended to  represent those of the company.


Re: Recovering deleted messages?

2021-11-04 Thread Dave Stevens
On Thu, 4 Nov 2021 19:01:03 -0400
"Sean McBride"  wrote:

> I have a user who accidentally used a POP client

which one?

d

-- 
Sometimes I wonder whether the world is being run by 
smart people who are putting us on or by imbeciles who 
really believe it.

Mark Twain


Recovering deleted messages?

2021-11-04 Thread Sean McBride
Hi all,

I've run postfix and dovecot for years, but they have been so trouble-free that 
I've never really learned in-depth how they work. :)

But now I have a user who accidentally used a POP client, and it deleted all 
his email.  He told me this only days later, and it's now been days later 
still, and so of course he has sent and received email since.  I have backups 
of course, but it is a feasible thing to 'merge' the deleted emails from the 
backup into his current mailboxes?

I couldn't find any FAQ for such a scenario, so thought I'd ask here...

Thanks,

Sean




Re: Solr FTS - message deletes not working as expected

2021-11-04 Thread Shawn Heisey

On 11/3/21 12:38 PM, Michael Slusarz wrote:

Have you tried another client?



I tried evolution on Linux.

I can't work out how to do an expunge in evolution.  I'm not sure that 
it CAN do it.  Whenever I delete a message, even with shift-delete, it 
is moved to the Trash folder (with delete and add sent to Solr), and 
then emptying the trash does delete from Solr.  This is exactly how 
Thunderbird works with "normal" deletes.


I use shift-delete in Thunderbird a lot.  Because when I delete a 
message, I really want it gone, I do not want another step to remember 
later -- emptying the trash folder.


The FTS behavior on sending a message with Thunderbird seems completely 
wrong.  When I send a message with evolution, I do see a delete in the 
solr log, but there are still two results in a query for the special 
text I included in the message, so something is still not quite right.


I couldn't get Windows Mail to connect to my email account. Even with 
their advanced settings.  I enter all the right information, and it just 
fails to connect.  There are only "Use SSL" checkboxes, and I have no 
idea what port/security settings it's using.  I can't tell it to use 
STARTTLS instead of mandatory TLS, or to use port 143 for imap and 587 
for submission.  I think that I did see a successful imap login in the 
mail.log from the attempt to add the account, but I had other clients 
running so it is difficult to be sure about that. I will have to close 
all my other clients (which includes an Android client) and try the 
connect again.  When the account setup fails to connect, it doesn't have 
an option to add the account anyway (which Thunderbird does have), so I 
can't edit the account settings.


The android client seems to not have an expunge option for deleting 
messages either.  It goes through Trash.


Thanks,
Shawn




Re: Memory leaks in dovecot

2021-11-04 Thread justina colmena ~biz
Random bit-flipping due to aurora borealis from recent X1 class solar flares. 
Do expect soft errors, hard errors, some temporary and some permanent damage to 
computer hardware.

On November 4, 2021 6:41:36 AM AKDT, Joan Moreau  wrote:
>
>
>Hi
>
>Anyone can help on those memory leaks since 2.3.17 ?
>
>These came after adding the fts_mail_user_init(user, FALSE, ) and 
>fts_mail_user_deinit(user) function calls to avoid breaking due to 
>change in the API
>
>Thank you for help
>
>doveadm: Warning: Event 0x5563f3f2b740 leaked (parent=0x5563f3f2b330): 
>mail-user.c:78
>doveadm: Warning: Event 0x5563f3f2b330 leaked (parent=(nil)): 
>mail-storage-service.c:1359
>doveadm: Warning: Event 0x5563f4009ef0 leaked (parent=0x5563f3f4cf80): 
>mail-index.c:67
>doveadm: Warning: Event 0x5563f40096c0 leaked (parent=0x5563f3f4cf80): 
>fs-api.c:32
>doveadm: Warning: Event 0x5563f40092b0 leaked (parent=0x5563f3f4cf80): 
>mail-storage.c:430
>doveadm: Warning: Event 0x5563f3f4cf80 leaked (parent=0x5563f3f21f00): 
>mail-user.c:78
>doveadm: Warning: Event 0x5563f3f21f00 leaked (parent=(nil)): 
>mail-storage-service.c:1359
>doveadm: Warning: Event 0x5563f3f2d080 leaked (parent=0x5563f3f234f0): 
>mail-index.c:67
>doveadm: Warning: Event 0x5563f3f2c820 leaked (parent=0x5563f3f234f0): 
>fs-api.c:32
>doveadm: Warning: Event 0x5563f3f2c300 leaked (parent=0x5563f3f234f0): 
>mail-storage.c:430
>doveadm: Warning: Event 0x5563f3f234f0 leaked (parent=0x5563f3f4e1d0): 
>mail-user.c:78
>doveadm: Warning: Event 0x5563f3f4e1d0 leaked (parent=(nil)): 
>mail-storage-service.c:1359
>doveadm: Warning: Event 0x5563f3f24d20 leaked (parent=0x5563f3fd58b0): 
>mail-index.c:67
>doveadm: Warning: Event 0x5563f3f24620 leaked (parent=0x5563f3fd58b0): 
>fs-api.c:32
>doveadm: Warning: Event 0x5563f3f23e30 leaked (parent=0x5563f3fd58b0): 
>mail-storage.c:430
>doveadm: Warning: Event 0x5563f3fd58b0 leaked (parent=0x5563f3fd54a0): 
>mail-user.c:78
>doveadm: Warning: Event 0x5563f3fd54a0 leaked (parent=(nil)): 
>mail-storage-service.c:1359
>doveadm: Warning: Event 0x5563f3fd6df0 leaked (parent=0x5563f3fcc8a0): 
>mail-index.c:67
>doveadm: Warning: Event 0x5563f3fd65c0 leaked (parent=0x5563f3fcc8a0): 
>fs-api.c:32
>doveadm: Warning: Event 0x5563f3fd5dd0 leaked (parent=0x5563f3fcc8a0): 
>mail-storage.c:430
>doveadm: Warning: Event 0x5563f3fcc8a0 leaked (parent=0x5563f3f1c990): 
>mail-user.c:78
>doveadm: Warning: Event 0x5563f3f1c990 leaked (parent=(nil)): 
>mail-storage-service.c:1359
>doveadm: Warning: Event 0x5563f3f16a20 leaked (parent=0x5563f3fbb710): 
>mail-index.c:67
-- 
Sent from my Android device with K-9 Mail. Please excuse my brevity.

Re: dsync-trouble

2021-11-04 Thread infoomatic

On 04.11.21 09:11, Hanns Mattes wrote:

chown -R 1777 /var/coredumps


that should probably be "chmod -R 1777 /var/coredumps"



Re: Dovecot v2.3.17 released

2021-11-04 Thread lists
The unicode hack is in the comments. Google "Trojan Source". Having never dealt 
with Hebrew and Arabic, it was news to me there is a right to left feature in 
Unicode.

TWIT Security Now (MP3): SN 843: Trojan Source - Chrome 0-days, Windows 11 
confusion, VoIP DDos attacks, Dune 
https://pdst.fm/e/chtbl.com/track/E91833/cdn.twit.tv/audio/sn/sn0843/sn0843.mp3#t=4768
 [01:19:28]

Or look for the paper. Hopefully this isn't too off topic. 




  Original Message  


From: rei...@bbmk.org
Sent: November 4, 2021 2:16 AM
To: dovecot@dovecot.org
Reply-to: dovecot@dovecot.org
Subject: Re: Dovecot v2.3.17 released


On Thu, 4 Nov 2021, Rupert Gallagher wrote:

> Please convert all source code to ASCII. If it fails to compile, then it may
> have a trojan hiding in Unicode clothing.

Did you check yourself?

The only source code files which contain non-7-bit-ASCII characters are
1. src/lib-storage/list/mailbox-list-index-status.c
  * Opportunistic function to see ïf we can extract guid from mailbox path */

i.e. in a /* comment */, and it's 8-bit ASCII not even UTF-anything.

2. src/lib-mail/test-qp-encoder.c
which defines binary data.

I don't think any C compiler allows Unicode in the code itself (instructions,
variables names, etc.)

Cheers.


Re: Dovecot v2.3.17 released

2021-11-04 Thread Bernardo Reino

On Thu, 4 Nov 2021, Rupert Gallagher wrote:

Please convert all source code to ASCII. If it fails to compile, then it may 
have a trojan hiding in Unicode clothing.


Did you check yourself?

The only source code files which contain non-7-bit-ASCII characters are
1. src/lib-storage/list/mailbox-list-index-status.c
 * Opportunistic function to see ïf we can extract guid from mailbox path */

i.e. in a /* comment */, and it's 8-bit ASCII not even UTF-anything.

2. src/lib-mail/test-qp-encoder.c
which defines binary data.

I don't think any C compiler allows Unicode in the code itself (instructions, 
variables names, etc.)


Cheers.


Re: dsync-trouble

2021-11-04 Thread Hanns Mattes
Hi Aki,

Am 04.11.21 um 08:51 schrieb Aki Tuomi:
> That's in IMAP process, not in doveadm process.
> 
> Can you try obtaining the core and producing gdb bt full for it?
> 
> Please refer to https://www.dovecot.org/bugreport-mail/ for more details.

never done before and got no output yet:

sysctl -w kern.sugid_coredump=1
sysctl -w kern.corefile=/var/coredumps/%U.%N.core

mkdir /var/coredumps
chown -R 1777 /var/coredumps

Invoked doveadm-command, but got no dump yet

any hint appreciated

Regards Hanns


Re: dsync-trouble

2021-11-04 Thread Aki Tuomi
That's in IMAP process, not in doveadm process.

Can you try obtaining the core and producing gdb bt full for it?

Please refer to https://www.dovecot.org/bugreport-mail/ for more details.

Aki

> On 04/11/2021 09:50 Hanns Mattes  wrote:
> 
>  
> Hi, Aki,
> 
> Am 04.11.21 um 08:29 schrieb Aki Tuomi:
> > Hi!
> 
> I'm afraid, my problem ist not restricted to doveadm, I can't login to
> the server:
> 
> Nov  4 08:41:32 freebsd dovecot[81830]: imap-login: Login:
> user=, method=CRAM-MD5, rip=94.79.154.202,
> lip=46.4.85.45, mpid=25795, TLS, session=
> Nov  4 08:41:32 freebsd dovecot[81830]:
> imap(t...@hanauix.de)<25795>: Panic: file array.c:
> line 10 (array_idx_modifiable_i): assertion failed: (idx <
> array->buffer->used / array->element_size)
> Nov  4 08:41:32 freebsd dovecot[81830]:
> imap(t...@hanauix.de)<25795>: Fatal: master:
> service(imap): child 25795 killed with signal 6 (core not dumped -
> https://dovecot.org/bugreport.html#coredumps)
> 
> and on the replication-partner I get also ssl-related errors:
> 
> 2021-11-04T08:41:23.147574+01:00 mail dovecot: doveadm(46.4.85.45):
> Error: SSL handshake failed: SSL_accept() failed: error:1408F10B:SSL
> routines:ssl3_get_record:wrong version number
> 
> 
> > Can you send output of 
> > 
> > doveadm -D sync -u x...@zzz.de tcps:mail.bruecko.de
> 
> (remote machine: 2021-11-04T08:47:08.899932+01:00 mail dovecot: doveadm:
> Error: read(SSL 46.4.85.45) failed: EOF (last sent=handshake, last
> recv=handshake)
> 
> here's the output
> 
> root@freebsd:/usr/local/etc/dovecot/conf.d# doveadm -D sync -u
> t...@hanauix.de tcps:mail.bruecko.de
> Debug: Loading modules from directory: /usr/local/lib/dovecot/doveadm
> Debug: Skipping module doveadm_acl_plugin, because dlopen() failed:
> /usr/local/lib/dovecot/doveadm/lib10_doveadm_acl_plugin.so: Undefined
> symbol "acl_user_module" (this is usually intentional, so just ignore
> this message)
> Debug: Skipping module doveadm_quota_plugin, because dlopen() failed:
> /usr/local/lib/dovecot/doveadm/lib10_doveadm_quota_plugin.so: Undefined
> symbol "quota_user_module" (this is usually intentional, so just ignore
> this message)
> Debug: Module loaded:
> /usr/local/lib/dovecot/doveadm/lib10_doveadm_sieve_plugin.so
> Debug: Skipping module doveadm_fts_lucene_plugin, because dlopen()
> failed:
> /usr/local/lib/dovecot/doveadm/lib20_doveadm_fts_lucene_plugin.so:
> Undefined symbol "lucene_index_init" (this is usually intentional, so
> just ignore this message)
> Debug: Skipping module doveadm_fts_plugin, because dlopen() failed:
> /usr/local/lib/dovecot/doveadm/lib20_doveadm_fts_plugin.so: Undefined
> symbol "fts_list_backend" (this is usually intentional, so just ignore
> this message)
> Debug: Skipping module doveadm_mail_crypt_plugin, because dlopen()
> failed: /usr/local/lib/dovecot/doveadm/libdoveadm_mail_crypt_plugin.so:
> Undefined symbol "mail_crypt_user_get_public_key" (this is usually
> intentional, so just ignore this message)
> Nov 04 08:49:59 Debug: Loading modules from directory:
> /usr/local/lib/dovecot
> Nov 04 08:49:59 Debug: Module loaded:
> /usr/local/lib/dovecot/lib01_acl_plugin.so
> Nov 04 08:49:59 Debug: Module loaded:
> /usr/local/lib/dovecot/lib10_quota_plugin.so
> Nov 04 08:49:59 Debug: Module loaded:
> /usr/local/lib/dovecot/lib15_notify_plugin.so
> Nov 04 08:49:59 Debug: Module loaded:
> /usr/local/lib/dovecot/lib20_fts_plugin.so
> Nov 04 08:49:59 Debug: Module loaded:
> /usr/local/lib/dovecot/lib20_zlib_plugin.so
> Nov 04 08:49:59 Debug: Module loaded:
> /usr/local/lib/dovecot/lib21_fts_xapian_plugin.so
> Nov 04 08:49:59 Debug: Loading modules from directory:
> /usr/local/lib/dovecot/doveadm
> Nov 04 08:49:59 Debug: Module loaded:
> /usr/local/lib/dovecot/doveadm/lib10_doveadm_acl_plugin.so
> Nov 04 08:49:59 Debug: Module loaded:
> /usr/local/lib/dovecot/doveadm/lib10_doveadm_quota_plugin.so
> Nov 04 08:49:59 Debug: Skipping module doveadm_fts_lucene_plugin,
> because dlopen() failed:
> /usr/local/lib/dovecot/doveadm/lib20_doveadm_fts_lucene_plugin.so:
> Undefined symbol "lucene_index_init" (this is usually intentional, so
> just ignore this message)
> Nov 04 08:49:59 Debug: Module loaded:
> /usr/local/lib/dovecot/doveadm/lib20_doveadm_fts_plugin.so
> Nov 04 08:49:59 Debug: Skipping module doveadm_mail_crypt_plugin,
> because dlopen() failed:
> /usr/local/lib/dovecot/doveadm/libdoveadm_mail_crypt_plugin.so:
> Undefined symbol "mail_crypt_user_get_public_key" (this is usually
> intentional, so just ignore this message)
> Nov 04 08:49:59 doveadm(t...@hanauix.de): Debug: auth-master: passdb
> lookup(t...@hanauix.de): Started passdb lookup
> Nov 04 08:49:59 doveadm(t...@hanauix.de): Debug: auth-master: conn
> unix:/var/run/dovecot/auth-userdb: Connecting
> Nov 04 08:49:59 doveadm(t...@hanauix.de): Debug: auth-master: conn
> unix:/var/run/dovecot/auth-userdb (uid=0): Client connected (fd=9)
> Nov 04 08:49:59 doveadm(t...@hanauix.de): Debug: auth-master: passdb
> lookup(t...@hanauix.de): auth PASS input: 

Re: dsync-trouble

2021-11-04 Thread Hanns Mattes
Hi, Aki,

Am 04.11.21 um 08:29 schrieb Aki Tuomi:
> Hi!

I'm afraid, my problem ist not restricted to doveadm, I can't login to
the server:

Nov  4 08:41:32 freebsd dovecot[81830]: imap-login: Login:
user=, method=CRAM-MD5, rip=94.79.154.202,
lip=46.4.85.45, mpid=25795, TLS, session=
Nov  4 08:41:32 freebsd dovecot[81830]:
imap(t...@hanauix.de)<25795>: Panic: file array.c:
line 10 (array_idx_modifiable_i): assertion failed: (idx <
array->buffer->used / array->element_size)
Nov  4 08:41:32 freebsd dovecot[81830]:
imap(t...@hanauix.de)<25795>: Fatal: master:
service(imap): child 25795 killed with signal 6 (core not dumped -
https://dovecot.org/bugreport.html#coredumps)

and on the replication-partner I get also ssl-related errors:

2021-11-04T08:41:23.147574+01:00 mail dovecot: doveadm(46.4.85.45):
Error: SSL handshake failed: SSL_accept() failed: error:1408F10B:SSL
routines:ssl3_get_record:wrong version number


> Can you send output of 
> 
> doveadm -D sync -u x...@zzz.de tcps:mail.bruecko.de

(remote machine: 2021-11-04T08:47:08.899932+01:00 mail dovecot: doveadm:
Error: read(SSL 46.4.85.45) failed: EOF (last sent=handshake, last
recv=handshake)

here's the output

root@freebsd:/usr/local/etc/dovecot/conf.d# doveadm -D sync -u
t...@hanauix.de tcps:mail.bruecko.de
Debug: Loading modules from directory: /usr/local/lib/dovecot/doveadm
Debug: Skipping module doveadm_acl_plugin, because dlopen() failed:
/usr/local/lib/dovecot/doveadm/lib10_doveadm_acl_plugin.so: Undefined
symbol "acl_user_module" (this is usually intentional, so just ignore
this message)
Debug: Skipping module doveadm_quota_plugin, because dlopen() failed:
/usr/local/lib/dovecot/doveadm/lib10_doveadm_quota_plugin.so: Undefined
symbol "quota_user_module" (this is usually intentional, so just ignore
this message)
Debug: Module loaded:
/usr/local/lib/dovecot/doveadm/lib10_doveadm_sieve_plugin.so
Debug: Skipping module doveadm_fts_lucene_plugin, because dlopen()
failed:
/usr/local/lib/dovecot/doveadm/lib20_doveadm_fts_lucene_plugin.so:
Undefined symbol "lucene_index_init" (this is usually intentional, so
just ignore this message)
Debug: Skipping module doveadm_fts_plugin, because dlopen() failed:
/usr/local/lib/dovecot/doveadm/lib20_doveadm_fts_plugin.so: Undefined
symbol "fts_list_backend" (this is usually intentional, so just ignore
this message)
Debug: Skipping module doveadm_mail_crypt_plugin, because dlopen()
failed: /usr/local/lib/dovecot/doveadm/libdoveadm_mail_crypt_plugin.so:
Undefined symbol "mail_crypt_user_get_public_key" (this is usually
intentional, so just ignore this message)
Nov 04 08:49:59 Debug: Loading modules from directory:
/usr/local/lib/dovecot
Nov 04 08:49:59 Debug: Module loaded:
/usr/local/lib/dovecot/lib01_acl_plugin.so
Nov 04 08:49:59 Debug: Module loaded:
/usr/local/lib/dovecot/lib10_quota_plugin.so
Nov 04 08:49:59 Debug: Module loaded:
/usr/local/lib/dovecot/lib15_notify_plugin.so
Nov 04 08:49:59 Debug: Module loaded:
/usr/local/lib/dovecot/lib20_fts_plugin.so
Nov 04 08:49:59 Debug: Module loaded:
/usr/local/lib/dovecot/lib20_zlib_plugin.so
Nov 04 08:49:59 Debug: Module loaded:
/usr/local/lib/dovecot/lib21_fts_xapian_plugin.so
Nov 04 08:49:59 Debug: Loading modules from directory:
/usr/local/lib/dovecot/doveadm
Nov 04 08:49:59 Debug: Module loaded:
/usr/local/lib/dovecot/doveadm/lib10_doveadm_acl_plugin.so
Nov 04 08:49:59 Debug: Module loaded:
/usr/local/lib/dovecot/doveadm/lib10_doveadm_quota_plugin.so
Nov 04 08:49:59 Debug: Skipping module doveadm_fts_lucene_plugin,
because dlopen() failed:
/usr/local/lib/dovecot/doveadm/lib20_doveadm_fts_lucene_plugin.so:
Undefined symbol "lucene_index_init" (this is usually intentional, so
just ignore this message)
Nov 04 08:49:59 Debug: Module loaded:
/usr/local/lib/dovecot/doveadm/lib20_doveadm_fts_plugin.so
Nov 04 08:49:59 Debug: Skipping module doveadm_mail_crypt_plugin,
because dlopen() failed:
/usr/local/lib/dovecot/doveadm/libdoveadm_mail_crypt_plugin.so:
Undefined symbol "mail_crypt_user_get_public_key" (this is usually
intentional, so just ignore this message)
Nov 04 08:49:59 doveadm(t...@hanauix.de): Debug: auth-master: passdb
lookup(t...@hanauix.de): Started passdb lookup
Nov 04 08:49:59 doveadm(t...@hanauix.de): Debug: auth-master: conn
unix:/var/run/dovecot/auth-userdb: Connecting
Nov 04 08:49:59 doveadm(t...@hanauix.de): Debug: auth-master: conn
unix:/var/run/dovecot/auth-userdb (uid=0): Client connected (fd=9)
Nov 04 08:49:59 doveadm(t...@hanauix.de): Debug: auth-master: passdb
lookup(t...@hanauix.de): auth PASS input: user=t...@hanauix.de
Nov 04 08:49:59 doveadm(t...@hanauix.de): Debug: auth-master: passdb
lookup(t...@hanauix.de): Finished passdb lookup (user=t...@hanauix.de )
Nov 04 08:49:59 doveadm(t...@hanauix.de)<69843><>: Debug: auth-master:
userdb lookup(t...@hanauix.de): Started userdb lookup
Nov 04 08:49:59 doveadm(t...@hanauix.de)<69843><>: Debug: auth-master:
userdb lookup(t...@hanauix.de): auth USER input: t...@hanauix.de

Re: dsync-trouble

2021-11-04 Thread Aki Tuomi
Hi!

Can you send output of 

doveadm -D sync -u x...@zzz.de tcps:mail.bruecko.de

Aki

> On 03/11/2021 21:22 Hanns Mattes  wrote:
> 
>  
> Hi,
> 
> dsync and replication are failing. They used to work, so I guess, it
> might be related to the update to 2.3.17.
> 
> This is a fresh install of Freebsd 13.
> 
> Please let me know, if further Information is needed (I haven't follow
> Odhiambos advice from another thread yet, but will follow, if requested)
> 
> With replication-plugin disabled:
> 
> # doveadm sync -u x...@zzz.de tcps:mail.bruecko.de
> doveadm(x...@zzz.de): Panic: file array.c: line 10
> (array_idx_modifiable_i): assertion failed: (idx < array->buffer->used /
> array->element_size)
> Abort
> 
> enabled plugin (btw: what makes dovecot trying to sync accounts on a
> fresh install, though the other server isn't configured to replicate
> with freebsd.bruecko.de):
> 
> Nov  3 19:08:28 freebsd dovecot[68537]:
> doveadm(x.z...@yyy.de)<91733>: Fatal: master:
> service(doveadm): child 91733 killed with signal 6 (core not dumped -
> https://dovecot.org/bugreport.html#coredumps)
> 
> I didn't follow Odhiambos advice from another thread yet, but do, if
> requested.
> 
> Any help appreciated
> 
> doveconf -n:
> 
> # 2.3.17 (e2aa53df5b): /usr/local/etc/dovecot/dovecot.conf
> # Pigeonhole version 0.5.17 (054dddfa)
> # OS: FreeBSD 13.0-RELEASE-p4 amd64
> # Hostname: freebsd.bruecko.de
> auth_master_user_separator = *
> auth_mechanisms = plain login digest-md5 cram-md5 apop
> auth_username_chars =
> abcdefghijklmnopqrstuvwxyzABCDEFGHIJKLMNOPQRSTUVWXYZ01234567890+.-_@
> auth_verbose = yes
> doveadm_password = # hidden, use -P to show it
> doveadm_port = 54321
> lda_mailbox_autocreate = yes
> lda_mailbox_autosubscribe = yes
> lda_original_recipient_header = X-Original-To
> lmtp_save_to_detail_mailbox = yes
> mail_location = mdbox:~/mdbox
> mail_plugins = " quota fts fts_xapian zlib notify acl"
> managesieve_notify_capability = mailto
> managesieve_sieve_capability = fileinto reject envelope
> encoded-character vacation subaddress comparator-i;ascii-numeric
> relational regex imap4flags copy include variables body enotify
> environment mailbox date index ihave duplicate mime foreverypart extracttext
> namespace {
>   hidden = no
>   ignore_on_failure = no
>   inbox = no
>   list = children
>   location = mdbox:%%h/mdbox
>   prefix = shared/%%u/
>   separator = /
>   subscriptions = yes
>   type = shared
> }
> namespace {
>   location = mdbox:/virtualmail/public:INDEXPVT=%h/mdbox/Public
>   prefix = Public/
>   separator = /
>   subscriptions = yes
>   type = public
> }
> namespace inbox {
>   inbox = yes
>   location =
>   mailbox Drafts {
> auto = subscribe
> special_use = \Drafts
>   }
>   mailbox Sent {
> auto = subscribe
> special_use = \Sent
>   }
>   mailbox "Sent Messages" {
> special_use = \Sent
>   }
>   mailbox Trash {
> auto = subscribe
> special_use = \Trash
>   }
>   prefix = INBOX/
>   separator = /
> }
> passdb {
>   args = /usr/local/etc/dovecot/master-users
>   driver = passwd-file
>   master = yes
>   pass = yes
> }
> passdb {
>   args = /usr/local/etc/dovecot/dovecot-ldap.conf.ext
>   driver = ldap
> }
> plugin {
>   acl = vfile
>   acl_anyone = allow
>   acl_shared_dict = file:/virtualmail/shared-mailboxes.db
>   fts = xapian
>   fts_autoindex = yes
>   fts_autoindex_exclude = \Trash
>   fts_enforced = yes
>   fts_xapian = partial=3 full=20 verbose=0
>   mail_replica = tcps:mail.bruecko.de
>   quota = dict:User quota::file:%h/dovecot-quota
>   quota_exceeded_message = Storage quota for this account has been
> exceeded, please try again later.
>   quota_grace = 250M
>   quota_rule = *:storage=2500M
>   quota_rule2 = INBOX/Trash:storage=+10%%
>   quota_status_nouser = DUNNO
>   quota_status_overquota = 552 5.2.2 Mailbox is full / Mailbox ist voll
>   quota_status_success = DUNNO
>   quota_warning = storage=95%% quota-warning 95 %u
>   quota_warning2 = storage=80%% quota-warning 80 %u
>   quota_warning3 = storage=75%% quota-warning 75 %u
>   sieve = ~/dovecot.sieve
>   sieve_dir = ~/sieve
>   sieve_global_dir = /virtualmail
>   sieve_max_actions = 0
>   sieve_max_redirects = 64
>   sieve_max_script_size = 0
>   sieve_quota_max_scripts = 0
>   trash = /usr/local/etc/dovecot/dovecot-trash.conf.ext
> }
> postmaster_address = postmas...@bruecko.de
> protocols = imap pop3 lmtp sieve
> replication_dsync_parameters = -d -N -l 30 -U -x Public
> service aggregator {
>   fifo_listener replication-notify-fifo {
> user = vmail
>   }
>   unix_listener replication-notify {
> user = vmail
>   }
> }
> service auth {
>   unix_listener /var/spool/postfix/private/auth {
> mode = 0666
>   }
>   unix_listener auth-userdb {
> group = vmail
> user = vmail
>   }
> }
> service decode2text {
>   executable = script /usr/local/libexec/dovecot/decode2text.sh
>   unix_listener decode2text {
> mode = 0666
>   }
>   user = dovecot
> }
> service doveadm {
>