Re: Userdb problem

2021-11-11 Thread Erwan David

Le 11/11/2021 à 21:31, Erwan David a écrit :

Hello

I am trying to move authentication from ldap to passwdfile. 
Autentication works, but clients do not find the mails.



With ldap I have :

root@email:~ # doveadm auth login erwan x
passdb: erwan auth succeeded
extra fields:
 user=erwan
userdb extra fields:
 erwan
 home=/var/db/mailboxes/erwan
 /var/db/mailboxes/erwan=/var/db/mailboxes/erwan
 uid=587
 gid=587
 auth_mech=PLAIN

With passwdfile I get

root@email:~ # doveadm auth login erwan x
passdb: erwan auth succeeded
extra fields:
 user=erwan
userdb extra fields:
 erwan
 home=/var/db/mailboxes/erwan,uid=587,gid=587
 uid=587
 gid=587
 auth_mech=PLAIN

The only difference is this 
"/var/db/mailboxes/erwan=/var/db/mailboxes/erwan" (which is the place 
where email is stored).



There is an obvious other difference in the home field... Sorry I only 
saw it when reading again my email...





Userdb problem

2021-11-11 Thread Erwan David

Hello

I am trying to move authentication from ldap to passwdfile. 
Autentication works, but clients do not find the mails.



With ldap I have :

root@email:~ # doveadm auth login erwan x
passdb: erwan auth succeeded
extra fields:
 user=erwan
userdb extra fields:
 erwan
 home=/var/db/mailboxes/erwan
 /var/db/mailboxes/erwan=/var/db/mailboxes/erwan
 uid=587
 gid=587
 auth_mech=PLAIN

With passwdfile I get

root@email:~ # doveadm auth login erwan x
passdb: erwan auth succeeded
extra fields:
 user=erwan
userdb extra fields:
 erwan
 home=/var/db/mailboxes/erwan,uid=587,gid=587
 uid=587
 gid=587
 auth_mech=PLAIN

The only difference is this 
"/var/db/mailboxes/erwan=/var/db/mailboxes/erwan" (which is the place 
where email is stored).



What is the problem with this ?


auth configuration is :


passdb {
  driver = passwd-file
  args = scheme=SHA512-CRYPT username_format=%n 
/usr/local/etc/dovecot/users

}

userdb {
  driver = passwd-file
  args = username_format=%n /usr/local/etc/dovecot/users

  # Default fields that can be overridden by passwd-file
  #default_fields = quota_rule=*:storage=1G
  default_fields = home=/var/db/mailboxes/%n,uid=587,gid=587

  # Override fields from passwd-file
  #override_fields = home=/home/virtual/%u
  override_fields = home=/var/db/mailboxes/%n,uid=587,gid=587
}




Re: dovecot-2.3.17: "Panic: file ioloop.c: line 865"

2021-11-11 Thread Piper Andreas

Hello,

  
Can you install dovecot debug symbols and redo the gdb backtrace? Package name is likely `dovecot-dbg`.




done, thanks for the hint.

Andreas

(gdb) bt
#0  __GI_raise (sig=sig@entry=6) at ../sysdeps/unix/sysv/linux/raise.c:51
#1  0x7f4e58be0921 in __GI_abort () at abort.c:79
#2  0x7f4e59427a11 in default_fatal_finish (status=0, 
type=LOG_TYPE_PANIC) at failures.c:459
#3  fatal_handler_real (ctx=, format=, 
args=) at failures.c:471
#4  0x7f4e59427b01 in i_internal_fatal_handler (ctx=, 
format=, args=)

at failures.c:872
#5  0x7f4e593744a7 in i_panic (format=format@entry=0x7f4e5946ab88 
"file %s: line %d (%s): assertion failed: (%s)")

at failures.c:524
#6  0x7f4e5944121c in io_loop_destroy 
(_ioloop=_ioloop@entry=0x7ffd0e203e68) at ioloop.c:865
#7  0x563d0150ffb6 in doveadm_print_server_flush () at 
doveadm-print-server.c:106

#8  0x563d01508fb7 in doveadm_print (
value=0x563d0269ced8 "AQAAAFoYRziwaStNyDEAAEKX94joZK5JAwQ", 'A' 
, "DMu73BjjBalfFPQAANPIMJnB2rkkBAg", 'A' 
, "EAAAD3Gkc4sGkrTcgxAABCl/eI02OuSQID", 'A' 
, "gAAAD4SNQYx691evBkAANXM"...)

at doveadm-print.c:87
#9  0x563d014f4427 in cmd_dsync_run (_ctx=0x563d01fc7cc8, 
user=) at doveadm-dsync.c:713
#10 0x563d014f6a44 in doveadm_mail_next_user 
(ctx=ctx@entry=0x563d01fc7cc8, error_r=error_r@entry=0x7ffd0e204108)

at doveadm-mail.c:462
#11 0x563d014f76be in doveadm_mail_single_user 
(ctx=ctx@entry=0x563d01fc7cc8, error_r=error_r@entry=0x7ffd0e204108)

at doveadm-mail.c:493
#12 0x563d014f7c6f in doveadm_mail_cmd_exec (wildcard_user=0x0, 
ctx=0x563d01fc7cc8) at doveadm-mail.c:654
#13 doveadm_cmd_ver2_to_mail_cmd_wrapper (cctx=) at 
doveadm-mail.c:983
#14 0x563d01508c1b in doveadm_cmd_run_ver2 (argc=argc@entry=9, 
argv=argv@entry=0x563d01f6b3d0, cctx=cctx@entry=0x7ffd0e204260)

at doveadm-cmd.c:465
#15 0x563d0150d612 in doveadm_cmd_server_run_ver2 
(cctx=0x7ffd0e204260, argv=0x563d01f6b3d0, argc=9, conn=0x563d01fc1988)

at client-connection-tcp.c:187
#16 doveadm_cmd_handle (cctx=0x7ffd0e204260, argv=, 
argc=, cmd_name=,

conn=0x563d01fc1988) at client-connection-tcp.c:214
#17 client_handle_command (args=, conn=0x563d01fc1988) at 
client-connection-tcp.c:284
#18 client_connection_tcp_input (conn=0x563d01fc1988) at 
client-connection-tcp.c:436
#19 0x7f4e594406d9 in io_loop_call_io (io=0x563d01fc5950) at 
ioloop.c:737
#20 0x7f4e59442034 in io_loop_handler_run_internal 
(ioloop=ioloop@entry=0x563d01f73ed0) at ioloop-epoll.c:222
#21 0x7f4e594407e0 in io_loop_handler_run (ioloop=) 
at ioloop.c:789
#22 0x7f4e59440a18 in io_loop_run (ioloop=0x563d01f73ed0) at 
ioloop.c:762
#23 0x7f4e593a6a23 in master_service_run (service=0x563d01f73d30, 
callback=) at master-service.c:863
#24 0x563d014e6922 in main (argc=, argv=out>) at main.c:124


--

Dr. Andreas Piper, Hochschulrechenzentrum der Philipps-Univ. Marburg
  Hans-Meerwein-Straße 6, 35032 Marburg, Germany
Phone: +49 6421 28-23521  Fax: -26994  E-Mail: pi...@hrz.uni-marburg.de



smime.p7s
Description: S/MIME Cryptographic Signature


Re: dovecot-2.3.17: "Panic: file ioloop.c: line 865"

2021-11-11 Thread Aki Tuomi
> On 11/11/2021 15:53 Piper Andreas  wrote:
> 
>  
> Hello,
> 
> since the upgrade from dovecot-2.3.16 to 2.3.17 I get 'Panic'-errors in 
> the system-log of my replicator hosts. See below for log messages, 
> doveconf-output and gdb-backtrace. Storage filesystem is ZFS.
> 
> The error seems to be correlated with exactly one user-mailbox, this 
> user is repeatedly noted as 'failed' in replication status, although 
> replication of this mailbox seems to work, as the mailbox status shows 
> always the identical size on both replicators. The error can be produced 
> by forcing replication of this individual mailbox.
> 
> Is there anything I can do to repair this mailbox?
> 
> Thanks for any hints,
> Andreas
> 
 
Can you install dovecot debug symbols and redo the gdb backtrace? Package name 
is likely `dovecot-dbg`.

Aki


dovecot-2.3.17: "Panic: file ioloop.c: line 865"

2021-11-11 Thread Piper Andreas

Hello,

since the upgrade from dovecot-2.3.16 to 2.3.17 I get 'Panic'-errors in 
the system-log of my replicator hosts. See below for log messages, 
doveconf-output and gdb-backtrace. Storage filesystem is ZFS.


The error seems to be correlated with exactly one user-mailbox, this 
user is repeatedly noted as 'failed' in replication status, although 
replication of this mailbox seems to work, as the mailbox status shows 
always the identical size on both replicators. The error can be produced 
by forcing replication of this individual mailbox.


Is there anything I can do to repair this mailbox?

Thanks for any hints,
Andreas

Example log-messages:

Nov 11 07:17:50 vhrz311 dovecot: doveadm(119455): Error: write() 
failed: Timed out after 60 seconds
Nov 11 07:17:50 vhrz311 dovecot: doveadm(119455): Panic: file ioloop.c: 
line 865 (io_loop_destroy): assertion failed: (ioloop == cur

rent_ioloop)
Nov 11 07:17:50 vhrz311 dovecot: doveadm(119455): Error: Raw backtrace: 
/usr/lib/dovecot/libdovecot.so.0(backtrace_append+0x42) [0x7
f4e59419182] -> /usr/lib/dovecot/libdovecot.so.0(backtrace_get+0x1e) 
[0x7f4e5941929e] -> /usr/lib/dovecot/libdovecot.so.0(+0xf8a5e)
[0x7f4e59427a5e] -> /usr/lib/dovecot/libdovecot.so.0(+0xf8b01) 
[0x7f4e59427b01] -> /usr/lib/dovecot/libdovecot.so.0(i_fatal+0) [0x7f
4e593744a7] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_destroy+0x2dc) 
[0x7f4e5944121c] -> dovecot/doveadm-server(+0x46fb6) [0x563d0
150ffb6] -> dovecot/doveadm-server(doveadm_print+0x27) [0x563d01508fb7] 
-> dovecot/doveadm-server(+0x2b427) [0x563d014f4427] -> dove
cot/doveadm-server(+0x2da44) [0x563d014f6a44] -> 
dovecot/doveadm-server(doveadm_cmd_ver2_to_mail_cmd_wrapper+0x2cf) 
[0x563d014f7c6f]
 -> dovecot/doveadm-server(doveadm_cmd_run_ver2+0x43b) [0x563d01508c1b] 
-> dovecot/doveadm-server(+0x44612) [0x563d0150d612] -> /usr
/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x69) [0x7f4e594406d9] -> 
/usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal
+0x134) [0x7f4e59442034] -> 
/usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x50) 
[0x7f4e594407e0] -> /usr/lib/dovecot/libdovec
ot.so.0(io_loop_run+0x38) [0x7f4e59440a18] -> 
/usr/lib/dovecot/libdovecot.so.0(master_service_run+0x13) 
[0x7f4e593a6a23] -> dovecot/
doveadm-server(main+0x102) [0x563d014e6922] -> 
/lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xe7) [0x7f4e58bc1bf7] 
-> dovecot/d

oveadm-server(_start+0x2a) [0x563d014e69aa]
Nov 11 07:17:50 vhrz311 dovecot: doveadm(119455): Fatal: master: 
service(doveadm): child 119455 killed with signal 6 (core dumped)


'doveconf -n':

# 2.3.17 (e2aa53df5b): /etc/dovecot/dovecot.conf
# Pigeonhole version 0.5.17 (054dddfa)
# OS: Linux 4.15.0-162-generic x86_64 Ubuntu 18.04.6 LTS
# Hostname: vhrz311.HRZ.Uni-Marburg.DE
auth_cache_negative_ttl = 0
auth_cache_size = 10 M
auth_master_user_separator = *
auth_worker_max_count = 1024
base_dir = /var/run/dovecot/
default_client_limit = 1
default_vsz_limit = 6 G
doveadm_password = # hidden, use -P to show it
doveadm_port = 12345
first_valid_gid = 1
first_valid_uid = 1
imap_max_line_length = 640 k
last_valid_gid = 1
last_valid_uid = 1
mail_attribute_dict = file:%h/mdbox/dovecot-attributes
mail_gid = 1
mail_location = mdbox:%h/mdbox
mail_plugins = " mail_log notify zlib notify replication"
mail_privileged_group = mail
mail_uid = 1
managesieve_notify_capability = mailto
managesieve_sieve_capability = fileinto reject envelope 
encoded-character vacation subaddress comparator-i;ascii-numeric 
relational regex imap4flags copy include variables body enotify 
environment mailbox date index ihave duplicate mime foreverypart extracttext

namespace inbox {
  hidden = no
  inbox = yes
  list = yes
  location =
  prefix =
  separator = /
  subscriptions = yes
  type = private
}
passdb {
  args = /etc/dovecot.deny
  deny = yes
  driver = passwd-file
}
passdb {
  args = /etc/dovecot/private/passwd.masterusers
  driver = passwd-file
  master = yes
}
passdb {
  args = /etc/dovecot/dovecot-ldap.hrz.conf.ext
  driver = ldap
  name = passdb_ldap_hrz
}
passdb {
  args = /etc/dovecot/dovecot-ldap.staff.conf.ext
  driver = ldap
  name = passdb_ldap_staff
}
passdb {
  args = /etc/dovecot/dovecot-ldap.students.conf.ext
  driver = ldap
  name = passdb_ldap_students
}
plugin {
  mail_replica = tcp:172.25.1.95
  sieve = file:~/sieve;active=~/.dovecot.sieve
  sieve_default = /var/lib/dovecot/default.sieve
  sieve_max_actions = 55
  sieve_max_redirects = 50
}
pop3_uidl_format = %08Xv%08Xu
postmaster_address = postmas...@hrz.uni-marburg.de
protocols = imap pop3 lmtp sieve
replication_dsync_parameters = -d -n INBOX -l 30 -U
replication_max_conns = 20
service aggregator {
  fifo_listener replication-notify-fifo {
user = vmail
  }
  unix_listener replication-notify {
user = vmail
  }
}
service auth-worker {
  user = $default_internal_user
}
service auth {
  client_limit = 1
}
service config {
  process_min_avail = 8
}
service doveadm {
  inet_listener {
port 

2.3.17: Panic on LMTP deliveries

2021-11-11 Thread Michael Glaus
Hello

Since the doevcot update to 2.3.17 i get a panic if a mail is delivered with 
lmtp.
In the logs i get these messages:

lmtp(r...@example.com)<21067>: Error: lmtp-server: conn 
10.0.0.105:52981 [1]: rcpt r...@example.com: duplicate db: User 
r...@example.com doesn't have home dir set, disabling duplicate database
lmtp(r...@example.com)<21067>: Panic: file imem.c: line 
65 (i_strconcat): assertion failed: (str1 != NULL)
lmtp(r...@example.com)<21067>: Fatal: master: 
service(lmtp): child 21067 killed with signal 6 (core dumped)

In the running config userdb does not return the field “home” and therefor a 
user does not have a “mail_home” only a “mail_location”.
If i change the config to provide a “mail_home” it works, but due to the 
directory structure i can not change this yet.

Best regards

Michael Glaus
Junior System Administrator
-- 
Hostpoint AG
Neue Jonastrasse 60 | 8640 Rapperswil-Jona | Schweiz
michael.gl...@hostpoint.ch | www.hostpoint.ch