Re: 2.3.10.1 on OpenBSD
On 2020-07-06, Rupert Gallagher wrote: > Both Dovecot and OpenDKIM packages on OpenBSD are rejecting > connections because of CRYPTO, and they use libressl by default. That's best reported with information (at least version numbers of software involved, relevant logs, and info about which server is having problems) to the package maintainer and/or libressl developers. > I use > openssl because libressl does not implement dane, so I am recompiling > both to serve my use case, and sharing results along the way. It is difficult to correctly build against openssl on a system where the OS and all other packages use libressl. If you mix the two (i.e. headers from libressl and library from openssl or vice-versa, or linking against libraries that pull in "the other" library than you're using - the obvious example in the case of Dovecot would be ldap/mariadb/pgsql libraries) then you can expect it to fail, possibly in exciting ways.
Re: Apple Mail and subfolders
On 11 Jul 2020, at 13:50, Filip Hajný wrote: > > I’ve created a test server and found out that the driving factor is what the > namespace `separator` is set to. If set to /, Apple Mail gets confused and > URL-encodes it when creating a new folder. If the separator is blank (as set > by default) or set to e.g. a dot, everything works just fine. > > Based on example and docs I found, a slash character should be good or even > recommended, suggesting this is some kind of bug in Apple Mail, but I’m not > versed enough in the IMAP related RFCs to understand. Interesting. I have always and only used '.' For the IMAP separator. I believe this was either reacquired or the default way back when with cyrus and I never changed it. -- Margo: P.S. We still hate you. but it's the twenty-first century. It shouldn't be this hard for a girl to get an evil demigod abortion. Eliot: And we're emotionally advanced. We can hold resentment and sympathy for a person at the same time.
Re: Apple Mail and subfolders
> I just created a subfolder in Apple mail. It shows up on the server as > .list.Subfolder > I drug your message into the folder, and the message shows up in Mail.app and > shows up in the subfolder on the server > > # ls -lnR .lists.Subfolder [10:40] > [/usr/local/virtual/krem...@kreme.com/Maildir] > total 56 > drwx-- 2 89 89 512 Jul 11 10:41 cur > -rw--- 1 89 8921 Jul 11 10:41 dovecot-keywords > -rw--- 1 89 89 109 Jul 11 10:41 dovecot-uidlist > -rw--- 1 89 89 1924 Jul 11 10:41 dovecot.index.cache > -rw--- 1 89 89 868 Jul 11 10:41 dovecot.index.log > -rw--- 1 89 89 0 Jul 11 10:35 maildirfolder > drwx-- 2 89 89 512 Jul 11 10:35 new > drwx-- 2 89 89 512 Jul 11 10:41 tmp > I’ve created a test server and found out that the driving factor is what the namespace `separator` is set to. If set to /, Apple Mail gets confused and URL-encodes it when creating a new folder. If the separator is blank (as set by default) or set to e.g. a dot, everything works just fine. Based on example and docs I found, a slash character should be good or even recommended, suggesting this is some kind of bug in Apple Mail, but I’m not versed enough in the IMAP related RFCs to understand. >> >> This definitely used to work fine in the past. >> >> Running 2.3.10.1 as part of the Mailcow suite. > > I'm not familiar with that. Is that running dovecot on your Mac? My server is > a FreeBSD 12.1 machine running dovecot-2.3.10.1_2. Mailcow is a suite of server SW based on Dovecot & Postfix, intended to provide a full-featured mail server. In effect I’m running Dovecot in a Docker container on Alpine Linux. -F
Re: Syncing emails from external server like Gmail
> On 11. Jul 2020, at 14.22, Vitalii wrote: > > Greeting > > I've managed to backup my emails from external email server via dsync > and imapc: protocol like this: > > doveadm -Dv -o imapc_user='u...@gmail.com' -o imapc_password="pass" > -o imapc_host=imap.gmail.com backup -R -u d...@ejoom.com imapc: > It basicly does it to verify mail -> UID pairing. You can try to save imapc indexes locally by defining imapc location as: imapc:~/.imapc to see if it can be skipped. Sami
Re: Apple Mail and subfolders
On 11 Jul 2020, at 08:05, Filip Hajný wrote: > does anybody here use MacOS (Catalina) Mail, who can confirm that subfolders > (i.e. folders inside folders) work for them? Yes, works fine on Catalina (and, if you're curious, Big Sur). > It seems that I cannot create/access Maildir subfolders at all. Subfolders > created in Mail show up as '.folder\2esubfolder' on disk, suggesting that > Apple Mail is URL-coding the dot separator before it passes it onto Dovecot. > No such translation takes place when interpreting the IMAP tree though, > resulting in subfolders rendered as plain entries with the dot separator > preserved. That is odd, but I can't give you suggestions as it's always worked (I've been using Mail.app as my primary MUA since Mac OX X 10.2 or so, when I got off Eudora. > Subfolders can be created from elsewhere (SoGO, Roundube, Thunderbird) just > fine and work here just fine, suggesting that all is well in terms of Dovecot > configuration. Subfolders created here though show up as a proper hierarchy > in Apple Mail, but their contents is not displayed, so the user thinks the > subfolder is empty. I just created a subfolder in Apple mail. It shows up on the server as .list.Subfolder I drug your message into the folder, and the message shows up in Mail.app and shows up in the subfolder on the server # ls -lnR .lists.Subfolder [10:40] [/usr/local/virtual/krem...@kreme.com/Maildir] total 56 drwx-- 2 89 89 512 Jul 11 10:41 cur -rw--- 1 89 8921 Jul 11 10:41 dovecot-keywords -rw--- 1 89 89 109 Jul 11 10:41 dovecot-uidlist -rw--- 1 89 89 1924 Jul 11 10:41 dovecot.index.cache -rw--- 1 89 89 868 Jul 11 10:41 dovecot.index.log -rw--- 1 89 89 0 Jul 11 10:35 maildirfolder drwx-- 2 89 89 512 Jul 11 10:35 new drwx-- 2 89 89 512 Jul 11 10:41 tmp .lists.Subfolder/cur: total 16 -rw--- 1 89 89 6035 Jul 11 08:05 1594476342.M306501P20070.mail.covisp.net,S=6035,W=6154:2,Sab .lists.Subfolder/new: total 0 .lists.Subfolder/tmp: total 0 > > This definitely used to work fine in the past. > > Running 2.3.10.1 as part of the Mailcow suite. I'm not familiar with that. Is that running dovecot on your Mac? My server is a FreeBSD 12.1 machine running dovecot-2.3.10.1_2. -- "Are you pondering what I'm pondering?" "I think so, Brain, but where are we going to get a trained octopus at this time of night?"
Apple Mail and subfolders
Hi all, does anybody here use MacOS (Catalina) Mail, who can confirm that subfolders (i.e. folders inside folders) work for them? It seems that I cannot create/access Maildir subfolders at all. Subfolders created in Mail show up as '.folder\2esubfolder' on disk, suggesting that Apple Mail is URL-coding the dot separator before it passes it onto Dovecot. No such translation takes place when interpreting the IMAP tree though, resulting in subfolders rendered as plain entries with the dot separator preserved. Subfolders can be created from elsewhere (SoGO, Roundube, Thunderbird) just fine and work here just fine, suggesting that all is well in terms of Dovecot configuration. Subfolders created here though show up as a proper hierarchy in Apple Mail, but their contents is not displayed, so the user thinks the subfolder is empty. This definitely used to work fine in the past. Running 2.3.10.1 as part of the Mailcow suite. -F
Syncing emails from external server like Gmail
Greeting I've managed to backup my emails from external email server via dsync and imapc: protocol like this: doveadm -Dv -o imapc_user='u...@gmail.com' -o imapc_password="pass" -o imapc_host=imap.gmail.com backup -R -u d...@ejoom.com imapc: taken from https://wiki.dovecot.org/Migration/Dsync I wish to do regular syncing of 5min interval to substitute 'getmail' program. When I repeat the command It doesn't download all the attachments(!good) but It seems that at retrieve all the the GUIDs and UIDs(!bad) again that take quite long considering 30K emails. The question is how to speed it up and retrieve only new emails? Does anyone have a solution for regular synchronization? What is the best way? Logs look like this: https://gist.githubusercontent.com/vnagara/87e0da1b21b51f68fd74270b3ec653b3/raw/70ebd6d98338aa80c33ecabf7f108f5e7ce10d49/dsync%2520logs.log It wrights that "Mailboxes are equal" but still verifies all the UIDs again. Thanks. Debug: Loading modules from directory: /usr/lib/dovecot/modules/doveadm Debug: Skipping module doveadm_acl_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_acl_plugin.so: undefined symbol: acl_user_module (this is usually intentional, so just ignore this message) Debug: Skipping module doveadm_expire_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_expire_plugin.so: undefined symbol: expire_set_deinit (this is usually intentional, so just ignore this message) Debug: Skipping module doveadm_quota_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_quota_plugin.so: undefined symbol: quota_user_module (this is usually intentional, so just ignore this message) Debug: Module loaded: /usr/lib/dovecot/modules/doveadm/lib10_doveadm_sieve_plugin.so Debug: Skipping module doveadm_fts_lucene_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib20_doveadm_fts_lucene_plugin.so: undefined symbol: lucene_index_iter_deinit (this is usually intentional, so just ignore this message) Debug: Skipping module doveadm_fts_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/lib20_doveadm_fts_plugin.so: undefined symbol: fts_user_get_language_list (this is usually intentional, so just ignore this message) Debug: Skipping module doveadm_mail_crypt_plugin, because dlopen() failed: /usr/lib/dovecot/modules/doveadm/libdoveadm_mail_crypt_plugin.so: undefined symbol: mail_crypt_box_get_pvt_digests (this is usually intentional, so just ignore this message) doveadm(d...@ejoom.com)<5798><>: Debug: auth USER input: d...@ejoom.com home=/var/vmail/ejoom.com/duke mail=mdbox:/var/vmail/ejoom.com/duke/mdbox uid=5000 gid=5000 quota_rule=*:storage=0B sieve=/var/vmail/ejoom.com/duke/.sieve doveadm(d...@ejoom.com)<5798><>: Debug: Added userdb setting: mail=mdbox:/var/vmail/ejoom.com/duke/mdbox doveadm(d...@ejoom.com)<5798><>: Debug: Added userdb setting: plugin/quota_rule=*:storage=0B doveadm(d...@ejoom.com)<5798><>: Debug: Added userdb setting: plugin/sieve=/var/vmail/ejoom.com/duke/.sieve doveadm(d...@ejoom.com): Debug: Effective uid=5000, gid=5000, home=/var/vmail/ejoom.com/duke doveadm(d...@ejoom.com): Debug: Namespace inbox: type=private, prefix=, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=yes location=mdbox:/var/vmail/ejoom.com/duke/mdbox doveadm(d...@ejoom.com): Debug: fs: root=/var/vmail/ejoom.com/duke/mdbox, index=, indexpvt=, control=, inbox=, alt= doveadm(d...@ejoom.com): Debug: brain M: Namespace has location mdbox:/var/vmail/ejoom.com/duke/mdbox doveadm(d...@ejoom.com): Debug: Namespace : Using permissions from /var/vmail/ejoom.com/duke/mdbox: mode=0700 gid=default dsync(d...@ejoom.com): Debug: Effective uid=5000, gid=5000, home=/var/vmail/ejoom.com/duke dsync(d...@ejoom.com): Debug: Namespace inbox: type=private, prefix=, sep=/, inbox=yes, hidden=no, list=yes, subscriptions=yes location=imapc: dsync(d...@ejoom.com): Debug: imapc(imap.gmail.com:993): Created new connection dsync(d...@ejoom.com): Debug: imapc(imap.gmail.com:993): Looking up IP address (reconnect_ok=true, last_connect=1594462325) dsync(d...@ejoom.com): Debug: imapc(imap.gmail.com:993): Connecting to 142.250.31.108:993 dsync(d...@ejoom.com): Info: imapc(imap.gmail.com:993): Connected to 142.250.31.108:993 (local 192.168.1.7:40204) dsync(d...@ejoom.com): Debug: imapc(imap.gmail.com:993): Starting SSL handshake dsync(d...@ejoom.com): Debug: imapc(imap.gmail.com:993): SSL handshake successful dsync(d...@ejoom.com): Debug: imapc(imap.gmail.com:993): Server capabilities: IMAP4rev1 UNSELECT IDLE NAMESPACE QUOTA ID XLIST CHILDREN X-GM-EXT-1 XYZZY SASL-IR AUTH=XOAUTH2 AUTH=PLAIN AUTH=PLAIN-CLIENTTOKEN AUTH=OAUTHBEARER AUTH=XOAUTH dsync(d...@ejoom.com): Debug: imapc(imap.gmail.com:993): Authenticating as d...@ejoom.com dsync(d...@ejoom.com): Debug: imapc(imap.gmail.com:993): Server capabilities: IMAP4rev1 UNSELECT IDLE NAMESPACE QUOTA ID XLIST CHILDREN X-GM-EXT-1 UIDPLUS COMPRESS=DEFLATE ENABLE MOVE
