[Dovecot] LDA and postfix with recipient delimiter: documentation

Just a comment about the documentation for postfix integration when using receipient delimiter and delivery of user+...@domain.ext to u...@domain: http://wiki.dovecot.org/LDA/Postfix I had some issues to get this working, so thought I'd share my experience. Dovecot version 1.2.rc3. Postfix

Re: [Dovecot] LDA and postfix with recipient delimiter:documentation

mr.maX wrote: ${domain} is a somewhat recent addition to Postfix. I guess the docs could say to use ${domain} instead of ${nexthop} if Postfix is newer than X (should look up what version added that). ${domain} parameter has been added starting with Postfix 2.5, which means that people

[Dovecot] recipient delimiter and lmtp

I read in the list archives about work in progress on an lmtp delivery agent.As a previous cyrus user where that was the preferred delivery method from postfix, this sounds interesting. I was wondering whether it will handle recipient delimiters. ie will it be able to map user+...@example.com to

Re: [Dovecot] expire: mysql table creation error

Timo Sirainen wrote: On Thu, 2009-05-28 at 08:04 +0200, John Fawcett wrote: but maybe that's not such a good primary key, probably better to do: mysql CREATE TABLE expires ( - id integer not null auto_increment, - username varchar(100) not null, - mailbox varchar

[Dovecot] Maildir compression utility

Does anyone know of a script to compress old mails stored in a maildir format by carrying out the steps described at http://wiki.dovecot.org/Plugins/Zlib thanks, John

Re: [Dovecot] Maildir compression utility

Steffen Kaiser wrote: On Fri, 29 May 2009, John Fawcett wrote: Does anyone know of a script to compress old mails stored in a maildir format by carrying out the steps described at http://wiki.dovecot.org/Plugins/Zlib I made this script: http://www2.inf.fh-bonn-rhein-sieg.de/skdata

[Dovecot] dovecot corrupted transaction log

Hi I came across this error which happend immedately after a mail delivery to the inbox. Should I look for the problem externally to dovecot (ie. file system, operating system) or within dovecot? I never saw this error before installing 2.2.1, with 2.2.2 I seemed to get even more of them so

Re: [Dovecot] dovecot corrupted transaction log

On 13/06/13 04:31, Timo Sirainen wrote: On Tue, 2013-06-11 at 00:34 +0200, John Fawcett wrote: Hi I came across this error which happend immedately after a mail delivery to the inbox. Should I look for the problem externally to dovecot (ie. file system, operating system) or within dovecot? I

Re: [Dovecot] dovecot corrupted transaction log

On 13/06/13 08:50, John Fawcett wrote: On 13/06/13 04:31, Timo Sirainen wrote: On Tue, 2013-06-11 at 00:34 +0200, John Fawcett wrote: Hi I came across this error which happend immedately after a mail delivery to the inbox. Should I look for the problem externally to dovecot (ie. file system

[Dovecot] dnsbl feature for dovecot

dnsbl's are a popular method to prevent listed ips from making connections to mta software. cf. postscreen_dnsbl_sites in postfix Would it be possible to introduce such a feature in dovecot, so that connections can be denied based on a dnsbl lookup (where the precise dnsbls used are

Re: [Dovecot] dnsbl feature for dovecot

On 03/07/13 05:24, Professa Dementia wrote: On 7/2/2013 7:11 PM, Stan Hoeppner wrote: On 7/2/2013 8:32 PM, Professa Dementia wrote: On 7/2/2013 6:21 PM, John Fawcett wrote: dnsbl's are a popular method to prevent listed ips from making connections to mta software. cf. postscreen_dnsbl_sites

Re: [Dovecot] dnsbl feature for dovecot

On 03/07/13 09:26, Robert Schetterer wrote: Am 03.07.2013 04:11, schrieb Stan Hoeppner: On 7/2/2013 8:32 PM, Professa Dementia wrote: On 7/2/2013 6:21 PM, John Fawcett wrote: dnsbl's are a popular method to prevent listed ips from making connections to mta software. cf

Re: [Dovecot] dnsbl feature for dovecot

On 03/07/13 03:27, Timo Sirainen wrote: On 3.7.2013, at 4.21, John Fawcett john...@erba.tv wrote: dnsbl's are a popular method to prevent listed ips from making connections to mta software. cf. postscreen_dnsbl_sites in postfix Would it be possible to introduce such a feature in dovecot

Re: [Dovecot] dnsbl feature for dovecot

On 03/07/13 18:44, Benny Pedersen wrote: Timo Sirainen skrev den 2013-07-03 03:27: You're talking about IMAP/POP3 connections? Possible, yeah .. possibly even without code changes by using tcpwrappers. why is it needed ? setup fail2ban to manange xtables-addons geoip csv files from

Re: [Dovecot] dnsbl feature for dovecot

On 03/07/13 18:40, Benny Pedersen wrote: John Fawcett skrev den 2013-07-03 03:21: dnsbl's are a popular method to prevent listed ips from making connections to mta software. hmm are pop3/imap clients not authed users ? well done in this case no, I am talking about connections from zombies.

Re: [Dovecot] dnsbl feature for dovecot

On 03/07/13 12:47, Professa Dementia wrote: On 7/3/2013 12:35 AM, John Fawcett wrote: The point is to stop spambot connections to pop and imap (which are usually done to try and steal credentials). This is not the usual way spambots work. Generally, spambots scrape addresses from various

Correct user for replication

Hi I've set up replication with the settings below. With these settings, aggregator runs as user dovecot and replicator as user root. Are those the recommended settings or should I change them, in particular for replicator which is running as a privileged user? service aggregator {

Re: Dovecot dsync tcps sends incomplete certificate chain

On 01/04/2017 08:40 PM, Juri wrote: > Hi, > I'm trying to configure a Dovecot dsync service between two servers, using a > tcp+ssl connection and > a valid Let's Encrypt certificate. > I followed the guide on the wiki (http://wiki.dovecot.org/Replication) using > the tcps method, but > when I

Re: Dovecot dsync tcps sends incomplete certificate chain

On 01/05/2017 08:55 PM, Juri wrote: > 5 Gennaio 2017 01:21, "John Fawcett" <j...@voipsupport.it> wrote: > >> On 01/04/2017 08:40 PM, Juri wrote: >> >> > Thank you. > > In fact I tried both settings, that is > |ssl_client_ca_dir = /etc/ssl

Re: Extra intermediate certificate when using ssl_alt_cert

On 10/03/18 14:06, Aki Tuomi wrote: > >> On 10 March 2018 at 14:49 John Fawcett < j...@voipsupport.it >> <mailto:j...@voipsupport.it>> wrote: >> >> >> On 08/03/18 18:43, Peter Linss wrote: >>> I just added an ECDSA certificate to my m

Re: Extra intermediate certificate when using ssl_alt_cert

On 10/03/18 14:20, John Fawcett wrote: > On 10/03/18 14:06, Aki Tuomi wrote: >> >>> On 10 March 2018 at 14:49 John Fawcett < j...@voipsupport.it >>> <mailto:j...@voipsupport.it>> wrote: >>> >>> >>> On 08/03/18 18:43, Peter Linss wro

Re: Extra intermediate certificate when using ssl_alt_cert

On 08/03/18 18:43, Peter Linss wrote: > I just added an ECDSA certificate to my mail server using ssl_alt_cert (the > RSA certificate is specified by ssl_cert), both certificate files contain the > certificate and a single intermediate (which currently happens to be the same > intermediate from

Re: Panic: file smtp-address.c: line 530 (smtp_address_write): assertion failed: (smtp_char_is_qpair(*p))

On 04/03/18 08:08, A.L.E.C wrote: > On 03/02/2018 03:32 PM, Ralf Hildebrandt wrote: >> The address causing the error is: >> >> From: =?utf-8?Q?Dorit_M=C3=BCller?= >> >> Note the "umlaut" in the email address... :) > This is about SMTPUTF8 (RFC6531). Looks like your only option

Re: Panic: file smtp-address.c: line 530 (smtp_address_write): assertion failed: (smtp_char_is_qpair(*p))

On 03/03/18 22:10, Stephan Bosch wrote: > > Clearly, the relevant specifications don't allow UTF-8 in the local part > without email address internationalization (EAI), which Dovecot does not > support nor announce yet (although that should be mended somewhat soon). > My preferred fix for now

Re: Panic: file smtp-address.c: line 530 (smtp_address_write): assertion failed: (smtp_char_is_qpair(*p))

On 04/03/18 09:55, Stephan Bosch wrote: > Op 3/4/2018 om 9:07 AM schreef John Fawcett: >> On 03/03/18 22:10, Stephan Bosch wrote: >>> Clearly, the relevant specifications don't allow UTF-8 in the local part >>> without email address internationalization (EAI), which D

Re: Coredump: Panic: file smtp-address.c: line 530 (smtp_address_write): assertion failed: (smtp_char_is_qpair(*p))

On 05/03/18 15:14, Ralf Hildebrandt wrote: > Got a coredump: > > Mar 5 15:09:42 mail-cbf dovecot: > lmtp(backup@backup.invalid)<15425><2B+kCaZPnVpBPAAAplP5LA>: Fatal: master: > service(lmtp): child 15425 killed with signal 6 (core dumped) > > > #0 0x7fea19977428 in __GI_raise

Re: [ext] Re: Panic: file smtp-address.c: line 530 (smtp_address_write): assertion failed: (smtp_char_is_qpair(*p))

On 05/03/18 14:03, Ralf Hildebrandt wrote: > * A.L.E.C : >> On 03/02/2018 03:32 PM, Ralf Hildebrandt wrote: >>> The address causing the error is: >>> >>> From: =?utf-8?Q?Dorit_M=C3=BCller?= >>> >>> Note the "umlaut" in the email address... :) >> This is about

Re: IMAP preauth and stats-writer

On 06/01/2019 02:26, John Fawcett wrote: > On 05/01/2019 15:49, Mark Hills wrote: >> I use IMAP preauth; I connect with Alpine over SSH which is very useful. >> >> The last few upgrades this has become more difficult to to. Last time >> (moving 2.2 -> 2.3, I think

Re: IMAP preauth and stats-writer

On 05/01/2019 15:49, Mark Hills wrote: > I use IMAP preauth; I connect with Alpine over SSH which is very useful. > > The last few upgrades this has become more difficult to to. Last time > (moving 2.2 -> 2.3, I think) I had to put in a workaround: > > stats_writer_socket_path = > > It

Re: IMAP preauth and stats-writer

On 06/01/2019 11:37, Stephan Bosch wrote: > > Op 06/01/2019 om 03:35 schreef John Fawcett: >> On 06/01/2019 02:26, John Fawcett wrote: >> >>> Can't see anything in the Dovecot 2.3.4 code that would give this >>> problem, setting >>> >>> stats_w

Feature request: client bind address for replication

Hi would it be possible to consider a new parameter for replication: doveadm_local_ip which allows the source ip address to be set when connection to a remote dovecot for replication? It could be useful when the network interface has multiple ips and a specific one is used for mail services. See

Re: Managesieve problem

On 03/02/2019 18:51, Ervin Hegedüs wrote: > Hi John, > > On Sun, Feb 03, 2019 at 04:44:44PM +0100, John wrote: >> On 2/3/19 2:09 PM, Hegedüs Ervin wrote: >>> Hi John, >>> >>> On Sun, Feb 03, 2019 at 09:56:38AM +0100, John Fawcett wrote: >>>> On

Re: Crash when using dict quotas with sqlite database

On 01/02/2019 20:40, Marcel Menzel wrote: > Hello, > > > After I configured a SQLite backed dict quota backend, the dict process > crashes every time a quota operation is happening. > > SQLite: 3.26.0 > > Dovecot: 2.3.4 (0ecbaf23d) > > Linux: 4.20.4.a-1-hardened #1 SMP PREEMPT Fri Jan 25 01:24:51

Re: Managesieve problem

On 01/02/2019 13:39, Ervin Hegedüs wrote: > Hi, > > I'ld try to set up the managesieve (for RoundCube) - the sieve is > works as well with dovecot (I mean my filters works perfectly). > > When I would try to connect to managesieve, I got an error, and > mail.err contains: > > dovecot:

Re: Dovecot v2.3.9.2 released

On 13/12/2019 15:16, aki.tu...@dovecot.fi wrote: > We are pleased to release v2.3.9.2 of Dovecot. Please find it from > locations below > > https://dovecot.org/releases/2.3/dovecot-2.3.9.2.tar.gz > https://dovecot.org/releases/2.3/dovecot-2.3.9.2.tar.gz.sig > Binary packages in

Re: Solr commit and optimize: which user?

On 15/12/2019 17:13, John Gateley wrote: > Hi, > > I have Solr FTR working with dovecot, and need to do the commit and > optimize recommended here: > https://wiki.dovecot.org/Plugins/FTS/Solr > > Should this run as root, or as each mail user. The documentation above > implies, but doesn't state, >

Re: Newbie question about replication

On 16/10/2020 14:23, Piotr Auksztulewicz wrote: > Hi, > > I am a long-time dovecot user/admin for my family mail server, but > I had ventured into configuring replication only recently and I am not > sure about how it should work and what are the good practices. My intent > for replication was to

Re: Problem reading SSL key

On 17/10/2020 19:13, Tech Support wrote: > > All; > >     I’m trying to setup dovecot to use SSL, but I’m getting an error > message in the logs. I’m getting the error imap-login: Fatal: Couldn't > parse private ssl_key. I’m using a commercial cert so I know that the > .crt and .key files

Re: Strange permissions error - Failed to stat sieve storage path

On 14/10/2020 16:31, Graham Leggett wrote: > Hi all > > I have dovecot-lda set up to run as vmail:vmail, with some sieve scripts in > /var/lib/dovecot/sieve. > > The sieve scripts fail to be found with the following (detailed and very > helpful) error message: > > Oct 14 16:13:33 gatekeeper

Re: v2.3.11.3 solr plugin search via MUA fails to match accented ascii characters; cmd line exec of `doveadm fts lookup` PANICs (assertion failed)

On 12/10/2020 00:27, PGNet Dev wrote: > for _un_accented "tambien", match is correctly -- and quickly -- returned. > > in logs, > > ==> /var/log/dovecot/dovecot-info.log <== > 2020-10-11 14:57:05 imap-login: Info: Login: user=, > method=PLAIN, rip=10.0.1.7, lip=10.0.1.50, mpid=67743,

Re: v2.3.11.3 solr plugin search via MUA fails to match accented ascii characters; cmd line exec of `doveadm fts lookup` PANICs (assertion failed)

for this accented-character search mystery.  I've got a _lot_ > of mail with various languages in bodies, so _do_ need to get this > sorted. > >> On 10/18/20 2:58 PM, John Fawcett wrote: > ... >> silly question > ... > > hardly! > > > creating 2 message

Re: Newbie question about replication

On 18/10/2020 22:53, Piotr Auksztulewicz wrote: > On Sat, Oct 17, 2020 at 11:17:34PM +0200, John Fawcett wrote: >>> I have observed my mail storage directories on both instances and have >>> noticed that they diverge a little over time - the instance B not having >>

Re: v2.3.11.3 solr plugin search via MUA fails to match accented ascii characters; cmd line exec of `doveadm fts lookup` PANICs (assertion failed)

On 19/10/2020 17:00, PGNet Dev wrote: > On 10/19/20 1:18 AM, John Fawcett wrote: >> I would recommend you to redo the tests after correcting the >> configuration. To be doubly sure you can include accented and unique non >> accented text in the same email and search for both

Re: v2.3.11.3 solr plugin search via MUA fails to match accented ascii characters; cmd line exec of `doveadm fts lookup` PANICs (assertion failed)

On 19/10/2020 16:20, PGNet Dev wrote: > On 10/18/20 10:28 PM, Aki Tuomi wrote: >> Dovecot FTS tokenization is not done, unless you have `use_libfts` in >> fts_solr setting, in your case >> >> fts_solr = url=https://solr.example.com:8984/solr/dovecot/ use_libfts > > changing > > -    fts_solr =

Re: v2.3.11.3 solr plugin search via MUA fails to match accented ascii characters; cmd line exec of `doveadm fts lookup` PANICs (assertion failed)

On 19/10/2020 17:56, PGNet Dev wrote: > On 10/19/20 8:24 AM, John Fawcett wrote: > >> Depending how solr has been setup you could see the logging in the web >> server access log. My access log is where I configured it in >> /var/log/httpd/servername.access_log, yours ma

Re: v2.3.11.3 solr plugin search via MUA fails to match accented ascii characters; cmd line exec of `doveadm fts lookup` PANICs (assertion failed)

On 19/10/2020 19:02, PGNet Dev wrote: > On 10/19/20 9:48 AM, John Fawcett wrote: >> --with-icu should be sufficient, actually on centos 7 I got libuci >> compiled in without setting the explicit flag. > >> Here's my ldd, which is under /usr/local/lib/dovecot >>

Re: Indexer error after upgrade to 2.3.11.3

On 21/10/2020 19:00, John Fawcett wrote: > On 21/10/2020 16:44, Patrik Peng wrote: >> On 16.10.20 18:34, Patrik Peng wrote: >>> On 16.10.20 18:00, Scott Q. wrote: >>>> This reminds me, the way I was able to reproduce this consistently >>>>

Re: Indexer error after upgrade to 2.3.11.3 [trial patch]

On 22/10/2020 10:23, John Fawcett wrote: > On 21/10/2020 19:00, John Fawcett wrote: >> On 21/10/2020 16:44, Patrik Peng wrote: >>> On 16.10.20 18:34, Patrik Peng wrote: >>>> On 16.10.20 18:00, Scott Q. wrote: >>>>> This reminds me, the

Re: Dovecot replication not picking up new mail in maildir

On 25/10/2020 17:19, jayare~d...@videocoding.org wrote: > I've got a basic dovecot master-master replication setup between two > servers (imap1 and imap2). Actions such as deleting messages or moving > them between folders are replicated correctly and quickly. > > However, when new mail is

Re: AUTH command behaviour when authentication process failed or aborted by user is changed

On 24/12/2020 08:42, Михаил Сандаков wrote: > Hi all, > > . > > Also seems like new behaviour is not fully accorded to rfc1734 > (https://tools.ietf.org/html/rfc1734 > ). Based on this part of rfc: > "If an AUTH >  command fails with a negative response,

Re: Dovecot+Solr+Tika segmentation fault

On 04/12/2020 09:29, Manuel Josupeit-Walter wrote: A fix was posted on this list which seems to avoid segfaults when using solr+tika. I reposted it not long ago in response to another question. Before exploring the other segfaults it would be worthwhile getting that fix. If

Re: quota-status for outgoing mail (Dovecot/Postfix)

On 06/12/2020 21:13, Peter Folta wrote: > [Dovecot version 2.3.11.3 (502c39af9)] > > Hi all, > > I’m using Dovecot’s quota-status service to let Postfix check the > recipient’s quota before accepting emails following the guide > here: https://blog.sys4.de/postfix-dovecot-mailbox-quota-en.html >

Re: Fts solr add fields message-id, date, in-reply-to

On 07/12/2020 02:21, peacecop kalmer: wrote: > > I remember to have written a message to the list but maybe, it wasn't > to the list but just the sender. Anyway, here it is: > > "Can't you start using an environment where we can separate different > topics and lessen mail traffic? I subscribed to

Re: Fts solr add fields message-id, date, in-reply-to

On 07/12/2020 00:22, michael1970 wrote: > Hi, > > how can I add fields message-id, date, in-reply-to to fts solr index like > hdr,body,subject or to? > > Thanks, Michael > > > > -- > Sent from: http://dovecot.2317879.n4.nabble.com/ Hi Michael I don't think you have to do anything specific. I

Re: Fts solr add fields message-id, date, in-reply-to

On 07/12/2020 02:32, michael1970 wrote: > Hi John, > > I have the standard Dovecot Solr, like in documentation. > > When I query in solr backend > http://127.0.0.1:8983/solr/dovecot/select?q=*%3A* > I see as json: > > "uid":[1075], > "box":["202ab12237483a5e6c139a2345"], >

[patch] enhancement for adding limits to solr and tika parsing

Hi As mentioned in a previous thread, the solr + tika combination has caused me some issues due to attachment size. While tika seems to be able to parse large attachments, the resulting volume of text can overwhelm the solr server. One solution would be to throw resources at the problem, but in

Re: logging in to postfixadmin failed probably because of a dovecot error

On 02/12/2020 02:25, peacecop kalmer: wrote: > > I can’t log in to postfixadmin anymore. It says that the username or > password is incorrect. It can’t be incorrect as I’ve stored them in > Google and “Chrome”. I have two admin accounts and none of them can’t > be used for logging in. So I changed

Re: dovecot/imap killed with signal 6 after SEARCH in specific mailbox

On 07/12/2020 16:58, Jiri wrote: > Hi All, > on my older production server (Deb9 dovecot version 2.2.27-3+deb9u6) a > client reported that searching text in one mailbox failed while other > mailboxes do search ok. > He is using Rouddcube webmail and is searching the whole messages > including the

Re: Question about login_log_format_elements in a proxy environment

On 07/12/2020 06:02, Adi Pircalabu wrote: > Hi, > > I have a Dovecot proxy setup with several proxy machines (currently > running 2.3.11.3) in front of the real Dovecot servers (2.3.10.1) > storing the mailboxes. "doveconf -a | egrep lip" returns: > login_log_format_elements = user=<%u> method=%m

Re: Question about login_log_format_elements in a proxy environment

On 08/12/2020 01:01, Adi Pircalabu wrote: > On 08-12-2020 10:33, Adi Pircalabu wrote: >> On 08-12-2020 9:41, John Fawcett wrote: >>> On 07/12/2020 23:22, John Fawcett wrote: >>>> On 07/12/2020 23:09, Adi Pircalabu wrote: >>>>> On 08-12-2020 3:13, John F

Re: Question about login_log_format_elements in a proxy environment

On 07/12/2020 23:22, John Fawcett wrote: > On 07/12/2020 23:09, Adi Pircalabu wrote: >> On 08-12-2020 3:13, John Fawcett wrote: >>> On 07/12/2020 06:02, Adi Pircalabu wrote: >>>> Hi, >>>> >>>> I have a Dovecot proxy setup with several pro

Re: Question about login_log_format_elements in a proxy environment

On 07/12/2020 23:09, Adi Pircalabu wrote: > On 08-12-2020 3:13, John Fawcett wrote: >> On 07/12/2020 06:02, Adi Pircalabu wrote: >>> Hi, >>> >>> I have a Dovecot proxy setup with several proxy machines (currently >>> running 2.3.11.3) in front of th

Re: Dovecot+Solr+Tika segmentation fault

On 30/11/2020 09:45, Manuel Josupeit-Walter wrote: > Hi all, > > I am running a mail server for family and friends based on Dovecot and > Docker. Today I made a weird observation which I must have overlooked > for a long time so far because they logs were written to the journal. > However, I am

Re: Unexpected behavior of doveadm mailbox delete -e -s

On 13/12/2020 05:59, Mar Alegre wrote: > Hello, > > I have encountered what I believe to be a bug, or at least inaccurate > documentation. I am running version 2.3.4.1 of Dovecot (installed via > the default repo for Debian 10), so my apologies if this has been > fixed in a more recent version. I

Potential issue with lmtp_rawlog_dir when using TLS

Hi not sure why this happens, but looks like lmtp_rawlog_dir blocks the successful negotiation of an lmtp starttls connection. Reproducible with openssl s_client.  Two runs with only difference the presence of lmtp_rawlog_dir setting in dovecot config. Failed connection with lmtp_rawlog_dir

Re: dovecot fts-solr + solr 8.7.0 upgrade: "Indexing failed: 401 Unauthorized" + "Transaction commit failed: FTS transaction commit failed: backend deinit" ?

On 13/11/2020 14:56, PGNet Dev wrote: > I've built a new dovecot + fts-solr instance; I've now picked up & am > running the recently released solr 8.7.0. > > In a test account, I've one message -- in the 'Drafts' folder. > > On exec of fts 'index' > > doveadm index -u testu...@example.com -q

Re: dovecot fts-solr + solr 8.7.0 upgrade: "Indexing failed: 401 Unauthorized" + "Transaction commit failed: FTS transaction commit failed: backend deinit" ?

On 13/11/2020 21:32, PGNet Dev wrote: > On 11/13/20 11:37 AM, John Fawcett wrote: >>> still dunno why the 401. :-/ >> >> So I just did a quick check of running dovecot with a standalone >> solr-8.7.0 instance and I'm not seeing any issues. > > +1 > >

Re: dovecot fts-solr + solr 8.7.0 upgrade: "Indexing failed: 401 Unauthorized" + "Transaction commit failed: FTS transaction commit failed: backend deinit" ?

On 13/11/2020 19:55, PGNet Dev wrote: > On 11/13/20 9:56 AM, PGNet Dev wrote: >>> (2) see here: https://wiki.dovecot.org/Plugins/FTS/Solr >>> >>> two useful settings are debug and rawlog_dir=whatever to be added in >>> the same line as fts_solr > > with > > fts_solr = ... debug > > line #35 @

Re: dovecot fts-solr + solr 8.7.0 upgrade: "Indexing failed: 401 Unauthorized" + "Transaction commit failed: FTS transaction commit failed: backend deinit" ?

On 13/11/2020 22:04, PGNet Dev wrote: >> I guess you didn't need to enclose username and password in quotes, i.e. >> >> fts_solr = >> url=https://myuser:my%40p...@solr.example.com:8984/solr/dovecot/ >> use_libfts soft_commit=yes batch_size=250 > > On 11/13/20

Re: dovecot fts-solr + solr 8.7.0 upgrade: "Indexing failed: 401 Unauthorized" + "Transaction commit failed: FTS transaction commit failed: backend deinit" ?

On 13/11/2020 22:30, John Fawcett wrote: > On 13/11/2020 22:04, PGNet Dev wrote: >>> I guess you didn't need to enclose username and password in quotes, i.e. >>> >>> fts_solr = >>> url=https://myuser:my%40p...@solr.example.com:8984/solr/dovecot/ >&g

Re: [patch] enhancement for tika server protected by user/password basic auth

On 16/11/2020 01:14, PGNet Dev wrote: > On 11/15/20 1:29 PM, John Fawcett wrote: >>> atm, listening on localhost, with Dovecot -> Tika direct, no proxy. >>> >>> similarly fragile under load.  throwing ~10 messages with .5-5MB >>> attachments at

Re: last-login Plugin

On 16/11/2020 11:55, Andrea Gabellini wrote: > Hello, > > i'm using last_login plugin and store data into a MySql DB. I'm using > version 2.3.10.1 and the config is at the end of the email. > > I would like to store also the remote IP and the session name. The > config is working but other

[patch] enhancement for tika server protected by user/password basic auth

Hi The existing code is designed for a tika server on local host, or on a remote host that is either accessable to all or for example taht is protected by ip restrictions via a proxy in front of it. I've configured a tika server behind an apache proxy which enforces basic auth, but sending basic

Re: [patch] enhancement for tika server protected by user/password basic auth

On 15/11/2020 18:10, John Fawcett wrote: > On 15/11/2020 15:49, PGNet Dev wrote: >> On 11/15/20 6:33 AM, John Fawcett wrote: >>> I've configured a tika server behind an apache proxy which enforces >>> basic auth, but sending basic auth credentials for a tika server is

Re: [patch] enhancement for tika server protected by user/password basic auth

On 15/11/2020 20:48, PGNet Dev wrote: > On 11/15/20 11:13 AM, John Fawcett wrote: >> Just a couple of updates about Tika and Solr together. >> >> 1. On mass reindexing I'm seeing panics - see below. These are present >> with Dovecot 2.3.10 and 2.3.11.3. Seem to

Re: [patch] enhancement for tika server protected by user/password basic auth

On 15/11/2020 15:49, PGNet Dev wrote: > On 11/15/20 6:33 AM, John Fawcett wrote: >> I've configured a tika server behind an apache proxy which enforces >> basic auth, but sending basic auth credentials for a tika server is not >> currently supported by Dovecot. > > i w

Re: [patch] enhancement for tika server protected by user/password basic auth

On 15/11/2020 21:54, PGNet Dev wrote: > On 11/15/20 12:21 PM, John Fawcett wrote: >> I'm using tika-server.jar installed as a service > > yup. same here. > > atm, listening on localhost, with Dovecot -> Tika direct, no proxy. > > similarly fragile under load.  thr

Re: Delivering locally through the Submission Server

On 02/11/2020 20:17, R. Diez wrote: > Hi all: > > I am learning Dovecot step by step. I have enabled the Submission > Server, in the hope that I would not need to learn other MTAs like > Postfix. the submission server is a proxy in front of an MTA. You can't avoid having an MTA somewhere in your

Re: Delivering locally through the Submission Server

On 02/11/2020 21:33, R. Diez wrote: > >> what should it do with the non local messages or local messages directly >> at aliases? > > OK, so I gather that the Submission Server cannot do that (yet). > > My suggestion for a future version would then be: How about running > dovecot-lda, if the user

Re: HIGHESTMODSEQ replication issue

On 09/10/2020 21:17, Gustavo Ajeitos [Office365] wrote: > Hello, > > I'm using dovecot 2.3.10 in OpenSUSE and I have configured a > master/master replication between two backends, it works well but I > have found an issue with the replication of the HIGHESTMODSEQ. > When I move a set of message

Re: Indexer error after upgrade to 2.3.11.3 [trial patch]

On 31/10/2020 00:18, Scott Q. wrote: > I have implemented this change and the core dumps went away. > > It appears so far that it's indeed the right fix. > > Has this change been introduced in 2.3.11.3 ?  > > Thanks! I've also been running it for 4 days without any further panics / segfaults and

Re: v2.3.11.3 solr plugin search via MUA fails to match accented ascii characters; cmd line exec of `doveadm fts lookup` PANICs (assertion failed) [proposed patch]

On 31/10/2020 04:57, PGNet Dev wrote: > On 10/18/20 10:28 PM, Aki Tuomi wrote: >>> doveadm(myu...@example.com): Panic: file mail-storage.c: line >>> 2112 (mailbox_get_open_status): assertion failed: (box->opened) > ... > >> I can reproduce your problem with the `fts lookup` command. Luckily >>

Re: Indexer error after upgrade to 2.3.11.3 [trial patch]

On 31/10/2020 15:15, Scott Q. wrote: > But do you know how this bug was introduced ? > > I checked the history of that file and don't see anything introduced > recently that might cause > this:  > https://github.com/dovecot/core/commits/master/src/lib-http/http-client-request.c >

Re: v2.3.11.3 solr plugin search via MUA fails to match accented ascii characters; cmd line exec of `doveadm fts lookup` PANICs (assertion failed) [proposed patch]

On 31/10/2020 22:01, PGNet Dev wrote: > On 10/31/20 9:55 AM, John Fawcett wrote: >> I can contribute a patch that solves the segfault. Unfortunately though >> fts search may be more broken than this. It does not give me search >> results, even though I see it querying

Re: v2.3.11.3 solr plugin search via MUA fails to match accented ascii characters; cmd line exec of `doveadm fts lookup` PANICs (assertion failed) [proposed patch]

On 01/11/2020 15:20, PGNet Dev wrote: > On 11/1/20 1:56 AM, John Fawcett wrote: >> At the moment I don't see other corrections needed in dovecot apart from >> command line doveadm fts which is not a show stopper. Via doveadm search >> I confirm - on my simple config - tha

Re: v2.3.11.3 solr plugin search via MUA fails to match accented ascii characters; cmd line exec of `doveadm fts lookup` PANICs (assertion failed) [proposed patch]

On 31/10/2020 17:55, John Fawcett wrote: > On 31/10/2020 04:57, PGNet Dev wrote: >> On 10/18/20 10:28 PM, Aki Tuomi wrote: >>>> doveadm(myu...@example.com): Panic: file mail-storage.c: line >>>> 2112 (mailbox_get_open_status): assertion failed: (box->opened

Re: Indexer error after upgrade to 2.3.11.3

On 21/10/2020 16:44, Patrik Peng wrote: > On 16.10.20 18:34, Patrik Peng wrote: >> On 16.10.20 18:00, Scott Q. wrote: >>> This reminds me, the way I was able to reproduce this consistently >>> was by having large headers ( 100+ lines ). >>> >>> >>> On Friday, 16/10/2020 at 11:49 Patrik Peng wrote:

Re: HIGHESTMODSEQ replication issue

On 04/11/2020 18:33, Gustavo Ajeitos [Office365] wrote: > Hi John, > >     Thank you for your answer! > > I agree with you, I think you recommendation should solve the problem, > it seems the only possible workaround. > I have to investigate if it possible and how to accomplish that with > the

Re: Solr and FTS - assertion failure [proposed patch for upper bound on rows in solr search]

On 30/12/2020 16:04, Antonino Esposito wrote: > Hi, > > in the latest weeks i'm working on the Solr integration and > immediately i've faced the assertion failure errors, on 2.0.19, 2.2.9 > and 2.3.11.3 servers in our network. > Reading the thread on debian ML, I realize this issue is related to >

Re: Solr and FTS - assertion failure

On 30/12/2020 16:04, Antonino Esposito wrote: > Hi, > > in the latest weeks i'm working on the Solr integration and > immediately i've faced the assertion failure errors, on 2.0.19, 2.2.9 > and 2.3.11.3 servers in our network. > Reading the thread on debian ML, I realize this issue is related to >

Re: fts_solr: Indexing failed (fails on particular messages/mailboxes by timeout)

On 15/01/2021 11:39, Alexey Panov wrote: > I guess I was indeed correct. As message body is the part of mail > index dovecot indeed sends all those binary messages as a part of > message body: > >> doveadm fetch -u test.u...@interpont.com >> "body" mailbox KS2 uid

Re: [BUG REPORT] In some cases dovecot sends (huge) binary data to solr for indexing

t; <https://filebin.ca/5oy6yqLSCr3H/rawlog.obfuscated.txt> > > (Both files were processed with perl doveadm-obfuscate.pl > <https://www.dovecot.org/tools/doveadm-obfuscate.pl>; the script > doesn’t replace non-latin characters so they were replaced with ‘R’ > manually) > > Wo

Re: Dovecot 2.3.11.3 LMTP dropping connection after first part of multipart message received

On 10/12/2020 14:58, Steve Akerman wrote: > Good afternoon > > I have been using Dovecot with great success for several months now > with one problem: > > I have received several messages (3 to date out of a much larger > number) which cause Dovecot LMTP to drop the connection with sendmail >

Re: Getting panic in http-client-request.c: line 1240 during indexing on Ubuntu 20.04

On 07/02/2021 20:15, @lbutlr wrote: > On 07 Feb 2021, at 02:07, @lbutlr wrote: >> On 06 Feb 2021, at 11:06, John Fawcett wrote: >>> 19.08.20 >> Is that a malformed ISO date 2019-08-20 or a truncated europeans style >> 19-08-2020? > Either way, I cannot find

Re: fts_encoder

On 07/02/2021 18:51, Joan Moreau wrote: > > more info : the function fts_parser_script_more in > plugins/fts/fts-parser.c properly read the output of the script > > still, the data is not sent to the FTS pligins (xapian or any other) > > > > On 2021-02-07 17:37, Joan Moreau wrote: > >> more info :

Re: fts_encoder

On 08/02/2021 15:22, Joan Moreau wrote: > > Well, thank you for the answer, but the actual issue is that data sent > by the decoder (stipulated in the conf file) is properly collected by > dovecot core, but /not/ sent to the plugin : the plugin receives the > original data. > > This is not

Re: Getting panic in http-client-request.c: line 1240 during indexing on Ubuntu 20.04

On 08/02/2021 18:40, deano-dove...@areyes.com wrote: > > On 2021-02-07 7:32 pm, John Fawcett wrote: > >> On 07/02/2021 20:15, @lbutlr wrote: >>> On 07 Feb 2021, at 02:07, @lbutlr >> <mailto:krem...@kreme.com>> wrote: >>>> On 06 Feb 2021, at

Re: fts_encoder

On 08/02/2021 21:35, Joan Moreau wrote: > > Well, in the function xxx_build_more of FTS plugin, the data received > in the original PDF, not the output of pdftotext > > Can you clarify where do you put your log in the solr plugin , so I > can check the situation in the xapian plugin ? > I used the

Re: fts_encoder

On 08/02/2021 23:05, Stuart Henderson wrote: > On 2021/02/08 21:33, Joan Moreau wrote: >> Yes , once again : output of the decoder is fine, I also put log inide the >> dovecot core to >> check whether data is properly transmitted, and result is that it is (i.e. >> dovecot core >> receives the

Re: fts_encoder

On 09/02/2021 15:33, Joan Moreau wrote: > > If I place the following code in the plugin > fts_backend_xxx_update_build_more function (lucene, squat and xapian, > as solr refuses to work properly on my setup) > >         { >                 char * s = i_strdup("EMPTY"); >                 if(data !=

  1   2   >