dsync will be removed in 2.4 - why?
Hi there, I recently learned that dsync (mail replication) functionality will be removed in the upcoming releases of dovecot. What is the reason and will there be a replacement? How can I synchronize my e-mails in the future? Thanks a lot. Regards Oliver ___ dovecot mailing list -- dovecot@dovecot.org To unsubscribe send an email to dovecot-le...@dovecot.org
dovecot replication problem
Hi there, I'm experiencing the following when I replicate mails between two host, using different versions of dovecot: *Host A Host B result* dovecot-2.3-19 --> dovecort-2.3.16 ERROR: auth: Error: All password databases were skipped. doveadm(10.0.0.1,oliver.kr...@snoog.ch): Error: auth-master: passdb lookup(oliver.kr...@snoog.ch): Auth PASS lookup failed mail | 2024-07-04T14:21:35.635047+00:00 mail dovecot: doveadm(10.0.0.1,oliver.kr...@snoog.ch): Error: /run/dovecot/auth-userdb: passdb lookup failed (to see if user is proxied, because doveadm_port is set) dovecot-2.3-21 --> dovecort-2.3.16 no errors, working Basically it does work with 2.3-21 --> 2.3-16 and it does not work with 2.3-19 ---> 2.3-16 without any changes in the configuration files. Any ideas? Thank you very much. Best regards Oliver ___ dovecot mailing list -- dovecot@dovecot.org To unsubscribe send an email to dovecot-le...@dovecot.org
Debian community repository (bookworm)
Hi there, I 'can not find the debian community repository for dovecot-xxx-2.3.21. In fact https://repo.dovecot.org/ce-2.3-latest/debian/ does not provide bookworm. Any ideas? Thank you very much. Best regards Oliver ___ dovecot mailing list -- dovecot@dovecot.org To unsubscribe send an email to dovecot-le...@dovecot.org
Re: Error: fts_solr: received invalid uid
Hi Aki, this is it, it's working again with 2.3.17.1 ! Thx a lot. Regards Oliver On 2022-01-06 22:21, Aki Tuomi wrote: Have you tried 2.3.17.1? You can get packages from https://repo.dovecot.org/ Aki On 06/01/2022 21:45 oliver.kr...@snoog.ch wrote: Hello, I made serveral tests, never had a problemm woth dovecot version 2.3.4 with 2.3.13 things get worse and dovecot crashes. I might have read someting in the release notes of dovecot 2.3.13. that there is a problem. Regards Oliver > On 1/2/22 3:08 PM, John Fawcett wrote: >> unless I'm missing something that doesn't look like the type of query >> dovecot launches - dovecot sends various parameters including the >> request for xml results. The thing that looks odd to me is that the >> results fields should be single values not arrays enclosed in [], ie I >> would have expected >> "uid":21, >> >> instead of >> >> "uid":[21], >> >> I'd be interested to see the equivalent xml output produced by running >> a query that dovecot sends. >> > > This Solr instance is not configured properly for dovecot.? Most of the > fields are configured as multiValued (which is why you see an array > rather than a single value), and the response is JSON.? A Solr instance > that is properly configured for dovecot would return XML, not JSON. > > You're going to want to provide a proper solrconfig.xml and > managed-schema file, restart Solr or reload the core for dovecot, and > do > a full reindex.? At the following URL, you can find the shell script > that I use to do a full reindex: > > https://apaste.info/tK1B > > At the following URL are links to the solrconfig.xml and schema that > are > appropriate for dovecot.? These instructions say to name the schema > file > "schema.xml" ... this will work, as long as Solr has read-write access > to the conf directory so it can rename the file to "managed-schema".? > If > it doesn't, then you should name the file "managed-schema" yourself. > > https://doc.dovecot.org/configuration_manual/fts/solr/ > > Thanks, > Shawn
Re: Error: fts_solr: received invalid uid
Hello, I made serveral tests, never had a problemm woth dovecot version 2.3.4 with 2.3.13 things get worse and dovecot crashes. I might have read someting in the release notes of dovecot 2.3.13. that there is a problem. Regards Oliver On 1/2/22 3:08 PM, John Fawcett wrote: unless I'm missing something that doesn't look like the type of query dovecot launches - dovecot sends various parameters including the request for xml results. The thing that looks odd to me is that the results fields should be single values not arrays enclosed in [], ie I would have expected "uid":21, instead of "uid":[21], I'd be interested to see the equivalent xml output produced by running a query that dovecot sends. This Solr instance is not configured properly for dovecot.? Most of the fields are configured as multiValued (which is why you see an array rather than a single value), and the response is JSON.? A Solr instance that is properly configured for dovecot would return XML, not JSON. You're going to want to provide a proper solrconfig.xml and managed-schema file, restart Solr or reload the core for dovecot, and do a full reindex.? At the following URL, you can find the shell script that I use to do a full reindex: https://apaste.info/tK1B At the following URL are links to the solrconfig.xml and schema that are appropriate for dovecot.? These instructions say to name the schema file "schema.xml" ... this will work, as long as Solr has read-write access to the conf directory so it can rename the file to "managed-schema".? If it doesn't, then you should name the file "managed-schema" yourself. https://doc.dovecot.org/configuration_manual/fts/solr/ Thanks, Shawn
Re: Error: fts_solr: received invalid uid
Hi John, You are right this was not a dovecot solr query. It is really strange everything seems to work with Dovecot 2.3.4. E.g. search and rebuilding index from scratch using doveadm. As soon as I use version 2.3.13 things are getting wild: dovecot crashed when I re-scan the index using doveadm and search does not work anymore, after re-scan: Panic: file http-client-request.c: line 1240 (http_client_request_send_more): assertion failed: (req->payload_input != NULL) doveadm(kr...@invectrix.ch): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(backtrace_append+0x42) [0x7fc54cace4e2] -> /usr/lib/dovecot/libdovecot.so.0(backtrace_get+0x1e) [0x7fc54cace5fe] -> /usr/lib/dovecot/libdovecot.so.0(+0xfc49b) [0x7fc54cada49b] -> /usr/lib/dovecot/libdovecot.so.0(+0xfc4d1) [0x7fc54cada4d1] -> /usr/lib/dovecot/libdovecot.so.0(+0x53aee) [0x7fc54ca31aee] -> /usr/lib/dovecot/libdovecot.so.0(+0x4aec2) [0x7fc54ca28ec2] -> /usr/lib/dovecot/libdovecot.so.0(http_client_connection_output+0xee) [0x7fc54ca7ebde] -> /usr/lib/dovecot/libdovecot.so.0(+0x122171) [0x7fc54cb00171] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x69) [0x7fc54caeff59] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x132) [0x7fc54caf1592] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x50) [0x7fc54caf] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x40) [0x7fc54caf01c0] -> /usr/lib/dovecot/libdovecot.so.0(+0x9c4cd) [0x7fc54ca7a4cd] -> /usr/lib/dovecot/libdovecot.so.0(http_client_request_finish_payload+0x2c) [0x7fc54ca7a6dc] -> /usr/lib/dovecot/modules/lib20_fts_plugin.so(+0xf243) [0x7fc54c0a6243] -> /usr/lib/dovecot/modules/lib20_fts_plugin.so(fts_parser_more+0x25) [0x7fc54c0a5345] -> /usr/lib/dovecot/modules/lib20_fts_plugin.so(+0xbfcf) [0x7fc54c0a2fcf] -> /usr/lib/dovecot/modules/lib20_fts_plugin.so(fts_build_mail+0xa27) [0x7fc54c0a3a87] -> /usr/lib/dovecot/modules/lib20_fts_plugin.so(+0x11f0b) [0x7fc54c0a8f0b] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_precache+0x2e) [0x7fc54cbf14ae] -> doveadm(+0x3761f) [0x55d18bdbf61f] -> doveadm(+0x31bad) [0x55d18bdb9bad] -> doveadm(+0x32860) [0x55d18bdba860] -> doveadm(doveadm_cmd_ver2_to_mail_cmd_wrapper+0x22d) [0x55d18bdbb4ad] -> doveadm(doveadm_cmd_run_ver2+0x4c8) [0x55d18bdcbb88] -> doveadm(doveadm_cmd_try_run_ver2+0x3a) [0x55d18bdcbbda] -> doveadm(main+0x1d0) [0x55d18bdaa450] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xea) [0x7fc54c69fd0a] -> doveadm(_start+0x2a) [0x55d18bdaa92a] and solr: 2022-01-03 00:13:20.829 ERROR (qtp1991278377-21) [ x:dovecot] o.a.s.s.HttpSolrCall null:[com.ctc.wstx.exc.WstxLazyException] com.ctc.wstx.exc.WstxIOException: Early EOF Caused by: org.eclipse.jetty.io.EofException: Early EOF at org.eclipse.jetty.server.HttpInput$3.getError(HttpInput.java:1143) at org.eclipse.jetty.server.HttpInput$3.noContent(HttpInput.java:1131) at org.eclipse.jetty.server.HttpInput.read(HttpInput.java:318) Seems like dovecot is sending an empty query? Oliver Hi Oliver unless I'm missing something that doesn't look like the type of query dovecot launches - dovecot sends various parameters including the request for xml results. The thing that looks odd to me is that the results fields should be single values not arrays enclosed in [], ie I would have expected "uid":21, instead of "uid":[21], I'd be interested to see the equivalent xml output produced by running a query that dovecot sends. John
Re: Error: fts_solr: received invalid uid (John Fawcett)
Hi John, You are right this was not a dovecot solr query. It is really strange everything seems to work with Dovecot 2.3.4. E.g. search and rebuilding index from scratch using doveadm. As soon as I use version 2.3.13 things are getting wild: dovecot crashed when I re-scan the index using doveadm and search does not work anymore, after re-scan: Panic: file http-client-request.c: line 1240 (http_client_request_send_more): assertion failed: (req->payload_input != NULL) doveadm(kr...@invectrix.ch): Error: Raw backtrace: /usr/lib/dovecot/libdovecot.so.0(backtrace_append+0x42) [0x7fc54cace4e2] -> /usr/lib/dovecot/libdovecot.so.0(backtrace_get+0x1e) [0x7fc54cace5fe] -> /usr/lib/dovecot/libdovecot.so.0(+0xfc49b) [0x7fc54cada49b] -> /usr/lib/dovecot/libdovecot.so.0(+0xfc4d1) [0x7fc54cada4d1] -> /usr/lib/dovecot/libdovecot.so.0(+0x53aee) [0x7fc54ca31aee] -> /usr/lib/dovecot/libdovecot.so.0(+0x4aec2) [0x7fc54ca28ec2] -> /usr/lib/dovecot/libdovecot.so.0(http_client_connection_output+0xee) [0x7fc54ca7ebde] -> /usr/lib/dovecot/libdovecot.so.0(+0x122171) [0x7fc54cb00171] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_call_io+0x69) [0x7fc54caeff59] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x132) [0x7fc54caf1592] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_handler_run+0x50) [0x7fc54caf] -> /usr/lib/dovecot/libdovecot.so.0(io_loop_run+0x40) [0x7fc54caf01c0] -> /usr/lib/dovecot/libdovecot.so.0(+0x9c4cd) [0x7fc54ca7a4cd] -> /usr/lib/dovecot/libdovecot.so.0(http_client_request_finish_payload+0x2c) [0x7fc54ca7a6dc] -> /usr/lib/dovecot/modules/lib20_fts_plugin.so(+0xf243) [0x7fc54c0a6243] -> /usr/lib/dovecot/modules/lib20_fts_plugin.so(fts_parser_more+0x25) [0x7fc54c0a5345] -> /usr/lib/dovecot/modules/lib20_fts_plugin.so(+0xbfcf) [0x7fc54c0a2fcf] -> /usr/lib/dovecot/modules/lib20_fts_plugin.so(fts_build_mail+0xa27) [0x7fc54c0a3a87] -> /usr/lib/dovecot/modules/lib20_fts_plugin.so(+0x11f0b) [0x7fc54c0a8f0b] -> /usr/lib/dovecot/libdovecot-storage.so.0(mail_precache+0x2e) [0x7fc54cbf14ae] -> doveadm(+0x3761f) [0x55d18bdbf61f] -> doveadm(+0x31bad) [0x55d18bdb9bad] -> doveadm(+0x32860) [0x55d18bdba860] -> doveadm(doveadm_cmd_ver2_to_mail_cmd_wrapper+0x22d) [0x55d18bdbb4ad] -> doveadm(doveadm_cmd_run_ver2+0x4c8) [0x55d18bdcbb88] -> doveadm(doveadm_cmd_try_run_ver2+0x3a) [0x55d18bdcbbda] -> doveadm(main+0x1d0) [0x55d18bdaa450] -> /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xea) [0x7fc54c69fd0a] -> doveadm(_start+0x2a) [0x55d18bdaa92a] and solr: 2022-01-03 00:13:20.829 ERROR (qtp1991278377-21) [ x:dovecot] o.a.s.s.HttpSolrCall null:[com.ctc.wstx.exc.WstxLazyException] com.ctc.wstx.exc.WstxIOException: Early EOF Caused by: org.eclipse.jetty.io.EofException: Early EOF at org.eclipse.jetty.server.HttpInput$3.getError(HttpInput.java:1143) at org.eclipse.jetty.server.HttpInput$3.noContent(HttpInput.java:1131) at org.eclipse.jetty.server.HttpInput.read(HttpInput.java:318) Seems like dovecot is sending an empty query? Oliver Hi Oliver unless I'm missing something that doesn't look like the type of query dovecot launches - dovecot sends various parameters including the request for xml results. The thing that looks odd to me is that the results fields should be single values not arrays enclosed in [], ie I would have expected "uid":21, instead of "uid":[21], I'd be interested to see the equivalent xml output produced by running a query that dovecot sends. John
Re: Error: fts_solr: received invalid uid
Here is what solr sends to dovecot, the offending uid in this exmaple is
'21'
{
"responseHeader":{
"status":0,
"QTime":1,
"params":{
"q":"body:Zeitserver"}},
"response":{"numFound":1,"start":0,"numFoundExact":true,"docs":[
{
"uid":[21],
"box":["2e60f3054059c95fbf580600eb1947e0"],
"user":["oliver.kr...@snoog.ch"],
"id":"21/2e60f3054059c95fbf580600eb1947e0/oliver.kr...@snoog.ch",
"body":[" ... "],
"hdr":[" ... "],
"from":["..."],
"subject":["..."],
"to":["..."],
"_version_":1720682332306800640}]
}}
Oliver
I'm using dovecot 2.3.13,? solr 8.x. and roundcube 1.5.1. However when
I do a search I get the the Error: fts_solr: received invalid uid,
search results are ok.
Thanks
Presumably one of the uid returned from solr could not be decoded (i.e.
converted to an int). The offending uid should have been printed as
part
of the message. If you need to get more info you could investigate what
is being returned by solr running the exact same query from a browser
if
you're able to retrieve it from the solr log.
Alternatively you could set rawlog_dir in the fts_solr dovecot settings
and then look at what is being sent back from solr in the .in file that
is logged.
https://doc.dovecot.org/settings/plugin/fts-solr-plugin/?highlight=fts%20dovecot%20plugin
John
Error: fts_solr: received invalid uid
I'm using dovecot 2.3.13, solr 8.x. and roundcube 1.5.1. However when I do a search I get the the Error: fts_solr: received invalid uid, search results are ok. Thanks
