Re: Getting panic in http-client-request.c: line 1240 during indexing on Ubuntu 20.04
On 10-02-2021 01:08, Scott Q. wrote: > Is this the same bug that John created a patch for but then Dovecot > fixed differently in the latest version ? > > The one with the assertion ? If so, I thought it was fixed, no ? > > No, this is still active, running dovecot-2.3.13-2.x86_64, updated this morning: doveadm(dexter): Panic: file http-client-request.c: line 1240 (http_client_request_send_more): assertion failed: (req->payload_input != NULL) doveadm(dexter): Error: Raw backtrace: /usr/lib64/dovecot/libdovecot.so.0(backtrace_append+0x42) [0x7f2faa8b64c2] -> /usr/lib64/dovecot/libdovecot.so.0(backtrace_get+0x1e) [0x7f2faa8b65ce] -> /usr/lib64/dovecot/libdovecot.so.0(+0xf262e) [0x7f2faa8c362e] -> /usr/lib64/dovecot/libdovecot.so.0(+0xf2671) [0x7f2faa8c3671] -> /usr/lib64/dovecot/libdovecot.so.0(i_fatal+0) [0x7f2faa815d1a] -> /usr/lib64/dovecot/libdovecot.so.0(http_client_request_send_more+0x3dd) [0x7f2faa85dffd] -> /usr/lib64/dovecot/libdovecot.so.0(http_client_connection_output+0xf1) [0x7f2faa862741] -> /usr/lib64/dovecot/libdovecot.so.0(+0x11ba30) [0x7f2faa8eca30] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_call_io+0x65) [0x7f2faa8db775] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0x12b) [0x7f2faa8dd10b] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run+0x59) [0x7f2faa8db879] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_run+0x38) [0x7f2faa8dbab8] -> /usr/lib64/dovecot/libdovecot.so.0(+0x8c526) [0x7f2faa85d526] -> /usr/lib64/dovecot/libdovecot.so.0(http_client_request_send_payload+0x2c) [0x7f2faa85d7ac] -> /usr/lib64/dovecot/lib20_fts_plugin.so(+0xd52d) [0x7f2fa7ba752d] -> /usr/lib64/dovecot/lib20_fts_plugin.so(fts_parser_more+0x27) [0x7f2fa7ba64b7] -> /usr/lib64/dovecot/lib20_fts_plugin.so(+0xa2a1) [0x7f2fa7ba42a1] -> /usr/lib64/dovecot/lib20_fts_plugin.so(fts_build_mail+0x54) [0x7f2fa7ba4c04] -> /usr/lib64/dovecot/lib20_fts_plugin.so(+0x10e32) [0x7f2fa7baae32] -> /usr/lib64/dovecot/libdovecot-storage.so.0(mail_precache+0x2e) [0x7f2faabc639e] -> /bin/doveadm(+0x3288f) [0x56466593d88f] -> /bin/doveadm(+0x32e28) [0x56466593de28] -> /bin/doveadm(+0x2cbd7) [0x564665937bd7] -> /bin/doveadm(+0x2d9e7) [0x5646659389e7] -> /bin/doveadm(doveadm_cmd_ver2_to_mail_cmd_wrapper+0x21d) [0x5646659396cd] -> /bin/doveadm(doveadm_cmd_run_ver2+0x472) [0x56466594a3c2] -> /bin/doveadm(doveadm_cmd_try_run_ver2+0x37) [0x56466594a4e7] -> /bin/doveadm(main+0x1d4) [0x564665927984] -> /lib64/libc.so.6(__libc_start_main+0xf5) [0x7f2faa123555] -> /bin/doveadm(+0x1ce1f) [0x564665927e1f] Aborted Regards, Arjen
Re: Getting panic in http-client-request.c: line 1240 during indexing on Ubuntu 20.04
On 08-02-2021 18:40, deano-dove...@areyes.com wrote: > > Do we have when (or even if) that patch will make it into the main ? > I would really rather prefer pulling from repo ... > Please! I struggle with this for at least two years now! Arjen
Re: Problem with tika
Greetings,
Is the anyone who could please help me shed light on this?
Arjen
On 06-03-2020 09:52, Arjen Heidinga wrote:
> Hello all,
>
> For some time now we've bin using solr as a search engine (working
> great). I have added tika for searching inside documents, however it
> keeps crashing when indexing. When just indexing mails that arrive works
> good, but a reindex on all mail constantly crashes with below stacktrace.
>
> When I observe the packets with wireshark I see a HTTP-flow going to
> tika and suddenly, midway a document dovecot (or the server) sends a
> RST. Sometimes after thousands of documents, sometimes after a few.
> Usually after a few hundred.
>
> It appears there are less errors using http than https.
>
>
>
> Relevant config:
>
> OS: CentOS6, fully updated
>
> plugin {
> fts = solr
> batch_size = 1
> fts_solr =
> url=https://username:passw...@solr-01.vevida.net:443/solr/dovecot/
> #fts_tika = https://solr-01.vevida.net:443/tika/
> batch_size = 1000
> fts_autoindex=yes
> soft_commit=no
> }
>
> # dovecot --version
> 2.3.9.3 (9f41b88fa)
>
> # Configure options:
>
> --docdir=%{_docdir}/dovecot \
> --disable-static \
> --with-nss \
> --with-shadow \
> --with-pam \
> --with-gssapi=plugin \
> --with-ldap=plugin \
> --with-sql=plugin \
> --with-pgsql \
> --with-sqlite \
> --with-zlib \
> --with-bzlib \
> --with-lzma \
> --with-libcap \
> --with-ssl=openssl \
> --with-ssldir=%{ssldir} \
> --with-solr \
> --with-docs
>
> # It is compiled agains the latest openssl
>
> # Tika and Solr: Both latest versions.
>
> #Stacktrace:
>
> doveadm(i...@samenmetrenske.nl): Info: Sent: Caching mails seq=1..161
>
> doveadm(i...@samenmetrenske.nl): Panic: file http-client-request.c: line
> 1173 (http_client_request_send_more): assertion failed:
> (req->payload_input != NULL)
>
> doveadm(info@xxx.x): Error: Raw backtrace:
> /usr/lib64/dovecot/libdovecot.so.0(backtrace_append+0x2f)
> [0x7f95d805acbf] ->
> /usr/lib64/dovecot/libdovecot.so.0(backtrace_get+0x26) [0x7f95d805add6]
> -> /usr/lib64/dovecot/libdovecot.so.0(+0xe90ba) [0x7f95d80660ba] ->
> /usr/lib64/dovecot/libdovecot.so.0(+0xe9161) [0x7f95d8066161] ->
> /usr/lib64/dovecot/libdovecot.so.0(+0x41158) [0x7f95d7fbe158] ->
> /usr/lib64/dovecot/libdovecot.so.0(http_client_request_send_more+0x424)
> [0x7f95d8005094] ->
> /usr/lib64/dovecot/libdovecot.so.0(http_client_connection_output+0x11a)
> [0x7f95d800a24a] ->
> /usr/lib64/dovecot/libssl_iostream_openssl.so(+0x8f6a) [0x7f95d57a2f6a]
> -> /usr/lib64/dovecot/libdovecot.so.0(+0x114483) [0x7f95d8091483] ->
> /usr/lib64/dovecot/libdovecot.so.0(io_loop_call_io+0x61)
> [0x7f95d807e581] ->
> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0xdc)
> [0x7f95d808076c] ->
> /usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run+0x5c)
> [0x7f95d807e67c] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_run+0x38)
> [0x7f95d807e8c8] -> /usr/lib64/dovecot/libdovecot.so.0(+0x89105)
> [0x7f95d8006105] ->
> /usr/lib64/dovecot/libdovecot.so.0(http_client_request_send_payload+0x1f)
> [0x7f95d80063cf] -> /usr/lib64/dovecot/lib20_fts_plugin.so(+0xd31d)
> [0x7f95d6ad931d] ->
> /usr/lib64/dovecot/lib20_fts_plugin.so(fts_parser_more+0x1a)
> [0x7f95d6ad83ca] ->
> /usr/lib64/dovecot/lib20_fts_plugin.so(fts_build_mail+0x761)
> [0x7f95d6ad6401] -> /usr/lib64/dovecot/lib20_fts_plugin.so(+0x114ca)
> [0x7f95d6add4ca] ->
> /usr/lib64/dovecot/libdovecot-storage.so.0(mail_precache+0x2a)
> [0x7f95d835ab4a] -> doveadm(+0x31e75) [0x55e7c1052e75] ->
> doveadm(+0x321fb) [0x55e7c10531fb] -> doveadm(+0x2c321) [0x55e7c104d321]
> -> doveadm(+0x2c577) [0x55e7c104d577] ->
> doveadm(doveadm_cmd_ver2_to_mail_cmd_wrapper+0x1e8) [0x55e7c104ec38] ->
> doveadm(doveadm_cmd_run_ver2+0x52e) [0x55e7c105fafe] ->
> doveadm(doveadm_cmd_try_run_ver2+0x37) [0x55e7c105fb97] ->
> doveadm(main+0x21a) [0x55e7c1062aca] ->
> /lib64/libc.so.6(__libc_start_main+0x100) [0x7f95d7983d20] ->
> doveadm(+0x1c479) [0x55e7c103d479]
>
signature.asc
Description: OpenPGP digital signature
Problem with tika
Hello all,
For some time now we've bin using solr as a search engine (working
great). I have added tika for searching inside documents, however it
keeps crashing when indexing. When just indexing mails that arrive works
good, but a reindex on all mail constantly crashes with below stacktrace.
When I observe the packets with wireshark I see a HTTP-flow going to
tika and suddenly, midway a document dovecot (or the server) sends a
RST. Sometimes after thousands of documents, sometimes after a few.
Usually after a few hundred.
It appears there are less errors using http than https.
Relevant config:
OS: CentOS6, fully updated
plugin {
fts = solr
batch_size = 1
fts_solr =
url=https://username:passw...@solr-01.vevida.net:443/solr/dovecot/
#fts_tika = https://solr-01.vevida.net:443/tika/
batch_size = 1000
fts_autoindex=yes
soft_commit=no
}
# dovecot --version
2.3.9.3 (9f41b88fa)
# Configure options:
--docdir=%{_docdir}/dovecot \
--disable-static \
--with-nss \
--with-shadow \
--with-pam \
--with-gssapi=plugin \
--with-ldap=plugin \
--with-sql=plugin \
--with-pgsql \
--with-sqlite \
--with-zlib \
--with-bzlib \
--with-lzma \
--with-libcap \
--with-ssl=openssl \
--with-ssldir=%{ssldir} \
--with-solr \
--with-docs
# It is compiled agains the latest openssl
# Tika and Solr: Both latest versions.
#Stacktrace:
doveadm(i...@samenmetrenske.nl): Info: Sent: Caching mails seq=1..161
doveadm(i...@samenmetrenske.nl): Panic: file http-client-request.c: line
1173 (http_client_request_send_more): assertion failed:
(req->payload_input != NULL)
doveadm(info@xxx.x): Error: Raw backtrace:
/usr/lib64/dovecot/libdovecot.so.0(backtrace_append+0x2f)
[0x7f95d805acbf] ->
/usr/lib64/dovecot/libdovecot.so.0(backtrace_get+0x26) [0x7f95d805add6]
-> /usr/lib64/dovecot/libdovecot.so.0(+0xe90ba) [0x7f95d80660ba] ->
/usr/lib64/dovecot/libdovecot.so.0(+0xe9161) [0x7f95d8066161] ->
/usr/lib64/dovecot/libdovecot.so.0(+0x41158) [0x7f95d7fbe158] ->
/usr/lib64/dovecot/libdovecot.so.0(http_client_request_send_more+0x424)
[0x7f95d8005094] ->
/usr/lib64/dovecot/libdovecot.so.0(http_client_connection_output+0x11a)
[0x7f95d800a24a] ->
/usr/lib64/dovecot/libssl_iostream_openssl.so(+0x8f6a) [0x7f95d57a2f6a]
-> /usr/lib64/dovecot/libdovecot.so.0(+0x114483) [0x7f95d8091483] ->
/usr/lib64/dovecot/libdovecot.so.0(io_loop_call_io+0x61)
[0x7f95d807e581] ->
/usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run_internal+0xdc)
[0x7f95d808076c] ->
/usr/lib64/dovecot/libdovecot.so.0(io_loop_handler_run+0x5c)
[0x7f95d807e67c] -> /usr/lib64/dovecot/libdovecot.so.0(io_loop_run+0x38)
[0x7f95d807e8c8] -> /usr/lib64/dovecot/libdovecot.so.0(+0x89105)
[0x7f95d8006105] ->
/usr/lib64/dovecot/libdovecot.so.0(http_client_request_send_payload+0x1f)
[0x7f95d80063cf] -> /usr/lib64/dovecot/lib20_fts_plugin.so(+0xd31d)
[0x7f95d6ad931d] ->
/usr/lib64/dovecot/lib20_fts_plugin.so(fts_parser_more+0x1a)
[0x7f95d6ad83ca] ->
/usr/lib64/dovecot/lib20_fts_plugin.so(fts_build_mail+0x761)
[0x7f95d6ad6401] -> /usr/lib64/dovecot/lib20_fts_plugin.so(+0x114ca)
[0x7f95d6add4ca] ->
/usr/lib64/dovecot/libdovecot-storage.so.0(mail_precache+0x2a)
[0x7f95d835ab4a] -> doveadm(+0x31e75) [0x55e7c1052e75] ->
doveadm(+0x321fb) [0x55e7c10531fb] -> doveadm(+0x2c321) [0x55e7c104d321]
-> doveadm(+0x2c577) [0x55e7c104d577] ->
doveadm(doveadm_cmd_ver2_to_mail_cmd_wrapper+0x1e8) [0x55e7c104ec38] ->
doveadm(doveadm_cmd_run_ver2+0x52e) [0x55e7c105fafe] ->
doveadm(doveadm_cmd_try_run_ver2+0x37) [0x55e7c105fb97] ->
doveadm(main+0x21a) [0x55e7c1062aca] ->
/lib64/libc.so.6(__libc_start_main+0x100) [0x7f95d7983d20] ->
doveadm(+0x1c479) [0x55e7c103d479]
signature.asc
Description: OpenPGP digital signature
