Bug#916375: [debian-mysql] Bug#916375: Bug#916375: apache2: Segmentation fault when mod_perl.so is loaded

2019-04-15 Thread Otto Kekäläinen
For the record some debug output:

### Stretch before upgrade

# dpkg -S /usr/lib/x86_64-linux-gnu/libma* /usr/lib/x86_64-linux-gnu/libmy*
libmagic1:amd64: /usr/lib/x86_64-linux-gnu/libmagic.so.1
libmagic1:amd64: /usr/lib/x86_64-linux-gnu/libmagic.so.1.0.0
libmailutils5:amd64: /usr/lib/x86_64-linux-gnu/libmailutils.so.5
libmailutils5:amd64: /usr/lib/x86_64-linux-gnu/libmailutils.so.5.0.1
libmariadbclient-dev: /usr/lib/x86_64-linux-gnu/libmariadbclient.a
libmariadbclient-dev: /usr/lib/x86_64-linux-gnu/libmariadbclient.so
libmariadbclient18:amd64: /usr/lib/x86_64-linux-gnu/libmariadbclient.so.18
libmariadbclient18:amd64: /usr/lib/x86_64-linux-gnu/libmariadbclient.so.18.0.0
libmariadbclient-dev: /usr/lib/x86_64-linux-gnu/libmariadbclient_r.a
libmariadbclient-dev: /usr/lib/x86_64-linux-gnu/libmariadbclient_r.so
libmariadbclient-dev: /usr/lib/x86_64-linux-gnu/libmariadbclient_r.so.18
libmariadbclient-dev: /usr/lib/x86_64-linux-gnu/libmariadbclient_r.so.18.0.0
libmariadbclient-dev-compat:amd64: /usr/lib/x86_64-linux-gnu/libmysqlclient.so
libmariadbclient-dev-compat:amd64: /usr/lib/x86_64-linux-gnu/libmysqlclient_r.so
libmariadbd-dev:amd64: /usr/lib/x86_64-linux-gnu/libmysqld.a
libmariadbd-dev:amd64: /usr/lib/x86_64-linux-gnu/libmysqld.so
libmariadbd18:amd64: /usr/lib/x86_64-linux-gnu/libmysqld.so.18
libmariadbclient-dev: /usr/lib/x86_64-linux-gnu/libmysqlservices.a

# find /usr/lib/x86_64-linux-gnu/libma* /usr/lib/x86_64-linux-gnu/libmy* -ls
11878  4 lrwxrwxrwx   1 root root   17 Jun 11
2018 /usr/lib/x86_64-linux-gnu/libmagic.so.1 -> libmagic.so.1.0.0
11869136 -rw-r--r--   1 root root   137448 Jun 11
2018 /usr/lib/x86_64-linux-gnu/libmagic.so.1.0.0
43036  4 lrwxrwxrwx   1 root root   21 Dec 25
2016 /usr/lib/x86_64-linux-gnu/libmailutils.so.5 ->
libmailutils.so.5.0.1
43004820 -rw-r--r--   1 root root   836960 Dec 25
2016 /usr/lib/x86_64-linux-gnu/libmailutils.so.5.0.1
14428   5440 -rw-r--r--   1 root root  5570262 Aug 10
2017 /usr/lib/x86_64-linux-gnu/libmariadbclient.a
14439  4 lrwxrwxrwx   1 root root   22 Aug 10
2017 /usr/lib/x86_64-linux-gnu/libmariadbclient.so ->
libmariadbclient.so.18
14078  4 lrwxrwxrwx   1 root root   26 Aug 10
2017 /usr/lib/x86_64-linux-gnu/libmariadbclient.so.18 ->
libmariadbclient.so.18.0.0
14071   4068 -rw-r--r--   1 root root  4163048 Aug 10
2017 /usr/lib/x86_64-linux-gnu/libmariadbclient.so.18.0.0
14440  4 lrwxrwxrwx   1 root root   18 Aug 10
2017 /usr/lib/x86_64-linux-gnu/libmariadbclient_r.a ->
libmariadbclient.a
14441  4 lrwxrwxrwx   1 root root   19 Aug 10
2017 /usr/lib/x86_64-linux-gnu/libmariadbclient_r.so ->
libmariadbclient.so
14442  4 lrwxrwxrwx   1 root root   19 Aug 10
2017 /usr/lib/x86_64-linux-gnu/libmariadbclient_r.so.18 ->
libmariadbclient.so
14443  4 lrwxrwxrwx   1 root root   19 Aug 10
2017 /usr/lib/x86_64-linux-gnu/libmariadbclient_r.so.18.0.0 ->
libmariadbclient.so
14454  4 lrwxrwxrwx   1 root root   19 Aug 10
2017 /usr/lib/x86_64-linux-gnu/libmysqlclient.so ->
libmariadbclient.so
14455  4 lrwxrwxrwx   1 root root   21 Aug 10
2017 /usr/lib/x86_64-linux-gnu/libmysqlclient_r.so ->
libmariadbclient_r.so
14478  28864 -rw-r--r--   1 root root 29554908 Aug 10
2017 /usr/lib/x86_64-linux-gnu/libmysqld.a
14482  4 lrwxrwxrwx   1 root root   15 Aug 10
2017 /usr/lib/x86_64-linux-gnu/libmysqld.so -> libmysqld.so.18
14466  16208 -rw-r--r--   1 root root 16593304 Aug 10
2017 /usr/lib/x86_64-linux-gnu/libmysqld.so.18
14429 20 -rw-r--r--   1 root root19430 Aug 10
2017 /usr/lib/x86_64-linux-gnu/libmysqlservices.a

# nm -D /usr/lib/x86_64-linux-gnu/libmariadbclient.so.18.0.0 | egrep
'lib(mariadb|mysql)client_'
 A libmariadbclient_16
 A libmariadbclient_18

# ldconfig -p | grep -e mariadb -e mysql
libmysqld.so.18 (libc6,x86-64) => /usr/lib/x86_64-linux-gnu/libmysqld.so.18
libmysqld.so (libc6,x86-64) => /usr/lib/x86_64-linux-gnu/libmysqld.so
libmariadbclient.so.18 (libc6,x86-64) =>
/usr/lib/x86_64-linux-gnu/libmariadbclient.so.18
libmariadbclient.so (libc6,x86-64) =>
/usr/lib/x86_64-linux-gnu/libmariadbclient.so

# curl -IL http://localhost/otrs/index.pl?Action=Admin
HTTP/1.1 200 OK
Date: Mon, 15 Apr 2019 19:02:38 GMT
Server: Apache/2.4.25 (Debian)
X-Powered-By: OTRS 5.0.16 (https://www.otrs.com/)
X-UA-Compatible: IE=edge,chrome=1
X-Frame-Options: SAMEORIGIN
Expires: Tue, 1 Jan 1980 12:00:00 GMT
Cache-Control: no-cache
Pragma: no-cache
X-OTRS-Login: /otrs/index.pl?
Set-Cookie: OTRSBrowserHasCookie=1; path=/otrs/; expires=1y
Vary: Accept-Encoding
Content-Type: text/html; charset=utf-8;


### Stretch after upgrade

Everything else is identical apart from:
# nm -D /usr/lib/x86_64-linux-gnu/libmariadbclient.so.18.0.0 | egrep

Bug#916375: [debian-mysql] Bug#916375: Bug#916375: apache2: Segmentation fault when mod_perl.so is loaded

2019-04-15 Thread Otto Kekäläinen
### Buster

# dpkg -S /usr/lib/x86_64-linux-gnu/libma* /usr/lib/x86_64-linux-gnu/libmy*
libmariadb-dev: /usr/lib/x86_64-linux-gnu/libmariadb.so
libmariadb3:amd64: /usr/lib/x86_64-linux-gnu/libmariadb.so.3
libmariadb-dev: /usr/lib/x86_64-linux-gnu/libmariadbclient.a
libmariadb-dev: /usr/lib/x86_64-linux-gnu/libmariadbclient.so
libmariadb-dev-compat:amd64: /usr/lib/x86_64-linux-gnu/libmysqlclient.a
libmariadb-dev-compat:amd64: /usr/lib/x86_64-linux-gnu/libmysqlclient.so
libmariadb-dev-compat:amd64: /usr/lib/x86_64-linux-gnu/libmysqlclient_r.a
libmariadb-dev-compat:amd64: /usr/lib/x86_64-linux-gnu/libmysqlclient_r.so
libmariadb-dev: /usr/lib/x86_64-linux-gnu/libmysqlservices.a

# find /usr/lib/x86_64-linux-gnu/libma* /usr/lib/x86_64-linux-gnu/libmy* -ls
11162  4 lrwxrwxrwx   1 root root   15 Apr  1
20:05 /usr/lib/x86_64-linux-gnu/libmariadb.so -> libmariadb.so.3
 7973332 -rw-r--r--   1 root root   335984 Apr  1
20:05 /usr/lib/x86_64-linux-gnu/libmariadb.so.3
11149460 -rw-r--r--   1 root root   467280 Apr  1
20:05 /usr/lib/x86_64-linux-gnu/libmariadbclient.a
11163  4 lrwxrwxrwx   1 root root   15 Apr  1
20:05 /usr/lib/x86_64-linux-gnu/libmariadbclient.so -> libmariadb.so.3
11177  4 lrwxrwxrwx   1 root root   18 Apr  1
20:05 /usr/lib/x86_64-linux-gnu/libmysqlclient.a -> libmariadbclient.a
11178  4 lrwxrwxrwx   1 root root   15 Apr  1
20:05 /usr/lib/x86_64-linux-gnu/libmysqlclient.so -> libmariadb.so.3
11179  4 lrwxrwxrwx   1 root root   18 Apr  1
20:05 /usr/lib/x86_64-linux-gnu/libmysqlclient_r.a ->
libmariadbclient.a
11180  4 lrwxrwxrwx   1 root root   15 Apr  1
20:05 /usr/lib/x86_64-linux-gnu/libmysqlclient_r.so -> libmariadb.so.3
11150 20 -rw-r--r--   1 root root19430 Apr  1
20:05 /usr/lib/x86_64-linux-gnu/libmysqlservices.a

# nm -D /usr/lib/x86_64-linux-gnu/libmariadb.so.3 | egrep 'lib(mariadb|mysql)'
 A libmariadb_3
 A libmariadbclient_18
 A libmysqlclient_18

# ldconfig -p | grep -e mariadb -e mysql
libmariadb.so.3 (libc6,x86-64) => /lib/x86_64-linux-gnu/libmariadb.so.3
libmariadb.so (libc6,x86-64) => /lib/x86_64-linux-gnu/libmariadb.so



Bug#916375: [debian-mysql] Bug#916375: Bug#916375: apache2: Segmentation fault when mod_perl.so is loaded

2019-04-14 Thread Otto Kekäläinen
Control: severity important
Severity: important

> Can you still reproduce this with latest versions of MariaDB 10.3.13
> and mod_perl ?

Downgrading severity since no more info has been provided in past
month and there are no new reports that somebody would be affected.



Bug#916375: [debian-mysql] Bug#916375: apache2: Segmentation fault when mod_perl.so is loaded

2019-03-13 Thread Otto Kekäläinen
Control: tags -1 moreinfo

Hello!

Can you still reproduce this with latest versions of MariaDB 10.3.13
and mod_perl ?



Processed: Re: Bug#916375: [debian-mysql] Bug#916375: apache2: Segmentation fault when mod_perl.so is loaded

2019-03-13 Thread Debian Bug Tracking System
Processing control commands:

> tags -1 moreinfo
Bug #916375 [libmariadbclient18] apache2: Segmentation fault when mod_perl.so 
is enabled
Added tag(s) moreinfo.

-- 
916375: https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=916375
Debian Bug Tracking System
Contact ow...@bugs.debian.org with problems



Bug#916375: [debian-mysql] Bug#916375: apache2: Segmentation fault when mod_perl.so is loaded

2019-02-22 Thread Otto Kekäläinen
Potentially related:
- https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=916375 apache2:
Segmentation fault when mod_perl.so is enabled
- https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=918988
libmysqlclient symbol conflict segfaulted Apache
- https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=920619
libaprutil1-dbd-mysql should also be added to the Breaks-list



Bug#916375: apache2: Segmentation fault when mod_perl.so is loaded

2019-01-12 Thread Niko Tyni
Control: reassign -1 libmariadbclient18 10.1.37-0+deb9u1

This reportedly regressed with DSA-4341-1, reassigning to the correct
package.
-- 
Niko Tyni   nt...@debian.org



Processed: Re: Bug#916375: apache2: Segmentation fault when mod_perl.so is loaded

2019-01-12 Thread Debian Bug Tracking System
Processing control commands:

> reassign -1 libmariadbclient18 10.1.37-0+deb9u1
Bug #916375 [apache2] apache2: Segmentation fault when mod_perl.so is enabled
Bug reassigned from package 'apache2' to 'libmariadbclient18'.
No longer marked as found in versions apache2/2.4.25-3+deb9u6.
Ignoring request to alter fixed versions of bug #916375 to the same values 
previously set
Bug #916375 [libmariadbclient18] apache2: Segmentation fault when mod_perl.so 
is enabled
Marked as found in versions mariadb-10.1/10.1.37-0+deb9u1.

-- 
916375: https://bugs.debian.org/cgi-bin/bugreport.cgi?bug=916375
Debian Bug Tracking System
Contact ow...@bugs.debian.org with problems



Bug#916375: apache2: Segmentation fault when mod_perl.so is loaded

2018-12-18 Thread Hans-Georg Thien

Thanks Niko,

it seems that you where right regarding libmariadbclient18 ...

downgrading libmariadbclient18 fixed the issue :-)

    dpkg -i libmariadbclient18_10.1.26-0+deb9u1_amd64.deb



Niko Tyni wrote:

On Thu, Dec 13, 2018 at 06:44:32PM +0100, h.thien wrote:

Package: apache2
Version: 2.4.25-3+deb9u6
Severity: grave
Tags: patch
Justification: renders package unusable
gdb> Thread 1 "/opt/otrs/bin/cgi-bi" received signal SIGSEGV, 
Segmentation fault.
gdb> bt
#0  0x7fffdcd290c7 in free_defaults () from 
/usr/lib/x86_64-linux-gnu/libmariadbclient.so.18
We are using unattended upgrades (security only), and we suspect that 
an automatic system update has installed a new Perl version that now causes 
these problems.

Have you ruled out the MariaDB update? That one seems the most
likely to have triggered this regression.

   https://www.debian.org/security/2018/dsa-4341

(Not sure how reliably you got the list of loaded shared libraries;
you seem to be running the prefork mpm so presumably only some of your
apache processes will have the libraries loaded by the actual Perl
application.)




--
Hans-Georg Thien | Software Engineer
callas software GmbH | Schoenhauser Allee 6/7 | 10119 Berlin | Germany
Tel +49.30.4439031-0 | Fax +49.30.4416402 | www.callassoftware.com
Amtsgericht Charlottenburg, HRB 59615
Geschäftsführung: Olaf Drümmer, Ulrich Frotscher, Dietrich von Seggern



Bug#916375: apache2: Segmentation fault when mod_perl.so is loaded

2018-12-15 Thread Niko Tyni
On Thu, Dec 13, 2018 at 06:44:32PM +0100, h.thien wrote:
> Package: apache2
> Version: 2.4.25-3+deb9u6
> Severity: grave
> Tags: patch
> Justification: renders package unusable

>   gdb> Thread 1 "/opt/otrs/bin/cgi-bi" received signal SIGSEGV, 
> Segmentation fault.
>   gdb> bt
>   #0  0x7fffdcd290c7 in free_defaults () from 
> /usr/lib/x86_64-linux-gnu/libmariadbclient.so.18

>   We are using unattended upgrades (security only), and we suspect that 
> an automatic system update has installed a new Perl version that now causes 
> these problems.

Have you ruled out the MariaDB update? That one seems the most
likely to have triggered this regression.

  https://www.debian.org/security/2018/dsa-4341

(Not sure how reliably you got the list of loaded shared libraries;
you seem to be running the prefork mpm so presumably only some of your
apache processes will have the libraries loaded by the actual Perl
application.)

-- 
Niko Tyni   nt...@debian.org



Bug#916375: Fwd: Bug#916375: apache2: Segmentation fault when mod_perl.so is loaded

2018-12-13 Thread Xavier
Cc: libapache2-mod-perl2


 Message 
Subject : Bug#916375: apache2: Segmentation fault when mod_perl.so is loaded
Date : Thu, 13 Dec 2018 19:09:02 +
>From : h.thien 
To : debian-bugs-d...@lists.debian.org
Cc : t...@security.debian.org, Debian Apache Maintainers


Package: apache2
Version: 2.4.25-3+deb9u6
Severity: grave
Tags: patch
Justification: renders package unusable

Dear Maintainer,

For communication with our customers we use the OTRS Ticket System.

The server was reinstalled about a year ago and worked fine until it
was rebooted three days ago.

Since then the Apache web server crashes reproducibly as soon as it has
to process a request. Here is a stacktrace:

cd /etc/apache2
. envvars
gdb /usr/sbin/apache2
gdb> set args -X
gdb> run

# ... now use the webbrowser to send an http request to the 
apache2
server: http://otrs-testing/otrs/index.pl?Action=Admin

gdb> Thread 1 "/opt/otrs/bin/cgi-bi" received signal SIGSEGV,
Segmentation fault.
gdb> bt
#0  0x7fffdcd290c7 in free_defaults () from
/usr/lib/x86_64-linux-gnu/libmariadbclient.so.18
#1  0x7fffdcd29422 in free_defaults () from
/usr/lib/x86_64-linux-gnu/libmariadbclient.so.18
#2  0x7fffdcd29461 in free_defaults () from
/usr/lib/x86_64-linux-gnu/libmariadbclient.so.18
#3  0x7fffdcd29637 in free_defaults () from
/usr/lib/x86_64-linux-gnu/libmariadbclient.so.18
#4  0x7fffdccf5868 in mysql_options4 () from
/usr/lib/x86_64-linux-gnu/libmariadbclient.so.18
#5  0x7fffdd2cabc8 in mysql_dr_connect () from
/usr/lib/x86_64-linux-gnu/perl5/5.24/auto/DBD/mysql/mysql.so
#6  0x7fffdd2ccc69 in ?? () from
/usr/lib/x86_64-linux-gnu/perl5/5.24/auto/DBD/mysql/mysql.so
#7  0x7fffdd2ccd71 in mysql_db_login () from
/usr/lib/x86_64-linux-gnu/perl5/5.24/auto/DBD/mysql/mysql.so
#8  0x7fffdd2d9651 in ?? () from
/usr/lib/x86_64-linux-gnu/perl5/5.24/auto/DBD/mysql/mysql.so
#9  0x73901950 in Perl_pp_entersub () from
/usr/lib/x86_64-linux-gnu/libperl.so.5.24
#10 0x738f9e96 in Perl_runops_standard () from
/usr/lib/x86_64-linux-gnu/libperl.so.5.24
#11 0x73879d5b in Perl_call_sv () from
/usr/lib/x86_64-linux-gnu/libperl.so.5.24
#12 0x7fffea84c2e9 in XS_DBI_dispatch () from
/usr/lib/x86_64-linux-gnu/perl5/5.24/auto/DBI/DBI.so
#13 0x73901950 in Perl_pp_entersub () from
/usr/lib/x86_64-linux-gnu/libperl.so.5.24
#14 0x738f9e96 in Perl_runops_standard () from
/usr/lib/x86_64-linux-gnu/libperl.so.5.24
#15 0x7387a10e in Perl_call_sv () from
/usr/lib/x86_64-linux-gnu/libperl.so.5.24
#16 0x73c32c68 in modperl_callback () from
/usr/lib/apache2/modules/mod_perl.so
#17 0x73c33606 in modperl_callback_run_handlers () 
from
/usr/lib/apache2/modules/mod_perl.so
#18 0x73c33d9f in modperl_callback_per_dir () from
/usr/lib/apache2/modules/mod_perl.so
#19 0x73c2e0fb in ?? () from
/usr/lib/apache2/modules/mod_perl.so
#20 0x73c2e32c in modperl_response_handler_cgi () 
from
/usr/lib/apache2/modules/mod_perl.so
#21 0x555abc40 in ap_run_handler ()
#22 0x555ac1d6 in ap_invoke_handler ()
#23 0x555c3e13 in ap_process_async_request ()
#24 0x555c3f20 in ap_process_request ()
#25 0x555bffdd in ?? ()
#26 0x555b5ab0 in ap_run_process_connection ()
#27 0x740686bf in ?? () from
/usr/lib/apache2/modules/mod_mpm_prefork.so
#28 0x740688f2 in ?? () from
/usr/lib/apache2/modules/mod_mpm_prefork.so
#29 0x74069e37 in ?? () from
/usr/lib/apache2/modules/mod_mpm_prefork.so
#30 0x5558f00e in ap_run_mpm ()
#31 0x55587c4d in main ()

We are using unattended upgrades (security only), and we suspect that
an automatic system update has installed a new Perl version that now
causes these problems.

We have a second OTRS fallback system that hasn't been restarted for 94
days, and everything is still working fine there.

If we compare the shared libraries loaded by apache on these two
systems (/proc//maps) we can see that the following .so
files have been renewed.

  484 -rw-r--r-- 1 root root   489960 Nov 29 20:45
/usr/lib/x86_64-linux-gnu/libtiff.so.5.2.6
  

Bug#916375: apache2: Segmentation fault when mod_perl.so is loaded

2018-12-13 Thread h.thien
Package: apache2
Version: 2.4.25-3+deb9u6
Severity: grave
Tags: patch
Justification: renders package unusable

Dear Maintainer,

For communication with our customers we use the OTRS Ticket System.

The server was reinstalled about a year ago and worked fine until it 
was rebooted three days ago.

Since then the Apache web server crashes reproducibly as soon as it has 
to process a request. Here is a stacktrace:

cd /etc/apache2
. envvars
gdb /usr/sbin/apache2
gdb> set args -X
gdb> run

# ... now use the webbrowser to send an http request to the 
apache2 server: http://otrs-testing/otrs/index.pl?Action=Admin

gdb> Thread 1 "/opt/otrs/bin/cgi-bi" received signal SIGSEGV, 
Segmentation fault.
gdb> bt
#0  0x7fffdcd290c7 in free_defaults () from 
/usr/lib/x86_64-linux-gnu/libmariadbclient.so.18
#1  0x7fffdcd29422 in free_defaults () from 
/usr/lib/x86_64-linux-gnu/libmariadbclient.so.18
#2  0x7fffdcd29461 in free_defaults () from 
/usr/lib/x86_64-linux-gnu/libmariadbclient.so.18
#3  0x7fffdcd29637 in free_defaults () from 
/usr/lib/x86_64-linux-gnu/libmariadbclient.so.18
#4  0x7fffdccf5868 in mysql_options4 () from 
/usr/lib/x86_64-linux-gnu/libmariadbclient.so.18
#5  0x7fffdd2cabc8 in mysql_dr_connect () from 
/usr/lib/x86_64-linux-gnu/perl5/5.24/auto/DBD/mysql/mysql.so
#6  0x7fffdd2ccc69 in ?? () from 
/usr/lib/x86_64-linux-gnu/perl5/5.24/auto/DBD/mysql/mysql.so
#7  0x7fffdd2ccd71 in mysql_db_login () from 
/usr/lib/x86_64-linux-gnu/perl5/5.24/auto/DBD/mysql/mysql.so
#8  0x7fffdd2d9651 in ?? () from 
/usr/lib/x86_64-linux-gnu/perl5/5.24/auto/DBD/mysql/mysql.so
#9  0x73901950 in Perl_pp_entersub () from 
/usr/lib/x86_64-linux-gnu/libperl.so.5.24
#10 0x738f9e96 in Perl_runops_standard () from 
/usr/lib/x86_64-linux-gnu/libperl.so.5.24
#11 0x73879d5b in Perl_call_sv () from 
/usr/lib/x86_64-linux-gnu/libperl.so.5.24
#12 0x7fffea84c2e9 in XS_DBI_dispatch () from 
/usr/lib/x86_64-linux-gnu/perl5/5.24/auto/DBI/DBI.so
#13 0x73901950 in Perl_pp_entersub () from 
/usr/lib/x86_64-linux-gnu/libperl.so.5.24
#14 0x738f9e96 in Perl_runops_standard () from 
/usr/lib/x86_64-linux-gnu/libperl.so.5.24
#15 0x7387a10e in Perl_call_sv () from 
/usr/lib/x86_64-linux-gnu/libperl.so.5.24
#16 0x73c32c68 in modperl_callback () from 
/usr/lib/apache2/modules/mod_perl.so
#17 0x73c33606 in modperl_callback_run_handlers () 
from /usr/lib/apache2/modules/mod_perl.so
#18 0x73c33d9f in modperl_callback_per_dir () from 
/usr/lib/apache2/modules/mod_perl.so
#19 0x73c2e0fb in ?? () from 
/usr/lib/apache2/modules/mod_perl.so
#20 0x73c2e32c in modperl_response_handler_cgi () 
from /usr/lib/apache2/modules/mod_perl.so
#21 0x555abc40 in ap_run_handler ()
#22 0x555ac1d6 in ap_invoke_handler ()
#23 0x555c3e13 in ap_process_async_request ()
#24 0x555c3f20 in ap_process_request ()
#25 0x555bffdd in ?? ()
#26 0x555b5ab0 in ap_run_process_connection ()
#27 0x740686bf in ?? () from 
/usr/lib/apache2/modules/mod_mpm_prefork.so
#28 0x740688f2 in ?? () from 
/usr/lib/apache2/modules/mod_mpm_prefork.so
#29 0x74069e37 in ?? () from 
/usr/lib/apache2/modules/mod_mpm_prefork.so
#30 0x5558f00e in ap_run_mpm ()
#31 0x55587c4d in main ()

We are using unattended upgrades (security only), and we suspect that 
an automatic system update has installed a new Perl version that now causes 
these problems.

We have a second OTRS fallback system that hasn't been restarted for 94 
days, and everything is still working fine there.

If we compare the shared libraries loaded by apache on these two 
systems (/proc//maps) we can see that the following .so files have 
been renewed.

  484 -rw-r--r-- 1 root root   489960 Nov 29 20:45 
/usr/lib/x86_64-linux-gnu/libtiff.so.5.2.6
 2008 -rw-r--r-- 1 root root  2049312 Nov 29 12:11 
/usr/lib/x86_64-linux-gnu/libperl.so.5.24.1
   92 -rw-r--r-- 1 root root88760 Nov 29 12:11 
/usr/lib/x86_64-linux-gnu/perl/5.24.1/auto/B/B.so
   20 -rw-r--r-- 1 root root