ajconejo commented on issue #2041: URL: https://github.com/apache/incubator-pagespeed-mod/issues/2041#issuecomment-699146162
Hi Otto As I´ve two apps using memcached on the server I´ve configured a 2nd memcached instance so each one use its own. After that, I ´m still having similar crashes. I´ll disable memcache on pagespeed and continue to monitor. How can I get verbose logging and a crash dump for pagespeed? I´m using ubuntu bionic. I´ve enabled RateLimitBrackgroundFetches but not yet LoadFromFile. I´m going step by step in order to pinpoint the origin of the issue. Other thing I´ve detected is that when this happens, I´ve over a hundred connections to memcached port even though the service has very low usage. Though I didn´t had time to check the details of the process shown below. sudo netstat -tulpan |grep 11212 tcp 0 0 127.0.0.1:11212 0.0.0.0:* LISTEN 8006/memcached tcp 0 0 127.0.0.1:11212 127.0.0.1:46128 ESTABLISHED 8006/memcached tcp 0 0 127.0.0.1:45876 127.0.0.1:11212 ESTABLISHED 7010/apache2 tcp 0 0 127.0.0.1:11212 127.0.0.1:44842 ESTABLISHED 8006/memcached tcp 0 0 127.0.0.1:39644 127.0.0.1:11212 ESTABLISHED 28108/apache2 tcp 0 0 127.0.0.1:45408 127.0.0.1:11212 ESTABLISHED 6173/apache2 tcp 0 0 127.0.0.1:45436 127.0.0.1:11212 ESTABLISHED 6261/apache2 tcp 0 0 127.0.0.1:11212 127.0.0.1:45036 ESTABLISHED 8006/memcached tcp 0 0 127.0.0.1:44780 127.0.0.1:11212 ESTABLISHED 5017/apache2 tcp 0 0 127.0.0.1:45904 127.0.0.1:11212 ESTABLISHED 7086/apache2 . . . . Again, Thanks for your time. Much appreciated. These are the crashes from today as of now. [Fri Sep 25 14:00:38.904717 2020] [pagespeed:alert] [pid 23826] [mod_pagespeed 1.13.35.2-0 @23826] [0925/140038:FATAL:cache_batcher.cc(272)] Check failed: iter != in_flight_.end(). \n/usr/lib/apache2/modules/mod_pagespeed_ap24.so(+0xb370e) [0x7fbc7babd70e]\n/usr/lib/apache2/modules/mod_pagespeed_ap24.so(+0xab060) [0x7fbc7bab5060]\n/usr/lib/apache2/modules/mod_pagespeed_ap24.so(+0xb58e0) [0x7fbc7babf8e0]\n/usr/lib/apache2/modules/mod_pagespeed_ap24.so(+0x24e513) [0x7fbc7bc58513]\n/usr/lib/apache2/modules/mod_pagespeed_ap24.so(+0x24e65b) [0x7fbc7bc5865b]\n/usr/lib/apache2/modules/mod_pagespeed_ap24.so(+0x1f0ea4) [0x7fbc7bbfaea4]\n/usr/lib/apache2/modules/mod_pagespeed_ap24.so(+0x1f0f2d) [0x7fbc7bbfaf2d]\n/usr/lib/apache2/modules/mod_pagespeed_ap24.so(+0x24e04b) [0x7fbc7bc5804b]\n/usr/lib/apache2/modules/mod_pagespeed_ap24.so(+0x373677) [0x7fbc7bd7d677]\n/usr/lib/apache2/modules/mod_pagespeed_ap24.so(+0x37ad9a) [0x7fbc7bd84d9a]\n/usr/lib/apache2/modules/mod_pagespeed_ap24.so(+0xa302e ) [0x7fbc7baad02e]\n/usr/lib/apache2/modules/mod_pagespeed_ap24.so(+0xa3129) [0x7fbc7baad129]\n/usr/lib/apache2/modules/mod_pagespeed_ap24.so(+0xacb55) [0x7fbc7bab6b55]\n/lib/x86_64-linux-gnu/libc.so.6(+0x430f1) [0x7fbc803bb0f1]\n/lib/x86_64-linux-gnu/libc.so.6(+0x431ea) [0x7fbc803bb1ea]\n/usr/lib/apache2/modules/mpm_itk.so(itk_fork_process+0x6c) [0x7fbc7cc2b9bc]\n/usr/sbin/apache2(ap_run_process_connection+0x40) [0x559566c8faf0]\n/usr/lib/apache2/modules/mod_mpm_prefork.so(+0x3831) [0x7fbc7c81e831]\n/usr/lib/apache2/modules/mod_mpm_prefork.so(+0x3b34) [0x7fbc7c81eb34]\n/usr/lib/apache2/modules/mod_mpm_prefork.so(+0x457e) [0x7fbc7c81f57e]\n/usr/sbin/apache2(ap_run_mpm+0x4e) [0x559566c692be]\n/usr/sbin/apache2(main+0x9fb) [0x559566c61b5b]\n/lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xe7) [0x7fbc80399b97]\n/usr/sbin/apache2(_start+0x2a) [0x559566c61c5a] [Fri Sep 25 10:14:33.275474 2020] [pagespeed:alert] [pid 4949] [mod_pagespeed 1.13.35.2-0 @4949] [0925/101433:FATAL:cache_batcher.cc(272)] Check failed: iter != in_flight_.end(). \n/usr/lib/apache2/modules/mod_pagespeed_ap24.so(+0xb370e) [0x7fcb1f57d70e]\n/usr/lib/apache2/modules/mod_pagespeed_ap24.so(+0xab060) [0x7fcb1f575060]\n/usr/lib/apache2/modules/mod_pagespeed_ap24.so(+0xb58e0) [0x7fcb1f57f8e0]\n/usr/lib/apache2/modules/mod_pagespeed_ap24.so(+0x24e513) [0x7fcb1f718513]\n/usr/lib/apache2/modules/mod_pagespeed_ap24.so(+0x24e65b) [0x7fcb1f71865b]\n/usr/lib/apache2/modules/mod_pagespeed_ap24.so(+0x1f0ea4) [0x7fcb1f6baea4]\n/usr/lib/apache2/modules/mod_pagespeed_ap24.so(+0x1f0f2d) [0x7fcb1f6baf2d]\n/usr/lib/apache2/modules/mod_pagespeed_ap24.so(+0x24e04b) [0x7fcb1f71804b]\n/usr/lib/apache2/modules/mod_pagespeed_ap24.so(+0x373677) [0x7fcb1f83d677]\n/usr/lib/apache2/modules/mod_pagespeed_ap24.so(+0x37ad9a) [0x7fcb1f844d9a]\n/usr/lib/apache2/modules/mod_pagespeed_ap24.so(+0xa302e) [0x7fcb1f56d02e]\n/usr/lib/apache2/modules/mod_pagespeed_ap24.so(+0xa3129) [0x7fcb1f56d129]\n/usr/lib/apache2/modules/mod_pagespeed_ap24.so(+0xacb55) [0x7fcb1f576b55]\n/lib/x86_64-linux-gnu/libc.so.6(+0x430f1) [0x7fcb23e7b0f1]\n/lib/x86_64-linux-gnu/libc.so.6(+0x431ea) [0x7fcb23e7b1ea]\n/usr/lib/apache2/modules/mpm_itk.so(itk_fork_process+0x6c) [0x7fcb206eb9bc]\n/usr/sbin/apache2(ap_run_process_connection+0x40) [0x558509bd2af0]\n/usr/lib/apache2/modules/mod_mpm_prefork.so(+0x3831) [0x7fcb202de831]\n/usr/lib/apache2/modules/mod_mpm_prefork.so(+0x3b34) [0x7fcb202deb34]\n/usr/lib/apache2/modules/mod_mpm_prefork.so(+0x457e) [0x7fcb202df57e]\n/usr/sbin/apache2(ap_run_mpm+0x4e) [0x558509bac2be]\n/usr/sbin/apache2(main+0x9fb) [0x558509ba4b5b]\n/lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xe7) [0x7fcb23e59b97]\n/usr/sbin/apache2(_start+0x2a) [0x558509ba4c5a] [Fri Sep 25 08:44:21.182062 2020] [pagespeed:alert] [pid 344] [mod_pagespeed 1.13.35.2-0 @344] [0925/084421:FATAL:cache_batcher.cc(272)] Check failed: iter != in_flight_.end(). \n/usr/lib/apache2/modules/mod_pagespeed_ap24.so(+0xb370e) [0x7fcb1f57d70e]\n/usr/lib/apache2/modules/mod_pagespeed_ap24.so(+0xab060) [0x7fcb1f575060]\n/usr/lib/apache2/modules/mod_pagespeed_ap24.so(+0xb58e0) [0x7fcb1f57f8e0]\n/usr/lib/apache2/modules/mod_pagespeed_ap24.so(+0x24e513) [0x7fcb1f718513]\n/usr/lib/apache2/modules/mod_pagespeed_ap24.so(+0x24e65b) [0x7fcb1f71865b]\n/usr/lib/apache2/modules/mod_pagespeed_ap24.so(+0x1f0ea4) [0x7fcb1f6baea4]\n/usr/lib/apache2/modules/mod_pagespeed_ap24.so(+0x1f0f2d) [0x7fcb1f6baf2d]\n/usr/lib/apache2/modules/mod_pagespeed_ap24.so(+0x24e04b) [0x7fcb1f71804b]\n/usr/lib/apache2/modules/mod_pagespeed_ap24.so(+0x373677) [0x7fcb1f83d677]\n/usr/lib/apache2/modules/mod_pagespeed_ap24.so(+0x37ad9a) [0x7fcb1f844d9a]\n/usr/lib/apache2/modules/mod_pagespeed_ap24.so(+0xa302e) [0 x7fcb1f56d02e]\n/usr/lib/apache2/modules/mod_pagespeed_ap24.so(+0xa3129) [0x7fcb1f56d129]\n/usr/lib/apache2/modules/mod_pagespeed_ap24.so(+0xacb55) [0x7fcb1f576b55]\n/lib/x86_64-linux-gnu/libc.so.6(+0x430f1) [0x7fcb23e7b0f1]\n/lib/x86_64-linux-gnu/libc.so.6(+0x431ea) [0x7fcb23e7b1ea]\n/usr/lib/apache2/modules/mpm_itk.so(itk_fork_process+0x6c) [0x7fcb206eb9bc]\n/usr/sbin/apache2(ap_run_process_connection+0x40) [0x558509bd2af0]\n/usr/lib/apache2/modules/mod_mpm_prefork.so(+0x3831) [0x7fcb202de831]\n/usr/lib/apache2/modules/mod_mpm_prefork.so(+0x3b34) [0x7fcb202deb34]\n/usr/lib/apache2/modules/mod_mpm_prefork.so(+0x457e) [0x7fcb202df57e]\n/usr/sbin/apache2(ap_run_mpm+0x4e) [0x558509bac2be]\n/usr/sbin/apache2(main+0x9fb) [0x558509ba4b5b]\n/lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xe7) [0x7fcb23e59b97]\n/usr/sbin/apache2(_start+0x2a) [0x558509ba4c5a] ---------------------------------------------------------------- This is an automated message from the Apache Git Service. To respond to the message, please log on to GitHub and use the URL above to go to the specific comment. For queries about this service, please contact Infrastructure at: us...@infra.apache.org
