On 29 Oct 2021, at 11:33, Remi Gacogne via dnsdist <dnsdist@mailman.powerdns.com> wrote: > would you mind getting the output of "lsof -n -p <pid of dnsdist>" while the > issue is still happening? A full backtrace with gdb might also be good to have
Sure that's fine, output follows. I've uploaded the gdb output as it's quite long. We've got three other instances to take the load, so I'm happy to keep it running as is for the moment. Adam GDB thread dump: https://gist.githubusercontent.com/TheMysteriousX/08185778d506e973a0bbe8675dd35282/raw/fc5378be3e9b40abd5c4c6f50da6f0e0cdb5fe35/dnsdist%2520thread%2520dump lsof: COMMAND PID USER FD TYPE DEVICE SIZE/OFF NODE NAME dnsdist 1351 dnsdist cwd DIR 253,0 224 128 / dnsdist 1351 dnsdist rtd DIR 253,0 224 128 / dnsdist 1351 dnsdist txt REG 253,0 8461520 16827142 /usr/bin/dnsdist dnsdist 1351 dnsdist mem REG 253,0 9253600 401478 /var/lib/sss/mc/passwd dnsdist 1351 dnsdist mem REG 253,0 6940392 401482 /var/lib/sss/mc/group dnsdist 1351 dnsdist mem REG 253,0 46280 25375781 /usr/lib64/libnss_sss.so.2 dnsdist 1351 dnsdist mem REG 253,0 30256 25167667 /usr/lib64/libcap-ng.so.0.0.0 dnsdist 1351 dnsdist mem REG 253,0 26192 25167768 /usr/lib64/libattr.so.1.1.2448 dnsdist 1351 dnsdist mem REG 253,0 543160 25167185 /usr/lib64/libpcre2-8.so.0.7.1 dnsdist 1351 dnsdist mem REG 253,0 37024 25167632 /usr/lib64/libffi.so.6.0.2 dnsdist 1351 dnsdist mem REG 253,0 123336 25167669 /usr/lib64/libaudit.so.1.0.0 dnsdist 1351 dnsdist mem REG 253,0 1869272 25254232 /usr/lib64/libdb-5.3.so dnsdist 1351 dnsdist mem REG 253,0 309104 25439215 /usr/lib64/liblua-5.3.so dnsdist 1351 dnsdist mem REG 253,0 54816 25167770 /usr/lib64/libacl.so.1.1.2253 dnsdist 1351 dnsdist mem REG 253,0 54688 25167496 /usr/lib64/libpopt.so.0.0.1 dnsdist 1351 dnsdist mem REG 253,0 678440 25439213 /usr/lib64/libzstd.so.1.4.4 dnsdist 1351 dnsdist mem REG 253,0 104744 25443492 /usr/lib64/libelf-0.182.so dnsdist 1351 dnsdist mem REG 253,0 74744 25167530 /usr/lib64/libbz2.so.1.0.6 dnsdist 1351 dnsdist mem REG 253,0 144392 25167536 /usr/lib64/libgpg-error.so.0.24.2 dnsdist 1351 dnsdist mem REG 253,0 168536 25165966 /usr/lib64/libselinux.so.1 dnsdist 1351 dnsdist mem REG 253,0 33392 25439203 /usr/lib64/libuuid.so.1.3.0 dnsdist 1351 dnsdist mem REG 253,0 343544 25288469 /usr/lib64/libblkid.so.1.1.0 dnsdist 1351 dnsdist mem REG 253,0 1503456 25167662 /usr/lib64/libgmp.so.10.3.2 dnsdist 1351 dnsdist mem REG 253,0 201632 25167916 /usr/lib64/libhogweed.so.4.5 dnsdist 1351 dnsdist mem REG 253,0 239456 25202369 /usr/lib64/libnettle.so.6.5 dnsdist 1351 dnsdist mem REG 253,0 81408 25167992 /usr/lib64/libtasn1.so.6.5.5 dnsdist 1351 dnsdist mem REG 253,0 1760264 25167714 /usr/lib64/libunistring.so.2.1.0 dnsdist 1351 dnsdist mem REG 253,0 162224 25167717 /usr/lib64/libidn2.so.0.3.6 dnsdist 1351 dnsdist mem REG 253,0 1246520 25301369 /usr/lib64/libp11-kit.so.0.3.0 dnsdist 1351 dnsdist mem REG 253,0 95416 25205548 /usr/lib64/libz.so.1.2.11 dnsdist 1351 dnsdist mem REG 253,0 23464 25167336 /usr/lib64/libutil-2.28.so dnsdist 1351 dnsdist mem REG 253,0 142712 25167518 /usr/lib64/libcrypt.so.1.1.0 dnsdist 1351 dnsdist mem REG 253,0 123520 25341073 /usr/lib64/libresolv-2.28.so dnsdist 1351 dnsdist mem REG 253,0 2181160 25221757 /usr/lib64/libperl.so.5.26.3 dnsdist 1351 dnsdist mem REG 253,0 207472 25788589 /usr/lib64/librpmio.so.8.2.0 dnsdist 1351 dnsdist mem REG 253,0 519352 25702207 /usr/lib64/librpm.so.8.2.0 dnsdist 1351 dnsdist mem REG 253,0 62344 25185617 /usr/lib64/libsensors.so.4.4.0 dnsdist 1351 dnsdist mem REG 253,0 1188080 25167585 /usr/lib64/libgcrypt.so.20.2.5 dnsdist 1351 dnsdist mem REG 253,0 371312 25185868 /usr/lib64/libmount.so.1.1.0 dnsdist 1351 dnsdist mem REG 253,0 119760 25185932 /usr/lib64/liblz4.so.1.8.3 dnsdist 1351 dnsdist mem REG 253,0 192016 25167491 /usr/lib64/liblzma.so.5.2.4 dnsdist 1351 dnsdist mem REG 253,0 69024 25341075 /usr/lib64/librt-2.28.so dnsdist 1351 dnsdist mem REG 253,0 208616 25167221 /usr/lib64/libtinfo.so.6.1 dnsdist 1351 dnsdist mem REG 253,0 28816 25341062 /usr/lib64/libdl-2.28.so dnsdist 1351 dnsdist mem REG 253,0 3167976 25167314 /usr/lib64/libc-2.28.so dnsdist 1351 dnsdist mem REG 253,0 99656 25266484 /usr/lib64/libgcc_s-8-20200928.so.1 dnsdist 1351 dnsdist mem REG 253,0 2191840 25341064 /usr/lib64/libm-2.28.so dnsdist 1351 dnsdist mem REG 253,0 1661376 25167578 /usr/lib64/libstdc++.so.6.0.25 dnsdist 1351 dnsdist mem REG 253,0 320704 25341071 /usr/lib64/libpthread-2.28.so dnsdist 1351 dnsdist mem REG 253,0 2052344 25202373 /usr/lib64/libgnutls.so.30.28.0 dnsdist 1351 dnsdist mem REG 253,0 91808 25301086 /usr/lib64/liblmdb.so.0.0.0 dnsdist 1351 dnsdist mem REG 253,0 3071456 25216207 /usr/lib64/libcrypto.so.1.1.1g dnsdist 1351 dnsdist mem REG 253,0 615576 25216209 /usr/lib64/libssl.so.1.1.1g dnsdist 1351 dnsdist mem REG 253,0 550472 25301098 /usr/lib64/libre2.so.0.0.0 dnsdist 1351 dnsdist mem REG 253,0 19416 25301092 /usr/lib64/libcdb.so.1 dnsdist 1351 dnsdist mem REG 253,0 24976 25167552 /usr/lib64/libcap.so.2.26 dnsdist 1351 dnsdist mem REG 253,0 948304 25301363 /usr/lib64/libnetsnmp.so.35.0.0 dnsdist 1351 dnsdist mem REG 253,0 494192 25484131 /usr/lib64/libnetsnmpagent.so.35.0.0 dnsdist 1351 dnsdist mem REG 253,0 1719288 25288256 /usr/lib64/libnetsnmpmibs.so.35.0.0 dnsdist 1351 dnsdist mem REG 253,0 1367288 25185948 /usr/lib64/libsystemd.so.0.23.0 dnsdist 1351 dnsdist mem REG 253,0 45704 25301106 /usr/lib64/libfstrm.so.0.1.0 dnsdist 1351 dnsdist mem REG 253,0 407520 25301105 /usr/lib64/libsodium.so.23.3.0 dnsdist 1351 dnsdist mem REG 253,0 230936 25167977 /usr/lib64/libedit.so.0.0.56 dnsdist 1351 dnsdist mem REG 253,0 516448 25301101 /usr/lib64/libluajit-5.1.so.2.1.0 dnsdist 1351 dnsdist mem REG 253,0 278504 25167286 /usr/lib64/ld-2.28.so dnsdist 1351 dnsdist 0r CHR 1,3 0t0 9312 /dev/null dnsdist 1351 dnsdist 1u unix 0xffff8fb4b5dfc900 0t0 28586 type=STREAM dnsdist 1351 dnsdist 2u unix 0xffff8fb4b5dfc900 0t0 28586 type=STREAM dnsdist 1351 dnsdist 3u unix 0xffff8fb4b5dfed00 0t0 28630 type=DGRAM dnsdist 1351 dnsdist 4u IPv4 28654 0t0 UDP *:domain dnsdist 1351 dnsdist 5u IPv4 28631 0t0 TCP 127.0.0.1:5199 (LISTEN) dnsdist 1351 dnsdist 6u IPv6 28632 0t0 TCP [::1]:5199 (LISTEN) dnsdist 1351 dnsdist 7u IPv4 28633 0t0 TCP 127.0.0.1:webcache (LISTEN) dnsdist 1351 dnsdist 8u IPv6 28634 0t0 TCP [::1]:webcache (LISTEN) dnsdist 1351 dnsdist 9u IPv4 28655 0t0 TCP *:domain (LISTEN) dnsdist 1351 dnsdist 10u a_inode 0,14 0 9306 [eventpoll] dnsdist 1351 dnsdist 11u IPv6 28637 0t0 UDP [::1]:35903->[2001:630:1:160::195]:domain dnsdist 1351 dnsdist 12u a_inode 0,14 0 9306 [eventpoll] dnsdist 1351 dnsdist 13u IPv4 28640 0t0 UDP 194.83.7.197:45941->194.83.7.195:domain dnsdist 1351 dnsdist 14u a_inode 0,14 0 9306 [eventpoll] dnsdist 1351 dnsdist 15u IPv6 28650 0t0 UDP [::1]:51827->[2001:630:1:170::67]:domain dnsdist 1351 dnsdist 16u a_inode 0,14 0 9306 [eventpoll] dnsdist 1351 dnsdist 17u IPv4 28653 0t0 UDP 194.83.7.197:57454->193.63.72.67:domain dnsdist 1351 dnsdist 18u IPv6 28656 0t0 UDP *:domain dnsdist 1351 dnsdist 19u IPv6 28657 0t0 TCP *:domain (LISTEN) dnsdist 1351 dnsdist 20r REG 253,0 6940392 401482 /var/lib/sss/mc/group dnsdist 1351 dnsdist 21r REG 253,0 9253600 401478 /var/lib/sss/mc/passwd dnsdist 1351 dnsdist 22r FIFO 0,13 0t0 28662 pipe dnsdist 1351 dnsdist 23w FIFO 0,13 0t0 28662 pipe dnsdist 1351 dnsdist 24u a_inode 0,14 0 9306 [eventpoll] dnsdist 1351 dnsdist 25r FIFO 0,13 0t0 27533 pipe dnsdist 1351 dnsdist 26w FIFO 0,13 0t0 27533 pipe dnsdist 1351 dnsdist 27r FIFO 0,13 0t0 27534 pipe dnsdist 1351 dnsdist 28w FIFO 0,13 0t0 27534 pipe dnsdist 1351 dnsdist 33r FIFO 0,13 0t0 27535 pipe dnsdist 1351 dnsdist 34w FIFO 0,13 0t0 27535 pipe dnsdist 1351 dnsdist 35u a_inode 0,14 0 9306 [eventpoll] dnsdist 1351 dnsdist 36r FIFO 0,13 0t0 27538 pipe dnsdist 1351 dnsdist 37w FIFO 0,13 0t0 27538 pipe dnsdist 1351 dnsdist 38r FIFO 0,13 0t0 27539 pipe dnsdist 1351 dnsdist 39w FIFO 0,13 0t0 27539 pipe dnsdist 1351 dnsdist 40r FIFO 0,13 0t0 27540 pipe dnsdist 1351 dnsdist 41w FIFO 0,13 0t0 27540 pipe dnsdist 1351 dnsdist 42r FIFO 0,13 0t0 27541 pipe dnsdist 1351 dnsdist 43w FIFO 0,13 0t0 27541 pipe dnsdist 1351 dnsdist 44r FIFO 0,13 0t0 27542 pipe dnsdist 1351 dnsdist 45w FIFO 0,13 0t0 27542 pipe dnsdist 1351 dnsdist 46r FIFO 0,13 0t0 27543 pipe dnsdist 1351 dnsdist 47w FIFO 0,13 0t0 27543 pipe dnsdist 1351 dnsdist 48r FIFO 0,13 0t0 27544 pipe dnsdist 1351 dnsdist 49w FIFO 0,13 0t0 27544 pipe dnsdist 1351 dnsdist 50u a_inode 0,14 0 9306 [eventpoll] dnsdist 1351 dnsdist 51u a_inode 0,14 0 9306 [eventpoll] dnsdist 1351 dnsdist 52u a_inode 0,14 0 9306 [eventpoll] dnsdist 1351 dnsdist 53u a_inode 0,14 0 9306 [eventpoll] dnsdist 1351 dnsdist 54u a_inode 0,14 0 9306 [eventpoll] dnsdist 1351 dnsdist 57u a_inode 0,14 0 9306 [eventpoll] dnsdist 1351 dnsdist 58u a_inode 0,14 0 9306 [eventpoll] dnsdist 1351 dnsdist 60u a_inode 0,14 0 9306 [eventpoll] dnsdist 1351 dnsdist 62u a_inode 0,14 0 9306 [eventpoll] Jisc is a registered charity (number 1149740) and a company limited by guarantee which is registered in England under company number. 05747339, VAT number GB 197 0632 86. Jisc’s registered office is: 4 Portwall Lane, Bristol, BS1 6NB. T 0203 697 5800. Jisc Services Limited is a wholly owned Jisc subsidiary and a company limited by guarantee which is registered in England under company number 02881024, VAT number GB 197 0632 86. The registered office is: 4 Portwall Lane, Bristol, BS1 6NB. T 0203 697 5800. Jisc Commercial Limited is a wholly owned Jisc subsidiary and a company limited by shares which is registered in England under company number 09316933, VAT number GB 197 0632 86. The registered office is: 4 Portwall Lane, Bristol, BS1 6NB. T 0203 697 5800. For more details on how Jisc handles your data see our privacy notice here: https://www.jisc.ac.uk/website/privacy-notice _______________________________________________ dnsdist mailing list dnsdist@mailman.powerdns.com https://mailman.powerdns.com/mailman/listinfo/dnsdist
