[jira] [Commented] (TS-833) Crash Report: Continuation::handleEvent, event=2, 0xdeadbeef, ink_freelist_free related
[ https://issues.apache.org/jira/browse/TS-833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13063760#comment-13063760 ] Zhao Yongming commented on TS-833: -- we have testing the patch in trunk for 24hours without any crash, I'd like conclude that we have fix the issue. I will call for more testing. Crash Report: Continuation::handleEvent, event=2, 0xdeadbeef, ink_freelist_free related --- Key: TS-833 URL: https://issues.apache.org/jira/browse/TS-833 Project: Traffic Server Issue Type: Bug Components: Core Affects Versions: 3.1.0 Environment: current trunk, with --enable-debug Reporter: Zhao Yongming Labels: freelist Fix For: 3.1.0 Attachments: TS-833-2.diff, TS-833-3.diff, TS-833.diff bt #1 {code} #0 0x004d2c5c in Continuation::handleEvent (this=0x19581df0, event=2, data=0x197c4fc0) at I_Continuation.h:146 146 return (this-*handler) (event, data); (gdb) bt #0 0x004d2c5c in Continuation::handleEvent (this=0x19581df0, event=2, data=0x197c4fc0) at I_Continuation.h:146 #1 0x006f5830 in EThread::process_event (this=0x2ae29010, e=0x197c4fc0, calling_code=2) at UnixEThread.cc:140 #2 0x006f5b72 in EThread::execute (this=0x2ae29010) at UnixEThread.cc:217 #3 0x004ff37d in main (argc=3, argv=0x7fff76c41528) at Main.cc:1958 (gdb) info f Stack level 0, frame at 0x7fff76c40e40: rip = 0x4d2c5c in Continuation::handleEvent(int, void*) (I_Continuation.h:146); saved rip 0x6f5830 called by frame at 0x7fff76c40eb0 source language c++. Arglist at 0x7fff76c40e30, args: this=0x19581df0, event=2, data=0x197c4fc0 Locals at 0x7fff76c40e30, Previous frame's sp is 0x7fff76c40e40 Saved registers: rbp at 0x7fff76c40e30, rip at 0x7fff76c40e38 (gdb) x/40x this 0x19581df0: 0x19581901 0x 0xefbeadde 0xefbeadde 0x19581e00: 0xefbeadde 0xefbeadde 0xefbeadde 0xefbeadde 0x19581e10: 0xefbeadde 0xefbeadde 0xefbeadde 0xefbeadde 0x19581e20: 0xefbeadde 0xefbeadde 0xefbeadde 0xefbeadde 0x19581e30: 0xefbeadde 0xefbeadde 0xefbeadde 0xefbeadde 0x19581e40: 0xefbeadde 0xefbeadde 0xefbeadde 0xefbeadde 0x19581e50: 0xefbeadde 0xefbeadde 0xefbeadde 0xefbeadde 0x19581e60: 0xefbeadde 0xefbeadde 0xefbeadde 0xefbeadde 0x19581e70: 0xefbeadde 0xefbeadde 0xefbeadde 0xefbeadde 0x19581e80: 0xefbeadde 0xefbeadde 0xefbeadde 0xefbeadde {code} bt #2 {code} #0 0x004d637c in Continuation::handleEvent (this=0xc3cc390, event=2, data=0xc4408a0) at I_Continuation.h:146 146 return (this-*handler) (event, data); (gdb) bt #0 0x004d637c in Continuation::handleEvent (this=0xc3cc390, event=2, data=0xc4408a0) at I_Continuation.h:146 #1 0x0070364c in EThread::process_event (this=0x2ae29010, e=0xc4408a0, calling_code=2) at UnixEThread.cc:140 #2 0x0070398e in EThread::execute (this=0x2ae29010) at UnixEThread.cc:217 #3 0x00502aac in main (argc=3, argv=0x7fff32ef2f58) at Main.cc:1961 (gdb) p *this $1 = {force_VFPT_to_top = {_vptr.force_VFPT_to_top = 0x2aaab002f011}, handler = 0xefbeaddeefbeadde, this adjustment -1171307680053154338, handler_name = 0xefbeaddeefbeadde Address 0xefbeaddeefbeadde out of bounds, mutex = {m_ptr = 0xefbeaddeefbeadde}, link = {SLinkContinuation = { next = 0xefbeaddeefbeadde}, prev = 0xefbeaddeefbeadde}} (gdb) {code} bt #3 {code} #0 0x004d2c5c in Continuation::handleEvent (this=0x2aaab00615b0, event=2, data=0x2aaab00d1570) at I_Continuation.h:146 146 return (this-*handler) (event, data); (gdb) bt #0 0x004d2c5c in Continuation::handleEvent (this=0x2aaab00615b0, event=2, data=0x2aaab00d1570) at I_Continuation.h:146 #1 0x006f5830 in EThread::process_event (this=0x2ae29010, e=0x2aaab00d1570, calling_code=2) at UnixEThread.cc:140 #2 0x006f5b72 in EThread::execute (this=0x2ae29010) at UnixEThread.cc:217 #3 0x004ff37d in main (argc=3, argv=0x7fff421f08d8) at Main.cc:1958 (gdb) info f Stack level 0, frame at 0x7fff421f01f0: rip = 0x4d2c5c in Continuation::handleEvent(int, void*) (I_Continuation.h:146); saved rip 0x6f5830 called by frame at 0x7fff421f0260 source language c++. Arglist at 0x7fff421f01e0, args: this=0x2aaab00615b0, event=2, data=0x2aaab00d1570 Locals at 0x7fff421f01e0, Previous frame's sp is 0x7fff421f01f0 Saved registers: rbp at 0x7fff421f01e0, rip at 0x7fff421f01e8 (gdb) p this-handler $1 = 0xefbeaddeefbeadde, this adjustment -1171307680053154338 {code} --
[jira] [Commented] (TS-833) Crash Report: Continuation::handleEvent, event=2, 0xdeadbeef, ink_freelist_free related
[ https://issues.apache.org/jira/browse/TS-833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13053038#comment-13053038 ] Zhao Yongming commented on TS-833: -- John: I got the case you comment on 17/Jun/11 22:07, the gdb shows: {code} [New process 12674] #0 0x0063f9f5 in get_dns (h=0x18ea3070, id=27816) at DNS.cc:752 752 if (e-once_written_flag) (gdb) bt #0 0x0063f9f5 in get_dns (h=0x18ea3070, id=27816) at DNS.cc:752 #1 0x00643e33 in dns_process (handler=0x18ea3070, buf=0x2aaab1292010, len=159) at DNS.cc:1170 #2 0x00645cfc in DNSHandler::recv_dns (this=0x18ea3070, event=5, e=0x18e7df50) at DNS.cc:690 #3 0x0064655f in DNSHandler::mainEvent (this=0x18ea3070, event=5, e=0x18e7df50) at DNS.cc:703 #4 0x004d302f in Continuation::handleEvent (this=0x18ea3070, event=5, data=0x18e7df50) at I_Continuation.h:146 #5 0x006f9978 in EThread::process_event (this=0x2ae29010, e=0x18e7df50, calling_code=5) at UnixEThread.cc:140 #6 0x006f9e96 in EThread::execute (this=0x2ae29010) at UnixEThread.cc:262 #7 0x004ff74d in main (argc=3, argv=0x7fff21439ac8) at Main.cc:1958 (gdb) print e $1 = (DNSEntry *) 0xefbeaddeefbeadde (gdb) print h-in_flight $2 = 4 (gdb) {code} and the traffic.out looks {code} [TrafficServer] using root directory '/usr' [Jun 20 10:47:48.118] Manager {47791815218176} NOTE: [LocalManager::pollMgmtProcessServer] New process connecting fd '9' [Jun 20 10:47:48.118] Manager {47791815218176} NOTE: [Alarms::signalAlarm] Server Process born [Jun 20 10:47:49.141] {47286116713584} STATUS: opened /var/log/trafficserver/diags.log [Jun 20 10:47:49.142] {47286116713584} NOTE: updated diags config [Jun 20 10:47:49.146] Server {47286116713584} NOTE: cache clustering disabled [Jun 20 10:47:49.169] Server {47286116713584} NOTE: cache clustering disabled [Jun 20 10:47:49.639] Server {47286116713584} NOTE: logging initialized[7], logging_mode = 3 [Jun 20 10:47:49.680] Server {47286116713584} NOTE: traffic server running [Jun 20 10:47:49.735] Server {1099794752} WARNING: failover: connection to DNS server 127.0.0.1 lost, move to 121.14.89.156 [Jun 20 10:47:50.243] Server {1124858176} WARNING: Access logging to local log directory suspended - configured space allocation exhausted. [Jun 20 10:47:55.446] Server {47286116713584} NOTE: cache enabled [Jun 20 10:47:56.001] Server {47286116713584} NOTE: [log-coll] host up [121.14.89.156:8085] [Jun 21 00:00:00.001] Server {1124858176} STATUS: The logfile /var/log/trafficserver/error.log was rolled to /var/log/trafficserver/error.log_cache174.cn62.20110620.10h47m49s-20110621.00h00m00s.old. [Jun 21 00:00:05.001] Server {1124858176} STATUS: The rolled logfile, /var/log/trafficserver/error.log_cache174.cn62.20110620.10h47m49s-20110621.00h00m00s.old, was auto-deleted; 0 bytes were reclaimed. NOTE: Traffic Server received Sig 11: Segmentation fault /usr/bin/traffic_server - STACK TRACE: /usr/bin/traffic_server[0x51ba3e] /lib64/libpthread.so.0[0x36af20e7c0] [0x2aaab015ac70] /usr/bin/traffic_server(_ZN10DNSHandler8recv_dnsEiP5Event+0x6a0)[0x645cfc] /usr/bin/traffic_server(_ZN10DNSHandler9mainEventEiP5Event+0x39)[0x64655f] /usr/bin/traffic_server(_ZN12Continuation11handleEventEiPv+0x6f)[0x4d302f] /usr/bin/traffic_server(_ZN7EThread13process_eventEP5Eventi+0x11e)[0x6f9978] /usr/bin/traffic_server(_ZN7EThread7executeEv+0x3c0)[0x6f9e96] /usr/bin/traffic_server(main+0x10c7)[0x4ff74d] /lib64/libc.so.6(__libc_start_main+0xf4)[0x36ae61d994] /usr/bin/traffic_server(__gxx_personality_v0+0x491)[0x4b2149] /usr/bin/traffic_server(__gxx_personality_v0+0x491)[0x4b2149] [Jun 21 01:02:34.760] Manager {47791815218176} FATAL: [LocalManager::pollMgmtProcessServer] Error in read (errno: 104) [Jun 21 01:02:36.778] Manager {47791815218176} FATAL: (last system error 104: Connection reset by peer) [Jun 21 01:02:36.778] Manager {47791815218176} NOTE: [LocalManager::mgmtShutdown] Executing shutdown request. [Jun 21 01:02:36.778] Manager {47791815218176} NOTE: [LocalManager::processShutdown] Executing process shutdown request. [Jun 21 01:02:36.784] Manager {47791815218176} ERROR: [LocalManager::sendMgmtMsgToProcesses] Error writing message [Jun 21 01:02:36.785] Manager {47791815218176} ERROR: (last system error 32: Broken pipe) [E. Mgmt] log == [TrafficManager] using root directory '/usr' [Jun 21 01:02:40.791] {46942772802560} NOTE: updated diags config [Jun 21 01:02:51.503] Manager {46942772802560} NOTE: [ClusterCom::ClusterCom] Node running on OS: 'Linux' Release: '2.6.18-164.11.1.el5' [Jun 21 01:02:51.531] Manager {46942772802560} NOTE: [LocalManager::listenForProxy] Listening on port: 8080 [Jun 21 01:02:51.531] Manager {46942772802560} NOTE: [LocalManager::listenForProxy] Listening on port: 80 [Jun 21 01:02:51.531] Manager {46942772802560} NOTE: [TrafficManager] Setup complete [Jun 21 01:02:52.594] Manager
[jira] [Commented] (TS-833) Crash Report: Continuation::handleEvent, event=2, 0xdeadbeef, ink_freelist_free related
[ https://issues.apache.org/jira/browse/TS-833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13052302#comment-13052302 ] mohan_zl commented on TS-833: - {code} #0 0x0063f9f5 in get_dns (h=0x18ea3070, id=27816) at DNS.cc:752 752 if (e-once_written_flag) (gdb) bt #0 0x0063f9f5 in get_dns (h=0x18ea3070, id=27816) at DNS.cc:752 #1 0x00643e33 in dns_process (handler=0x18ea3070, buf=0x2aaab1292010, len=159) at DNS.cc:1170 #2 0x00645cfc in DNSHandler::recv_dns (this=0x18ea3070, event=5, e=0x18e7df50) at DNS.cc:690 #3 0x0064655f in DNSHandler::mainEvent (this=0x18ea3070, event=5, e=0x18e7df50) at DNS.cc:703 #4 0x004d302f in Continuation::handleEvent (this=0x18ea3070, event=5, data=0x18e7df50) at I_Continuation.h:146 #5 0x006f9978 in EThread::process_event (this=0x2ae29010, e=0x18e7df50, calling_code=5) at UnixEThread.cc:140 #6 0x006f9e96 in EThread::execute (this=0x2ae29010) at UnixEThread.cc:262 #7 0x004ff74d in main (argc=3, argv=0x7fff21439ac8) at Main.cc:1958 (gdb) info f Stack level 0, frame at 0x7fff214382c0: rip = 0x63f9f5 in get_dns (DNS.cc:752); saved rip 0x643e33 called by frame at 0x7fff214390a0 source language c++. Arglist at 0x7fff214382b0, args: h=0x18ea3070, id=27816 Locals at 0x7fff214382b0, Previous frame's sp is 0x7fff214382c0 Saved registers: rbp at 0x7fff214382b0, rip at 0x7fff214382b8 (gdb) info args h = (DNSHandler *) 0x18ea3070 id = 27816 (gdb) p h $1 = (DNSHandler *) 0x18ea3070 (gdb) p h-handler_name $2 = 0x755f55 DNSHandler::mainEvent {code} Crash Report: Continuation::handleEvent, event=2, 0xdeadbeef, ink_freelist_free related --- Key: TS-833 URL: https://issues.apache.org/jira/browse/TS-833 Project: Traffic Server Issue Type: Bug Components: Core Affects Versions: 3.1.0 Environment: current trunk, with --enable-debug Reporter: Zhao Yongming Labels: freelist Fix For: 3.1.0 Attachments: TS-833-2.diff, TS-833-3.diff, TS-833.diff bt #1 {code} #0 0x004d2c5c in Continuation::handleEvent (this=0x19581df0, event=2, data=0x197c4fc0) at I_Continuation.h:146 146 return (this-*handler) (event, data); (gdb) bt #0 0x004d2c5c in Continuation::handleEvent (this=0x19581df0, event=2, data=0x197c4fc0) at I_Continuation.h:146 #1 0x006f5830 in EThread::process_event (this=0x2ae29010, e=0x197c4fc0, calling_code=2) at UnixEThread.cc:140 #2 0x006f5b72 in EThread::execute (this=0x2ae29010) at UnixEThread.cc:217 #3 0x004ff37d in main (argc=3, argv=0x7fff76c41528) at Main.cc:1958 (gdb) info f Stack level 0, frame at 0x7fff76c40e40: rip = 0x4d2c5c in Continuation::handleEvent(int, void*) (I_Continuation.h:146); saved rip 0x6f5830 called by frame at 0x7fff76c40eb0 source language c++. Arglist at 0x7fff76c40e30, args: this=0x19581df0, event=2, data=0x197c4fc0 Locals at 0x7fff76c40e30, Previous frame's sp is 0x7fff76c40e40 Saved registers: rbp at 0x7fff76c40e30, rip at 0x7fff76c40e38 (gdb) x/40x this 0x19581df0: 0x19581901 0x 0xefbeadde 0xefbeadde 0x19581e00: 0xefbeadde 0xefbeadde 0xefbeadde 0xefbeadde 0x19581e10: 0xefbeadde 0xefbeadde 0xefbeadde 0xefbeadde 0x19581e20: 0xefbeadde 0xefbeadde 0xefbeadde 0xefbeadde 0x19581e30: 0xefbeadde 0xefbeadde 0xefbeadde 0xefbeadde 0x19581e40: 0xefbeadde 0xefbeadde 0xefbeadde 0xefbeadde 0x19581e50: 0xefbeadde 0xefbeadde 0xefbeadde 0xefbeadde 0x19581e60: 0xefbeadde 0xefbeadde 0xefbeadde 0xefbeadde 0x19581e70: 0xefbeadde 0xefbeadde 0xefbeadde 0xefbeadde 0x19581e80: 0xefbeadde 0xefbeadde 0xefbeadde 0xefbeadde {code} bt #2 {code} #0 0x004d637c in Continuation::handleEvent (this=0xc3cc390, event=2, data=0xc4408a0) at I_Continuation.h:146 146 return (this-*handler) (event, data); (gdb) bt #0 0x004d637c in Continuation::handleEvent (this=0xc3cc390, event=2, data=0xc4408a0) at I_Continuation.h:146 #1 0x0070364c in EThread::process_event (this=0x2ae29010, e=0xc4408a0, calling_code=2) at UnixEThread.cc:140 #2 0x0070398e in EThread::execute (this=0x2ae29010) at UnixEThread.cc:217 #3 0x00502aac in main (argc=3, argv=0x7fff32ef2f58) at Main.cc:1961 (gdb) p *this $1 = {force_VFPT_to_top = {_vptr.force_VFPT_to_top = 0x2aaab002f011}, handler = 0xefbeaddeefbeadde, this adjustment -1171307680053154338, handler_name = 0xefbeaddeefbeadde Address 0xefbeaddeefbeadde out of bounds, mutex = {m_ptr =
[jira] [Commented] (TS-833) Crash Report: Continuation::handleEvent, event=2, 0xdeadbeef, ink_freelist_free related
[ https://issues.apache.org/jira/browse/TS-833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13051784#comment-13051784 ] mohan_zl commented on TS-833: - By the way, now we found an interesting problem, we use 20 machines for testing, and each node use single mode. We found if the nodes have run for a while, then some machine have a very very low qps, but not crash, and if one node crashed, then when it restart, it can run well as before. I think maybe this problem is not caused by cache, but the proxy or net module. Crash Report: Continuation::handleEvent, event=2, 0xdeadbeef, ink_freelist_free related --- Key: TS-833 URL: https://issues.apache.org/jira/browse/TS-833 Project: Traffic Server Issue Type: Bug Components: Core Affects Versions: 3.1.0 Environment: current trunk, with --enable-debug Reporter: Zhao Yongming Labels: freelist Fix For: 3.1.0 Attachments: TS-833-2.diff, TS-833-3.diff, TS-833.diff bt #1 {code} #0 0x004d2c5c in Continuation::handleEvent (this=0x19581df0, event=2, data=0x197c4fc0) at I_Continuation.h:146 146 return (this-*handler) (event, data); (gdb) bt #0 0x004d2c5c in Continuation::handleEvent (this=0x19581df0, event=2, data=0x197c4fc0) at I_Continuation.h:146 #1 0x006f5830 in EThread::process_event (this=0x2ae29010, e=0x197c4fc0, calling_code=2) at UnixEThread.cc:140 #2 0x006f5b72 in EThread::execute (this=0x2ae29010) at UnixEThread.cc:217 #3 0x004ff37d in main (argc=3, argv=0x7fff76c41528) at Main.cc:1958 (gdb) info f Stack level 0, frame at 0x7fff76c40e40: rip = 0x4d2c5c in Continuation::handleEvent(int, void*) (I_Continuation.h:146); saved rip 0x6f5830 called by frame at 0x7fff76c40eb0 source language c++. Arglist at 0x7fff76c40e30, args: this=0x19581df0, event=2, data=0x197c4fc0 Locals at 0x7fff76c40e30, Previous frame's sp is 0x7fff76c40e40 Saved registers: rbp at 0x7fff76c40e30, rip at 0x7fff76c40e38 (gdb) x/40x this 0x19581df0: 0x19581901 0x 0xefbeadde 0xefbeadde 0x19581e00: 0xefbeadde 0xefbeadde 0xefbeadde 0xefbeadde 0x19581e10: 0xefbeadde 0xefbeadde 0xefbeadde 0xefbeadde 0x19581e20: 0xefbeadde 0xefbeadde 0xefbeadde 0xefbeadde 0x19581e30: 0xefbeadde 0xefbeadde 0xefbeadde 0xefbeadde 0x19581e40: 0xefbeadde 0xefbeadde 0xefbeadde 0xefbeadde 0x19581e50: 0xefbeadde 0xefbeadde 0xefbeadde 0xefbeadde 0x19581e60: 0xefbeadde 0xefbeadde 0xefbeadde 0xefbeadde 0x19581e70: 0xefbeadde 0xefbeadde 0xefbeadde 0xefbeadde 0x19581e80: 0xefbeadde 0xefbeadde 0xefbeadde 0xefbeadde {code} bt #2 {code} #0 0x004d637c in Continuation::handleEvent (this=0xc3cc390, event=2, data=0xc4408a0) at I_Continuation.h:146 146 return (this-*handler) (event, data); (gdb) bt #0 0x004d637c in Continuation::handleEvent (this=0xc3cc390, event=2, data=0xc4408a0) at I_Continuation.h:146 #1 0x0070364c in EThread::process_event (this=0x2ae29010, e=0xc4408a0, calling_code=2) at UnixEThread.cc:140 #2 0x0070398e in EThread::execute (this=0x2ae29010) at UnixEThread.cc:217 #3 0x00502aac in main (argc=3, argv=0x7fff32ef2f58) at Main.cc:1961 (gdb) p *this $1 = {force_VFPT_to_top = {_vptr.force_VFPT_to_top = 0x2aaab002f011}, handler = 0xefbeaddeefbeadde, this adjustment -1171307680053154338, handler_name = 0xefbeaddeefbeadde Address 0xefbeaddeefbeadde out of bounds, mutex = {m_ptr = 0xefbeaddeefbeadde}, link = {SLinkContinuation = { next = 0xefbeaddeefbeadde}, prev = 0xefbeaddeefbeadde}} (gdb) {code} bt #3 {code} #0 0x004d2c5c in Continuation::handleEvent (this=0x2aaab00615b0, event=2, data=0x2aaab00d1570) at I_Continuation.h:146 146 return (this-*handler) (event, data); (gdb) bt #0 0x004d2c5c in Continuation::handleEvent (this=0x2aaab00615b0, event=2, data=0x2aaab00d1570) at I_Continuation.h:146 #1 0x006f5830 in EThread::process_event (this=0x2ae29010, e=0x2aaab00d1570, calling_code=2) at UnixEThread.cc:140 #2 0x006f5b72 in EThread::execute (this=0x2ae29010) at UnixEThread.cc:217 #3 0x004ff37d in main (argc=3, argv=0x7fff421f08d8) at Main.cc:1958 (gdb) info f Stack level 0, frame at 0x7fff421f01f0: rip = 0x4d2c5c in Continuation::handleEvent(int, void*) (I_Continuation.h:146); saved rip 0x6f5830 called by frame at 0x7fff421f0260 source language c++. Arglist at 0x7fff421f01e0, args: this=0x2aaab00615b0, event=2, data=0x2aaab00d1570 Locals at
[jira] [Commented] (TS-833) Crash Report: Continuation::handleEvent, event=2, 0xdeadbeef, ink_freelist_free related
[ https://issues.apache.org/jira/browse/TS-833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13050947#comment-13050947 ] Zhao Yongming commented on TS-833: -- we have got another rare Seg Fault, not sure if it is this bug related, here is the stack trace: traffic.out: {code} NOTE: Traffic Server received Sig 11: Segmentation fault /usr/bin/traffic_server - STACK TRACE: /usr/bin/traffic_server[0x51ba3e] /lib64/libpthread.so.0[0x30ec20e7c0] [0x122802e65b371fd0] /usr/bin/traffic_server(DNSEntry::mainEvent(int, Event*)+0x595)[0x643b65] /usr/bin/traffic_server(Continuation::handleEvent(int, void*)+0x6f)[0x4d302f] /usr/bin/traffic_server(DNSProcessor::getby(char const*, int, int, Continuation*, DNSHandler*, int)+0x250)[0x641472] /usr/bin/traffic_server(DNSProcessor::gethostbyname(Continuation*, char const*, DNSHandler*, int)+0x47)[0x6378c7] /usr/bin/traffic_server(HostDBContinuation::do_dns()+0x2b9)[0x630125] /usr/bin/traffic_server(HostDBContinuation::probeEvent(int, Event*)+0x341)[0x6313b3] /usr/bin/traffic_server(Continuation::handleEvent(int, void*)+0x6f)[0x4d302f] /usr/bin/traffic_server(EThread::process_event(Event*, int)+0x11e)[0x6f9978] /usr/bin/traffic_server(EThread::execute()+0x1e4)[0x6f9cba] /usr/bin/traffic_server[0x6f92c9] /lib64/libpthread.so.0[0x30ec2064a7] /lib64/libc.so.6(clone+0x6d)[0x30eb6d3c2d] /lib64/libc.so.6(clone+0x6d)[0x30eb6d3c2d] [Jun 17 16:22:52.570] Manager {47840561255424} FATAL: [LocalManager::pollMgmtProcessServer] Error in read (errno: 104) {code} gdb: {code} (gdb) bt #0 0x006424b0 in write_dns_event (h=0x1e3c1fb0, e=0x2aaab006a690) at DNS.cc:898 #1 0x006427b6 in write_dns (h=0x1e3c1fb0) at DNS.cc:804 #2 0x00643b65 in DNSEntry::mainEvent (this=0x2aaab006ba50, event=1, e=0x0) at DNS.cc:965 #3 0x004d302f in Continuation::handleEvent (this=0x2aaab006ba50, event=1, data=0x0) at I_Continuation.h:146 #4 0x00641472 in DNSProcessor::getby (this=0xac22e0, x=0x1e3dda14 img04.taobaocdn.com, len=0, type=1, cont=0x1e3dd960, adnsH=0x0, timeout=0) at DNS.cc:999 #5 0x006378c7 in DNSProcessor::gethostbyname (this=0xac22e0, cont=0x1e3dd960, name=0x1e3dda14 img04.taobaocdn.com, adnsH=0x0, timeout=0) at I_DNSProcessor.h:123 #6 0x00630125 in HostDBContinuation::do_dns (this=0x1e3dd960) at HostDB.cc:1771 #7 0x006313b3 in HostDBContinuation::probeEvent (this=0x1e3dd960, event=2, e=0x215c9980) at HostDB.cc:1696 #8 0x004d302f in Continuation::handleEvent (this=0x1e3dd960, event=2, data=0x215c9980) at I_Continuation.h:146 #9 0x006f9978 in EThread::process_event (this=0x2af2a010, e=0x215c9980, calling_code=2) at UnixEThread.cc:140 #10 0x006f9cba in EThread::execute (this=0x2af2a010) at UnixEThread.cc:217 #11 0x006f92c9 in spawn_thread_internal (a=0x1e393b40) at Thread.cc:88 #12 0x0030ec2064a7 in start_thread () from /lib64/libpthread.so.0 #13 0x0030eb6d3c2d in clone () from /lib64/libc.so.6 (gdb) info f Stack level 0, frame at 0x40ee0a70: rip = 0x6424b0 in write_dns_event (DNS.cc:898); saved rip 0x6427b6 called by frame at 0x40ee0ac0 source language c++. Arglist at 0x40ee0a60, args: h=0x1e3c1fb0, e=0x2aaab006a690 Locals at 0x40ee0a60, Previous frame's sp is 0x40ee0a70 Saved registers: rbx at 0x40ee0a48, rbp at 0x40ee0a60, r12 at 0x40ee0a50, r13 at 0x40ee0a58, rip at 0x40ee0a68 {code} Crash Report: Continuation::handleEvent, event=2, 0xdeadbeef, ink_freelist_free related --- Key: TS-833 URL: https://issues.apache.org/jira/browse/TS-833 Project: Traffic Server Issue Type: Bug Components: Core Affects Versions: 3.1.0 Environment: current trunk, with --enable-debug Reporter: Zhao Yongming Labels: freelist Attachments: TS-833-2.diff, TS-833-3.diff, TS-833.diff bt #1 {code} #0 0x004d2c5c in Continuation::handleEvent (this=0x19581df0, event=2, data=0x197c4fc0) at I_Continuation.h:146 146 return (this-*handler) (event, data); (gdb) bt #0 0x004d2c5c in Continuation::handleEvent (this=0x19581df0, event=2, data=0x197c4fc0) at I_Continuation.h:146 #1 0x006f5830 in EThread::process_event (this=0x2ae29010, e=0x197c4fc0, calling_code=2) at UnixEThread.cc:140 #2 0x006f5b72 in EThread::execute (this=0x2ae29010) at UnixEThread.cc:217 #3 0x004ff37d in main (argc=3, argv=0x7fff76c41528) at Main.cc:1958 (gdb) info f Stack level 0, frame at 0x7fff76c40e40: rip = 0x4d2c5c in Continuation::handleEvent(int, void*) (I_Continuation.h:146); saved rip 0x6f5830 called by frame at 0x7fff76c40eb0 source language c++. Arglist at 0x7fff76c40e30, args: this=0x19581df0, event=2, data=0x197c4fc0 Locals at
[jira] [Commented] (TS-833) Crash Report: Continuation::handleEvent, event=2, 0xdeadbeef, ink_freelist_free related
[ https://issues.apache.org/jira/browse/TS-833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13050620#comment-13050620 ] John Plevyak commented on TS-833: - mohan_zl, this latest crash is with TS-833-3.diff ?? Crash Report: Continuation::handleEvent, event=2, 0xdeadbeef, ink_freelist_free related --- Key: TS-833 URL: https://issues.apache.org/jira/browse/TS-833 Project: Traffic Server Issue Type: Bug Components: Core Affects Versions: 3.1.0 Environment: current trunk, with --enable-debug Reporter: Zhao Yongming Labels: freelist Attachments: TS-833-2.diff, TS-833-3.diff, TS-833.diff bt #1 {code} #0 0x004d2c5c in Continuation::handleEvent (this=0x19581df0, event=2, data=0x197c4fc0) at I_Continuation.h:146 146 return (this-*handler) (event, data); (gdb) bt #0 0x004d2c5c in Continuation::handleEvent (this=0x19581df0, event=2, data=0x197c4fc0) at I_Continuation.h:146 #1 0x006f5830 in EThread::process_event (this=0x2ae29010, e=0x197c4fc0, calling_code=2) at UnixEThread.cc:140 #2 0x006f5b72 in EThread::execute (this=0x2ae29010) at UnixEThread.cc:217 #3 0x004ff37d in main (argc=3, argv=0x7fff76c41528) at Main.cc:1958 (gdb) info f Stack level 0, frame at 0x7fff76c40e40: rip = 0x4d2c5c in Continuation::handleEvent(int, void*) (I_Continuation.h:146); saved rip 0x6f5830 called by frame at 0x7fff76c40eb0 source language c++. Arglist at 0x7fff76c40e30, args: this=0x19581df0, event=2, data=0x197c4fc0 Locals at 0x7fff76c40e30, Previous frame's sp is 0x7fff76c40e40 Saved registers: rbp at 0x7fff76c40e30, rip at 0x7fff76c40e38 (gdb) x/40x this 0x19581df0: 0x19581901 0x 0xefbeadde 0xefbeadde 0x19581e00: 0xefbeadde 0xefbeadde 0xefbeadde 0xefbeadde 0x19581e10: 0xefbeadde 0xefbeadde 0xefbeadde 0xefbeadde 0x19581e20: 0xefbeadde 0xefbeadde 0xefbeadde 0xefbeadde 0x19581e30: 0xefbeadde 0xefbeadde 0xefbeadde 0xefbeadde 0x19581e40: 0xefbeadde 0xefbeadde 0xefbeadde 0xefbeadde 0x19581e50: 0xefbeadde 0xefbeadde 0xefbeadde 0xefbeadde 0x19581e60: 0xefbeadde 0xefbeadde 0xefbeadde 0xefbeadde 0x19581e70: 0xefbeadde 0xefbeadde 0xefbeadde 0xefbeadde 0x19581e80: 0xefbeadde 0xefbeadde 0xefbeadde 0xefbeadde {code} bt #2 {code} #0 0x004d637c in Continuation::handleEvent (this=0xc3cc390, event=2, data=0xc4408a0) at I_Continuation.h:146 146 return (this-*handler) (event, data); (gdb) bt #0 0x004d637c in Continuation::handleEvent (this=0xc3cc390, event=2, data=0xc4408a0) at I_Continuation.h:146 #1 0x0070364c in EThread::process_event (this=0x2ae29010, e=0xc4408a0, calling_code=2) at UnixEThread.cc:140 #2 0x0070398e in EThread::execute (this=0x2ae29010) at UnixEThread.cc:217 #3 0x00502aac in main (argc=3, argv=0x7fff32ef2f58) at Main.cc:1961 (gdb) p *this $1 = {force_VFPT_to_top = {_vptr.force_VFPT_to_top = 0x2aaab002f011}, handler = 0xefbeaddeefbeadde, this adjustment -1171307680053154338, handler_name = 0xefbeaddeefbeadde Address 0xefbeaddeefbeadde out of bounds, mutex = {m_ptr = 0xefbeaddeefbeadde}, link = {SLinkContinuation = { next = 0xefbeaddeefbeadde}, prev = 0xefbeaddeefbeadde}} (gdb) {code} bt #3 {code} #0 0x004d2c5c in Continuation::handleEvent (this=0x2aaab00615b0, event=2, data=0x2aaab00d1570) at I_Continuation.h:146 146 return (this-*handler) (event, data); (gdb) bt #0 0x004d2c5c in Continuation::handleEvent (this=0x2aaab00615b0, event=2, data=0x2aaab00d1570) at I_Continuation.h:146 #1 0x006f5830 in EThread::process_event (this=0x2ae29010, e=0x2aaab00d1570, calling_code=2) at UnixEThread.cc:140 #2 0x006f5b72 in EThread::execute (this=0x2ae29010) at UnixEThread.cc:217 #3 0x004ff37d in main (argc=3, argv=0x7fff421f08d8) at Main.cc:1958 (gdb) info f Stack level 0, frame at 0x7fff421f01f0: rip = 0x4d2c5c in Continuation::handleEvent(int, void*) (I_Continuation.h:146); saved rip 0x6f5830 called by frame at 0x7fff421f0260 source language c++. Arglist at 0x7fff421f01e0, args: this=0x2aaab00615b0, event=2, data=0x2aaab00d1570 Locals at 0x7fff421f01e0, Previous frame's sp is 0x7fff421f01f0 Saved registers: rbp at 0x7fff421f01e0, rip at 0x7fff421f01e8 (gdb) p this-handler $1 = 0xefbeaddeefbeadde, this adjustment -1171307680053154338 {code} -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (TS-833) Crash Report: Continuation::handleEvent, event=2, 0xdeadbeef, ink_freelist_free related
[ https://issues.apache.org/jira/browse/TS-833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13050836#comment-13050836 ] mohan_zl commented on TS-833: - @John yeah, i use TS-833-3.diff with the latest trunk. Crash Report: Continuation::handleEvent, event=2, 0xdeadbeef, ink_freelist_free related --- Key: TS-833 URL: https://issues.apache.org/jira/browse/TS-833 Project: Traffic Server Issue Type: Bug Components: Core Affects Versions: 3.1.0 Environment: current trunk, with --enable-debug Reporter: Zhao Yongming Labels: freelist Attachments: TS-833-2.diff, TS-833-3.diff, TS-833.diff bt #1 {code} #0 0x004d2c5c in Continuation::handleEvent (this=0x19581df0, event=2, data=0x197c4fc0) at I_Continuation.h:146 146 return (this-*handler) (event, data); (gdb) bt #0 0x004d2c5c in Continuation::handleEvent (this=0x19581df0, event=2, data=0x197c4fc0) at I_Continuation.h:146 #1 0x006f5830 in EThread::process_event (this=0x2ae29010, e=0x197c4fc0, calling_code=2) at UnixEThread.cc:140 #2 0x006f5b72 in EThread::execute (this=0x2ae29010) at UnixEThread.cc:217 #3 0x004ff37d in main (argc=3, argv=0x7fff76c41528) at Main.cc:1958 (gdb) info f Stack level 0, frame at 0x7fff76c40e40: rip = 0x4d2c5c in Continuation::handleEvent(int, void*) (I_Continuation.h:146); saved rip 0x6f5830 called by frame at 0x7fff76c40eb0 source language c++. Arglist at 0x7fff76c40e30, args: this=0x19581df0, event=2, data=0x197c4fc0 Locals at 0x7fff76c40e30, Previous frame's sp is 0x7fff76c40e40 Saved registers: rbp at 0x7fff76c40e30, rip at 0x7fff76c40e38 (gdb) x/40x this 0x19581df0: 0x19581901 0x 0xefbeadde 0xefbeadde 0x19581e00: 0xefbeadde 0xefbeadde 0xefbeadde 0xefbeadde 0x19581e10: 0xefbeadde 0xefbeadde 0xefbeadde 0xefbeadde 0x19581e20: 0xefbeadde 0xefbeadde 0xefbeadde 0xefbeadde 0x19581e30: 0xefbeadde 0xefbeadde 0xefbeadde 0xefbeadde 0x19581e40: 0xefbeadde 0xefbeadde 0xefbeadde 0xefbeadde 0x19581e50: 0xefbeadde 0xefbeadde 0xefbeadde 0xefbeadde 0x19581e60: 0xefbeadde 0xefbeadde 0xefbeadde 0xefbeadde 0x19581e70: 0xefbeadde 0xefbeadde 0xefbeadde 0xefbeadde 0x19581e80: 0xefbeadde 0xefbeadde 0xefbeadde 0xefbeadde {code} bt #2 {code} #0 0x004d637c in Continuation::handleEvent (this=0xc3cc390, event=2, data=0xc4408a0) at I_Continuation.h:146 146 return (this-*handler) (event, data); (gdb) bt #0 0x004d637c in Continuation::handleEvent (this=0xc3cc390, event=2, data=0xc4408a0) at I_Continuation.h:146 #1 0x0070364c in EThread::process_event (this=0x2ae29010, e=0xc4408a0, calling_code=2) at UnixEThread.cc:140 #2 0x0070398e in EThread::execute (this=0x2ae29010) at UnixEThread.cc:217 #3 0x00502aac in main (argc=3, argv=0x7fff32ef2f58) at Main.cc:1961 (gdb) p *this $1 = {force_VFPT_to_top = {_vptr.force_VFPT_to_top = 0x2aaab002f011}, handler = 0xefbeaddeefbeadde, this adjustment -1171307680053154338, handler_name = 0xefbeaddeefbeadde Address 0xefbeaddeefbeadde out of bounds, mutex = {m_ptr = 0xefbeaddeefbeadde}, link = {SLinkContinuation = { next = 0xefbeaddeefbeadde}, prev = 0xefbeaddeefbeadde}} (gdb) {code} bt #3 {code} #0 0x004d2c5c in Continuation::handleEvent (this=0x2aaab00615b0, event=2, data=0x2aaab00d1570) at I_Continuation.h:146 146 return (this-*handler) (event, data); (gdb) bt #0 0x004d2c5c in Continuation::handleEvent (this=0x2aaab00615b0, event=2, data=0x2aaab00d1570) at I_Continuation.h:146 #1 0x006f5830 in EThread::process_event (this=0x2ae29010, e=0x2aaab00d1570, calling_code=2) at UnixEThread.cc:140 #2 0x006f5b72 in EThread::execute (this=0x2ae29010) at UnixEThread.cc:217 #3 0x004ff37d in main (argc=3, argv=0x7fff421f08d8) at Main.cc:1958 (gdb) info f Stack level 0, frame at 0x7fff421f01f0: rip = 0x4d2c5c in Continuation::handleEvent(int, void*) (I_Continuation.h:146); saved rip 0x6f5830 called by frame at 0x7fff421f0260 source language c++. Arglist at 0x7fff421f01e0, args: this=0x2aaab00615b0, event=2, data=0x2aaab00d1570 Locals at 0x7fff421f01e0, Previous frame's sp is 0x7fff421f01f0 Saved registers: rbp at 0x7fff421f01e0, rip at 0x7fff421f01e8 (gdb) p this-handler $1 = 0xefbeaddeefbeadde, this adjustment -1171307680053154338 {code} -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (TS-833) Crash Report: Continuation::handleEvent, event=2, 0xdeadbeef, ink_freelist_free related
[ https://issues.apache.org/jira/browse/TS-833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13050861#comment-13050861 ] mohan_zl commented on TS-833: - @John, is there any possibilities that these problem is caused by some deep bug? Crash Report: Continuation::handleEvent, event=2, 0xdeadbeef, ink_freelist_free related --- Key: TS-833 URL: https://issues.apache.org/jira/browse/TS-833 Project: Traffic Server Issue Type: Bug Components: Core Affects Versions: 3.1.0 Environment: current trunk, with --enable-debug Reporter: Zhao Yongming Labels: freelist Attachments: TS-833-2.diff, TS-833-3.diff, TS-833.diff bt #1 {code} #0 0x004d2c5c in Continuation::handleEvent (this=0x19581df0, event=2, data=0x197c4fc0) at I_Continuation.h:146 146 return (this-*handler) (event, data); (gdb) bt #0 0x004d2c5c in Continuation::handleEvent (this=0x19581df0, event=2, data=0x197c4fc0) at I_Continuation.h:146 #1 0x006f5830 in EThread::process_event (this=0x2ae29010, e=0x197c4fc0, calling_code=2) at UnixEThread.cc:140 #2 0x006f5b72 in EThread::execute (this=0x2ae29010) at UnixEThread.cc:217 #3 0x004ff37d in main (argc=3, argv=0x7fff76c41528) at Main.cc:1958 (gdb) info f Stack level 0, frame at 0x7fff76c40e40: rip = 0x4d2c5c in Continuation::handleEvent(int, void*) (I_Continuation.h:146); saved rip 0x6f5830 called by frame at 0x7fff76c40eb0 source language c++. Arglist at 0x7fff76c40e30, args: this=0x19581df0, event=2, data=0x197c4fc0 Locals at 0x7fff76c40e30, Previous frame's sp is 0x7fff76c40e40 Saved registers: rbp at 0x7fff76c40e30, rip at 0x7fff76c40e38 (gdb) x/40x this 0x19581df0: 0x19581901 0x 0xefbeadde 0xefbeadde 0x19581e00: 0xefbeadde 0xefbeadde 0xefbeadde 0xefbeadde 0x19581e10: 0xefbeadde 0xefbeadde 0xefbeadde 0xefbeadde 0x19581e20: 0xefbeadde 0xefbeadde 0xefbeadde 0xefbeadde 0x19581e30: 0xefbeadde 0xefbeadde 0xefbeadde 0xefbeadde 0x19581e40: 0xefbeadde 0xefbeadde 0xefbeadde 0xefbeadde 0x19581e50: 0xefbeadde 0xefbeadde 0xefbeadde 0xefbeadde 0x19581e60: 0xefbeadde 0xefbeadde 0xefbeadde 0xefbeadde 0x19581e70: 0xefbeadde 0xefbeadde 0xefbeadde 0xefbeadde 0x19581e80: 0xefbeadde 0xefbeadde 0xefbeadde 0xefbeadde {code} bt #2 {code} #0 0x004d637c in Continuation::handleEvent (this=0xc3cc390, event=2, data=0xc4408a0) at I_Continuation.h:146 146 return (this-*handler) (event, data); (gdb) bt #0 0x004d637c in Continuation::handleEvent (this=0xc3cc390, event=2, data=0xc4408a0) at I_Continuation.h:146 #1 0x0070364c in EThread::process_event (this=0x2ae29010, e=0xc4408a0, calling_code=2) at UnixEThread.cc:140 #2 0x0070398e in EThread::execute (this=0x2ae29010) at UnixEThread.cc:217 #3 0x00502aac in main (argc=3, argv=0x7fff32ef2f58) at Main.cc:1961 (gdb) p *this $1 = {force_VFPT_to_top = {_vptr.force_VFPT_to_top = 0x2aaab002f011}, handler = 0xefbeaddeefbeadde, this adjustment -1171307680053154338, handler_name = 0xefbeaddeefbeadde Address 0xefbeaddeefbeadde out of bounds, mutex = {m_ptr = 0xefbeaddeefbeadde}, link = {SLinkContinuation = { next = 0xefbeaddeefbeadde}, prev = 0xefbeaddeefbeadde}} (gdb) {code} bt #3 {code} #0 0x004d2c5c in Continuation::handleEvent (this=0x2aaab00615b0, event=2, data=0x2aaab00d1570) at I_Continuation.h:146 146 return (this-*handler) (event, data); (gdb) bt #0 0x004d2c5c in Continuation::handleEvent (this=0x2aaab00615b0, event=2, data=0x2aaab00d1570) at I_Continuation.h:146 #1 0x006f5830 in EThread::process_event (this=0x2ae29010, e=0x2aaab00d1570, calling_code=2) at UnixEThread.cc:140 #2 0x006f5b72 in EThread::execute (this=0x2ae29010) at UnixEThread.cc:217 #3 0x004ff37d in main (argc=3, argv=0x7fff421f08d8) at Main.cc:1958 (gdb) info f Stack level 0, frame at 0x7fff421f01f0: rip = 0x4d2c5c in Continuation::handleEvent(int, void*) (I_Continuation.h:146); saved rip 0x6f5830 called by frame at 0x7fff421f0260 source language c++. Arglist at 0x7fff421f01e0, args: this=0x2aaab00615b0, event=2, data=0x2aaab00d1570 Locals at 0x7fff421f01e0, Previous frame's sp is 0x7fff421f01f0 Saved registers: rbp at 0x7fff421f01e0, rip at 0x7fff421f01e8 (gdb) p this-handler $1 = 0xefbeaddeefbeadde, this adjustment -1171307680053154338 {code} -- This message is automatically generated by JIRA. For more information on JIRA, see:
[jira] [Commented] (TS-833) Crash Report: Continuation::handleEvent, event=2, 0xdeadbeef, ink_freelist_free related
[ https://issues.apache.org/jira/browse/TS-833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13050173#comment-13050173 ] mohan_zl commented on TS-833: - {quote} #0 0x004d2c5c in Continuation::handleEvent (this=0xda48180, event=2, data=0xdb212d0) at I_Continuation.h:146 146 return (this-*handler) (event, data); (gdb) bt #0 0x004d2c5c in Continuation::handleEvent (this=0xda48180, event=2, data=0xdb212d0) at I_Continuation.h:146 #1 0x006f58c8 in EThread::process_event (this=0x2ae29010, e=0xdb212d0, calling_code=2) at UnixEThread.cc:140 #2 0x006f5c0a in EThread::execute (this=0x2ae29010) at UnixEThread.cc:217 #3 0x004ff37d in main (argc=3, argv=0x7fff0e981f48) at Main.cc:1958 (gdb) x/40x this 0xda48180: 0x0da477a1 0x 0xefbeadde 0xefbeadde 0xda48190: 0xefbeadde 0xefbeadde 0xefbeadde 0xefbeadde 0xda481a0: 0xefbeadde 0xefbeadde 0xefbeadde 0xefbeadde 0xda481b0: 0xefbeadde 0xefbeadde 0xefbeadde 0xefbeadde 0xda481c0: 0xefbeadde 0xefbeadde 0xefbeadde 0xefbeadde 0xda481d0: 0xefbeadde 0xefbeadde 0xefbeadde 0xefbeadde 0xda481e0: 0xefbeadde 0xefbeadde 0xefbeadde 0xefbeadde 0xda481f0: 0xefbeadde 0xefbeadde 0xefbeadde 0xefbeadde 0xda48200: 0xefbeadde 0xefbeadde 0xefbeadde 0xefbeadde 0xda48210: 0xefbeadde 0xefbeadde 0xefbeadde 0xefbeadde (gdb) info f Stack level 0, frame at 0x7fff0e981860: rip = 0x4d2c5c in Continuation::handleEvent(int, void*) (I_Continuation.h:146); saved rip 0x6f58c8 called by frame at 0x7fff0e9818d0 source language c++. Arglist at 0x7fff0e981850, args: this=0xda48180, event=2, data=0xdb212d0 Locals at 0x7fff0e981850, Previous frame's sp is 0x7fff0e981860 Saved registers: rbp at 0x7fff0e981850, rip at 0x7fff0e981858 (gdb) info args this = (Continuation * const) 0xda48180 event = 2 data = (void *) 0xdb212d0 (gdb) p this-handler_name $1 = 0xefbeaddeefbeadde Address 0xefbeaddeefbeadde out of bounds (gdb) p *this $2 = {force_VFPT_to_top = {_vptr.force_VFPT_to_top = 0xda477a1}, handler = 0xefbeaddeefbeadde, this adjustment -1171307680053154338, handler_name = 0xefbeaddeefbeadde Address 0xefbeaddeefbeadde out of bounds, mutex = {m_ptr = 0xefbeaddeefbeadde}, link = {SLinkContinuation = { next = 0xefbeaddeefbeadde}, prev = 0xefbeaddeefbeadde}} {quote} Crash Report: Continuation::handleEvent, event=2, 0xdeadbeef, ink_freelist_free related --- Key: TS-833 URL: https://issues.apache.org/jira/browse/TS-833 Project: Traffic Server Issue Type: Bug Components: Core Affects Versions: 3.1.0 Environment: current trunk, with --enable-debug Reporter: Zhao Yongming Labels: freelist Attachments: TS-833-2.diff, TS-833-3.diff, TS-833.diff bt #1 {code} #0 0x004d2c5c in Continuation::handleEvent (this=0x19581df0, event=2, data=0x197c4fc0) at I_Continuation.h:146 146 return (this-*handler) (event, data); (gdb) bt #0 0x004d2c5c in Continuation::handleEvent (this=0x19581df0, event=2, data=0x197c4fc0) at I_Continuation.h:146 #1 0x006f5830 in EThread::process_event (this=0x2ae29010, e=0x197c4fc0, calling_code=2) at UnixEThread.cc:140 #2 0x006f5b72 in EThread::execute (this=0x2ae29010) at UnixEThread.cc:217 #3 0x004ff37d in main (argc=3, argv=0x7fff76c41528) at Main.cc:1958 (gdb) info f Stack level 0, frame at 0x7fff76c40e40: rip = 0x4d2c5c in Continuation::handleEvent(int, void*) (I_Continuation.h:146); saved rip 0x6f5830 called by frame at 0x7fff76c40eb0 source language c++. Arglist at 0x7fff76c40e30, args: this=0x19581df0, event=2, data=0x197c4fc0 Locals at 0x7fff76c40e30, Previous frame's sp is 0x7fff76c40e40 Saved registers: rbp at 0x7fff76c40e30, rip at 0x7fff76c40e38 (gdb) x/40x this 0x19581df0: 0x19581901 0x 0xefbeadde 0xefbeadde 0x19581e00: 0xefbeadde 0xefbeadde 0xefbeadde 0xefbeadde 0x19581e10: 0xefbeadde 0xefbeadde 0xefbeadde 0xefbeadde 0x19581e20: 0xefbeadde 0xefbeadde 0xefbeadde 0xefbeadde 0x19581e30: 0xefbeadde 0xefbeadde 0xefbeadde 0xefbeadde 0x19581e40: 0xefbeadde 0xefbeadde 0xefbeadde 0xefbeadde 0x19581e50: 0xefbeadde 0xefbeadde 0xefbeadde 0xefbeadde 0x19581e60: 0xefbeadde 0xefbeadde 0xefbeadde 0xefbeadde 0x19581e70: 0xefbeadde 0xefbeadde 0xefbeadde 0xefbeadde 0x19581e80: 0xefbeadde 0xefbeadde 0xefbeadde 0xefbeadde {code} bt #2 {code} #0
[jira] [Commented] (TS-833) Crash Report: Continuation::handleEvent, event=2, 0xdeadbeef, ink_freelist_free related
[ https://issues.apache.org/jira/browse/TS-833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13050174#comment-13050174 ] mohan_zl commented on TS-833: - @John I think this bug has not been fixed yet. Crash Report: Continuation::handleEvent, event=2, 0xdeadbeef, ink_freelist_free related --- Key: TS-833 URL: https://issues.apache.org/jira/browse/TS-833 Project: Traffic Server Issue Type: Bug Components: Core Affects Versions: 3.1.0 Environment: current trunk, with --enable-debug Reporter: Zhao Yongming Labels: freelist Attachments: TS-833-2.diff, TS-833-3.diff, TS-833.diff bt #1 {code} #0 0x004d2c5c in Continuation::handleEvent (this=0x19581df0, event=2, data=0x197c4fc0) at I_Continuation.h:146 146 return (this-*handler) (event, data); (gdb) bt #0 0x004d2c5c in Continuation::handleEvent (this=0x19581df0, event=2, data=0x197c4fc0) at I_Continuation.h:146 #1 0x006f5830 in EThread::process_event (this=0x2ae29010, e=0x197c4fc0, calling_code=2) at UnixEThread.cc:140 #2 0x006f5b72 in EThread::execute (this=0x2ae29010) at UnixEThread.cc:217 #3 0x004ff37d in main (argc=3, argv=0x7fff76c41528) at Main.cc:1958 (gdb) info f Stack level 0, frame at 0x7fff76c40e40: rip = 0x4d2c5c in Continuation::handleEvent(int, void*) (I_Continuation.h:146); saved rip 0x6f5830 called by frame at 0x7fff76c40eb0 source language c++. Arglist at 0x7fff76c40e30, args: this=0x19581df0, event=2, data=0x197c4fc0 Locals at 0x7fff76c40e30, Previous frame's sp is 0x7fff76c40e40 Saved registers: rbp at 0x7fff76c40e30, rip at 0x7fff76c40e38 (gdb) x/40x this 0x19581df0: 0x19581901 0x 0xefbeadde 0xefbeadde 0x19581e00: 0xefbeadde 0xefbeadde 0xefbeadde 0xefbeadde 0x19581e10: 0xefbeadde 0xefbeadde 0xefbeadde 0xefbeadde 0x19581e20: 0xefbeadde 0xefbeadde 0xefbeadde 0xefbeadde 0x19581e30: 0xefbeadde 0xefbeadde 0xefbeadde 0xefbeadde 0x19581e40: 0xefbeadde 0xefbeadde 0xefbeadde 0xefbeadde 0x19581e50: 0xefbeadde 0xefbeadde 0xefbeadde 0xefbeadde 0x19581e60: 0xefbeadde 0xefbeadde 0xefbeadde 0xefbeadde 0x19581e70: 0xefbeadde 0xefbeadde 0xefbeadde 0xefbeadde 0x19581e80: 0xefbeadde 0xefbeadde 0xefbeadde 0xefbeadde {code} bt #2 {code} #0 0x004d637c in Continuation::handleEvent (this=0xc3cc390, event=2, data=0xc4408a0) at I_Continuation.h:146 146 return (this-*handler) (event, data); (gdb) bt #0 0x004d637c in Continuation::handleEvent (this=0xc3cc390, event=2, data=0xc4408a0) at I_Continuation.h:146 #1 0x0070364c in EThread::process_event (this=0x2ae29010, e=0xc4408a0, calling_code=2) at UnixEThread.cc:140 #2 0x0070398e in EThread::execute (this=0x2ae29010) at UnixEThread.cc:217 #3 0x00502aac in main (argc=3, argv=0x7fff32ef2f58) at Main.cc:1961 (gdb) p *this $1 = {force_VFPT_to_top = {_vptr.force_VFPT_to_top = 0x2aaab002f011}, handler = 0xefbeaddeefbeadde, this adjustment -1171307680053154338, handler_name = 0xefbeaddeefbeadde Address 0xefbeaddeefbeadde out of bounds, mutex = {m_ptr = 0xefbeaddeefbeadde}, link = {SLinkContinuation = { next = 0xefbeaddeefbeadde}, prev = 0xefbeaddeefbeadde}} (gdb) {code} bt #3 {code} #0 0x004d2c5c in Continuation::handleEvent (this=0x2aaab00615b0, event=2, data=0x2aaab00d1570) at I_Continuation.h:146 146 return (this-*handler) (event, data); (gdb) bt #0 0x004d2c5c in Continuation::handleEvent (this=0x2aaab00615b0, event=2, data=0x2aaab00d1570) at I_Continuation.h:146 #1 0x006f5830 in EThread::process_event (this=0x2ae29010, e=0x2aaab00d1570, calling_code=2) at UnixEThread.cc:140 #2 0x006f5b72 in EThread::execute (this=0x2ae29010) at UnixEThread.cc:217 #3 0x004ff37d in main (argc=3, argv=0x7fff421f08d8) at Main.cc:1958 (gdb) info f Stack level 0, frame at 0x7fff421f01f0: rip = 0x4d2c5c in Continuation::handleEvent(int, void*) (I_Continuation.h:146); saved rip 0x6f5830 called by frame at 0x7fff421f0260 source language c++. Arglist at 0x7fff421f01e0, args: this=0x2aaab00615b0, event=2, data=0x2aaab00d1570 Locals at 0x7fff421f01e0, Previous frame's sp is 0x7fff421f01f0 Saved registers: rbp at 0x7fff421f01e0, rip at 0x7fff421f01e8 (gdb) p this-handler $1 = 0xefbeaddeefbeadde, this adjustment -1171307680053154338 {code} -- This message is automatically generated by JIRA. For more information on JIRA, see: http://www.atlassian.com/software/jira
[jira] [Commented] (TS-833) Crash Report: Continuation::handleEvent, event=2, 0xdeadbeef, ink_freelist_free related
[ https://issues.apache.org/jira/browse/TS-833?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanelfocusedCommentId=13048750#comment-13048750 ] John Plevyak commented on TS-833: - I have a theory about this, but I am not sure why the problem has only manifest now as it seems to have been in the codebase for a while. The theory is that the vc_next is bad because it has been closed as a result of the inactivity callback. This could be checked by walking down nh-open_list in the debugger (or code) to see if next_vc is in the list. Crash Report: Continuation::handleEvent, event=2, 0xdeadbeef, ink_freelist_free related --- Key: TS-833 URL: https://issues.apache.org/jira/browse/TS-833 Project: Traffic Server Issue Type: Bug Components: Core Affects Versions: 3.1.0 Environment: current trunk, with --enable-debug Reporter: Zhao Yongming Labels: freelist bt #1 {code} #0 0x004d2c5c in Continuation::handleEvent (this=0x19581df0, event=2, data=0x197c4fc0) at I_Continuation.h:146 146 return (this-*handler) (event, data); (gdb) bt #0 0x004d2c5c in Continuation::handleEvent (this=0x19581df0, event=2, data=0x197c4fc0) at I_Continuation.h:146 #1 0x006f5830 in EThread::process_event (this=0x2ae29010, e=0x197c4fc0, calling_code=2) at UnixEThread.cc:140 #2 0x006f5b72 in EThread::execute (this=0x2ae29010) at UnixEThread.cc:217 #3 0x004ff37d in main (argc=3, argv=0x7fff76c41528) at Main.cc:1958 (gdb) info f Stack level 0, frame at 0x7fff76c40e40: rip = 0x4d2c5c in Continuation::handleEvent(int, void*) (I_Continuation.h:146); saved rip 0x6f5830 called by frame at 0x7fff76c40eb0 source language c++. Arglist at 0x7fff76c40e30, args: this=0x19581df0, event=2, data=0x197c4fc0 Locals at 0x7fff76c40e30, Previous frame's sp is 0x7fff76c40e40 Saved registers: rbp at 0x7fff76c40e30, rip at 0x7fff76c40e38 (gdb) x/40x this 0x19581df0: 0x19581901 0x 0xefbeadde 0xefbeadde 0x19581e00: 0xefbeadde 0xefbeadde 0xefbeadde 0xefbeadde 0x19581e10: 0xefbeadde 0xefbeadde 0xefbeadde 0xefbeadde 0x19581e20: 0xefbeadde 0xefbeadde 0xefbeadde 0xefbeadde 0x19581e30: 0xefbeadde 0xefbeadde 0xefbeadde 0xefbeadde 0x19581e40: 0xefbeadde 0xefbeadde 0xefbeadde 0xefbeadde 0x19581e50: 0xefbeadde 0xefbeadde 0xefbeadde 0xefbeadde 0x19581e60: 0xefbeadde 0xefbeadde 0xefbeadde 0xefbeadde 0x19581e70: 0xefbeadde 0xefbeadde 0xefbeadde 0xefbeadde 0x19581e80: 0xefbeadde 0xefbeadde 0xefbeadde 0xefbeadde {code} bt #2 {code} #0 0x004d637c in Continuation::handleEvent (this=0xc3cc390, event=2, data=0xc4408a0) at I_Continuation.h:146 146 return (this-*handler) (event, data); (gdb) bt #0 0x004d637c in Continuation::handleEvent (this=0xc3cc390, event=2, data=0xc4408a0) at I_Continuation.h:146 #1 0x0070364c in EThread::process_event (this=0x2ae29010, e=0xc4408a0, calling_code=2) at UnixEThread.cc:140 #2 0x0070398e in EThread::execute (this=0x2ae29010) at UnixEThread.cc:217 #3 0x00502aac in main (argc=3, argv=0x7fff32ef2f58) at Main.cc:1961 (gdb) p *this $1 = {force_VFPT_to_top = {_vptr.force_VFPT_to_top = 0x2aaab002f011}, handler = 0xefbeaddeefbeadde, this adjustment -1171307680053154338, handler_name = 0xefbeaddeefbeadde Address 0xefbeaddeefbeadde out of bounds, mutex = {m_ptr = 0xefbeaddeefbeadde}, link = {SLinkContinuation = { next = 0xefbeaddeefbeadde}, prev = 0xefbeaddeefbeadde}} (gdb) {code} bt #3 {code} #0 0x004d2c5c in Continuation::handleEvent (this=0x2aaab00615b0, event=2, data=0x2aaab00d1570) at I_Continuation.h:146 146 return (this-*handler) (event, data); (gdb) bt #0 0x004d2c5c in Continuation::handleEvent (this=0x2aaab00615b0, event=2, data=0x2aaab00d1570) at I_Continuation.h:146 #1 0x006f5830 in EThread::process_event (this=0x2ae29010, e=0x2aaab00d1570, calling_code=2) at UnixEThread.cc:140 #2 0x006f5b72 in EThread::execute (this=0x2ae29010) at UnixEThread.cc:217 #3 0x004ff37d in main (argc=3, argv=0x7fff421f08d8) at Main.cc:1958 (gdb) info f Stack level 0, frame at 0x7fff421f01f0: rip = 0x4d2c5c in Continuation::handleEvent(int, void*) (I_Continuation.h:146); saved rip 0x6f5830 called by frame at 0x7fff421f0260 source language c++. Arglist at 0x7fff421f01e0, args: this=0x2aaab00615b0, event=2, data=0x2aaab00d1570 Locals at 0x7fff421f01e0, Previous frame's sp is 0x7fff421f01f0 Saved registers: rbp at 0x7fff421f01e0,