[jira] [Comment Edited] (TS-2403) Segfault when HostDB full

2016-06-20 Thread John Rushford (JIRA)

[ 
https://issues.apache.org/jira/browse/TS-2403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15339760#comment-15339760
 ] 

John Rushford edited comment on TS-2403 at 6/20/16 3:57 PM:


Got a segfault  on two of our caches today that look very similar to the above 
stack traces.  our caches are running ATS 5.3.2.  Here is the BT:

{noformat}
#0  ats_ip_addr_cmp (lhs=0x7fff5a0733d8, rhs=0x8) at ../../lib/ts/ink_inet.h:795
#1  ats_ip_addr_eq (lhs=0x7fff5a0733d8, rhs=0x8) at ../../lib/ts/ink_inet.h:850
#2  0x006887e9 in restore_info (this=, 
event=, e=) at HostDB.cc:1349
#3  HostDBContinuation::dnsEvent (this=, event=, e=) at HostDB.cc:1575
#4  0x006a3db4 in handleEvent (this=0x2b0cd8044200) at 
../../iocore/eventsystem/I_Continuation.h:145
#5  DNSEntry::postEvent (this=0x2b0cd8044200) at DNS.cc:1267
#6  0x006a5695 in dns_result (h=0x45c42e0, e=0x2b0cd8044200, 
ent=0x5ef6000, retry=) at DNS.cc:1219
#7  0x006a6e80 in dns_process (this=0x45c42e0) at DNS.cc:1585
#8  DNSHandler::recv_dns (this=0x45c42e0) at DNS.cc:785
#9  0x006a7f62 in DNSHandler::mainEvent (this=0x45c42e0, event=, e=) at DNS.cc:797
#10 0x00759f65 in handleEvent (this=0x2b0cbfc1b010, e=0x2b0d6c025040, 
calling_code=5) at I_Continuation.h:145
#11 EThread::process_event (this=0x2b0cbfc1b010, e=0x2b0d6c025040, 
calling_code=5) at UnixEThread.cc:128
#12 0x0075a8a9 in EThread::execute (this=0x2b0cbfc1b010) at 
UnixEThread.cc:252
#13 0x004deb84 in main (argv=) at Main.cc:1849
{noformat}

Config settings:

{noformat}
CONFIG proxy.config.hostdb.size INT 12
CONFIG proxy.config.hostdb.storage_size INT 33554432
CONFIG proxy.config.hostdb.ttl_mode INT 0
CONFIG proxy.config.hostdb.timeout INT 1440
CONFIG proxy.config.hostdb.strict_round_robin INT 0
{noformat}


was (Author: jrushford):
Got a segfault  on two of our caches today that look very similar to the above 
stack traces.  our caches are running ATS 5.3.2.  Here is the BT:

{noformat}
#0  ats_ip_addr_cmp (lhs=0x7fff5a0733d8, rhs=0x8) at ../../lib/ts/ink_inet.h:795
#1  ats_ip_addr_eq (lhs=0x7fff5a0733d8, rhs=0x8) at ../../lib/ts/ink_inet.h:850
#2  0x006887e9 in restore_info (this=, 
event=, e=) at HostDB.cc:1349
#3  HostDBContinuation::dnsEvent (this=, event=, e=) at HostDB.cc:1575
#4  0x006a3db4 in handleEvent (this=0x2b0cd8044200) at 
../../iocore/eventsystem/I_Continuation.h:145
#5  DNSEntry::postEvent (this=0x2b0cd8044200) at DNS.cc:1267
#6  0x006a5695 in dns_result (h=0x45c42e0, e=0x2b0cd8044200, 
ent=0x5ef6000, retry=) at DNS.cc:1219
#7  0x006a6e80 in dns_process (this=0x45c42e0) at DNS.cc:1585
#8  DNSHandler::recv_dns (this=0x45c42e0) at DNS.cc:785
#9  0x006a7f62 in DNSHandler::mainEvent (this=0x45c42e0, event=, e=) at DNS.cc:797
#10 0x00759f65 in handleEvent (this=0x2b0cbfc1b010, e=0x2b0d6c025040, 
calling_code=5) at I_Continuation.h:145
#11 EThread::process_event (this=0x2b0cbfc1b010, e=0x2b0d6c025040, 
calling_code=5) at UnixEThread.cc:128
#12 0x0075a8a9 in EThread::execute (this=0x2b0cbfc1b010) at 
UnixEThread.cc:252
#13 0x004deb84 in main (argv=) at Main.cc:1849
{noformat}

> Segfault when HostDB full
> -
>
> Key: TS-2403
> URL: https://issues.apache.org/jira/browse/TS-2403
> Project: Traffic Server
>  Issue Type: Bug
>  Components: DNS
>Affects Versions: 4.0.1
>Reporter: David Carlin
>Assignee: Thomas Jackson
>  Labels: Crash
> Fix For: sometime
>
>
> diags.log leading up to crash:
> {noformat}
> [Nov 25 10:50:23.346] Server {0x2b06c4302700} WARNING: out of room in hostdb 
> for round-robin DNS data
> [Nov 25 10:50:23.379] Server {0x2b06c4100700} WARNING: out of room in hostdb 
> for round-robin DNS data
> [Nov 25 10:50:23.449] Server {0x2b06c4a09700} WARNING: out of room in hostdb 
> for round-robin DNS data
> [Nov 25 10:50:23.462] Server {0x2b06c4403700} WARNING: out of room in hostdb 
> for round-robin DNS data
> [Nov 25 10:50:23.494] Server {0x2b06bed1f540} WARNING: out of room in hostdb 
> for reverse DNS data
> [Nov 25 10:54:46.919] {0x2baa2d65b540} STATUS: opened 
> /home/y/logs/trafficserver/diags.log
> [Nov 25 10:54:46.927] {0x2baa2d65b540} NOTE: updated diags config
> [Nov 25 10:54:46.961] Server {0x2baa2d65b540} NOTE: cache clustering disabled
> [Nov 25 10:54:46.995] Server {0x2baa2d65b540} NOTE: ip_allow.config updated, 
> reloading
> [Nov 25 10:54:47.059] Server {0x2baa2d65b540} NOTE: cache clustering disabled
> [Nov 25 10:54:47.072] Server {0x2baa2d65b540} NOTE: logging initialized[15], 
> logging_mode = 3
> [Nov 25 10:54:47.103] Server {0x2baa2d65b540} NOTE: loading plugin 
> '/home/y/libexec64/trafficserver/quick_filter.so'
> [Nov 25 10:54:47.326] Server {0x2baa2d65b540} NOTE: loading plugin 
> '/home/y/lib

[jira] [Comment Edited] (TS-2403) Segfault when HostDB full

2016-06-20 Thread John Rushford (JIRA)

[ 
https://issues.apache.org/jira/browse/TS-2403?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=15339760#comment-15339760
 ] 

John Rushford edited comment on TS-2403 at 6/20/16 3:55 PM:


Got a segfault  on two of our caches today that look very similar to the above 
stack traces.  our caches are running ATS 5.3.2.  Here is the BT:

{noformat}
#0  ats_ip_addr_cmp (lhs=0x7fff5a0733d8, rhs=0x8) at ../../lib/ts/ink_inet.h:795
#1  ats_ip_addr_eq (lhs=0x7fff5a0733d8, rhs=0x8) at ../../lib/ts/ink_inet.h:850
#2  0x006887e9 in restore_info (this=, 
event=, e=) at HostDB.cc:1349
#3  HostDBContinuation::dnsEvent (this=, event=, e=) at HostDB.cc:1575
#4  0x006a3db4 in handleEvent (this=0x2b0cd8044200) at 
../../iocore/eventsystem/I_Continuation.h:145
#5  DNSEntry::postEvent (this=0x2b0cd8044200) at DNS.cc:1267
#6  0x006a5695 in dns_result (h=0x45c42e0, e=0x2b0cd8044200, 
ent=0x5ef6000, retry=) at DNS.cc:1219
#7  0x006a6e80 in dns_process (this=0x45c42e0) at DNS.cc:1585
#8  DNSHandler::recv_dns (this=0x45c42e0) at DNS.cc:785
#9  0x006a7f62 in DNSHandler::mainEvent (this=0x45c42e0, event=, e=) at DNS.cc:797
#10 0x00759f65 in handleEvent (this=0x2b0cbfc1b010, e=0x2b0d6c025040, 
calling_code=5) at I_Continuation.h:145
#11 EThread::process_event (this=0x2b0cbfc1b010, e=0x2b0d6c025040, 
calling_code=5) at UnixEThread.cc:128
#12 0x0075a8a9 in EThread::execute (this=0x2b0cbfc1b010) at 
UnixEThread.cc:252
#13 0x004deb84 in main (argv=) at Main.cc:1849
{noformat}


was (Author: jrushford):
Got a segfault  on two of our caches today that look very similar to the above 
stack traces.  our caches are running ATS 5.3.2.  Here is the BT:

#0  ats_ip_addr_cmp (lhs=0x7fff5a0733d8, rhs=0x8) at ../../lib/ts/ink_inet.h:795
#1  ats_ip_addr_eq (lhs=0x7fff5a0733d8, rhs=0x8) at ../../lib/ts/ink_inet.h:850
#2  0x006887e9 in restore_info (this=, 
event=, e=) at HostDB.cc:1349
#3  HostDBContinuation::dnsEvent (this=, event=, e=) at HostDB.cc:1575
#4  0x006a3db4 in handleEvent (this=0x2b0cd8044200) at 
../../iocore/eventsystem/I_Continuation.h:145
#5  DNSEntry::postEvent (this=0x2b0cd8044200) at DNS.cc:1267
#6  0x006a5695 in dns_result (h=0x45c42e0, e=0x2b0cd8044200, 
ent=0x5ef6000, retry=) at DNS.cc:1219
#7  0x006a6e80 in dns_process (this=0x45c42e0) at DNS.cc:1585
#8  DNSHandler::recv_dns (this=0x45c42e0) at DNS.cc:785
#9  0x006a7f62 in DNSHandler::mainEvent (this=0x45c42e0, event=, e=) at DNS.cc:797
#10 0x00759f65 in handleEvent (this=0x2b0cbfc1b010, e=0x2b0d6c025040, 
calling_code=5) at I_Continuation.h:145
#11 EThread::process_event (this=0x2b0cbfc1b010, e=0x2b0d6c025040, 
calling_code=5) at UnixEThread.cc:128
#12 0x0075a8a9 in EThread::execute (this=0x2b0cbfc1b010) at 
UnixEThread.cc:252
#13 0x004deb84 in main (argv=) at Main.cc:1849

> Segfault when HostDB full
> -
>
> Key: TS-2403
> URL: https://issues.apache.org/jira/browse/TS-2403
> Project: Traffic Server
>  Issue Type: Bug
>  Components: DNS
>Affects Versions: 4.0.1
>Reporter: David Carlin
>Assignee: Thomas Jackson
>  Labels: Crash
> Fix For: sometime
>
>
> diags.log leading up to crash:
> {noformat}
> [Nov 25 10:50:23.346] Server {0x2b06c4302700} WARNING: out of room in hostdb 
> for round-robin DNS data
> [Nov 25 10:50:23.379] Server {0x2b06c4100700} WARNING: out of room in hostdb 
> for round-robin DNS data
> [Nov 25 10:50:23.449] Server {0x2b06c4a09700} WARNING: out of room in hostdb 
> for round-robin DNS data
> [Nov 25 10:50:23.462] Server {0x2b06c4403700} WARNING: out of room in hostdb 
> for round-robin DNS data
> [Nov 25 10:50:23.494] Server {0x2b06bed1f540} WARNING: out of room in hostdb 
> for reverse DNS data
> [Nov 25 10:54:46.919] {0x2baa2d65b540} STATUS: opened 
> /home/y/logs/trafficserver/diags.log
> [Nov 25 10:54:46.927] {0x2baa2d65b540} NOTE: updated diags config
> [Nov 25 10:54:46.961] Server {0x2baa2d65b540} NOTE: cache clustering disabled
> [Nov 25 10:54:46.995] Server {0x2baa2d65b540} NOTE: ip_allow.config updated, 
> reloading
> [Nov 25 10:54:47.059] Server {0x2baa2d65b540} NOTE: cache clustering disabled
> [Nov 25 10:54:47.072] Server {0x2baa2d65b540} NOTE: logging initialized[15], 
> logging_mode = 3
> [Nov 25 10:54:47.103] Server {0x2baa2d65b540} NOTE: loading plugin 
> '/home/y/libexec64/trafficserver/quick_filter.so'
> [Nov 25 10:54:47.326] Server {0x2baa2d65b540} NOTE: loading plugin 
> '/home/y/libexec64/trafficserver/header_filter.so'
> [Nov 25 10:54:49.395] Server {0x2baa2d65b540} NOTE: traffic server running
> {noformat}
> From traffic.out:
> {noformat}
> NOTE: Traffic Server received Sig 11: Segmentation fault
> /home/y/bin/traffic_server - STACK TRACE:
> /lib64/libpthread.so.0(+0x3d07