Hi, After upgrading from varnish-1.1.2-6 to varnish-2.0.3-1.el5 (rpms on RHEL 5.1) we see child processes dying every few seconds, with "Panic message: Assert error in http_StatusMessage()". See examples below. Most requests are correctly served to the client but maybe one in twenty results in a panic.
Are we right in assuming that "status >= 100 && status <= 999) not true" means that the the backend (Jetty through Pound) returns something unexpected? Also, probably not related, but a bit strange - for some reason the varnish entries in the messages log are all one hour off. Mar 12 11:31:22 lens varnishd[6440]: Child (6441) said managed to mmap 1073741824 bytes of 1073741824 Mar 12 11:31:22 lens varnishd[6440]: Child (6441) said Ready Mar 12 12:31:34 lens pound: (b78c8b90) error final flush to 127.0.0.1: Connection reset by peer Mar 12 12:31:34 lens pound: (b7f21b90) error copy response body: Connection reset by peer Mar 12 11:31:35 lens varnishd[6440]: Child (6441) died signal=6 Mar 12 11:31:35 lens varnishd[6440]: Child (6441) Panic message: Assert error in http_StatusMessage(), cache_http.c line 111: Condition(status >= 100 && status <= 999) not true. thread = (cache-worker)sp = 0x4d9c4004 { fd = 259, id = 259, xid = 54781249, client = 66.249.72.76:52354, step = STP_FETCH, handling = fetch, err_code = 200, err_reason = (null), ws = 0x4d9c404c { id = "sess", {s,f,r,e} = {0x4d9c4534,,+384,(nil),+16384}, }, worker = 0x64bf90c4 { }, vcl = { srcname = { "input", "Default", }, }, obj = 0x9045b000 { refcnt = 1, xid = 54781249, ws = 0x9045b018 { id = "obj", {s,f,r,e} = {0x9045b1ec,,0x9045b1ec,(nil),+7700}, }, http = { ws = 0x9045b018 { id = "obj", {s,f,r,e} = {0x9045b1ec,,0x9045b1ec,(nil),+7700}, }, }, len = 0, store = { }, }, }, Mar 12 12:31:35 lens pound: (b78c8b90) error copy response body: Connection reset by peer Mar 12 11:31:35 lens varnishd[6440]: child (6614) Started Mar 12 11:31:35 lens varnishd[6440]: Child (6614) said Closed fds: 4 5 6 10 11 13 14 Mar 12 11:31:35 lens varnishd[6440]: Child (6614) said Child starts Mar 12 11:31:35 lens varnishd[6440]: Child (6614) said managed to mmap 1073741824 bytes of 1073741824 Mar 12 11:31:35 lens varnishd[6440]: Child (6614) said Ready Mar 12 11:31:43 lens varnishd[6440]: Child (6614) died signal=6 Mar 12 11:31:43 lens varnishd[6440]: Child (6614) Panic message: Assert error in http_StatusMessage(), cache_http.c line 111: Condition(status >= 100 && status <= 999) not true. thread = (cache-worker)sp = 0x68274004 { fd = 240, id = 240, xid = 1612998532, client = 87.9.113.139:1951, step = STP_FETCH, handling = pass, err_code = 200, err_reason = (null), ws = 0x6827404c { id = "sess", {s,f,r,e} = {0x68274534,,+958,(nil),+16384}, }, worker = 0x6a7ff0c4 { }, vcl = { srcname = { "input", "Default", }, }, obj = 0x904ad000 { refcnt = 1, xid = 1612998532, ws = 0x904ad018 { id = "obj", {s,f,r,e} = {0x904ad1ec,,0x904ad1ec,(nil),+7700}, }, http = { ws = 0x904ad018 { id = "obj", {s,f,r,e} = {0x904ad1ec,,0x904ad1ec,(nil),+7700}, }, }, len = 0, store = { }, }, }, Mar 12 12:31:43 lens pound: (b76c0b90) error final flush to 127.0.0.1: Connection reset by peer Mar 12 11:31:43 lens varnishd[6440]: child (6705) Started Mar 12 11:31:43 lens varnishd[6440]: Child (6705) said Closed fds: 4 5 6 10 11 13 14 Mar 12 11:31:43 lens varnishd[6440]: Child (6705) said Child starts Mar 12 11:31:43 lens varnishd[6440]: Child (6705) said managed to mmap 1073741824 bytes of 1073741824 Mar 12 11:31:43 lens varnishd[6440]: Child (6705) said Ready Mar 12 11:31:45 lens varnishd[6440]: Child (6705) died signal=6 Mar 12 11:31:45 lens varnishd[6440]: Child (6705) Panic message: Assert error in http_StatusMessage(), cache_http.c line 111: Condition(status >= 100 && status <= 999) not true. thread = (cache-worker)sp = 0x6eb6c004 { fd = 28, id = 28, xid = 1111961222, client = 220.101.18.164:3006, step = STP_FETCH, handling = fetch, err_code = 200, err_reason = (null), ws = 0x6eb6c04c { id = "sess", {s,f,r,e} = {0x6eb6c534,,+844,(nil),+16384}, }, worker = 0x692ff0c4 { }, vcl = { srcname = { "input", "Default", }, }, obj = 0x901de000 { refcnt = 1, xid = 1111961222, ws = 0x901de018 { id = "obj", {s,f,r,e} = {0x901de1ec,,0x901de1ec,(nil),+7700}, }, http = { ws = 0x901de018 { id = "obj", {s,f,r,e} = {0x901de1ec,,0x901de1ec,(nil),+7700}, }, }, len = 0, store = { }, }, }, Mar 12 11:31:45 lens varnishd[6440]: child (6733) Started Mar 12 12:31:45 lens pound: (b722eb90) error final flush to 127.0.0.1: Connection reset by peer Mar 12 11:31:45 lens varnishd[6440]: Child (6733) said Closed fds: 4 5 6 10 11 13 14 Mar 12 11:31:45 lens varnishd[6440]: Child (6733) said Child starts Mar 12 11:31:45 lens varnishd[6440]: Child (6733) said managed to mmap 1073741824 bytes of 1073741824 Mar 12 11:31:45 lens varnishd[6440]: Child (6733) said Ready Mar 12 11:31:45 lens varnishd[6440]: Child (6733) died signal=6 Mar 12 11:31:45 lens varnishd[6440]: Child (6733) Panic message: Assert error in http_StatusMessage(), cache_http.c line 111: Condition(status >= 100 && status <= 999) not true. thread = (cache-worker)sp = 0x6eb25004 { fd = 20, id = 20, xid = 324143333, client = 87.9.113.139:1980, step = STP_FETCH, handling = pass, ws = 0x6eb2504c { id = "sess", {s,f,r,e} = {0x6eb25534,,+882,(nil),+16384}, }, worker = 0x6ccfc0c4 { }, vcl = { srcname = { "input", "Default", }, }, obj = 0x90103000 { refcnt = 1, xid = 324143333, ws = 0x90103018 { id = "obj", {s,f,r,e} = {0x901031ec,,0x901031ec,(nil),+7700}, }, http = { ws = 0x90103018 { id = "obj", {s,f,r,e} = {0x901031ec,,0x901031ec,(nil),+7700}, }, }, len = 0, store = { }, }, }, Mar 12 11:31:45 lens varnishd[6440]: child (6749) Started Mar 12 12:31:45 lens pound: (b722eb90) error final flush to 127.0.0.1: Connection reset by peer Mar 12 11:31:45 lens varnishd[6440]: Child (6749) said Closed fds: 4 5 6 10 11 13 14 Mar 12 11:31:45 lens varnishd[6440]: Child (6749) said Child starts Mar 12 11:31:45 lens varnishd[6440]: Child (6749) said managed to mmap 1073741824 bytes of 1073741824 Mar 12 11:31:45 lens varnishd[6440]: Child (6749) said Ready Any help would be greatly appreciated. Thanks, Patrik _______________________________________________ varnish-misc mailing list varnish-misc@projects.linpro.no http://projects.linpro.no/mailman/listinfo/varnish-misc