Re: [asterisk-users] Asterisk Core Dump in app_queue - Anyone seen?
On 1/4/07, Douglas Garstang [EMAIL PROTECTED] wrote: Richard, We have underscores all over the place in our config files, including others in queues.conf. I don't think that's the murder weapon. I think, in general, queues are one of Asterisks biggest features, and also one of it's shakiest. The reload, which is run from a script, caused a reload on 3 servers that are supposed to be redundant, and each crapped it's pants in a slightly different manner. The first stopped processing all queue calls (ie calls would lockup), the second core dumped, and the third seemed ok until you did another 'reload app_queue.so' where it would tell you that the previous reload was not finished yet. Someone made a post yesterday about doing 200 queues on Asterisk. I don't envy what he is about to endure. Doug - There was some bug fixing done on app_queue post 1.2.9.1 to try to accomodate some possibly shaky memory management on linked lists that occurred during a reload. You may want to look at upgrading to latest 1.2.X or backporting those changes and see if the issue still exists. BJ -- Bird's The Word Technologies, Inc. http://www.btwtech.com/ ___ --Bandwidth and Colocation provided by Easynews.com -- asterisk-users mailing list To UNSUBSCRIBE or update options visit: http://lists.digium.com/mailman/listinfo/asterisk-users
Re: [asterisk-users] Asterisk Core Dump in app_queue - Anyone seen?
Douglas Garstang wrote *snipped cat = 0x81507e0 mcao_QMain tmp = 0x6d6f7250 Address 0x6d6f7250 out of bounds *snipped a quick run through of of app_queue.c (my copy) for anything directly dealing with a reload shows tmp in use for realtime later a reference for convert to dashes from uunderscores i would do a quick test of a queue name without underscores ___ --Bandwidth and Colocation provided by Easynews.com -- asterisk-users mailing list To UNSUBSCRIBE or update options visit: http://lists.digium.com/mailman/listinfo/asterisk-users
RE: [asterisk-users] Asterisk Core Dump in app_queue - Anyone seen?
Richard, We have underscores all over the place in our config files, including others in queues.conf. I don't think that's the murder weapon. I think, in general, queues are one of Asterisks biggest features, and also one of it's shakiest. The reload, which is run from a script, caused a reload on 3 servers that are supposed to be redundant, and each crapped it's pants in a slightly different manner. The first stopped processing all queue calls (ie calls would lockup), the second core dumped, and the third seemed ok until you did another 'reload app_queue.so' where it would tell you that the previous reload was not finished yet. Someone made a post yesterday about doing 200 queues on Asterisk. I don't envy what he is about to endure. Doug. -Original Message- From: Richard Lyman [mailto:[EMAIL PROTECTED] Sent: Thursday, January 04, 2007 9:45 AM To: Asterisk Users Mailing List - Non-Commercial Discussion Subject: Re: [asterisk-users] Asterisk Core Dump in app_queue - Anyone seen? Douglas Garstang wrote *snipped cat = 0x81507e0 mcao_QMain tmp = 0x6d6f7250 Address 0x6d6f7250 out of bounds *snipped a quick run through of of app_queue.c (my copy) for anything directly dealing with a reload shows tmp in use for realtime later a reference for convert to dashes from uunderscores i would do a quick test of a queue name without underscores ___ --Bandwidth and Colocation provided by Easynews.com -- asterisk-users mailing list To UNSUBSCRIBE or update options visit: http://lists.digium.com/mailman/listinfo/asterisk-users ___ --Bandwidth and Colocation provided by Easynews.com -- asterisk-users mailing list To UNSUBSCRIBE or update options visit: http://lists.digium.com/mailman/listinfo/asterisk-users
[asterisk-users] Asterisk Core Dump in app_queue - Anyone seen?
Anyone seen this? It ocurred on a 'reload app_queue.so' command.
Asterisk version is 1.2.9.1.
Tried again, but it was not immediately reproducable.
Doug.
(gdb) bt
#0 reload_queues () at app_queue.c:3339
#1 0xb778a7a8 in reload () at app_queue.c:4012
#2 0x0805bb44 in ast_module_reload (name=0x8137cc7 app_queue.so) at
loader.c:257
#3 0x08092b3f in handle_reload (fd=33, argc=2, argv=0xbddfa470) at cli.c:147
#4 0x0809283e in ast_cli_command (fd=33, s=0x6d6f7250 Address 0x6d6f7250 out
of bounds) at cli.c:1364
#5 0x080aef0f in action_command (s=0x81ead18, m=0xbddfaac0) at manager.c:927
#6 0x080b3ee4 in process_message (s=0x81ead18, m=0xbddfaac0) at manager.c:1305
#7 0x080b2ac5 in session_do (data=0x81ead18) at manager.c:1401
#8 0xb7f15ed8 in pthread_start_thread () from /lib/libpthread.so.0
#9 0xb7e147ea in clone () from /lib/libc.so.6
(gdb) bt full
#0 reload_queues () at app_queue.c:3339
q = (struct ast_call_queue *) 0x81adca8
ql = (struct ast_call_queue *) 0xbddfaec0
qn = (struct ast_call_queue *) 0xb7dc03b3
cfg = (struct ast_config *) 0x81aca30
cat = 0x81507e0 mcao_QMain
tmp = 0x6d6f7250 Address 0x6d6f7250 out of bounds
var = (struct ast_variable *) 0x811e340
prev = (struct member *) 0x8101b79
cur = (struct member *) 0x2854554f
newm = (struct member *) 0x0
new = 0
general_val = 0x2854554f Address 0x2854554f out of bounds
interface = '\0' repeats 79 times
penalty = 900
#1 0xb778a7a8 in reload () at app_queue.c:4012
No locals.
#2 0x0805bb44 in ast_module_reload (name=0x8137cc7 app_queue.so) at
loader.c:257
m = (struct module *) 0x81f3b10
reloaded = 2
oldversion = 863401873
reload = (int (*)(void)) 0xb778a7a0 reload
#3 0x08092b3f in handle_reload (fd=33, argc=2, argv=0xbddfa470) at cli.c:147
x = 1
res = 1836020304
#4 0x0809283e in ast_cli_command (fd=33, s=0x6d6f7250 Address 0x6d6f7250 out
of bounds) at cli.c:1364
argv = {0x8137cc0 reload, 0x8137cc7 app_queue.so, 0x0, 0x8227d68
;\\b¬úæ·: 2007-01-03 15:17:39.165755\r\n,
0xbddfa49c h¥ß½ïÀÛ·h}\\bh}\\b,
0xb7dc3fea
ë\234\211$ÿÐëÔ\213]ô\213uø\213}ü\211ì]é¿üÿÿU\211å\203ì(\211]ô\211uø\211}üè°Cûÿ\201ÃÜ\237\n,
0xb7e6fa00 ,
0x8227d68 ;\\b¬úæ·: 2007-01-03 15:17:39.165755\r\n, 0xb7e6dff4
\034\020, 0x26 Address 0x26 out of bounds,
0x27 Address 0x27 out of bounds, 0xbddfa568 \200, 0xb7dbc0ef
\213U\b\213\002\205Àu\b\213\205pÿÿÿ\211\002ÆD\aÿ,
0x8227d68 ;\\b¬úæ·: 2007-01-03 15:17:39.165755\r\n, 0x8227d68
;\\b¬úæ·: 2007-01-03 15:17:39.165755\r\n,
0x26 Address 0x26 out of bounds, 0x8227d68 ;\\b¬úæ·: 2007-01-03
15:17:39.165755\r\n, 0x0,
0x26 Address 0x26 out of bounds, 0xfbad8000 Address 0xfbad8000 out of
bounds,
0x8227d68 ;\\b¬úæ·: 2007-01-03 15:17:39.165755\r\n, 0x8227d68
;\\b¬úæ·: 2007-01-03 15:17:39.165755\r\n,
0x8227d68 ;\\b¬úæ·: 2007-01-03 15:17:39.165755\r\n, 0x8227d68
;\\b¬úæ·: 2007-01-03 15:17:39.165755\r\n, 0x8227d8e ,
0x8227dcc , 0x8227d68 ;\\b¬úæ·: 2007-01-03 15:17:39.165755\r\n,
0x8227dcc , 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0,
0xbddfa544 ôßæ·\020\234 \bh¥ß½ê?Ü·, 0xb700 Address 0xb700 out of
bounds, 0x0, 0xbddfa544 ôßæ·\020\234 \bh¥ß½ê?Ü·,
0xb7e6dff4 \034\020, 0x0, 0xb7e6da00 , 0x0, 0xb7f1a756 \201Ã\236H,
0xb7f1eff4 tî, 0xb7e6fa00 , 0xb7e6fa00 ,
0xbddfa54c h¥ß½ê?Ü·, 0xb7f170eb
ëÃ\213\203pÿÿÿ;(r\022\213\203Ðÿÿÿ;(s\b\213\203¤ÿÿÿë½\213\203 ÿÿÿ\213,
0xb7e6fa10 ,
0x8209c10 È\017\025\bèÃ\035\b: 2007-01-03 15:17:39.165755\r\n, 0xb7e6fa00
, 0xb7e6dff4 \034\020, 0xb7e6dff4 \034\020,
0x8209c10 È\017\025\bèÃ\035\b: 2007-01-03 15:17:39.165755\r\n, 0xbddfa568
\200,
0xb7dc3fea
ë\234\211$ÿÐëÔ\213]ô\213uø\213}ü\211ì]é¿üÿÿU\211å\203ì(\211]ô\211uø\211}üè°Cûÿ\201ÃÜ\237\n,
0xb7e6fa00 ,
0x8209c10 È\017\025\bèÃ\035\b: 2007-01-03 15:17:39.165755\r\n, 0x21
Address 0x21 out of bounds,
0x21 Address 0x21 out of bounds, 0x81ead18 \017, 0x80 Address 0x80 out
of bounds,
0x8091ffb \213\\$\030\203Ä\034ÃÇ\004$\004}
e = (struct ast_cli_entry *) 0x81197a0
x = 2
dup = 0x8137cc0 reload
tws = 0
#5 0x080aef0f in action_command (s=0x81ead18, m=0xbddfaac0) at manager.c:927
No locals.
#6 0x080b3ee4 in process_message (s=0x81ead18, m=0xbddfaac0) at manager.c:1305
ret = 0
eqe = (struct eventqent *) 0x0
action = Command, '\0' repeats 72 times
tmp = (struct manager_action *) 0x8144818
idText = ActionID: 2007-01-03 15:17:39.165755\r\n, '\0' repeats 217
times
iabuf = 216.187.141.250
#7 0x080b2ac5 in session_do (data=0x81ead18) at manager.c:1401
m = {hdrcount = 3, headers = {Action: Command\000\n, '\0' repeats
238 times,
Command: reload app_queue.so\000\n, '\0' repeats 225 times,
ActionID: 2007-01-03 15:17:39.165755\000\n, '\0' repeats 217 times,
\000\n, '\0' repeats 253 times,
'\0' repeats 255 times repeats 76 times}}
RE: [asterisk-users] Asterisk Core Dump in app_queue - Anyone seen?
Bugger. :(
-Original Message-
From: Douglas Garstang
Sent: Wed 1/3/2007 3:27 PM
To: Asterisk Users Mailing List - Non-Commercial Discussion
Cc:
Subject:[asterisk-users] Asterisk Core Dump in app_queue - Anyone seen?
Anyone seen this? It ocurred on a 'reload app_queue.so' command.
Asterisk version is 1.2.9.1.
Tried again, but it was not immediately reproducable.
Doug.
(gdb) bt
#0 reload_queues () at app_queue.c:3339
#1 0xb778a7a8 in reload () at app_queue.c:4012
#2 0x0805bb44 in ast_module_reload (name=0x8137cc7 app_queue.so) at
loader.c:257
#3 0x08092b3f in handle_reload (fd=33, argc=2, argv=0xbddfa470) at cli.c:147
#4 0x0809283e in ast_cli_command (fd=33, s=0x6d6f7250 Address 0x6d6f7250 out
of bounds) at cli.c:1364
#5 0x080aef0f in action_command (s=0x81ead18, m=0xbddfaac0) at manager.c:927
#6 0x080b3ee4 in process_message (s=0x81ead18, m=0xbddfaac0) at manager.c:1305
#7 0x080b2ac5 in session_do (data=0x81ead18) at manager.c:1401
#8 0xb7f15ed8 in pthread_start_thread () from /lib/libpthread.so.0
#9 0xb7e147ea in clone () from /lib/libc.so.6
(gdb) bt full
#0 reload_queues () at app_queue.c:3339
q = (struct ast_call_queue *) 0x81adca8
ql = (struct ast_call_queue *) 0xbddfaec0
qn = (struct ast_call_queue *) 0xb7dc03b3
cfg = (struct ast_config *) 0x81aca30
cat = 0x81507e0 mcao_QMain
tmp = 0x6d6f7250 Address 0x6d6f7250 out of bounds
var = (struct ast_variable *) 0x811e340
prev = (struct member *) 0x8101b79
cur = (struct member *) 0x2854554f
newm = (struct member *) 0x0
new = 0
general_val = 0x2854554f Address 0x2854554f out of bounds
interface = '\0' repeats 79 times
penalty = 900
#1 0xb778a7a8 in reload () at app_queue.c:4012
No locals.
#2 0x0805bb44 in ast_module_reload (name=0x8137cc7 app_queue.so) at
loader.c:257
m = (struct module *) 0x81f3b10
reloaded = 2
oldversion = 863401873
reload = (int (*)(void)) 0xb778a7a0 reload
#3 0x08092b3f in handle_reload (fd=33, argc=2, argv=0xbddfa470) at cli.c:147
x = 1
res = 1836020304
#4 0x0809283e in ast_cli_command (fd=33, s=0x6d6f7250 Address 0x6d6f7250 out
of bounds) at cli.c:1364
argv = {0x8137cc0 reload, 0x8137cc7 app_queue.so, 0x0, 0x8227d68
;\\b¬úæ·: 2007-01-03 15:17:39.165755\r\n,
0xbddfa49c h¥ß½ïÀÛ·h}\\bh}\\b,
0xb7dc3fea
ë\234\211$ÿÐëÔ\213]ô\213uø\213}ü\211ì]é¿üÿÿU\211å\203ì(\211]ô\211uø\211}üè°Cûÿ\201ÃÜ\237\n,
0xb7e6fa00 ,
0x8227d68 ;\\b¬úæ·: 2007-01-03 15:17:39.165755\r\n, 0xb7e6dff4
\034\020, 0x26 Address 0x26 out of bounds,
0x27 Address 0x27 out of bounds, 0xbddfa568 \200, 0xb7dbc0ef
\213U\b\213\002\205Àu\b\213\205pÿÿÿ\211\002ÆD\aÿ,
0x8227d68 ;\\b¬úæ·: 2007-01-03 15:17:39.165755\r\n, 0x8227d68
;\\b¬úæ·: 2007-01-03 15:17:39.165755\r\n,
0x26 Address 0x26 out of bounds, 0x8227d68 ;\\b¬úæ·: 2007-01-03
15:17:39.165755\r\n, 0x0,
0x26 Address 0x26 out of bounds, 0xfbad8000 Address 0xfbad8000 out of
bounds,
0x8227d68 ;\\b¬úæ·: 2007-01-03 15:17:39.165755\r\n, 0x8227d68
;\\b¬úæ·: 2007-01-03 15:17:39.165755\r\n,
0x8227d68 ;\\b¬úæ·: 2007-01-03 15:17:39.165755\r\n, 0x8227d68
;\\b¬úæ·: 2007-01-03 15:17:39.165755\r\n, 0x8227d8e ,
0x8227dcc , 0x8227d68 ;\\b¬úæ·: 2007-01-03 15:17:39.165755\r\n,
0x8227dcc , 0x0, 0x0, 0x0, 0x0, 0x0, 0x0, 0x0,
0xbddfa544 ôßæ·\020\234 \bh¥ß½ê?Ü·, 0xb700 Address 0xb700 out of
bounds, 0x0, 0xbddfa544 ôßæ·\020\234 \bh¥ß½ê?Ü·,
0xb7e6dff4 \034\020, 0x0, 0xb7e6da00 , 0x0, 0xb7f1a756 \201Ã\236H,
0xb7f1eff4 tî, 0xb7e6fa00 , 0xb7e6fa00 ,
0xbddfa54c h¥ß½ê?Ü·, 0xb7f170eb
ëÃ\213\203pÿÿÿ;(r\022\213\203Ðÿÿÿ;(s\b\213\203¤ÿÿÿë½\213\203 ÿÿÿ\213,
0xb7e6fa10 ,
0x8209c10 È\017\025\bèÃ\035\b: 2007-01-03 15:17:39.165755\r\n, 0xb7e6fa00
, 0xb7e6dff4 \034\020, 0xb7e6dff4 \034\020,
0x8209c10 È\017\025\bèÃ\035\b: 2007-01-03 15:17:39.165755\r\n, 0xbddfa568
\200,
0xb7dc3fea
ë\234\211$ÿÐëÔ\213]ô\213uø\213}ü\211ì]é¿üÿÿU\211å\203ì(\211]ô\211uø\211}üè°Cûÿ\201ÃÜ\237\n,
0xb7e6fa00 ,
0x8209c10 È\017\025\bèÃ\035\b: 2007-01-03 15:17:39.165755\r\n, 0x21
Address 0x21 out of bounds,
0x21 Address 0x21 out of bounds, 0x81ead18 \017, 0x80 Address 0x80 out
of bounds,
0x8091ffb \213\\$\030\203Ä\034ÃÇ\004$\004}
e = (struct ast_cli_entry *) 0x81197a0
x = 2
dup = 0x8137cc0 reload
tws = 0
#5 0x080aef0f in action_command (s=0x81ead18, m=0xbddfaac0) at manager.c:927
No locals.
#6 0x080b3ee4 in process_message (s=0x81ead18, m=0xbddfaac0) at manager.c:1305
ret = 0
eqe = (struct eventqent *) 0x0
action = Command, '\0' repeats 72 times
tmp = (struct manager_action *) 0x8144818
idText = ActionID: 2007-01-03 15:17:39.165755\r\n, '\0' repeats 217
times
iabuf = 216.187.141.250
#7 0x080b2ac5 in session_do (data=0x81ead18) at manager.c:1401
m = {hdrcount = 3, headers = {Action: Command\000\n
