hi All,
Last month, one of the our server got stuck but We could n't find the
reason. Here I have attached the OS(Red Hat Enterprise Linux AS relese 4)
message log. I think issue may be in MySQL.
We are using MySQL Server version: 5.1.12-beta MySQL Community Server (GPL)
So if you can please send me what are the actions we can take for avoid this
type of scenarios in future.
Thanks
#----------------------------------------------------------------------------------------------------------------------------------
Aug 14 22:18:48 localhost kernel: Unable to handle kernel NULL pointer
dereference at 0000000000000018 RIP:
Aug 14 22:18:48 localhost kernel:
<ffffffffa0156b14>{:jbd:journal_commit_transaction+1140}
Aug 14 22:18:48 localhost kernel: PML4 46aec067 PGD 29203b067 PMD 0
Aug 14 22:18:48 localhost kernel: Oops: 0002 [1] SMP
Aug 14 22:18:48 localhost kernel: CPU 2
Aug 14 22:18:48 localhost kernel: Modules linked in: nfsd exportfs lockd
parport_pc lp parport autofs4 i2c_dev i2c_core sunrpc ds yenta_socket
pcmcia_core dm_mod button battery ac md5 ipv6 joydev ohci_hcd ehci_hcd tg3
floppy ext3 jbd mppVhba(U) qla2400(U) qla2xxx(U) qla2xxx_conf(U) aacraid(U)
mppUpper(U) sg sd_mod scsi_mod
Aug 14 22:18:48 localhost kernel: Pid: 2255, comm: kjournald Tainted: GF
2.6.9-5.ELsmp
Aug 14 22:18:48 localhost kernel: RIP: 0010:[<ffffffffa0156b14>]
<ffffffffa0156b14>{:jbd:journal_commit_transaction+1140}
Aug 14 22:18:48 localhost kernel: RSP: 0000:000001032adf7bb8 EFLAGS:
00010202
Aug 14 22:18:48 localhost kernel: RAX: 000001025e9b0d98 RBX:
0000000000000000 RCX: 00000000c0000100
Aug 14 22:18:48 localhost kernel: RDX: 00000101c5721818 RSI:
000001032adf6000 RDI: 0000000000000202
Aug 14 22:18:48 localhost kernel: RBP: 0000000000000000 R08:
000001032adf6000 R09: 00000100b58bdd80
Aug 14 22:18:48 localhost kernel: R10: 000001032adf7b68 R11:
000001032adf7b68 R12: 00000101c5721b88
Aug 14 22:18:48 localhost kernel: R13: 00000103277aeac0 R14:
00000100cfe30e00 R15: 0000000000000000
Aug 14 22:18:48 localhost kernel: FS: 0000002a95564b00(0000)
GS:ffffffff804bf400(0000) knlGS:0000000000000000
Aug 14 22:18:48 localhost kernel: CS: 0010 DS: 0000 ES: 0000 CR0:
000000008005003b
Aug 14 22:18:48 localhost kernel: CR2: 0000000000000018 CR3:
00000000cff6e000 CR4: 00000000000006e0
Aug 14 22:18:48 localhost kernel: Process kjournald (pid: 2255, threadinfo
000001032adf6000, task 000001032a8d67f0)
Aug 14 22:18:48 localhost kernel: Stack: 0000000000000000 0000000000000000
0000000000000000 0000000000000000
Aug 14 22:18:48 localhost kernel: 0000010078d73088 0000000000001fd0
0000000000000000 000001032a8d67f0
Aug 14 22:18:48 localhost kernel: ffffffff80132ff0 000001032adf7c30
Aug 14 22:18:48 localhost kernel: Call
Trace:<ffffffff80132ff0>{autoremove_wake_function+0}
<ffffffff80132ff0>{autoremove_wake_function+0}
Aug 14 22:18:48 localhost kernel:
<ffffffffa0159898>{:jbd:kjournald+250}
<ffffffff80132ff0>{autoremove_wake_function+0}
Aug 14 22:18:48 localhost kernel:
<ffffffff80132ff0>{autoremove_wake_function+0}
<ffffffffa0159798>{:jbd:commit_timeout+0}
Aug 14 22:18:48 localhost kernel: <ffffffff80110c23>{child_rip+8}
<ffffffffa015979e>{:jbd:kjournald+0}
Aug 14 22:18:48 localhost kernel: <ffffffff80110c1b>{child_rip+0}
Aug 14 22:18:48 localhost kernel:
Aug 14 22:18:48 localhost kernel: Code: f0 ff 43 18 8b 03 a8 04 74 52 49 8d
be 5c 01 00 00 e8 17 1a
Aug 14 22:18:48 localhost kernel: RIP
<ffffffffa0156b14>{:jbd:journal_commit_transaction+1140} RSP
<000001032adf7bb8>
Aug 14 22:18:48 localhost kernel: CR2: 0000000000000018
#------------------------------------------------------------------------------------------------------------------------------------
Aug 24 17:41:35 localhost kernel: Unable to handle kernel NULL pointer
dereference at 0000000000000000 RIP:
Aug 24 17:41:35 localhost kernel:
<ffffffffa0156b10>{:jbd:journal_commit_transaction+1136}
Aug 24 17:41:35 localhost kernel: PML4 2cd832067 PGD 1f1216067 PMD 0
Aug 24 17:41:35 localhost kernel: Oops: 0000 [1] SMP
Aug 24 17:41:35 localhost kernel: CPU 3
Aug 24 17:41:35 localhost kernel: Modules linked in: parport_pc lp parport
autofs4 i2c_dev i2c_core sunrpc ds yenta_socket pcmcia_core dm_mod button
battery ac md5 ipv6 joydev ohci_hcd ehci_hcd tg3 floppy ext3 jbd mppVhba(U)
qla2400(U) qla2xxx(U) qla2xxx_conf(U) aacraid(U) mppUpper(U) sg sd_mod
scsi_mod
Aug 24 17:41:35 localhost kernel: Pid: 2312, comm: kjournald Tainted: GF
2.6.9-5.ELsmp
Aug 24 17:41:35 localhost kernel: RIP: 0010:[<ffffffffa0156b10>]
<ffffffffa0156b10>{:jbd:journal_commit_transaction+1136}
Aug 24 17:41:35 localhost kernel: RSP: 0018:000001032ae27bb8 EFLAGS:
00010206
Aug 24 17:41:35 localhost kernel: RAX: 00000102691752f0 RBX:
00000101018779d0 RCX: 00000000c0000100
Aug 24 17:41:35 localhost kernel: RDX: 00000000c0000100 RSI:
00000101018779d0 RDI: 00000100cfe3dc00
Aug 24 17:41:35 localhost kernel: RBP: 0000000000000000 R08:
000001032ae26000 R09: 0000000000000046
[EMAIL PROTECTED] log]# grep "Aug 24 17:41" messages.2
Aug 24 17:41:35 localhost kernel: Unable to handle kernel NULL pointer
dereference at 0000000000000000 RIP:
Aug 24 17:41:35 localhost kernel:
<ffffffffa0156b10>{:jbd:journal_commit_transaction+1136}
Aug 24 17:41:35 localhost kernel: PML4 2cd832067 PGD 1f1216067 PMD 0
Aug 24 17:41:35 localhost kernel: Oops: 0000 [1] SMP
Aug 24 17:41:35 localhost kernel: CPU 3
Aug 24 17:41:35 localhost kernel: Modules linked in: parport_pc lp parport
autofs4 i2c_dev i2c_core sunrpc ds yenta_socket pcmcia_core dm_mod button
battery ac md5 ipv6 joydev ohci_hcd ehci_hcd tg3 floppy ext3 jbd mppVhba(U)
qla2400(U) qla2xxx(U) qla2xxx_conf(U) aacraid(U) mppUpper(U) sg sd_mod
scsi_mod
Aug 24 17:41:35 localhost kernel: Pid: 2312, comm: kjournald Tainted: GF
2.6.9-5.ELsmp
Aug 24 17:41:35 localhost kernel: RIP: 0010:[<ffffffffa0156b10>]
<ffffffffa0156b10>{:jbd:journal_commit_transaction+1136}
Aug 24 17:41:35 localhost kernel: RSP: 0018:000001032ae27bb8 EFLAGS:
00010206
Aug 24 17:41:35 localhost kernel: RAX: 00000102691752f0 RBX:
00000101018779d0 RCX: 00000000c0000100
Aug 24 17:41:35 localhost kernel: RDX: 00000000c0000100 RSI:
00000101018779d0 RDI: 00000100cfe3dc00
Aug 24 17:41:35 localhost kernel: RBP: 0000000000000000 R08:
000001032ae26000 R09: 0000000000000046
Aug 24 17:41:36 localhost kernel: R10: 0000000000000060 R11:
000001032ae27b68 R12: 0000000000000000
Aug 24 17:41:36 localhost kernel: R13: 000001032d39e4c0 R14:
00000100cfe3dc00 R15: 00000100cfe3dce0
Aug 24 17:41:36 localhost kernel: FS: 0000002a95564b00(0000)
GS:ffffffff804bf480(0000) knlGS:0000000000000000
Aug 24 17:41:36 localhost kernel: CS: 0010 DS: 0000 ES: 0000 CR0:
000000008005003b
Aug 24 17:41:36 localhost kernel: CR2: 0000000000000000 CR3:
0000000037e24000 CR4: 00000000000006e0
Aug 24 17:41:36 localhost kernel: Process kjournald (pid: 2312, threadinfo
000001032ae26000, task 000001032a8727f0)
Aug 24 17:41:36 localhost kernel: Stack: 0000000000000000 0000000000000000
0000000000000000 0000000000000000
Aug 24 17:41:36 localhost kernel: 00000101a5e340e0 0000000000001988
0000000000000000 000001032a8727f0
Aug 24 17:41:36 localhost kernel: ffffffff80132ff0 000001032ae27c30
Aug 24 17:41:36 localhost kernel: Call
Trace:<ffffffff80132ff0>{autoremove_wake_function+0}
<ffffffff80132ff0>{autoremove_wake_function+0}
Aug 24 17:41:36 localhost kernel:
<ffffffffa0159898>{:jbd:kjournald+250}
<ffffffff80132ff0>{autoremove_wake_function+0}
Aug 24 17:41:36 localhost kernel:
<ffffffff80132ff0>{autoremove_wake_function+0}
<ffffffffa0159798>{:jbd:commit_timeout+0}
Aug 24 17:41:36 localhost kernel: <ffffffff80110c23>{child_rip+8}
<ffffffffa015979e>{:jbd:kjournald+0}
Aug 24 17:41:36 localhost kernel: <ffffffff80110c1b>{child_rip+0}
Aug 24 17:41:36 localhost kernel:
Aug 24 17:41:36 localhost kernel: Code: 49 8b 1c 24 f0 ff 43 18 8b 03 a8 04
74 52 49 8d be 5c 01 00
Aug 24 17:41:36 localhost kernel: RIP
<ffffffffa0156b10>{:jbd:journal_commit_transaction+1136} RSP
<000001032ae27bb8>
Aug 24 17:41:36 localhost kernel: CR2: 0000000000000000
Aug 24 17:41:36 localhost kernel: <0>Assertion failure in
journal_dirty_data() at fs/jbd/transaction.c:986: "jh->b_transaction ==
journal->j_committing_transaction"
Aug 24 17:41:36 localhost kernel: ----------- [cut here ] --------- [please
bite here ] ---------
Aug 24 17:41:36 localhost kernel: Kernel BUG at transaction:986
Aug 24 17:41:36 localhost kernel: invalid operand: 0000 [2] SMP
Aug 24 17:41:36 localhost kernel: CPU 2
Aug 24 17:41:36 localhost kernel: Modules linked in: parport_pc lp parport
autofs4 i2c_dev i2c_core sunrpc ds yenta_socket pcmcia_core dm_mod button
battery ac md5 ipv6 joydev ohci_hcd ehci_hcd tg3 floppy ext3 jbd mppVhba(U)
qla2400(U) qla2xxx(U) qla2xxx_conf(U) aacraid(U) mppUpper(U) sg sd_mod
scsi_mod
Aug 24 17:41:36 localhost kernel: Pid: 5442, comm: pdflush Tainted: GF
2.6.9-5.ELsmp
Aug 24 17:41:36 localhost kernel: RIP: 0010:[<ffffffffa0155d4c>]
<ffffffffa0155d4c>{:jbd:journal_dirty_data+167}
Aug 24 17:41:36 localhost kernel: RSP: 0000:0000010014805ab8 EFLAGS:
00010212
Aug 24 17:41:36 localhost kernel: RAX: 0000000000000083 RBX:
0000010089c7f870 RCX: 0000000000000246
Aug 24 17:41:36 localhost kernel: RDX: 0000000000006ac2 RSI:
0000000000000246 RDI: ffffffff803c7520
--
Nipuna Perera
http://nipunaperera.blogspot.com
