[Kernel-packages] [Bug 1443648] Re: Kernel panics on iSER (iscsi over IB) logouts
inaddy@mylinux ~/Work/Kernel/Ubuntu/ubuntu-trusty master git tag --contains d6cdcda08c712cae7f071866e7e2e331242d66c3 Ubuntu-3.13.0-60.99 Ubuntu-3.13.0-62.101 Ubuntu-3.13.0-62.102 Ubuntu-3.13.0-63.103 Ubuntu-3.13.0-64.104 Ubuntu-3.13.0-65.105 linux-image-generic | 3.13.0.24.28 | trusty | amd64, arm64, armhf, i386, ppc64el linux-image-generic | 3.13.0.65.71 | trusty-security | amd64, arm64, armhf, i386, ppc64el linux-image-generic | 3.13.0.65.71 | trusty-updates | amd64, arm64, armhf, i386, ppc64el This is already Fix Released. ** Changed in: linux (Ubuntu Trusty) Status: Fix Committed => Fix Released -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1443648 Title: Kernel panics on iSER (iscsi over IB) logouts Status in linux package in Ubuntu: Invalid Status in linux source package in Trusty: Fix Released Bug description: SRU Justification: Impact: After iSER was fixed by LP: #1409904 iscsi logouts cause panics. Fix: Upstream development and devel bisection between 3.13 and 3.16. Testcase: To use iSER and shut down the open-iscsi daemon (comment #8). - While shutting down the "open-iscsi" daemon (with an iSER mapped volume from other host) I'm getting the following kernel panic for kernel 3.13.0-49: """ [272820.948946] scsi15 : iSCSI Initiator over iSER [272843.474551] sd 14:0:0:1: [sdc] Synchronizing SCSI cache [272843.998231] BUG: unable to handle kernel paging request at a03840b7 [272843.998258] IP: [] 0xa03840b7 [272843.998278] PGD 1c11067 PUD 1c12063 PMD 80afb5067 PTE 0 [272843.998306] Oops: 0010 [#1] SMP [272843.998324] Modules linked in: rdma_ucm ib_ucm ib_srp scsi_transport_srp scsi_tgt ib_srpt ib_mthca ib_ipa [272843.998742] CPU: 1 PID: 32399 Comm: kworker/1:0 Not tainted 3.13.0-49-generic #81-Ubuntu [272843.998758] Hardware name: HP ProLiant DL360e Gen8, BIOS P73 11/12/2013 [272843.998774] Workqueue: ib_cm cm_work_handler [ib_cm] [272843.998789] task: 88080b72c800 ti: 880802522000 task.ti: 880802522000 [272843.998827] RIP: 0010:[] [] 0xa03840b7 [272843.998870] RSP: 0018:880802523c28 EFLAGS: 00010296 [272843.998893] RAX: 8800b851d801 RBX: 8807af8482b8 RCX: 00018028 [272843.998929] RDX: 00018029 RSI: 8028 RDI: 88081f003900 [272843.998965] RBP: 880802523c30 R08: R09: 0001 [272843.999002] R10: ea0002e14740 R11: a00e0b9a R12: 88080953e400 [272843.999038] R13: 8807af8482b8 R14: 88080953e400 R15: [272843.999075] FS: () GS:88083f42() knlGS: [272843.999113] CS: 0010 DS: ES: CR0: 80050033 [272843.999136] CR2: a03840b7 CR3: 0008024f1000 CR4: 000407e0 [272843.999173] Stack: [272843.999191] 8807af54 880802523c60 a0386425 8807af8482b8 [272843.999245] 88080953e400 88080acf9fa8 880802523cf0 880802523ca0 [272843.999297] a0384f58 810aacc4 8807af8482b8 8807af8482d0 [272843.999349] Call Trace: [272843.999378] [] ? __wake_up+0x44/0x50 [272843.999406] [] ? cma_comp_exch+0x4b/0x60 [rdma_cm] [272843.999432] [] ? cma_ib_handler+0xf9/0x230 [rdma_cm] [272843.999460] [] ? cm_process_work+0x26/0x150 [ib_cm] [272843.999487] [] ? cm_work_handler+0xa83/0x161c [ib_cm] [272843.999515] [] ? process_one_work+0x182/0x450 [272843.999540] [] ? worker_thread+0x121/0x410 [272843.999565] [] ? rescuer_thread+0x430/0x430 [272843.999590] [] ? kthread+0xd2/0xf0 [272843.999615] [] ? kthread_create_on_node+0x1c0/0x1c0 [272843.999641] [] ? ret_from_fork+0x7c/0xb0 [272843.999666] [] ? kthread_create_on_node+0x1c0/0x1c0 [272843.999691] Code: Bad RIP value. [272843.999721] RIP [] 0xa03840b7 [272843.999749] RSP [272843.999770] CR2: a03840b7 """ I got also this one (looks the same): """ [ 479.240278] BUG: unable to handle kernel paging request at a04af0b7 [ 479.240453] IP: [] 0xa04af0b7 [ 479.240572] PGD 1c11067 PUD 1c12063 PMD 80bccf067 PTE 0 [ 479.240849] Oops: 0010 [#1] SMP [ 479.241014] Modules linked in: ip6table_filter ip6_tables iptable_filter ip_tables ebtable_nat ebtables x_ [ 479.245546] [ 479.245603] CPU: 2 PID: 257 Comm: kworker/2:1 Not tainted 3.13.0-49-generic #81-Ubuntu [ 479.245668] Hardware name: HP ProLiant DL360e Gen8, BIOS P73 11/12/2013 [ 479.245734] Workqueue: ib_cm cm_work_handler [ib_cm] [ 479.245847] task: 880811ad6000 ti: 88081142 task.ti: 88081142 [ 479.245923] RIP: 0010:[] [] 0xa04af0b7 [ 479.246065] RSP: 0018:880811421c28 EFLAGS: 00010296 [ 479.246138] RAX: 8807f6d85501 RBX: 8807e613a2b8
[Kernel-packages] [Bug 1443648] Re: Kernel panics on iSER (iscsi over IB) logouts
2nd verification: https://bugs.launchpad.net/ubuntu/+source/libibverbs/+bug/1409904/comments/88 -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1443648 Title: Kernel panics on iSER (iscsi over IB) logouts Status in linux package in Ubuntu: Invalid Status in linux source package in Trusty: Fix Committed Bug description: SRU Justification: Impact: After iSER was fixed by LP: #1409904 iscsi logouts cause panics. Fix: Upstream development and devel bisection between 3.13 and 3.16. Testcase: To use iSER and shut down the open-iscsi daemon (comment #8). - While shutting down the "open-iscsi" daemon (with an iSER mapped volume from other host) I'm getting the following kernel panic for kernel 3.13.0-49: """ [272820.948946] scsi15 : iSCSI Initiator over iSER [272843.474551] sd 14:0:0:1: [sdc] Synchronizing SCSI cache [272843.998231] BUG: unable to handle kernel paging request at a03840b7 [272843.998258] IP: [] 0xa03840b7 [272843.998278] PGD 1c11067 PUD 1c12063 PMD 80afb5067 PTE 0 [272843.998306] Oops: 0010 [#1] SMP [272843.998324] Modules linked in: rdma_ucm ib_ucm ib_srp scsi_transport_srp scsi_tgt ib_srpt ib_mthca ib_ipa [272843.998742] CPU: 1 PID: 32399 Comm: kworker/1:0 Not tainted 3.13.0-49-generic #81-Ubuntu [272843.998758] Hardware name: HP ProLiant DL360e Gen8, BIOS P73 11/12/2013 [272843.998774] Workqueue: ib_cm cm_work_handler [ib_cm] [272843.998789] task: 88080b72c800 ti: 880802522000 task.ti: 880802522000 [272843.998827] RIP: 0010:[] [] 0xa03840b7 [272843.998870] RSP: 0018:880802523c28 EFLAGS: 00010296 [272843.998893] RAX: 8800b851d801 RBX: 8807af8482b8 RCX: 00018028 [272843.998929] RDX: 00018029 RSI: 8028 RDI: 88081f003900 [272843.998965] RBP: 880802523c30 R08: R09: 0001 [272843.999002] R10: ea0002e14740 R11: a00e0b9a R12: 88080953e400 [272843.999038] R13: 8807af8482b8 R14: 88080953e400 R15: [272843.999075] FS: () GS:88083f42() knlGS: [272843.999113] CS: 0010 DS: ES: CR0: 80050033 [272843.999136] CR2: a03840b7 CR3: 0008024f1000 CR4: 000407e0 [272843.999173] Stack: [272843.999191] 8807af54 880802523c60 a0386425 8807af8482b8 [272843.999245] 88080953e400 88080acf9fa8 880802523cf0 880802523ca0 [272843.999297] a0384f58 810aacc4 8807af8482b8 8807af8482d0 [272843.999349] Call Trace: [272843.999378] [] ? __wake_up+0x44/0x50 [272843.999406] [] ? cma_comp_exch+0x4b/0x60 [rdma_cm] [272843.999432] [] ? cma_ib_handler+0xf9/0x230 [rdma_cm] [272843.999460] [] ? cm_process_work+0x26/0x150 [ib_cm] [272843.999487] [] ? cm_work_handler+0xa83/0x161c [ib_cm] [272843.999515] [] ? process_one_work+0x182/0x450 [272843.999540] [] ? worker_thread+0x121/0x410 [272843.999565] [] ? rescuer_thread+0x430/0x430 [272843.999590] [] ? kthread+0xd2/0xf0 [272843.999615] [] ? kthread_create_on_node+0x1c0/0x1c0 [272843.999641] [] ? ret_from_fork+0x7c/0xb0 [272843.999666] [] ? kthread_create_on_node+0x1c0/0x1c0 [272843.999691] Code: Bad RIP value. [272843.999721] RIP [] 0xa03840b7 [272843.999749] RSP [272843.999770] CR2: a03840b7 """ I got also this one (looks the same): """ [ 479.240278] BUG: unable to handle kernel paging request at a04af0b7 [ 479.240453] IP: [] 0xa04af0b7 [ 479.240572] PGD 1c11067 PUD 1c12063 PMD 80bccf067 PTE 0 [ 479.240849] Oops: 0010 [#1] SMP [ 479.241014] Modules linked in: ip6table_filter ip6_tables iptable_filter ip_tables ebtable_nat ebtables x_ [ 479.245546] [ 479.245603] CPU: 2 PID: 257 Comm: kworker/2:1 Not tainted 3.13.0-49-generic #81-Ubuntu [ 479.245668] Hardware name: HP ProLiant DL360e Gen8, BIOS P73 11/12/2013 [ 479.245734] Workqueue: ib_cm cm_work_handler [ib_cm] [ 479.245847] task: 880811ad6000 ti: 88081142 task.ti: 88081142 [ 479.245923] RIP: 0010:[] [] 0xa04af0b7 [ 479.246065] RSP: 0018:880811421c28 EFLAGS: 00010296 [ 479.246138] RAX: 8807f6d85501 RBX: 8807e613a2b8 RCX: 00018029 [ 479.246212] RDX: 0001802a RSI: 8029 RDI: 88081f003900 [ 479.246287] RBP: 880811421c30 R08: R09: 0001 [ 479.246361] R10: ea001fdb6140 R11: a00f7b9a R12: 8807e6238c00 [ 479.246435] R13: 8807e613a2b8 R14: 8807e6238c00 R15: [ 479.246510] FS: () GS:88083f44() knlGS: [ 479.246597] CS: 0010 DS: ES: CR0: 80050033 [ 479.246669] CR2:
[Kernel-packages] [Bug 1443648] Re: Kernel panics on iSER (iscsi over IB) logouts
** Changed in: linux (Ubuntu Trusty) Importance: Undecided = High ** Changed in: linux (Ubuntu) Importance: High = Undecided -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1443648 Title: Kernel panics on iSER (iscsi over IB) logouts Status in linux package in Ubuntu: Invalid Status in linux source package in Trusty: Fix Committed Bug description: SRU Justification: Impact: After iSER was fixed by LP: #1409904 iscsi logouts cause panics. Fix: Upstream development and devel bisection between 3.13 and 3.16. Testcase: To use iSER and shut down the open-iscsi daemon (comment #8). - While shutting down the open-iscsi daemon (with an iSER mapped volume from other host) I'm getting the following kernel panic for kernel 3.13.0-49: [272820.948946] scsi15 : iSCSI Initiator over iSER [272843.474551] sd 14:0:0:1: [sdc] Synchronizing SCSI cache [272843.998231] BUG: unable to handle kernel paging request at a03840b7 [272843.998258] IP: [a03840b7] 0xa03840b7 [272843.998278] PGD 1c11067 PUD 1c12063 PMD 80afb5067 PTE 0 [272843.998306] Oops: 0010 [#1] SMP [272843.998324] Modules linked in: rdma_ucm ib_ucm ib_srp scsi_transport_srp scsi_tgt ib_srpt ib_mthca ib_ipa [272843.998742] CPU: 1 PID: 32399 Comm: kworker/1:0 Not tainted 3.13.0-49-generic #81-Ubuntu [272843.998758] Hardware name: HP ProLiant DL360e Gen8, BIOS P73 11/12/2013 [272843.998774] Workqueue: ib_cm cm_work_handler [ib_cm] [272843.998789] task: 88080b72c800 ti: 880802522000 task.ti: 880802522000 [272843.998827] RIP: 0010:[a03840b7] [a03840b7] 0xa03840b7 [272843.998870] RSP: 0018:880802523c28 EFLAGS: 00010296 [272843.998893] RAX: 8800b851d801 RBX: 8807af8482b8 RCX: 00018028 [272843.998929] RDX: 00018029 RSI: 8028 RDI: 88081f003900 [272843.998965] RBP: 880802523c30 R08: R09: 0001 [272843.999002] R10: ea0002e14740 R11: a00e0b9a R12: 88080953e400 [272843.999038] R13: 8807af8482b8 R14: 88080953e400 R15: [272843.999075] FS: () GS:88083f42() knlGS: [272843.999113] CS: 0010 DS: ES: CR0: 80050033 [272843.999136] CR2: a03840b7 CR3: 0008024f1000 CR4: 000407e0 [272843.999173] Stack: [272843.999191] 8807af54 880802523c60 a0386425 8807af8482b8 [272843.999245] 88080953e400 88080acf9fa8 880802523cf0 880802523ca0 [272843.999297] a0384f58 810aacc4 8807af8482b8 8807af8482d0 [272843.999349] Call Trace: [272843.999378] [810aacc4] ? __wake_up+0x44/0x50 [272843.999406] [a03c436b] ? cma_comp_exch+0x4b/0x60 [rdma_cm] [272843.999432] [a03c6429] ? cma_ib_handler+0xf9/0x230 [rdma_cm] [272843.999460] [a01b2166] ? cm_process_work+0x26/0x150 [ib_cm] [272843.999487] [a01b4183] ? cm_work_handler+0xa83/0x161c [ib_cm] [272843.999515] [81083a82] ? process_one_work+0x182/0x450 [272843.999540] [81084871] ? worker_thread+0x121/0x410 [272843.999565] [81084750] ? rescuer_thread+0x430/0x430 [272843.999590] [8108b5b2] ? kthread+0xd2/0xf0 [272843.999615] [8108b4e0] ? kthread_create_on_node+0x1c0/0x1c0 [272843.999641] [8173258c] ? ret_from_fork+0x7c/0xb0 [272843.999666] [8108b4e0] ? kthread_create_on_node+0x1c0/0x1c0 [272843.999691] Code: Bad RIP value. [272843.999721] RIP [a03840b7] 0xa03840b7 [272843.999749] RSP 880802523c28 [272843.999770] CR2: a03840b7 I got also this one (looks the same): [ 479.240278] BUG: unable to handle kernel paging request at a04af0b7 [ 479.240453] IP: [a04af0b7] 0xa04af0b7 [ 479.240572] PGD 1c11067 PUD 1c12063 PMD 80bccf067 PTE 0 [ 479.240849] Oops: 0010 [#1] SMP [ 479.241014] Modules linked in: ip6table_filter ip6_tables iptable_filter ip_tables ebtable_nat ebtables x_ [ 479.245546] [ 479.245603] CPU: 2 PID: 257 Comm: kworker/2:1 Not tainted 3.13.0-49-generic #81-Ubuntu [ 479.245668] Hardware name: HP ProLiant DL360e Gen8, BIOS P73 11/12/2013 [ 479.245734] Workqueue: ib_cm cm_work_handler [ib_cm] [ 479.245847] task: 880811ad6000 ti: 88081142 task.ti: 88081142 [ 479.245923] RIP: 0010:[a04af0b7] [a04af0b7] 0xa04af0b7 [ 479.246065] RSP: 0018:880811421c28 EFLAGS: 00010296 [ 479.246138] RAX: 8807f6d85501 RBX: 8807e613a2b8 RCX: 00018029 [ 479.246212] RDX: 0001802a RSI: 8029 RDI: 88081f003900 [ 479.246287] RBP: 880811421c30 R08: R09: 0001 [
[Kernel-packages] [Bug 1443648] Re: Kernel panics on iSER (iscsi over IB) logouts
Verifying this right now, will share results soon. -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1443648 Title: Kernel panics on iSER (iscsi over IB) logouts Status in linux package in Ubuntu: Invalid Status in linux source package in Trusty: Fix Committed Bug description: SRU Justification: Impact: After iSER was fixed by LP: #1409904 iscsi logouts cause panics. Fix: Upstream development and devel bisection between 3.13 and 3.16. Testcase: To use iSER and shut down the open-iscsi daemon (comment #8). - While shutting down the open-iscsi daemon (with an iSER mapped volume from other host) I'm getting the following kernel panic for kernel 3.13.0-49: [272820.948946] scsi15 : iSCSI Initiator over iSER [272843.474551] sd 14:0:0:1: [sdc] Synchronizing SCSI cache [272843.998231] BUG: unable to handle kernel paging request at a03840b7 [272843.998258] IP: [a03840b7] 0xa03840b7 [272843.998278] PGD 1c11067 PUD 1c12063 PMD 80afb5067 PTE 0 [272843.998306] Oops: 0010 [#1] SMP [272843.998324] Modules linked in: rdma_ucm ib_ucm ib_srp scsi_transport_srp scsi_tgt ib_srpt ib_mthca ib_ipa [272843.998742] CPU: 1 PID: 32399 Comm: kworker/1:0 Not tainted 3.13.0-49-generic #81-Ubuntu [272843.998758] Hardware name: HP ProLiant DL360e Gen8, BIOS P73 11/12/2013 [272843.998774] Workqueue: ib_cm cm_work_handler [ib_cm] [272843.998789] task: 88080b72c800 ti: 880802522000 task.ti: 880802522000 [272843.998827] RIP: 0010:[a03840b7] [a03840b7] 0xa03840b7 [272843.998870] RSP: 0018:880802523c28 EFLAGS: 00010296 [272843.998893] RAX: 8800b851d801 RBX: 8807af8482b8 RCX: 00018028 [272843.998929] RDX: 00018029 RSI: 8028 RDI: 88081f003900 [272843.998965] RBP: 880802523c30 R08: R09: 0001 [272843.999002] R10: ea0002e14740 R11: a00e0b9a R12: 88080953e400 [272843.999038] R13: 8807af8482b8 R14: 88080953e400 R15: [272843.999075] FS: () GS:88083f42() knlGS: [272843.999113] CS: 0010 DS: ES: CR0: 80050033 [272843.999136] CR2: a03840b7 CR3: 0008024f1000 CR4: 000407e0 [272843.999173] Stack: [272843.999191] 8807af54 880802523c60 a0386425 8807af8482b8 [272843.999245] 88080953e400 88080acf9fa8 880802523cf0 880802523ca0 [272843.999297] a0384f58 810aacc4 8807af8482b8 8807af8482d0 [272843.999349] Call Trace: [272843.999378] [810aacc4] ? __wake_up+0x44/0x50 [272843.999406] [a03c436b] ? cma_comp_exch+0x4b/0x60 [rdma_cm] [272843.999432] [a03c6429] ? cma_ib_handler+0xf9/0x230 [rdma_cm] [272843.999460] [a01b2166] ? cm_process_work+0x26/0x150 [ib_cm] [272843.999487] [a01b4183] ? cm_work_handler+0xa83/0x161c [ib_cm] [272843.999515] [81083a82] ? process_one_work+0x182/0x450 [272843.999540] [81084871] ? worker_thread+0x121/0x410 [272843.999565] [81084750] ? rescuer_thread+0x430/0x430 [272843.999590] [8108b5b2] ? kthread+0xd2/0xf0 [272843.999615] [8108b4e0] ? kthread_create_on_node+0x1c0/0x1c0 [272843.999641] [8173258c] ? ret_from_fork+0x7c/0xb0 [272843.999666] [8108b4e0] ? kthread_create_on_node+0x1c0/0x1c0 [272843.999691] Code: Bad RIP value. [272843.999721] RIP [a03840b7] 0xa03840b7 [272843.999749] RSP 880802523c28 [272843.999770] CR2: a03840b7 I got also this one (looks the same): [ 479.240278] BUG: unable to handle kernel paging request at a04af0b7 [ 479.240453] IP: [a04af0b7] 0xa04af0b7 [ 479.240572] PGD 1c11067 PUD 1c12063 PMD 80bccf067 PTE 0 [ 479.240849] Oops: 0010 [#1] SMP [ 479.241014] Modules linked in: ip6table_filter ip6_tables iptable_filter ip_tables ebtable_nat ebtables x_ [ 479.245546] [ 479.245603] CPU: 2 PID: 257 Comm: kworker/2:1 Not tainted 3.13.0-49-generic #81-Ubuntu [ 479.245668] Hardware name: HP ProLiant DL360e Gen8, BIOS P73 11/12/2013 [ 479.245734] Workqueue: ib_cm cm_work_handler [ib_cm] [ 479.245847] task: 880811ad6000 ti: 88081142 task.ti: 88081142 [ 479.245923] RIP: 0010:[a04af0b7] [a04af0b7] 0xa04af0b7 [ 479.246065] RSP: 0018:880811421c28 EFLAGS: 00010296 [ 479.246138] RAX: 8807f6d85501 RBX: 8807e613a2b8 RCX: 00018029 [ 479.246212] RDX: 0001802a RSI: 8029 RDI: 88081f003900 [ 479.246287] RBP: 880811421c30 R08: R09: 0001 [ 479.246361] R10: ea001fdb6140 R11: a00f7b9a R12: 8807e6238c00 [
[Kernel-packages] [Bug 1443648] Re: Kernel panics on iSER (iscsi over IB) logouts
I was able to verify that the new kernel fixes the issue: root@dixie:~# uname -a Linux dixie 3.13.0-62-generic #101-Ubuntu SMP Thu Jul 30 09:01:36 UTC 2015 x86_64 x86_64 x86_64 GNU/Linux root@dixie:~# iscsiadm -m discovery --op=show --type sendtargets --portal 172.16.0.1 -I iser 172.16.0.1:3260,1 iqn.2001-04.com.hertz-lunit1 root@dixie:~# iscsiadm -m discovery --op=new --op=del --type sendtargets --portal 172.16.0.1 -I iser 172.16.0.1:3260,1 iqn.2001-04.com.hertz-lunit1 root@dixie:~# iscsiadm -m node -l Logging in to [iface: iser, target: iqn.2001-04.com.hertz-lunit1, portal: 172.16.0.1,3260] (multiple) Login to [iface: iser, target: iqn.2001-04.com.hertz-lunit1, portal: 172.16.0.1,3260] successful. root@dixie:~# ls /dev/sdc /dev/sdc root@dixie:~# dd if=/dev/zero of=/dev/sdc bs=1M count=1024 oflag=direct 1024+0 records in 1024+0 records out 1073741824 bytes (1.1 GB) copied, 1.01833 s, 1.1 GB/s root@dixie:~# service open-iscsi stop * Unmounting iscsi-backed filesystems [ OK ] * Disconnecting iSCSI targets Logging out of session [sid: 3, target: iqn.2001-04.com.hertz-lunit1, portal: 172.16.0.1,3260] ### NO KERNEL PANIC!!! (as it used to happen) Logout of [sid: 3, target: iqn.2001-04.com.hertz-lunit1, portal: 172.16.0.1,3260] successful. [ OK ] * Stopping iSCSI initiator service [ OK ] root@dixie:~# root@dixie:~# root@dixie:~# service open-iscsi start * Starting iSCSI initiator service iscsid [ OK ] * Setting up iSCSI targets iscsiadm: No records found [ OK ] * Mounting network filesystems [ OK ] ** Tags removed: verification-needed-trusty ** Tags added: verification-done ** Tags added: sts -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1443648 Title: Kernel panics on iSER (iscsi over IB) logouts Status in linux package in Ubuntu: Invalid Status in linux source package in Trusty: Fix Committed Bug description: SRU Justification: Impact: After iSER was fixed by LP: #1409904 iscsi logouts cause panics. Fix: Upstream development and devel bisection between 3.13 and 3.16. Testcase: To use iSER and shut down the open-iscsi daemon (comment #8). - While shutting down the open-iscsi daemon (with an iSER mapped volume from other host) I'm getting the following kernel panic for kernel 3.13.0-49: [272820.948946] scsi15 : iSCSI Initiator over iSER [272843.474551] sd 14:0:0:1: [sdc] Synchronizing SCSI cache [272843.998231] BUG: unable to handle kernel paging request at a03840b7 [272843.998258] IP: [a03840b7] 0xa03840b7 [272843.998278] PGD 1c11067 PUD 1c12063 PMD 80afb5067 PTE 0 [272843.998306] Oops: 0010 [#1] SMP [272843.998324] Modules linked in: rdma_ucm ib_ucm ib_srp scsi_transport_srp scsi_tgt ib_srpt ib_mthca ib_ipa [272843.998742] CPU: 1 PID: 32399 Comm: kworker/1:0 Not tainted 3.13.0-49-generic #81-Ubuntu [272843.998758] Hardware name: HP ProLiant DL360e Gen8, BIOS P73 11/12/2013 [272843.998774] Workqueue: ib_cm cm_work_handler [ib_cm] [272843.998789] task: 88080b72c800 ti: 880802522000 task.ti: 880802522000 [272843.998827] RIP: 0010:[a03840b7] [a03840b7] 0xa03840b7 [272843.998870] RSP: 0018:880802523c28 EFLAGS: 00010296 [272843.998893] RAX: 8800b851d801 RBX: 8807af8482b8 RCX: 00018028 [272843.998929] RDX: 00018029 RSI: 8028 RDI: 88081f003900 [272843.998965] RBP: 880802523c30 R08: R09: 0001 [272843.999002] R10: ea0002e14740 R11: a00e0b9a R12: 88080953e400 [272843.999038] R13: 8807af8482b8 R14: 88080953e400 R15: [272843.999075] FS: () GS:88083f42() knlGS: [272843.999113] CS: 0010 DS: ES: CR0: 80050033 [272843.999136] CR2: a03840b7 CR3: 0008024f1000 CR4: 000407e0 [272843.999173] Stack: [272843.999191] 8807af54 880802523c60 a0386425 8807af8482b8 [272843.999245] 88080953e400 88080acf9fa8 880802523cf0 880802523ca0 [272843.999297] a0384f58 810aacc4 8807af8482b8 8807af8482d0 [272843.999349] Call Trace: [272843.999378] [810aacc4] ? __wake_up+0x44/0x50 [272843.999406] [a03c436b] ? cma_comp_exch+0x4b/0x60 [rdma_cm] [272843.999432] [a03c6429] ? cma_ib_handler+0xf9/0x230 [rdma_cm] [272843.999460]
[Kernel-packages] [Bug 1443648] Re: Kernel panics on iSER (iscsi over IB) logouts
** Attachment added: how-to-test-this.txt https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1443648/+attachment/4443045/+files/how-to-test-this.txt -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1443648 Title: Kernel panics on iSER (iscsi over IB) logouts Status in linux package in Ubuntu: Invalid Status in linux source package in Trusty: Fix Committed Bug description: SRU Justification: Impact: After iSER was fixed by LP: #1409904 iscsi logouts cause panics. Fix: Upstream development and devel bisection between 3.13 and 3.16. Testcase: To use iSER and shut down the open-iscsi daemon (comment #8). - While shutting down the open-iscsi daemon (with an iSER mapped volume from other host) I'm getting the following kernel panic for kernel 3.13.0-49: [272820.948946] scsi15 : iSCSI Initiator over iSER [272843.474551] sd 14:0:0:1: [sdc] Synchronizing SCSI cache [272843.998231] BUG: unable to handle kernel paging request at a03840b7 [272843.998258] IP: [a03840b7] 0xa03840b7 [272843.998278] PGD 1c11067 PUD 1c12063 PMD 80afb5067 PTE 0 [272843.998306] Oops: 0010 [#1] SMP [272843.998324] Modules linked in: rdma_ucm ib_ucm ib_srp scsi_transport_srp scsi_tgt ib_srpt ib_mthca ib_ipa [272843.998742] CPU: 1 PID: 32399 Comm: kworker/1:0 Not tainted 3.13.0-49-generic #81-Ubuntu [272843.998758] Hardware name: HP ProLiant DL360e Gen8, BIOS P73 11/12/2013 [272843.998774] Workqueue: ib_cm cm_work_handler [ib_cm] [272843.998789] task: 88080b72c800 ti: 880802522000 task.ti: 880802522000 [272843.998827] RIP: 0010:[a03840b7] [a03840b7] 0xa03840b7 [272843.998870] RSP: 0018:880802523c28 EFLAGS: 00010296 [272843.998893] RAX: 8800b851d801 RBX: 8807af8482b8 RCX: 00018028 [272843.998929] RDX: 00018029 RSI: 8028 RDI: 88081f003900 [272843.998965] RBP: 880802523c30 R08: R09: 0001 [272843.999002] R10: ea0002e14740 R11: a00e0b9a R12: 88080953e400 [272843.999038] R13: 8807af8482b8 R14: 88080953e400 R15: [272843.999075] FS: () GS:88083f42() knlGS: [272843.999113] CS: 0010 DS: ES: CR0: 80050033 [272843.999136] CR2: a03840b7 CR3: 0008024f1000 CR4: 000407e0 [272843.999173] Stack: [272843.999191] 8807af54 880802523c60 a0386425 8807af8482b8 [272843.999245] 88080953e400 88080acf9fa8 880802523cf0 880802523ca0 [272843.999297] a0384f58 810aacc4 8807af8482b8 8807af8482d0 [272843.999349] Call Trace: [272843.999378] [810aacc4] ? __wake_up+0x44/0x50 [272843.999406] [a03c436b] ? cma_comp_exch+0x4b/0x60 [rdma_cm] [272843.999432] [a03c6429] ? cma_ib_handler+0xf9/0x230 [rdma_cm] [272843.999460] [a01b2166] ? cm_process_work+0x26/0x150 [ib_cm] [272843.999487] [a01b4183] ? cm_work_handler+0xa83/0x161c [ib_cm] [272843.999515] [81083a82] ? process_one_work+0x182/0x450 [272843.999540] [81084871] ? worker_thread+0x121/0x410 [272843.999565] [81084750] ? rescuer_thread+0x430/0x430 [272843.999590] [8108b5b2] ? kthread+0xd2/0xf0 [272843.999615] [8108b4e0] ? kthread_create_on_node+0x1c0/0x1c0 [272843.999641] [8173258c] ? ret_from_fork+0x7c/0xb0 [272843.999666] [8108b4e0] ? kthread_create_on_node+0x1c0/0x1c0 [272843.999691] Code: Bad RIP value. [272843.999721] RIP [a03840b7] 0xa03840b7 [272843.999749] RSP 880802523c28 [272843.999770] CR2: a03840b7 I got also this one (looks the same): [ 479.240278] BUG: unable to handle kernel paging request at a04af0b7 [ 479.240453] IP: [a04af0b7] 0xa04af0b7 [ 479.240572] PGD 1c11067 PUD 1c12063 PMD 80bccf067 PTE 0 [ 479.240849] Oops: 0010 [#1] SMP [ 479.241014] Modules linked in: ip6table_filter ip6_tables iptable_filter ip_tables ebtable_nat ebtables x_ [ 479.245546] [ 479.245603] CPU: 2 PID: 257 Comm: kworker/2:1 Not tainted 3.13.0-49-generic #81-Ubuntu [ 479.245668] Hardware name: HP ProLiant DL360e Gen8, BIOS P73 11/12/2013 [ 479.245734] Workqueue: ib_cm cm_work_handler [ib_cm] [ 479.245847] task: 880811ad6000 ti: 88081142 task.ti: 88081142 [ 479.245923] RIP: 0010:[a04af0b7] [a04af0b7] 0xa04af0b7 [ 479.246065] RSP: 0018:880811421c28 EFLAGS: 00010296 [ 479.246138] RAX: 8807f6d85501 RBX: 8807e613a2b8 RCX: 00018029 [ 479.246212] RDX: 0001802a RSI: 8029 RDI: 88081f003900 [ 479.246287] RBP: 880811421c30 R08: R09:
Re: [Kernel-packages] [Bug 1443648] Re: Kernel panics on iSER (iscsi over IB) logouts
+ Kamal -Original Message- From: boun...@canonical.com [mailto:boun...@canonical.com] On Behalf Of Brad Figg Sent: Wednesday, August 5, 2015 9:15 PM To: Amir Vadai am...@mellanox.com Subject: [Bug 1443648] Re: Kernel panics on iSER (iscsi over IB) logouts Importance: High This bug is awaiting verification that the kernel in -proposed solves the problem. Please test the kernel and update this bug with the results. If the problem is solved, change the tag 'verification-needed- trusty' to 'verification-done-trusty'. If verification is not done by 5 working days from today, this fix will be dropped from the source code, and this bug will be closed. See https://wiki.ubuntu.com/Testing/EnableProposed for documentation how to enable and use -proposed. Thank you! ** Tags added: verification-needed-trusty -- You received this bug notification because you are subscribed to the bug report. https://bugs.launchpad.net/bugs/1443648 Title: Kernel panics on iSER (iscsi over IB) logouts Status in linux package in Ubuntu: Invalid Status in linux source package in Trusty: Fix Committed Bug description: SRU Justification: Impact: After iSER was fixed by LP: #1409904 iscsi logouts cause panics. Fix: Upstream development and devel bisection between 3.13 and 3.16. Testcase: To use iSER and shut down the open-iscsi daemon (comment #8). - While shutting down the open-iscsi daemon (with an iSER mapped volume from other host) I'm getting the following kernel panic for kernel 3.13.0-49: [272820.948946] scsi15 : iSCSI Initiator over iSER [272843.474551] sd 14:0:0:1: [sdc] Synchronizing SCSI cache [272843.998231] BUG: unable to handle kernel paging request at a03840b7 [272843.998258] IP: [a03840b7] 0xa03840b7 [272843.998278] PGD 1c11067 PUD 1c12063 PMD 80afb5067 PTE 0 [272843.998306] Oops: 0010 [#1] SMP [272843.998324] Modules linked in: rdma_ucm ib_ucm ib_srp scsi_transport_srp scsi_tgt ib_srpt ib_mthca ib_ipa [272843.998742] CPU: 1 PID: 32399 Comm: kworker/1:0 Not tainted 3.13.0-49-generic #81-Ubuntu [272843.998758] Hardware name: HP ProLiant DL360e Gen8, BIOS P73 11/12/2013 [272843.998774] Workqueue: ib_cm cm_work_handler [ib_cm] [272843.998789] task: 88080b72c800 ti: 880802522000 task.ti: 880802522000 [272843.998827] RIP: 0010:[a03840b7] [a03840b7] 0xa03840b7 [272843.998870] RSP: 0018:880802523c28 EFLAGS: 00010296 [272843.998893] RAX: 8800b851d801 RBX: 8807af8482b8 RCX: 00018028 [272843.998929] RDX: 00018029 RSI: 8028 RDI: 88081f003900 [272843.998965] RBP: 880802523c30 R08: R09: 0001 [272843.999002] R10: ea0002e14740 R11: a00e0b9a R12: 88080953e400 [272843.999038] R13: 8807af8482b8 R14: 88080953e400 R15: [272843.999075] FS: () GS:88083f42() knlGS: [272843.999113] CS: 0010 DS: ES: CR0: 80050033 [272843.999136] CR2: a03840b7 CR3: 0008024f1000 CR4: 000407e0 [272843.999173] Stack: [272843.999191] 8807af54 880802523c60 a0386425 8807af8482b8 [272843.999245] 88080953e400 88080acf9fa8 880802523cf0 880802523ca0 [272843.999297] a0384f58 810aacc4 8807af8482b8 8807af8482d0 [272843.999349] Call Trace: [272843.999378] [810aacc4] ? __wake_up+0x44/0x50 [272843.999406] [a03c436b] ? cma_comp_exch+0x4b/0x60 [rdma_cm] [272843.999432] [a03c6429] ? cma_ib_handler+0xf9/0x230 [rdma_cm] [272843.999460] [a01b2166] ? cm_process_work+0x26/0x150 [ib_cm] [272843.999487] [a01b4183] ? cm_work_handler+0xa83/0x161c [ib_cm] [272843.999515] [81083a82] ? process_one_work+0x182/0x450 [272843.999540] [81084871] ? worker_thread+0x121/0x410 [272843.999565] [81084750] ? rescuer_thread+0x430/0x430 [272843.999590] [8108b5b2] ? kthread+0xd2/0xf0 [272843.999615] [8108b4e0] ? kthread_create_on_node+0x1c0/0x1c0 [272843.999641] [8173258c] ? ret_from_fork+0x7c/0xb0 [272843.999666] [8108b4e0] ? kthread_create_on_node+0x1c0/0x1c0 [272843.999691] Code: Bad RIP value. [272843.999721] RIP [a03840b7] 0xa03840b7 [272843.999749] RSP 880802523c28 [272843.999770] CR2: a03840b7 I got also this one (looks the same): [ 479.240278] BUG: unable to handle kernel paging request at a04af0b7 [ 479.240453] IP: [a04af0b7] 0xa04af0b7 [ 479.240572] PGD 1c11067 PUD 1c12063 PMD 80bccf067 PTE 0 [ 479.240849] Oops: 0010 [#1] SMP [ 479.241014] Modules linked in: ip6table_filter ip6_tables iptable_filter ip_tables ebtable_nat ebtables x_ [ 479.245546] [ 479.245603] CPU: 2 PID: 257 Comm: kworker/2:1 Not tainted
[Kernel-packages] [Bug 1443648] Re: Kernel panics on iSER (iscsi over IB) logouts
This bug is awaiting verification that the kernel in -proposed solves the problem. Please test the kernel and update this bug with the results. If the problem is solved, change the tag 'verification-needed- trusty' to 'verification-done-trusty'. If verification is not done by 5 working days from today, this fix will be dropped from the source code, and this bug will be closed. See https://wiki.ubuntu.com/Testing/EnableProposed for documentation how to enable and use -proposed. Thank you! ** Tags added: verification-needed-trusty -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1443648 Title: Kernel panics on iSER (iscsi over IB) logouts Status in linux package in Ubuntu: Invalid Status in linux source package in Trusty: Fix Committed Bug description: SRU Justification: Impact: After iSER was fixed by LP: #1409904 iscsi logouts cause panics. Fix: Upstream development and devel bisection between 3.13 and 3.16. Testcase: To use iSER and shut down the open-iscsi daemon (comment #8). - While shutting down the open-iscsi daemon (with an iSER mapped volume from other host) I'm getting the following kernel panic for kernel 3.13.0-49: [272820.948946] scsi15 : iSCSI Initiator over iSER [272843.474551] sd 14:0:0:1: [sdc] Synchronizing SCSI cache [272843.998231] BUG: unable to handle kernel paging request at a03840b7 [272843.998258] IP: [a03840b7] 0xa03840b7 [272843.998278] PGD 1c11067 PUD 1c12063 PMD 80afb5067 PTE 0 [272843.998306] Oops: 0010 [#1] SMP [272843.998324] Modules linked in: rdma_ucm ib_ucm ib_srp scsi_transport_srp scsi_tgt ib_srpt ib_mthca ib_ipa [272843.998742] CPU: 1 PID: 32399 Comm: kworker/1:0 Not tainted 3.13.0-49-generic #81-Ubuntu [272843.998758] Hardware name: HP ProLiant DL360e Gen8, BIOS P73 11/12/2013 [272843.998774] Workqueue: ib_cm cm_work_handler [ib_cm] [272843.998789] task: 88080b72c800 ti: 880802522000 task.ti: 880802522000 [272843.998827] RIP: 0010:[a03840b7] [a03840b7] 0xa03840b7 [272843.998870] RSP: 0018:880802523c28 EFLAGS: 00010296 [272843.998893] RAX: 8800b851d801 RBX: 8807af8482b8 RCX: 00018028 [272843.998929] RDX: 00018029 RSI: 8028 RDI: 88081f003900 [272843.998965] RBP: 880802523c30 R08: R09: 0001 [272843.999002] R10: ea0002e14740 R11: a00e0b9a R12: 88080953e400 [272843.999038] R13: 8807af8482b8 R14: 88080953e400 R15: [272843.999075] FS: () GS:88083f42() knlGS: [272843.999113] CS: 0010 DS: ES: CR0: 80050033 [272843.999136] CR2: a03840b7 CR3: 0008024f1000 CR4: 000407e0 [272843.999173] Stack: [272843.999191] 8807af54 880802523c60 a0386425 8807af8482b8 [272843.999245] 88080953e400 88080acf9fa8 880802523cf0 880802523ca0 [272843.999297] a0384f58 810aacc4 8807af8482b8 8807af8482d0 [272843.999349] Call Trace: [272843.999378] [810aacc4] ? __wake_up+0x44/0x50 [272843.999406] [a03c436b] ? cma_comp_exch+0x4b/0x60 [rdma_cm] [272843.999432] [a03c6429] ? cma_ib_handler+0xf9/0x230 [rdma_cm] [272843.999460] [a01b2166] ? cm_process_work+0x26/0x150 [ib_cm] [272843.999487] [a01b4183] ? cm_work_handler+0xa83/0x161c [ib_cm] [272843.999515] [81083a82] ? process_one_work+0x182/0x450 [272843.999540] [81084871] ? worker_thread+0x121/0x410 [272843.999565] [81084750] ? rescuer_thread+0x430/0x430 [272843.999590] [8108b5b2] ? kthread+0xd2/0xf0 [272843.999615] [8108b4e0] ? kthread_create_on_node+0x1c0/0x1c0 [272843.999641] [8173258c] ? ret_from_fork+0x7c/0xb0 [272843.999666] [8108b4e0] ? kthread_create_on_node+0x1c0/0x1c0 [272843.999691] Code: Bad RIP value. [272843.999721] RIP [a03840b7] 0xa03840b7 [272843.999749] RSP 880802523c28 [272843.999770] CR2: a03840b7 I got also this one (looks the same): [ 479.240278] BUG: unable to handle kernel paging request at a04af0b7 [ 479.240453] IP: [a04af0b7] 0xa04af0b7 [ 479.240572] PGD 1c11067 PUD 1c12063 PMD 80bccf067 PTE 0 [ 479.240849] Oops: 0010 [#1] SMP [ 479.241014] Modules linked in: ip6table_filter ip6_tables iptable_filter ip_tables ebtable_nat ebtables x_ [ 479.245546] [ 479.245603] CPU: 2 PID: 257 Comm: kworker/2:1 Not tainted 3.13.0-49-generic #81-Ubuntu [ 479.245668] Hardware name: HP ProLiant DL360e Gen8, BIOS P73 11/12/2013 [ 479.245734] Workqueue: ib_cm cm_work_handler [ib_cm] [ 479.245847] task: 880811ad6000 ti: 88081142 task.ti: 88081142 [
[Kernel-packages] [Bug 1443648] Re: Kernel panics on iSER (iscsi over IB) logouts
** Changed in: linux (Ubuntu Trusty) Status: In Progress = Fix Committed -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1443648 Title: Kernel panics on iSER (iscsi over IB) logouts Status in linux package in Ubuntu: Invalid Status in linux source package in Trusty: Fix Committed Bug description: SRU Justification: Impact: After iSER was fixed by LP: #1409904 iscsi logouts cause panics. Fix: Upstream development and devel bisection between 3.13 and 3.16. Testcase: To use iSER and shut down the open-iscsi daemon (comment #8). - While shutting down the open-iscsi daemon (with an iSER mapped volume from other host) I'm getting the following kernel panic for kernel 3.13.0-49: [272820.948946] scsi15 : iSCSI Initiator over iSER [272843.474551] sd 14:0:0:1: [sdc] Synchronizing SCSI cache [272843.998231] BUG: unable to handle kernel paging request at a03840b7 [272843.998258] IP: [a03840b7] 0xa03840b7 [272843.998278] PGD 1c11067 PUD 1c12063 PMD 80afb5067 PTE 0 [272843.998306] Oops: 0010 [#1] SMP [272843.998324] Modules linked in: rdma_ucm ib_ucm ib_srp scsi_transport_srp scsi_tgt ib_srpt ib_mthca ib_ipa [272843.998742] CPU: 1 PID: 32399 Comm: kworker/1:0 Not tainted 3.13.0-49-generic #81-Ubuntu [272843.998758] Hardware name: HP ProLiant DL360e Gen8, BIOS P73 11/12/2013 [272843.998774] Workqueue: ib_cm cm_work_handler [ib_cm] [272843.998789] task: 88080b72c800 ti: 880802522000 task.ti: 880802522000 [272843.998827] RIP: 0010:[a03840b7] [a03840b7] 0xa03840b7 [272843.998870] RSP: 0018:880802523c28 EFLAGS: 00010296 [272843.998893] RAX: 8800b851d801 RBX: 8807af8482b8 RCX: 00018028 [272843.998929] RDX: 00018029 RSI: 8028 RDI: 88081f003900 [272843.998965] RBP: 880802523c30 R08: R09: 0001 [272843.999002] R10: ea0002e14740 R11: a00e0b9a R12: 88080953e400 [272843.999038] R13: 8807af8482b8 R14: 88080953e400 R15: [272843.999075] FS: () GS:88083f42() knlGS: [272843.999113] CS: 0010 DS: ES: CR0: 80050033 [272843.999136] CR2: a03840b7 CR3: 0008024f1000 CR4: 000407e0 [272843.999173] Stack: [272843.999191] 8807af54 880802523c60 a0386425 8807af8482b8 [272843.999245] 88080953e400 88080acf9fa8 880802523cf0 880802523ca0 [272843.999297] a0384f58 810aacc4 8807af8482b8 8807af8482d0 [272843.999349] Call Trace: [272843.999378] [810aacc4] ? __wake_up+0x44/0x50 [272843.999406] [a03c436b] ? cma_comp_exch+0x4b/0x60 [rdma_cm] [272843.999432] [a03c6429] ? cma_ib_handler+0xf9/0x230 [rdma_cm] [272843.999460] [a01b2166] ? cm_process_work+0x26/0x150 [ib_cm] [272843.999487] [a01b4183] ? cm_work_handler+0xa83/0x161c [ib_cm] [272843.999515] [81083a82] ? process_one_work+0x182/0x450 [272843.999540] [81084871] ? worker_thread+0x121/0x410 [272843.999565] [81084750] ? rescuer_thread+0x430/0x430 [272843.999590] [8108b5b2] ? kthread+0xd2/0xf0 [272843.999615] [8108b4e0] ? kthread_create_on_node+0x1c0/0x1c0 [272843.999641] [8173258c] ? ret_from_fork+0x7c/0xb0 [272843.999666] [8108b4e0] ? kthread_create_on_node+0x1c0/0x1c0 [272843.999691] Code: Bad RIP value. [272843.999721] RIP [a03840b7] 0xa03840b7 [272843.999749] RSP 880802523c28 [272843.999770] CR2: a03840b7 I got also this one (looks the same): [ 479.240278] BUG: unable to handle kernel paging request at a04af0b7 [ 479.240453] IP: [a04af0b7] 0xa04af0b7 [ 479.240572] PGD 1c11067 PUD 1c12063 PMD 80bccf067 PTE 0 [ 479.240849] Oops: 0010 [#1] SMP [ 479.241014] Modules linked in: ip6table_filter ip6_tables iptable_filter ip_tables ebtable_nat ebtables x_ [ 479.245546] [ 479.245603] CPU: 2 PID: 257 Comm: kworker/2:1 Not tainted 3.13.0-49-generic #81-Ubuntu [ 479.245668] Hardware name: HP ProLiant DL360e Gen8, BIOS P73 11/12/2013 [ 479.245734] Workqueue: ib_cm cm_work_handler [ib_cm] [ 479.245847] task: 880811ad6000 ti: 88081142 task.ti: 88081142 [ 479.245923] RIP: 0010:[a04af0b7] [a04af0b7] 0xa04af0b7 [ 479.246065] RSP: 0018:880811421c28 EFLAGS: 00010296 [ 479.246138] RAX: 8807f6d85501 RBX: 8807e613a2b8 RCX: 00018029 [ 479.246212] RDX: 0001802a RSI: 8029 RDI: 88081f003900 [ 479.246287] RBP: 880811421c30 R08: R09: 0001 [ 479.246361] R10: ea001fdb6140 R11: a00f7b9a
[Kernel-packages] [Bug 1443648] Re: Kernel panics on iSER (iscsi over IB) logouts
** Changed in: linux (Ubuntu Trusty) Assignee: (unassigned) = Rafael David Tinoco (inaddy) ** Changed in: linux (Ubuntu) Assignee: Rafael David Tinoco (inaddy) = (unassigned) ** Changed in: linux (Ubuntu Trusty) Status: New = In Progress ** Changed in: linux (Ubuntu) Status: Confirmed = Invalid -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1443648 Title: Kernel panics on iSER (iscsi over IB) logouts Status in linux package in Ubuntu: Invalid Status in linux source package in Trusty: In Progress Bug description: While shutting down the open-iscsi daemon (with an iSER mapped volume from other host) I'm getting the following kernel panic for kernel 3.13.0-49: [272820.948946] scsi15 : iSCSI Initiator over iSER [272843.474551] sd 14:0:0:1: [sdc] Synchronizing SCSI cache [272843.998231] BUG: unable to handle kernel paging request at a03840b7 [272843.998258] IP: [a03840b7] 0xa03840b7 [272843.998278] PGD 1c11067 PUD 1c12063 PMD 80afb5067 PTE 0 [272843.998306] Oops: 0010 [#1] SMP [272843.998324] Modules linked in: rdma_ucm ib_ucm ib_srp scsi_transport_srp scsi_tgt ib_srpt ib_mthca ib_ipa [272843.998742] CPU: 1 PID: 32399 Comm: kworker/1:0 Not tainted 3.13.0-49-generic #81-Ubuntu [272843.998758] Hardware name: HP ProLiant DL360e Gen8, BIOS P73 11/12/2013 [272843.998774] Workqueue: ib_cm cm_work_handler [ib_cm] [272843.998789] task: 88080b72c800 ti: 880802522000 task.ti: 880802522000 [272843.998827] RIP: 0010:[a03840b7] [a03840b7] 0xa03840b7 [272843.998870] RSP: 0018:880802523c28 EFLAGS: 00010296 [272843.998893] RAX: 8800b851d801 RBX: 8807af8482b8 RCX: 00018028 [272843.998929] RDX: 00018029 RSI: 8028 RDI: 88081f003900 [272843.998965] RBP: 880802523c30 R08: R09: 0001 [272843.999002] R10: ea0002e14740 R11: a00e0b9a R12: 88080953e400 [272843.999038] R13: 8807af8482b8 R14: 88080953e400 R15: [272843.999075] FS: () GS:88083f42() knlGS: [272843.999113] CS: 0010 DS: ES: CR0: 80050033 [272843.999136] CR2: a03840b7 CR3: 0008024f1000 CR4: 000407e0 [272843.999173] Stack: [272843.999191] 8807af54 880802523c60 a0386425 8807af8482b8 [272843.999245] 88080953e400 88080acf9fa8 880802523cf0 880802523ca0 [272843.999297] a0384f58 810aacc4 8807af8482b8 8807af8482d0 [272843.999349] Call Trace: [272843.999378] [810aacc4] ? __wake_up+0x44/0x50 [272843.999406] [a03c436b] ? cma_comp_exch+0x4b/0x60 [rdma_cm] [272843.999432] [a03c6429] ? cma_ib_handler+0xf9/0x230 [rdma_cm] [272843.999460] [a01b2166] ? cm_process_work+0x26/0x150 [ib_cm] [272843.999487] [a01b4183] ? cm_work_handler+0xa83/0x161c [ib_cm] [272843.999515] [81083a82] ? process_one_work+0x182/0x450 [272843.999540] [81084871] ? worker_thread+0x121/0x410 [272843.999565] [81084750] ? rescuer_thread+0x430/0x430 [272843.999590] [8108b5b2] ? kthread+0xd2/0xf0 [272843.999615] [8108b4e0] ? kthread_create_on_node+0x1c0/0x1c0 [272843.999641] [8173258c] ? ret_from_fork+0x7c/0xb0 [272843.999666] [8108b4e0] ? kthread_create_on_node+0x1c0/0x1c0 [272843.999691] Code: Bad RIP value. [272843.999721] RIP [a03840b7] 0xa03840b7 [272843.999749] RSP 880802523c28 [272843.999770] CR2: a03840b7 I got also this one (looks the same): [ 479.240278] BUG: unable to handle kernel paging request at a04af0b7 [ 479.240453] IP: [a04af0b7] 0xa04af0b7 [ 479.240572] PGD 1c11067 PUD 1c12063 PMD 80bccf067 PTE 0 [ 479.240849] Oops: 0010 [#1] SMP [ 479.241014] Modules linked in: ip6table_filter ip6_tables iptable_filter ip_tables ebtable_nat ebtables x_ [ 479.245546] [ 479.245603] CPU: 2 PID: 257 Comm: kworker/2:1 Not tainted 3.13.0-49-generic #81-Ubuntu [ 479.245668] Hardware name: HP ProLiant DL360e Gen8, BIOS P73 11/12/2013 [ 479.245734] Workqueue: ib_cm cm_work_handler [ib_cm] [ 479.245847] task: 880811ad6000 ti: 88081142 task.ti: 88081142 [ 479.245923] RIP: 0010:[a04af0b7] [a04af0b7] 0xa04af0b7 [ 479.246065] RSP: 0018:880811421c28 EFLAGS: 00010296 [ 479.246138] RAX: 8807f6d85501 RBX: 8807e613a2b8 RCX: 00018029 [ 479.246212] RDX: 0001802a RSI: 8029 RDI: 88081f003900 [ 479.246287] RBP: 880811421c30 R08: R09: 0001 [ 479.246361] R10: ea001fdb6140 R11: a00f7b9a R12: 8807e6238c00 [
[Kernel-packages] [Bug 1443648] Re: Kernel panics on iSER (iscsi over IB) logouts
** Description changed: + SRU Justification: + + Impact: After iSER was fixed by LP: #1409904 iscsi logouts cause panics. + Fix: Upstream development and devel bisection between 3.13 and 3.16. + Testcase: To use iSER and shut down the open-iscsi daemon (comment #8). + + - + While shutting down the open-iscsi daemon (with an iSER mapped volume from other host) I'm getting the following kernel panic for kernel 3.13.0-49: [272820.948946] scsi15 : iSCSI Initiator over iSER [272843.474551] sd 14:0:0:1: [sdc] Synchronizing SCSI cache [272843.998231] BUG: unable to handle kernel paging request at a03840b7 [272843.998258] IP: [a03840b7] 0xa03840b7 [272843.998278] PGD 1c11067 PUD 1c12063 PMD 80afb5067 PTE 0 [272843.998306] Oops: 0010 [#1] SMP [272843.998324] Modules linked in: rdma_ucm ib_ucm ib_srp scsi_transport_srp scsi_tgt ib_srpt ib_mthca ib_ipa [272843.998742] CPU: 1 PID: 32399 Comm: kworker/1:0 Not tainted 3.13.0-49-generic #81-Ubuntu [272843.998758] Hardware name: HP ProLiant DL360e Gen8, BIOS P73 11/12/2013 [272843.998774] Workqueue: ib_cm cm_work_handler [ib_cm] [272843.998789] task: 88080b72c800 ti: 880802522000 task.ti: 880802522000 [272843.998827] RIP: 0010:[a03840b7] [a03840b7] 0xa03840b7 [272843.998870] RSP: 0018:880802523c28 EFLAGS: 00010296 [272843.998893] RAX: 8800b851d801 RBX: 8807af8482b8 RCX: 00018028 [272843.998929] RDX: 00018029 RSI: 8028 RDI: 88081f003900 [272843.998965] RBP: 880802523c30 R08: R09: 0001 [272843.999002] R10: ea0002e14740 R11: a00e0b9a R12: 88080953e400 [272843.999038] R13: 8807af8482b8 R14: 88080953e400 R15: [272843.999075] FS: () GS:88083f42() knlGS: [272843.999113] CS: 0010 DS: ES: CR0: 80050033 [272843.999136] CR2: a03840b7 CR3: 0008024f1000 CR4: 000407e0 [272843.999173] Stack: [272843.999191] 8807af54 880802523c60 a0386425 8807af8482b8 [272843.999245] 88080953e400 88080acf9fa8 880802523cf0 880802523ca0 [272843.999297] a0384f58 810aacc4 8807af8482b8 8807af8482d0 [272843.999349] Call Trace: [272843.999378] [810aacc4] ? __wake_up+0x44/0x50 [272843.999406] [a03c436b] ? cma_comp_exch+0x4b/0x60 [rdma_cm] [272843.999432] [a03c6429] ? cma_ib_handler+0xf9/0x230 [rdma_cm] [272843.999460] [a01b2166] ? cm_process_work+0x26/0x150 [ib_cm] [272843.999487] [a01b4183] ? cm_work_handler+0xa83/0x161c [ib_cm] [272843.999515] [81083a82] ? process_one_work+0x182/0x450 [272843.999540] [81084871] ? worker_thread+0x121/0x410 [272843.999565] [81084750] ? rescuer_thread+0x430/0x430 [272843.999590] [8108b5b2] ? kthread+0xd2/0xf0 [272843.999615] [8108b4e0] ? kthread_create_on_node+0x1c0/0x1c0 [272843.999641] [8173258c] ? ret_from_fork+0x7c/0xb0 [272843.999666] [8108b4e0] ? kthread_create_on_node+0x1c0/0x1c0 [272843.999691] Code: Bad RIP value. [272843.999721] RIP [a03840b7] 0xa03840b7 [272843.999749] RSP 880802523c28 [272843.999770] CR2: a03840b7 I got also this one (looks the same): [ 479.240278] BUG: unable to handle kernel paging request at a04af0b7 [ 479.240453] IP: [a04af0b7] 0xa04af0b7 [ 479.240572] PGD 1c11067 PUD 1c12063 PMD 80bccf067 PTE 0 [ 479.240849] Oops: 0010 [#1] SMP [ 479.241014] Modules linked in: ip6table_filter ip6_tables iptable_filter ip_tables ebtable_nat ebtables x_ [ 479.245546] [ 479.245603] CPU: 2 PID: 257 Comm: kworker/2:1 Not tainted 3.13.0-49-generic #81-Ubuntu [ 479.245668] Hardware name: HP ProLiant DL360e Gen8, BIOS P73 11/12/2013 [ 479.245734] Workqueue: ib_cm cm_work_handler [ib_cm] [ 479.245847] task: 880811ad6000 ti: 88081142 task.ti: 88081142 [ 479.245923] RIP: 0010:[a04af0b7] [a04af0b7] 0xa04af0b7 [ 479.246065] RSP: 0018:880811421c28 EFLAGS: 00010296 [ 479.246138] RAX: 8807f6d85501 RBX: 8807e613a2b8 RCX: 00018029 [ 479.246212] RDX: 0001802a RSI: 8029 RDI: 88081f003900 [ 479.246287] RBP: 880811421c30 R08: R09: 0001 [ 479.246361] R10: ea001fdb6140 R11: a00f7b9a R12: 8807e6238c00 [ 479.246435] R13: 8807e613a2b8 R14: 8807e6238c00 R15: [ 479.246510] FS: () GS:88083f44() knlGS: [ 479.246597] CS: 0010 DS: ES: CR0: 80050033 [ 479.246669] CR2: a04af0b7 CR3: 000811549000 CR4: 000407e0 [ 479.246743] Stack: [
[Kernel-packages] [Bug 1443648] Re: Kernel panics on iSER (iscsi over IB) logouts
Proposed this fix to kernel team mailing list. Waiting on SRU. -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1443648 Title: Kernel panics on iSER (iscsi over IB) logouts Status in linux package in Ubuntu: Invalid Status in linux source package in Trusty: In Progress Bug description: SRU Justification: Impact: After iSER was fixed by LP: #1409904 iscsi logouts cause panics. Fix: Upstream development and devel bisection between 3.13 and 3.16. Testcase: To use iSER and shut down the open-iscsi daemon (comment #8). - While shutting down the open-iscsi daemon (with an iSER mapped volume from other host) I'm getting the following kernel panic for kernel 3.13.0-49: [272820.948946] scsi15 : iSCSI Initiator over iSER [272843.474551] sd 14:0:0:1: [sdc] Synchronizing SCSI cache [272843.998231] BUG: unable to handle kernel paging request at a03840b7 [272843.998258] IP: [a03840b7] 0xa03840b7 [272843.998278] PGD 1c11067 PUD 1c12063 PMD 80afb5067 PTE 0 [272843.998306] Oops: 0010 [#1] SMP [272843.998324] Modules linked in: rdma_ucm ib_ucm ib_srp scsi_transport_srp scsi_tgt ib_srpt ib_mthca ib_ipa [272843.998742] CPU: 1 PID: 32399 Comm: kworker/1:0 Not tainted 3.13.0-49-generic #81-Ubuntu [272843.998758] Hardware name: HP ProLiant DL360e Gen8, BIOS P73 11/12/2013 [272843.998774] Workqueue: ib_cm cm_work_handler [ib_cm] [272843.998789] task: 88080b72c800 ti: 880802522000 task.ti: 880802522000 [272843.998827] RIP: 0010:[a03840b7] [a03840b7] 0xa03840b7 [272843.998870] RSP: 0018:880802523c28 EFLAGS: 00010296 [272843.998893] RAX: 8800b851d801 RBX: 8807af8482b8 RCX: 00018028 [272843.998929] RDX: 00018029 RSI: 8028 RDI: 88081f003900 [272843.998965] RBP: 880802523c30 R08: R09: 0001 [272843.999002] R10: ea0002e14740 R11: a00e0b9a R12: 88080953e400 [272843.999038] R13: 8807af8482b8 R14: 88080953e400 R15: [272843.999075] FS: () GS:88083f42() knlGS: [272843.999113] CS: 0010 DS: ES: CR0: 80050033 [272843.999136] CR2: a03840b7 CR3: 0008024f1000 CR4: 000407e0 [272843.999173] Stack: [272843.999191] 8807af54 880802523c60 a0386425 8807af8482b8 [272843.999245] 88080953e400 88080acf9fa8 880802523cf0 880802523ca0 [272843.999297] a0384f58 810aacc4 8807af8482b8 8807af8482d0 [272843.999349] Call Trace: [272843.999378] [810aacc4] ? __wake_up+0x44/0x50 [272843.999406] [a03c436b] ? cma_comp_exch+0x4b/0x60 [rdma_cm] [272843.999432] [a03c6429] ? cma_ib_handler+0xf9/0x230 [rdma_cm] [272843.999460] [a01b2166] ? cm_process_work+0x26/0x150 [ib_cm] [272843.999487] [a01b4183] ? cm_work_handler+0xa83/0x161c [ib_cm] [272843.999515] [81083a82] ? process_one_work+0x182/0x450 [272843.999540] [81084871] ? worker_thread+0x121/0x410 [272843.999565] [81084750] ? rescuer_thread+0x430/0x430 [272843.999590] [8108b5b2] ? kthread+0xd2/0xf0 [272843.999615] [8108b4e0] ? kthread_create_on_node+0x1c0/0x1c0 [272843.999641] [8173258c] ? ret_from_fork+0x7c/0xb0 [272843.999666] [8108b4e0] ? kthread_create_on_node+0x1c0/0x1c0 [272843.999691] Code: Bad RIP value. [272843.999721] RIP [a03840b7] 0xa03840b7 [272843.999749] RSP 880802523c28 [272843.999770] CR2: a03840b7 I got also this one (looks the same): [ 479.240278] BUG: unable to handle kernel paging request at a04af0b7 [ 479.240453] IP: [a04af0b7] 0xa04af0b7 [ 479.240572] PGD 1c11067 PUD 1c12063 PMD 80bccf067 PTE 0 [ 479.240849] Oops: 0010 [#1] SMP [ 479.241014] Modules linked in: ip6table_filter ip6_tables iptable_filter ip_tables ebtable_nat ebtables x_ [ 479.245546] [ 479.245603] CPU: 2 PID: 257 Comm: kworker/2:1 Not tainted 3.13.0-49-generic #81-Ubuntu [ 479.245668] Hardware name: HP ProLiant DL360e Gen8, BIOS P73 11/12/2013 [ 479.245734] Workqueue: ib_cm cm_work_handler [ib_cm] [ 479.245847] task: 880811ad6000 ti: 88081142 task.ti: 88081142 [ 479.245923] RIP: 0010:[a04af0b7] [a04af0b7] 0xa04af0b7 [ 479.246065] RSP: 0018:880811421c28 EFLAGS: 00010296 [ 479.246138] RAX: 8807f6d85501 RBX: 8807e613a2b8 RCX: 00018029 [ 479.246212] RDX: 0001802a RSI: 8029 RDI: 88081f003900 [ 479.246287] RBP: 880811421c30 R08: R09: 0001 [ 479.246361] R10: ea001fdb6140 R11: a00f7b9a R12: 8807e6238c00
[Kernel-packages] [Bug 1443648] Re: Kernel panics on iSER (iscsi over IB) logouts
** Also affects: linux (Ubuntu Trusty) Importance: Undecided Status: New ** Changed in: linux (Ubuntu Trusty) Milestone: None = ubuntu-14.04.3 -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1443648 Title: Kernel panics on iSER (iscsi over IB) logouts Status in linux package in Ubuntu: Confirmed Status in linux source package in Trusty: New Bug description: While shutting down the open-iscsi daemon (with an iSER mapped volume from other host) I'm getting the following kernel panic for kernel 3.13.0-49: [272820.948946] scsi15 : iSCSI Initiator over iSER [272843.474551] sd 14:0:0:1: [sdc] Synchronizing SCSI cache [272843.998231] BUG: unable to handle kernel paging request at a03840b7 [272843.998258] IP: [a03840b7] 0xa03840b7 [272843.998278] PGD 1c11067 PUD 1c12063 PMD 80afb5067 PTE 0 [272843.998306] Oops: 0010 [#1] SMP [272843.998324] Modules linked in: rdma_ucm ib_ucm ib_srp scsi_transport_srp scsi_tgt ib_srpt ib_mthca ib_ipa [272843.998742] CPU: 1 PID: 32399 Comm: kworker/1:0 Not tainted 3.13.0-49-generic #81-Ubuntu [272843.998758] Hardware name: HP ProLiant DL360e Gen8, BIOS P73 11/12/2013 [272843.998774] Workqueue: ib_cm cm_work_handler [ib_cm] [272843.998789] task: 88080b72c800 ti: 880802522000 task.ti: 880802522000 [272843.998827] RIP: 0010:[a03840b7] [a03840b7] 0xa03840b7 [272843.998870] RSP: 0018:880802523c28 EFLAGS: 00010296 [272843.998893] RAX: 8800b851d801 RBX: 8807af8482b8 RCX: 00018028 [272843.998929] RDX: 00018029 RSI: 8028 RDI: 88081f003900 [272843.998965] RBP: 880802523c30 R08: R09: 0001 [272843.999002] R10: ea0002e14740 R11: a00e0b9a R12: 88080953e400 [272843.999038] R13: 8807af8482b8 R14: 88080953e400 R15: [272843.999075] FS: () GS:88083f42() knlGS: [272843.999113] CS: 0010 DS: ES: CR0: 80050033 [272843.999136] CR2: a03840b7 CR3: 0008024f1000 CR4: 000407e0 [272843.999173] Stack: [272843.999191] 8807af54 880802523c60 a0386425 8807af8482b8 [272843.999245] 88080953e400 88080acf9fa8 880802523cf0 880802523ca0 [272843.999297] a0384f58 810aacc4 8807af8482b8 8807af8482d0 [272843.999349] Call Trace: [272843.999378] [810aacc4] ? __wake_up+0x44/0x50 [272843.999406] [a03c436b] ? cma_comp_exch+0x4b/0x60 [rdma_cm] [272843.999432] [a03c6429] ? cma_ib_handler+0xf9/0x230 [rdma_cm] [272843.999460] [a01b2166] ? cm_process_work+0x26/0x150 [ib_cm] [272843.999487] [a01b4183] ? cm_work_handler+0xa83/0x161c [ib_cm] [272843.999515] [81083a82] ? process_one_work+0x182/0x450 [272843.999540] [81084871] ? worker_thread+0x121/0x410 [272843.999565] [81084750] ? rescuer_thread+0x430/0x430 [272843.999590] [8108b5b2] ? kthread+0xd2/0xf0 [272843.999615] [8108b4e0] ? kthread_create_on_node+0x1c0/0x1c0 [272843.999641] [8173258c] ? ret_from_fork+0x7c/0xb0 [272843.999666] [8108b4e0] ? kthread_create_on_node+0x1c0/0x1c0 [272843.999691] Code: Bad RIP value. [272843.999721] RIP [a03840b7] 0xa03840b7 [272843.999749] RSP 880802523c28 [272843.999770] CR2: a03840b7 I got also this one (looks the same): [ 479.240278] BUG: unable to handle kernel paging request at a04af0b7 [ 479.240453] IP: [a04af0b7] 0xa04af0b7 [ 479.240572] PGD 1c11067 PUD 1c12063 PMD 80bccf067 PTE 0 [ 479.240849] Oops: 0010 [#1] SMP [ 479.241014] Modules linked in: ip6table_filter ip6_tables iptable_filter ip_tables ebtable_nat ebtables x_ [ 479.245546] [ 479.245603] CPU: 2 PID: 257 Comm: kworker/2:1 Not tainted 3.13.0-49-generic #81-Ubuntu [ 479.245668] Hardware name: HP ProLiant DL360e Gen8, BIOS P73 11/12/2013 [ 479.245734] Workqueue: ib_cm cm_work_handler [ib_cm] [ 479.245847] task: 880811ad6000 ti: 88081142 task.ti: 88081142 [ 479.245923] RIP: 0010:[a04af0b7] [a04af0b7] 0xa04af0b7 [ 479.246065] RSP: 0018:880811421c28 EFLAGS: 00010296 [ 479.246138] RAX: 8807f6d85501 RBX: 8807e613a2b8 RCX: 00018029 [ 479.246212] RDX: 0001802a RSI: 8029 RDI: 88081f003900 [ 479.246287] RBP: 880811421c30 R08: R09: 0001 [ 479.246361] R10: ea001fdb6140 R11: a00f7b9a R12: 8807e6238c00 [ 479.246435] R13: 8807e613a2b8 R14: 8807e6238c00 R15: [ 479.246510] FS: () GS:88083f44() knlGS:
[Kernel-packages] [Bug 1443648] Re: Kernel panics on iSER (iscsi over IB) logouts
Anyone can use the following PPA for hotfixed 3.13 (Trusty) kernel for x86/x64: https://launchpad.net/~inaddy/+archive/ubuntu/lp1443648-x64 And the following PPA for hotfixed kernel for arm64 (moonshot): https://launchpad.net/~inaddy/+archive/ubuntu/lp1443648-arm64 These PPAs should be used for any Trusty machine being an iSER (iSCSI over IB) client. PLEASE - provide feedback for these kernels so I can ask kernel team to SRU my backport. OBS: I had to deal with some conflicts when backporting code from 3.16 to 3.13. I already tested myself and it looks okay but I'll stress test the 3.13 iSER code a bit more. -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1443648 Title: Kernel panics on iSER (iscsi over IB) logouts Status in linux package in Ubuntu: Confirmed Bug description: While shutting down the open-iscsi daemon (with an iSER mapped volume from other host) I'm getting the following kernel panic for kernel 3.13.0-49: [272820.948946] scsi15 : iSCSI Initiator over iSER [272843.474551] sd 14:0:0:1: [sdc] Synchronizing SCSI cache [272843.998231] BUG: unable to handle kernel paging request at a03840b7 [272843.998258] IP: [a03840b7] 0xa03840b7 [272843.998278] PGD 1c11067 PUD 1c12063 PMD 80afb5067 PTE 0 [272843.998306] Oops: 0010 [#1] SMP [272843.998324] Modules linked in: rdma_ucm ib_ucm ib_srp scsi_transport_srp scsi_tgt ib_srpt ib_mthca ib_ipa [272843.998742] CPU: 1 PID: 32399 Comm: kworker/1:0 Not tainted 3.13.0-49-generic #81-Ubuntu [272843.998758] Hardware name: HP ProLiant DL360e Gen8, BIOS P73 11/12/2013 [272843.998774] Workqueue: ib_cm cm_work_handler [ib_cm] [272843.998789] task: 88080b72c800 ti: 880802522000 task.ti: 880802522000 [272843.998827] RIP: 0010:[a03840b7] [a03840b7] 0xa03840b7 [272843.998870] RSP: 0018:880802523c28 EFLAGS: 00010296 [272843.998893] RAX: 8800b851d801 RBX: 8807af8482b8 RCX: 00018028 [272843.998929] RDX: 00018029 RSI: 8028 RDI: 88081f003900 [272843.998965] RBP: 880802523c30 R08: R09: 0001 [272843.999002] R10: ea0002e14740 R11: a00e0b9a R12: 88080953e400 [272843.999038] R13: 8807af8482b8 R14: 88080953e400 R15: [272843.999075] FS: () GS:88083f42() knlGS: [272843.999113] CS: 0010 DS: ES: CR0: 80050033 [272843.999136] CR2: a03840b7 CR3: 0008024f1000 CR4: 000407e0 [272843.999173] Stack: [272843.999191] 8807af54 880802523c60 a0386425 8807af8482b8 [272843.999245] 88080953e400 88080acf9fa8 880802523cf0 880802523ca0 [272843.999297] a0384f58 810aacc4 8807af8482b8 8807af8482d0 [272843.999349] Call Trace: [272843.999378] [810aacc4] ? __wake_up+0x44/0x50 [272843.999406] [a03c436b] ? cma_comp_exch+0x4b/0x60 [rdma_cm] [272843.999432] [a03c6429] ? cma_ib_handler+0xf9/0x230 [rdma_cm] [272843.999460] [a01b2166] ? cm_process_work+0x26/0x150 [ib_cm] [272843.999487] [a01b4183] ? cm_work_handler+0xa83/0x161c [ib_cm] [272843.999515] [81083a82] ? process_one_work+0x182/0x450 [272843.999540] [81084871] ? worker_thread+0x121/0x410 [272843.999565] [81084750] ? rescuer_thread+0x430/0x430 [272843.999590] [8108b5b2] ? kthread+0xd2/0xf0 [272843.999615] [8108b4e0] ? kthread_create_on_node+0x1c0/0x1c0 [272843.999641] [8173258c] ? ret_from_fork+0x7c/0xb0 [272843.999666] [8108b4e0] ? kthread_create_on_node+0x1c0/0x1c0 [272843.999691] Code: Bad RIP value. [272843.999721] RIP [a03840b7] 0xa03840b7 [272843.999749] RSP 880802523c28 [272843.999770] CR2: a03840b7 I got also this one (looks the same): [ 479.240278] BUG: unable to handle kernel paging request at a04af0b7 [ 479.240453] IP: [a04af0b7] 0xa04af0b7 [ 479.240572] PGD 1c11067 PUD 1c12063 PMD 80bccf067 PTE 0 [ 479.240849] Oops: 0010 [#1] SMP [ 479.241014] Modules linked in: ip6table_filter ip6_tables iptable_filter ip_tables ebtable_nat ebtables x_ [ 479.245546] [ 479.245603] CPU: 2 PID: 257 Comm: kworker/2:1 Not tainted 3.13.0-49-generic #81-Ubuntu [ 479.245668] Hardware name: HP ProLiant DL360e Gen8, BIOS P73 11/12/2013 [ 479.245734] Workqueue: ib_cm cm_work_handler [ib_cm] [ 479.245847] task: 880811ad6000 ti: 88081142 task.ti: 88081142 [ 479.245923] RIP: 0010:[a04af0b7] [a04af0b7] 0xa04af0b7 [ 479.246065] RSP: 0018:880811421c28 EFLAGS: 00010296 [ 479.246138] RAX: 8807f6d85501 RBX: 8807e613a2b8 RCX: 00018029 [
[Kernel-packages] [Bug 1443648] Re: Kernel panics on iSER (iscsi over IB) logouts
I have backported this fix to 3.13 (attached as a .patch for review if anyone is willing to). Will do more tests, provide PPA for feedback for hopefully will ask kernel team for SRU. ** Patch added: 0001-iSER-relies-on-refcounting-to-manage-iser-connection.patch https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1443648/+attachment/4383207/+files/0001-iSER-relies-on-refcounting-to-manage-iser-connection.patch -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1443648 Title: Kernel panics on iSER (iscsi over IB) logouts Status in linux package in Ubuntu: Confirmed Bug description: While shutting down the open-iscsi daemon (with an iSER mapped volume from other host) I'm getting the following kernel panic for kernel 3.13.0-49: [272820.948946] scsi15 : iSCSI Initiator over iSER [272843.474551] sd 14:0:0:1: [sdc] Synchronizing SCSI cache [272843.998231] BUG: unable to handle kernel paging request at a03840b7 [272843.998258] IP: [a03840b7] 0xa03840b7 [272843.998278] PGD 1c11067 PUD 1c12063 PMD 80afb5067 PTE 0 [272843.998306] Oops: 0010 [#1] SMP [272843.998324] Modules linked in: rdma_ucm ib_ucm ib_srp scsi_transport_srp scsi_tgt ib_srpt ib_mthca ib_ipa [272843.998742] CPU: 1 PID: 32399 Comm: kworker/1:0 Not tainted 3.13.0-49-generic #81-Ubuntu [272843.998758] Hardware name: HP ProLiant DL360e Gen8, BIOS P73 11/12/2013 [272843.998774] Workqueue: ib_cm cm_work_handler [ib_cm] [272843.998789] task: 88080b72c800 ti: 880802522000 task.ti: 880802522000 [272843.998827] RIP: 0010:[a03840b7] [a03840b7] 0xa03840b7 [272843.998870] RSP: 0018:880802523c28 EFLAGS: 00010296 [272843.998893] RAX: 8800b851d801 RBX: 8807af8482b8 RCX: 00018028 [272843.998929] RDX: 00018029 RSI: 8028 RDI: 88081f003900 [272843.998965] RBP: 880802523c30 R08: R09: 0001 [272843.999002] R10: ea0002e14740 R11: a00e0b9a R12: 88080953e400 [272843.999038] R13: 8807af8482b8 R14: 88080953e400 R15: [272843.999075] FS: () GS:88083f42() knlGS: [272843.999113] CS: 0010 DS: ES: CR0: 80050033 [272843.999136] CR2: a03840b7 CR3: 0008024f1000 CR4: 000407e0 [272843.999173] Stack: [272843.999191] 8807af54 880802523c60 a0386425 8807af8482b8 [272843.999245] 88080953e400 88080acf9fa8 880802523cf0 880802523ca0 [272843.999297] a0384f58 810aacc4 8807af8482b8 8807af8482d0 [272843.999349] Call Trace: [272843.999378] [810aacc4] ? __wake_up+0x44/0x50 [272843.999406] [a03c436b] ? cma_comp_exch+0x4b/0x60 [rdma_cm] [272843.999432] [a03c6429] ? cma_ib_handler+0xf9/0x230 [rdma_cm] [272843.999460] [a01b2166] ? cm_process_work+0x26/0x150 [ib_cm] [272843.999487] [a01b4183] ? cm_work_handler+0xa83/0x161c [ib_cm] [272843.999515] [81083a82] ? process_one_work+0x182/0x450 [272843.999540] [81084871] ? worker_thread+0x121/0x410 [272843.999565] [81084750] ? rescuer_thread+0x430/0x430 [272843.999590] [8108b5b2] ? kthread+0xd2/0xf0 [272843.999615] [8108b4e0] ? kthread_create_on_node+0x1c0/0x1c0 [272843.999641] [8173258c] ? ret_from_fork+0x7c/0xb0 [272843.999666] [8108b4e0] ? kthread_create_on_node+0x1c0/0x1c0 [272843.999691] Code: Bad RIP value. [272843.999721] RIP [a03840b7] 0xa03840b7 [272843.999749] RSP 880802523c28 [272843.999770] CR2: a03840b7 I got also this one (looks the same): [ 479.240278] BUG: unable to handle kernel paging request at a04af0b7 [ 479.240453] IP: [a04af0b7] 0xa04af0b7 [ 479.240572] PGD 1c11067 PUD 1c12063 PMD 80bccf067 PTE 0 [ 479.240849] Oops: 0010 [#1] SMP [ 479.241014] Modules linked in: ip6table_filter ip6_tables iptable_filter ip_tables ebtable_nat ebtables x_ [ 479.245546] [ 479.245603] CPU: 2 PID: 257 Comm: kworker/2:1 Not tainted 3.13.0-49-generic #81-Ubuntu [ 479.245668] Hardware name: HP ProLiant DL360e Gen8, BIOS P73 11/12/2013 [ 479.245734] Workqueue: ib_cm cm_work_handler [ib_cm] [ 479.245847] task: 880811ad6000 ti: 88081142 task.ti: 88081142 [ 479.245923] RIP: 0010:[a04af0b7] [a04af0b7] 0xa04af0b7 [ 479.246065] RSP: 0018:880811421c28 EFLAGS: 00010296 [ 479.246138] RAX: 8807f6d85501 RBX: 8807e613a2b8 RCX: 00018029 [ 479.246212] RDX: 0001802a RSI: 8029 RDI: 88081f003900 [ 479.246287] RBP: 880811421c30 R08: R09: 0001 [ 479.246361] R10: ea001fdb6140 R11:
[Kernel-packages] [Bug 1443648] Re: Kernel panics on iSER (iscsi over IB) logouts
No Kernel panics for iSER Logout at this time (with this patch): Linux dixie 3.13.11-ckt18-test01 #3 SMP Fri Apr 24 13:46:29 BRT 2015 x86_64 x86_64 x86_64 GNU/Linux root@dixie:~# iscsiadm -m discovery --op=new --op=del --type sendtargets --portal 172.16.0.1 -I iser 172.16.0.1:3260,1 iqn.2001-04.com.hertz-lunit1 root@dixie:~# iscsiadm -m node -l Logging in to [iface: iser, target: iqn.2001-04.com.hertz-lunit1, portal: 172.16.0.1,3260] (multiple) Login to [iface: iser, target: iqn.2001-04.com.hertz-lunit1, portal: 172.16.0.1,3260] successful. root@dixie:~# dd if=/dev/zero of=/dev/sdc bs=1M count=1024 oflag=direct 1024+0 records in 1024+0 records out 1073741824 bytes (1.1 GB) copied, 0.996458 s, 1.1 GB/s root@dixie:~# service open-iscsi stop * Unmounting iscsi-backed filesystems [ OK ] * Disconnecting iSCSI targets Logging out of session [sid: 5, target: iqn.2001-04.com.hertz-lunit1, portal: 172.16.0.1,3260] Logout of [sid: 5, target: iqn.2001-04.com.hertz-lunit1, portal: 172.16.0.1,3260] successful. * Stopping iSCSI initiator service [ OK ] And then again: root@dixie:~# iscsiadm -m discovery --op=new --op=del --type sendtargets --portal 172.16.0.1 -I iser 172.16.0.1:3260,1 iqn.2001-04.com.hertz-lunit1 root@dixie:~# iscsiadm -m node -l Logging in to [iface: iser, target: iqn.2001-04.com.hertz-lunit1, portal: 172.16.0.1,3260] (multiple) Login to [iface: iser, target: iqn.2001-04.com.hertz-lunit1, portal: 172.16.0.1,3260] successful. root@dixie:~# dd if=/dev/zero of=/dev/sdc bs=1M count=1024 oflag=direct 1024+0 records in 1024+0 records out 1073741824 bytes (1.1 GB) copied, 0.844185 s, 1.3 GB/s root@dixie:~# service open-iscsi stop * Unmounting iscsi-backed filesystems [ OK ] * Disconnecting iSCSI targets Logging out of session [sid: 2, target: iqn.2001-04.com.hertz-lunit1, portal: 172.16.0.1,3260] Logout of [sid: 2, target: iqn.2001-04.com.hertz-lunit1, portal: 172.16.0.1,3260] successful. * Stopping iSCSI initiator service No kernel panic again. Will do some stress testing for iSER to make sure everything is good. -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1443648 Title: Kernel panics on iSER (iscsi over IB) logouts Status in linux package in Ubuntu: Confirmed Bug description: While shutting down the open-iscsi daemon (with an iSER mapped volume from other host) I'm getting the following kernel panic for kernel 3.13.0-49: [272820.948946] scsi15 : iSCSI Initiator over iSER [272843.474551] sd 14:0:0:1: [sdc] Synchronizing SCSI cache [272843.998231] BUG: unable to handle kernel paging request at a03840b7 [272843.998258] IP: [a03840b7] 0xa03840b7 [272843.998278] PGD 1c11067 PUD 1c12063 PMD 80afb5067 PTE 0 [272843.998306] Oops: 0010 [#1] SMP [272843.998324] Modules linked in: rdma_ucm ib_ucm ib_srp scsi_transport_srp scsi_tgt ib_srpt ib_mthca ib_ipa [272843.998742] CPU: 1 PID: 32399 Comm: kworker/1:0 Not tainted 3.13.0-49-generic #81-Ubuntu [272843.998758] Hardware name: HP ProLiant DL360e Gen8, BIOS P73 11/12/2013 [272843.998774] Workqueue: ib_cm cm_work_handler [ib_cm] [272843.998789] task: 88080b72c800 ti: 880802522000 task.ti: 880802522000 [272843.998827] RIP: 0010:[a03840b7] [a03840b7] 0xa03840b7 [272843.998870] RSP: 0018:880802523c28 EFLAGS: 00010296 [272843.998893] RAX: 8800b851d801 RBX: 8807af8482b8 RCX: 00018028 [272843.998929] RDX: 00018029 RSI: 8028 RDI: 88081f003900 [272843.998965] RBP: 880802523c30 R08: R09: 0001 [272843.999002] R10: ea0002e14740 R11: a00e0b9a R12: 88080953e400 [272843.999038] R13: 8807af8482b8 R14: 88080953e400 R15: [272843.999075] FS: () GS:88083f42() knlGS: [272843.999113] CS: 0010 DS: ES: CR0: 80050033 [272843.999136] CR2: a03840b7 CR3: 0008024f1000 CR4: 000407e0 [272843.999173] Stack: [272843.999191] 8807af54 880802523c60 a0386425 8807af8482b8 [272843.999245] 88080953e400 88080acf9fa8 880802523cf0 880802523ca0 [272843.999297] a0384f58 810aacc4 8807af8482b8 8807af8482d0 [272843.999349] Call Trace: [272843.999378] [810aacc4] ? __wake_up+0x44/0x50 [272843.999406] [a03c436b] ? cma_comp_exch+0x4b/0x60 [rdma_cm] [272843.999432] [a03c6429] ? cma_ib_handler+0xf9/0x230 [rdma_cm] [272843.999460] [a01b2166] ? cm_process_work+0x26/0x150 [ib_cm] [272843.999487] [a01b4183] ? cm_work_handler+0xa83/0x161c [ib_cm]
[Kernel-packages] [Bug 1443648] Re: Kernel panics on iSER (iscsi over IB) logouts
** Tags added: patch -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1443648 Title: Kernel panics on iSER (iscsi over IB) logouts Status in linux package in Ubuntu: Confirmed Bug description: While shutting down the open-iscsi daemon (with an iSER mapped volume from other host) I'm getting the following kernel panic for kernel 3.13.0-49: [272820.948946] scsi15 : iSCSI Initiator over iSER [272843.474551] sd 14:0:0:1: [sdc] Synchronizing SCSI cache [272843.998231] BUG: unable to handle kernel paging request at a03840b7 [272843.998258] IP: [a03840b7] 0xa03840b7 [272843.998278] PGD 1c11067 PUD 1c12063 PMD 80afb5067 PTE 0 [272843.998306] Oops: 0010 [#1] SMP [272843.998324] Modules linked in: rdma_ucm ib_ucm ib_srp scsi_transport_srp scsi_tgt ib_srpt ib_mthca ib_ipa [272843.998742] CPU: 1 PID: 32399 Comm: kworker/1:0 Not tainted 3.13.0-49-generic #81-Ubuntu [272843.998758] Hardware name: HP ProLiant DL360e Gen8, BIOS P73 11/12/2013 [272843.998774] Workqueue: ib_cm cm_work_handler [ib_cm] [272843.998789] task: 88080b72c800 ti: 880802522000 task.ti: 880802522000 [272843.998827] RIP: 0010:[a03840b7] [a03840b7] 0xa03840b7 [272843.998870] RSP: 0018:880802523c28 EFLAGS: 00010296 [272843.998893] RAX: 8800b851d801 RBX: 8807af8482b8 RCX: 00018028 [272843.998929] RDX: 00018029 RSI: 8028 RDI: 88081f003900 [272843.998965] RBP: 880802523c30 R08: R09: 0001 [272843.999002] R10: ea0002e14740 R11: a00e0b9a R12: 88080953e400 [272843.999038] R13: 8807af8482b8 R14: 88080953e400 R15: [272843.999075] FS: () GS:88083f42() knlGS: [272843.999113] CS: 0010 DS: ES: CR0: 80050033 [272843.999136] CR2: a03840b7 CR3: 0008024f1000 CR4: 000407e0 [272843.999173] Stack: [272843.999191] 8807af54 880802523c60 a0386425 8807af8482b8 [272843.999245] 88080953e400 88080acf9fa8 880802523cf0 880802523ca0 [272843.999297] a0384f58 810aacc4 8807af8482b8 8807af8482d0 [272843.999349] Call Trace: [272843.999378] [810aacc4] ? __wake_up+0x44/0x50 [272843.999406] [a03c436b] ? cma_comp_exch+0x4b/0x60 [rdma_cm] [272843.999432] [a03c6429] ? cma_ib_handler+0xf9/0x230 [rdma_cm] [272843.999460] [a01b2166] ? cm_process_work+0x26/0x150 [ib_cm] [272843.999487] [a01b4183] ? cm_work_handler+0xa83/0x161c [ib_cm] [272843.999515] [81083a82] ? process_one_work+0x182/0x450 [272843.999540] [81084871] ? worker_thread+0x121/0x410 [272843.999565] [81084750] ? rescuer_thread+0x430/0x430 [272843.999590] [8108b5b2] ? kthread+0xd2/0xf0 [272843.999615] [8108b4e0] ? kthread_create_on_node+0x1c0/0x1c0 [272843.999641] [8173258c] ? ret_from_fork+0x7c/0xb0 [272843.999666] [8108b4e0] ? kthread_create_on_node+0x1c0/0x1c0 [272843.999691] Code: Bad RIP value. [272843.999721] RIP [a03840b7] 0xa03840b7 [272843.999749] RSP 880802523c28 [272843.999770] CR2: a03840b7 I got also this one (looks the same): [ 479.240278] BUG: unable to handle kernel paging request at a04af0b7 [ 479.240453] IP: [a04af0b7] 0xa04af0b7 [ 479.240572] PGD 1c11067 PUD 1c12063 PMD 80bccf067 PTE 0 [ 479.240849] Oops: 0010 [#1] SMP [ 479.241014] Modules linked in: ip6table_filter ip6_tables iptable_filter ip_tables ebtable_nat ebtables x_ [ 479.245546] [ 479.245603] CPU: 2 PID: 257 Comm: kworker/2:1 Not tainted 3.13.0-49-generic #81-Ubuntu [ 479.245668] Hardware name: HP ProLiant DL360e Gen8, BIOS P73 11/12/2013 [ 479.245734] Workqueue: ib_cm cm_work_handler [ib_cm] [ 479.245847] task: 880811ad6000 ti: 88081142 task.ti: 88081142 [ 479.245923] RIP: 0010:[a04af0b7] [a04af0b7] 0xa04af0b7 [ 479.246065] RSP: 0018:880811421c28 EFLAGS: 00010296 [ 479.246138] RAX: 8807f6d85501 RBX: 8807e613a2b8 RCX: 00018029 [ 479.246212] RDX: 0001802a RSI: 8029 RDI: 88081f003900 [ 479.246287] RBP: 880811421c30 R08: R09: 0001 [ 479.246361] R10: ea001fdb6140 R11: a00f7b9a R12: 8807e6238c00 [ 479.246435] R13: 8807e613a2b8 R14: 8807e6238c00 R15: [ 479.246510] FS: () GS:88083f44() knlGS: [ 479.246597] CS: 0010 DS: ES: CR0: 80050033 [ 479.246669] CR2: a04af0b7 CR3: 000811549000 CR4: 000407e0 [ 479.246743] Stack: [
[Kernel-packages] [Bug 1443648] Re: Kernel panics on iSER (iscsi over IB) logouts
I'll be cherry-picking/backporting needed commits to 3.13 (hopefully based on linux-stable git tree backports for 3.13 and/or 3.14). Will maintain the case updated. -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1443648 Title: Kernel panics on iSER (iscsi over IB) logouts Status in linux package in Ubuntu: Confirmed Bug description: While shutting down the open-iscsi daemon (with an iSER mapped volume from other host) I'm getting the following kernel panic for kernel 3.13.0-49: [272820.948946] scsi15 : iSCSI Initiator over iSER [272843.474551] sd 14:0:0:1: [sdc] Synchronizing SCSI cache [272843.998231] BUG: unable to handle kernel paging request at a03840b7 [272843.998258] IP: [a03840b7] 0xa03840b7 [272843.998278] PGD 1c11067 PUD 1c12063 PMD 80afb5067 PTE 0 [272843.998306] Oops: 0010 [#1] SMP [272843.998324] Modules linked in: rdma_ucm ib_ucm ib_srp scsi_transport_srp scsi_tgt ib_srpt ib_mthca ib_ipa [272843.998742] CPU: 1 PID: 32399 Comm: kworker/1:0 Not tainted 3.13.0-49-generic #81-Ubuntu [272843.998758] Hardware name: HP ProLiant DL360e Gen8, BIOS P73 11/12/2013 [272843.998774] Workqueue: ib_cm cm_work_handler [ib_cm] [272843.998789] task: 88080b72c800 ti: 880802522000 task.ti: 880802522000 [272843.998827] RIP: 0010:[a03840b7] [a03840b7] 0xa03840b7 [272843.998870] RSP: 0018:880802523c28 EFLAGS: 00010296 [272843.998893] RAX: 8800b851d801 RBX: 8807af8482b8 RCX: 00018028 [272843.998929] RDX: 00018029 RSI: 8028 RDI: 88081f003900 [272843.998965] RBP: 880802523c30 R08: R09: 0001 [272843.999002] R10: ea0002e14740 R11: a00e0b9a R12: 88080953e400 [272843.999038] R13: 8807af8482b8 R14: 88080953e400 R15: [272843.999075] FS: () GS:88083f42() knlGS: [272843.999113] CS: 0010 DS: ES: CR0: 80050033 [272843.999136] CR2: a03840b7 CR3: 0008024f1000 CR4: 000407e0 [272843.999173] Stack: [272843.999191] 8807af54 880802523c60 a0386425 8807af8482b8 [272843.999245] 88080953e400 88080acf9fa8 880802523cf0 880802523ca0 [272843.999297] a0384f58 810aacc4 8807af8482b8 8807af8482d0 [272843.999349] Call Trace: [272843.999378] [810aacc4] ? __wake_up+0x44/0x50 [272843.999406] [a03c436b] ? cma_comp_exch+0x4b/0x60 [rdma_cm] [272843.999432] [a03c6429] ? cma_ib_handler+0xf9/0x230 [rdma_cm] [272843.999460] [a01b2166] ? cm_process_work+0x26/0x150 [ib_cm] [272843.999487] [a01b4183] ? cm_work_handler+0xa83/0x161c [ib_cm] [272843.999515] [81083a82] ? process_one_work+0x182/0x450 [272843.999540] [81084871] ? worker_thread+0x121/0x410 [272843.999565] [81084750] ? rescuer_thread+0x430/0x430 [272843.999590] [8108b5b2] ? kthread+0xd2/0xf0 [272843.999615] [8108b4e0] ? kthread_create_on_node+0x1c0/0x1c0 [272843.999641] [8173258c] ? ret_from_fork+0x7c/0xb0 [272843.999666] [8108b4e0] ? kthread_create_on_node+0x1c0/0x1c0 [272843.999691] Code: Bad RIP value. [272843.999721] RIP [a03840b7] 0xa03840b7 [272843.999749] RSP 880802523c28 [272843.999770] CR2: a03840b7 I got also this one (looks the same): [ 479.240278] BUG: unable to handle kernel paging request at a04af0b7 [ 479.240453] IP: [a04af0b7] 0xa04af0b7 [ 479.240572] PGD 1c11067 PUD 1c12063 PMD 80bccf067 PTE 0 [ 479.240849] Oops: 0010 [#1] SMP [ 479.241014] Modules linked in: ip6table_filter ip6_tables iptable_filter ip_tables ebtable_nat ebtables x_ [ 479.245546] [ 479.245603] CPU: 2 PID: 257 Comm: kworker/2:1 Not tainted 3.13.0-49-generic #81-Ubuntu [ 479.245668] Hardware name: HP ProLiant DL360e Gen8, BIOS P73 11/12/2013 [ 479.245734] Workqueue: ib_cm cm_work_handler [ib_cm] [ 479.245847] task: 880811ad6000 ti: 88081142 task.ti: 88081142 [ 479.245923] RIP: 0010:[a04af0b7] [a04af0b7] 0xa04af0b7 [ 479.246065] RSP: 0018:880811421c28 EFLAGS: 00010296 [ 479.246138] RAX: 8807f6d85501 RBX: 8807e613a2b8 RCX: 00018029 [ 479.246212] RDX: 0001802a RSI: 8029 RDI: 88081f003900 [ 479.246287] RBP: 880811421c30 R08: R09: 0001 [ 479.246361] R10: ea001fdb6140 R11: a00f7b9a R12: 8807e6238c00 [ 479.246435] R13: 8807e613a2b8 R14: 8807e6238c00 R15: [ 479.246510] FS: () GS:88083f44() knlGS: [ 479.246597] CS: 0010 DS: ES:
[Kernel-packages] [Bug 1443648] Re: Kernel panics on iSER (iscsi over IB) logouts
After taking long time bisecting kernel (3.13 - 3.16) it came out that the following commit (and its dependencies) are the ones that fixes the issue: commit b73c3adabdb1e2cb2f2c69bc3cbb9306aa3f9700 Author: Ariel Nahum ari...@mellanox.com Date: Thu May 22 11:00:18 2014 +0300 IB/iser: Simplify connection management iSER relies on refcounting to manage iser connections establishment and teardown. Following commit 39ff05dbbbdb (IB/iser: Enhance disconnection logic for multi-pathing), iser connection maintain 3 references: - iscsi_endpoint (at creation stage) - cma_id (at connection request stage) - iscsi_conn (at bind stage) We can avoid taking explicit refcounts by correctly serializing iser teardown flows (graceful and non-graceful). Our approach is to trigger a scheduled work to handle ordered teardown by gracefully waiting for 2 cleanup stages to complete: 1. Cleanup of live pending tasks indicated by iscsi_conn_stop completion 2. Flush errors processing Each completed stage will notify a waiting worker thread when it is done to allow teardwon continuation. Since iSCSI connection establishment may trigger endpoint disconnect without a successful endpoint connect, we rely on the iscsi - iser binding (.conn_bind) to learn about the teardown policy we should take wrt cleanup stages. Since all cleanup worker threads are scheduled (release_wq) in .ep_disconnect it is safe to assume that when module_exit is called, all cleanup workers are already scheduled. Thus proper module unload shall flush all scheduled works before allowing safe exit, to guarantee no resources got left behind. Signed-off-by: Ariel Nahum ari...@mellanox.com Signed-off-by: Sagi Grimberg sa...@mellanox.com Reviewed-by: Roi Dayan r...@mellanox.com Reviewed-by: Or Gerlitz ogerl...@mellanox.com Signed-off-by: Roland Dreier rol...@purestorage.com -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1443648 Title: Kernel panics on iSER (iscsi over IB) logouts Status in linux package in Ubuntu: Confirmed Bug description: While shutting down the open-iscsi daemon (with an iSER mapped volume from other host) I'm getting the following kernel panic for kernel 3.13.0-49: [272820.948946] scsi15 : iSCSI Initiator over iSER [272843.474551] sd 14:0:0:1: [sdc] Synchronizing SCSI cache [272843.998231] BUG: unable to handle kernel paging request at a03840b7 [272843.998258] IP: [a03840b7] 0xa03840b7 [272843.998278] PGD 1c11067 PUD 1c12063 PMD 80afb5067 PTE 0 [272843.998306] Oops: 0010 [#1] SMP [272843.998324] Modules linked in: rdma_ucm ib_ucm ib_srp scsi_transport_srp scsi_tgt ib_srpt ib_mthca ib_ipa [272843.998742] CPU: 1 PID: 32399 Comm: kworker/1:0 Not tainted 3.13.0-49-generic #81-Ubuntu [272843.998758] Hardware name: HP ProLiant DL360e Gen8, BIOS P73 11/12/2013 [272843.998774] Workqueue: ib_cm cm_work_handler [ib_cm] [272843.998789] task: 88080b72c800 ti: 880802522000 task.ti: 880802522000 [272843.998827] RIP: 0010:[a03840b7] [a03840b7] 0xa03840b7 [272843.998870] RSP: 0018:880802523c28 EFLAGS: 00010296 [272843.998893] RAX: 8800b851d801 RBX: 8807af8482b8 RCX: 00018028 [272843.998929] RDX: 00018029 RSI: 8028 RDI: 88081f003900 [272843.998965] RBP: 880802523c30 R08: R09: 0001 [272843.999002] R10: ea0002e14740 R11: a00e0b9a R12: 88080953e400 [272843.999038] R13: 8807af8482b8 R14: 88080953e400 R15: [272843.999075] FS: () GS:88083f42() knlGS: [272843.999113] CS: 0010 DS: ES: CR0: 80050033 [272843.999136] CR2: a03840b7 CR3: 0008024f1000 CR4: 000407e0 [272843.999173] Stack: [272843.999191] 8807af54 880802523c60 a0386425 8807af8482b8 [272843.999245] 88080953e400 88080acf9fa8 880802523cf0 880802523ca0 [272843.999297] a0384f58 810aacc4 8807af8482b8 8807af8482d0 [272843.999349] Call Trace: [272843.999378] [810aacc4] ? __wake_up+0x44/0x50 [272843.999406] [a03c436b] ? cma_comp_exch+0x4b/0x60 [rdma_cm] [272843.999432] [a03c6429] ? cma_ib_handler+0xf9/0x230 [rdma_cm] [272843.999460] [a01b2166] ? cm_process_work+0x26/0x150 [ib_cm] [272843.999487] [a01b4183] ? cm_work_handler+0xa83/0x161c [ib_cm] [272843.999515] [81083a82] ? process_one_work+0x182/0x450 [272843.999540] [81084871] ? worker_thread+0x121/0x410 [272843.999565] [81084750] ? rescuer_thread+0x430/0x430 [272843.999590]
[Kernel-packages] [Bug 1443648] Re: Kernel panics on iSER (iscsi over IB) logouts
Probable commits that should be backported to 3.13: c7ca4b69d9ac8ec22f7c6b37a1ab9ac910c726cd IB/iser: Bump version to 1.4 e7eeffa4a073c9d5a4b04a64c5efb1edcb89fb11 IB/iser: Add missing newlines to logging messages 66d4e62d27875f3ae417e3b73396e290bb184b5c IB/iser: Fix a possible race in iser connection states transition b73c3adabdb1e2cb2f2c69bc3cbb9306aa3f9700 IB/iser: Simplify connection management To check if these commits are already in our kernel: OK - 9fda1ac5fa09c49e9148f85be14f55e2bb856c0f IB/iser: Fix error flow in iser_create_ib_conn_res() OK - 39ff05dbbbdb082bbabf06206c56b3cd4ef73904 IB/iser: Enhance disconnection logic for multi-pathing OK - d265b9808272c9f25e1c36d3fb5ddb466efd90e9 IB/iser: Remove buggy back-pointer setting OK - 2110f9bf37511df06220bb7e977f417baecf2950 IB/iser: Add asynchronous event handler -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1443648 Title: Kernel panics on iSER (iscsi over IB) logouts Status in linux package in Ubuntu: Confirmed Bug description: While shutting down the open-iscsi daemon (with an iSER mapped volume from other host) I'm getting the following kernel panic for kernel 3.13.0-49: [272820.948946] scsi15 : iSCSI Initiator over iSER [272843.474551] sd 14:0:0:1: [sdc] Synchronizing SCSI cache [272843.998231] BUG: unable to handle kernel paging request at a03840b7 [272843.998258] IP: [a03840b7] 0xa03840b7 [272843.998278] PGD 1c11067 PUD 1c12063 PMD 80afb5067 PTE 0 [272843.998306] Oops: 0010 [#1] SMP [272843.998324] Modules linked in: rdma_ucm ib_ucm ib_srp scsi_transport_srp scsi_tgt ib_srpt ib_mthca ib_ipa [272843.998742] CPU: 1 PID: 32399 Comm: kworker/1:0 Not tainted 3.13.0-49-generic #81-Ubuntu [272843.998758] Hardware name: HP ProLiant DL360e Gen8, BIOS P73 11/12/2013 [272843.998774] Workqueue: ib_cm cm_work_handler [ib_cm] [272843.998789] task: 88080b72c800 ti: 880802522000 task.ti: 880802522000 [272843.998827] RIP: 0010:[a03840b7] [a03840b7] 0xa03840b7 [272843.998870] RSP: 0018:880802523c28 EFLAGS: 00010296 [272843.998893] RAX: 8800b851d801 RBX: 8807af8482b8 RCX: 00018028 [272843.998929] RDX: 00018029 RSI: 8028 RDI: 88081f003900 [272843.998965] RBP: 880802523c30 R08: R09: 0001 [272843.999002] R10: ea0002e14740 R11: a00e0b9a R12: 88080953e400 [272843.999038] R13: 8807af8482b8 R14: 88080953e400 R15: [272843.999075] FS: () GS:88083f42() knlGS: [272843.999113] CS: 0010 DS: ES: CR0: 80050033 [272843.999136] CR2: a03840b7 CR3: 0008024f1000 CR4: 000407e0 [272843.999173] Stack: [272843.999191] 8807af54 880802523c60 a0386425 8807af8482b8 [272843.999245] 88080953e400 88080acf9fa8 880802523cf0 880802523ca0 [272843.999297] a0384f58 810aacc4 8807af8482b8 8807af8482d0 [272843.999349] Call Trace: [272843.999378] [810aacc4] ? __wake_up+0x44/0x50 [272843.999406] [a03c436b] ? cma_comp_exch+0x4b/0x60 [rdma_cm] [272843.999432] [a03c6429] ? cma_ib_handler+0xf9/0x230 [rdma_cm] [272843.999460] [a01b2166] ? cm_process_work+0x26/0x150 [ib_cm] [272843.999487] [a01b4183] ? cm_work_handler+0xa83/0x161c [ib_cm] [272843.999515] [81083a82] ? process_one_work+0x182/0x450 [272843.999540] [81084871] ? worker_thread+0x121/0x410 [272843.999565] [81084750] ? rescuer_thread+0x430/0x430 [272843.999590] [8108b5b2] ? kthread+0xd2/0xf0 [272843.999615] [8108b4e0] ? kthread_create_on_node+0x1c0/0x1c0 [272843.999641] [8173258c] ? ret_from_fork+0x7c/0xb0 [272843.999666] [8108b4e0] ? kthread_create_on_node+0x1c0/0x1c0 [272843.999691] Code: Bad RIP value. [272843.999721] RIP [a03840b7] 0xa03840b7 [272843.999749] RSP 880802523c28 [272843.999770] CR2: a03840b7 I got also this one (looks the same): [ 479.240278] BUG: unable to handle kernel paging request at a04af0b7 [ 479.240453] IP: [a04af0b7] 0xa04af0b7 [ 479.240572] PGD 1c11067 PUD 1c12063 PMD 80bccf067 PTE 0 [ 479.240849] Oops: 0010 [#1] SMP [ 479.241014] Modules linked in: ip6table_filter ip6_tables iptable_filter ip_tables ebtable_nat ebtables x_ [ 479.245546] [ 479.245603] CPU: 2 PID: 257 Comm: kworker/2:1 Not tainted 3.13.0-49-generic #81-Ubuntu [ 479.245668] Hardware name: HP ProLiant DL360e Gen8, BIOS P73 11/12/2013 [ 479.245734] Workqueue: ib_cm cm_work_handler [ib_cm] [ 479.245847] task: 880811ad6000 ti: 88081142 task.ti: 88081142 [ 479.245923] RIP:
[Kernel-packages] [Bug 1443648] Re: Kernel panics on iSER (iscsi over IB) logouts
I started bisecting this issue: Upstream linux-stable git repo v3.13 - BISECT BAD (same issue as description) Upstream linux-stable git repo v3.16 - BISECT GOOD (no issues after iSER iscsi login and iscsid turned off) It will take sometime but I'll come up with the commit that fixes this behavior: - Kernel 3.13 panicing on iscsi logout after node has logged in and mapped target using iSER. -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1443648 Title: Kernel panics on iSER (iscsi over IB) logouts Status in linux package in Ubuntu: Confirmed Bug description: While shutting down the open-iscsi daemon (with an iSER mapped volume from other host) I'm getting the following kernel panic for kernel 3.13.0-49: [272820.948946] scsi15 : iSCSI Initiator over iSER [272843.474551] sd 14:0:0:1: [sdc] Synchronizing SCSI cache [272843.998231] BUG: unable to handle kernel paging request at a03840b7 [272843.998258] IP: [a03840b7] 0xa03840b7 [272843.998278] PGD 1c11067 PUD 1c12063 PMD 80afb5067 PTE 0 [272843.998306] Oops: 0010 [#1] SMP [272843.998324] Modules linked in: rdma_ucm ib_ucm ib_srp scsi_transport_srp scsi_tgt ib_srpt ib_mthca ib_ipa [272843.998742] CPU: 1 PID: 32399 Comm: kworker/1:0 Not tainted 3.13.0-49-generic #81-Ubuntu [272843.998758] Hardware name: HP ProLiant DL360e Gen8, BIOS P73 11/12/2013 [272843.998774] Workqueue: ib_cm cm_work_handler [ib_cm] [272843.998789] task: 88080b72c800 ti: 880802522000 task.ti: 880802522000 [272843.998827] RIP: 0010:[a03840b7] [a03840b7] 0xa03840b7 [272843.998870] RSP: 0018:880802523c28 EFLAGS: 00010296 [272843.998893] RAX: 8800b851d801 RBX: 8807af8482b8 RCX: 00018028 [272843.998929] RDX: 00018029 RSI: 8028 RDI: 88081f003900 [272843.998965] RBP: 880802523c30 R08: R09: 0001 [272843.999002] R10: ea0002e14740 R11: a00e0b9a R12: 88080953e400 [272843.999038] R13: 8807af8482b8 R14: 88080953e400 R15: [272843.999075] FS: () GS:88083f42() knlGS: [272843.999113] CS: 0010 DS: ES: CR0: 80050033 [272843.999136] CR2: a03840b7 CR3: 0008024f1000 CR4: 000407e0 [272843.999173] Stack: [272843.999191] 8807af54 880802523c60 a0386425 8807af8482b8 [272843.999245] 88080953e400 88080acf9fa8 880802523cf0 880802523ca0 [272843.999297] a0384f58 810aacc4 8807af8482b8 8807af8482d0 [272843.999349] Call Trace: [272843.999378] [810aacc4] ? __wake_up+0x44/0x50 [272843.999406] [a03c436b] ? cma_comp_exch+0x4b/0x60 [rdma_cm] [272843.999432] [a03c6429] ? cma_ib_handler+0xf9/0x230 [rdma_cm] [272843.999460] [a01b2166] ? cm_process_work+0x26/0x150 [ib_cm] [272843.999487] [a01b4183] ? cm_work_handler+0xa83/0x161c [ib_cm] [272843.999515] [81083a82] ? process_one_work+0x182/0x450 [272843.999540] [81084871] ? worker_thread+0x121/0x410 [272843.999565] [81084750] ? rescuer_thread+0x430/0x430 [272843.999590] [8108b5b2] ? kthread+0xd2/0xf0 [272843.999615] [8108b4e0] ? kthread_create_on_node+0x1c0/0x1c0 [272843.999641] [8173258c] ? ret_from_fork+0x7c/0xb0 [272843.999666] [8108b4e0] ? kthread_create_on_node+0x1c0/0x1c0 [272843.999691] Code: Bad RIP value. [272843.999721] RIP [a03840b7] 0xa03840b7 [272843.999749] RSP 880802523c28 [272843.999770] CR2: a03840b7 I got also this one (looks the same): [ 479.240278] BUG: unable to handle kernel paging request at a04af0b7 [ 479.240453] IP: [a04af0b7] 0xa04af0b7 [ 479.240572] PGD 1c11067 PUD 1c12063 PMD 80bccf067 PTE 0 [ 479.240849] Oops: 0010 [#1] SMP [ 479.241014] Modules linked in: ip6table_filter ip6_tables iptable_filter ip_tables ebtable_nat ebtables x_ [ 479.245546] [ 479.245603] CPU: 2 PID: 257 Comm: kworker/2:1 Not tainted 3.13.0-49-generic #81-Ubuntu [ 479.245668] Hardware name: HP ProLiant DL360e Gen8, BIOS P73 11/12/2013 [ 479.245734] Workqueue: ib_cm cm_work_handler [ib_cm] [ 479.245847] task: 880811ad6000 ti: 88081142 task.ti: 88081142 [ 479.245923] RIP: 0010:[a04af0b7] [a04af0b7] 0xa04af0b7 [ 479.246065] RSP: 0018:880811421c28 EFLAGS: 00010296 [ 479.246138] RAX: 8807f6d85501 RBX: 8807e613a2b8 RCX: 00018029 [ 479.246212] RDX: 0001802a RSI: 8029 RDI: 88081f003900 [ 479.246287] RBP: 880811421c30 R08: R09: 0001 [ 479.246361] R10: ea001fdb6140 R11: a00f7b9a R12:
[Kernel-packages] [Bug 1443648] Re: Kernel panics on iSER (iscsi over IB) logouts
Kernel 3.16 does not suffer from this issue. I'll cherry-pick fixes either by checking git commits or bisecting development tree (since I have a reproducer). -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1443648 Title: Kernel panics on iSER (iscsi over IB) logouts Status in linux package in Ubuntu: Confirmed Bug description: While shutting down the open-iscsi daemon (with an iSER mapped volume from other host) I'm getting the following kernel panic for kernel 3.13.0-49: [272820.948946] scsi15 : iSCSI Initiator over iSER [272843.474551] sd 14:0:0:1: [sdc] Synchronizing SCSI cache [272843.998231] BUG: unable to handle kernel paging request at a03840b7 [272843.998258] IP: [a03840b7] 0xa03840b7 [272843.998278] PGD 1c11067 PUD 1c12063 PMD 80afb5067 PTE 0 [272843.998306] Oops: 0010 [#1] SMP [272843.998324] Modules linked in: rdma_ucm ib_ucm ib_srp scsi_transport_srp scsi_tgt ib_srpt ib_mthca ib_ipa [272843.998742] CPU: 1 PID: 32399 Comm: kworker/1:0 Not tainted 3.13.0-49-generic #81-Ubuntu [272843.998758] Hardware name: HP ProLiant DL360e Gen8, BIOS P73 11/12/2013 [272843.998774] Workqueue: ib_cm cm_work_handler [ib_cm] [272843.998789] task: 88080b72c800 ti: 880802522000 task.ti: 880802522000 [272843.998827] RIP: 0010:[a03840b7] [a03840b7] 0xa03840b7 [272843.998870] RSP: 0018:880802523c28 EFLAGS: 00010296 [272843.998893] RAX: 8800b851d801 RBX: 8807af8482b8 RCX: 00018028 [272843.998929] RDX: 00018029 RSI: 8028 RDI: 88081f003900 [272843.998965] RBP: 880802523c30 R08: R09: 0001 [272843.999002] R10: ea0002e14740 R11: a00e0b9a R12: 88080953e400 [272843.999038] R13: 8807af8482b8 R14: 88080953e400 R15: [272843.999075] FS: () GS:88083f42() knlGS: [272843.999113] CS: 0010 DS: ES: CR0: 80050033 [272843.999136] CR2: a03840b7 CR3: 0008024f1000 CR4: 000407e0 [272843.999173] Stack: [272843.999191] 8807af54 880802523c60 a0386425 8807af8482b8 [272843.999245] 88080953e400 88080acf9fa8 880802523cf0 880802523ca0 [272843.999297] a0384f58 810aacc4 8807af8482b8 8807af8482d0 [272843.999349] Call Trace: [272843.999378] [810aacc4] ? __wake_up+0x44/0x50 [272843.999406] [a03c436b] ? cma_comp_exch+0x4b/0x60 [rdma_cm] [272843.999432] [a03c6429] ? cma_ib_handler+0xf9/0x230 [rdma_cm] [272843.999460] [a01b2166] ? cm_process_work+0x26/0x150 [ib_cm] [272843.999487] [a01b4183] ? cm_work_handler+0xa83/0x161c [ib_cm] [272843.999515] [81083a82] ? process_one_work+0x182/0x450 [272843.999540] [81084871] ? worker_thread+0x121/0x410 [272843.999565] [81084750] ? rescuer_thread+0x430/0x430 [272843.999590] [8108b5b2] ? kthread+0xd2/0xf0 [272843.999615] [8108b4e0] ? kthread_create_on_node+0x1c0/0x1c0 [272843.999641] [8173258c] ? ret_from_fork+0x7c/0xb0 [272843.999666] [8108b4e0] ? kthread_create_on_node+0x1c0/0x1c0 [272843.999691] Code: Bad RIP value. [272843.999721] RIP [a03840b7] 0xa03840b7 [272843.999749] RSP 880802523c28 [272843.999770] CR2: a03840b7 I got also this one (looks the same): [ 479.240278] BUG: unable to handle kernel paging request at a04af0b7 [ 479.240453] IP: [a04af0b7] 0xa04af0b7 [ 479.240572] PGD 1c11067 PUD 1c12063 PMD 80bccf067 PTE 0 [ 479.240849] Oops: 0010 [#1] SMP [ 479.241014] Modules linked in: ip6table_filter ip6_tables iptable_filter ip_tables ebtable_nat ebtables x_ [ 479.245546] [ 479.245603] CPU: 2 PID: 257 Comm: kworker/2:1 Not tainted 3.13.0-49-generic #81-Ubuntu [ 479.245668] Hardware name: HP ProLiant DL360e Gen8, BIOS P73 11/12/2013 [ 479.245734] Workqueue: ib_cm cm_work_handler [ib_cm] [ 479.245847] task: 880811ad6000 ti: 88081142 task.ti: 88081142 [ 479.245923] RIP: 0010:[a04af0b7] [a04af0b7] 0xa04af0b7 [ 479.246065] RSP: 0018:880811421c28 EFLAGS: 00010296 [ 479.246138] RAX: 8807f6d85501 RBX: 8807e613a2b8 RCX: 00018029 [ 479.246212] RDX: 0001802a RSI: 8029 RDI: 88081f003900 [ 479.246287] RBP: 880811421c30 R08: R09: 0001 [ 479.246361] R10: ea001fdb6140 R11: a00f7b9a R12: 8807e6238c00 [ 479.246435] R13: 8807e613a2b8 R14: 8807e6238c00 R15: [ 479.246510] FS: () GS:88083f44() knlGS: [ 479.246597] CS: 0010 DS: ES:
[Kernel-packages] [Bug 1443648] Re: Kernel panics on iSER (iscsi over IB) logouts
This bug was discovered when fixing iSER enablement for Trusty in case: https://bugs.launchpad.net/ubuntu/+source/open-iscsi/+bug/1401575 -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1443648 Title: Kernel panics on iSER (iscsi over IB) logouts Status in linux package in Ubuntu: Confirmed Bug description: While shutting down the open-iscsi daemon (with an iSER mapped volume from other host) I'm getting the following kernel panic for kernel 3.13.0-49: [272820.948946] scsi15 : iSCSI Initiator over iSER [272843.474551] sd 14:0:0:1: [sdc] Synchronizing SCSI cache [272843.998231] BUG: unable to handle kernel paging request at a03840b7 [272843.998258] IP: [a03840b7] 0xa03840b7 [272843.998278] PGD 1c11067 PUD 1c12063 PMD 80afb5067 PTE 0 [272843.998306] Oops: 0010 [#1] SMP [272843.998324] Modules linked in: rdma_ucm ib_ucm ib_srp scsi_transport_srp scsi_tgt ib_srpt ib_mthca ib_ipa [272843.998742] CPU: 1 PID: 32399 Comm: kworker/1:0 Not tainted 3.13.0-49-generic #81-Ubuntu [272843.998758] Hardware name: HP ProLiant DL360e Gen8, BIOS P73 11/12/2013 [272843.998774] Workqueue: ib_cm cm_work_handler [ib_cm] [272843.998789] task: 88080b72c800 ti: 880802522000 task.ti: 880802522000 [272843.998827] RIP: 0010:[a03840b7] [a03840b7] 0xa03840b7 [272843.998870] RSP: 0018:880802523c28 EFLAGS: 00010296 [272843.998893] RAX: 8800b851d801 RBX: 8807af8482b8 RCX: 00018028 [272843.998929] RDX: 00018029 RSI: 8028 RDI: 88081f003900 [272843.998965] RBP: 880802523c30 R08: R09: 0001 [272843.999002] R10: ea0002e14740 R11: a00e0b9a R12: 88080953e400 [272843.999038] R13: 8807af8482b8 R14: 88080953e400 R15: [272843.999075] FS: () GS:88083f42() knlGS: [272843.999113] CS: 0010 DS: ES: CR0: 80050033 [272843.999136] CR2: a03840b7 CR3: 0008024f1000 CR4: 000407e0 [272843.999173] Stack: [272843.999191] 8807af54 880802523c60 a0386425 8807af8482b8 [272843.999245] 88080953e400 88080acf9fa8 880802523cf0 880802523ca0 [272843.999297] a0384f58 810aacc4 8807af8482b8 8807af8482d0 [272843.999349] Call Trace: [272843.999378] [810aacc4] ? __wake_up+0x44/0x50 [272843.999406] [a03c436b] ? cma_comp_exch+0x4b/0x60 [rdma_cm] [272843.999432] [a03c6429] ? cma_ib_handler+0xf9/0x230 [rdma_cm] [272843.999460] [a01b2166] ? cm_process_work+0x26/0x150 [ib_cm] [272843.999487] [a01b4183] ? cm_work_handler+0xa83/0x161c [ib_cm] [272843.999515] [81083a82] ? process_one_work+0x182/0x450 [272843.999540] [81084871] ? worker_thread+0x121/0x410 [272843.999565] [81084750] ? rescuer_thread+0x430/0x430 [272843.999590] [8108b5b2] ? kthread+0xd2/0xf0 [272843.999615] [8108b4e0] ? kthread_create_on_node+0x1c0/0x1c0 [272843.999641] [8173258c] ? ret_from_fork+0x7c/0xb0 [272843.999666] [8108b4e0] ? kthread_create_on_node+0x1c0/0x1c0 [272843.999691] Code: Bad RIP value. [272843.999721] RIP [a03840b7] 0xa03840b7 [272843.999749] RSP 880802523c28 [272843.999770] CR2: a03840b7 I got also this one (looks the same): [ 479.240278] BUG: unable to handle kernel paging request at a04af0b7 [ 479.240453] IP: [a04af0b7] 0xa04af0b7 [ 479.240572] PGD 1c11067 PUD 1c12063 PMD 80bccf067 PTE 0 [ 479.240849] Oops: 0010 [#1] SMP [ 479.241014] Modules linked in: ip6table_filter ip6_tables iptable_filter ip_tables ebtable_nat ebtables x_ [ 479.245546] [ 479.245603] CPU: 2 PID: 257 Comm: kworker/2:1 Not tainted 3.13.0-49-generic #81-Ubuntu [ 479.245668] Hardware name: HP ProLiant DL360e Gen8, BIOS P73 11/12/2013 [ 479.245734] Workqueue: ib_cm cm_work_handler [ib_cm] [ 479.245847] task: 880811ad6000 ti: 88081142 task.ti: 88081142 [ 479.245923] RIP: 0010:[a04af0b7] [a04af0b7] 0xa04af0b7 [ 479.246065] RSP: 0018:880811421c28 EFLAGS: 00010296 [ 479.246138] RAX: 8807f6d85501 RBX: 8807e613a2b8 RCX: 00018029 [ 479.246212] RDX: 0001802a RSI: 8029 RDI: 88081f003900 [ 479.246287] RBP: 880811421c30 R08: R09: 0001 [ 479.246361] R10: ea001fdb6140 R11: a00f7b9a R12: 8807e6238c00 [ 479.246435] R13: 8807e613a2b8 R14: 8807e6238c00 R15: [ 479.246510] FS: () GS:88083f44() knlGS: [ 479.246597] CS: 0010 DS: ES: CR0: 80050033
[Kernel-packages] [Bug 1443648] Re: Kernel panics on iSER (iscsi over IB) logouts
** Changed in: linux (Ubuntu) Importance: Undecided = High -- You received this bug notification because you are a member of Kernel Packages, which is subscribed to linux in Ubuntu. https://bugs.launchpad.net/bugs/1443648 Title: Kernel panics on iSER (iscsi over IB) logouts Status in linux package in Ubuntu: Confirmed Bug description: While shutting down the open-iscsi daemon (with an iSER mapped volume from other host) I'm getting the following kernel panic for kernel 3.13.0-49: [272820.948946] scsi15 : iSCSI Initiator over iSER [272843.474551] sd 14:0:0:1: [sdc] Synchronizing SCSI cache [272843.998231] BUG: unable to handle kernel paging request at a03840b7 [272843.998258] IP: [a03840b7] 0xa03840b7 [272843.998278] PGD 1c11067 PUD 1c12063 PMD 80afb5067 PTE 0 [272843.998306] Oops: 0010 [#1] SMP [272843.998324] Modules linked in: rdma_ucm ib_ucm ib_srp scsi_transport_srp scsi_tgt ib_srpt ib_mthca ib_ipa [272843.998742] CPU: 1 PID: 32399 Comm: kworker/1:0 Not tainted 3.13.0-49-generic #81-Ubuntu [272843.998758] Hardware name: HP ProLiant DL360e Gen8, BIOS P73 11/12/2013 [272843.998774] Workqueue: ib_cm cm_work_handler [ib_cm] [272843.998789] task: 88080b72c800 ti: 880802522000 task.ti: 880802522000 [272843.998827] RIP: 0010:[a03840b7] [a03840b7] 0xa03840b7 [272843.998870] RSP: 0018:880802523c28 EFLAGS: 00010296 [272843.998893] RAX: 8800b851d801 RBX: 8807af8482b8 RCX: 00018028 [272843.998929] RDX: 00018029 RSI: 8028 RDI: 88081f003900 [272843.998965] RBP: 880802523c30 R08: R09: 0001 [272843.999002] R10: ea0002e14740 R11: a00e0b9a R12: 88080953e400 [272843.999038] R13: 8807af8482b8 R14: 88080953e400 R15: [272843.999075] FS: () GS:88083f42() knlGS: [272843.999113] CS: 0010 DS: ES: CR0: 80050033 [272843.999136] CR2: a03840b7 CR3: 0008024f1000 CR4: 000407e0 [272843.999173] Stack: [272843.999191] 8807af54 880802523c60 a0386425 8807af8482b8 [272843.999245] 88080953e400 88080acf9fa8 880802523cf0 880802523ca0 [272843.999297] a0384f58 810aacc4 8807af8482b8 8807af8482d0 [272843.999349] Call Trace: [272843.999378] [810aacc4] ? __wake_up+0x44/0x50 [272843.999406] [a03c436b] ? cma_comp_exch+0x4b/0x60 [rdma_cm] [272843.999432] [a03c6429] ? cma_ib_handler+0xf9/0x230 [rdma_cm] [272843.999460] [a01b2166] ? cm_process_work+0x26/0x150 [ib_cm] [272843.999487] [a01b4183] ? cm_work_handler+0xa83/0x161c [ib_cm] [272843.999515] [81083a82] ? process_one_work+0x182/0x450 [272843.999540] [81084871] ? worker_thread+0x121/0x410 [272843.999565] [81084750] ? rescuer_thread+0x430/0x430 [272843.999590] [8108b5b2] ? kthread+0xd2/0xf0 [272843.999615] [8108b4e0] ? kthread_create_on_node+0x1c0/0x1c0 [272843.999641] [8173258c] ? ret_from_fork+0x7c/0xb0 [272843.999666] [8108b4e0] ? kthread_create_on_node+0x1c0/0x1c0 [272843.999691] Code: Bad RIP value. [272843.999721] RIP [a03840b7] 0xa03840b7 [272843.999749] RSP 880802523c28 [272843.999770] CR2: a03840b7 I got also this one (looks the same): [ 479.240278] BUG: unable to handle kernel paging request at a04af0b7 [ 479.240453] IP: [a04af0b7] 0xa04af0b7 [ 479.240572] PGD 1c11067 PUD 1c12063 PMD 80bccf067 PTE 0 [ 479.240849] Oops: 0010 [#1] SMP [ 479.241014] Modules linked in: ip6table_filter ip6_tables iptable_filter ip_tables ebtable_nat ebtables x_ [ 479.245546] [ 479.245603] CPU: 2 PID: 257 Comm: kworker/2:1 Not tainted 3.13.0-49-generic #81-Ubuntu [ 479.245668] Hardware name: HP ProLiant DL360e Gen8, BIOS P73 11/12/2013 [ 479.245734] Workqueue: ib_cm cm_work_handler [ib_cm] [ 479.245847] task: 880811ad6000 ti: 88081142 task.ti: 88081142 [ 479.245923] RIP: 0010:[a04af0b7] [a04af0b7] 0xa04af0b7 [ 479.246065] RSP: 0018:880811421c28 EFLAGS: 00010296 [ 479.246138] RAX: 8807f6d85501 RBX: 8807e613a2b8 RCX: 00018029 [ 479.246212] RDX: 0001802a RSI: 8029 RDI: 88081f003900 [ 479.246287] RBP: 880811421c30 R08: R09: 0001 [ 479.246361] R10: ea001fdb6140 R11: a00f7b9a R12: 8807e6238c00 [ 479.246435] R13: 8807e613a2b8 R14: 8807e6238c00 R15: [ 479.246510] FS: () GS:88083f44() knlGS: [ 479.246597] CS: 0010 DS: ES: CR0: 80050033 [ 479.246669] CR2: a04af0b7 CR3: 000811549000 CR4: