Re: [Gluster-users] v3.1 gluster peer status crashes debian Xen DomU
Anand Avati anand.avati@... writes: That does not seem to be the complete call trace. Can you post the complete trace? This seems like a kernel bug strangely triggered by gluster Avati Sorry for my late response, correct about trace, only had a visual dump and could not scroll back. After that had a go at crash kernel but that turned out not exactly trivial in the xenserver/pv setup. Long story short, I updated xenserver to 5.6.1, rolled out new debian 6.0 64 bit vms with squeeze rc1, installed glusterfs 3.1.2 (deb packages) and now it works ok! Jacco ___ Gluster-users mailing list Gluster-users@gluster.org http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
Re: [Gluster-users] v3.1 gluster peer status crashes debian Xen DomU
That does not seem to be the complete call trace. Can you post the complete trace? This seems like a kernel bug strangely triggered by gluster Avati On Thu, Dec 23, 2010 at 11:48 PM, Jacco Beije ja...@redproc.com wrote: Can you post the kernel backtrace? Avati redid test to get kernel backtrace: [423738.055715] [8101104f] ? do_notify_resume+0x87/0x73f [423738.055721] [8100ecf2] ? check_events+0x12/0x20 [423738.055727] [8100ecdf] ? xen_restore_fl_direct_end+0x0/0x1 [423738.254840] [8130c8b2] ? _spin_unlock_irqrestore+0xd/0xe [423738.254846] [8131034c] ? kprobe_flush_task+0x9f/0xac [423738.254853] [81049098] ? finish_task_switch+0x96/0xaf [423738.254858] [81011e0e] ? int_signal+0x12/0x17 [423738.254862] Code: 87 d8 00 00 00 2b 87 d0 00 00 00 be 0e 00 00 00 89 87 c4 0 0 00 00 e8 50 48 fe ff 8b 8b c4 00 00 00 48 03 8b d0 00 00 00 f6 01 01 48 8b 1 1 74 20 48 33 95 40 02 00 00 8a 43 7d 48 c1 e2 10 75 08 [423738.254925] RIP [81270a43] eth_type_trans+0x3d/0xae [423738.254932] RSP 88003ef7b988 [423738.254937] ---[ end trace c0aa069d16ca8ed9 ]--- [423738.254940] Kernel panic - not syncing: Fatal exception in interrupt [423738.254946] Pid: 2070, comm: gluster Tainted: G D 2.6.32-5-xen-amd64 #1 [423738.254951] Call Trace: [423738.254955] [8130a9fa] ? panic+0x86/0x143 [423738.254961] [8100ecdf] ? xen_restore_fl_direct_end+0x0/0x1 [423738.254967] [8130c8b2] ? _spin_unlock_ireqrestore+0xd/0xe [423738.254973] [8104f3c5] ? release_console_sem+0x17e/0x1af [423738.254979] [8130d755] ? oops_end+0xa7/0xb4 [423738.254985] [81013416] ? do_alignment_check+0x88/0x92 I also tried a gdb, but same as strace this works ok without panic. Jacco ___ Gluster-users mailing list Gluster-users@gluster.org http://gluster.org/cgi-bin/mailman/listinfo/gluster-users ___ Gluster-users mailing list Gluster-users@gluster.org http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
Re: [Gluster-users] v3.1 gluster peer status crashes debian Xen DomU
Can you post the kernel backtrace? Avati On Sun, Dec 19, 2010 at 11:21 PM, Jacco Beije ja...@redproc.com wrote: Craig Carl cr...@... writes: Max - Can you try again with Gluster 3.1.1, please install from source - http://download.gluster.com/pub/gluster/glusterfs/3.1/3.1.1/glusterfs-3.1.1.tar.gz I'm experiencing the same problems. Tests on XenServer 5.6 running Debian Squeeze vm with latest kernel 2.6.32-5-xen-amd64. Tested using gluster 3.1.1 debian package, gluster 3.1.1 from source and gluster 3.1.2qa2 and all of them crash vm with a kernel panic when running gluster peer status. Interestingly, when I do strace gluster peer status it does not crash; peer status is shown and gluster exits normally... Jacco ___ Gluster-users mailing list Gluster-users@gluster.org http://gluster.org/cgi-bin/mailman/listinfo/gluster-users ___ Gluster-users mailing list Gluster-users@gluster.org http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
Re: [Gluster-users] v3.1 gluster peer status crashes debian Xen DomU
Can you post the kernel backtrace? Avati redid test to get kernel backtrace: [423738.055715] [8101104f] ? do_notify_resume+0x87/0x73f [423738.055721] [8100ecf2] ? check_events+0x12/0x20 [423738.055727] [8100ecdf] ? xen_restore_fl_direct_end+0x0/0x1 [423738.254840] [8130c8b2] ? _spin_unlock_irqrestore+0xd/0xe [423738.254846] [8131034c] ? kprobe_flush_task+0x9f/0xac [423738.254853] [81049098] ? finish_task_switch+0x96/0xaf [423738.254858] [81011e0e] ? int_signal+0x12/0x17 [423738.254862] Code: 87 d8 00 00 00 2b 87 d0 00 00 00 be 0e 00 00 00 89 87 c4 0 0 00 00 e8 50 48 fe ff 8b 8b c4 00 00 00 48 03 8b d0 00 00 00 f6 01 01 48 8b 1 1 74 20 48 33 95 40 02 00 00 8a 43 7d 48 c1 e2 10 75 08 [423738.254925] RIP [81270a43] eth_type_trans+0x3d/0xae [423738.254932] RSP 88003ef7b988 [423738.254937] ---[ end trace c0aa069d16ca8ed9 ]--- [423738.254940] Kernel panic - not syncing: Fatal exception in interrupt [423738.254946] Pid: 2070, comm: gluster Tainted: G D2.6.32-5-xen-amd64 #1 [423738.254951] Call Trace: [423738.254955] [8130a9fa] ? panic+0x86/0x143 [423738.254961] [8100ecdf] ? xen_restore_fl_direct_end+0x0/0x1 [423738.254967] [8130c8b2] ? _spin_unlock_ireqrestore+0xd/0xe [423738.254973] [8104f3c5] ? release_console_sem+0x17e/0x1af [423738.254979] [8130d755] ? oops_end+0xa7/0xb4 [423738.254985] [81013416] ? do_alignment_check+0x88/0x92 I also tried a gdb, but same as strace this works ok without panic. Jacco ___ Gluster-users mailing list Gluster-users@gluster.org http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
Re: [Gluster-users] v3.1 gluster peer status crashes debian Xen DomU
Craig Carl cr...@... writes: Max - Can you try again with Gluster 3.1.1, please install from source - http://download.gluster.com/pub/gluster/glusterfs/3.1/3.1.1/glusterfs-3.1.1.tar.gz I'm experiencing the same problems. Tests on XenServer 5.6 running Debian Squeeze vm with latest kernel 2.6.32-5-xen-amd64. Tested using gluster 3.1.1 debian package, gluster 3.1.1 from source and gluster 3.1.2qa2 and all of them crash vm with a kernel panic when running gluster peer status. Interestingly, when I do strace gluster peer status it does not crash; peer status is shown and gluster exits normally... Jacco ___ Gluster-users mailing list Gluster-users@gluster.org http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
Re: [Gluster-users] v3.1 gluster peer status crashes debian Xen DomU
Max - Can you try again with Gluster 3.1.1, please install from source - http://download.gluster.com/pub/gluster/glusterfs/3.1/3.1.1/glusterfs-3.1.1.tar.gz Instructions - http://www.gluster.com/community/documentation/index.php/Gluster_3.1:_Installing_GlusterFS_From_Source Thanks, Craig -- Craig Carl Senior Systems Engineer Gluster On 11/30/2010 04:04 PM, Max Ivanov wrote: I am trying to deploy glusterfs on Xen VM running on debian squeeze. I've downloaded 3.1 deb file as mentioned in doc, added peers but gluster peers status either hangs or crashes VM (yes, I've got crash log entry in xend.log). Do I do something wrong? ___ Gluster-users mailing list Gluster-users@gluster.org http://gluster.org/cgi-bin/mailman/listinfo/gluster-users ___ Gluster-users mailing list Gluster-users@gluster.org http://gluster.org/cgi-bin/mailman/listinfo/gluster-users
