[openstack-dev] nova compute error
Hi I'm getting foollowing error while booting VM on compute node in nova-compute service using devstack due to which the VM is stuck at spawning state.. ERROR nova.openstack.common.rpc.amqp [req-da485913-0cb2-47c1-ac61-6657361286c3 nova service] Exception during message handling [16:18:23] Abhishek Jain: Traceback (most recent call last): 2014-05-07 05:38:52.835 6754 TRACE nova.openstack.common.rpc.amqp File "/opt/stack/nova/nova/openstack/common/rpc/amqp.py", line 461, in _process_data 2014-05-07 05:38:52.835 6754 TRACE nova.openstack.common.rpc.amqp **args) 2014-05-07 05:38:52.835 6754 TRACE nova.openstack.common.rpc.amqp File "/opt/stack/nova/nova/openstack/common/rpc/dispatcher.py", line 178, in dispatch Please help regarding this.. Thanks Sonia ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] nova-compute error
Hi Thierry Thanks for help On Wed, May 7, 2014 at 1:31 PM, Thierry Carrez wrote: > sonia verma wrote: > > Hi all > > > > I'm getting following error when booting VM onto compute node from > > openstack dashboard... > > [...] > > Hi! > > This list is for future development topics only, and your question is > about debugging an issue you have using OpenStack. You shall get better > answers by asking your question on the general OpenStack mailing-list > (openst...@lists.openstack.org). > > For more information see: > https://wiki.openstack.org/wiki/Mailing_Lists > > -- > Thierry Carrez (ttx) > > ___ > OpenStack-dev mailing list > OpenStack-dev@lists.openstack.org > http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev > ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] nova-compute error
Thanks Thierry for the help On Wed, May 7, 2014 at 1:31 PM, Thierry Carrez wrote: > sonia verma wrote: > > Hi all > > > > I'm getting following error when booting VM onto compute node from > > openstack dashboard... > > [...] > > Hi! > > This list is for future development topics only, and your question is > about debugging an issue you have using OpenStack. You shall get better > answers by asking your question on the general OpenStack mailing-list > (openst...@lists.openstack.org). > > For more information see: > https://wiki.openstack.org/wiki/Mailing_Lists > > -- > Thierry Carrez (ttx) > > ___ > OpenStack-dev mailing list > OpenStack-dev@lists.openstack.org > http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev > ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] nova-compute error
sonia verma wrote: > Hi all > > I'm getting following error when booting VM onto compute node from > openstack dashboard... > [...] Hi! This list is for future development topics only, and your question is about debugging an issue you have using OpenStack. You shall get better answers by asking your question on the general OpenStack mailing-list (openst...@lists.openstack.org). For more information see: https://wiki.openstack.org/wiki/Mailing_Lists -- Thierry Carrez (ttx) ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
[openstack-dev] nova-compute error
Hi all I'm getting following error when booting VM onto compute node from openstack dashboard... 014-05-06 12:47:22.393 DEBUG nova.openstack.common.processutils [req-cc3cf4c6-160d-4dd4-b44d-d8f5c25fb55c admin admin] Result was 12 execute /opt/stack/nova/nova/openstack/common/processutils.py:172 2014-05-06 12:47:22.395 DEBUG nova.virt.disk.mount.api [req-cc3cf4c6-160d-4dd4-b44d-d8f5c25fb55c admin admin] Failed to mount filesystem: Unexpected error while running command. Command: sudo nova-rootwrap /etc/nova/rootwrap.conf mount /dev/nbd9 /tmp/openstack-vfs-localfsjqwQWj Exit code: 12 Stdout: '' Stderr: "Failed to read bootsector (size=0)\nFailed to mount '/dev/nbd9': Invalid argument\nThe device '/dev/nbd9' doesn't seem to have a valid NTFS.\nMaybe the wrong device is used? Or the whole disk instead of a\npartition (e.g. /dev/sda, not /dev/sda1)? Or the other way around?\n" mnt_dev /opt/stack/nova/nova/virt/disk/mount/api.py:198 2014-05-06 12:47:22.396 DEBUG nova.virt.disk.mount.api [req-cc3cf4c6-160d-4dd4-b44d-d8f5c25fb55c admin admin] Fail to mount, tearing back down do_mount /opt/stack/nova/nova/virt/disk/mount/api.py:219 2014-05-06 12:47:22.396 DEBUG nova.virt.disk.mount.api [req-cc3cf4c6-160d-4dd4-b44d-d8f5c25fb55c admin admin] Unmap dev /dev/nbd9 unmap_dev /opt/stack/nova/nova/virt/disk/mount/api.py:184 2014-05-06 12:47:22.397 DEBUG nova.virt.disk.mount.nbd [req-cc3cf4c6-160d-4dd4-b44d-d8f5c25fb55c admin admin] Release nbd device /dev/nbd9 unget_dev /opt/stack/nova/nova/virt/disk/mount/nbd.py:129 2014-05-06 12:47:22.398 DEBUG nova.openstack.common.processutils [req-cc3cf4c6-160d-4dd4-b44d-d8f5c25fb55c admin admin] Running cmd (subprocess): sudo nova-rootwrap /etc/nova/rootwrap.conf qemu-nbd -d /dev/nbd9 execute /opt/stack/nova/nova/openstack/common/processutils.py:147 2014-05-06 12:47:22.573 DEBUG nova.virt.disk.vfs.localfs [req-cc3cf4c6-160d-4dd4-b44d-d8f5c25fb55c admin admin] Failed to mount image Failed to mount filesystem: Unexpected error while running command. Command: sudo nova-rootwrap /etc/nova/rootwrap.conf mount /dev/nbd9 /tmp/openstack-vfs-localfsjqwQWj Exit code: 12 Please help regarding this. Thanks Sonia ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] nova compute error
Hi I changed the ebtables version i.e ebtables_2.0.9.2-2ubuntu3_powerpc.deb from version 2.0.10-4 and the error just reduced to one as below... 2014-05-03 11:26:42.052 12065 TRACE nova.openstack.common.rpc.amqp if ret == -1: raise libvirtError ('virDomainCreateWithFlags() failed', dom=self) 2014-05-03 11:26:42.052 12065 TRACE nova.openstack.common.rpc.amqp libvirtError: Error while building firewall: Some rules could not be created for interface tap9dafa3dd-7a: Failure to execute command '$EBT -t nat -A libvirt-J-tap9dafa3dd-7a -j J-tap9dafa3dd-7a-mac' : 'The kernel doesn't support a certain ebtables extension, consider recompiling your kernel or insmod the extension.'. 2014-05-03 11:26:42.052 12065 TRACE nova.openstack.common.rpc.amqp 2014-05-03 11:26:42.052 12065 TRACE nova.openstack.common.rpc.amqp 2014-05-03 11:26:45.374 12065 DEBUG nova.openstack.common.rpc.amqp [-] Making synchronous call on conductor ... multicall /opt/stack/nova/nova/o I'm using ubuntu 13.10 with powerpc architeture. Is there any other way of booting VM without the dependency of ebtables.PLease let me know. Thanks On Sat, May 3, 2014 at 12:55 PM, abhishek jain wrote: > Hi all > > I want to boot VM from controller node onto the compute node using > devstack.All my services such as nova,q-agt,nova-compute,neutron,etc are > running properly both on compute node as well on the controller node.I'm > also able to boot VMs on controller node from the openstack dashvoard > .However issue is coming when I'm booting VM from controller node onto > compute node. > Following is the error in the nova-compute logs when I'm trying to boot VM > on compute node from controller node > > > 2014-04-30 05:10:22.452 17049 TRACE nova.openstack.common.rpc.amqp if > ret == -1: raise libvirtError ('virDomainCreateWithFlags() failed', > dom=self) > 2014-04-30 05:10:22.452 17049 TRACE nova.openstack.common.rpc.amqp > libvirtError: Error while building firewall: Some rules could not be > created for interface tap74d2ff08-7f: Failure to execute command '$EBT -t > nat -A libvirt-J-tap74d2ff08-7f -j J-tap74d2ff08-7f-mac' : 'Unable to > update the kernel. Two possible causes: > 2014-04-30 05:10:22.452 17049 TRACE nova.openstack.common.rpc.amqp 1. > Multiple ebtables programs were executing simultaneously. The ebtables > 2014-04-30 05:10:22.452 17049 TRACE nova.openstack.common.rpc.amqp > userspace tool doesn't by default support multiple ebtables programs > running > 2014-04-30 05:10:22.452 17049 TRACE nova.openstack.common.rpc.amqp > concurrently. The ebtables option --concurrent or a tool like flock can be > 2014-04-30 05:10:22.452 17049 TRACE nova.openstack.common.rpc.amqpused > to support concurrent scripts that update the ebtables kernel tables. > 2014-04-30 05:10:22.452 17049 TRACE nova.openstack.common.rpc.amqp 2. The > kernel doesn't support a certain ebtables extension, consider > 2014-04-30 05:10:22.452 17049 TRACE nova.openstack.common.rpc.amqp > recompiling your kernel or insmod the extension. > 2014-04-30 05:10:22.452 17049 TRACE nova.openstack.common.rpc.amqp .'. > 2014-04-30 05:10:22.452 17049 TRACE nova.openstack.common.rpc.amqp > 2014-04-30 05:10:22.452 17049 TRACE nova.openstack.common.rpc.amqp > 2014-04-30 05:10:29.066 17049 DEBUG nova.openstack.common.rpc.amqp [-] > Making synchronous call on conductor ... multicall /opt/stack/nova/nova/o > > From the logs it appears that the command $EBT -t nat -A > libvirt-J-tap74d2ff08-7f -j J-tap74d2ff08-7f-mac is not able to update the > kernel with the ebtables rules.I have also enabled the ebtables modules(*) > in my kernel. > > Please help me regarding this. > Also is there any other way of booting the VM without updating the rules > in kernel . > > Thanks > Abhisehk Jain > > ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
[openstack-dev] nova compute error
Hi all I want to boot VM from controller node onto the compute node using devstack.All my services such as nova,q-agt,nova-compute,neutron,etc are running properly both on compute node as well on the controller node.I'm also able to boot VMs on controller node from the openstack dashvoard .However issue is coming when I'm booting VM from controller node onto compute node. Following is the error in the nova-compute logs when I'm trying to boot VM on compute node from controller node 2014-04-30 05:10:22.452 17049 TRACE nova.openstack.common.rpc.amqp if ret == -1: raise libvirtError ('virDomainCreateWithFlags() failed', dom=self) 2014-04-30 05:10:22.452 17049 TRACE nova.openstack.common.rpc.amqp libvirtError: Error while building firewall: Some rules could not be created for interface tap74d2ff08-7f: Failure to execute command '$EBT -t nat -A libvirt-J-tap74d2ff08-7f -j J-tap74d2ff08-7f-mac' : 'Unable to update the kernel. Two possible causes: 2014-04-30 05:10:22.452 17049 TRACE nova.openstack.common.rpc.amqp 1. Multiple ebtables programs were executing simultaneously. The ebtables 2014-04-30 05:10:22.452 17049 TRACE nova.openstack.common.rpc.amqp userspace tool doesn't by default support multiple ebtables programs running 2014-04-30 05:10:22.452 17049 TRACE nova.openstack.common.rpc.amqp concurrently. The ebtables option --concurrent or a tool like flock can be 2014-04-30 05:10:22.452 17049 TRACE nova.openstack.common.rpc.amqpused to support concurrent scripts that update the ebtables kernel tables. 2014-04-30 05:10:22.452 17049 TRACE nova.openstack.common.rpc.amqp 2. The kernel doesn't support a certain ebtables extension, consider 2014-04-30 05:10:22.452 17049 TRACE nova.openstack.common.rpc.amqp recompiling your kernel or insmod the extension. 2014-04-30 05:10:22.452 17049 TRACE nova.openstack.common.rpc.amqp .'. 2014-04-30 05:10:22.452 17049 TRACE nova.openstack.common.rpc.amqp 2014-04-30 05:10:22.452 17049 TRACE nova.openstack.common.rpc.amqp 2014-04-30 05:10:29.066 17049 DEBUG nova.openstack.common.rpc.amqp [-] Making synchronous call on conductor ... multicall /opt/stack/nova/nova/o >From the logs it appears that the command $EBT -t nat -A libvirt-J-tap74d2ff08-7f -j J-tap74d2ff08-7f-mac is not able to update the kernel with the ebtables rules.I have also enabled the ebtables modules(*) in my kernel. Please help me regarding this. Also is there any other way of booting the VM without updating the rules in kernel . Thanks Abhisehk Jain ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] nova-compute error
This is a development list, and your question sounds usage-related. I suggest asking again on the users list: http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack Thanks. -Ben On 04/29/2014 12:53 AM, abhishek jain wrote: Hi all I'm getting follwoing error when trying to run nova-compute service.. if ret is None: raise libvirtError ('virNodeListDevices() failed', conn=self) 2014-04-29 00:51:47.153 28127 TRACE nova.openstack.common.threadgroup libvirtError: this function is not supported by the connection driver: virNodeNumOfDevices 2014-04-29 00:51:47.153 28127 TRACE nova.openstack.common.threadgroup Please help regarding this. Thanks Abhishek Jain ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
[openstack-dev] nova-compute error
Hi all I'm getting follwoing error when trying to run nova-compute service.. if ret is None: raise libvirtError ('virNodeListDevices() failed', conn=self) 2014-04-29 00:51:47.153 28127 TRACE nova.openstack.common.threadgroup libvirtError: this function is not supported by the connection driver: virNodeNumOfDevices 2014-04-29 00:51:47.153 28127 TRACE nova.openstack.common.threadgroup Please help regarding this. Thanks Abhishek Jain ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] nova compute error
Maybe the link is help for you. http://superuser.com/questions/232807/iproute2-not-functioning-rtnetlink-answers-operation-not-supported Best regards to you. Ricky On Sat, Apr 26, 2014 at 6:29 PM, abhishek jain wrote: > Hi Ricky > > Thanks.You are right. > I'm getting following error after running the command ... > > sudo ip link add qvbb2fc7c52-ae type veth peer name qvob2fc7c52-ae > > RTNETLINK answers: Operation not supported > > Below is the description of my system.. > > uname -a > Linux t4240-ubuntu1310 3.8.13-rt9-QorIQ-SDK-V1.4 #3 SMP Wed Apr 23 > 12:11:58 CDT 2014 ppc64 ppc64 ppc64 GNU/Linux > > Plaese help regarding this. > > > On Sat, Apr 26, 2014 at 2:13 PM, Bohai (ricky) wrote: > >> It seems that the command “ip link add qvbb2fc7c52-ae type veth peer >> name qvob2fc7c52-ae” failed. >> >> Maybe you can try it manually and confirm whether it’s the reason. >> >> >> >> Best regards to you. >> >> Ricky >> >> >> >> *From:* abhishek jain [mailto:ashujain9...@gmail.com] >> *Sent:* Saturday, April 26, 2014 3:25 PM >> *To:* OpenStack Development Mailing List (not for usage questions) >> *Subject:* [openstack-dev] nova compute error >> >> >> >> Hi all.. >> >> I'm getting following nova-compute error and thus not able to boot the >> VMs on my compute node... >> >> >> nova-ompute service stopped and started giving following error... >> [02:06:44] Abhishek Jain: 2014-04-25 15:32:00.112 6501 TRACE >> nova.openstack.common.threadgroup cmd=' '.join(cmd)) >> 2014-04-25 15:32:00.112 6501 TRACE nova.openstack.common.threadgroup >> ProcessExecutionError: Unexpected error while running command. >> 2014-04-25 15:32:00.112 6501 TRACE nova.openstack.common.threadgroup >> Command: ip link add qvbb2fc7c52-ae type veth peer name qvob2fc7c52-ae >> 2014-04-25 15:32:00.112 6501 TRACE nova.openstack.common.threadgroup Exit >> code: 2 >> 2014-04-25 15:32:00.112 6501 TRACE nova.openstack.common.threadgroup >> Stdout: '' >> 2014-04-25 15:32:00.112 6501 TRACE nova.openstack.common.threadgroup >> Stderr: 'RTNETLINK answers: Operation not supported\n' >> 2014-04-25 15:32:00.112 6501 TRACE nova.openstack.common.threadgroup >> >> I'm able to run other services such as nova and q-agt on compute node and >> also the compute node is reflected on the controller node and vice versa. >> >> Please help me regarding this . >> >> Thanks >> >> Abhishek Jain >> >> ___ >> OpenStack-dev mailing list >> OpenStack-dev@lists.openstack.org >> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev >> >> > > ___ > OpenStack-dev mailing list > OpenStack-dev@lists.openstack.org > http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev > > ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] nova compute error
Hi Ricky Thanks.You are right. I'm getting following error after running the command ... sudo ip link add qvbb2fc7c52-ae type veth peer name qvob2fc7c52-ae RTNETLINK answers: Operation not supported Below is the description of my system.. uname -a Linux t4240-ubuntu1310 3.8.13-rt9-QorIQ-SDK-V1.4 #3 SMP Wed Apr 23 12:11:58 CDT 2014 ppc64 ppc64 ppc64 GNU/Linux Plaese help regarding this. On Sat, Apr 26, 2014 at 2:13 PM, Bohai (ricky) wrote: > It seems that the command “ip link add qvbb2fc7c52-ae type veth peer > name qvob2fc7c52-ae” failed. > > Maybe you can try it manually and confirm whether it’s the reason. > > > > Best regards to you. > > Ricky > > > > *From:* abhishek jain [mailto:ashujain9...@gmail.com] > *Sent:* Saturday, April 26, 2014 3:25 PM > *To:* OpenStack Development Mailing List (not for usage questions) > *Subject:* [openstack-dev] nova compute error > > > > Hi all.. > > I'm getting following nova-compute error and thus not able to boot the VMs > on my compute node... > > > nova-ompute service stopped and started giving following error... > [02:06:44] Abhishek Jain: 2014-04-25 15:32:00.112 6501 TRACE > nova.openstack.common.threadgroup cmd=' '.join(cmd)) > 2014-04-25 15:32:00.112 6501 TRACE nova.openstack.common.threadgroup > ProcessExecutionError: Unexpected error while running command. > 2014-04-25 15:32:00.112 6501 TRACE nova.openstack.common.threadgroup > Command: ip link add qvbb2fc7c52-ae type veth peer name qvob2fc7c52-ae > 2014-04-25 15:32:00.112 6501 TRACE nova.openstack.common.threadgroup Exit > code: 2 > 2014-04-25 15:32:00.112 6501 TRACE nova.openstack.common.threadgroup > Stdout: '' > 2014-04-25 15:32:00.112 6501 TRACE nova.openstack.common.threadgroup > Stderr: 'RTNETLINK answers: Operation not supported\n' > 2014-04-25 15:32:00.112 6501 TRACE nova.openstack.common.threadgroup > > I'm able to run other services such as nova and q-agt on compute node and > also the compute node is reflected on the controller node and vice versa. > > Please help me regarding this . > > Thanks > > Abhishek Jain > > ___ > OpenStack-dev mailing list > OpenStack-dev@lists.openstack.org > http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev > > ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
Re: [openstack-dev] nova compute error
It seems that the command “ip link add qvbb2fc7c52-ae type veth peer name qvob2fc7c52-ae” failed. Maybe you can try it manually and confirm whether it’s the reason. Best regards to you. Ricky From: abhishek jain [mailto:ashujain9...@gmail.com] Sent: Saturday, April 26, 2014 3:25 PM To: OpenStack Development Mailing List (not for usage questions) Subject: [openstack-dev] nova compute error Hi all.. I'm getting following nova-compute error and thus not able to boot the VMs on my compute node... nova-ompute service stopped and started giving following error... [02:06:44] Abhishek Jain: 2014-04-25 15:32:00.112 6501 TRACE nova.openstack.common.threadgroup cmd=' '.join(cmd)) 2014-04-25 15:32:00.112 6501 TRACE nova.openstack.common.threadgroup ProcessExecutionError: Unexpected error while running command. 2014-04-25 15:32:00.112 6501 TRACE nova.openstack.common.threadgroup Command: ip link add qvbb2fc7c52-ae type veth peer name qvob2fc7c52-ae 2014-04-25 15:32:00.112 6501 TRACE nova.openstack.common.threadgroup Exit code: 2 2014-04-25 15:32:00.112 6501 TRACE nova.openstack.common.threadgroup Stdout: '' 2014-04-25 15:32:00.112 6501 TRACE nova.openstack.common.threadgroup Stderr: 'RTNETLINK answers: Operation not supported\n' 2014-04-25 15:32:00.112 6501 TRACE nova.openstack.common.threadgroup I'm able to run other services such as nova and q-agt on compute node and also the compute node is reflected on the controller node and vice versa. Please help me regarding this . Thanks Abhishek Jain ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
[openstack-dev] nova compute error
Hi all.. I'm getting following nova-compute error and thus not able to boot the VMs on my compute node... nova-ompute service stopped and started giving following error... [02:06:44] Abhishek Jain: 2014-04-25 15:32:00.112 6501 TRACE nova.openstack.common.threadgroup cmd=' '.join(cmd)) 2014-04-25 15:32:00.112 6501 TRACE nova.openstack.common.threadgroup ProcessExecutionError: Unexpected error while running command. 2014-04-25 15:32:00.112 6501 TRACE nova.openstack.common.threadgroup Command: ip link add qvbb2fc7c52-ae type veth peer name qvob2fc7c52-ae 2014-04-25 15:32:00.112 6501 TRACE nova.openstack.common.threadgroup Exit code: 2 2014-04-25 15:32:00.112 6501 TRACE nova.openstack.common.threadgroup Stdout: '' 2014-04-25 15:32:00.112 6501 TRACE nova.openstack.common.threadgroup Stderr: 'RTNETLINK answers: Operation not supported\n' 2014-04-25 15:32:00.112 6501 TRACE nova.openstack.common.threadgroup I'm able to run other services such as nova and q-agt on compute node and also the compute node is reflected on the controller node and vice versa. Please help me regarding this . Thanks Abhishek Jain ___ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev