When i temporarily hard code the network_name variable in /usr/lib/python2.7/dist-packages/nova/virt/vmwareapi/vmops.py as below:
def _get_vif_infos(): vif_infos = [] for (network, mapping) in network_info: mac_address = mapping['mac'] #Balu #network_name = network['bridge'] network_name = 'br-eth1' The instance creation proceeds and then errors for another reason as shown below: 2013-01-23 08:35:12 DEBUG nova.virt.vmwareapi.read_write_util [req-ec9d0530-ca3d-4a8e-8166-834f6e11ed32 9ac7dbe62fb349ce84927598a0f54d68 b439758af3814f739fe7ab09b98a0120] Exception during HTTP connection close in VMWareHTTpWrite. Exception is '' from (pid=14354) close /usr/lib/python2.7/dist-packages/nova/virt/vmwareapi/read_write_util.py:146 2013-01-23 08:35:12 DEBUG nova.virt.vmwareapi.vmware_images [req-ec9d0530-ca3d-4a8e-8166-834f6e11ed32 9ac7dbe62fb349ce84927598a0f54d68 b439758af3814f739fe7ab09b98a0120] [instance: 6a0bfd1b-e4c4-4430-8898-312e73decd62] Downloaded image 4d70a998-a51e-4557-81fa-23747db12305 from glance image server from (pid=14354) fetch_image /usr/lib/python2.7/dist-packages/nova/virt/vmwareapi/vmware_images.py:109 2013-01-23 08:35:12 DEBUG nova.virt.vmwareapi.read_write_util [req-ec9d0530-ca3d-4a8e-8166-834f6e11ed32 9ac7dbe62fb349ce84927598a0f54d68 b439758af3814f739fe7ab09b98a0120] Exception during HTTP connection close in VMWareHTTpWrite. Exception is from (pid=14354) close /usr/lib/python2.7/dist-packages/nova/virt/vmwareapi/read_write_util.py:146 2013-01-23 08:35:12 DEBUG nova.virt.vmwareapi.vmops [req-ec9d0530-ca3d-4a8e-8166-834f6e11ed32 9ac7dbe62fb349ce84927598a0f54d68 b439758af3814f739fe7ab09b98a0120] [instance: 6a0bfd1b-e4c4-4430-8898-312e73decd62] Downloaded image file data 4d70a998-a51e-4557-81fa-23747db12305 to the ESX data store datastore1 from (pid=14354) _fetch_image_on_esx_datastore /usr/lib/python2.7/dist-packages/nova/virt/vmwareapi/vmops.py:308 2013-01-23 08:35:19 DEBUG nova.virt.vmwareapi.vmops [req-ec9d0530-ca3d-4a8e-8166-834f6e11ed32 9ac7dbe62fb349ce84927598a0f54d68 b439758af3814f739fe7ab09b98a0120] [instance: 6a0bfd1b-e4c4-4430-8898-312e73decd62] Reconfiguring VM instance to attach the image disk from (pid=14354) _attach_vmdk_to_the_vm /usr/lib/python2.7/dist-packages/nova/virt/vmwareapi/vmops.py:323 2013-01-23 08:35:27 WARNING nova.virt.vmwareapi.driver [-] Task [ReconfigVM_Task] (returnval){ value = "haTask-23-vim.VirtualMachine.reconfigure-449287255" _type = "Task" } status: error Unable to access file /vmfs/volumes/5088d916-58b2aa06-6a35-d4ae52a0f879/instance-0000003f/instance-0000003f.vmdk 2013-01-23 08:35:27 ERROR nova.compute.manager [req-ec9d0530-ca3d-4a8e-8166-834f6e11ed32 9ac7dbe62fb349ce84927598a0f54d68 b439758af3814f739fe7ab09b98a0120] [instance: 6a0bfd1b-e4c4-4430-8898-312e73decd62] Instance failed to spawn The file actually exists on the ESXi Server, but its size is just a few bytes. So looks like it was still copying when it aborted. There are a few exception in VMWareHTTpWrite as well. So there are two issues: 1. Its not picking up the bridge name 2. Unable to access(or copy) the vmdk instance file Regards, Balu On Wed, Jan 23, 2013 at 4:08 PM, Balamurugan V G <balamuruga...@gmail.com>wrote: > I see that there is no value being passed for 'bridge'. The snippet from > the nova-compute log just before the Execption is below: > > > 2013-01-23 02:33:37 DEBUG nova.compute.manager > [req-9c972e4e-3f8b-4cc3-b151-963b71f0b9a2 9ac7dbe62fb349ce84927598a0f54d68 > b439758af3814f739fe7ab09b98a0120] [instance: > ad7a8f84-f303-4733-9822-2e81b7cbc407] Instance network_info: > |[VIF({'network': Network({*'bridge': '',* 'subnets': [Subnet({'ips': > [FixedIP({'meta': {}, 'version': 4, 'type': 'fixed', 'floating_ips': [], > 'address': u'50.50.1.4'})], 'version': 4, 'meta': {'dhcp_server': > u'50.50.1.2'}, 'dns': [], 'routes': [], 'cidr': u'50.50.1.0/24', > 'gateway': IP({'meta': {}, 'version': 4, 'type': 'gateway', 'address': > u'50.50.1.1'})})], 'meta': {'injected': False, 'tenant_id': > u'b439758af3814f739fe7ab09b98a0120'}, 'id': > u'dcef8ce4-dff0-4a54-9112-9695c28c02d5', 'label': u'net1'}), 'meta': {}, > 'id': u'0c68ea85-b289-486e-bdaf-999bc35256a9', 'address': > u'fa:16:3e:45:e5:6b'})]| from (pid=13103) _allocate_network > /usr/lib/python2.7/dist-packages/nova/compute/manager.py:715 > > What could be going wrong here? > > Regards, > Balu > > On Wed, Jan 23, 2013 at 1:08 PM, Balamurugan V G > <balamuruga...@gmail.com>wrote: > >> Hi, >> >> I have a two node OpenStack Folsom Setup. One node runs all services with >> KVM. The other nodes is a Compute Node for ESXi 5.1. I have set the >> availabality_zones for each of this so that I can schedule instances as per >> my need. I am able to operate the instances on the KVM just fine. But when >> I launch an instance for ESXi, it goes to ERROR state with the error >> 'NetworkNotFoundForBridge: Network could not be found for bridge'. >> >> After the vanilla Folsom installation, I was getting an AttribueError >> which got fixed after applying the patch at >> https://bugs.launchpad.net/nova/+bug/1063885 >> >> But then after that, I am seeing this error. >> >> root@openstack-kvm:~# nova show 8110c50c-ed26-48dd-886b-71b44ee382dd >> >> +-------------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------+ >> | Property | Value >> >> | >> >> +-------------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------+ >> | OS-DCF:diskConfig | MANUAL >> >> | >> | OS-EXT-SRV-ATTR:host | openstack-esxi >> >> | >> | OS-EXT-SRV-ATTR:hypervisor_hostname | None >> >> | >> | OS-EXT-SRV-ATTR:instance_name | instance-00000016 >> >> | >> | OS-EXT-STS:power_state | 0 >> >> | >> | OS-EXT-STS:task_state | None >> >> | >> | OS-EXT-STS:vm_state | error >> >> | >> | accessIPv4 | >> >> | >> | accessIPv6 | >> >> | >> | config_drive | >> >> | >> | created | 2013-01-23T07:13:11Z >> >> | >> | fault | {u'message': >> u'NetworkNotFoundForBridge', u'code': 404, u'details': u'Network could not >> be found for bridge ', u'created': u'2013-01-23T07:13:14Z'} | >> | flavor | m1.tiny (6) >> >> | >> | hostId | >> a9edbd6bb1136ff3bcf5225d1f6a34e0d18cc21eb9837acd67dec105 >> | >> | id | >> 8110c50c-ed26-48dd-886b-71b44ee382dd >> | >> | image | Ubuntu1204 >> (4d70a998-a51e-4557-81fa-23747db12305) >> | >> | key_name | None >> >> | >> | metadata | {} >> >> | >> | name | VM2 >> >> | >> | security_groups | [{u'name': u'default'}] >> >> | >> | status | ERROR >> >> | >> | tenant_id | b439758af3814f739fe7ab09b98a0120 >> >> | >> | updated | 2013-01-23T07:13:14Z >> >> | >> | user_id | 9ac7dbe62fb349ce84927598a0f54d68 >> >> | >> >> +-------------------------------------+-----------------------------------------------------------------------------------------------------------------------------------------------------+ >> root@openstack-kvm:~# >> >> My /etc/nova/nova.conf on the ESXi compute nodes is: >> >> [DEFAULT] >> logdir=/var/log/nova >> state_path=/var/lib/nova >> lock_path=/run/lock/nova >> verbose=True >> api_paste_config=/etc/nova/api-paste.ini >> scheduler_driver=nova.scheduler.simple.SimpleScheduler >> s3_host=10.5.3.230 >> ec2_host=10.5.3.230 >> ec2_dmz_host=10.5.3.230 >> rabbit_host=10.5.3.230 >> cc_host=10.5.3.230 >> dmz_cidr=169.254.169.254/32 >> metadata_host=10.5.3.230 >> metadata_listen=0.0.0.0 >> nova_url=http://10.5.3.230:8774/v1.1/ >> sql_connection=mysql://novaUser:novaPass@10.5.3.230/nova >> ec2_url=http://10.5.3.230:8773/services/Cloud >> root_helper=sudo nova-rootwrap /etc/nova/rootwrap.conf >> my_ip=10.5.3.231 >> >> # Auth >> use_deprecated_auth=false >> auth_strategy=keystone >> keystone_ec2_url=http://10.5.3.230:5000/v2.0/ec2tokens >> # Imaging service >> glance_api_servers=10.5.3.230:9292 >> image_service=nova.image.glance.GlanceImageService >> >> # Vnc configuration >> novnc_enabled=true >> novncproxy_base_url=http://10.5.12.20:6080/vnc_auto.html >> novncproxy_port=6080 >> vncserver_proxyclient_address=10.5.12.20 >> vncserver_listen=0.0.0.0 >> >> # Network settings >> network_api_class=nova.network.quantumv2.api.API >> quantum_url=http://10.5.3.230:9696 >> quantum_auth_strategy=keystone >> quantum_admin_tenant_name=service >> quantum_admin_username=quantum >> quantum_admin_password=service_pass >> quantum_admin_auth_url=http://10.5.3.230:35357/v2.0 >> libvirt_vif_driver=nova.virt.libvirt.vif.LibvirtHybridOVSBridgeDriver >> linuxnet_interface_driver=nova.network.linux_net.LinuxOVSInterfaceDriver >> firewall_driver=nova.virt.libvirt.firewall.IptablesFirewallDriver >> >> # Compute # >> compute_driver= vmwareapi.VMWareESXDriver >> vmwareapi_host_ip=10.5.3.99 >> vmwareapi_host_username=root >> vmwareapi_host_password=S0nicwall >> vmwareapi_wsdl_loc= >> http://127.0.0.1:8080/vmware/SDK/vsphere-ws/wsdl/vim25/vimService.wsdl >> connection_type = vmwareapi >> vmware_vif_driver = nova.virt.vmwareapi.vif.VMWareVlanBridgeDriver >> console_manager = nova.console.vmrc_manager.ConsoleVMRCManager >> vmwareapi_vlan_interface= vmnic4 >> node_availability_zone=zone2 >> >> # Cinder # >> volume_api_class=nova.volume.cinder.API >> osapi_volume_listen_port=5900 >> >> >> The log snippet from nova-compute.log is below: >> >> >> 2013-01-22 23:13:14 TRACE nova.compute.manager [instance: >> 8110c50c-ed26-48dd-886b-71b44ee382dd] Traceback (most recent call last): >> 2013-01-22 23:13:14 TRACE nova.compute.manager [instance: >> 8110c50c-ed26-48dd-886b-71b44ee382dd] File >> "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 743, in >> _spawn >> 2013-01-22 23:13:14 TRACE nova.compute.manager [instance: >> 8110c50c-ed26-48dd-886b-71b44ee382dd] block_device_info) >> 2013-01-22 23:13:14 TRACE nova.compute.manager [instance: >> 8110c50c-ed26-48dd-886b-71b44ee382dd] File >> "/usr/lib/python2.7/dist-packages/nova/virt/vmwareapi/driver.py", line 132, >> in spawn >> 2013-01-22 23:13:14 TRACE nova.compute.manager [instance: >> 8110c50c-ed26-48dd-886b-71b44ee382dd] self._vmops.spawn(context, >> instance, image_meta, network_info) >> 2013-01-22 23:13:14 TRACE nova.compute.manager [instance: >> 8110c50c-ed26-48dd-886b-71b44ee382dd] File >> "/usr/lib/python2.7/dist-packages/nova/virt/vmwareapi/vmops.py", line 187, >> in spawn >> 2013-01-22 23:13:14 TRACE nova.compute.manager [instance: >> 8110c50c-ed26-48dd-886b-71b44ee382dd] vif_infos = _get_vif_infos() >> 2013-01-22 23:13:14 TRACE nova.compute.manager [instance: >> 8110c50c-ed26-48dd-886b-71b44ee382dd] File >> "/usr/lib/python2.7/dist-packages/nova/virt/vmwareapi/vmops.py", line 180, >> in _get_vif_infos >> 2013-01-22 23:13:14 TRACE nova.compute.manager [instance: >> 8110c50c-ed26-48dd-886b-71b44ee382dd] network_ref = >> _check_if_network_bridge_exists(network_name) >> 2013-01-22 23:13:14 TRACE nova.compute.manager [instance: >> 8110c50c-ed26-48dd-886b-71b44ee382dd] File >> "/usr/lib/python2.7/dist-packages/nova/virt/vmwareapi/vmops.py", line 168, >> in _check_if_network_bridge_exists >> 2013-01-22 23:13:14 TRACE nova.compute.manager [instance: >> 8110c50c-ed26-48dd-886b-71b44ee382dd] raise >> exception.NetworkNotFoundForBridge(bridge=network_name) >> 2013-01-22 23:13:14 TRACE nova.compute.manager [instance: >> 8110c50c-ed26-48dd-886b-71b44ee382dd] NetworkNotFoundForBridge: Network >> could not be found for bridge >> 2013-01-22 23:13:14 TRACE nova.compute.manager [instance: >> 8110c50c-ed26-48dd-886b-71b44ee382dd] >> 2013-01-22 23:13:14 DEBUG nova.compute.manager >> [req-16f199b5-f891-48b6-9020-9b8149535b9a 9ac7dbe62fb349ce84927598a0f54d68 >> b439758af3814f739fe7ab09b98a0120] [instance: >> 8110c50c-ed26-48dd-886b-71b44ee382dd] Deallocating network for instance >> from (pid=2686) _deallocate_network >> /usr/lib/python2.7/dist-packages/nova/compute/manager.py:769 >> 2013-01-22 23:13:14 DEBUG nova.network.quantumv2.api >> [req-16f199b5-f891-48b6-9020-9b8149535b9a 9ac7dbe62fb349ce84927598a0f54d68 >> b439758af3814f739fe7ab09b98a0120] deallocate_for_instance() for VM2 from >> (pid=2686) deallocate_for_instance >> /usr/lib/python2.7/dist-packages/nova/network/quantumv2/api.py:160 >> 2013-01-22 23:13:14 DEBUG nova.compute.manager >> [req-16f199b5-f891-48b6-9020-9b8149535b9a 9ac7dbe62fb349ce84927598a0f54d68 >> b439758af3814f739fe7ab09b98a0120] [instance: >> 8110c50c-ed26-48dd-886b-71b44ee382dd] Retry info not present, will not >> reschedule from (pid=2686) _reschedule >> /usr/lib/python2.7/dist-packages/nova/compute/manager.py:564 >> 2013-01-22 23:13:14 DEBUG nova.utils >> [req-16f199b5-f891-48b6-9020-9b8149535b9a 9ac7dbe62fb349ce84927598a0f54d68 >> b439758af3814f739fe7ab09b98a0120] Got semaphore "compute_resources" for >> method "update_usage"... from (pid=2686) inner >> /usr/lib/python2.7/dist-packages/nova/utils.py:713 >> 2013-01-22 23:13:14 DEBUG nova.utils >> [req-16f199b5-f891-48b6-9020-9b8149535b9a 9ac7dbe62fb349ce84927598a0f54d68 >> b439758af3814f739fe7ab09b98a0120] Got semaphore "compute_resources" for >> method "update_usage"... from (pid=2686) inner >> /usr/lib/python2.7/dist-packages/nova/utils.py:713 >> 2013-01-22 23:13:14 ERROR nova.openstack.common.rpc.amqp [-] Exception >> during message handling >> 2013-01-22 23:13:14 TRACE nova.openstack.common.rpc.amqp Traceback (most >> recent call last): >> 2013-01-22 23:13:14 TRACE nova.openstack.common.rpc.amqp File >> "/usr/lib/python2.7/dist-packages/nova/openstack/common/rpc/amqp.py", line >> 275, in _process_data >> 2013-01-22 23:13:14 TRACE nova.openstack.common.rpc.amqp rval = >> self.proxy.dispatch(ctxt, version, method, **args) >> 2013-01-22 23:13:14 TRACE nova.openstack.common.rpc.amqp File >> "/usr/lib/python2.7/dist-packages/nova/openstack/common/rpc/dispatcher.py", >> line 145, in dispatch >> 2013-01-22 23:13:14 TRACE nova.openstack.common.rpc.amqp return >> getattr(proxyobj, method)(ctxt, **kwargs) >> 2013-01-22 23:13:14 TRACE nova.openstack.common.rpc.amqp File >> "/usr/lib/python2.7/dist-packages/nova/exception.py", line 117, in wrapped >> 2013-01-22 23:13:14 TRACE nova.openstack.common.rpc.amqp temp_level, >> payload) >> 2013-01-22 23:13:14 TRACE nova.openstack.common.rpc.amqp File >> "/usr/lib/python2.7/contextlib.py", line 24, in __exit__ >> 2013-01-22 23:13:14 TRACE nova.openstack.common.rpc.amqp >> self.gen.next() >> 2013-01-22 23:13:14 TRACE nova.openstack.common.rpc.amqp File >> "/usr/lib/python2.7/dist-packages/nova/exception.py", line 92, in wrapped >> 2013-01-22 23:13:14 TRACE nova.openstack.common.rpc.amqp return >> f(*args, **kw) >> 2013-01-22 23:13:14 TRACE nova.openstack.common.rpc.amqp File >> "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 181, in >> decorated_function >> 2013-01-22 23:13:14 TRACE nova.openstack.common.rpc.amqp pass >> 2013-01-22 23:13:14 TRACE nova.openstack.common.rpc.amqp File >> "/usr/lib/python2.7/contextlib.py", line 24, in __exit__ >> 2013-01-22 23:13:14 TRACE nova.openstack.common.rpc.amqp >> self.gen.next() >> 2013-01-22 23:13:14 TRACE nova.openstack.common.rpc.amqp File >> "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 167, in >> decorated_function >> 2013-01-22 23:13:14 TRACE nova.openstack.common.rpc.amqp return >> function(self, context, *args, **kwargs) >> 2013-01-22 23:13:14 TRACE nova.openstack.common.rpc.amqp File >> "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 202, in >> decorated_function >> 2013-01-22 23:13:14 TRACE nova.openstack.common.rpc.amqp >> kwargs['instance']['uuid'], e, sys.exc_info()) >> 2013-01-22 23:13:14 TRACE nova.openstack.common.rpc.amqp File >> "/usr/lib/python2.7/contextlib.py", line 24, in __exit__ >> 2013-01-22 23:13:14 TRACE nova.openstack.common.rpc.amqp >> self.gen.next() >> 2013-01-22 23:13:14 TRACE nova.openstack.common.rpc.amqp File >> "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 196, in >> decorated_function >> 2013-01-22 23:13:14 TRACE nova.openstack.common.rpc.amqp return >> function(self, context, *args, **kwargs) >> 2013-01-22 23:13:14 TRACE nova.openstack.common.rpc.amqp File >> "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 824, in >> run_instance >> 2013-01-22 23:13:14 TRACE nova.openstack.common.rpc.amqp >> do_run_instance() >> 2013-01-22 23:13:14 TRACE nova.openstack.common.rpc.amqp File >> "/usr/lib/python2.7/dist-packages/nova/utils.py", line 752, in inner >> 2013-01-22 23:13:14 TRACE nova.openstack.common.rpc.amqp retval = >> f(*args, **kwargs) >> 2013-01-22 23:13:14 TRACE nova.openstack.common.rpc.amqp File >> "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 823, in >> do_run_instance >> 2013-01-22 23:13:14 TRACE nova.openstack.common.rpc.amqp >> admin_password, is_first_time, instance) >> 2013-01-22 23:13:14 TRACE nova.openstack.common.rpc.amqp File >> "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 516, in >> _run_instance >> 2013-01-22 23:13:14 TRACE nova.openstack.common.rpc.amqp >> self._set_instance_error_state(context, instance['uuid']) >> 2013-01-22 23:13:14 TRACE nova.openstack.common.rpc.amqp File >> "/usr/lib/python2.7/contextlib.py", line 24, in __exit__ >> 2013-01-22 23:13:14 TRACE nova.openstack.common.rpc.amqp >> self.gen.next() >> 2013-01-22 23:13:14 TRACE nova.openstack.common.rpc.amqp File >> "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 504, in >> _run_instance >> 2013-01-22 23:13:14 TRACE nova.openstack.common.rpc.amqp >> is_first_time, request_spec, filter_properties) >> 2013-01-22 23:13:14 TRACE nova.openstack.common.rpc.amqp File >> "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 496, in >> _run_instance >> 2013-01-22 23:13:14 TRACE nova.openstack.common.rpc.amqp >> injected_files, admin_password) >> 2013-01-22 23:13:14 TRACE nova.openstack.common.rpc.amqp File >> "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 743, in >> _spawn >> 2013-01-22 23:13:14 TRACE nova.openstack.common.rpc.amqp >> block_device_info) >> 2013-01-22 23:13:14 TRACE nova.openstack.common.rpc.amqp File >> "/usr/lib/python2.7/dist-packages/nova/virt/vmwareapi/driver.py", line 132, >> in spawn >> 2013-01-22 23:13:14 TRACE nova.openstack.common.rpc.amqp >> self._vmops.spawn(context, instance, image_meta, network_info) >> 2013-01-22 23:13:14 TRACE nova.openstack.common.rpc.amqp File >> "/usr/lib/python2.7/dist-packages/nova/virt/vmwareapi/vmops.py", line 187, >> in spawn >> 2013-01-22 23:13:14 TRACE nova.openstack.common.rpc.amqp vif_infos = >> _get_vif_infos() >> 2013-01-22 23:13:14 TRACE nova.openstack.common.rpc.amqp File >> "/usr/lib/python2.7/dist-packages/nova/virt/vmwareapi/vmops.py", line 180, >> in _get_vif_infos >> 2013-01-22 23:13:14 TRACE nova.openstack.common.rpc.amqp network_ref >> = _check_if_network_bridge_exists(network_name) >> 2013-01-22 23:13:14 TRACE nova.openstack.common.rpc.amqp File >> "/usr/lib/python2.7/dist-packages/nova/virt/vmwareapi/vmops.py", line 168, >> in _check_if_network_bridge_exists >> 2013-01-22 23:13:14 TRACE nova.openstack.common.rpc.amqp raise >> exception.NetworkNotFoundForBridge(bridge=network_name) >> 2013-01-22 23:13:14 TRACE nova.openstack.common.rpc.amqp >> NetworkNotFoundForBridge: Network could not be found for bridge >> 2013-01-22 23:13:14 TRACE nova.openstack.common.rpc.amqp >> >> Any help will be greatly appreciated. >> >> Thanks, >> Balu >> > >
_______________________________________________ Mailing list: https://launchpad.net/~openstack Post to : openstack@lists.launchpad.net Unsubscribe : https://launchpad.net/~openstack More help : https://help.launchpad.net/ListHelp