** Changed in: nova/grizzly Status: Fix Committed => Fix Released
-- You received this bug notification because you are a member of Yahoo! Engineering Team, which is subscribed to OpenStack Compute (nova). https://bugs.launchpad.net/bugs/1184807 Title: Snapshot failure with VMwareVCDriver Status in OpenStack Compute (Nova): Fix Released Status in OpenStack Compute (nova) grizzly series: Fix Released Status in The OpenStack VMwareAPI subTeam: Fix Committed Bug description: I am unable to get snapshots working in my dev setup with the VCDriver. snapshot API call claims to succeed, but we get an internal exception (below) and the snapshot stays in 'queued' status in Horizon. The relevant code is here: https://github.com/openstack/nova/blob/master/nova/virt/vmwareapi/vmops.py#L515 It seems like the underlying snapshot succeeds, but the attempt to copy the disk afterward fails. Browsing the datastore, I see that a vmware-tmp directory was created, but I do not see any files in it. space/stack/nova/nova/openstack/common/rpc/amqp.py:337 2013-05-27 17:15:04.615 DEBUG nova.virt.vmwareapi.driver [-] Task [CreateSnapshot_Task] (returnval){ value = "task-123" _type = "Task" } status: success from (pid=4595) _poll_task /extraspace/stack/nova/nova/virt/vmwareapi/driver.py:576 2013-05-27 17:15:04.615 DEBUG nova.virt.vmwareapi.vmops [req-5a19f94a-6e87-4196-8bbd-4ea396e2f04f demo demo] [instance: 0d044e1b-074b-47de-9002-de5d87230aa5] Created Snapshot of the VM instance from (pid=4595) _create_vm_snapshot /extraspace/stack/nova/nova/virt/vmwareapi/vmops.py:477 2013-05-27 17:15:04.616 DEBUG nova.openstack.common.rpc.amqp [req-5a19f94a-6e87-4196-8bbd-4ea396e2f04f demo demo] Making synchronous call on conductor ... from (pid=4595) multicall /extraspace/stack/nova/nova/openstack/common/rpc/amqp.py:586 2013-05-27 17:15:04.616 DEBUG nova.openstack.common.rpc.amqp [req-5a19f94a-6e87-4196-8bbd-4ea396e2f04f demo demo] MSG_ID is 43832e8692c64fdeabba8b34c531b682 from (pid=4595) multicall /extraspace/stack/nova/nova/openstack/common/rpc/amqp.py:589 2013-05-27 17:15:04.617 DEBUG nova.openstack.common.rpc.amqp [req-5a19f94a-6e87-4196-8bbd-4ea396e2f04f demo demo] UNIQUE_ID is ff2a695783ba459e8aef5a0097eefb95. from (pid=4595) _add_unique_id /extraspace/stack/nova/nova/openstack/common/rpc/amqp.py:337 2013-05-27 17:15:04.981 DEBUG nova.openstack.common.lockutils [req-5a19f94a-6e87-4196-8bbd-4ea396e2f04f demo demo] Got semaphore "compute_resources" for method "update_usage"... from (pid=4595) inner /extraspace/stack/nova/nova/openstack/common/lockutils.py:186 2013-05-27 17:15:04.982 DEBUG nova.openstack.common.rpc.amqp [req-5a19f94a-6e87-4196-8bbd-4ea396e2f04f demo demo] Making synchronous call on conductor ... from (pid=4595) multicall /extraspace/stack/nova/nova/openstack/common/rpc/amqp.py:586 2013-05-27 17:15:04.982 DEBUG nova.openstack.common.rpc.amqp [req-5a19f94a-6e87-4196-8bbd-4ea396e2f04f demo demo] MSG_ID is 8de1b35ad1624e4cbbd25dca3b7ff41e from (pid=4595) multicall /extraspace/stack/nova/nova/openstack/common/rpc/amqp.py:589 2013-05-27 17:15:04.983 DEBUG nova.openstack.common.rpc.amqp [req-5a19f94a-6e87-4196-8bbd-4ea396e2f04f demo demo] UNIQUE_ID is 96b0cd1f45e84bc486863e9bab4b1b8f. from (pid=4595) _add_unique_id /extraspace/stack/nova/nova/openstack/common/rpc/amqp.py:337 2013-05-27 17:15:05.174 DEBUG nova.virt.vmwareapi.vmops [req-5a19f94a-6e87-4196-8bbd-4ea396e2f04f demo demo] [instance: 0d044e1b-074b-47de-9002-de5d87230aa5] Copying disk data before snapshot of the VM from (pid=4595) _copy_vmdk_content /extraspace/stack/nova/nova/virt/vmwareapi/vmops.py:522 2013-05-27 17:15:05.222 WARNING nova.virt.vmwareapi.driver [-] Task [CopyVirtualDisk_Task] (returnval){ value = "task-124" _type = "Task" } status: error The requested operation is not implemented by the server. 2013-05-27 17:15:05.224 DEBUG nova.openstack.common.rpc.amqp [req-5a19f94a-6e87-4196-8bbd-4ea396e2f04f demo demo] Making synchronous call on conductor ... from (pid=4595) multicall /extraspace/stack/nova/nova/openstack/common/rpc/amqp.py:586 2013-05-27 17:15:05.224 DEBUG nova.openstack.common.rpc.amqp [req-5a19f94a-6e87-4196-8bbd-4ea396e2f04f demo demo] MSG_ID is 838e0c86a1b04e46856ed43797442f6f from (pid=4595) multicall /extraspace/stack/nova/nova/openstack/common/rpc/amqp.py:589 2013-05-27 17:15:05.225 DEBUG nova.openstack.common.rpc.amqp [req-5a19f94a-6e87-4196-8bbd-4ea396e2f04f demo demo] UNIQUE_ID is bcb86dcabbb040bf81bfa0a0676e4b14. from (pid=4595) _add_unique_id /extraspace/stack/nova/nova/openstack/common/rpc/amqp.py:337 2013-05-27 17:15:05.244 DEBUG nova.openstack.common.rpc.amqp [req-5a19f94a-6e87-4196-8bbd-4ea396e2f04f demo demo] Making synchronous call on conductor ... from (pid=4595) multicall /extraspace/stack/nova/nova/openstack/common/rpc/amqp.py:586 2013-05-27 17:15:05.244 DEBUG nova.openstack.common.rpc.amqp [req-5a19f94a-6e87-4196-8bbd-4ea396e2f04f demo demo] MSG_ID is 41c6cb58361f4686b717f3e3f3074178 from (pid=4595) multicall /extraspace/stack/nova/nova/openstack/common/rpc/amqp.py:589 2013-05-27 17:15:05.244 DEBUG nova.openstack.common.rpc.amqp [req-5a19f94a-6e87-4196-8bbd-4ea396e2f04f demo demo] UNIQUE_ID is c732adbadd424eb1ac56d2e259041600. from (pid=4595) _add_unique_id /extraspace/stack/nova/nova/openstack/common/rpc/amqp.py:337 2013-05-27 17:15:05.624 DEBUG nova.openstack.common.lockutils [req-5a19f94a-6e87-4196-8bbd-4ea396e2f04f demo demo] Got semaphore "compute_resources" for method "update_usage"... from (pid=4595) inner /extraspace/stack/nova/nova/openstack/common/lockutils.py:186 2013-05-27 17:15:05.625 DEBUG nova.openstack.common.rpc.amqp [req-5a19f94a-6e87-4196-8bbd-4ea396e2f04f demo demo] Making synchronous call on conductor ... from (pid=4595) multicall /extraspace/stack/nova/nova/openstack/common/rpc/amqp.py:586 2013-05-27 17:15:05.626 DEBUG nova.openstack.common.rpc.amqp [req-5a19f94a-6e87-4196-8bbd-4ea396e2f04f demo demo] MSG_ID is 206d42da6b5947caaaa3473d80744544 from (pid=4595) multicall /extraspace/stack/nova/nova/openstack/common/rpc/amqp.py:589 2013-05-27 17:15:05.626 DEBUG nova.openstack.common.rpc.amqp [req-5a19f94a-6e87-4196-8bbd-4ea396e2f04f demo demo] UNIQUE_ID is 2ab81258b1c8413e83eb278d4d3539a2. from (pid=4595) _add_unique_id /extraspace/stack/nova/nova/openstack/common/rpc/amqp.py:337 2013-05-27 17:15:05.672 ERROR nova.openstack.common.rpc.amqp [req-5a19f94a-6e87-4196-8bbd-4ea396e2f04f demo demo] Exception during message handling 2013-05-27 17:15:05.672 TRACE nova.openstack.common.rpc.amqp Traceback (most recent call last): 2013-05-27 17:15:05.672 TRACE nova.openstack.common.rpc.amqp File "/extraspace/stack/nova/nova/openstack/common/rpc/amqp.py", line 433, in _process_data 2013-05-27 17:15:05.672 TRACE nova.openstack.common.rpc.amqp **args) 2013-05-27 17:15:05.672 TRACE nova.openstack.common.rpc.amqp File "/extraspace/stack/nova/nova/openstack/common/rpc/dispatcher.py", line 148, in dispatch 2013-05-27 17:15:05.672 TRACE nova.openstack.common.rpc.amqp return getattr(proxyobj, method)(ctxt, **kwargs) 2013-05-27 17:15:05.672 TRACE nova.openstack.common.rpc.amqp File "/extraspace/stack/nova/nova/exception.py", line 98, in wrapped 2013-05-27 17:15:05.672 TRACE nova.openstack.common.rpc.amqp temp_level, payload) 2013-05-27 17:15:05.672 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/contextlib.py", line 24, in __exit__ 2013-05-27 17:15:05.672 TRACE nova.openstack.common.rpc.amqp self.gen.next() 2013-05-27 17:15:05.672 TRACE nova.openstack.common.rpc.amqp File "/extraspace/stack/nova/nova/exception.py", line 75, in wrapped 2013-05-27 17:15:05.672 TRACE nova.openstack.common.rpc.amqp return f(self, context, *args, **kw) 2013-05-27 17:15:05.672 TRACE nova.openstack.common.rpc.amqp File "/extraspace/stack/nova/nova/compute/manager.py", line 214, in decorated_function 2013-05-27 17:15:05.672 TRACE nova.openstack.common.rpc.amqp pass 2013-05-27 17:15:05.672 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/contextlib.py", line 24, in __exit__ 2013-05-27 17:15:05.672 TRACE nova.openstack.common.rpc.amqp self.gen.next() 2013-05-27 17:15:05.672 TRACE nova.openstack.common.rpc.amqp File "/extraspace/stack/nova/nova/compute/manager.py", line 200, in decorated_function 2013-05-27 17:15:05.672 TRACE nova.openstack.common.rpc.amqp return function(self, context, *args, **kwargs) 2013-05-27 17:15:05.672 TRACE nova.openstack.common.rpc.amqp File "/extraspace/stack/nova/nova/compute/manager.py", line 242, in decorated_function 2013-05-27 17:15:05.672 TRACE nova.openstack.common.rpc.amqp e, sys.exc_info()) 2013-05-27 17:15:05.672 TRACE nova.openstack.common.rpc.amqp File "/usr/lib/python2.7/contextlib.py", line 24, in __exit__ 2013-05-27 17:15:05.672 TRACE nova.openstack.common.rpc.amqp self.gen.next() 2013-05-27 17:15:05.672 TRACE nova.openstack.common.rpc.amqp File "/extraspace/stack/nova/nova/compute/manager.py", line 229, in decorated_function 2013-05-27 17:15:05.672 TRACE nova.openstack.common.rpc.amqp return function(self, context, *args, **kwargs) 2013-05-27 17:15:05.672 TRACE nova.openstack.common.rpc.amqp File "/extraspace/stack/nova/nova/compute/manager.py", line 1887, in snapshot_instance 2013-05-27 17:15:05.672 TRACE nova.openstack.common.rpc.amqp self.driver.snapshot(context, instance, image_id, update_task_state) 2013-05-27 17:15:05.672 TRACE nova.openstack.common.rpc.amqp File "/extraspace/stack/nova/nova/virt/vmwareapi/driver.py", line 180, in snapshot 2013-05-27 17:15:05.672 TRACE nova.openstack.common.rpc.amqp self._vmops.snapshot(context, instance, name, update_task_state) 2013-05-27 17:15:05.672 TRACE nova.openstack.common.rpc.amqp File "/extraspace/stack/nova/nova/virt/vmwareapi/vmops.py", line 537, in snapshot 2013-05-27 17:15:05.672 TRACE nova.openstack.common.rpc.amqp _copy_vmdk_content() 2013-05-27 17:15:05.672 TRACE nova.openstack.common.rpc.amqp File "/extraspace/stack/nova/nova/virt/vmwareapi/vmops.py", line 533, in _copy_vmdk_content 2013-05-27 17:15:05.672 TRACE nova.openstack.common.rpc.amqp self._session._wait_for_task(instance['uuid'], copy_disk_task) 2013-05-27 17:15:05.672 TRACE nova.openstack.common.rpc.amqp File "/extraspace/stack/nova/nova/virt/vmwareapi/driver.py", line 559, in _wait_for_task 2013-05-27 17:15:05.672 TRACE nova.openstack.common.rpc.amqp ret_val = done.wait() 2013-05-27 17:15:05.672 TRACE nova.openstack.common.rpc.amqp File "/usr/local/lib/python2.7/dist-packages/eventlet/event.py", line 116, in wait 2013-05-27 17:15:05.672 TRACE nova.openstack.common.rpc.amqp return hubs.get_hub().switch() 2013-05-27 17:15:05.672 TRACE nova.openstack.common.rpc.amqp File "/usr/local/lib/python2.7/dist-packages/eventlet/hubs/hub.py", line 187, in switch 2013-05-27 17:15:05.672 TRACE nova.openstack.common.rpc.amqp return self.greenlet.switch() 2013-05-27 17:15:05.672 TRACE nova.openstack.common.rpc.amqp NovaException: The requested operation is not implemented by the server. 2013-05-27 17:15:05.672 TRACE nova.openstack.common.rpc.amqp To manage notifications about this bug go to: https://bugs.launchpad.net/nova/+bug/1184807/+subscriptions -- Mailing list: https://launchpad.net/~yahoo-eng-team Post to : yahoo-eng-team@lists.launchpad.net Unsubscribe : https://launchpad.net/~yahoo-eng-team More help : https://help.launchpad.net/ListHelp