[Yahoo-eng-team] [Bug 1249519] Re: VMware: deleting instance snapshot too soon leaves instance in Image Uploading state
** Changed in: nova
Status: Fix Committed = Fix Released
--
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/1249519
Title:
VMware: deleting instance snapshot too soon leaves instance in Image
Uploading state
Status in OpenStack Compute (Nova):
Fix Released
Status in OpenStack Compute (nova) icehouse series:
Fix Released
Bug description:
branch: stable/havana
driver: VMwareVCDriver
When using the nova VMwareVCDriver, the following scenario will cause
an instance to be stuck in Image Uploading state:
1. Create an instance
2. Snapshot the instance
3. While the image is in Queuing state, immediately delete the image
The screen-n-cpu.log shows:
2013-11-08 14:45:29.334 DEBUG glanceclient.common.http [-] curl -i -X PUT -H
'X-Service-Catalog: [{endpoints: [{adminURL:
http://172.30.0.3:8776/v1/61df65834f494153af76939ffbf5e1a0;, region:
RegionOne, internalURL:
http://172.30.0.3:8776/v1/61df65834f494153af76939ffbf5e1a0;, id:
536fa98e69a544bca1086f07acdf7663, publicURL:
http://172.30.0.3:8776/v1/61df65834f494153af76939ffbf5e1a0}],
endpoints_links: [], type: volume, name: cinder}]' -H
'X-Identity-Status: Confirmed' -H 'X-Auth-Token:
bd579bd82586cca09e43c975944ef24d' -H 'x-image-meta-property-owner_id:
61df65834f494153af76939ffbf5e1a0' -H 'x-image-meta-container_format: bare' -H
'Transfer-Encoding: chunked' -H 'x-glance-registry-purge-props: true' -H
'X-Tenant-Id: 61df65834f494153af76939ffbf5e1a0' -H 'User-Agent:
python-glanceclient' -H 'x-image-meta-property-vmware_image_version: 1' -H
'x-image-meta-property-vmware_adaptertype: lsiLogic' -H 'X-Roles: admin' -H
'X-User-Id: 65aedf8343994f329508a502518a
7a0f' -H 'x-image-meta-is_public: false' -H
'x-image-meta-property-vmware_ostype: otherGuest' -H 'x-image-meta-size:
41125888' -H 'Content-Type: application/octet-stream' -H
'x-image-meta-disk_format: vmdk' -H 'x-image-meta-name: ax1_snap' -d
'ThreadSafePipe maxsize=10'
http://172.30.0.3:9292/v1/images/6cf638ec-844e-41f1-8597-c696a2d946da from
(pid=15600) log_curl_request
/opt/stack/python-glanceclient/glanceclient/common/http.py:142
2013-11-08 14:45:30.138 DEBUG nova.openstack.common.rpc.amqp [-] Making
synchronous call on conductor ... from (pid=15600) multicall
/opt/stack/nova/nova/openstack/common/rpc/amqp.py:553
2013-11-08 14:45:30.138 DEBUG nova.openstack.common.rpc.amqp [-] MSG_ID is
354436bd11ce4e07af07157381ff6147 from (pid=15600) multicall
/opt/stack/nova/nova/openstack/common/rpc/amqp.py:556
2013-11-08 14:45:30.139 DEBUG nova.openstack.common.rpc.amqp [-] UNIQUE_ID is
940f2aa02d024f5abecaefec16d44fc5. from (pid=15600) _add_unique_id
/opt/stack/nova/nova/openstack/common/rpc/amqp.py:341
2013-11-08 14:45:30.141 DEBUG amqp [-] Closed channel #1 from (pid=15600)
_do_close /usr/local/lib/python2.7/dist-packages/amqp/channel.py:95
2013-11-08 14:45:30.141 DEBUG amqp [-] using channel_id: 1 from (pid=15600)
__init__ /usr/local/lib/python2.7/dist-packages/amqp/channel.py:71
2013-11-08 14:45:30.142 DEBUG amqp [-] Channel open from (pid=15600) _open_ok
/usr/local/lib/python2.7/dist-packages/amqp/channel.py:429
2013-11-08 14:45:39.350 DEBUG glanceclient.common.http [-]
HTTP/1.1 403 Forbidden
date: Fri, 08 Nov 2013 22:45:29 GMT
content-length: 54
content-type: text/plain; charset=UTF-8
x-openstack-request-id: req-7d82c3c6-4d70-4506-8380-fe9e58b34801
403 Forbidden
Forbidden to update deleted image.
from (pid=15600) log_http_response
/opt/stack/python-glanceclient/glanceclient/common/http.py:152
2013-11-08 14:45:39.351 ERROR glanceclient.common.http [-] Request returned
failure status.
Traceback (most recent call last):
File /usr/local/lib/python2.7/dist-packages/eventlet/queue.py, line 107,
in switch
self.greenlet.switch(value)
File /usr/local/lib/python2.7/dist-packages/eventlet/greenthread.py, line
194, in main
result = function(*args, **kwargs)
File /opt/stack/nova/nova/virt/vmwareapi/io_util.py, line 106, in _inner
data=self.input)
File /opt/stack/nova/nova/image/glance.py, line 395, in update
_reraise_translated_image_exception(image_id)
File /opt/stack/nova/nova/image/glance.py, line 393, in update
image_id, **image_meta)
File /opt/stack/nova/nova/image/glance.py, line 212, in call
return getattr(client.images, method)(*args, **kwargs)
File /opt/stack/python-glanceclient/glanceclient/v1/images.py, line 291,
in update
'PUT', url, headers=hdrs, body=image_data)
File /opt/stack/python-glanceclient/glanceclient/common/http.py, line
288, in raw_request
return self._http_request(url, method, **kwargs)
File /opt/stack/python-glanceclient/glanceclient/common/http.py, line
248, in _http_request
raise exc.from_response(resp, body_str)
ImageNotAuthorized: Not authorized for image
[Yahoo-eng-team] [Bug 1249519] Re: VMware: deleting instance snapshot too soon leaves instance in Image Uploading state
** Changed in: nova/icehouse
Status: Fix Committed = Fix Released
--
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/1249519
Title:
VMware: deleting instance snapshot too soon leaves instance in Image
Uploading state
Status in OpenStack Compute (Nova):
Fix Committed
Status in OpenStack Compute (nova) icehouse series:
Fix Released
Bug description:
branch: stable/havana
driver: VMwareVCDriver
When using the nova VMwareVCDriver, the following scenario will cause
an instance to be stuck in Image Uploading state:
1. Create an instance
2. Snapshot the instance
3. While the image is in Queuing state, immediately delete the image
The screen-n-cpu.log shows:
2013-11-08 14:45:29.334 DEBUG glanceclient.common.http [-] curl -i -X PUT -H
'X-Service-Catalog: [{endpoints: [{adminURL:
http://172.30.0.3:8776/v1/61df65834f494153af76939ffbf5e1a0;, region:
RegionOne, internalURL:
http://172.30.0.3:8776/v1/61df65834f494153af76939ffbf5e1a0;, id:
536fa98e69a544bca1086f07acdf7663, publicURL:
http://172.30.0.3:8776/v1/61df65834f494153af76939ffbf5e1a0}],
endpoints_links: [], type: volume, name: cinder}]' -H
'X-Identity-Status: Confirmed' -H 'X-Auth-Token:
bd579bd82586cca09e43c975944ef24d' -H 'x-image-meta-property-owner_id:
61df65834f494153af76939ffbf5e1a0' -H 'x-image-meta-container_format: bare' -H
'Transfer-Encoding: chunked' -H 'x-glance-registry-purge-props: true' -H
'X-Tenant-Id: 61df65834f494153af76939ffbf5e1a0' -H 'User-Agent:
python-glanceclient' -H 'x-image-meta-property-vmware_image_version: 1' -H
'x-image-meta-property-vmware_adaptertype: lsiLogic' -H 'X-Roles: admin' -H
'X-User-Id: 65aedf8343994f329508a502518a
7a0f' -H 'x-image-meta-is_public: false' -H
'x-image-meta-property-vmware_ostype: otherGuest' -H 'x-image-meta-size:
41125888' -H 'Content-Type: application/octet-stream' -H
'x-image-meta-disk_format: vmdk' -H 'x-image-meta-name: ax1_snap' -d
'ThreadSafePipe maxsize=10'
http://172.30.0.3:9292/v1/images/6cf638ec-844e-41f1-8597-c696a2d946da from
(pid=15600) log_curl_request
/opt/stack/python-glanceclient/glanceclient/common/http.py:142
2013-11-08 14:45:30.138 DEBUG nova.openstack.common.rpc.amqp [-] Making
synchronous call on conductor ... from (pid=15600) multicall
/opt/stack/nova/nova/openstack/common/rpc/amqp.py:553
2013-11-08 14:45:30.138 DEBUG nova.openstack.common.rpc.amqp [-] MSG_ID is
354436bd11ce4e07af07157381ff6147 from (pid=15600) multicall
/opt/stack/nova/nova/openstack/common/rpc/amqp.py:556
2013-11-08 14:45:30.139 DEBUG nova.openstack.common.rpc.amqp [-] UNIQUE_ID is
940f2aa02d024f5abecaefec16d44fc5. from (pid=15600) _add_unique_id
/opt/stack/nova/nova/openstack/common/rpc/amqp.py:341
2013-11-08 14:45:30.141 DEBUG amqp [-] Closed channel #1 from (pid=15600)
_do_close /usr/local/lib/python2.7/dist-packages/amqp/channel.py:95
2013-11-08 14:45:30.141 DEBUG amqp [-] using channel_id: 1 from (pid=15600)
__init__ /usr/local/lib/python2.7/dist-packages/amqp/channel.py:71
2013-11-08 14:45:30.142 DEBUG amqp [-] Channel open from (pid=15600) _open_ok
/usr/local/lib/python2.7/dist-packages/amqp/channel.py:429
2013-11-08 14:45:39.350 DEBUG glanceclient.common.http [-]
HTTP/1.1 403 Forbidden
date: Fri, 08 Nov 2013 22:45:29 GMT
content-length: 54
content-type: text/plain; charset=UTF-8
x-openstack-request-id: req-7d82c3c6-4d70-4506-8380-fe9e58b34801
403 Forbidden
Forbidden to update deleted image.
from (pid=15600) log_http_response
/opt/stack/python-glanceclient/glanceclient/common/http.py:152
2013-11-08 14:45:39.351 ERROR glanceclient.common.http [-] Request returned
failure status.
Traceback (most recent call last):
File /usr/local/lib/python2.7/dist-packages/eventlet/queue.py, line 107,
in switch
self.greenlet.switch(value)
File /usr/local/lib/python2.7/dist-packages/eventlet/greenthread.py, line
194, in main
result = function(*args, **kwargs)
File /opt/stack/nova/nova/virt/vmwareapi/io_util.py, line 106, in _inner
data=self.input)
File /opt/stack/nova/nova/image/glance.py, line 395, in update
_reraise_translated_image_exception(image_id)
File /opt/stack/nova/nova/image/glance.py, line 393, in update
image_id, **image_meta)
File /opt/stack/nova/nova/image/glance.py, line 212, in call
return getattr(client.images, method)(*args, **kwargs)
File /opt/stack/python-glanceclient/glanceclient/v1/images.py, line 291,
in update
'PUT', url, headers=hdrs, body=image_data)
File /opt/stack/python-glanceclient/glanceclient/common/http.py, line
288, in raw_request
return self._http_request(url, method, **kwargs)
File /opt/stack/python-glanceclient/glanceclient/common/http.py, line
248, in _http_request
raise exc.from_response(resp, body_str)
ImageNotAuthorized: Not authorized for image
[Yahoo-eng-team] [Bug 1249519] Re: VMware: deleting instance snapshot too soon leaves instance in Image Uploading state
** Also affects: nova/icehouse
Importance: Undecided
Status: New
** Changed in: nova/icehouse
Status: New = Fix Committed
** Changed in: nova/icehouse
Milestone: None = 2014.1.1
--
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/1249519
Title:
VMware: deleting instance snapshot too soon leaves instance in Image
Uploading state
Status in OpenStack Compute (Nova):
Fix Committed
Status in OpenStack Compute (nova) icehouse series:
Fix Committed
Bug description:
branch: stable/havana
driver: VMwareVCDriver
When using the nova VMwareVCDriver, the following scenario will cause
an instance to be stuck in Image Uploading state:
1. Create an instance
2. Snapshot the instance
3. While the image is in Queuing state, immediately delete the image
The screen-n-cpu.log shows:
2013-11-08 14:45:29.334 DEBUG glanceclient.common.http [-] curl -i -X PUT -H
'X-Service-Catalog: [{endpoints: [{adminURL:
http://172.30.0.3:8776/v1/61df65834f494153af76939ffbf5e1a0;, region:
RegionOne, internalURL:
http://172.30.0.3:8776/v1/61df65834f494153af76939ffbf5e1a0;, id:
536fa98e69a544bca1086f07acdf7663, publicURL:
http://172.30.0.3:8776/v1/61df65834f494153af76939ffbf5e1a0}],
endpoints_links: [], type: volume, name: cinder}]' -H
'X-Identity-Status: Confirmed' -H 'X-Auth-Token:
bd579bd82586cca09e43c975944ef24d' -H 'x-image-meta-property-owner_id:
61df65834f494153af76939ffbf5e1a0' -H 'x-image-meta-container_format: bare' -H
'Transfer-Encoding: chunked' -H 'x-glance-registry-purge-props: true' -H
'X-Tenant-Id: 61df65834f494153af76939ffbf5e1a0' -H 'User-Agent:
python-glanceclient' -H 'x-image-meta-property-vmware_image_version: 1' -H
'x-image-meta-property-vmware_adaptertype: lsiLogic' -H 'X-Roles: admin' -H
'X-User-Id: 65aedf8343994f329508a502518a
7a0f' -H 'x-image-meta-is_public: false' -H
'x-image-meta-property-vmware_ostype: otherGuest' -H 'x-image-meta-size:
41125888' -H 'Content-Type: application/octet-stream' -H
'x-image-meta-disk_format: vmdk' -H 'x-image-meta-name: ax1_snap' -d
'ThreadSafePipe maxsize=10'
http://172.30.0.3:9292/v1/images/6cf638ec-844e-41f1-8597-c696a2d946da from
(pid=15600) log_curl_request
/opt/stack/python-glanceclient/glanceclient/common/http.py:142
2013-11-08 14:45:30.138 DEBUG nova.openstack.common.rpc.amqp [-] Making
synchronous call on conductor ... from (pid=15600) multicall
/opt/stack/nova/nova/openstack/common/rpc/amqp.py:553
2013-11-08 14:45:30.138 DEBUG nova.openstack.common.rpc.amqp [-] MSG_ID is
354436bd11ce4e07af07157381ff6147 from (pid=15600) multicall
/opt/stack/nova/nova/openstack/common/rpc/amqp.py:556
2013-11-08 14:45:30.139 DEBUG nova.openstack.common.rpc.amqp [-] UNIQUE_ID is
940f2aa02d024f5abecaefec16d44fc5. from (pid=15600) _add_unique_id
/opt/stack/nova/nova/openstack/common/rpc/amqp.py:341
2013-11-08 14:45:30.141 DEBUG amqp [-] Closed channel #1 from (pid=15600)
_do_close /usr/local/lib/python2.7/dist-packages/amqp/channel.py:95
2013-11-08 14:45:30.141 DEBUG amqp [-] using channel_id: 1 from (pid=15600)
__init__ /usr/local/lib/python2.7/dist-packages/amqp/channel.py:71
2013-11-08 14:45:30.142 DEBUG amqp [-] Channel open from (pid=15600) _open_ok
/usr/local/lib/python2.7/dist-packages/amqp/channel.py:429
2013-11-08 14:45:39.350 DEBUG glanceclient.common.http [-]
HTTP/1.1 403 Forbidden
date: Fri, 08 Nov 2013 22:45:29 GMT
content-length: 54
content-type: text/plain; charset=UTF-8
x-openstack-request-id: req-7d82c3c6-4d70-4506-8380-fe9e58b34801
403 Forbidden
Forbidden to update deleted image.
from (pid=15600) log_http_response
/opt/stack/python-glanceclient/glanceclient/common/http.py:152
2013-11-08 14:45:39.351 ERROR glanceclient.common.http [-] Request returned
failure status.
Traceback (most recent call last):
File /usr/local/lib/python2.7/dist-packages/eventlet/queue.py, line 107,
in switch
self.greenlet.switch(value)
File /usr/local/lib/python2.7/dist-packages/eventlet/greenthread.py, line
194, in main
result = function(*args, **kwargs)
File /opt/stack/nova/nova/virt/vmwareapi/io_util.py, line 106, in _inner
data=self.input)
File /opt/stack/nova/nova/image/glance.py, line 395, in update
_reraise_translated_image_exception(image_id)
File /opt/stack/nova/nova/image/glance.py, line 393, in update
image_id, **image_meta)
File /opt/stack/nova/nova/image/glance.py, line 212, in call
return getattr(client.images, method)(*args, **kwargs)
File /opt/stack/python-glanceclient/glanceclient/v1/images.py, line 291,
in update
'PUT', url, headers=hdrs, body=image_data)
File /opt/stack/python-glanceclient/glanceclient/common/http.py, line
288, in raw_request
return self._http_request(url, method, **kwargs)
File /opt/stack/python-glanceclient/glanceclient/common/http.py,
