[Yahoo-eng-team] [Bug 1881727] [NEW] Nova retains the 'delta' file for the entire snapshot upload time
Public bug reported: When the live snapshot happens it setups a 100% copy of the original file using libvirt/qemu to sync the disk to it using "Shallow" mode (this is the .delta file). From that .delta file it extracts the image and uploads it. The delta file remains till the upload completes which results in 3x space required for each snapshots. To fix this issue, the .delta file can be removed once the image is extracted from the .delta file https://github.com/openstack/nova/blob/stable/pike/nova/virt/libvirt/driver.py#L2007-L2008 ** Affects: nova Importance: Undecided Status: New -- You received this bug notification because you are a member of Yahoo! Engineering Team, which is subscribed to OpenStack Compute (nova). https://bugs.launchpad.net/bugs/1881727 Title: Nova retains the 'delta' file for the entire snapshot upload time Status in OpenStack Compute (nova): New Bug description: When the live snapshot happens it setups a 100% copy of the original file using libvirt/qemu to sync the disk to it using "Shallow" mode (this is the .delta file). From that .delta file it extracts the image and uploads it. The delta file remains till the upload completes which results in 3x space required for each snapshots. To fix this issue, the .delta file can be removed once the image is extracted from the .delta file https://github.com/openstack/nova/blob/stable/pike/nova/virt/libvirt/driver.py#L2007-L2008 To manage notifications about this bug go to: https://bugs.launchpad.net/nova/+bug/1881727/+subscriptions -- Mailing list: https://launchpad.net/~yahoo-eng-team Post to : yahoo-eng-team@lists.launchpad.net Unsubscribe : https://launchpad.net/~yahoo-eng-team More help : https://help.launchpad.net/ListHelp
[Yahoo-eng-team] [Bug 1630826] Re: Neutron unit tests failures due to OperationalError: (sqlite3.OperationalError) no such table
** Changed in: neutron Status: Incomplete => Invalid -- You received this bug notification because you are a member of Yahoo! Engineering Team, which is subscribed to neutron. https://bugs.launchpad.net/bugs/1630826 Title: Neutron unit tests failures due to OperationalError: (sqlite3.OperationalError) no such table Status in neutron: Invalid Bug description: Release: stable/liberty Tag: 7.0.4 Neutron unit tests are failing inconsistently, every run has different set of failures, around 300+ tests are failing with this following error: {0} neutron.tests.unit.services.metering.test_metering_plugin.TestMeteringPluginL3AgentSchedulerServicePlugin.test_add_metering_label_rpc_call [0.428998s] ... FAILED Captured traceback: ~~~ Traceback (most recent call last): File "/home/jenkins/workspace/neutron@2/neutron/tests/unit/services/metering/test_metering_plugin.py", line 374, in test_add_metering_label_rpc_call set_context=True): File "/usr/lib64/python2.7/contextlib.py", line 17, in __enter__ return self.gen.next() File "/home/jenkins/workspace/neutron@2/neutron/tests/unit/db/metering/test_metering_db.py", line 94, in metering_label description, **kwargs) File "/home/jenkins/workspace/neutron@2/neutron/tests/unit/db/metering/test_metering_db.py", line 58, in _make_metering_label raise webob.exc.HTTPClientError(code=res.status_int) webob.exc.HTTPClientError: The server could not comply with the request since it is either malformed or otherwise incorrect. Captured pythonlogging: ~~~ 2016-09-29 15:33:52,379 INFO [neutron.manager] Loading core plugin: neutron.tests.unit.extensions.test_l3.TestNoL3NatPlugin 2016-09-29 15:33:52,379 INFO [neutron.manager] Loading Plugin: neutron.services.metering.metering_plugin.MeteringPlugin 2016-09-29 15:33:52,380 INFO [neutron.manager] Loading Plugin: neutron.tests.unit.extensions.test_l3.TestL3NatAgentSchedulingServicePlugin 2016-09-29 15:33:52,411 WARNING [neutron.notifiers.nova] Authenticating to nova using nova_admin_* options is deprecated. This should be done using an auth plugin, like password 2016-09-29 15:33:52,472 INFO [neutron.quota.resource_registry] Creating instance of TrackedResource for resource:subnet 2016-09-29 15:33:52,472 WARNING [neutron.quota.resource_registry] subnet is already registered 2016-09-29 15:33:52,473 WARNING [neutron.notifiers.nova] Authenticating to nova using nova_admin_* options is deprecated. This should be done using an auth plugin, like password 2016-09-29 15:33:52,511 INFO [neutron.quota.resource_registry] Creating instance of TrackedResource for resource:subnetpool 2016-09-29 15:33:52,511 WARNING [neutron.quota.resource_registry] subnetpool is already registered 2016-09-29 15:33:52,512 WARNING [neutron.notifiers.nova] Authenticating to nova using nova_admin_* options is deprecated. This should be done using an auth plugin, like password 2016-09-29 15:33:52,550 INFO [neutron.quota.resource_registry] Creating instance of TrackedResource for resource:network 2016-09-29 15:33:52,550 WARNING [neutron.quota.resource_registry] network is already registered 2016-09-29 15:33:52,551 WARNING [neutron.notifiers.nova] Authenticating to nova using nova_admin_* options is deprecated. This should be done using an auth plugin, like password 2016-09-29 15:33:52,589 INFO [neutron.quota.resource_registry] Creating instance of TrackedResource for resource:port 2016-09-29 15:33:52,589 WARNING [neutron.quota.resource_registry] port is already registered 2016-09-29 15:33:52,593 INFO [neutron.common.config] Config paste file: /home/jenkins/workspace/neutron@2/neutron/tests/etc/api-paste.ini.test 2016-09-29 15:33:52,596 INFO [neutron.quota.resource_registry] Creating instance of TrackedResource for resource:router 2016-09-29 15:33:52,596 WARNING [neutron.quota.resource_registry] router is already registered 2016-09-29 15:33:52,597 WARNING [neutron.notifiers.nova] Authenticating to nova using nova_admin_* options is deprecated. This should be done using an auth plugin, like password 2016-09-29 15:33:52,634 INFO [neutron.quota.resource_registry] Creating instance of TrackedResource for resource:floatingip 2016-09-29 15:33:52,635 WARNING [neutron.quota.resource_registry] floatingip is already registered 2016-09-29 15:33:52,635 WARNING [neutron.notifiers.nova] Authenticating to nova using nova_admin_* options is deprecated. This should be done using an auth plugin, like password 2016-09-29 15:33:52,673 WARNING [neutron.notifiers.nova] Authenticating to nova using nova_admin_* options is deprecated. This should be done using an auth plugin, like password 2016-09-29
[Yahoo-eng-team] [Bug 1630826] [NEW] Neutron unit tests failures due to OperationalError: (sqlite3.OperationalError) no such table
Public bug reported: Release: stable/liberty Tag: 7.0.4 Neutron unit tests are failing inconsistently, every run has different set of failures, around 300+ tests are failing with this following error: {0} neutron.tests.unit.services.metering.test_metering_plugin.TestMeteringPluginL3AgentSchedulerServicePlugin.test_add_metering_label_rpc_call [0.428998s] ... FAILED Captured traceback: ~~~ Traceback (most recent call last): File "/home/jenkins/workspace/neutron@2/neutron/tests/unit/services/metering/test_metering_plugin.py", line 374, in test_add_metering_label_rpc_call set_context=True): File "/usr/lib64/python2.7/contextlib.py", line 17, in __enter__ return self.gen.next() File "/home/jenkins/workspace/neutron@2/neutron/tests/unit/db/metering/test_metering_db.py", line 94, in metering_label description, **kwargs) File "/home/jenkins/workspace/neutron@2/neutron/tests/unit/db/metering/test_metering_db.py", line 58, in _make_metering_label raise webob.exc.HTTPClientError(code=res.status_int) webob.exc.HTTPClientError: The server could not comply with the request since it is either malformed or otherwise incorrect. Captured pythonlogging: ~~~ 2016-09-29 15:33:52,379 INFO [neutron.manager] Loading core plugin: neutron.tests.unit.extensions.test_l3.TestNoL3NatPlugin 2016-09-29 15:33:52,379 INFO [neutron.manager] Loading Plugin: neutron.services.metering.metering_plugin.MeteringPlugin 2016-09-29 15:33:52,380 INFO [neutron.manager] Loading Plugin: neutron.tests.unit.extensions.test_l3.TestL3NatAgentSchedulingServicePlugin 2016-09-29 15:33:52,411 WARNING [neutron.notifiers.nova] Authenticating to nova using nova_admin_* options is deprecated. This should be done using an auth plugin, like password 2016-09-29 15:33:52,472 INFO [neutron.quota.resource_registry] Creating instance of TrackedResource for resource:subnet 2016-09-29 15:33:52,472 WARNING [neutron.quota.resource_registry] subnet is already registered 2016-09-29 15:33:52,473 WARNING [neutron.notifiers.nova] Authenticating to nova using nova_admin_* options is deprecated. This should be done using an auth plugin, like password 2016-09-29 15:33:52,511 INFO [neutron.quota.resource_registry] Creating instance of TrackedResource for resource:subnetpool 2016-09-29 15:33:52,511 WARNING [neutron.quota.resource_registry] subnetpool is already registered 2016-09-29 15:33:52,512 WARNING [neutron.notifiers.nova] Authenticating to nova using nova_admin_* options is deprecated. This should be done using an auth plugin, like password 2016-09-29 15:33:52,550 INFO [neutron.quota.resource_registry] Creating instance of TrackedResource for resource:network 2016-09-29 15:33:52,550 WARNING [neutron.quota.resource_registry] network is already registered 2016-09-29 15:33:52,551 WARNING [neutron.notifiers.nova] Authenticating to nova using nova_admin_* options is deprecated. This should be done using an auth plugin, like password 2016-09-29 15:33:52,589 INFO [neutron.quota.resource_registry] Creating instance of TrackedResource for resource:port 2016-09-29 15:33:52,589 WARNING [neutron.quota.resource_registry] port is already registered 2016-09-29 15:33:52,593 INFO [neutron.common.config] Config paste file: /home/jenkins/workspace/neutron@2/neutron/tests/etc/api-paste.ini.test 2016-09-29 15:33:52,596 INFO [neutron.quota.resource_registry] Creating instance of TrackedResource for resource:router 2016-09-29 15:33:52,596 WARNING [neutron.quota.resource_registry] router is already registered 2016-09-29 15:33:52,597 WARNING [neutron.notifiers.nova] Authenticating to nova using nova_admin_* options is deprecated. This should be done using an auth plugin, like password 2016-09-29 15:33:52,634 INFO [neutron.quota.resource_registry] Creating instance of TrackedResource for resource:floatingip 2016-09-29 15:33:52,635 WARNING [neutron.quota.resource_registry] floatingip is already registered 2016-09-29 15:33:52,635 WARNING [neutron.notifiers.nova] Authenticating to nova using nova_admin_* options is deprecated. This should be done using an auth plugin, like password 2016-09-29 15:33:52,673 WARNING [neutron.notifiers.nova] Authenticating to nova using nova_admin_* options is deprecated. This should be done using an auth plugin, like password 2016-09-29 15:33:52,709 WARNING [neutron.notifiers.nova] Authenticating to nova using nova_admin_* options is deprecated. This should be done using an auth plugin, like password 2016-09-29 15:33:52,773ERROR [neutron.api.v2.resource] create failed Traceback (most recent call last): File "/home/jenkins/workspace/neutron@2/neutron/api/v2/resource.py", line 83, in resource result = method(request=request, **args) File