[Yahoo-eng-team] [Bug 1804271] Re: nova-api is broken in postgresql jobs

2018-12-14 Thread Matt Riedemann
** Also affects: nova/rocky Importance: Undecided Status: New -- You received this bug notification because you are a member of Yahoo! Engineering Team, which is subscribed to OpenStack Compute (nova). https://bugs.launchpad.net/bugs/1804271 Title: nova-api is broken in postgresql

[Yahoo-eng-team] [Bug 1808579] [NEW] Compute API in nova - issues in force_complete live migration API ref

2018-12-14 Thread Matt Riedemann
-- Release: 18.1.0.dev876 on 2018-10-30 10:13:24 SHA: f6996903d2ef0fdb40135b506c83ed6517b28e19 Source: https://git.openstack.org/cgit/openstack/nova/tree/api-ref/source/index.rst URL: https://developer.openstack.org/api-ref/compute/ ** Affects: nova Importance: Medium

[Yahoo-eng-team] [Bug 1799246] Re: module level init of db transation contexts cause failure under mod_wsgi on module reload

2018-12-13 Thread Matt Riedemann
** Also affects: nova/rocky Importance: Undecided Status: New ** Changed in: nova/rocky Status: New => In Progress ** Changed in: nova/rocky Importance: Undecided => Medium ** Changed in: nova/rocky Assignee: (unassigned) => Lee Yarwood (lyarwood) -- You received this

[Yahoo-eng-team] [Bug 1808089] Re: Feature to detach volume from a shelved(_offloaded) instance is broken

2018-12-13 Thread Matt Riedemann
Yeah I recreated: http://paste.openstack.org/show/737236/ ** Also affects: nova/queens Importance: Undecided Status: New ** Also affects: nova/rocky Importance: Undecided Status: New ** Changed in: nova/queens Status: New => Confirmed ** Changed in: nova/queens

[Yahoo-eng-team] [Bug 1808063] Re: glanceclient.exc.HTTPBadGateway: 502 Proxy Error during server snapshot

2018-12-13 Thread Matt Riedemann
There is definitely some kind of infinite loop here: Dec 13 14:43:21.412172 ubuntu-xenial-rax-ord-0001176665 devstack@g-api.service[6990]: /opt/stack/new/glance/glance/quota/__init__.py:168: ResourceWarning: unclosed Dec 13 14:43:21.412563 ubuntu-xenial-rax-ord-0001176665

[Yahoo-eng-team] [Bug 1808010] Re: Tempest cirros ssh setup fails due to lack of disk space causing config-drive setup to fail forcing fallback to metadata server which fails due to hitting 10 second

2018-12-13 Thread Matt Riedemann
** Changed in: nova Status: New => Confirmed ** Also affects: devstack Importance: Undecided Status: New ** Changed in: devstack Status: New => In Progress ** Changed in: devstack Assignee: (unassigned) => Dr. Jens Harbott (j-harbott) ** Changed in: devstack

[Yahoo-eng-team] [Bug 1808247] [NEW] nova-lvm job failing with ArgsAlreadyParsedError (privsep)

2018-12-12 Thread Matt Riedemann
Public bug reported: Seen here: http://logs.openstack.org/43/619143/12/check/nova- lvm/786180c/logs/screen-n-cpu.txt.gz?level=TRACE#_Dec_12_12_35_39_607002 Dec 12 12:35:39.607002 ubuntu-xenial-rax-iad-0001148680 nova-compute[29772]: ERROR nova.compute.manager [None

[Yahoo-eng-team] [Bug 1807044] Re: nova-api startup does not scan cells looking for minimum nova-compute service version

2018-12-12 Thread Matt Riedemann
It should also be noted that you only hit this if you configure nova with [upgrade_levels]compute=auto. ** Also affects: nova/queens Importance: Undecided Status: New ** Also affects: nova/pike Importance: Undecided Status: New ** Also affects: nova/rocky Importance:

[Yahoo-eng-team] [Bug 1808171] [NEW] TaggedBootDevicesTest.test_tagged_boot_devices intermittently fails waiting for network-vif-plugged event which neutron does not send

2018-12-12 Thread Matt Riedemann
Public bug reported: Seen here: http://logs.openstack.org/46/623246/3/check/nova- multiattach/efa830b/logs/screen-n-cpu.txt.gz?#_Dec_12_00_01_13_179474 Dec 12 00:01:13.179474 ubuntu-xenial-inap-mtl01-0001136812 nova- compute[29399]: WARNING nova.virt.libvirt.driver [None req-f43f3c35

[Yahoo-eng-team] [Bug 1807723] Re: swap multiattach volume intermittently fails when servers are on different hosts

2018-12-11 Thread Matt Riedemann
signee: (unassigned) => Matt Riedemann (mriedem) ** No longer affects: nova ** Summary changed: - swap multiattach volume intermittently fails when servers are on different hosts + test_volume_swap_with_multiattach intermittently fails during cleanup -- You received this bug notification be

[Yahoo-eng-team] [Bug 1807723] Re: swap multiattach volume intermittently fails when servers are on different hosts

2018-12-10 Thread Matt Riedemann
** No longer affects: cinder -- You received this bug notification because you are a member of Yahoo! Engineering Team, which is subscribed to OpenStack Compute (nova). https://bugs.launchpad.net/bugs/1807723 Title: swap multiattach volume intermittently fails when servers are on different

[Yahoo-eng-team] [Bug 1807747] [NEW] "cannot format data, exception: Expected a dictionary, got

2018-12-10 Thread Matt Riedemann
thub.com/openstack/oslo.context/blob/0daf01065d1d51694e06aaecb3dcf4dcc78710fe/oslo_context/context.py#L318 The fix might be here: https://review.openstack.org/#/c/564349/ ** Affects: nova Importance: Medium Assignee: Matt Riedemann (mriedem) Status: Triaged ** Tags: api logging polic

[Yahoo-eng-team] [Bug 1807723] Re: swap multiattach volume intermittently fails when servers are on different hosts

2018-12-10 Thread Matt Riedemann
Looking at the swap volume flow in nova again, I think https://github.com/openstack/nova/blob/ae3064b7a820ea02f7fc8a1aa4a41f35a06534f1/nova/compute/manager.py#L5798-L5806 is likely intentional since for volume1/server1 there is only a single BDM record. It starts out with the old volume_id and

[Yahoo-eng-team] [Bug 1807723] [NEW] swap multiattach volume intermittently fails when servers are on different hosts

2018-12-10 Thread Matt Riedemann
Public bug reported: This is found from debugging the tempest.api.compute.admin.test_volume_swap.TestMultiAttachVolumeSwap failures in the (multinode) tempest-slow job here: https://review.openstack.org/#/c/606981/ The failure is ultimately during teardown of the test class, it fails to delete

[Yahoo-eng-team] [Bug 1807518] Re: BasicOperationsImagesTest.test_update_image fails with 502 error "UnexpectedContentType"

2018-12-08 Thread Matt Riedemann
Clark Boylan has a fix here: https://review.openstack.org/#/c/623597/ ** Also affects: devstack Importance: Undecided Status: New ** No longer affects: glance ** Changed in: devstack Assignee: (unassigned) => Clark Boylan (cboylan) ** Changed in: devstack Status: New =>

[Yahoo-eng-team] [Bug 1807518] [NEW] BasicOperationsImagesTest.test_update_image fails with 502 error "UnexpectedContentType"

2018-12-08 Thread Matt Riedemann
Public bug reported: http://logs.openstack.org/96/623596/1/check/grenade-py3/77e4c1b/job- output.txt.gz#_2018-12-08_02_05_43_696072 2018-12-08 02:05:43.696072 | primary | {0} tempest.api.image.v2.test_images.BasicOperationsImagesTest.test_update_image [0.402494s] ... FAILED 2018-12-08

[Yahoo-eng-team] [Bug 1804125] Re: Nova placement disregards nova aggregate metadata

2018-12-07 Thread Matt Riedemann
@Jeff, yeah it's gross, and taken way too long to deal with (granted, I don't think anyone noticed/appreciated this regression until ~queens, about a year after it happened). There has been discussion about how to make the aggregate filters with the allocation_ratio metadata *work* again,

[Yahoo-eng-team] [Bug 1778784] Re: mox_fixture = self.useFixture(moxstubout.MoxStubout()) usage is deprecated from oslo.test 3.5.0

2018-12-07 Thread Matt Riedemann
** Also affects: nova/rocky Importance: Undecided Status: New ** Also affects: nova/queens Importance: Undecided Status: New ** Changed in: nova Assignee: Balazs Gibizer (balazs-gibizer) => Matt Riedemann (mriedem) ** Changed in: nova/queens Status:

[Yahoo-eng-team] [Bug 1807407] [NEW] snapshot related tests intermittently fail in cells v1 job

2018-12-07 Thread Matt Riedemann
Public bug reported: There are two snapshot test failures in this job run under class ImagesOneServerTestJSON: http://logs.openstack.org/47/623247/2/check/nova-cells-v1/18338f0/job- output.txt.gz 2018-12-06 23:40:45.318619 | primary | {1}

[Yahoo-eng-team] [Bug 1607400] Re: UEFI not supported on SLES

2018-12-06 Thread Matt Riedemann
So, should this be marked invalid then? ** Changed in: nova Status: In Progress => Invalid -- You received this bug notification because you are a member of Yahoo! Engineering Team, which is subscribed to OpenStack Compute (nova). https://bugs.launchpad.net/bugs/1607400 Title: UEFI

[Yahoo-eng-team] [Bug 1807232] [NEW] Useful image properties in glance - img_signature* properties are not documented

2018-12-06 Thread Matt Riedemann
Public bug reported: - [x] This is a doc addition request. I was looking at this nova config option: https://docs.openstack.org/nova/rocky/configuration/config.html#DEFAULT.non_inheritable_image_properties And noticed that those img_signature* properties are not documented in the useful image

[Yahoo-eng-team] [Bug 1807219] [NEW] SchedulerReporClient init slows down nova-api startup

2018-12-06 Thread Matt Riedemann
stack.org/#/c/615641/ The NOTE in the API is no longer true: https://github.com/openstack/nova/blob/c9dca64fa64005e5bea327f06a7a3f4821ab72b1/nova/compute/api.py#L256 So the API likely just needs to add it's own lazy-load behavior for that client. ** Affects: nova Importance: Medium Assi

[Yahoo-eng-team] [Bug 1805887] Re: Used RAM greater than Available RAM with ram allocation ratio is set to 0.9

2018-12-06 Thread Matt Riedemann
Mitaka is very old at this point. Is this still a problem on newer releases, like Pike or Rocky? ** Changed in: nova Status: New => Invalid -- You received this bug notification because you are a member of Yahoo! Engineering Team, which is subscribed to OpenStack Compute (nova).

[Yahoo-eng-team] [Bug 1764883] Re: Evacuation fails if the source host returns while the migration is still in progress

2018-12-06 Thread Matt Riedemann
** Also affects: nova/pike Importance: Undecided Status: New ** Also affects: nova/queens Importance: Undecided Status: New ** Changed in: nova Importance: Undecided => Medium ** Changed in: nova/pike Status: New => In Progress ** Changed in: nova/queens

[Yahoo-eng-team] [Bug 1805917] Re: Should use aggregate allocation ratio when weigh if set

2018-12-06 Thread Matt Riedemann
Isn't this covered by blueprint https://blueprints.launchpad.net/nova/+spec/per-aggregate-scheduling- weight ? If so, this is a feature request already covered by the blueprint... ** Changed in: nova Importance: Undecided => Wishlist ** Changed in: nova Status: New => Invalid ** Tags

[Yahoo-eng-team] [Bug 1805989] Re: Weight policy to stack/spread instances and "max_placement_results"

2018-12-06 Thread Matt Riedemann
This is working as designed. The underlying issues that require CERN to set max_placement_results to such a low number (10 when there are ~200 hosts per cell, and ~14K hosts total in the deployment) are what we need to focus on, like bug 1805984 for example. ** Changed in: nova Status: New

[Yahoo-eng-team] [Bug 1807110] Re: Shelved instance image/snapshot is not protected from deletion

2018-12-06 Thread Matt Riedemann
Hmm, this is an interesting point. Setting the protected=true flag on the image seems like a good solution, except I don't see any kind of force delete option for images. Would a user be able to change the protected value from true to false if they really knew what they were doing and wanted to

[Yahoo-eng-team] [Bug 1807044] [NEW] nova-api startup does not scan cells looking for minimum nova-compute service version

2018-12-05 Thread Matt Riedemann
Public bug reported: This CI job failed devstack setup because nova-api took longer than 60 seconds to start (it took 64 seconds): http://logs.openstack.org/01/619701/5/gate/tempest- slow/2bb461b/controller/logs/screen-n-api.txt.gz Looking at what could be taking time in there, it was noticed

[Yahoo-eng-team] [Bug 1806925] [NEW] evacuate test fails due to timeout waiting for evacuate to complete

2018-12-05 Thread Matt Riedemann
Public bug reported: In the post-test hook in the nova-live-migration job where we test evacuate, we're doing the following: 1. create an image-backed and volume-backed server on the subnode 2. stop libvirtd on the local node 3. run evacuate to see it fail because nova-compute is disabled on the

[Yahoo-eng-team] [Bug 1806515] Re: Instance tag not taken care of when bury in cell0

2018-12-04 Thread Matt Riedemann
** Changed in: nova Importance: Undecided => Medium ** Tags added: api cells ** Also affects: nova/pike Importance: Undecided Status: New ** Also affects: nova/rocky Importance: Undecided Status: New ** Also affects: nova/queens Importance: Undecided Status:

[Yahoo-eng-team] [Bug 1806126] [NEW] LibvirtRbdEvacuateTest and LibvirtFlatEvacuateTest tests race fail

2018-11-30 Thread Matt Riedemann
Public bug reported: Seen here: http://logs.openstack.org/22/606122/7/check/nova-tox- functional/1f3126b/testr_results.html.gz There are different failures, but the tests were introduced with this change: https://review.openstack.org/#/c/591733/ For example, in

[Yahoo-eng-team] [Bug 1806123] [NEW] i/o concurrency semaphore test changes are racy

2018-11-30 Thread Matt Riedemann
Public bug reported: Seen here: http://logs.openstack.org/22/606122/7/check/openstack-tox- py27/d70a4d5/testr_results.html.gz ft1.7: nova.tests.unit.virt.libvirt.test_driver.LibvirtSnapshotTests.test_raw_with_rbd_clone_failure_does_cold_snapshot_StringException: pythonlogging:'': {{{

[Yahoo-eng-team] [Bug 1806064] Re: Volume remains in attaching/reserved status, if the instance is deleted after TooManyInstances exception in nova-conductor

2018-11-30 Thread Matt Riedemann
It should be relatively easy to write a functional regression test similar to https://review.openstack.org/#/c/545123/5/nova/tests/functional/wsgi/test_servers.py but for this scenario. ** Changed in: nova Status: New => Triaged ** Changed in: nova Importance: Undecided => Medium **

[Yahoo-eng-team] [Bug 1805902] [NEW] Attaching physical PCI devices to guests in nova - bad link for configuring a flavor for pci_passthrough

2018-11-29 Thread Matt Riedemann
Public bug reported: - [x] This doc is inaccurate in this way: The pci_passthrough 'manage flavors' link here is wrong: https://docs.openstack.org/nova/latest/admin/pci- passthrough.html#configure-a-flavor-controller It should probably link to this doc:

[Yahoo-eng-team] [Bug 1805901] [NEW] Attaching physical PCI devices to guests in nova - bad link to neutron admin guide

2018-11-29 Thread Matt Riedemann
Public bug reported: - [x] I have a fix to the document that I can paste below including example: input and output. The link to the neutron admin guide here is broken: https://docs.openstack.org/nova/latest/admin/pci-passthrough.html #configure-nova-scheduler-controller Looks like bad

[Yahoo-eng-team] [Bug 1805087] Re: libvirt+KVM: High CPU usage on Windows 10 (1803) guests

2018-11-28 Thread Matt Riedemann
Thanks for this very nicely detailed bug report, it sounds like you're OK with your solution and this should ultimately be resolved with the hpet blueprint in stein which you're already aware of. Given that, we'll likely close this as part of that blueprint since I'm not sure what kind of

[Yahoo-eng-team] [Bug 1804510] Re: mysql_exceptions_OperationalError, "Authentication plugin 'caching_sha2_password' cannot be loaded:

2018-11-28 Thread Matt Riedemann
This is definitely not a nova issue. From reading some other forums, it is a change in mysql 8. It would probably be better to ask in ask.openstack.org (forum), or check other solution sites via google. Or read the mysql docs: https://dev.mysql.com/doc/refman/8.0/en/caching-sha2-pluggable-

[Yahoo-eng-team] [Bug 1805164] Re: Services can not be disabled

2018-11-28 Thread Matt Riedemann
ova/pike Importance: Undecided => Medium ** Changed in: nova Importance: Medium => Low ** Changed in: nova Assignee: (unassigned) => Matt Riedemann (mriedem) ** Changed in: nova/rocky Importance: Undecided => Medium ** Changed in: nova/pike Importance: Medium

[Yahoo-eng-team] [Bug 1805463] Re: Spice console does not working

2018-11-28 Thread Matt Riedemann
It looks like the nova-consoleauth service is not running since the RPC call is timing out - can you confirm? ** Tags added: console spice ** Changed in: nova Status: New => Invalid -- You received this bug notification because you are a member of Yahoo! Engineering Team, which is

[Yahoo-eng-team] [Bug 1805233] [NEW] Compute schedulers in nova - weights section is out of date

2018-11-26 Thread Matt Riedemann
Public bug reported: - [x] This doc is inaccurate in this way: This bug is specifically about the weights section here: https://docs.openstack.org/nova/rocky/admin/configuration/schedulers.html#weights There are a few issues: 1. Mentioning cells in here is not qualified as only for cells v1,

[Yahoo-eng-team] [Bug 1680773] Re: Migration of a one VM deployed as part of group fails with NoValidHost

2018-11-26 Thread Matt Riedemann
*** This bug is a duplicate of bug 1718455 *** https://bugs.launchpad.net/bugs/1718455 This has been fixed awhile ago, I need to find the duplicate bug. ** This bug has been marked a duplicate of bug 1718455 [pike] Nova host disable and Live Migrate all instances fail. -- You received

[Yahoo-eng-team] [Bug 1789423] Re: Server operations fail to complete with versioned notifications if payload contains unset is_public field

2018-11-21 Thread Matt Riedemann
** Also affects: nova/ocata Importance: Undecided Status: New ** Also affects: nova/rocky Importance: Undecided Status: New ** Also affects: nova/queens Importance: Undecided Status: New ** Also affects: nova/pike Importance: Undecided Status: New **

[Yahoo-eng-team] [Bug 1804325] [NEW] InstanceNotFound traceback errors in n-api logs while polling for server delete

2018-11-20 Thread Matt Riedemann
Public bug reported: As a result of this change: https://review.openstack.org/#/c/591658/ The nova-api logs now traceback InstanceNotFound errors when polling a server to be deleted, which is an expected situation and we shouldn't be logging errors in the API logs for that:

[Yahoo-eng-team] [Bug 1627597] Re: Nova instance backup with rotation 0 creates backup and deletes it immediately

2018-11-19 Thread Matt Riedemann
** Changed in: nova Status: In Progress => Won't Fix -- You received this bug notification because you are a member of Yahoo! Engineering Team, which is subscribed to OpenStack Compute (nova). https://bugs.launchpad.net/bugs/1627597 Title: Nova instance backup with rotation 0 creates

[Yahoo-eng-team] [Bug 1768807] Re: Live Migration failure: 'ascii' codec can't encode characters in position 251-252

2018-11-19 Thread Matt Riedemann
** Also affects: nova/rocky Importance: Undecided Status: New ** Changed in: nova/rocky Status: New => In Progress ** Changed in: nova/rocky Importance: Undecided => Medium ** Changed in: nova/rocky Assignee: (unassigned) => s10 (vlad-esten) -- You received this bug

[Yahoo-eng-team] [Bug 1801326] Re: CRITICAL keystonemiddleware.auth_token

2018-11-14 Thread Matt Riedemann
Looks like some kind of misconfiguration. You're trying to create a flavor and nova-api is trying to call keystone to validate the token using the keystone auth token middleware, and that is failing because something is misconfigured. Check the install docs and config docs:

[Yahoo-eng-team] [Bug 1796192] Re: online_data_migrations exceptions quietly masked

2018-11-13 Thread Matt Riedemann
** Changed in: nova Assignee: Matt Riedemann (mriedem) => iain MacDonnell (imacdonn) ** Also affects: nova/rocky Importance: Undecided Status: New ** Changed in: nova/rocky Status: New => Fix Released ** Changed in: nova/rocky Importance: Undecided => Medium *

[Yahoo-eng-team] [Bug 1802640] [NEW] TimeoutException: Commands [

2018-11-10 Thread Matt Riedemann
Public bug reported: Seen here: http://logs.openstack.org/40/617040/1/check/nova- next/0a82b26/logs/screen-q-agt.txt.gz?level=TRACE Nov 10 03:51:03.120446 ubuntu-xenial-ovh-bhs1-461070 neutron-openvswitch-agent[26802]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command:

[Yahoo-eng-team] [Bug 1799892] Re: Placement API crashes with 500s in Rocky upgrade with downed compute nodes

2018-11-09 Thread Matt Riedemann
There is an online data migration: https://review.openstack.org/#/c/377138/62/nova/objects/resource_provider.py@917 But it's only when listing/showing resource providers. The allocation candidates code must be getting the providers and relying on the root_provider_id using sqla model objects

[Yahoo-eng-team] [Bug 1798688] Re: iptables_hybrid tests tempest.api.compute.servers.test_servers_negative.ServersNegativeTestJSON.test_shelve_shelved_server failed

2018-11-09 Thread Matt Riedemann
Looks like the failure is here? http://logs.openstack.org/26/615126/5/check/tempest- full/69d913a/controller/logs/screen-n-super- cond.txt.gz#_Nov_06_19_48_37_408999 The test is failing to unshelve the server because unshelve fails during scheduling b/c of that placement failure. I saw this the

[Yahoo-eng-team] [Bug 1802041] Re: Failed to publish message to topic 'nova': 'NoneType' object has no attribute '__getitem__'

2018-11-09 Thread Matt Riedemann
Hmm, nova-api is failing to RPC cast to the nova-conductor service. What is the value of the [conductor]/topic configuration option in nova.conf? It should be 'conductor'. Do you have it set to 'nova'? https://docs.openstack.org/nova/queens/configuration/config.html#conductor.topic Otherwise

[Yahoo-eng-team] [Bug 1771810] Re: Quota calculation connects to all available cells

2018-11-08 Thread Matt Riedemann
** Also affects: nova/rocky Importance: Undecided Status: New ** Changed in: nova/rocky Status: New => Confirmed ** Changed in: nova/rocky Importance: Undecided => Medium ** Changed in: nova Importance: Low => Medium -- You received this bug notification because you are

[Yahoo-eng-team] [Bug 1801702] Re: Spawn may fail when cache=none on block device with logical block size > 512

2018-11-08 Thread Matt Riedemann
Maybe the check should try 8192, 4096 and then 512 and failing all three consider it not supported. ** Changed in: nova Status: New => Triaged ** Changed in: nova Importance: Undecided => High ** Also affects: nova/ocata Importance: Undecided Status: New ** Also affects:

[Yahoo-eng-team] [Bug 1802167] [NEW] nova-manage db purge -h has weird help for --before option

2018-11-07 Thread Matt Riedemann
Public bug reported: This is probably due to not having a metavar defined for the --before option, but the help output is weird: stack@stein:~/nova$ nova-manage db purge -h /usr/local/lib/python2.7/dist-packages/psycopg2/__init__.py:144: UserWarning: The psycopg2 wheel package will be renamed

[Yahoo-eng-team] [Bug 1801789] [NEW] GET /os-migrations sample has incorrect sort order

2018-11-05 Thread Matt Riedemann
Public bug reported: The API reference sample for the GET /os-migrations API with the 2.59 microversion: https://developer.openstack.org/api-ref/compute/?expanded=list- migrations-detail#list-migrations Shows an incorrect sort order. The returned migrations are sorted by [created_at, id] in

[Yahoo-eng-team] [Bug 1800441] Re: Unexpected exception in API method: MessagingTimeout: Timed out waiting for a reply to message ID

2018-11-01 Thread Matt Riedemann
Well, is the nova-consoleauth service running? Looks like it's timing out trying to communicate with the nova-consoleauth service, which you might have not installed/configured due to some confusion over the deprecation of that service in the Rocky release, see:

[Yahoo-eng-team] [Bug 1800508] Re: Missing exception handling mechanism in 'schedule_and_build_instances' for DBError at line 1180 of nova/conductor/manager.py

2018-11-01 Thread Matt Riedemann
** Tags removed: fault ** Tags added: fault-injection ** Changed in: nova Status: Triaged => Opinion -- You received this bug notification because you are a member of Yahoo! Engineering Team, which is subscribed to OpenStack Compute (nova). https://bugs.launchpad.net/bugs/1800508 Title:

[Yahoo-eng-team] [Bug 1800998] Re: It is impossible to release IP from instance. Error: 'AttributeError: remove_fixed_ip'

2018-11-01 Thread Matt Riedemann
This is a CLI issue. You're using python-novaclient 11.0.0 and the corresponding remove_fixed_ip code in novaclient was removed in 10.0.0: https://github.com/openstack/python- novaclient/commit/01fb16533bf562f39fe822bc12b9cc34b8580359#diff- 23708944688abb26fc151d28d327c721 So you need

[Yahoo-eng-team] [Bug 1800936] [NEW] 2.66 server-get-resp.json API sample is wrong - and likely not tested

2018-10-31 Thread Matt Riedemann
Public bug reported: The API sample for the GET /servers/{server_id} response is clearly not correct: https://github.com/openstack/nova/blob/f13debf2f0e5377b9d0b0bbd9422c6a79d2cc611/doc/api_samples/servers/v2.66 /server-get-resp.json Since a GET on a single server does not return a list. So

[Yahoo-eng-team] [Bug 1744079] Re: [SRU] disk over-commit still not correctly calculated during live migration

2018-10-31 Thread Matt Riedemann
** Also affects: nova/rocky Importance: Undecided Status: New ** Also affects: nova/queens Importance: Undecided Status: New ** Changed in: nova/queens Importance: Undecided => Low ** Changed in: nova/rocky Importance: Undecided => Low ** Changed in: nova/rocky

[Yahoo-eng-team] [Bug 1784155] Re: nova_placement service start not coordinated with api db sync on multiple controllers

2018-10-31 Thread Matt Riedemann
** Also affects: nova/rocky Importance: Undecided Status: New ** Changed in: nova/rocky Status: New => In Progress ** Changed in: nova/rocky Assignee: (unassigned) => Lee Yarwood (lyarwood) ** Changed in: nova/rocky Importance: Undecided => Low -- You received this

[Yahoo-eng-team] [Bug 1800661] [NEW] doc: Flavors in nova - numbered request groups

2018-10-30 Thread Matt Riedemann
Public bug reported: - [x] This is a doc addition request. The flavors doc mentions traits but does not mention anything about granular resource request groupings as described in the spec: https://specs.openstack.org/openstack/nova-specs/specs/queens/approved

[Yahoo-eng-team] [Bug 1800663] [NEW] docs: Flavors in nova - custom resource classes and overrides

2018-10-30 Thread Matt Riedemann
Public bug reported: - [x] This is a doc addition request. The nova flavor user guide doesn't mention the ability to specify custom resource classes on a flavor, or how to override standard resource classes, introduced in this spec in Pike:

[Yahoo-eng-team] [Bug 1800657] [NEW] docs: ComputeDriver.update_provider_tree in nova

2018-10-30 Thread Matt Riedemann
Public bug reported: - [x] This is a doc addition request. The document should be updated for the reshape provider tree changes made in Stein: https://specs.openstack.org/openstack/nova-specs/specs/stein/approved /reshape-provider-tree.html#changes-to-update-provider-tree Specifically the

[Yahoo-eng-team] [Bug 1800511] Re: VMs started before Rocky upgrade cannot be live migrated

2018-10-29 Thread Matt Riedemann
FWIW I don't think https://github.com/openstack/nova/commit/2b52cde565d542c03f004b48ee9c1a6a25f5b7cd really changed how https://github.com/openstack/nova/commit/f02b3800051234ecc14f3117d5987b1a8ef75877 could have broken anything. _update_vif_xml is called from the source host using migrate data

[Yahoo-eng-team] [Bug 1800472] [NEW] nova.tests.functional.test_server_group.ServerGroupTestV264.test_boot_servers_with_affinity_no_valid_host intermittently failing with "OpenStackApiNotFoundExceptio

2018-10-29 Thread Matt Riedemann
Public bug reported: http://logs.openstack.org/48/613348/1/check/nova-tox-functional/16b5d01 /job-output.txt.gz#_2018-10-29_10_14_46_484703 2018-10-29 10:14:46.550516 | ubuntu-xenial | 2018-10-29 10:14:45,457 INFO [nova.api.openstack.requestlog] 127.0.0.1 "POST

[Yahoo-eng-team] [Bug 1771860] Re: instance.availability_zone reports wrong az after live migration

2018-10-25 Thread Matt Riedemann
** Also affects: nova/rocky Importance: Undecided Status: New ** Changed in: nova/pike Status: New => Triaged ** Changed in: nova/queens Status: New => Triaged ** Changed in: nova/pike Importance: Undecided => Medium ** Changed in: nova/rocky Status: New =>

[Yahoo-eng-team] [Bug 1796689] Re: Incorrect results for tenant usage

2018-10-25 Thread Matt Riedemann
** Tags added: api ** Changed in: nova Importance: Undecided => Medium ** Also affects: nova/ocata Importance: Undecided Status: New ** Also affects: nova/rocky Importance: Undecided Status: New ** Also affects: nova/queens Importance: Undecided Status: New **

[Yahoo-eng-team] [Bug 1794302] Re: Live migration : service catalog is empty

2018-10-24 Thread Matt Riedemann
Check the [neutron] section of the nova configuration file used for your nova-conductor service, because that is what is failing. Is that configured? And if so, what are the values? Are those consistent with what is in the service catalog for the networking service (neutron)? ** Changed in: nova

[Yahoo-eng-team] [Bug 1797771] Re: nova rebuild using openstack server rebuild is failing

2018-10-24 Thread Matt Riedemann
This doesn't seem to be a nova problem, but a problem with your database: 2018-10-11 04:47:49.827 12628 ERROR nova.api.metadata.handler [req-e8a61425-56dc-4dd7-bbca-05ae913f24c0 - - - - -] Failed to get metadata for instance id: b9f8fe03-a78b-43f3-bc1f-68ceaff3f978 2018-10-11 04:47:49.827 12628

[Yahoo-eng-team] [Bug 1799727] Re: CPU_Allocation_Ratio from nova.conf doesn't update exisiting providers

2018-10-24 Thread Matt Riedemann
I believe the bug is right here: https://github.com/openstack/nova/blob/835faf3f40af6b0e07c585690982a997d6a2ac47/nova/compute/provider_tree.py#L128 That is just comparing the keys in the dict, not the values, so: >>> old {'a': 1, 'b': 2} >>> new {'a': 1, 'b': 2} >>> new['b'] = 3 >>> old {'a':

[Yahoo-eng-team] [Bug 1799727] Re: CPU_Allocation_Ratio from nova.conf doesn't update exisiting providers

2018-10-24 Thread Matt Riedemann
I guess this shouldn't be a problem in queens because the resource tracker didn't use that provider tree to report back the inventory changes: https://github.com/openstack/nova/blob/stable/queens/nova/compute/resource_tracker.py#L883 That was done in Rocky:

[Yahoo-eng-team] [Bug 1799707] [NEW] shutdown_timeout config min version is not consistent with glance image meta def

2018-10-24 Thread Matt Riedemann
Assignee: Matt Riedemann (mriedem) Status: In Progress ** Tags: compute config ** Changed in: nova Assignee: (unassigned) => Matt Riedemann (mriedem) -- You received this bug notification because you are a member of Yahoo! Engineering Team, which is subscribed to OpenStack

[Yahoo-eng-team] [Bug 1799557] [NEW] stopped instance resize (migrate_disk_and_power_off) fails, vm_state changed to active

2018-10-23 Thread Matt Riedemann
Public bug reported: This is based on code inspection, but I was wondering what would happen if a user tried to resize a baremetal instance, which isn't supported by the ironic virt driver. It is possible to resize a stopped instance. If a user tried to resize a stopped baremetal instance, I

[Yahoo-eng-team] [Bug 1799495] [NEW] api-ref: createImage description does not mention volume-backed snapshots

2018-10-23 Thread Matt Riedemann
Public bug reported: The API reference for the createImage server action: https://developer.openstack.org/api-ref/compute/?expanded=create-server- back-up-createbackup-action-detail,create-image-createimage-action- detail#create-image-createimage-action Does not mention anything about

[Yahoo-eng-team] [Bug 1778206] Re: Compute leaks volume attachments if we fail in driver.pre_live_migration

2018-10-23 Thread Matt Riedemann
** Tags added: compute live-migration volumes ** Also affects: nova/rocky Importance: Undecided Status: New ** Also affects: nova/pike Importance: Undecided Status: New ** Also affects: nova/queens Importance: Undecided Status: New ** Changed in: nova/pike

[Yahoo-eng-team] [Bug 1799298] Re: Metadata API cross joining instance_metadata and instance_system_metadata

2018-10-22 Thread Matt Riedemann
** Tags added: api db metadata performance ** Changed in: nova Status: New => Triaged ** Changed in: nova Importance: Undecided => Medium ** Also affects: nova/queens Importance: Undecided Status: New ** Also affects: nova/ocata Importance: Undecided Status: New

[Yahoo-eng-team] [Bug 1784353] Re: Rescheduled boot from volume instances fail due to the premature removal of their attachments

2018-10-22 Thread Matt Riedemann
** Also affects: nova/rocky Importance: Undecided Status: New ** Changed in: nova/queens Status: New => Triaged ** Changed in: nova/rocky Status: New => Triaged ** Changed in: nova Assignee: Stephen Finucane (stephenfinucane) => Lee Yarwood (lyarwood) ** Changed

[Yahoo-eng-team] [Bug 1799186] Re: Queens compute node is not compatible with Pike Controller node

2018-10-22 Thread Matt Riedemann
This isn't really supported. You should be configuring [upgrade_levels]/compute to pike: https://docs.openstack.org/nova/latest/configuration/config.html#upgrade_levels.compute Until you get everything upgraded to Queens at which point you can remove the RPC version pin. ** Changed in: nova

[Yahoo-eng-team] [Bug 1798787] Re: Installation help documentation is incorrect

2018-10-19 Thread Matt Riedemann
Yeah looking at this page in queens you see the nova-consoleauth service being installed and started: https://docs.openstack.org/nova/queens/install/controller-install- ubuntu.html But not in Rocky: https://docs.openstack.org/nova/rocky/install/controller-install- ubuntu.html That is because

[Yahoo-eng-team] [Bug 1789654] Re: placement allocation_ratio initialized with 0.0

2018-10-17 Thread Matt Riedemann
** Changed in: nova/rocky Status: In Progress => Fix Released -- You received this bug notification because you are a member of Yahoo! Engineering Team, which is subscribed to OpenStack Compute (nova). https://bugs.launchpad.net/bugs/1789654 Title: placement allocation_ratio

[Yahoo-eng-team] [Bug 1798188] Re: VNC stops working in rolling upgrade by default

2018-10-16 Thread Matt Riedemann
One suggestion in IRC today was that we could add a "nova-status upgrade check" which iterates the cell DBs looking to see if there are any non- deleted/disabled nova-consoleauth services table records and if so, check to see if there are no console_auth_tokens entries in that DB and if

[Yahoo-eng-team] [Bug 1798172] Re: Ironic driver tries to update the compute_node's UUID which of course fails in case of existing compute_nodes

2018-10-16 Thread Matt Riedemann
** Changed in: nova Status: New => Triaged ** Changed in: nova Importance: Undecided => High ** Also affects: nova/rocky Importance: Undecided Status: New ** Changed in: nova/rocky Status: New => Confirmed ** Changed in: nova/rocky Importance: Undecided => High

[Yahoo-eng-team] [Bug 1798158] Re: Non-templated transport_url will fail if not defined in config

2018-10-16 Thread Matt Riedemann
** Also affects: nova/rocky Importance: Undecided Status: New ** Changed in: nova/rocky Importance: Undecided => Medium ** Changed in: nova/rocky Status: New => Triaged ** Tags added: cells -- You received this bug notification because you are a member of Yahoo!

[Yahoo-eng-team] [Bug 1763051] Re: Need to audit when notifications are sent during live migration

2018-10-15 Thread Matt Riedemann
** Also affects: nova/queens Importance: Undecided Status: New ** Also affects: nova/rocky Importance: Undecided Status: New ** Changed in: nova/queens Status: New => Confirmed ** Changed in: nova/rocky Status: New => Confirmed ** Changed in: nova/queens

[Yahoo-eng-team] [Bug 1797966] [NEW] Tempest fails with "detaching network adapter failed.: libvirtError: internal error: End of file from qemu monitor"

2018-10-15 Thread Matt Riedemann
0 and qemu 2.11). Looking at this change: https://review.openstack.org/#/c/270891/4/nova/virt/libvirt/driver.py The one issue there is we're using a stale guest object. We should try to get a new instance of the guest object from the host and if the guest is gone we should get an Instance

[Yahoo-eng-team] [Bug 1788619] Re: disk cachemodes should be restricted with multiattached volumes

2018-10-12 Thread Matt Riedemann
Have you tested this or just guessing that the libvirt driver in nova isn't doing the right thing? Because multiattach disks are always set to cache mode "none": https://github.com/openstack/nova/blob/20bc0136d0665bafdcd379f19389a0a5ea7bf310/nova/virt/libvirt/driver.py#L423-L426 #

[Yahoo-eng-team] [Bug 1797580] [NEW] NoValidHost during live migration after cold migrating to a specified host

2018-10-12 Thread Matt Riedemann
Importance: High Assignee: Matt Riedemann (mriedem) Status: Triaged ** Affects: nova/queens Importance: High Status: Confirmed ** Affects: nova/rocky Importance: High Status: Confirmed ** Tags: live-migration ** Also affects: nova/queens Importance

[Yahoo-eng-team] [Bug 1797237] [NEW] Superfluous "Create attachment failed for volume" error in nova-api logs

2018-10-10 Thread Matt Riedemann
or downloading (HTTP 400) (Request-ID: req-c7739c6e-b110-4b0e-a0ee- 62f3e530205e) We shouldn't log an error for that since it doesn't require operator intervention. ** Affects: nova Importance: Medium Assignee: Matt Riedemann (mriedem) Status: In Progress ** Affects: nova/queens

[Yahoo-eng-team] [Bug 1796981] Re: nova/compute/manager.py throws TypeError: 'NoneType' object is not iterable

2018-10-10 Thread Matt Riedemann
ium ** Changed in: nova/pike Importance: Undecided => Medium ** Changed in: nova/queens Importance: Undecided => Medium ** Changed in: nova/rocky Importance: Undecided => Medium ** Tags added: libvirt ** Changed in: nova Assignee: (unassigned) => Matt Riedemann (mriedem)

[Yahoo-eng-team] [Bug 1797185] [NEW] live migration intermittently fails in CI with "Connection refused" during guest transfer

2018-10-10 Thread Matt Riedemann
Public bug reported: Seen here: http://logs.openstack.org/31/606031/4/check/nova-live- migration/9d106bb/logs/screen-n-cpu.txt.gz#_Oct_10_15_27_01_355106 Oct 10 15:27:01.355106 ubuntu-xenial-ovh-gra1-0002837152 nova-compute[15353]: ERROR nova.virt.libvirt.driver [None

[Yahoo-eng-team] [Bug 1796920] Re: Baremetal nodes should not be exposing non-custom-resource-class (vcpu, ram, disk)

2018-10-09 Thread Matt Riedemann
> Triaged ** Changed in: nova/pike Importance: Undecided => High ** Changed in: nova/rocky Assignee: (unassigned) => Matt Riedemann (mriedem) ** Changed in: nova/queens Importance: Undecided => High ** Changed in: nova/rocky Status: New => Triaged ** Changed in:

[Yahoo-eng-team] [Bug 1796737] [NEW] resize: hypervisor local_gb_used still reports usage even with volume-backed instances after fix for bug 1469179

2018-10-08 Thread Matt Riedemann
/blob/f63fd14975cda83d24121b010cbedfc3a7e5ff1f/nova/compute/resource_tracker.py#L1466 ** Affects: nova Importance: Medium Assignee: Matt Riedemann (mriedem) Status: Triaged ** Affects: nova/rocky Importance: Medium Status: Triaged ** Tags: compute resour volumes

[Yahoo-eng-team] [Bug 1763043] Re: Unnecessary "Instance not resizing, skipping migration" warning in n-cpu logs during live migration

2018-10-08 Thread Matt Riedemann
** Also affects: nova/rocky Importance: Undecided Status: New ** Changed in: nova/rocky Status: New => Confirmed ** Changed in: nova/rocky Importance: Undecided => Medium -- You received this bug notification because you are a member of Yahoo! Engineering Team, which is

[Yahoo-eng-team] [Bug 1795992] [NEW] retry_select_destinations decorator can make a mess with allocations in placement in a large multi-create request

2018-10-03 Thread Matt Riedemann
2536892 nova-conductor[24583]: ERROR nova.conductor.manager 'to message ID %s' % msg_id) Oct 02 23:29:15.161412 ubuntu-xenial-limestone-regionone-0002536892 nova-conductor[24583]: ERROR nova.conductor.manager MessagingTimeout: Timed out waiting for a reply to message ID 832f7daa5e764687921a

[Yahoo-eng-team] [Bug 1795966] Re: (HTTP 500)

2018-10-03 Thread Matt Riedemann
Well, did you run "nova-manage api_db sync" when you setup the system? ** Changed in: nova Status: New => Invalid -- You received this bug notification because you are a member of Yahoo! Engineering Team, which is subscribed to OpenStack Compute (nova).

[Yahoo-eng-team] [Bug 1794126] Re: typo in IVS related privsep method, VM creation failure

2018-10-03 Thread Matt Riedemann
** Also affects: nova/queens Importance: Undecided Status: New ** Changed in: nova Status: New => Won't Fix ** Changed in: nova/queens Status: New => In Progress ** Changed in: nova/queens Assignee: (unassigned) => Aditya Vaja (wolverine-av) ** Changed in:

[Yahoo-eng-team] [Bug 1794985] Re: [QUEEN]: block migration is pretty unusable, blockjob bandwidth is limited to 1Mbps

2018-10-03 Thread Matt Riedemann
I believe that code was all reverted: https://review.openstack.org/#/q/Ibf2b5eeafd962e93ae4ab6290015d58c33024132 Marking this as invalid. ** Changed in: nova Status: New => Invalid -- You received this bug notification because you are a member of Yahoo! Engineering Team, which is

[Yahoo-eng-team] [Bug 1794914] Re: Nova API error when launch an instance

2018-10-03 Thread Matt Riedemann
Sounds like neutron auth configuration needs to be investigated. ** Changed in: nova Status: New => Incomplete ** Changed in: nova Status: Incomplete => Invalid -- You received this bug notification because you are a member of Yahoo! Engineering Team, which is subscribed to

[Yahoo-eng-team] [Bug 1795064] Re: SR-IOV error IndexError: pop from empty list

2018-10-03 Thread Matt Riedemann
This has been around since Juno: https://review.openstack.org/#/c/98828/ ** Changed in: nova Importance: Undecided => Medium ** Also affects: nova/ocata Importance: Undecided Status: New ** Also affects: nova/queens Importance: Undecided Status: New ** Also affects:

<    1   2   3   4   5   6   7   8   9   10   >