[Yahoo-eng-team] [Bug 1827628] Re: Cannot model affinity (and/or anti) with placement "limits" parameter

2019-05-09 Thread Matt Riedemann
This is closer to bug 1777591 than bug 1805984. ** Also affects: nova/queens Importance: Undecided Status: New ** Also affects: nova/stein Importance: Undecided Status: New ** Also affects: nova/rocky Importance: Undecided Status: New ** Changed in: nova/queens

[Yahoo-eng-team] [Bug 1828042] [NEW] Compute API in nova - all_tenants listed in non-admin query params set

2019-05-07 Thread Matt Riedemann
Public bug reported: - [x] This doc is inaccurate in this way: https://developer.openstack.org/api-ref/compute/?expanded=list-servers- detail#list-servers The GET /servers and GET /servers/detail entries say: """ - For non-admin users, whitelist is different from admin users whitelist. Valid

[Yahoo-eng-team] [Bug 1820588] Re: Bandwidth resource is leaked if a bound port is deleted in neutron

2019-05-07 Thread Matt Riedemann
** Also affects: nova/stein Importance: Undecided Status: New ** Changed in: nova/stein Status: New => Confirmed ** Changed in: nova/stein Importance: Undecided => Low -- You received this bug notification because you are a member of Yahoo! Engineering Team, which is subscri

[Yahoo-eng-team] [Bug 1803961] Re: Nova doesn't call migrate_volume_completion after cinder volume migration

2019-05-07 Thread Matt Riedemann
** Changed in: nova Importance: Undecided => Medium ** Also affects: nova/rocky Importance: Undecided Status: New ** Also affects: nova/queens Importance: Undecided Status: New ** Also affects: nova/stein Importance: Undecided Status: New ** Changed in: nova/que

[Yahoo-eng-team] [Bug 1821696] Re: Failed to start instances with encrypted volumes

2019-05-04 Thread Matt Riedemann
** Also affects: nova/queens Importance: Undecided Status: New ** Also affects: nova/rocky Importance: Undecided Status: New ** Also affects: nova/stein Importance: Undecided Status: New ** Changed in: nova/queens Status: New => In Progress ** Changed in: no

[Yahoo-eng-team] [Bug 1827453] Re: Nova scheduler attempts to re-assign currently in-use SR-IOV VF to new VM

2019-05-04 Thread Matt Riedemann
*** This bug is a duplicate of bug 1633120 *** https://bugs.launchpad.net/bugs/1633120 ** This bug has been marked a duplicate of bug 1633120 Nova scheduler tries to assign an already-in-use SRIOV QAT VF to a new instance -- You received this bug notification because you are a member of

[Yahoo-eng-team] [Bug 1811726] Re: Deleting compute service only deletes "first" ironic node resource provider from placement

2019-05-03 Thread Matt Riedemann
** Changed in: nova Assignee: (unassigned) => Matt Riedemann (mriedem) ** Also affects: nova/stein Importance: Undecided Status: New ** Changed in: nova/stein Status: New => Confirmed ** Changed in: nova/stein Importance: Undecided => Medium -- You received

[Yahoo-eng-team] [Bug 1756179] Re: deleting a nova-compute service leaves orphaned records in placement and host mapping

2019-05-03 Thread Matt Riedemann
** Also affects: nova/ocata Importance: Undecided Status: New ** Changed in: nova/ocata Status: New => Fix Released ** Changed in: nova/ocata Importance: Undecided => Medium ** Changed in: nova/ocata Assignee: (unassigned) => huanhongda (hongda) -- You received this bu

[Yahoo-eng-team] [Bug 1827418] [NEW] Routed provider networks in neutron - placement CLI example

2019-05-02 Thread Matt Riedemann
Public bug reported: - [x] This is a doc addition request. The section of the doc that has the curl request to placement which says "As of the writing of this guide, there is not placement API CLI client, so the curl command is used for this example.", that could be replaced with using osc-placem

[Yahoo-eng-team] [Bug 1642492] Re: Swapping volume does not change non-bootable volume's 'Bootable' flag to True

2019-05-01 Thread Matt Riedemann
This is a super old bug that is arguably not really a bug - I don't see how it's really an issue. You can't boot from a non-bootable volume, which is what the user is trying to do here. If you're swapping the root volume to a non-bootable volume with no image then I'd expect reboot of the server to

[Yahoo-eng-team] [Bug 1826523] Re: libvirtError exceptions during volume attach leave volume connected to host

2019-04-26 Thread Matt Riedemann
https://review.opendev.org/#/c/655712/ ** Changed in: nova Status: New => In Progress ** Changed in: nova Importance: Undecided => Medium ** Changed in: nova Assignee: (unassigned) => Lee Yarwood (lyarwood) ** Tags added: libvirt volumes ** Also affects: nova/rocky Importance

[Yahoo-eng-team] [Bug 1826472] [NEW] addFloatingIp action can fail if re-associating a floating IP to an instance in another cell

2019-04-25 Thread Matt Riedemann
Public bug reported: Ran into this with the new nova-multi-cell job: http://logs.openstack.org/22/655222/3/check/nova-multi- cell/c1ba7e0/controller/logs/screen-n-api.txt.gz#_Apr_25_20_35_15_249786 Apr 25 20:35:15.249786 ubuntu-bionic-rax-ord-0005726254 devstack@n-api.service[19571]: ERROR nova

[Yahoo-eng-team] [Bug 1825882] Re: Virsh disk attach errors silently ignored

2019-04-25 Thread Matt Riedemann
Yeah indeed it looks like the raise was used improperly. Probably a better thing to do here would be to use the excutils.save_and_reraise_exception() which provides a context manager that you can control if the exception should be re-raised or not. ** Changed in: nova Status: New => Triaged

[Yahoo-eng-team] [Bug 1826062] Re: nova-grenade-live-migration broken since opendev repo rename

2019-04-23 Thread Matt Riedemann
False alarm, I just needed to rebase https://review.opendev.org/#/c/640207/. ** Changed in: nova/stein Status: New => Invalid ** Changed in: nova/rocky Status: New => Invalid -- You received this bug notification because you are a member of Yahoo! Engineering Team, which is subscr

[Yahoo-eng-team] [Bug 1826062] Re: nova-grenade-live-migration broken since opendev repo rename

2019-04-23 Thread Matt Riedemann
Apparently there was an opendev migration patch on stable branches as well, but https://review.opendev.org/#/q/Ie9b61775dbb92b10237688eaddaca606c1c73a23 was hit in queens and pike since it's non-voting and missed the migration patch. ** Changed in: nova/pike Status: New => Invalid ** Chang

[Yahoo-eng-team] [Bug 1826062] [NEW] nova-grenade-live-migration broken since opendev repo rename

2019-04-23 Thread Matt Riedemann
Public bug reported: (5:12:16 PM) mriedem: i just noticed this in a non-voting job in stable/pike but it's also in queens, looks like legacy jobs are now failing because of incorrect or missing required-projects on devstack-gate? (5:12:17 PM) mriedem: http://logs.openstack.org/98/640198/2/check

[Yahoo-eng-team] [Bug 1652335] Re: The scheduler returns limits even if the instance was boot using AZ forced flag

2019-04-23 Thread Matt Riedemann
If you're forcing the host you're bypassing the scheduler filters and that's why you're risking the over-subscription (and failure) of resources. https://specs.openstack.org/openstack/nova- specs/specs/train/approved/add-host-and-hypervisor-hostname-flag-to- create-server.html will solve this, but

[Yahoo-eng-team] [Bug 1801897] Re: List AVZs can take several seconds

2019-04-23 Thread Matt Riedemann
Note that the scatter/gather routine when fetching services from the HostAPI was already backported to pike: https://review.opendev.org/#/q/I90b488102eb265d971cade29892279a22d3b5273 ** Also affects: nova/queens Importance: Undecided Status: New ** Also affects: nova/rocky Importance

[Yahoo-eng-team] [Bug 1677097] Re: AvailabilityZoneFilter returns a wrong result because of the availablity_zone in the instances table has not be updated

2019-04-23 Thread Matt Riedemann
*** This bug is a duplicate of bug 1771860 *** https://bugs.launchpad.net/bugs/1771860 ** This bug has been marked a duplicate of bug 1771860 instance.availability_zone reports wrong az after live migration -- You received this bug notification because you are a member of Yahoo! Engineeri

[Yahoo-eng-team] [Bug 1453629] Re: Creating neutron ports uses incorrect instance availability zone

2019-04-23 Thread Matt Riedemann
I think this was likely inadvertently fixed by https://review.opendev.org/#/c/446053/ in Pike. Sam, can you confirm? ** Changed in: nova Status: Confirmed => Fix Released ** Changed in: nova Assignee: (unassigned) => Dan Smith (danms) -- You received this bug notification because yo

[Yahoo-eng-team] [Bug 1825583] Re: Region name isn't respected when configuring ironic

2019-04-23 Thread Matt Riedemann
** Changed in: nova Importance: Undecided => Medium ** Also affects: nova/queens Importance: Undecided Status: New ** Also affects: nova/rocky Importance: Undecided Status: New ** Also affects: nova/stein Importance: Undecided Status: New -- You received this b

[Yahoo-eng-team] [Bug 1803717] Re: Instance snapshot fails with rbd backend

2019-04-23 Thread Matt Riedemann
> With the merge of https://review.opendev.org/#/c/650064/ this bug was introduced on the Rocky stable branch two weeks ago. Hmm, looks like you're right because the ceph job in that change is failing snapshot tests: http://logs.openstack.org/64/650064/2/check/devstack-plugin-ceph- tempest/291529

[Yahoo-eng-team] [Bug 1825537] Re: finish_resize failures incorrectly revert allocations

2019-04-19 Thread Matt Riedemann
Gerrit is down but I've written a functional regression test to recreate the bug and attached it as a patch for now. ** Description changed: - This is purely based on code inspection right now, I need to write a - functional test to recreate the issue. - While triaging bug 1821594 it got me th

[Yahoo-eng-team] [Bug 1749215] Re: Allocations not deleted on failed resize_instance

2019-04-19 Thread Matt Riedemann
I think this possibly introduced a regression bug 1825537 so I've marked Ocata as won't fix for this bug. ** Changed in: nova/ocata Status: Confirmed => Won't Fix -- You received this bug notification because you are a member of Yahoo! Engineering Team, which is subscribed to OpenStack Co

[Yahoo-eng-team] [Bug 1825537] [NEW] finish_resize failures incorrectly revert allocations

2019-04-19 Thread Matt Riedemann
Public bug reported: This is purely based on code inspection right now, I need to write a functional test to recreate the issue. While triaging bug 1821594 it got me thinking about handling placement allocations during resize when something fails, which got me thinking about an older fix: https:

[Yahoo-eng-team] [Bug 1825535] [NEW] nova.tests.unit.test_rpc.TestRPC intermittently fails if run in isolation

2019-04-19 Thread Matt Riedemann
NoSuchGroupError: no such group [oslo_messaging_notifications]' b'' It looks like that's because the notification setup in the base test class isn't taking into account when the RPCFixture is being used: https://github.com/openstack/nova/blob/b7a018f1265d9e0354e26

[Yahoo-eng-team] [Bug 1825435] [NEW] TestRPC unit tests intermittently fail with "'>' not supported between instances of 'NoneType' and 'datetime.datetime'"

2019-04-18 Thread Matt Riedemann
Public bug reported: Seen here: http://logs.openstack.org/45/649345/7/check/openstack-tox-py36/ba15c17 /job-output.txt.gz#_2019-04-18_18_12_52_121182 2019-04-18 18:12:52.121182 | ubuntu-bionic | {3} nova.tests.unit.test_rpc.TestRPC.test_get_transport_url_null [] ... inprogress 2019-04-18 18:12:

[Yahoo-eng-team] [Bug 1781300] Re: resize reschedule results in CantStartEngineError during up-call to InstanceMappings table

2019-04-18 Thread Matt Riedemann
Marking this as low severity since most deployments are probably running all services (except maybe nova-compute) with the api_db/connection configured so they wouldn't hit this, but it's definitely something we can hit in a multinode devstack environment in the gate. ** Also affects: nova/rocky

[Yahoo-eng-team] [Bug 1774249] Re: update_available_resource will raise DiskNotFound after resize but before confirm

2019-04-17 Thread Matt Riedemann
** Also affects: nova/pike Importance: Undecided Status: New ** Also affects: nova/rocky Importance: Undecided Status: New ** Also affects: nova/stein Importance: Undecided Status: New ** Also affects: nova/ocata Importance: Undecided Status: New ** Also

[Yahoo-eng-team] [Bug 1825020] Re: resize of instance, that was booted from volume, trigger image size check then fails resize

2019-04-16 Thread Matt Riedemann
Are you sure this is reproducible in pure nova code? Because this looks like forked nova code for starlingx: Traceback (most recent call last): File "/usr/lib64/python2.7/site-packages/nfv_plugins/nfvi_plugins/nfvi_compute_api.py", line 2127, in resize_instance future.result = (yield) Loo

[Yahoo-eng-team] [Bug 1825034] Re: listing deleted servers from the API fails after running fill_virtual_interface_list online data migration

2019-04-16 Thread Matt Riedemann
** Also affects: nova/stein Importance: Undecided Status: New ** Changed in: nova/stein Status: New => Confirmed ** Changed in: nova/stein Importance: Undecided => High -- You received this bug notification because you are a member of Yahoo! Engineering Team, which is subscr

[Yahoo-eng-team] [Bug 1825034] [NEW] listing deleted servers from the API fails after running fill_virtual_interface_list online data migration

2019-04-16 Thread Matt Riedemann
Public bug reported: I found this bug while trying to recreate bug 1825018 with a functional test. The fill_virtual_interface_list online data migration creates a fake mostly empty instance record to satisfy a foreign key constraint in the virtual_interfaces table which is used as a marker when p

[Yahoo-eng-team] [Bug 1825018] [NEW] security group driver gets loaded way too much in the api

2019-04-16 Thread Matt Riedemann
Public bug reported: There was a fix in Mitaka https://review.openstack.org/#/c/256073/ to cache the security group driver once it was loaded per process. That cache was removed in Newton https://review.openstack.org/#/c/325684/. I put up a test patch to see how many times the security group drive

[Yahoo-eng-team] [Bug 1822917] Re: "Overwriting current allocation" warnings in logs during move operations although there are no failures

2019-04-16 Thread Matt Riedemann
** Also affects: nova/stein Importance: Undecided Status: New ** Changed in: nova/stein Importance: Undecided => Medium ** Changed in: nova/stein Status: New => Confirmed -- You received this bug notification because you are a member of Yahoo! Engineering Team, which is subs

[Yahoo-eng-team] [Bug 1822801] Re: Baremetal port's host_id get updated during instance restart

2019-04-15 Thread Matt Riedemann
This was regressed in Stein with change https://review.openstack.org/#/c/603844/. ** Changed in: nova Importance: Undecided => High ** Tags added: compute ironic neutron ** Also affects: nova/stein Importance: Undecided Status: New ** Changed in: nova/stein Status: New => Co

[Yahoo-eng-team] [Bug 1824435] Re: fill_virtual_interface_list migration fails on second attempt

2019-04-11 Thread Matt Riedemann
It's because the context doesn't have a project_id so the first pass creates a record with project_id=None: https://github.com/openstack/nova/blob/03322bb517925a9f5a04ebdb41c3fd31e7962440/nova/db/sqlalchemy/api.py#L4037 There is also a unique constraint on project_id/name/deleted: https://github

[Yahoo-eng-team] [Bug 1819764] Re: Excessive warnings in nova-compute logs about unexpected network-vif-unplugged events during live migration

2019-04-11 Thread Matt Riedemann
** Also affects: nova/rocky Importance: Undecided Status: New -- You received this bug notification because you are a member of Yahoo! Engineering Team, which is subscribed to OpenStack Compute (nova). https://bugs.launchpad.net/bugs/1819764 Title: Excessive warnings in nova-compute

[Yahoo-eng-team] [Bug 1823794] [NEW] We should remove require_instance_exists_using_uuid

2019-04-08 Thread Matt Riedemann
Public bug reported: The require_instance_exists_using_uuid decorator is only used in one place in the DB API: https://github.com/openstack/nova/blob/fb1fee6772bb101eac83845bac9022df77113aaa/nova/db/sqlalchemy/api.py#L1599 This means that when listing virtual interfaces for an instance, we're do

[Yahoo-eng-team] [Bug 1646323] Re: instance action not record lock and unlock event

2019-04-08 Thread Matt Riedemann
This was implemented with blueprint fill-the-gap-for-instance-action- records https://review.openstack.org/#/c/523353/ in Queens. ** Changed in: nova Status: Confirmed => Invalid -- You received this bug notification because you are a member of Yahoo! Engineering Team, which is subscribed

[Yahoo-eng-team] [Bug 1823781] [NEW] Related virtual_interfaces not deleted in DB API instance_destroy method

2019-04-08 Thread Matt Riedemann
Public bug reported: I found this when testing change https://review.openstack.org/#/c/570202/ which adds a hard-delete parameter to the DB API instance_destroy() method. Normally this isn't a problem because when deleting an instance we call self.network_api.deallocate_for_instance which will ca

[Yahoo-eng-team] [Bug 1812945] Re: The computing node has left the mount information after the encryption fails.

2019-04-05 Thread Matt Riedemann
Feel free to backport this since it was introduced in Queens. ** Changed in: nova Assignee: Matt Riedemann (mriedem) => yenai (yenai2008) ** Also affects: nova/rocky Importance: Undecided Status: New ** Also affects: nova/queens Importance: Undecided Status:

[Yahoo-eng-team] [Bug 1737050] Re: No way to allow non admins the ability to filter on attributes such as host

2019-04-05 Thread Matt Riedemann
** Changed in: nova/rocky Status: In Progress => Invalid ** No longer affects: nova/rocky -- You received this bug notification because you are a member of Yahoo! Engineering Team, which is subscribed to OpenStack Compute (nova). https://bugs.launchpad.net/bugs/1737050 Title: No way to

[Yahoo-eng-team] [Bug 1717547] Re: Creating snapshot fails when image metadata has version field

2019-04-05 Thread Matt Riedemann
** Also affects: nova/queens Importance: Undecided Status: New ** Also affects: nova/rocky Importance: Undecided Status: New ** Changed in: nova/queens Status: New => In Progress ** Changed in: nova/rocky Status: New => In Progress ** Changed in: nova/ocata

[Yahoo-eng-team] [Bug 1785425] Re: tempest-full-py3 runs on test-only changes

2019-04-05 Thread Matt Riedemann
Also seeing this in stable/queens: https://review.openstack.org/#/c/649362/ ** Also affects: nova/queens Importance: Undecided Status: New ** Changed in: nova/queens Status: New => Confirmed ** Changed in: nova/queens Importance: Undecided => Medium -- You received this bug

[Yahoo-eng-team] [Bug 1823369] Re: _nova_check_type scheduler hint could be accidentally persisted during a rebuild with image change

2019-04-05 Thread Matt Riedemann
Also, force_hosts/force_nodes could be accidentally persisted in this case as well: https://github.com/openstack/nova/blob/a6963fa6858289d048e4d27ce8e61637cd023f4c/nova/compute/api.py#L3337-L3338 ** Also affects: nova/rocky Importance: Undecided Status: New ** Also affects: nova/stein

[Yahoo-eng-team] [Bug 1823370] Re: Evacuations are not restricted to the source cell during scheduling

2019-04-05 Thread Matt Riedemann
I likely need to write a functional test to recreate this first to see how things fail. ** Also affects: nova/pike Importance: Undecided Status: New ** Also affects: nova/stein Importance: Undecided Status: New ** Also affects: nova/queens Importance: Undecided Stat

[Yahoo-eng-team] [Bug 1823370] [NEW] Evacuations are not restricted to the source cell during scheduling

2019-04-05 Thread Matt Riedemann
Public bug reported: During most move operations we restrict the request spec to the cell the instance is in before calling the scheduler: unshelve: https://github.com/openstack/nova/blob/a6963fa6858289d048e4d27ce8e61637cd023f4c/nova/conductor/manager.py#L822 cold migrate: https://github.com/ope

[Yahoo-eng-team] [Bug 1823369] [NEW] _nova_check_type scheduler hint could be accidentally persisted during a rebuild with image change

2019-04-05 Thread Matt Riedemann
Public bug reported: This is based on code inspection and related to bug 1815153 (see comments 1-4) but when we rebuild a server with a new image we go through the scheduler with a special scheduler hint: https://github.com/openstack/nova/blob/a6963fa6858289d048e4d27ce8e61637cd023f4c/nova/compute

[Yahoo-eng-team] [Bug 1823251] [NEW] Spike in TestNovaMigrationsMySQL.test_walk_versions/test_innodb_tables failures since April 1 2019 on limestone-regionone

2019-04-04 Thread Matt Riedemann
Public bug reported: Seen here: http://logs.openstack.org/13/621313/21/check/openstack-tox-py36/ba2c848 /job-output.txt.gz#_2019-04-03_22_54_01_907907 The test times out and the underlying issue seems to be an InterfaceError from pymysql: http://paste.openstack.org/show/748901/ The thread swit

[Yahoo-eng-team] [Bug 1823215] [NEW] TestInstanceNotificationSampleWithMultipleComputeOldAttachFlow._test_live_migration_force_complete intermittent fails with MismatchError: 6 != 7

2019-04-04 Thread Matt Riedemann
Public bug reported: Seen here: http://logs.openstack.org/47/638047/9/check/nova-tox-functional/71f64ae /job-output.txt.gz#_2019-04-02_00_07_32_290065 2019-04-02 00:07:32.290065 | ubuntu-bionic | {2} nova.tests.functional.notification_sample_tests.test_instance.TestInstanceNotificationSampleWit

[Yahoo-eng-team] [Bug 1823203] Re: PortLimitExceeded results in 500 error from POST /servers/{server_id}/os-interface

2019-04-04 Thread Matt Riedemann
rvice[12332]: {{(pid=12334) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:943}} ** Changed in: nova Assignee: (unassigned) => Matt Riedemann (mriedem) ** Changed in: nova Importance: Undecided => Medium ** Changed in: nova Status: New => Confirmed ** Also affect

[Yahoo-eng-team] [Bug 1823207] Re: Annoying log on nova-compute startup with default configuration: "WARNING [nova.compute.monitors] Excluding nova.compute.monitors.cpu monitor virt_driver. Not in the

2019-04-04 Thread Matt Riedemann
** Also affects: nova/ocata Importance: Undecided Status: New ** Changed in: nova/ocata Status: New => Triaged ** Changed in: nova/ocata Importance: Undecided => Medium -- You received this bug notification because you are a member of Yahoo! Engineering Team, which is subscr

[Yahoo-eng-team] [Bug 1823207] [NEW] Annoying log on nova-compute startup with default configuration: "WARNING [nova.compute.monitors] Excluding nova.compute.monitors.cpu monitor virt_driver. Not in t

2019-04-04 Thread Matt Riedemann
&from=7d https://docs.openstack.org/nova/latest/configuration/config.html#DEFAULT.compute_monitors The help in that config option is also misleading since it mentions "numa_mem_bw" which does not exist in nova. ** Affects: nova Importance: Medium Assignee: Matt Riedemann (mrie

[Yahoo-eng-team] [Bug 1823198] Re: NetworkAmbiguous traceback in nova-compute logs even though it's a user error

2019-04-04 Thread Matt Riedemann
** Also affects: nova/queens Importance: Undecided Status: New ** Also affects: nova/stein Importance: Undecided Status: New ** Also affects: nova/pike Importance: Undecided Status: New ** Also affects: nova/rocky Importance: Undecided Status: New ** Chan

[Yahoo-eng-team] [Bug 1823203] [NEW] PortLimitExceeded results in 500 error from POST /servers/{server_id}/os-interface

2019-04-04 Thread Matt Riedemann
Public bug reported: This is based on code inspection at the moment, but attaching an interface (port) to a server by providing a network and having nova- compute create the port on that network can result in an over-quota failure from neutron: https://github.com/openstack/nova/blob/6ebb2c4cae65c

[Yahoo-eng-team] [Bug 1819764] Re: Excessive warnings in nova-compute logs about unexpected network-vif-unplugged events during live migration

2019-04-04 Thread Matt Riedemann
** Also affects: nova/stein Importance: Undecided Status: New ** Changed in: nova/stein Status: New => In Progress ** Changed in: nova/stein Assignee: (unassigned) => Matt Riedemann (mriedem) ** Changed in: nova/stein Importance: Undecided => Medium -- You

[Yahoo-eng-team] [Bug 1823198] [NEW] NetworkAmbiguous traceback in nova-compute logs even though it's a user error

2019-04-04 Thread Matt Riedemann
Public bug reported: There is a tempest negative test which is trying to attach a network interface to a server but it is not requesting a specific network or port: http://logs.openstack.org/58/637058/15/check/nova- next/f4e8140/logs/tempest.txt.gz#_2019-04-04_00_07_20_973 2019-04-04 00:07:20.97

[Yahoo-eng-team] [Bug 1823192] [NEW] Lack of documentation for rootwrap and privsep in nova docs

2019-04-04 Thread Matt Riedemann
Public bug reported: Regarding rootwrap, this is the only mention in the nova docs: https://docs.openstack.org/nova/stein/cli/nova-rootwrap.html And privsep isn't much better: https://docs.openstack.org/nova/stein/search.html?q=privsep There is no documentation really about how rootwrap should

[Yahoo-eng-team] [Bug 1823104] [NEW] CellMappingPayload in select_destinations versioned notification sends sensitive database_connection and transport_url information

2019-04-03 Thread Matt Riedemann
* Affects: nova Importance: High Assignee: Matt Riedemann (mriedem) Status: Triaged ** Affects: nova/stein Importance: Undecided Status: New ** Tags: notifications security stein-rc-potential ** Changed in: nova Assignee: (unassigned) => Matt Riedemann

[Yahoo-eng-team] [Bug 1821015] Re: Attaching virtual GPU devices to guests in nova - libvirt reshaping

2019-04-03 Thread Matt Riedemann
** Also affects: nova/stein Importance: Undecided Status: New ** Changed in: nova/stein Status: New => In Progress ** Changed in: nova/stein Importance: Undecided => Medium ** Changed in: nova/stein Assignee: (unassigned) => melanie witt (melwitt) -- You received this

[Yahoo-eng-team] [Bug 1822917] [NEW] "Overwriting current allocation" warnings in logs during move operations although there are no failures

2019-04-02 Thread Matt Riedemann
Public bug reported: I'm not sure why this is a warning: https://github.com/openstack/nova/blob/b33fa1c054ba4b7d4e789aa51250ad5c8325da2d/nova/scheduler/client/report.py#L1880 Because it shows up in normal operations during a resize where allocations are moved from the instance to the migration r

[Yahoo-eng-team] [Bug 1821824] Re: Forbidden traits in flavor properties don't work

2019-04-02 Thread Matt Riedemann
** Also affects: nova/stein Importance: Undecided Status: New ** Also affects: nova/rocky Importance: Undecided Status: New ** Changed in: nova Importance: Undecided => High ** Changed in: nova/rocky Status: New => Confirmed ** Changed in: nova/stein Status:

[Yahoo-eng-team] [Bug 1819460] Re: instance stuck in BUILD state due to unhandled exceptions in conductor

2019-04-02 Thread Matt Riedemann
** Also affects: nova/stein Importance: Undecided Status: New ** Changed in: nova/stein Status: New => Confirmed ** Changed in: nova/stein Importance: Undecided => Low ** Changed in: nova Importance: Low => Medium ** Changed in: nova/stein Importance: Low => Medium --

[Yahoo-eng-team] [Bug 1815692] Re: minimum nova-compute service version is not cached in nova-api when running under wsgi

2019-04-01 Thread Matt Riedemann
** Also affects: nova/stein Importance: Undecided Status: New ** Changed in: nova/stein Status: New => Confirmed ** Changed in: nova/stein Importance: Undecided => Low -- You received this bug notification because you are a member of Yahoo! Engineering Team, which is subscri

[Yahoo-eng-team] [Bug 1822251] Re: grenade job fail due to missing memcache module

2019-04-01 Thread Matt Riedemann
*** This bug is a duplicate of bug 1820892 *** https://bugs.launchpad.net/bugs/1820892 This is likely a duplicate of bug 1820892. ** This bug has been marked a duplicate of bug 1820892 Intermittent "Error starting thread.: ModuleNotFoundError: No module named 'etcd3gw'" in grenade-py3 job

[Yahoo-eng-team] [Bug 1821733] Re: Failed to compute_task_build_instances: local variable 'sibling_set' referenced before assignment

2019-04-01 Thread Matt Riedemann
** Also affects: nova/queens Importance: Undecided Status: New ** Changed in: nova Status: New => Invalid ** Changed in: nova/queens Status: New => In Progress ** Changed in: nova/queens Importance: Undecided => Medium ** Changed in: nova/queens Assignee: (unassi

[Yahoo-eng-team] [Bug 1822357] Re: nova-compute don't start in grenade job due to missing libvirt module

2019-04-01 Thread Matt Riedemann
*** This bug is a duplicate of bug 1820892 *** https://bugs.launchpad.net/bugs/1820892 Yeah it's the same problem as bug 1820892, libvirt-python is installed on py27 rather than py36: http://logs.openstack.org/45/638645/11/gate/neutron-grenade-dvr- multinode/4064577/logs/pip2-freeze.txt.gz l

[Yahoo-eng-team] [Bug 1818730] Re: Errors in finish_revert_resize can leave migration.dest_compute pointing at source_compute

2019-03-29 Thread Matt Riedemann
** Also affects: nova/rocky Importance: Undecided Status: New ** Also affects: nova/stein Importance: Undecided Status: New ** Changed in: nova/stein Status: New => Confirmed ** Changed in: nova/rocky Importance: Undecided => Medium ** Changed in: nova/rocky

[Yahoo-eng-team] [Bug 1642537] Re: finish_resize fails with DBDeadlock on migrations table

2019-03-28 Thread Matt Riedemann
** Also affects: nova/stein Importance: Undecided Status: New ** Also affects: nova/queens Importance: Undecided Status: New ** Also affects: nova/rocky Importance: Undecided Status: New ** Changed in: nova/queens Status: New => Confirmed ** Changed in: nova

[Yahoo-eng-team] [Bug 1819963] Re: Reverting a resize does not update the instance.availability_zone value to the source az

2019-03-28 Thread Matt Riedemann
** Also affects: nova/stein Importance: Undecided Status: New ** Changed in: nova/stein Status: New => In Progress ** Changed in: nova/stein Importance: Undecided => Medium ** Changed in: nova/stein Assignee: (unassigned) => Matt Riedemann (mriedem) -- You

[Yahoo-eng-team] [Bug 1821755] Re: live migration break the anti-affinity policy of server group simultaneously

2019-03-27 Thread Matt Riedemann
*** This bug is a duplicate of bug 1526642 *** https://bugs.launchpad.net/bugs/1526642 This is a long-standing known issue I believe, same for server build and evacuate (evacuate was fixed later in Rocky I think). There is a late affinity check in the compute service to check for the race in t

[Yahoo-eng-team] [Bug 1821916] Re: "openstack placement aggregate" CLI command should be replaced with "resource provider aggregate" in https://docs.openstack.org/nova/rocky/admin/configuration/schedu

2019-03-27 Thread Matt Riedemann
Heh, yeah, good catch, even the console example uses the correct CLI. ** Changed in: nova Status: New => Confirmed ** Changed in: nova Importance: Undecided => Low ** Also affects: nova/rocky Importance: Undecided Status: New ** Also affects: nova/stein Importance: Undeci

[Yahoo-eng-team] [Bug 1821764] [NEW] docs: JsonFilter query hint examples do not use valid json strings

2019-03-26 Thread Matt Riedemann
") ValueError: No JSON object could be decoded The docs should probably just be consistent and use the same example that works from the openstack server create command example: '[">=","$free_ram_mb",1024]' ** Affects: nova Importance: Medium

[Yahoo-eng-team] [Bug 1820337] Re: test_bfv_quota_race_local_delete intermittently fails with testtools.matchers._impl.MismatchError: ['bfv'] != []

2019-03-26 Thread Matt Riedemann
** Changed in: nova Assignee: Matt Riedemann (mriedem) => Matthew Booth (mbooth-9) ** Also affects: nova/queens Importance: Undecided Status: New ** Also affects: nova/stein Importance: Undecided Status: New ** Also affects: nova/pike Importance: Undeci

[Yahoo-eng-team] [Bug 1821594] Re: Error in confirm_migration leaves stale allocations and 'confirming' migration state

2019-03-25 Thread Matt Riedemann
This goes back to Pike as noted in the bug description. Before Pike the ResourceTracker.update_available_resource code would at least correct the allocations based on the instance.flavor and instance.host. ** Also affects: nova/rocky Importance: Undecided Status: New ** Also affects: no

[Yahoo-eng-team] [Bug 1669054] Re: RequestSpec.ignore_hosts from resize is reused in subsequent evacuate

2019-03-25 Thread Matt Riedemann
** Also affects: nova/pike Importance: Undecided Status: New ** Also affects: nova/rocky Importance: Undecided Status: New ** Also affects: nova/stein Importance: Undecided Status: New ** Also affects: nova/ocata Importance: Undecided Status: New ** Also

[Yahoo-eng-team] [Bug 1789654] Re: placement allocation_ratio initialized with 0.0

2019-03-25 Thread Matt Riedemann
** Also affects: nova/pike Importance: Undecided Status: New ** Also affects: nova/queens Importance: Undecided Status: New ** Changed in: nova/queens Status: New => In Progress ** Changed in: nova/pike Status: New => In Progress ** Changed in: nova/pike Imp

[Yahoo-eng-team] [Bug 1791075] Re: update_available_resource periodic does not take into account all evacuation states

2019-03-22 Thread Matt Riedemann
** Also affects: nova/queens Importance: Undecided Status: New ** Changed in: nova/queens Status: New => In Progress ** Changed in: nova/queens Importance: Undecided => Medium ** Changed in: nova/queens Assignee: (unassigned) => huanhongda (hongda) -- You received this

[Yahoo-eng-team] [Bug 1788403] Re: test_server_connectivity_cold_migration_revert randomly fails ssh check

2019-03-20 Thread Matt Riedemann
This isn't showing up in the gate anymore so presumably the nova change fixed the issue or at least enough to make it very rare. ** No longer affects: neutron ** Changed in: nova Status: Confirmed => Fix Released ** Changed in: nova Assignee: (unassigned) => Matt Riedema

[Yahoo-eng-team] [Bug 1808063] Re: glanceclient.exc.HTTPBadGateway: 502 Proxy Error during server snapshot - infinite loop in File "/opt/stack/new/glance/glance/quota/__init__.py", line 168 in __getat

2019-03-20 Thread Matt Riedemann
** Changed in: glance Status: Confirmed => Fix Released ** No longer affects: openstack-gate ** Changed in: glance Assignee: (unassigned) => Chris Dent (cdent) -- You received this bug notification because you are a member of Yahoo! Engineering Team, which is subscribed to Glance. h

[Yahoo-eng-team] [Bug 1821092] [NEW] test_local_delete_removes_allocations_after_compute_restart failing since https://review.openstack.org/#/c/644591/

2019-03-20 Thread Matt Riedemann
Public bug reported: This just started failing: http://logs.openstack.org/63/642863/1/gate/nova-tox-functional/6573680 /job-output.txt.gz#_2019-03-20_15_58_21_993250 2019-03-20 15:58:21.993250 | ubuntu-bionic | {0} nova.tests.functional.regressions.test_bug_1679750.TestLocalDeleteAllocations.te

[Yahoo-eng-team] [Bug 1821015] [NEW] Attaching virtual GPU devices to guests in nova - libvirt reshaping

2019-03-20 Thread Matt Riedemann
Public bug reported: - [x] This is a doc addition request. This is coming up from discussion about what to document in the release notes for the libvirt VGPU reshaper work that happened in Stein: https://review.openstack.org/#/c/644412/4/releasenotes/notes/stein- prelude-b5fe92310e1e725e.yaml@57

[Yahoo-eng-team] [Bug 1820851] Re: Please do cell mapping without periodic task or active admin involvment

2019-03-19 Thread Matt Riedemann
discover_hosts_in_cells_interval is not mandatory, and discover_hosts can be run in deployment tooling when a new compute node is deployed. One of the goals of cells v2 is isolation from the cell to the API DB, so for the cell to be able to register itself with the API DB would require an "up-call"

[Yahoo-eng-team] [Bug 1820337] [NEW] test_bfv_quota_race_local_delete intermittently fails with testtools.matchers._impl.MismatchError: ['bfv'] != []

2019-03-15 Thread Matt Riedemann
Public bug reported: Seen here: http://logs.openstack.org/72/640772/1/gate/nova-tox-functional- py35/44118f7/job-output.txt.gz#_2019-03-13_18_36_04_685027 2019-03-13 18:36:04.685027 | ubuntu-xenial | {2} nova.tests.functional.regressions.test_bug_1806064.BootFromVolumeOverQuotaRaceDeleteTest.te

[Yahoo-eng-team] [Bug 1820283] [NEW] Scheduler Evolution in nova - the doc needs updating

2019-03-15 Thread Matt Riedemann
Public bug reported: There are several things in this doc that could be more detailed and/or updated since they were written. Some notes: - The "Cross Project Affinity" section should probably talk about the [cinder]cross_az_attach config option (and limitations with it) and things like neutron

[Yahoo-eng-team] [Bug 1817458] Re: duplicate allocation candidates with granular request

2019-03-14 Thread Matt Riedemann
https://storyboard.openstack.org/#!/project/openstack/placement ** Changed in: nova Status: New => Invalid -- You received this bug notification because you are a member of Yahoo! Engineering Team, which is subscribed to OpenStack Compute (nova). https://bugs.launchpad.net/bugs/1817458 T

[Yahoo-eng-team] [Bug 1819910] Re: test_server_connectivity_live_migration intermittently fails with NoValidHost due to DestinationHypervisorTooOld

2019-03-14 Thread Matt Riedemann
Removing nova from this for tracking purposes. I can open a separate bug for the side effect logging issue in nova. ** No longer affects: nova -- You received this bug notification because you are a member of Yahoo! Engineering Team, which is subscribed to OpenStack Compute (nova). https://bugs.

[Yahoo-eng-team] [Bug 1819568] Re: network_data.json doesn't contain information about floating IPs

2019-03-14 Thread Matt Riedemann
Yeah looks like this is the "public-ipv4" key in the ec2 metadata response. Note that it only returns the first, even if multiple floating IPs are attached to the server. This is not really a bug though, it is at least a blueprint or if we're following the rules about API changes it would also nee

[Yahoo-eng-team] [Bug 1820018] Re: instance breaks the affinity/anti-affinity of server group with force_hosts or force_nodes

2019-03-14 Thread Matt Riedemann
This is arguably working as designed, see the ML discussion: http://lists.openstack.org/pipermail/openstack- discuss/2019-March/003813.html I have added this as a topic for discussion at the Train release PTG: https://etherpad.openstack.org/p/nova-ptg-train ** Changed in: nova Status: Ne

[Yahoo-eng-team] [Bug 1819963] Re: Reverting a resize does not update the instance.availability_zone value to the source az

2019-03-13 Thread Matt Riedemann
** Changed in: nova Importance: Low => Medium ** Also affects: nova/pike Importance: Undecided Status: New ** Also affects: nova/queens Importance: Undecided Status: New ** Also affects: nova/rocky Importance: Undecided Status: New ** Changed in: nova/pike

[Yahoo-eng-team] [Bug 1819963] [NEW] Reverting a resize does not update the instance.availability_zone value to the source az

2019-03-13 Thread Matt Riedemann
value. But the instance.availability_zone value in the database is still incorrect. ** Affects: nova Importance: Low Assignee: Matt Riedemann (mriedem) Status: Triaged ** Tags: availability-zones resize -- You received this bug notification because you are a member of Yahoo! E

[Yahoo-eng-team] [Bug 1819944] Re: nova-grenade-live-migration job failing on ubuntu bionic due to missing ceph package

2019-03-13 Thread Matt Riedemann
As a workaround the ceph part of the nova live migration post-test-hook is being disabled. ** No longer affects: devstack-plugin-ceph ** Changed in: nova Status: New => Confirmed ** Changed in: nova Importance: Undecided => High -- You received this bug notification because you are a

[Yahoo-eng-team] [Bug 1819944] Re: nova-grenade-live-migration job failing on ubuntu bionic due to missing ceph package

2019-03-13 Thread Matt Riedemann
It also looks like this should have already setup devstack-plugin-ceph to support bionic: https://review.openstack.org/#/c/611594/ ** No longer affects: nova ** Also affects: nova Importance: Undecided Status: New -- You received this bug notification because you are a member of Yaho

[Yahoo-eng-team] [Bug 1819944] Re: nova-grenade-live-migration job failing on ubuntu bionic due to missing ceph package

2019-03-13 Thread Matt Riedemann
Looks like we should be getting it from luminous: http://download.ceph.com/debian-luminous/dists/bionic/ (12:23:54 PM) coreycb: mriedem: hi, we have luminous in our bionic /queensrepos ** Also affects: devstack-plugin-ceph Importance: Undecided Status: New -- You received this bug no

[Yahoo-eng-team] [Bug 1815949] Re: missing special-case libvirt exception during device detach

2019-03-13 Thread Matt Riedemann
** Also affects: nova/pike Importance: Undecided Status: New ** Also affects: nova/rocky Importance: Undecided Status: New ** Also affects: nova/queens Importance: Undecided Status: New ** Changed in: nova/pike Status: New => Confirmed ** Changed in: nova/qu

[Yahoo-eng-team] [Bug 1819910] Re: test_server_connectivity_live_migration intermittently fails with NoValidHost due to PUT /allocations failure

2019-03-13 Thread Matt Riedemann
Looks like the allocations are swapped to the migration record here: Mar 13 01:08:15.371920 ubuntu-xenial-inap-mtl01-0003740112 nova- conductor[25115]: DEBUG nova.conductor.tasks.migrate [None req-a9345308-4e20-4976-ac6d-a1c529d14b16 tempest- TestNetworkAdvancedServerOps-840936673 tempest- TestNet

[Yahoo-eng-team] [Bug 1819910] [NEW] test_server_connectivity_live_migration intermittently fails with NoValidHost due to PUT /allocations failure

2019-03-13 Thread Matt Riedemann
Public bug reported: Seen here: http://logs.openstack.org/94/637594/1/gate/tempest- slow/90def65/controller/logs/screen-n-super- cond.txt.gz#_Mar_13_01_08_16_120854 Mar 13 01:08:16.120854 ubuntu-xenial-inap-mtl01-0003740112 nova-conductor[25115]: WARNING nova.scheduler.utils [None req-a9345308

[Yahoo-eng-team] [Bug 1819897] [NEW] Intermittent "Neutron did not start" failures in the gate

2019-03-13 Thread Matt Riedemann
Public bug reported: Seen here: http://logs.openstack.org/68/642068/2/gate/tempest-full- py3/3648e00/controller/logs/devstacklog.txt.gz#_2019-03-13_09_43_32_198 2019-03-13 09:42:32.696 | + functions-common:test_with_retry:2261: timeout 60 sh -c 'while ! wget --no-proxy -q -O- http://198.

[Yahoo-eng-team] [Bug 1734025] Re: cleanup running deleted instance with reap failed with none token context

2019-03-12 Thread Matt Riedemann
** Changed in: nova Assignee: Matt Riedemann (mriedem) => Li Xipeng (lixipeng) ** Changed in: nova Importance: Undecided => Medium ** Also affects: nova/pike Importance: Undecided Status: New ** Changed in: nova/pike Status: New => In Progress ** Changed in:

[Yahoo-eng-team] [Bug 1819764] [NEW] Excessive warnings in nova-compute logs about unexpected network-vif-unplugged events during live migration

2019-03-12 Thread Matt Riedemann
gs%3A%5C%22screen-n-cpu.txt%5C%22&from=7d ** Affects: nova Importance: Medium Assignee: Matt Riedemann (mriedem) Status: Confirmed ** Tags: compute live-migration neutron serviceability -- You received this bug notification because you are a member of Yahoo! Engineering Team,

<    1   2   3   4   5   6   7   8   9   10   >