[Yahoo-eng-team] [Bug 2052916] [NEW] HTTP get on s3tokens and ec2tokens endpoint gives 500 internal error

2024-02-12 Thread Tobias Urdin
Public bug reported: When doing a HTTP GET against s3tokens and ec2tokens endpoint we should get a 405 method not allowed but because the get method is getting enforced we get a 500 internal server error instead. AssertionError: PROGRAMMING ERROR: enforcement

[Yahoo-eng-team] [Bug 2049899] [NEW] disk remaining in logs during live migration says 100 when no disk is migrated

2024-01-19 Thread Tobias Urdin
Public bug reported: when doing live migrations for bfv instances the disk remaining in the nova log says 100 even if there is no disk to migrate ** Affects: nova Importance: Undecided Status: In Progress -- You received this bug notification because you are a member of Yahoo!

[Yahoo-eng-team] [Bug 2049903] [NEW] nova-compute starts even if resource provider creation fails with conflict

2024-01-19 Thread Tobias Urdin
Public bug reported: if an operator has a compute node and reinstalls it but forget to do a "openstack compute service delete " first (that would wipe the nova- compute service record and the resource provider in placement) the reinstalled compute node with the same hostname happily reports it's

[Yahoo-eng-team] [Bug 2034035] [NEW] neutron allowed address pair with same ip address causes ValueError

2023-09-04 Thread Tobias Urdin
Public bug reported: when managing allowed address pairs in horizon for a neutron port and you create two identical ip_address but with different mac_address, horizon crashes because the id in the table is the same, see below traceback. solution is to concat mac_address if set in the ID for that

[Yahoo-eng-team] [Bug 1787385] Re: vpnaas and dynamic-routing missing neutron-tempest-plugin in test-requirements.txt

2023-01-23 Thread Tobias Urdin
I have no idea what I was referring to there so will set as invalid, past me should have posted more details :p ** Changed in: neutron Status: New => Invalid -- You received this bug notification because you are a member of Yahoo! Engineering Team, which is subscribed to neutron.

[Yahoo-eng-team] [Bug 1960230] [NEW] resize fails with FileExistsError if earlier resize attempt failed to cleanup

2022-02-07 Thread Tobias Urdin
Public bug reported: This bug is related to resize with the libvirt driver If you are performing a resize and it fails the _cleanup_remote_migration() [1] function in the libvirt driver will try to cleanup the /var/lib/nova/instances/_resize directory on the remote side [2] - if this fails the

[Yahoo-eng-team] [Bug 1957167] [NEW] glance constraint for sqlalchemy is too low for xena

2022-01-12 Thread Tobias Urdin
Public bug reported: The glance requirement for sqlalchemy says >= 1.0.10 but using 1.3.2 gives error when trying to db sync this is xena release versions openstack-glance-21.1.0-1.el8.noarch python3-glance-store-2.3.0-2.el8.noarch python3-glanceclient-3.5.0-1.el8.noarch

[Yahoo-eng-team] [Bug 1948676] [NEW] rpc response timeout for agent report_state is not possible

2021-10-25 Thread Tobias Urdin
Public bug reported: When hosting a large amount of routers and/or networks the RPC calls from the agents can take a long time which requires us to increase the rpc_response_timeout from the default of 60 seconds to a higher value for the agents to not timeout. This has the side effect that if a

[Yahoo-eng-team] [Bug 1928875] Re: Neutron L3 HA state transition fails with KeyError and agent stops processing

2021-05-19 Thread Tobias Urdin
That seems about right. We upgraded from Train to Victoria recently so I would assume this was related to that. Ideally it should have handled the word 'master' as a transition and perhaps converted any /var/lib/neutron/ha_confs//state files or similar since the service did not work after one

[Yahoo-eng-team] [Bug 1928875] [NEW] Neutron L3 HA state transition fails with KeyError and agent stops processing

2021-05-18 Thread Tobias Urdin
Public bug reported: When using L3 HA enabled for routers sometimes the state transitions reports master instead of primary causing a KeyError in the TRANSLATION_MAP. This causes the agent to fail and stop processing them all together, if you then move a router (haven't tried for new routers) to

[Yahoo-eng-team] [Bug 1795280] Re: netns deletion on newer kernels fails with errno 16

2021-05-07 Thread Tobias Urdin
** Changed in: neutron Status: New => Invalid -- You received this bug notification because you are a member of Yahoo! Engineering Team, which is subscribed to neutron. https://bugs.launchpad.net/bugs/1795280 Title: netns deletion on newer kernels fails with errno 16 Status in

[Yahoo-eng-team] [Bug 1926978] [NEW] Leaking username and backend in RBD driver

2021-05-03 Thread Tobias Urdin
Public bug reported: The RBD utils get_pool_info() function raises an processutils.ProcessExecutionError from oslo.concurrency if it fails. That error message contains the Ceph username and the fact that it's running Ceph in the error message that a end-user can view. | fault

[Yahoo-eng-team] [Bug 1901707] [NEW] race condition on port binding vs instance being resumed for live-migrations

2020-10-27 Thread Tobias Urdin
Public bug reported: This is a separation from the discussion in this bug https://bugs.launchpad.net/neutron/+bug/1815989 There comment https://bugs.launchpad.net/neutron/+bug/1815989/comments/52 goes through in detail the flow on a Train deployment using neutron 15.1.0 (controller) and 15.3.0

[Yahoo-eng-team] [Bug 1869929] Re: RuntimeError: maximum recursion depth exceeded while calling a Python object

2020-04-03 Thread Tobias Urdin
Think this isn't a bug but was related to SELinux. This issue happend when I upgraded nova on our compute node and then this occured. So I removed the @db.select_db_reader_mode decorator usage in nova/objects/service.py to make it start. I then proceeded to upgrade Neutron and Ceilometer on the

[Yahoo-eng-team] [Bug 1869929] Re: RuntimeError: maximum recursion depth exceeded while calling a Python object

2020-04-01 Thread Tobias Urdin
** Also affects: nova Importance: Undecided Status: New -- You received this bug notification because you are a member of Yahoo! Engineering Team, which is subscribed to OpenStack Compute (nova). https://bugs.launchpad.net/bugs/1869929 Title: RuntimeError: maximum recursion depth

[Yahoo-eng-team] [Bug 1585699] Re: Neutron Metadata Agent Configuration - nova_metadata_ip

2020-01-28 Thread Tobias Urdin
** Changed in: puppet-neutron Status: New => Fix Released -- You received this bug notification because you are a member of Yahoo! Engineering Team, which is subscribed to neutron. https://bugs.launchpad.net/bugs/1585699 Title: Neutron Metadata Agent Configuration - nova_metadata_ip

[Yahoo-eng-team] [Bug 1828406] Re: neutron-dynamic-routing bgp ryu hold timer expired but never tried to recover

2019-05-13 Thread Tobias Urdin
Thanks Ryan, I'll mark it as invalid and wait until we are on Stein. ** Changed in: neutron Status: New => Invalid -- You received this bug notification because you are a member of Yahoo! Engineering Team, which is subscribed to neutron. https://bugs.launchpad.net/bugs/1828406 Title:

[Yahoo-eng-team] [Bug 1828547] [NEW] neutron-dynamic-routing TypeError: argument of type 'NoneType' is not iterable

2019-05-10 Thread Tobias Urdin
Public bug reported: Rocky with Ryu, dont have a reproduce on this one or don't know what caused it in the first place. python-neutron-13.0.3-1.el7.noarch openstack-neutron-openvswitch-13.0.3-1.el7.noarch python2-neutron-dynamic-routing-13.0.1-1.el7.noarch

[Yahoo-eng-team] [Bug 1828406] [NEW] neutron-dynamic-routing bgp ryu hold timer expired but never tried to recover

2019-05-09 Thread Tobias Urdin
Public bug reported: Lost connection to the peer and the hold timer expired but it never tried to recover. 2019-05-09 13:26:24.921 2461284 INFO bgpspeaker.speaker [-] Negotiated hold time 40 expired. 2019-05-09 13:26:24.922 2461284 INFO bgpspeaker.peer [-] Connection to peer lost, reason:

[Yahoo-eng-team] [Bug 1768807] Re: Live Migration failure: 'ascii' codec can't encode characters in position 251-252

2019-01-14 Thread Tobias Urdin
** Changed in: nova/rocky Status: Fix Committed => Fix Released -- You received this bug notification because you are a member of Yahoo! Engineering Team, which is subscribed to OpenStack Compute (nova). https://bugs.launchpad.net/bugs/1768807 Title: Live Migration failure: 'ascii'

[Yahoo-eng-team] [Bug 1799455] [NEW] AttributeError: 'BgpDrAgentNotifyApi' object has no attribute 'agent_updated'

2018-10-23 Thread Tobias Urdin
Public bug reported: When installing a new bgp-dragent and it's disabled by default (enable_new_agents=False) and you try to enable it, it throws an error on the first attempt then works on the second. openstack network agent set --enable 8139752e-5f08-424b-9b99-09772da3ec7d # fails openstack

[Yahoo-eng-team] [Bug 1795280] [NEW] netns deletion on newer kernels fails with errno 16

2018-09-30 Thread Tobias Urdin
Public bug reported: This is probably not neutron related, but need help with some input. On a 3.10 kernel on CentOS 7.5 by simply creating a network and deleting it properly terminates all processes, removes interfaces and deletes the network namespace. [root@controller ~]# uname -r

[Yahoo-eng-team] [Bug 1794259] [NEW] rocky upgrade path broken requirements pecan too low

2018-09-25 Thread Tobias Urdin
Public bug reported: When upgrading to Rocky we noticed that the pecan requirement is: pecan!=1.0.2,!=1.0.3,!=1.0.4,!=1.2,>=1.1.1 # BSD https://github.com/openstack/neutron/blob/stable/rocky/requirements.txt#L11 But when having python2-pecan-1.1.2 which should satisfy this requirement we get

[Yahoo-eng-team] [Bug 1793353] [NEW] broken upgrade path q->r requirement for oslo.db

2018-09-19 Thread Tobias Urdin
Public bug reported: Nova is using async_ introduced in oslo.db 4.40.0 but requirements.txt says oslo.db>=4.27.0 https://github.com/openstack/oslo.db/commit/df6bf3401266f42271627c1e408f87c71a06cef7 So if you still have an old oslo.db version from queens that satisfies that requirement services

[Yahoo-eng-team] [Bug 1793347] [NEW] keystone upgrade fails q->r oslo.log requirement to low

2018-09-19 Thread Tobias Urdin
Public bug reported: When upgrading from Keystone queens to rocky the requirements.txt for rocky says oslo.log >= 3.36.0 but versionutils.deprecated.ROCKY is not introduced until 3.37.0 Should bump requirements.txt to atleast 3.37.0 Error when running db sync: Traceback (most recent call last):

[Yahoo-eng-team] [Bug 1788384] [NEW] self-service password change UI is confusing for end users

2018-08-22 Thread Tobias Urdin
Public bug reported: When a end user wants to use the self-service feature to changing their own password it's very common that they go under Identity -> Users and press the "Change password" button for their own user which does not work unless they are admin because it calls update_user keystone

[Yahoo-eng-team] [Bug 1787919] [NEW] Upgrade router to L3 HA broke IPv6

2018-08-20 Thread Tobias Urdin
to troubleshoot this here or on IRC (tobias-urdin). Best regards Tobias [1] https://review.openstack.org/#/q/topic:bug/1667756+(status:open+OR+status:merged [2] http://lists.openstack.org/pipermail/openstack-dev/2018-August/133499.html ** Affects: neutron Importance: Undecided Status

[Yahoo-eng-team] [Bug 1787385] [NEW] vpnaas and dynamic-routing missing neutron-tempest-plugin in test-requirements.txt

2018-08-16 Thread Tobias Urdin
Public bug reported: The vpnaas and dynamic routing projects are missing the neutron-tempest- plugin in test-requirements.txt ** Affects: neutron Importance: Undecided Status: New -- You received this bug notification because you are a member of Yahoo! Engineering Team, which is

[Yahoo-eng-team] [Bug 1784590] [NEW] neutron-dynamic-routing bgp agent should have options for MP-BGP

2018-07-31 Thread Tobias Urdin
Public bug reported: neutron-dynamic-routing The implementation of BGP with Ryu supports IPv4 and IPv6 peers but the MP-BGP capabilities is announced based on if the peer is a v4 or v6 address. If you want to use a IPv4 peer but announce IPv6 prefixes this will not work because in

[Yahoo-eng-team] [Bug 1784342] [NEW] AttributeError: 'Subnet' object has no attribute '_obj_network_id'

2018-07-30 Thread Tobias Urdin
Public bug reported: Running rally caused subnets to be created without a network_id causing this AttributeError. OpenStack Queens RDO packages [root@controller1 ~]# rpm -qa | grep -i neutron python-neutron-12.0.2-1.el7.noarch openstack-neutron-12.0.2-1.el7.noarch

[Yahoo-eng-team] [Bug 1771517] [NEW] Quota update unexpected behavior with no access to keystone

2018-05-16 Thread Tobias Urdin
Public bug reported: Distro: OpenStack Queens running on Ubuntu 16.04 >From this commit [1] nova now needs access to keystone to perform quota (this bug is mostly related to issue we had with quota update). When keystone is not available the nova-api (running in eventlet) tries to use the

[Yahoo-eng-team] [Bug 1649616] Re: Keystone Token Flush job does not complete in HA deployed environment

2018-04-04 Thread Tobias Urdin
** Changed in: puppet-keystone Status: Triaged => Fix Released -- You received this bug notification because you are a member of Yahoo! Engineering Team, which is subscribed to OpenStack Identity (keystone). https://bugs.launchpad.net/bugs/1649616 Title: Keystone Token Flush job does

[Yahoo-eng-team] [Bug 1644187] Re: ValueError on creating new nova instance

2016-11-23 Thread Tobias Urdin
Was caused by our internal infrastructure sending an invalid API request. I'm sorry for the hassle, marking as invalid. ** Changed in: nova Status: New => Invalid ** Changed in: nova (Ubuntu) Status: New => Invalid -- You received this bug notification because you are a member of

[Yahoo-eng-team] [Bug 1644187] Re: ValueError on creating new nova instance

2016-11-23 Thread Tobias Urdin
Booting a nova instance with a block device as root volume. ** Also affects: nova (Ubuntu) Importance: Undecided Status: New -- You received this bug notification because you are a member of Yahoo! Engineering Team, which is subscribed to OpenStack Compute (nova).

[Yahoo-eng-team] [Bug 1644187] [NEW] ValueError on creating new nova instance

2016-11-23 Thread Tobias Urdin
Public bug reported: New bug introduced when upgrading nova-api on Ubuntu 14.04 for cloud archive liberty stable repo. (deb http://ubuntu-cloud.archive.canonical.com/ubuntu trusty-updates/liberty main) 2016-11-23 11:31:15.341 1600 ERROR nova.api.openstack.extensions

[Yahoo-eng-team] [Bug 1583977] Re: liberty neutron-l3-agent ha failes to spawn keepalived

2016-05-20 Thread Tobias Urdin
Moving the pid files for the affected router solves the issue. mv /var/lib/neutron/ha_confs/c1cc1a5d-c0ef-47b7-8d5c-88403e134725.* /root Found fix thanks to frickler on IRC. It has been merged for liberty https://review.openstack.org/#/c/299138/3 ** Changed in: cloud-archive Status: New

[Yahoo-eng-team] [Bug 1583977] [NEW] liberty neutron-l3-agent ha failes to spawn keepalived

2016-05-20 Thread Tobias Urdin
Public bug reported: After upgrading to 7.0.4 I have several routers that fails to spawn the keepalived process. The logs say 2016-05-20 11:01:11.181 23023 ERROR neutron.agent.linux.external_process [-] default-service for router with uuid c1cc1a5d-c0ef-47b7-8d5c-88403e134725 not found. The

[Yahoo-eng-team] [Bug 1525802] Re: live migration with multipath cinder volumes crashes node

2016-02-12 Thread Tobias Urdin
Resolved by changing the no_path_retry option in multipath.conf from "queue" to "0". The issue was that that when IO was queued and the path was about to be removed it was blocked and was never removed, so the flushing of the multipath device failed because the multipath device was in-use by

[Yahoo-eng-team] [Bug 1525802] [NEW] live migration with multipath cinder volumes crashes node

2015-12-13 Thread Tobias Urdin
Public bug reported: Hello, When issuing a live migration between kvm nodes having multipath cinder volume it sometimes hangs and causes qemu-kvm to crash, the only solution is a restart of the kvm node. Sometimes when live migrating you get stuck when it tries to migrate the active RAM, you

[Yahoo-eng-team] [Bug 1459791] Re: Juno to Kilo upgrade breaks default domain id

2015-12-07 Thread Tobias Urdin
Setting to invalid to clean up and since it seems like I was the only one having this issue. ** Changed in: keystone Status: In Progress => Invalid -- You received this bug notification because you are a member of Yahoo! Engineering Team, which is subscribed to OpenStack Identity

[Yahoo-eng-team] [Bug 1508907] [NEW] local_gb_used wrong in compute_nodes table when using Dell Cinder backend

2015-10-22 Thread Tobias Urdin
Public bug reported: We have compute nodes with a very small amount of disk so we deploy our instances to Cinder volumes with a Dell backend. The issue is that when creating instances with a Cinder volume it still gets counted towards the local storage used (local_gb_used in compute_nodes table

[Yahoo-eng-team] [Bug 1459791] [NEW] Juno to Kilo upgrade breaks default domain id

2015-05-28 Thread Tobias Urdin
Public bug reported: Hello, Upgrading from Keystone Juno to Kilo breaks my build. I have had close looks warnings and debug output in keystone.log and read notes on https://wiki.openstack.org/wiki/ReleaseNotes/Kilo#OpenStack_Identity_.28Keystone.29 but without any luck, I could simply bypass