[Yahoo-eng-team] [Bug 1853223] [NEW] [VPNaaS]: Python3 RuntimeError: dictionary changed size during iteration

2019-11-19 Thread Dongcan Ye
Public bug reported:

PY3 runtime error in driver report status:
Nov 13 03:13:11.221694 ubuntu-bionic-rax-iad-0012769742 
neutron-l3-agent[20209]: ERROR oslo.service.loopingcall [-] Fixed interval 
looping call 
'neutron_vpnaas.services.vpn.device_drivers.strongswan_ipsec.IPsecDriver.report_status'
 failed: RuntimeError: dictionary changed size during iteration
Nov 13 03:13:11.221694 ubuntu-bionic-rax-iad-0012769742 
neutron-l3-agent[20209]: ERROR oslo.service.loopingcall Traceback (most recent 
call last):
Nov 13 03:13:11.221694 ubuntu-bionic-rax-iad-0012769742 
neutron-l3-agent[20209]: ERROR oslo.service.loopingcall   File 
"/usr/local/lib/python3.6/dist-packages/oslo_service/loopingcall.py", line 150, 
in _run_loop
Nov 13 03:13:11.221694 ubuntu-bionic-rax-iad-0012769742 
neutron-l3-agent[20209]: ERROR oslo.service.loopingcall result = 
func(*self.args, **self.kw)
Nov 13 03:13:11.221694 ubuntu-bionic-rax-iad-0012769742 
neutron-l3-agent[20209]: ERROR oslo.service.loopingcall   File 
"/usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py", line 67, in 
wrapper
Nov 13 03:13:11.221694 ubuntu-bionic-rax-iad-0012769742 
neutron-l3-agent[20209]: ERROR oslo.service.loopingcall return 
method(*args, **kwargs)
Nov 13 03:13:11.221694 ubuntu-bionic-rax-iad-0012769742 
neutron-l3-agent[20209]: ERROR oslo.service.loopingcall   File 
"/opt/stack/neutron-vpnaas/neutron_vpnaas/services/vpn/device_drivers/ipsec.py",
 line 1067, in report_status
Nov 13 03:13:11.221694 ubuntu-bionic-rax-iad-0012769742 
neutron-l3-agent[20209]: ERROR oslo.service.loopingcall for process_id, 
process in self.processes.items():
Nov 13 03:13:11.221694 ubuntu-bionic-rax-iad-0012769742 
neutron-l3-agent[20209]: ERROR oslo.service.loopingcall RuntimeError: 
dictionary changed size during iteration
Nov 13 03:13:11.221694 ubuntu-bionic-rax-iad-0012769742 
neutron-l3-agent[20209]: ERROR oslo.service.loopingcall

Please search RuntimeError in log[1][2]

[1]
https://f68629e21ed230feb603-193839948e82df3f7b6031d1afea5d13.ssl.cf5.rackcdn.com/659063/8/check
/neutron-vpnaas-tempest/4e5241b/controller/logs/screen-q-l3.txt.gz

[2]
https://c808c0465a7aa7421965-eb83075bad77f107ed9b57803fd20c1f.ssl.cf2.rackcdn.com/693965/1/check
/neutron-vpnaas-tempest/3dde8e5/controller/logs/screen-q-l3.txt.gz

** Affects: neutron
 Importance: Undecided
 Assignee: Dongcan Ye (hellochosen)
 Status: New


** Tags: vpnaas

** Changed in: neutron
 Assignee: (unassigned) => Dongcan Ye (hellochosen)

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to neutron.
https://bugs.launchpad.net/bugs/1853223

Title:
  [VPNaaS]: Python3 RuntimeError: dictionary changed size during
  iteration

Status in neutron:
  New

Bug description:
  PY3 runtime error in driver report status:
  Nov 13 03:13:11.221694 ubuntu-bionic-rax-iad-0012769742 
neutron-l3-agent[20209]: ERROR oslo.service.loopingcall [-] Fixed interval 
looping call 
'neutron_vpnaas.services.vpn.device_drivers.strongswan_ipsec.IPsecDriver.report_status'
 failed: RuntimeError: dictionary changed size during iteration
  Nov 13 03:13:11.221694 ubuntu-bionic-rax-iad-0012769742 
neutron-l3-agent[20209]: ERROR oslo.service.loopingcall Traceback (most recent 
call last):
  Nov 13 03:13:11.221694 ubuntu-bionic-rax-iad-0012769742 
neutron-l3-agent[20209]: ERROR oslo.service.loopingcall   File 
"/usr/local/lib/python3.6/dist-packages/oslo_service/loopingcall.py", line 150, 
in _run_loop
  Nov 13 03:13:11.221694 ubuntu-bionic-rax-iad-0012769742 
neutron-l3-agent[20209]: ERROR oslo.service.loopingcall result = 
func(*self.args, **self.kw)
  Nov 13 03:13:11.221694 ubuntu-bionic-rax-iad-0012769742 
neutron-l3-agent[20209]: ERROR oslo.service.loopingcall   File 
"/usr/local/lib/python3.6/dist-packages/oslo_log/helpers.py", line 67, in 
wrapper
  Nov 13 03:13:11.221694 ubuntu-bionic-rax-iad-0012769742 
neutron-l3-agent[20209]: ERROR oslo.service.loopingcall return 
method(*args, **kwargs)
  Nov 13 03:13:11.221694 ubuntu-bionic-rax-iad-0012769742 
neutron-l3-agent[20209]: ERROR oslo.service.loopingcall   File 
"/opt/stack/neutron-vpnaas/neutron_vpnaas/services/vpn/device_drivers/ipsec.py",
 line 1067, in report_status
  Nov 13 03:13:11.221694 ubuntu-bionic-rax-iad-0012769742 
neutron-l3-agent[20209]: ERROR oslo.service.loopingcall for process_id, 
process in self.processes.items():
  Nov 13 03:13:11.221694 ubuntu-bionic-rax-iad-0012769742 
neutron-l3-agent[20209]: ERROR oslo.service.loopingcall RuntimeError: 
dictionary changed size during iteration
  Nov 13 03:13:11.221694 ubuntu-bionic-rax-iad-0012769742 
neutron-l3-agent[20209]: ERROR oslo.service.loopingcall

  Please search RuntimeError in log[1][2]

  [1]
  
https://f68629e21ed230feb603-193839948e82df3f7b6031d1afea5d13.ssl.cf5.rackcdn.com/659063/8/check
  /neutron-vpnaas-tempest/4e5241b/controller/logs/screen-q-l3.txt.gz

  [2]
  
https://c808c0465a7aa7421965-eb83075bad77f107ed9b57803

[Yahoo-eng-team] [Bug 1853089] Re: openstack env in Stein, CLI or Dashboard response slowly

2019-11-19 Thread Miguel Lavalle
Hi,

Same comments as in #1 and #2 above from Neutron. To treat this as a
bug, we need more specific data. Marking it invalid until more is
reported

** Changed in: neutron
   Status: New => Invalid

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/1853089

Title:
  openstack env in Stein, CLI or Dashboard response slowly

Status in neutron:
  Invalid
Status in OpenStack Compute (nova):
  Invalid

Bug description:
  Installed Stein OpenStack via Kolla, OpenStack node info as below:

  3 * Controller node which running in Virtualbox --- each machine memory: 32G 
and Disk:300G
  2 * Compute node which is physical rack server

  after operating in some days, the OpenStack response become very slow,
  the dashboard response is more slower.

  for example: run "openstack port list --timing" in CLI, it would spent
  about 13s when got 60 port data, and dashboard would spent more than
  20s.

To manage notifications about this bug go to:
https://bugs.launchpad.net/neutron/+bug/1853089/+subscriptions

-- 
Mailing list: https://launchpad.net/~yahoo-eng-team
Post to : yahoo-eng-team@lists.launchpad.net
Unsubscribe : https://launchpad.net/~yahoo-eng-team
More help   : https://help.launchpad.net/ListHelp


[Yahoo-eng-team] [Bug 1744670] Re: In pike ssl deployment horizon cnt retrieve volumes/snapshots and service data via cinderclient

2019-11-19 Thread OpenStack Infra
Reviewed:  https://review.opendev.org/675894
Committed: 
https://git.openstack.org/cgit/openstack/horizon/commit/?id=285c51f7e1b27a786fa9684abdc489998285b4e2
Submitter: Zuul
Branch:master

commit 285c51f7e1b27a786fa9684abdc489998285b4e2
Author: Ivan Kolodyazhny 
Date:   Mon Aug 12 16:19:44 2019 +0300

Add custom SSL CA Cert support for api.cinder.get_microversion

api.cinder.get_microversion function now supports OPENSTACK_SSL_NO_VERIFY
and OPENSTACK_SSL_CACERT config options.

This depends on commit 4a3a2c3c9a89ccff4e64d3da96de5b0af4303840 in
python-cinderclient, so the minimum version of python-cinderclient
is bumped to 5.0.0.

NOTE(amotoki): The stretegy of backporting to stable branches needs
a discussion with the requirements team as we cannot bump the
minimum version (at least the major version bump is surprising).

Change-Id: I22c6c60e10d8e9328f7f1e0c24d6c74496ec1a71
Closes-Bug: 1744670


** Changed in: horizon
   Status: In Progress => Fix Released

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Dashboard (Horizon).
https://bugs.launchpad.net/bugs/1744670

Title:
  In pike ssl deployment horizon cnt retrieve volumes/snapshots and
  service data via cinderclient

Status in OpenStack Dashboard (Horizon):
  Fix Released
Status in keystoneauth:
  Incomplete
Status in python-cinderclient:
  Confirmed

Bug description:
  Ops packages versions:
  openstack-cinder.noarch 11.0.1-1.el7
  openstack-dashboard.noarch  12.0.1-1.el7
  openstack-glance.noarch 15.0.0-2.el7
  openstack-keystone.noarch   12.0.0-1.el7
  openstack-neutron.noarch11.0.2-2.el7
  openstack-neutron-common.noarch 11.0.2-2.el7
  openstack-neutron-ml2.noarch11.0.2-2.el7
  openstack-nova-api.noarch   16.0.3-2.el7
  openstack-nova-common.noarch16.0.3-2.el7
  openstack-nova-conductor.noarch 16.0.3-2.el7
  openstack-nova-console.noarch   16.0.3-2.el7
  openstack-nova-novncproxy.noarch16.0.3-2.el7
  openstack-nova-placement-api.noarch 16.0.3-2.el7
  openstack-nova-scheduler.noarch 16.0.3-2.el7
  python2-cinderclient.noarch 3.1.0-1.el7

  Only after applying hard-coded links to certificate in cinder-client
  and keystone, the dashboard starts working:

  /cinderclient/client.py

  if self.timeout:
  kwargs.setdefault('timeout', self.timeout)
  self.http_log_req((url, method,), kwargs)
  resp = requests.request(
  method,
  url,
  +   cert = ("/etc/keystone/ssl/certs/signing_cert.pem",
  "/etc/keystone/ssl/private/signing_key.pem"),
  verify=self.verify_cert,
  **kwargs)
  self.http_log_resp(resp)

  /keystoneauth1/session.py

  def __init__(self, auth=None, session=None, original_ip=None, verify=True,
   cert=None, timeout=None, user_agent=None,
   redirect=_DEFAULT_REDIRECT_LIMIT, additional_headers=None,
   app_name=None, app_version=None, additional_user_agent=None,
   discovery_cache=None):

  self.auth = auth
  self.session = _construct_session(session)
  self.original_ip = original_ip
  self.verify = verify
  -   self.cert = cert
  +   self.cert = ("/etc/keystone/ssl/certs/signing_cert.pem",
  "/etc/keystone/ssl/private/signing_key.pem")
  self.timeout = None
  self.redirect = redirect
  self.additional_headers = additional_headers or {}
  self.app_name = app_name
  self.app_version = app_version
  self.additional_user_agent = additional_user_agent or []
  self._determined_user_agent = None
  if discovery_cache is None:
  discovery_cache = {}
  self._discovery_cache = discovery_cache

To manage notifications about this bug go to:
https://bugs.launchpad.net/horizon/+bug/1744670/+subscriptions

-- 
Mailing list: https://launchpad.net/~yahoo-eng-team
Post to : yahoo-eng-team@lists.launchpad.net
Unsubscribe : https://launchpad.net/~yahoo-eng-team
More help   : https://help.launchpad.net/ListHelp


[Yahoo-eng-team] [Bug 1850602] Re: remove firewall_v1 in neutron-lib

2019-11-19 Thread OpenStack Infra
Reviewed:  https://review.opendev.org/692094
Committed: 
https://git.openstack.org/cgit/openstack/neutron-fwaas/commit/?id=330e233a40b7d10436c8a8f74528a601747c98ec
Submitter: Zuul
Branch:master

commit 330e233a40b7d10436c8a8f74528a601747c98ec
Author: zhanghao 
Date:   Mon Nov 4 07:54:39 2019 -0500

Remove fwaas_v1 extensions

There are still related extensions of fwaas_v1 in
neutron-fwaas, it is necessary to remove them because
the fwaas_v1 code has been removed in the Stein cycle[1].

[1] https://review.opendev.org/#/c/616410/
Needed-By: https://review.opendev.org/#/c/692068/
Change-Id: I26d23c74123302ef167bd621acdafd9e0e02c6a0
Closes-bug: #1850602


** Changed in: neutron
   Status: In Progress => Fix Released

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to neutron.
https://bugs.launchpad.net/bugs/1850602

Title:
  remove firewall_v1 in neutron-lib

Status in neutron:
  Fix Released

Bug description:
  The fwaas_v1 code was removed in stein[1], so the related exceptions and api 
definitions can also be removed.
  [1]https://review.opendev.org/#/c/616410/

To manage notifications about this bug go to:
https://bugs.launchpad.net/neutron/+bug/1850602/+subscriptions

-- 
Mailing list: https://launchpad.net/~yahoo-eng-team
Post to : yahoo-eng-team@lists.launchpad.net
Unsubscribe : https://launchpad.net/~yahoo-eng-team
More help   : https://help.launchpad.net/ListHelp


[Yahoo-eng-team] [Bug 1853166] Re: nova not installable on py2 environments which breaks the gate

2019-11-19 Thread Matt Riedemann
** Changed in: nova
   Status: In Progress => Fix Released

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/1853166

Title:
  nova not installable on py2 environments which breaks the gate

Status in OpenStack Compute (nova):
  Fix Released

Bug description:
  As noted in the revert https://review.opendev.org/#/c/694891/ change
  https://review.opendev.org/#/c/687954/ made nova not installable on
  environments running python < 3.6:

  
http://logstash.openstack.org/#dashboard/file/logstash.json?query=message%3A%5C%22nova%20requires%20Python%20'%3E%3D3.6'%20but%20the%20running%20Python%20is%5C%22%20AND%20tags%3A%5C%22console%5C%22&from=7d

  Since devstack isn't by default using py3 lots of downstream jobs
  broke in other projects.

  This bug is to track the fix: https://review.opendev.org/#/c/695007/

To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/1853166/+subscriptions

-- 
Mailing list: https://launchpad.net/~yahoo-eng-team
Post to : yahoo-eng-team@lists.launchpad.net
Unsubscribe : https://launchpad.net/~yahoo-eng-team
More help   : https://help.launchpad.net/ListHelp


[Yahoo-eng-team] [Bug 1853171] [NEW] Deprecate and remove any "ofctl" code in Neutron and related projects

2019-11-19 Thread Rodolfo Alonso
Public bug reported:

This bug should track all changes related to deprecate and remove all
"ofctl" CLI application code in Neutron and related projects (e.g.:
networking-sfc).

Base function that should be removed:
https://github.com/openstack/neutron/blob/0fa7e74ebb386b178d36ae684ff04f03bdd6cb0d/neutron/agent/common/ovs_lib.py#L343

Any Open Flow call should use the native implementation, using os-ken
library.

** Affects: neutron
 Importance: Undecided
 Status: New

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to neutron.
https://bugs.launchpad.net/bugs/1853171

Title:
  Deprecate and remove any "ofctl" code in Neutron and related projects

Status in neutron:
  New

Bug description:
  This bug should track all changes related to deprecate and remove all
  "ofctl" CLI application code in Neutron and related projects (e.g.:
  networking-sfc).

  Base function that should be removed:
  
https://github.com/openstack/neutron/blob/0fa7e74ebb386b178d36ae684ff04f03bdd6cb0d/neutron/agent/common/ovs_lib.py#L343

  Any Open Flow call should use the native implementation, using os-ken
  library.

To manage notifications about this bug go to:
https://bugs.launchpad.net/neutron/+bug/1853171/+subscriptions

-- 
Mailing list: https://launchpad.net/~yahoo-eng-team
Post to : yahoo-eng-team@lists.launchpad.net
Unsubscribe : https://launchpad.net/~yahoo-eng-team
More help   : https://help.launchpad.net/ListHelp


[Yahoo-eng-team] [Bug 1853166] [NEW] nova not installable on py2 environments which breaks the gate

2019-11-19 Thread Matt Riedemann
Public bug reported:

As noted in the revert https://review.opendev.org/#/c/694891/ change
https://review.opendev.org/#/c/687954/ made nova not installable on
environments running python < 3.6:

http://logstash.openstack.org/#dashboard/file/logstash.json?query=message%3A%5C%22nova%20requires%20Python%20'%3E%3D3.6'%20but%20the%20running%20Python%20is%5C%22%20AND%20tags%3A%5C%22console%5C%22&from=7d

Since devstack isn't by default using py3 lots of downstream jobs broke
in other projects.

This bug is to track the fix: https://review.opendev.org/#/c/695007/

** Affects: nova
 Importance: Critical
 Assignee: Luigi Toscano (ltoscano)
 Status: In Progress


** Tags: gate-failure

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/1853166

Title:
  nova not installable on py2 environments which breaks the gate

Status in OpenStack Compute (nova):
  In Progress

Bug description:
  As noted in the revert https://review.opendev.org/#/c/694891/ change
  https://review.opendev.org/#/c/687954/ made nova not installable on
  environments running python < 3.6:

  
http://logstash.openstack.org/#dashboard/file/logstash.json?query=message%3A%5C%22nova%20requires%20Python%20'%3E%3D3.6'%20but%20the%20running%20Python%20is%5C%22%20AND%20tags%3A%5C%22console%5C%22&from=7d

  Since devstack isn't by default using py3 lots of downstream jobs
  broke in other projects.

  This bug is to track the fix: https://review.opendev.org/#/c/695007/

To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/1853166/+subscriptions

-- 
Mailing list: https://launchpad.net/~yahoo-eng-team
Post to : yahoo-eng-team@lists.launchpad.net
Unsubscribe : https://launchpad.net/~yahoo-eng-team
More help   : https://help.launchpad.net/ListHelp


[Yahoo-eng-team] [Bug 1852993] Re: Don't delete compute node when deleting service other than nova-compute

2019-11-19 Thread Matt Riedemann
Deleting a nova-consoleauth service shouldn't have anything to do with
deleting compute_nodes records, only deleting nova-compute services, but
I guess this doesn't filter on the service binary being nova-compute:

https://github.com/openstack/nova/blob/a054d03adef692db22e2466084e50cbf50112bb0/nova/db/sqlalchemy/api.py#L415

However, a nova-consoleauth service id shouldn't be mapped to a compute
node record, but that's probably where the OR is breaking things - the
service_id is likely NULL and the host is the same.

** Changed in: nova
   Importance: Undecided => Medium

** Tags added: db

** Also affects: nova/train
   Importance: Undecided
   Status: New

** Also affects: nova/rocky
   Importance: Undecided
   Status: New

** Also affects: nova/stein
   Importance: Undecided
   Status: New

** Changed in: nova/rocky
   Status: New => Confirmed

** Changed in: nova/stein
   Status: New => Confirmed

** Changed in: nova/stein
   Importance: Undecided => Medium

** Changed in: nova/train
   Importance: Undecided => Medium

** Changed in: nova/rocky
   Importance: Undecided => Medium

** Changed in: nova/train
   Status: New => Confirmed

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/1852993

Title:
  Don't delete compute node when deleting service other than nova-
  compute

Status in OpenStack Compute (nova):
  In Progress
Status in OpenStack Compute (nova) rocky series:
  Confirmed
Status in OpenStack Compute (nova) stein series:
  Confirmed
Status in OpenStack Compute (nova) train series:
  Confirmed

Bug description:
  When upgrading to Stein, nova-consoleauth service is deprecated and
  should be removed. However if nova-consoleauth service is located on
  the same host with nova-compute, matching row in compute_nodes table
  is soft-deleted as well, making nova-compute service report in log,
  that stale resource provider exists in placement:

  2019-11-18 16:03:20.069 7 ERROR nova.compute.manager 
[req-f0255008-c398-406c-bca0-12cdc34fc0b4 - - - - -] Error updating resources 
for node vzstor1.vstoragedomain.: ResourceProviderCreationFailed: Failed to 
create resource provider vzstor1.vstoragedomain
  2019-11-18 16:03:20.069 7 ERROR nova.compute.manager Traceback (most recent 
call last):
  2019-11-18 16:03:20.069 7 ERROR nova.compute.manager   File 
"/usr/lib/python2.7/site-packages/nova/compute/manager.py", line 7399, in 
update_available_resource_for_node
  2019-11-18 16:03:20.069 7 ERROR nova.compute.manager 
rt.update_available_resource(context, nodename)
  2019-11-18 16:03:20.069 7 ERROR nova.compute.manager   File 
"/usr/lib/python2.7/site-packages/nova/compute/resource_tracker.py", line 689, 
in update_available_resource
  2019-11-18 16:03:20.069 7 ERROR nova.compute.manager 
self._update_available_resource(context, resources)
  2019-11-18 16:03:20.069 7 ERROR nova.compute.manager   File 
"/usr/lib/python2.7/site-packages/oslo_concurrency/lockutils.py", line 274, in 
inner
  2019-11-18 16:03:20.069 7 ERROR nova.compute.manager return f(*args, 
**kwargs)
  2019-11-18 16:03:20.069 7 ERROR nova.compute.manager   File 
"/usr/lib/python2.7/site-packages/nova/compute/resource_tracker.py", line 713, 
in _update_available_resource
  2019-11-18 16:03:20.069 7 ERROR nova.compute.manager 
self._init_compute_node(context, resources)
  2019-11-18 16:03:20.069 7 ERROR nova.compute.manager   File 
"/usr/lib/python2.7/site-packages/nova/compute/resource_tracker.py", line 562, 
in _init_compute_node
  2019-11-18 16:03:20.069 7 ERROR nova.compute.manager 
self._update(context, cn)
  2019-11-18 16:03:20.069 7 ERROR nova.compute.manager   File 
"/usr/lib/python2.7/site-packages/nova/compute/resource_tracker.py", line 887, 
in _update
  2019-11-18 16:03:20.069 7 ERROR nova.compute.manager inv_data,
  2019-11-18 16:03:20.069 7 ERROR nova.compute.manager   File 
"/usr/lib/python2.7/site-packages/nova/scheduler/client/__init__.py", line 68, 
in set_inventory_for_provider
  2019-11-18 16:03:20.069 7 ERROR nova.compute.manager 
parent_provider_uuid=parent_provider_uuid,
  2019-11-18 16:03:20.069 7 ERROR nova.compute.manager   File 
"/usr/lib/python2.7/site-packages/nova/scheduler/client/__init__.py", line 37, 
in __run_method
  2019-11-18 16:03:20.069 7 ERROR nova.compute.manager return 
getattr(self.instance, __name)(*args, **kwargs)
  2019-11-18 16:03:20.069 7 ERROR nova.compute.manager   File 
"/usr/lib/python2.7/site-packages/nova/scheduler/client/report.py", line 1106, 
in set_inventory_for_provider
  2019-11-18 16:03:20.069 7 ERROR nova.compute.manager 
parent_provider_uuid=parent_provider_uuid)
  2019-11-18 16:03:20.069 7 ERROR nova.compute.manager   File 
"/usr/lib/python2.7/site-packages/nova/scheduler/client/report.py", line 667, 
in _ensure_resource_provider
  2019-11-18 16:03:20.069 7 ERROR nova.compute.manager 
parent_

[Yahoo-eng-team] [Bug 1853160] [NEW] uptime code does not work on FreeBSD

2019-11-19 Thread Igor Galić
Public bug reported:

The uptime code in cloudinit/util.py does not work for FreeBSD (any
more)

https://github.com/canonical/cloud-
init/blob/3baabe76a70b28abeee2da77826a35e27cf9019a/cloudinit/util.py#L1806-L1825
(link to the code in question at the time of reporting)


root@container-host-02:~ # python3.6
Python 3.6.9 (default, Oct 24 2019, 01:18:01) 
[GCC 4.2.1 Compatible FreeBSD Clang 6.0.1 (tags/RELEASE_601/final 335540)] on 
freebsd12
Type "help", "copyright", "credits" or "license" for more information.
>>> import ctypes
>>> libc = ctypes.CDLL('/lib/libc.so.7')
>>> import time
>>> size = ctypes.c_size_t()
>>> buf = ctypes.c_int()
>>> size.value = ctypes.sizeof(buf)
>>> libc.sysctlbyname("kern.boottime", ctypes.byref(buf), ctypes.byref(size), 
>>> None, 0)
-1
>>> 
root@container-host-02:~ #

and here's what happens when we ask for kern.boottime via sysctl(8):

root@container-host-02:~ # sysctl kern.boottime
kern.boottime: { sec = 1573656128, usec = 384300 } Wed Nov 13 14:42:08 2019
root@container-host-02:~ #

** Affects: cloud-init
 Importance: Undecided
 Status: New


** Tags: freebsd

** Tags added: freebsd

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to cloud-init.
https://bugs.launchpad.net/bugs/1853160

Title:
  uptime code does not work on FreeBSD

Status in cloud-init:
  New

Bug description:
  The uptime code in cloudinit/util.py does not work for FreeBSD (any
  more)

  https://github.com/canonical/cloud-
  
init/blob/3baabe76a70b28abeee2da77826a35e27cf9019a/cloudinit/util.py#L1806-L1825
  (link to the code in question at the time of reporting)

  
  root@container-host-02:~ # python3.6
  Python 3.6.9 (default, Oct 24 2019, 01:18:01) 
  [GCC 4.2.1 Compatible FreeBSD Clang 6.0.1 (tags/RELEASE_601/final 335540)] on 
freebsd12
  Type "help", "copyright", "credits" or "license" for more information.
  >>> import ctypes
  >>> libc = ctypes.CDLL('/lib/libc.so.7')
  >>> import time
  >>> size = ctypes.c_size_t()
  >>> buf = ctypes.c_int()
  >>> size.value = ctypes.sizeof(buf)
  >>> libc.sysctlbyname("kern.boottime", ctypes.byref(buf), ctypes.byref(size), 
None, 0)
  -1
  >>> 
  root@container-host-02:~ #

  and here's what happens when we ask for kern.boottime via sysctl(8):

  root@container-host-02:~ # sysctl kern.boottime
  kern.boottime: { sec = 1573656128, usec = 384300 } Wed Nov 13 14:42:08 2019
  root@container-host-02:~ #

To manage notifications about this bug go to:
https://bugs.launchpad.net/cloud-init/+bug/1853160/+subscriptions

-- 
Mailing list: https://launchpad.net/~yahoo-eng-team
Post to : yahoo-eng-team@lists.launchpad.net
Unsubscribe : https://launchpad.net/~yahoo-eng-team
More help   : https://help.launchpad.net/ListHelp


[Yahoo-eng-team] [Bug 1853159] [NEW] Compute node soft undelete raises inactive session error

2019-11-19 Thread Mark Goddard
Public bug reported:

In the fix for bug 1839560, soft-deleted compute nodes may be restored,
to ensure we can reuse ironic node UUIDs as compute node UUIDs. While
this seems to largely work, it results in some nasty errors being
generated.

Steps to reproduce
==

Same as bug 1839560.

Expected results


Compute node is restored in an orderly fashion.

Actual results
==

Example error:

http://paste.openstack.org/show/786350/

Despite the error, all my testing shows that the node is actually
restored. However, the exception raised breaks the execution of the
resource tracker update, which no doubt has some unintended
consequences.

Environment
===

Seen on Rocky 18.2.0, and master (in functional testing).

** Affects: nova
 Importance: Undecided
 Assignee: Mark Goddard (mgoddard)
 Status: In Progress

** Changed in: nova
 Assignee: (unassigned) => Mark Goddard (mgoddard)

** Changed in: nova
   Status: New => In Progress

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/1853159

Title:
  Compute node soft undelete raises inactive session error

Status in OpenStack Compute (nova):
  In Progress

Bug description:
  In the fix for bug 1839560, soft-deleted compute nodes may be
  restored, to ensure we can reuse ironic node UUIDs as compute node
  UUIDs. While this seems to largely work, it results in some nasty
  errors being generated.

  Steps to reproduce
  ==

  Same as bug 1839560.

  Expected results
  

  Compute node is restored in an orderly fashion.

  Actual results
  ==

  Example error:

  http://paste.openstack.org/show/786350/

  Despite the error, all my testing shows that the node is actually
  restored. However, the exception raised breaks the execution of the
  resource tracker update, which no doubt has some unintended
  consequences.

  Environment
  ===

  Seen on Rocky 18.2.0, and master (in functional testing).

To manage notifications about this bug go to:
https://bugs.launchpad.net/nova/+bug/1853159/+subscriptions

-- 
Mailing list: https://launchpad.net/~yahoo-eng-team
Post to : yahoo-eng-team@lists.launchpad.net
Unsubscribe : https://launchpad.net/~yahoo-eng-team
More help   : https://help.launchpad.net/ListHelp


[Yahoo-eng-team] [Bug 1851500] Re: "test_show_port_chain" conflicts with Flow Classifier

2019-11-19 Thread Bernard Cafarelli
Just remembering that "old" in-repo tempest tests were running with
OS_TESTR_CONCURRENCY=1 there is probably a LP for networking-sfc about
parallel tests still open

Though I had made some changes (unique IDs etc) at some point that
should allow parallel run, it looks like there is still something to fix

** Also affects: networking-sfc
   Importance: Undecided
   Status: New

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to neutron.
https://bugs.launchpad.net/bugs/1851500

Title:
  "test_show_port_chain" conflicts with Flow Classifier

Status in networking-sfc:
  New
Status in neutron:
  Confirmed

Bug description:
  Test case:
  
neutron_tempest_plugin.sfc.tests.api.test_sfc_extensions.SfcExtensionTestJSON.test_show_port_chain

  
  Error:
  ```
  Details: {'type': 'PortChainFlowClassifierInConflict', 'message': 'Flow 
Classifier a3d6ec45-5ea8-4e3a-a602-d24baa3ca360 conflicts with Flow Classifier 
a978b8ee-651b-4a7f-9475-58b224486827 in port chain 
b9fb54ee-1868-46ba-9abd-b09e69360a2d.', 'detail': ''}
  ```

  
  Log: 
https://storage.bhs1.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_6e4/692822/4/check/neutron-tempest-plugin-sfc/6e436c3/testr_results.html.gz

To manage notifications about this bug go to:
https://bugs.launchpad.net/networking-sfc/+bug/1851500/+subscriptions

-- 
Mailing list: https://launchpad.net/~yahoo-eng-team
Post to : yahoo-eng-team@lists.launchpad.net
Unsubscribe : https://launchpad.net/~yahoo-eng-team
More help   : https://help.launchpad.net/ListHelp


[Yahoo-eng-team] [Bug 1853089] Re: openstack env in Stein, CLI or Dashboard response slowly

2019-11-19 Thread Matt Riedemann
This is going to require profiling on your part. This isn't a nova bug.

** Changed in: nova
   Status: New => Invalid

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/1853089

Title:
  openstack env in Stein, CLI or Dashboard response slowly

Status in neutron:
  New
Status in OpenStack Compute (nova):
  Invalid

Bug description:
  Installed Stein OpenStack via Kolla, OpenStack node info as below:

  3 * Controller node which running in Virtualbox --- each machine memory: 32G 
and Disk:300G
  2 * Compute node which is physical rack server

  after operating in some days, the OpenStack response become very slow,
  the dashboard response is more slower.

  for example: run "openstack port list --timing" in CLI, it would spent
  about 13s when got 60 port data, and dashboard would spent more than
  20s.

To manage notifications about this bug go to:
https://bugs.launchpad.net/neutron/+bug/1853089/+subscriptions

-- 
Mailing list: https://launchpad.net/~yahoo-eng-team
Post to : yahoo-eng-team@lists.launchpad.net
Unsubscribe : https://launchpad.net/~yahoo-eng-team
More help   : https://help.launchpad.net/ListHelp


[Yahoo-eng-team] [Bug 1852665] Re: HostMappingNotFound in wigi.py

2019-11-19 Thread Matt Riedemann
*** This bug is a duplicate of bug 1780727 ***
https://bugs.launchpad.net/bugs/1780727

What release are you using? You must not have this fix:

https://review.opendev.org/#/q/I0d7644db3537a67b94e75972b3c4fce25a623763

I'm going to mark this as a duplicate of bug 1780727.

** This bug has been marked a duplicate of bug 1780727
   Handle HostMappingNotFound when deleting a service

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to OpenStack Compute (nova).
https://bugs.launchpad.net/bugs/1852665

Title:
  HostMappingNotFound in wigi.py

Status in OpenStack Compute (nova):
  New

Bug description:
  It seems to be diffrent from #1780727.

  # openstack compute service delete 26

  
  Failed to delete compute service with ID '26': 发生意外 API 错误。请在 
http://bugs.launchpad.net/nova/ 处报告此错误,并且附上 Nova API 日志(如果可能)。
   (HTTP 500) (Request-ID: 
req-a693a664-5834-48c6-acd9-c92d8b2eea28)

  nova-api-log:
  2019-11-15 08:41:23.576 11235 ERROR nova.api.openstack.wsgi 
[req-099cb32c-dfbb-4eaf-a067-a3737720977f 7c177645d83f4a769d51ab4b9801a90d 
04627ab3503248cb8d714ac1a44f543f - default default] Unexpected exception in API 
method: HostMappingNotFound: \u4e3b\u673a 
'computer3713hpdl580'\u6ca1\u6709\u6620\u5c04\u5230\u4efb\u4f55\u5355\u5143
  2019-11-15 08:41:23.576 11235 ERROR nova.api.openstack.wsgi Traceback (most 
recent call last):
  2019-11-15 08:41:23.576 11235 ERROR nova.api.openstack.wsgi   File 
"/usr/lib/python2.7/site-packages/nova/api/openstack/wsgi.py", line 801, in 
wrapped
  2019-11-15 08:41:23.576 11235 ERROR nova.api.openstack.wsgi return 
f(*args, **kwargs)
  2019-11-15 08:41:23.576 11235 ERROR nova.api.openstack.wsgi   File 
"/usr/lib/python2.7/site-packages/nova/api/openstack/compute/services.py", line 
237, in delete
  2019-11-15 08:41:23.576 11235 ERROR nova.api.openstack.wsgi service.host)
  2019-11-15 08:41:23.576 11235 ERROR nova.api.openstack.wsgi   File 
"/usr/lib/python2.7/site-packages/nova/exception_wrapper.py", line 79, in 
wrapped
  2019-11-15 08:41:23.576 11235 ERROR nova.api.openstack.wsgi 
function_name, call_dict, binary, tb)
  2019-11-15 08:41:23.576 11235 ERROR nova.api.openstack.wsgi   File 
"/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__
  2019-11-15 08:41:23.576 11235 ERROR nova.api.openstack.wsgi 
self.force_reraise()
  2019-11-15 08:41:23.576 11235 ERROR nova.api.openstack.wsgi   File 
"/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in 
force_reraise
  2019-11-15 08:41:23.576 11235 ERROR nova.api.openstack.wsgi 
six.reraise(self.type_, self.value, self.tb)
  2019-11-15 08:41:23.576 11235 ERROR nova.api.openstack.wsgi   File 
"/usr/lib/python2.7/site-packages/nova/exception_wrapper.py", line 69, in 
wrapped
  2019-11-15 08:41:23.576 11235 ERROR nova.api.openstack.wsgi return 
f(self, context, *args, **kw)
  2019-11-15 08:41:23.576 11235 ERROR nova.api.openstack.wsgi   File 
"/usr/lib/python2.7/site-packages/nova/compute/api.py", line 5416, in 
remove_host_from_aggregate
  2019-11-15 08:41:23.576 11235 ERROR nova.api.openstack.wsgi mapping = 
objects.HostMapping.get_by_host(context, host_name)
  2019-11-15 08:41:23.576 11235 ERROR nova.api.openstack.wsgi   File 
"/usr/lib/python2.7/site-packages/oslo_versionedobjects/base.py", line 184, in 
wrapper
  2019-11-15 08:41:23.576 11235 ERROR nova.api.openstack.wsgi result = 
fn(cls, context, *args, **kwargs)
  2019-11-15 08:41:23.576 11235 ERROR nova.api.openstack.wsgi   File 
"/usr/lib/python2.7/site-packages/nova/objects/host_mapping.py", line 100, in 
get_by_host
  2019-11-15 08:41:23.576 11235 ERROR nova.api.openstack.wsgi db_mapping = 
cls._get_by_host_from_db(context, host)
  2019-11-15 08:41:23.576 11235 ERROR nova.api.openstack.wsgi   File 
"/usr/lib/python2.7/site-packages/oslo_db/sqlalchemy/enginefacade.py", line 
993, in wrapper
  2019-11-15 08:41:23.576 11235 ERROR nova.api.openstack.wsgi return 
fn(*args, **kwargs)
  2019-11-15 08:41:23.576 11235 ERROR nova.api.openstack.wsgi   File 
"/usr/lib/python2.7/site-packages/nova/objects/host_mapping.py", line 95, in 
_get_by_host_from_db
  2019-11-15 08:41:23.576 11235 ERROR nova.api.openstack.wsgi raise 
exception.HostMappingNotFound(name=host)
  2019-11-15 08:41:23.576 11235 ERROR nova.api.openstack.wsgi 
HostMappingNotFound: \u4e3b\u673a 
'computer3713hpdl580'\u6ca1\u6709\u6620\u5c04\u5230\u4efb\u4f55\u5355\u5143
  2019-11-15 08:41:23.576 11235 ERROR nova.api.openstack.wsgi 
  。

  # openstack compute service list |egrep "(3713|ID)"
  | ID | Binary   | Host| Zone  | Status   | State 
| Updated At |
  | 26 | nova-compute | computer3713hpdl580 | sugonZone | disabled | down  
| 2019-07-24T01:25:20.00 |

  # nova service-list |egrep "(3713|Id)"
  | Id   | Binary   | Host  
  | Zone  | Status   | State | Updated_at 

[Yahoo-eng-team] [Bug 1853146] [NEW] Invalid runcmd script format makes it ignored without marking cloud init as failed

2019-11-19 Thread manuel
Public bug reported:

Info :
- cloud-init version `/usr/bin/cloud-init 19.2-36-g059d049c-0ubuntu2~16.04.1`

Issue:

If user-data script contains a malformed runcmd script, cloud-init fails
to parse it but do not mark cloud-init as failed.

Example:

```
runcmd:
- echo "begin runcmd"
- # empty
- echo "end"
```

The second line is empty, and causes the following warning in `/var/log
/cloud-init.log`:

```
2019-11-19 12:39:10,124 - helpers.py[DEBUG]: Running config-runcmd using lock 
()
2019-11-19 12:39:10,124 - schema.py[DEBUG]: Ignoring schema validation. 
python-jsonschema is not present
2019-11-19 12:39:10,124 - util.py[WARNING]: Failed to shellify ['echo "begin 
runcmd"', None, 'echo "end"'] into file 
/var/lib/cloud/instances/0B44BE6F-81FA-FF44-AB96-A0D9AB8B7171/scripts/runcmd
2019-11-19 12:39:10,124 - util.py[DEBUG]: Failed to shellify ['echo "begin 
runcmd"', None, 'echo "end"'] into file 
/var/lib/cloud/instances/0B44BE6F-81FA-FF44-AB96-A0D9AB8B7171/scripts/runcmd
Traceback (most recent call last):
  File "/usr/lib/python3/dist-packages/cloudinit/config/cc_runcmd.py", line 91, 
in handle
content = util.shellify(cmd)
  File "/usr/lib/python3/dist-packages/cloudinit/util.py", line 2117, in 
shellify
"Got: %s" % (type_utils.obj_name(args), args))
TypeError: Unable to shellify type 'NoneType'. Expected list, string, tuple. 
Got: None
2019-11-19 12:39:10,154 - handlers.py[DEBUG]: finish: 
modules-config/config-runcmd: SUCCESS: config-runcmd ran successfully
```


There is no error log in `/var/log/cloud-init-output.log`

But cloud-init status is "done"

I expect the status to be "error"

** Affects: cloud-init
 Importance: Undecided
 Status: New

** Summary changed:

- Invalid runcmd script format make it ignored without marking cloud init as 
failed
+ Invalid runcmd script format makes it ignored without marking cloud init as 
failed

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to cloud-init.
https://bugs.launchpad.net/bugs/1853146

Title:
  Invalid runcmd script format makes it ignored without marking cloud
  init as failed

Status in cloud-init:
  New

Bug description:
  Info :
  - cloud-init version `/usr/bin/cloud-init 19.2-36-g059d049c-0ubuntu2~16.04.1`

  Issue:

  If user-data script contains a malformed runcmd script, cloud-init
  fails to parse it but do not mark cloud-init as failed.

  Example:

  ```
  runcmd:
  - echo "begin runcmd"
  - # empty
  - echo "end"
  ```

  The second line is empty, and causes the following warning in
  `/var/log/cloud-init.log`:

  ```
  2019-11-19 12:39:10,124 - helpers.py[DEBUG]: Running config-runcmd using lock 
()
  2019-11-19 12:39:10,124 - schema.py[DEBUG]: Ignoring schema validation. 
python-jsonschema is not present
  2019-11-19 12:39:10,124 - util.py[WARNING]: Failed to shellify ['echo "begin 
runcmd"', None, 'echo "end"'] into file 
/var/lib/cloud/instances/0B44BE6F-81FA-FF44-AB96-A0D9AB8B7171/scripts/runcmd
  2019-11-19 12:39:10,124 - util.py[DEBUG]: Failed to shellify ['echo "begin 
runcmd"', None, 'echo "end"'] into file 
/var/lib/cloud/instances/0B44BE6F-81FA-FF44-AB96-A0D9AB8B7171/scripts/runcmd
  Traceback (most recent call last):
File "/usr/lib/python3/dist-packages/cloudinit/config/cc_runcmd.py", line 
91, in handle
  content = util.shellify(cmd)
File "/usr/lib/python3/dist-packages/cloudinit/util.py", line 2117, in 
shellify
  "Got: %s" % (type_utils.obj_name(args), args))
  TypeError: Unable to shellify type 'NoneType'. Expected list, string, tuple. 
Got: None
  2019-11-19 12:39:10,154 - handlers.py[DEBUG]: finish: 
modules-config/config-runcmd: SUCCESS: config-runcmd ran successfully
  ```

  
  There is no error log in `/var/log/cloud-init-output.log`

  But cloud-init status is "done"

  I expect the status to be "error"

To manage notifications about this bug go to:
https://bugs.launchpad.net/cloud-init/+bug/1853146/+subscriptions

-- 
Mailing list: https://launchpad.net/~yahoo-eng-team
Post to : yahoo-eng-team@lists.launchpad.net
Unsubscribe : https://launchpad.net/~yahoo-eng-team
More help   : https://help.launchpad.net/ListHelp


[Yahoo-eng-team] [Bug 1852835] Re: the parameter "--public" has been removed in new version

2019-11-19 Thread OpenStack Infra
Reviewed:  https://review.opendev.org/694782
Committed: 
https://git.openstack.org/cgit/openstack/glance/commit/?id=c540d54a352f631d2f791abf12fdb695b62c6230
Submitter: Zuul
Branch:master

commit c540d54a352f631d2f791abf12fdb695b62c6230
Author: Erno Kuvaja 
Date:   Mon Nov 18 14:17:08 2019 +

Fix old --public from install verify docs

Change-Id: I4128eb7e8d6a6827026d4454e1eaba188e19cf3a
Closes-Bug: #1852835


** Changed in: glance
   Status: In Progress => Fix Released

-- 
You received this bug notification because you are a member of Yahoo!
Engineering Team, which is subscribed to Glance.
https://bugs.launchpad.net/bugs/1852835

Title:
  the parameter "--public" has been removed in new version

Status in Glance:
  Fix Released

Bug description:
  glance: error: unrecognized arguments: --public

  the parameter "--public" has been removed in new version

  
  This bug tracker is for errors with the documentation, use the following as a 
template and remove or add fields as you see fit. Convert [ ] into [x] to check 
boxes:

  - [x] This doc is inaccurate in this way: __
  - [ ] This is a doc addition request.
  - [ ] I have a fix to the document that I can paste below including example: 
input and output. 

  If you have a troubleshooting or support issue, use the following
  resources:

   - Ask OpenStack: http://ask.openstack.org
   - The mailing list: http://lists.openstack.org
   - IRC: 'openstack' channel on Freenode

  ---
  Release:  on 2019-09-27 09:57:38
  SHA: 6e3ced8251cd6e273aa73f553a24fc475b219db5
  Source: https://opendev.org/openstack/glance/src/doc/source/install/verify.rst
  URL: https://docs.openstack.org/glance/train/install/verify.html

To manage notifications about this bug go to:
https://bugs.launchpad.net/glance/+bug/1852835/+subscriptions

-- 
Mailing list: https://launchpad.net/~yahoo-eng-team
Post to : yahoo-eng-team@lists.launchpad.net
Unsubscribe : https://launchpad.net/~yahoo-eng-team
More help   : https://help.launchpad.net/ListHelp