Public bug reported: Seen here:
http://logs.openstack.org/46/487246/2/experimental/gate-tempest-dsvm- neutron-dvr-ha-multinode-full-ubuntu-xenial-nv/6cd2a5b/logs/devstack- gate-discover-hosts.txt.gz localhost | SUCCESS | rc=0 >> Found 2 cell mappings. Skipping cell0 since it does not contain hosts. Getting compute nodes from cell 'cell1': a7345ef4-6c48-4c4a-912f-4c1f93b7f880 [00;32mDEBUG oslo_concurrency.lockutils [[01;36mNone req-510b4930-f0e6-4e15-b8a3-0b7064249e68 [00;36mNone None[00;32m] [01;35m[00;32mLock "a7345ef4-6c48-4c4a-912f-4c1f93b7f880" acquired by "nova.context.get_or_set_cached_cell_and_set_connections" :: waited 0.000s[00m [00;33m{{(pid=11111) inner /usr/local/lib/python2.7/dist-packages/oslo_concurrency/lockutils.py:270}}[00m [00;32mDEBUG oslo_concurrency.lockutils [[01;36mNone req-510b4930-f0e6-4e15-b8a3-0b7064249e68 [00;36mNone None[00;32m] [01;35m[00;32mLock "a7345ef4-6c48-4c4a-912f-4c1f93b7f880" released by "nova.context.get_or_set_cached_cell_and_set_connections" :: held 0.002s[00m [00;33m{{(pid=11111) inner /usr/local/lib/python2.7/dist-packages/oslo_concurrency/lockutils.py:282}}[00m Found 2 unmapped computes in cell: a7345ef4-6c48-4c4a-912f-4c1f93b7f880 Checking host mapping for compute host 'ubuntu-xenial-3-node-rax-dfw-10092052-748716': 0adb5bd3-18f2-47d5-9806-8f10e83ff7eb Creating host mapping for compute host 'ubuntu-xenial-3-node-rax-dfw-10092052-748716': 0adb5bd3-18f2-47d5-9806-8f10e83ff7eb Checking host mapping for compute host 'ubuntu-xenial-3-node-rax-dfw-10092052-748717': cd5c029b-c513-499e-baf3-d7fa47d72ba7 Creating host mapping for compute host 'ubuntu-xenial-3-node-rax-dfw-10092052-748717': cd5c029b-c513-499e-baf3-d7fa47d72ba7 This is due to caching the DB/MQ connections in the request context and locking on them: https://github.com/openstack/nova/commit/f4159d17552603b90912dba6fe5c604e8d0b8aa7 ** Affects: nova Importance: Medium Assignee: Matt Riedemann (mriedem) Status: In Progress ** Affects: nova/newton Importance: Medium Status: Confirmed ** Affects: nova/ocata Importance: Medium Status: Confirmed ** Tags: nova-manage -- You received this bug notification because you are a member of Yahoo! Engineering Team, which is subscribed to OpenStack Compute (nova). https://bugs.launchpad.net/bugs/1707001 Title: Ugly oslo.concurrency DEBUG output when running nova-manage cell_v2 discover_hosts Status in OpenStack Compute (nova): In Progress Status in OpenStack Compute (nova) newton series: Confirmed Status in OpenStack Compute (nova) ocata series: Confirmed Bug description: Seen here: http://logs.openstack.org/46/487246/2/experimental/gate-tempest-dsvm- neutron-dvr-ha-multinode-full-ubuntu-xenial-nv/6cd2a5b/logs/devstack- gate-discover-hosts.txt.gz localhost | SUCCESS | rc=0 >> Found 2 cell mappings. Skipping cell0 since it does not contain hosts. Getting compute nodes from cell 'cell1': a7345ef4-6c48-4c4a-912f-4c1f93b7f880 [00;32mDEBUG oslo_concurrency.lockutils [[01;36mNone req-510b4930-f0e6-4e15-b8a3-0b7064249e68 [00;36mNone None[00;32m] [01;35m[00;32mLock "a7345ef4-6c48-4c4a-912f-4c1f93b7f880" acquired by "nova.context.get_or_set_cached_cell_and_set_connections" :: waited 0.000s[00m [00;33m{{(pid=11111) inner /usr/local/lib/python2.7/dist-packages/oslo_concurrency/lockutils.py:270}}[00m [00;32mDEBUG oslo_concurrency.lockutils [[01;36mNone req-510b4930-f0e6-4e15-b8a3-0b7064249e68 [00;36mNone None[00;32m] [01;35m[00;32mLock "a7345ef4-6c48-4c4a-912f-4c1f93b7f880" released by "nova.context.get_or_set_cached_cell_and_set_connections" :: held 0.002s[00m [00;33m{{(pid=11111) inner /usr/local/lib/python2.7/dist-packages/oslo_concurrency/lockutils.py:282}}[00m Found 2 unmapped computes in cell: a7345ef4-6c48-4c4a-912f-4c1f93b7f880 Checking host mapping for compute host 'ubuntu-xenial-3-node-rax-dfw-10092052-748716': 0adb5bd3-18f2-47d5-9806-8f10e83ff7eb Creating host mapping for compute host 'ubuntu-xenial-3-node-rax-dfw-10092052-748716': 0adb5bd3-18f2-47d5-9806-8f10e83ff7eb Checking host mapping for compute host 'ubuntu-xenial-3-node-rax-dfw-10092052-748717': cd5c029b-c513-499e-baf3-d7fa47d72ba7 Creating host mapping for compute host 'ubuntu-xenial-3-node-rax-dfw-10092052-748717': cd5c029b-c513-499e-baf3-d7fa47d72ba7 This is due to caching the DB/MQ connections in the request context and locking on them: https://github.com/openstack/nova/commit/f4159d17552603b90912dba6fe5c604e8d0b8aa7 To manage notifications about this bug go to: https://bugs.launchpad.net/nova/+bug/1707001/+subscriptions -- Mailing list: https://launchpad.net/~yahoo-eng-team Post to : yahoo-eng-team@lists.launchpad.net Unsubscribe : https://launchpad.net/~yahoo-eng-team More help : https://help.launchpad.net/ListHelp
