Public bug reported: After upgrade from xenial/ocata to bionic/queens SR-IOV instance creation (--vnic-type direct) fails with missing devices:
The pci_devices mysql table if filled with wrong PCI entries, that do not exist on the server. Restarting nova-compute and nova-cloud- controller services did not fix (rediscover) the proper PCI devices. Related errors: 2020-06-17 12:55:19.556 1182599 WARNING nova.pci.utils [req-76b21329-b364-4999-ac86-8c729cb91ac0 - - - - -] No net device was found for VF 0000:d8:05.0: PciDeviceNotFoundById: PCI device 0000:d8:05.0 not found 2020-06-17 12:55:19.603 1182599 WARNING nova.pci.utils [req-76b21329-b364-4999-ac86-8c729cb91ac0 - - - - -] No net device was found for VF 0000:d8:05.1: PciDeviceNotFoundById: PCI device 0000:d8:05.1 not found 2020-06-17 12:55:19.711 1182599 WARNING nova.pci.utils [req-76b21329-b364-4999-ac86-8c729cb91ac0 - - - - -] No net device was found for VF 0000:d8:04.7: PciDeviceNotFoundById: PCI device 0000:d8:04.7 not found Error instance creation: {u'message': u'Device 0000:d8:04.4 not found: could not access /sys/bus/pci/devices/0000:d8:04.4/config: No such file or directory', u'code': 500, u'details': u'Traceback (most recent call last):\n File "/usr/lib/python2.7/dist-packa ges/nova/compute/manager.py", line 1863, in _do_build_and_run_instance\n filter_properties, request_spec)\n File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 2143, in _build_and_run_instance\n instance_uuid=instance.uuid, reason=six.text_type(e))\ nRescheduledException: Build of instance ec163abf-9c7a-460a-9512-4915f47af6b9 was re-scheduled: Device 0000:d8:04.4 not found: could not access /sys/bus/pci/devices/0000:d8:04.4/config: No such file or directory\n', u'created': u'2020-06-17T11:46:11Z' ** Affects: nova Importance: Undecided Status: New -- You received this bug notification because you are a member of Yahoo! Engineering Team, which is subscribed to OpenStack Compute (nova). https://bugs.launchpad.net/bugs/1883929 Title: Upgrade from X/O -> B/Q breaks pci_devices in mysql for SR-IOV Status in OpenStack Compute (nova): New Bug description: After upgrade from xenial/ocata to bionic/queens SR-IOV instance creation (--vnic-type direct) fails with missing devices: The pci_devices mysql table if filled with wrong PCI entries, that do not exist on the server. Restarting nova-compute and nova-cloud- controller services did not fix (rediscover) the proper PCI devices. Related errors: 2020-06-17 12:55:19.556 1182599 WARNING nova.pci.utils [req-76b21329-b364-4999-ac86-8c729cb91ac0 - - - - -] No net device was found for VF 0000:d8:05.0: PciDeviceNotFoundById: PCI device 0000:d8:05.0 not found 2020-06-17 12:55:19.603 1182599 WARNING nova.pci.utils [req-76b21329-b364-4999-ac86-8c729cb91ac0 - - - - -] No net device was found for VF 0000:d8:05.1: PciDeviceNotFoundById: PCI device 0000:d8:05.1 not found 2020-06-17 12:55:19.711 1182599 WARNING nova.pci.utils [req-76b21329-b364-4999-ac86-8c729cb91ac0 - - - - -] No net device was found for VF 0000:d8:04.7: PciDeviceNotFoundById: PCI device 0000:d8:04.7 not found Error instance creation: {u'message': u'Device 0000:d8:04.4 not found: could not access /sys/bus/pci/devices/0000:d8:04.4/config: No such file or directory', u'code': 500, u'details': u'Traceback (most recent call last):\n File "/usr/lib/python2.7/dist-packa ges/nova/compute/manager.py", line 1863, in _do_build_and_run_instance\n filter_properties, request_spec)\n File "/usr/lib/python2.7/dist-packages/nova/compute/manager.py", line 2143, in _build_and_run_instance\n instance_uuid=instance.uuid, reason=six.text_type(e))\ nRescheduledException: Build of instance ec163abf-9c7a-460a-9512-4915f47af6b9 was re-scheduled: Device 0000:d8:04.4 not found: could not access /sys/bus/pci/devices/0000:d8:04.4/config: No such file or directory\n', u'created': u'2020-06-17T11:46:11Z' To manage notifications about this bug go to: https://bugs.launchpad.net/nova/+bug/1883929/+subscriptions -- Mailing list: https://launchpad.net/~yahoo-eng-team Post to : yahoo-eng-team@lists.launchpad.net Unsubscribe : https://launchpad.net/~yahoo-eng-team More help : https://help.launchpad.net/ListHelp