As Diana pointed out, this started failing after we started running the job with cells v2.
I think I've figured out through my debugging patches that we're querying the cell0 database for the instance by uuid (the marker) and that's raising the MarkerNotFound and we don't handle it in the compute API code, then we fail. ** Also affects: nova Importance: Undecided Status: New ** Changed in: nova Assignee: (unassigned) => Matt Riedemann (mriedem) ** Changed in: nova Status: New => Confirmed ** Changed in: nova Importance: Undecided => High ** Changed in: python-novaclient Status: New => Invalid -- You received this bug notification because you are a member of Yahoo! Engineering Team, which is subscribed to OpenStack Compute (nova). https://bugs.launchpad.net/bugs/1647464 Title: novaclient.tests.functional.v2.test_servers.TestServersListNovaClient.test_list_all_servers broken since at least 12/2 Status in OpenStack Compute (nova): Confirmed Status in python-novaclient: Invalid Bug description: We're always getting a 400 on the marker value here now: http://logs.openstack.org/59/406359/1/check/gate-novaclient-dsvm- functional-neutron/30f5c67/console.html#_2016-12-05_18_00_49_690292 2016-12-05 18:00:49.690292 | 2016-12-05 18:00:49.689 | novaclient.tests.functional.v2.test_servers.TestServersListNovaClient.test_list_all_servers 2016-12-05 18:00:49.691677 | 2016-12-05 18:00:49.691 | ------------------------------------------------------------------------------------------- 2016-12-05 18:00:49.694401 | 2016-12-05 18:00:49.694 | 2016-12-05 18:00:49.695830 | 2016-12-05 18:00:49.695 | Captured traceback: 2016-12-05 18:00:49.697230 | 2016-12-05 18:00:49.696 | ~~~~~~~~~~~~~~~~~~~ 2016-12-05 18:00:49.698889 | 2016-12-05 18:00:49.698 | Traceback (most recent call last): 2016-12-05 18:00:49.700319 | 2016-12-05 18:00:49.699 | File "novaclient/tests/functional/v2/legacy/test_servers.py", line 104, in test_list_all_servers 2016-12-05 18:00:49.701907 | 2016-12-05 18:00:49.701 | output = self.nova("list", params="--limit -1 --name %s" % name) 2016-12-05 18:00:49.703240 | 2016-12-05 18:00:49.702 | File "novaclient/tests/functional/base.py", line 316, in nova 2016-12-05 18:00:49.704505 | 2016-12-05 18:00:49.704 | endpoint_type, merge_stderr) 2016-12-05 18:00:49.706426 | 2016-12-05 18:00:49.706 | File "/opt/stack/new/python-novaclient/.tox/functional/local/lib/python2.7/site-packages/tempest/lib/cli/base.py", line 124, in nova 2016-12-05 18:00:49.707668 | 2016-12-05 18:00:49.707 | 'nova', action, flags, params, fail_ok, merge_stderr) 2016-12-05 18:00:49.709199 | 2016-12-05 18:00:49.708 | File "/opt/stack/new/python-novaclient/.tox/functional/local/lib/python2.7/site-packages/tempest/lib/cli/base.py", line 368, in cmd_with_auth 2016-12-05 18:00:49.710930 | 2016-12-05 18:00:49.710 | self.cli_dir) 2016-12-05 18:00:49.712387 | 2016-12-05 18:00:49.712 | File "/opt/stack/new/python-novaclient/.tox/functional/local/lib/python2.7/site-packages/tempest/lib/cli/base.py", line 68, in execute 2016-12-05 18:00:49.714028 | 2016-12-05 18:00:49.713 | result_err) 2016-12-05 18:00:49.715601 | 2016-12-05 18:00:49.715 | tempest.lib.exceptions.CommandFailed: Command '['/opt/stack/new/python-novaclient/.tox/functional/bin/nova', '--os-username', 'admin', '--os-tenant-name', 'admin', '--os-password', 'secretadmin', '--os-auth-url', 'http://10.13.96.44/identity_admin', '--os-compute-api-version', '2.latest', '--os-endpoint-type', 'publicURL', 'list', '--limit', '-1', '--name', '6a31a7c8-189d-4a63-88d5-7ee1f63f6810']' returned non-zero exit status 1. 2016-12-05 18:00:49.717098 | 2016-12-05 18:00:49.716 | stdout: 2016-12-05 18:00:49.718661 | 2016-12-05 18:00:49.718 | 2016-12-05 18:00:49.720061 | 2016-12-05 18:00:49.719 | stderr: 2016-12-05 18:00:49.721559 | 2016-12-05 18:00:49.721 | ERROR (BadRequest): marker [282483d5-433b-4c34-8a5d-894e40db705d] not found (HTTP 400) (Request-ID: req-d0b88399-b0d6-4f0c-881c-442e88944350) There isn't anything obvious in the nova and novaclient changes around 12/2 that would cause this. To manage notifications about this bug go to: https://bugs.launchpad.net/nova/+bug/1647464/+subscriptions -- Mailing list: https://launchpad.net/~yahoo-eng-team Post to : yahoo-eng-team@lists.launchpad.net Unsubscribe : https://launchpad.net/~yahoo-eng-team More help : https://help.launchpad.net/ListHelp