[Yahoo-eng-team] [Bug 1732199] Re: test_extend_attached_volume fails with Unexpected compute_extend_volume result 'Error'

2017-11-14 Thread Matthew Treinish
This doesn't look like a tempest bug to me, it looks like nova is failing during the volume extend operation and that causes the test to fail. For example, see: http://logs.openstack.org/67/518967/2/check/legacy-tempest-dsvm-neutron-

[Yahoo-eng-team] [Bug 1712463] Re: taskflow not running under wsgi configuration

2017-08-29 Thread Matthew Treinish
** Also affects: oslo.concurrency Importance: Undecided Status: New -- You received this bug notification because you are a member of Yahoo! Engineering Team, which is subscribed to Glance. https://bugs.launchpad.net/bugs/1712463 Title: taskflow not running under wsgi configuration

[Yahoo-eng-team] [Bug 1703305] Re: some functions are deprecated in tempest

2017-07-10 Thread Matthew Treinish
This isn't actually a bug in tempest, those are interfaces that will be removed in a future version. The neutron tempest plugin is using them which is causing the warning to be emitted. The issue is that the neutron plugin code needs to be updated ** Changed in: tempest Status: New =>

[Yahoo-eng-team] [Bug 1681866] Re: Bad response code while validating token: 502

2017-07-06 Thread Matthew Treinish
This isn't a tempest bug, it's also likely not a bug in keystone. It looks like a configuration bug, apache returns 502 if mod_proxy is unable to reach the server it's proxying to (or some other issue with connecting to the proxy) This honestly looks like a dup of the bug that:

[Yahoo-eng-team] [Bug 1450209] Re: Glance API logs a never ending stream of 404 tracebacks from glance-registry

2017-05-21 Thread Matthew Treinish
The fix: https://review.openstack.org/#/c/355960/ has landed and been included in a release. ** Changed in: glance Status: In Progress => Fix Released -- You received this bug notification because you are a member of Yahoo! Engineering Team, which is subscribed to Glance.

[Yahoo-eng-team] [Bug 1692376] [NEW] Binary dependencies aren't easily discoverable

2017-05-21 Thread Matthew Treinish
Public bug reported: The binary dependencies required to run nova aren't really discoverable. They aren't present in bindep.txt which would be the expected mechanism for discovering them. (it's only used to install the unit test binary requirements) This makes it difficult to figure out how to

[Yahoo-eng-team] [Bug 1692375] [NEW] Placement install process isn't documented

2017-05-21 Thread Matthew Treinish
Public bug reported: The placement api is exposed only as a wsgi script however there is no documentation in nova or example configuration on how to use it. While this tends to fit into a standard mold providing users with this guidance is very useful. Right now the docs just say deploy it

[Yahoo-eng-team] [Bug 1677746] [NEW] neutron-sanity-check always requires ovs to be present

2017-03-30 Thread Matthew Treinish
Public bug reported: The neutron-sanity-check command has a hard dependency on ovs being present on the system being checked, even if you have all the --noovs* flags set. In my environment I'm running without ovs installed or configured and I hit failures like:

[Yahoo-eng-team] [Bug 1677752] [NEW] Binary dependencies aren't present in bindep (or documented anywhere)

2017-03-30 Thread Matthew Treinish
Public bug reported: The binary dependencies required to run neutron aren't present in bindep.txt. This makes it difficult to figure out how to install neutron from source in an environment since it's not clear what non-python dependencies there are. We should add everything into bindep.txt to

[Yahoo-eng-team] [Bug 1677742] [NEW] Missing Binary Commands don't log in a sane way

2017-03-30 Thread Matthew Treinish
Public bug reported: When running neutron in an environment with a missing binary command run by a linux agent the failure mode is far from clear. For example: http://paste.openstack.org/show/604877/ Is what was logged on my system when I didn't have ipset installed. It's not clear at all

[Yahoo-eng-team] [Bug 1665053] [NEW] test_stamp_pattern times out waiting for the device to show up on the guest

2017-02-15 Thread Matthew Treinish
Public bug reported: When running test_stamp_pattern sometimes the test times out waiting for the device to show up on the guest after the volume attach is issue. An example traceback is: Traceback (most recent call last): File "tempest/test.py", line 103, in wrapper

[Yahoo-eng-team] [Bug 1586931] Re: TestServerBasicOps: Test fails when deleting server and floating ip almost at the same time

2016-06-02 Thread Matthew Treinish
** Changed in: tempest Status: Won't Fix => Incomplete -- You received this bug notification because you are a member of Yahoo! Engineering Team, which is subscribed to OpenStack Compute (nova). https://bugs.launchpad.net/bugs/1586931 Title: TestServerBasicOps: Test fails when deleting

[Yahoo-eng-team] [Bug 1562323] Re: test_server_basic_ops rename in tempest is breaking cells job

2016-03-26 Thread Matthew Treinish
This is really a nova bug, and not a tempest bug. Tempest exposes the idempotent ids to enable tracking tests across renames. I don't feel that the fact nova's cell job (which should be using config flags instead of a giant regex anyway) isn't using this to identify tests in its blacklist is

[Yahoo-eng-team] [Bug 1538572] Re: Neutron api test fails with raise TypeError("Invalid credentials")

2016-01-27 Thread Matthew Treinish
I see nothing in that stacktrace which is importing tempest. All the code in this error is from the neutron repo ** Changed in: tempest Status: New => Invalid ** Also affects: neutron Importance: Undecided Status: New ** No longer affects: tempest -- You received this bug

[Yahoo-eng-team] [Bug 1533487] Re: test_create_server_with_personality fails on the gate

2016-01-12 Thread Matthew Treinish
Well I was gonna suggest the dashboard because it will show this information, but the job is non-voting check only when it would fail so that doesn't help. As a cool aside it does show that the change: https://review.openstack.org/#/c/257493/ makes it noticeably slower:

[Yahoo-eng-team] [Bug 1502039] Re: gate-tempest-dsvm-full-ceph fails with "There are not enough hosts available"

2015-10-02 Thread Matthew Treinish
Yes you are correct, this is not a tempest bug tempest made a request and got a 500 response which is never correct. You should file the bug against nova which is actually the cause of this failure: http://logs.openstack.org/31/230031/2/check/gate-tempest-dsvm-full-

[Yahoo-eng-team] [Bug 1494059] [NEW] fixed ip quota off by a large margin

2015-09-09 Thread Matthew Treinish
*** This bug is a duplicate of bug 1353962 *** https://bugs.launchpad.net/bugs/1353962 Public bug reported: Occasionally an overquota exception is raised by allocate_fixed_ip when there is quite a large amount of free fixed_ip left. For example in this tempest postgres job run:

[Yahoo-eng-team] [Bug 1468523] Re: tempest.api.compute.test_tenant_networks should be skipped when neutron is enabled

2015-09-03 Thread Matthew Treinish
I actually think the analysis in this bug is a bit off, looking at the tests in question there is a bug in tempest.api.compute.test_tenant_networks in that we should tell it to create a network with set_network_resources() in the setupClass. The fact its passing is actually a bug somewhere in

[Yahoo-eng-team] [Bug 1482609] Re: Intermittent py27 failure - TypeError: unsupported operand type(s

2015-08-07 Thread Matthew Treinish
** Changed in: os-testr Status: Fix Committed = Fix Released -- You received this bug notification because you are a member of Yahoo! Engineering Team, which is subscribed to OpenStack Compute (nova). https://bugs.launchpad.net/bugs/1482609 Title: Intermittent py27 failure - TypeError:

[Yahoo-eng-team] [Bug 1482816] [NEW] Nova should not return a 500 on floating ip create with ipv6

2015-08-07 Thread Matthew Treinish
Public bug reported: Neutron does not support creating or using floating ips on an ipv6 network. When nova gets a create floating ip call and does the passthrough call to neutron it will get a 400 response from neutron saying there is not ipv4 subnet available. This goes unhandled by nova and

[Yahoo-eng-team] [Bug 1450209] [NEW] Glance API logs a never ending stream of 404 tracebacks from glance-registry

2015-04-29 Thread Matthew Treinish
Public bug reported: Recently glance started logging tons of 404 tracebacks even when no operations fail. For example: http://logs.openstack.org/86/176786/2/gate/gate-tempest-dsvm- full/31efa56/logs/screen-g-api.txt.gz?level=TRACE in that gate run no tests failed and things just went along like

[Yahoo-eng-team] [Bug 1438282] Re: get hypervisors list and detail failed

2015-03-30 Thread Matthew Treinish
This bug his not in tempest, it's an internal error in nova. Tempest interacts with nova exclusively through the REST API and is only exposing this issue in nova. ** Changed in: tempest Status: New = Invalid ** Also affects: nova Importance: Undecided Status: New -- You

[Yahoo-eng-team] [Bug 1435588] Re: request-ids aren't being logged for any cinder.api.openstack.wsgi [-]

2015-03-23 Thread Matthew Treinish
Keystone doesn't log the request ids either: http://logs.openstack.org/48/165548/4/gate/gate-tempest-dsvm-neutron- full/5cbdc8e/logs/apache/keystone.txt.gz?level=INFO#_2015-03-19_20_35_44_383968 request ids were only recently added to keystone with: https://review.openstack.org/#/c/155901/ I

[Yahoo-eng-team] [Bug 1179008] Re: rename requires files to standard names

2015-03-05 Thread Matthew Treinish
** No longer affects: tempest -- You received this bug notification because you are a member of Yahoo! Engineering Team, which is subscribed to neutron. https://bugs.launchpad.net/bugs/1179008 Title: rename requires files to standard names Status in OpenStack Telemetry (Ceilometer): Fix

[Yahoo-eng-team] [Bug 1419043] Re: Conflict on isolated credential setup

2015-02-06 Thread Matthew Treinish
Looking through the failure logs this doesn't appear to be a tempest issue. Tempest is just triggering a race in keystone. ** Changed in: tempest Importance: High = Undecided ** Changed in: tempest Status: New = Invalid -- You received this bug notification because you are a member

[Yahoo-eng-team] [Bug 1396356] Re: ovs_lilb failing to find interface

2014-11-26 Thread Matthew Treinish
*** This bug is a duplicate of bug 1381379 *** https://bugs.launchpad.net/bugs/1381379 This is not a tempest bug, neutron is returning a 500 because of an unhandled exception. If you look in the neutron logs you'll see a failure in the DB layer around the typing in Postgres. This failure

[Yahoo-eng-team] [Bug 1395368] Re: ExternalNetworksTestJSON.test_delete_external_networks_with_floating_ip (icehouse) failures

2014-11-24 Thread Matthew Treinish
So I'm failing to see how this is a tempest bug, looking at the test code it's testing exactly what it set out to. That deleting an external network deletes all the resources (subnets, ports, etc) associated with it. It looks like the behavior differs from what's expected on icehouse neutron which

[Yahoo-eng-team] [Bug 1375432] [NEW] Duplicate entry in gitignore

2014-09-29 Thread Matthew Treinish
Public bug reported: The .gitignore file for nova contains the line for the sample config file, etc/nova/nova.conf.sample, twice. ** Affects: nova Importance: Low Assignee: Matthew Treinish (treinish) Status: In Progress -- You received this bug notification because you

[Yahoo-eng-team] [Bug 1371677] [NEW] Race in resource tracker causes 500 response on deleting during verify_resize state

2014-09-19 Thread Matthew Treinish
Public bug reported: During a tempest run occasionally a during the tempest.api.compute.servers.test_delete_server.DeleteServersTestJSON.test_delete_server_while_in_verify_resize_state test it will fail when the test attempts to delete a server in the verify_resize state. The failure is

[Yahoo-eng-team] [Bug 1371812] [NEW] n-cpu timeout on rpc allocating network

2014-09-19 Thread Matthew Treinish
Public bug reported: During a server create when the ec2 metadata triggers the async creation of the network information for the server n-cpu times out waiting for the rpc response from n-net causing the server to go into an error state. See:

[Yahoo-eng-team] [Bug 1349617] Re: SSHException: Error reading SSH protocol banner[Errno 104] Connection reset by peer

2014-09-17 Thread Matthew Treinish
affects: tempest status: fixreleased ** Changed in: tempest Importance: Undecided = Critical ** Changed in: tempest Status: Fix Committed = Fix Released -- You received this bug notification because you are a member of Yahoo! Engineering Team, which is subscribed to neutron.

[Yahoo-eng-team] [Bug 1268274] Re: KeyError in _get_server_ip

2014-09-09 Thread Matthew Treinish
** Changed in: tempest Status: Fix Committed = Fix Released -- You received this bug notification because you are a member of Yahoo! Engineering Team, which is subscribed to neutron. https://bugs.launchpad.net/bugs/1268274 Title: KeyError in _get_server_ip Status in OpenStack Neutron

[Yahoo-eng-team] [Bug 1254890] Re: Timed out waiting for thing ... to become ACTIVE causes tempest-dsvm-* failures

2014-09-09 Thread Matthew Treinish
** Changed in: tempest Status: Fix Committed = Fix Released -- You received this bug notification because you are a member of Yahoo! Engineering Team, which is subscribed to neutron. https://bugs.launchpad.net/bugs/1254890 Title: Timed out waiting for thing ... to become ACTIVE causes

[Yahoo-eng-team] [Bug 1294511] Re: test_aggregate_add_host_create_server_with_az fails with remote compute connection scenario

2014-09-09 Thread Matthew Treinish
** Changed in: tempest Status: Fix Committed = Fix Released -- You received this bug notification because you are a member of Yahoo! Engineering Team, which is subscribed to OpenStack Compute (nova). https://bugs.launchpad.net/bugs/1294511 Title:

[Yahoo-eng-team] [Bug 1338844] Re: FixedIpLimitExceeded: Maximum number of fixed ips exceeded in tempest nova-network runs since 7/4

2014-09-09 Thread Matthew Treinish
** Changed in: tempest Status: Fix Committed = Fix Released -- You received this bug notification because you are a member of Yahoo! Engineering Team, which is subscribed to OpenStack Compute (nova). https://bugs.launchpad.net/bugs/1338844 Title: FixedIpLimitExceeded: Maximum number of

[Yahoo-eng-team] [Bug 1362347] [NEW] gneutron-ns-meta invokes oom-killer during gate runs

2014-08-27 Thread Matthew Treinish
Public bug reported: Occasionally a neutron gate job fails because the node runs out of memory. oom-killer is invoked and it starts killing processes to save the node. (which just causes cascading issues) The kernel logs show that oom-killer is being invoked by neutron-ns-meta. An example of

[Yahoo-eng-team] [Bug 1213212] Re: test_resize_server_confirm server failed to build

2014-07-18 Thread Matthew Treinish
Based on the age of the bug, and the lack of logs I don't think we'll be able to make progress on this. We can open up a new bug with more detail if we come across this again. ** Changed in: nova Status: Confirmed = Invalid -- You received this bug notification because you are a member

[Yahoo-eng-team] [Bug 1328738] Re: tempest.api.image.v1.test_images.ListImagesTest fails in setup with BadRequest - The HTTP URL is invalid

2014-06-19 Thread Matthew Treinish
) = Matthew Treinish (treinish) -- You received this bug notification because you are a member of Yahoo! Engineering Team, which is subscribed to Glance. https://bugs.launchpad.net/bugs/1328738 Title: tempest.api.image.v1.test_images.ListImagesTest fails in setup with BadRequest - The HTTP URL

[Yahoo-eng-team] [Bug 1321797] Re: Tempest fails on backports to Icehouse

2014-05-23 Thread Matthew Treinish
So the issue here was actually a bug in devstack-gate, which broke the icehouse grenade jobs for tempest master which allowed this new test to be added when it wouldn't work. It has been removed with:

[Yahoo-eng-team] [Bug 1270355] Re: ERROR nova.virt.libvirt.driver virNetMessageFree:XX msg=0xnumber found in error logs of check job

2014-03-19 Thread Matthew Treinish
So our enforcement strategy for tracking failures and traces in the logs has changed since this was filed and this bug isn't valid any more because of the change. But this looked liked a whitelist matching issue when it still applied. ** Changed in: tempest Status: New = Invalid -- You

[Yahoo-eng-team] [Bug 1258682] Re: timeout causing gate-tempest-dsvm-full to fail

2013-12-09 Thread Matthew Treinish
I've uploaded some of the logs from the test node that John mentioned above that we held. That pastebin was just a grep of all the logs for TRACE. I can upload any of the other service logs from the node, I just figured these would be the most useful. ** Also affects: nova Importance:

[Yahoo-eng-team] [Bug 1258848] [NEW] vif doesn't exist Error message in tempest runs

2013-12-07 Thread Matthew Treinish
Public bug reported: On a successful tempest run the following error message was in the nova logs: ERROR nova.network.manager [req-1ef0c266-bec4-4414-ae27-f6937e6baa2a ListServersNegativeTestXML-tempest-117344783-user ListServersNegativeTestXML-tempest-117344783-tenant] Unable to release

[Yahoo-eng-team] [Bug 1226337] Re: tempest.scenario.test_volume_boot_pattern.TestVolumeBootPattern 'qemu-nbd: Failed to bdrv_open'

2013-10-04 Thread Matthew Treinish
** Changed in: tempest Status: Triaged = Invalid -- You received this bug notification because you are a member of Yahoo! Engineering Team, which is subscribed to OpenStack Compute (nova). https://bugs.launchpad.net/bugs/1226337 Title:

[Yahoo-eng-team] [Bug 1224001] Re: test_network_basic_ops fails waiting for network to become available

2013-10-02 Thread Matthew Treinish
** Changed in: swift Status: New = Invalid ** Changed in: tempest Status: New = Invalid -- You received this bug notification because you are a member of Yahoo! Engineering Team, which is subscribed to neutron. https://bugs.launchpad.net/bugs/1224001 Title:

[Yahoo-eng-team] [Bug 1006725] Re: Incorrect error returned during Create Image and multi byte characters used for Image name

2013-09-17 Thread Matthew Treinish
Russell, if you've got the change to unskip the bug how about you push it out for review to close the tempest side. ** Changed in: tempest Status: New = Invalid ** Changed in: tempest Status: Invalid = New ** Changed in: tempest Status: New = Triaged ** Changed in: tempest

[Yahoo-eng-team] [Bug 1217265] Re: FAIL: tempest.cli.simple_read_only.test_compute_manage.SimpleReadOnlyNovaManageTest

2013-08-29 Thread Matthew Treinish
** Changed in: tempest Status: Confirmed = Invalid ** Changed in: tempest Importance: Critical = Undecided ** Changed in: nova Status: New = Incomplete -- You received this bug notification because you are a member of Yahoo! Engineering Team, which is subscribed to OpenStack