On 1/11/2018 10:36 AM, Colleen Murphy wrote:
1) All trademark-related tests should go in the tempest repo, in accordance
    with the original resolution. This would mean that even projects that have
    never had tests in tempest would now have to add at least some of their
    black-box tests to tempest.

The value of this option is that centralizes tests used for the Interop program
in a location where interop-minded folks from the QA team can control them. The
downside is that projects that so far have avoided having a dependency on
tempest will now lose some control over the black-box tests that they use for
functional and integration that would now also be used for trademark
certification.
There's also concern for the review bandwidth of the QA team - we can't expect
the QA team to be continually responsible for an ever-growing list of projects
and their trademark tests.

How many tests are we talking about for designate and heat? Half a dozen? A dozen? More?

If it's just a couple of tests per project it doesn't seem terrible to have them live in Tempest so you get the "interop eye" on reviews, as noted in your email. If it's a considerable amount, then option 2 seems the best for the majority of parties.

--

Thanks,

Matt

__________________________________________________________________________
OpenStack Development Mailing List (not for usage questions)
Unsubscribe: [email protected]?subject:unsubscribe
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev

Reply via email to