On 07/12/2015 11:29 PM, Matt Fischer wrote: > We used Tempest for a time against our production environment. It was a > pain to clean up but ephemeral test jobs solves that for you. A few > questions: > > What version of tempest will be using?
master for now. We will see if new tags are created later. AFIK, tags mean Tempest does not support an old version of OpenStack (ie, tempest 5 only support juno / kilo / current (liberty)). > Will we maintain a blacklist if there are known failures? (although this > is a pain to keep updated) I don't think we'll have to, since tempest already provide some Python decorators to skip some bugs. If that happens, yes we'll have to find a way to exclude some tests or disable the run at all. That's why having it running without affecting job return code does not break anything now. > On Sun, Jul 12, 2015 at 8:44 PM, Emilien Macchi > <emilien.mac...@gmail.com <mailto:emilien.mac...@gmail.com>> wrote: > > Hi, > > I would like to propose to run Tempest at the end of the beaker > jobs, for testing purpose now. > > As a start, we would accept 0 & 1 as return code, because this is > really experimental. > Though I think it will be interesting to see how it behaves, > specially when we implement new configurations or plugins in our > modules. > > I already did a PoC for puppet-keystone: > https://review.openstack.org/198561 > (failing because it needs more work to pass keystone v3 tests but v2 > tests are successful). > As you can see the code is really light, since we use puppet-tempest. > > Any suggestion is welcome ! > > -- > Emilien Macchi > > __________________________________________________________________________ > OpenStack Development Mailing List (not for usage questions) > Unsubscribe: > openstack-dev-requ...@lists.openstack.org?subject:unsubscribe > <http://openstack-dev-requ...@lists.openstack.org?subject:unsubscribe> > http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev > > > > > __________________________________________________________________________ > OpenStack Development Mailing List (not for usage questions) > Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe > http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev > -- Emilien Macchi
signature.asc
Description: OpenPGP digital signature
__________________________________________________________________________ OpenStack Development Mailing List (not for usage questions) Unsubscribe: openstack-dev-requ...@lists.openstack.org?subject:unsubscribe http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev
