On Mon, Mar 17, 2014 at 12:25 PM, Sean Dague <s...@dague.net> wrote: > On 03/17/2014 03:22 PM, Joe Gordon wrote: > > > > > > > > On Mon, Mar 17, 2014 at 11:55 AM, Matthew Treinish <mtrein...@kortar.org > > <mailto:mtrein...@kortar.org>> wrote: > > > > Hi everyone, > > > > So a little while ago we noticed that in all the gate runs one of > > the ceilometer > > cli tests is consistently in the list of slowest tests. (and often > > the slowest) > > This was a bit surprising given the nature of the cli tests we > > expect them to > > execute very quickly. > > > > test_ceilometer_resource_list which just calls ceilometer > > resource_list from the > > CLI once is taking >=2 min to respond. For example: > > > http://logs.openstack.org/68/80168/3/gate/gate-tempest-dsvm-postgres-full/07ab7f5/logs/tempest.txt.gz#_2014-03-17_17_08_25_003 > > (where it takes > 3min) > > > > The cli tests are supposed to be quick read-only sanity checks of > > the cli > > functionality and really shouldn't ever be on the list of slowest > > tests for a > > gate run. I think there was possibly a performance regression > > recently in > > ceilometer because from I can tell this test used to normally take > > ~60 sec. > > (which honestly is probably too slow for a cli test too) but it is > > currently > > much slower than that. > > > > > > Sounds like we should add another round of sanity checking to the CLI > > tests: make sure all commands return within x seconds. As a first pass > > we can say x=60 and than crank it down in the future. > > So, the last thing I want to do is trigger a race here by us > artificially timing out on tests. However I do think cli tests should be > returning in < 2s otherwise they are not simple readonly tests. >
Agreed, I said 60 just as a starting point. > > -Sean > > -- > Sean Dague > Samsung Research America > s...@dague.net / sean.da...@samsung.com > http://dague.net > > > _______________________________________________ > OpenStack-dev mailing list > OpenStack-dev@lists.openstack.org > http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev > >
_______________________________________________ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev