Thanks for diving into this one guys! Very much appreciated. -Sean
On 11/02/2013 02:22 AM, Armando Migliaccio wrote: > I think/hope I nailed it down. Once more patch coming right up! > > > On Fri, Nov 1, 2013 at 11:15 AM, Salvatore Orlando <sorla...@nicira.com>wrote: > >> Hi Sean, >> >> I looked further yesterday and nailed down an issue which cause a spike of >> failures due to a patch merged on thursday early morning (GMT), for which a >> patch was pushed to gerrit. >> I then handed off to Armando Migliaccio, who has already pushed a few >> patches to solve these issues. (which are apparently more than one). >> >> https://review.openstack.org/#/c/54752/ >> https://review.openstack.org/#/c/54850/ >> >> there are also other patches related to postgres from Armando, but I'll >> leave to him to comment on whether they're related or not. >> >> Salvatore >> >> >> On 1 November 2013 18:07, Sean Dague <s...@dague.net> wrote: >> >>> Over the last 7 days - >>> >>> http://logstash.openstack.org/#eyJzZWFyY2giOiIobWVzc2FnZTpcIkZpbmlzaGVkOiBTVUNDRVNTXCIgT1IgbWVzc2FnZTpcIkZpbmlzaGVkOiBGQUlMVVJFXCIpIEFORCBidWlsZF9uYW1lOmdhdGUtdGVtcGVzdC1kZXZzdGFjay12bS1uZXV0cm9uLXBnLWlzb2xhdGVkIiwiZmllbGRzIjpbXSwib2Zmc2V0IjowLCJ0aW1lZnJhbWUiOiI2MDQ4MDAiLCJncmFwaG1vZGUiOiJjb3VudCIsInRpbWUiOnsidXNlcl9pbnRlcnZhbCI6MH0sInN0YW1wIjoxMzgzMzI4OTEyNzEzfQ== >>> >>> There is a 45% Failure rate of the >>> gate-tempest-devstack-vm-neutron-pg-isolated in neutron. Salvadore and I >>> were looking at logs the other day, and there are clearly SQL errors >>> being through because some of the Neutron queries are mysql specific >>> now. That may or may not be the issue, but it's at least suspicious. >>> >>> This is only currently affecting the neutron project jobs, because we >>> removed this from tempest yesterday as it was preventing us from merging >>> any non related code. >>> >>> But 45% is a really high race failure rate, it would be really good if >>> the neutron team could prioritize addressing this. I realize it's summit >>> week, so things are slow, but please ensure this comes up as part of the >>> overall discussion. >>> >>> -Sean >>> >>> -- >>> Sean Dague >>> http://dague.net >>> >>> >>> _______________________________________________ >>> OpenStack-dev mailing list >>> OpenStack-dev@lists.openstack.org >>> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev >>> >>> >> >> _______________________________________________ >> OpenStack-dev mailing list >> OpenStack-dev@lists.openstack.org >> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev >> >> > > > > _______________________________________________ > OpenStack-dev mailing list > OpenStack-dev@lists.openstack.org > http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev > -- Sean Dague http://dague.net
signature.asc
Description: OpenPGP digital signature
_______________________________________________ OpenStack-dev mailing list OpenStack-dev@lists.openstack.org http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-dev