Re: [openstack-dev] [all] Gate still backed up - need assistance with nova-network logging enhancements

2014-06-12 Thread Matt Riedemann
On 6/10/2014 5:36 AM, Michael Still wrote: https://review.openstack.org/99002 adds more logging to nova/network/manager.py, but I think you're not going to love the debug log level. Was this the sort of thing you were looking for though? Michael On Mon, Jun 9, 2014 at 11:45 PM, Sean Dague

Re: [openstack-dev] [all] Gate still backed up - need assistance with nova-network logging enhancements

2014-06-12 Thread Davanum Srinivas
Hey Matt, There is a connection pool in https://github.com/boto/boto/blob/develop/boto/connection.py which could be causing issues... -- dims On Thu, Jun 12, 2014 at 10:50 AM, Matt Riedemann mrie...@linux.vnet.ibm.com wrote: On 6/10/2014 5:36 AM, Michael Still wrote:

Re: [openstack-dev] [all] Gate still backed up - need assistance with nova-network logging enhancements

2014-06-12 Thread Matt Riedemann
On 6/12/2014 10:41 AM, Davanum Srinivas wrote: Hey Matt, There is a connection pool in https://github.com/boto/boto/blob/develop/boto/connection.py which could be causing issues... -- dims On Thu, Jun 12, 2014 at 10:50 AM, Matt Riedemann mrie...@linux.vnet.ibm.com wrote: On 6/10/2014

Re: [openstack-dev] [all] Gate still backed up - need assistance with nova-network logging enhancements

2014-06-10 Thread Michael Still
https://review.openstack.org/99002 adds more logging to nova/network/manager.py, but I think you're not going to love the debug log level. Was this the sort of thing you were looking for though? Michael On Mon, Jun 9, 2014 at 11:45 PM, Sean Dague s...@dague.net wrote: Based on some back of

[openstack-dev] [all] Gate still backed up - need assistance with nova-network logging enhancements

2014-06-09 Thread Sean Dague
Based on some back of envelope math the gate is basically processing 2 changes an hour, failing one of them. So if you want to know how long the gate is, take the length / 2 in hours. Right now we're doing a lot of revert roulette, trying to revert things that we think landed about the time