Re: [OpenStack-Infra] Ask.o.o down

[Tom Fifield]

On 廿十七年二月廿一日 暮 03:11, Tom Fifield wrote:



On 廿十七年二月十四日 暮 04:19, Joshua Hesketh wrote:



On Tue, Feb 14, 2017 at 7:15 PM, Tom Fifield mailto:t...@openstack.org>> wrote:

On 14/02/17 16:11, Joshua Hesketh wrote:

Hey Tom,

Where is that script being fired from (a quick grep doesn't find
it), or
is it a tool people are using?

If it's a tool we'd need to make sure whoever is using it gets
a new
version to rule it out.


Indeed.


It's fired from a PHP service on www.openstack.org
 itself, which writes to the Member
database:


https://github.com/OpenStackweb/openstack-org/blob/master/auc-metrics/code/services/ActiveModeratorService.php







Right. I wonder if somebody could check the logs to see if the process
times out. Sadly looking at that code it looks like any output messages
from the script will be discarded.



... and my patch was deployed, but the site is down today. So, looks
like it wasn't that.


Though, is it staying down for less time? It came back up just now - 
normally it'd be down for another 45mins.


Interesting traffic spikes at:
http://cacti.openstack.org/cacti/graph.php?action=view&local_graph_id=2549&rra_id=all

seem to correlate with the outage. Perhaps we can set up some tcpdumps?




The next step is to update the copy of the script it references:


https://github.com/OpenStackweb/openstack-org/blob/master/auc-metrics/lib/uc-recognition/tools/get_active_moderator.py





I am not sure if this is in place using git submodules or manually,
but will figure it out and get that updated.




 - Josh

On Tue, Feb 14, 2017 at 7:07 PM, Tom Fifield mailto:t...@openstack.org>
>> wrote:

On 14/02/17 16:06, Joshua Hesketh wrote:

Hey,

I've brought the service back up, but have no new clues
as to why.


Cheers.

Going to try: https://review.openstack.org/#/c/433478/

>
to see if this script is culprit.


- Josh

On Tue, Feb 14, 2017 at 6:50 PM, Tom Fifield
mailto:t...@openstack.org>
>


>


>>

Skipping back through previous days I find some
similar gaps
starting anywhere from 06:30 to 07:00 and ending
between
07:00 and
08:00 but they don't seem to occur every day and
I'm not
having much
luck finding a pattern. It _is_ conspicuously
close to when
/etc/cron.daily scripts get fired from the
crontab so
might coincide
with log rotation/service restarts? The graphs
don't
show these gaps
correlating with any spikes in CPU, memory or
disk
activity so it
doesn't seem to be resource starvation (at least
not for
any common
resources we're tracking).


   

Re: [OpenStack-Infra] Ask.o.o down

[Tom Fifield]

On 廿十七年二月十四日 暮 04:19, Joshua Hesketh wrote:



On Tue, Feb 14, 2017 at 7:15 PM, Tom Fifield mailto:t...@openstack.org>> wrote:

On 14/02/17 16:11, Joshua Hesketh wrote:

Hey Tom,

Where is that script being fired from (a quick grep doesn't find
it), or
is it a tool people are using?

If it's a tool we'd need to make sure whoever is using it gets a new
version to rule it out.


Indeed.


It's fired from a PHP service on www.openstack.org
 itself, which writes to the Member database:


https://github.com/OpenStackweb/openstack-org/blob/master/auc-metrics/code/services/ActiveModeratorService.php





Right. I wonder if somebody could check the logs to see if the process
times out. Sadly looking at that code it looks like any output messages
from the script will be discarded.



... and my patch was deployed, but the site is down today. So, looks 
like it wasn't that.





The next step is to update the copy of the script it references:


https://github.com/OpenStackweb/openstack-org/blob/master/auc-metrics/lib/uc-recognition/tools/get_active_moderator.py



I am not sure if this is in place using git submodules or manually,
but will figure it out and get that updated.




 - Josh

On Tue, Feb 14, 2017 at 7:07 PM, Tom Fifield mailto:t...@openstack.org>
>> wrote:

On 14/02/17 16:06, Joshua Hesketh wrote:

Hey,

I've brought the service back up, but have no new clues
as to why.


Cheers.

Going to try: https://review.openstack.org/#/c/433478/

>
to see if this script is culprit.


- Josh

On Tue, Feb 14, 2017 at 6:50 PM, Tom Fifield
mailto:t...@openstack.org>
>


>


>>

Skipping back through previous days I find some
similar gaps
starting anywhere from 06:30 to 07:00 and ending
between
07:00 and
08:00 but they don't seem to occur every day and
I'm not
having much
luck finding a pattern. It _is_ conspicuously
close to when
/etc/cron.daily scripts get fired from the
crontab so
might coincide
with log rotation/service restarts? The graphs don't
show these gaps
correlating with any spikes in CPU, memory or disk
activity so it
doesn't seem to be resource starvation (at least
not for
any common
resources we're tracking).


Indeed. It's down again today during the same timeslot.

Another idea for the cron-based theory:




https://github.com/openstack/uc-recognition/blob/master/tools/get_active_moderator.py

[OpenStack-Infra] Please add new IRC channel and metting

[Hiroyuki Eguchi]

Hi infra team.

I've created new project named Meteos which provides machine learning as a 
service.
It is not an official OpenStack project yet.

Is it possible to register IRC channel and irc-meetings, even if it is not an 
official project ?

We have already IRC channel named #openstack-meteos and some developers are 
attending every day.

I would like to register this channel in OpenStack IRC channels.

Thanks.


Hiroyuki Eguchi

___
OpenStack-Infra mailing list
OpenStack-Infra@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-infra

Re: [OpenStack-Infra] PTG team dinner?

[Clark Boylan]

On Wed, Feb 15, 2017, at 02:58 PM, Clark Boylan wrote:
> On Tue, Feb 14, 2017, at 03:01 PM, Clark Boylan wrote:
> > With the help of the small restaurant guide on the wiki I have
> > discovered Poor Calvin's. This place looks neat, supposedly fusion of
> > Thai and Southern food and is well reviewed. It is 0.8 miles or ~15
> > minute walk from the Sheraton according to Google so should be walkable
> > for most. Rather than draw out restaurant selection I was thinking I
> > would go ahead and try to make a reservation for however many people are
> > signed up on the etherpad for as close to 7pm as I can manage Monday
> > night. I will wait until tomorrow before doing this in order to provide
> > veto time if this location does not work for someone, in which case
> > please do help suggest an alternative.
> > 
> > If I can't get a reservation for us at Poor Calvin's I was looking at
> > Sway as a backup since it also has southern food and seems to be well
> > reviewed despite being hotel restaurant. Again please veto if necessary
> > and suggest alternatives.
> > 
> > Lastly I did update the etherpad with links to these restaurants (and a
> > few others) if you need more info.
> 
> Alright, with Monty's help we now have a reservation at Poor Calvin's
> for Monday the 20th at 7pm. The reservation is for 14 and under my name,
> Clark Boylan. See you there! (and at the PTG).

For everyone that signed up please meet up in the Sheraton Lobby at
6:30pm and we will coordinate travel from there. They won't seat us
until we all arrive so we'll need to show up on time.

Thank you,
Clark

___
OpenStack-Infra mailing list
OpenStack-Infra@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-infra

Re: [OpenStack-Infra] OpenDaylight Internship 2017 : Introduction

[Dong Ma]

Hello Yolande, I have made some plugin changes to use convert xml [1], if
you interested you can work on this part.

[1] https://etherpad.openstack.org/p/JJB_plugins_support

Thanks,
Dong

2017-02-14 0:58 GMT+08:00 Yolande Amate :

> Hello,
>
> My name is Yolande Amate, I am a third year computer Science student
> at the university of Buea Cameroon in Africa. I have been selected for
> the OpenDaylight internship [0] 2017, to work on the project  "Jenkins
> Job Builder-Improve Jenkins Plugins Support". I will be implementing
> support for Jenkins plugins, so I would like to know if there are any
> currently any plugins of interest to the community which are currently
> missing that I could add support for.
>
>  I am looking forward to working with the community and a successful
> contribution to the project.
>
> Cheers,
> Yolande
>
> [0] https://wiki.opendaylight.org/view/Interns
>
> ___
> OpenStack-Infra mailing list
> OpenStack-Infra@lists.openstack.org
> http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-infra
>
___
OpenStack-Infra mailing list
OpenStack-Infra@lists.openstack.org
http://lists.openstack.org/cgi-bin/mailman/listinfo/openstack-infra