Re: [vpp-dev] FD.io CI Outage

2022-06-21 Thread Dave Wallace
Folks, Jenkins was restarted last night which resolved the outage.  RCA is still being investigated. Thanks, -daw- On 6/20/22 4:36 PM, Dave Wallace via lists.fd.io wrote: Folks, Jenkins.fd.io was inadvertently put into maintenance mode on Saturday.  It was taken out of maintenance mode

[vpp-dev] FD.io CI Outage

2022-06-20 Thread Dave Wallace
Folks, Jenkins.fd.io was inadvertently put into maintenance mode on Saturday.  It was taken out of maintenance mode about 5 hours ago, but VPP & CSIT jobs are still stuck in the Jenkins Build Queue (currently 18 jobs in the queue). LF-IT tickets [0] have been opened and resolution of the

Re: [vpp-dev] FD.io CI outage

2021-12-15 Thread Dave Wallace
[0] https://jira.linuxfoundation.org/plugins/servlet/theme/portal/2/IT-23405 On 12/15/21 1:13 PM, Dave Wallace via lists.fd.io wrote: Folks, Due to service issues in AWS, gerrit.fd.io (AWS instance) is currently not communicating with jenkins.fd.io (Vexxhost instance). I have opened a

[vpp-dev] FD.io CI outage

2021-12-15 Thread Dave Wallace
Folks, Due to service issues in AWS, gerrit.fd.io (AWS instance) is currently not communicating with jenkins.fd.io (Vexxhost instance). I have opened a ticket with LF-IT [0] and Vanessa has put jenkins.fd.io into shutdown mode in anticipation of a reset when the communications issue is

[vpp-dev] FD.io CI Outage has been resolved

2021-09-21 Thread Dave Wallace
Folks, Sorry for the late notice, but I've been meeting bound while troubleshooting today's FD.io CI outage. There was a network configuration change in the Vexxhost datacenter that cause the public IP address of jenkins to become inaccessible from the Nomad cluster causing all jobs to