Folks,
Sorry for the late notice, but I've been meeting bound while
troubleshooting today's FD.io CI outage.
There was a network configuration change in the Vexxhost datacenter that
cause the public IP address of jenkins to become inaccessible from the
Nomad cluster causing all jobs to fail. This has been resolved.
Another issue still remains, that is why the external address was being
used. It was determined that Jenkins was configured this way in the a
portion of the cloud configuration even though Jenkins was configured to
use the internal IP address in the global configuration variables.
Unfortunately updating the cloud configuration failed to work after the
network issues were resolved and restoring the cloud configuration to
use jenkins.fd.io resolved the issue.
Given today's outage, I have recommended that Andrew push back the VPP
21.10 branch pull to Thursday 9/23/2021.
Kudo's to Peter Mikus for identifying the root cause of the outage,
Vanessa Valderrama for assisting during a PTO day to manage Jenkins
configuration changes & restarts, and Anton Baranov & Mohammed Naser for
fixing the data center network configuration.
Thanks,
-daw-
-=-=-=-=-=-=-=-=-=-=-=-
Links: You receive all messages sent to this group.
View/Reply Online (#20174): https://lists.fd.io/g/vpp-dev/message/20174
Mute This Topic: https://lists.fd.io/mt/85775812/21656
Group Owner: vpp-dev+ow...@lists.fd.io
Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub [arch...@mail-archive.com]
-=-=-=-=-=-=-=-=-=-=-=-
