Re: [vpp-dev] FD.io CI job failures
Folks, Vexxhost has made some adjustments to the networking infrastructure which has made the issue occur less frequently, but some jobs may still fail due to connection resets [0]. I have added a new Jenkins Failure Cause rule 'Java Connection Closed Exception' to make it easier to identify when the failure error signature indicates a 'java.nio.channels.ClosedChannelException' has occurred. Please issue a 'recheck' or 'remerge' as necessary to try again as directed by the Failure Cause recommendation. Vexxhost will continue to actively monitor the situation and make necessary changes until the issue is completely resolved. Thanks again for your patience. -daw- [0] https://jenkins.fd.io/job/vpp-verify-master-ubuntu2004-x86_64/2667/consoleFull On 3/4/2021 6:36 PM, Dave Wallace via lists.fd.io wrote: Folks, There have been numerous VPP CI job failures in the past day & a half due to two known issues. 1) Starting Wednesday there were DNS lookup failures which have since gone away. See LF-IT ticket [0] for details. 2) Yesterday & today there have been lots of 'Connection Resets". I opened a Vexxhost ticket [1] this morning for this issue. To date, there has not been a direct correlation identified to the move on Tues/Wed of some of the CSIT and Nomad servers but investigations are continuing to determine the root cause. Thank you for your patience as folks work to fix the CI. -daw- [0] https://jira.linuxfoundation.org/plugins/servlet/theme/portal/2/IT-21660 [1] https://secure.vexxhost.com/billing/viewticket.php?tid=BGH-086778=Q8VPulfR -=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#18873): https://lists.fd.io/g/vpp-dev/message/18873 Mute This Topic: https://lists.fd.io/mt/81090962/21656 Group Owner: vpp-dev+ow...@lists.fd.io Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub [arch...@mail-archive.com] -=-=-=-=-=-=-=-=-=-=-=-
Re: [vpp-dev] FD.io CI job failures
In addition, looks like we have test failures caused by ipsec async patch merged today. I submitted revert patch…. — Damjan > > On 05.03.2021., at 00:35, Dave Wallace wrote: > > Folks, > > There have been numerous VPP CI job failures in the past day & a half due to > two known issues. > > 1) Starting Wednesday there were DNS lookup failures which have since gone > away. >See LF-IT ticket [0] for details. > > 2) Yesterday & today there have been lots of 'Connection Resets". >I opened a Vexxhost ticket [1] this morning for this issue. > > To date, there has not been a direct correlation identified to the move on > Tues/Wed of some of the CSIT and Nomad servers but investigations are > continuing to determine the root cause. > > Thank you for your patience as folks work to fix the CI. > -daw- > > [0] https://jira.linuxfoundation.org/plugins/servlet/theme/portal/2/IT-21660 > [1] > https://secure.vexxhost.com/billing/viewticket.php?tid=BGH-086778=Q8VPulfR > > > -=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#18855): https://lists.fd.io/g/vpp-dev/message/18855 Mute This Topic: https://lists.fd.io/mt/81090962/21656 Group Owner: vpp-dev+ow...@lists.fd.io Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub [arch...@mail-archive.com] -=-=-=-=-=-=-=-=-=-=-=-
[vpp-dev] FD.io CI job failures
Folks, There have been numerous VPP CI job failures in the past day & a half due to two known issues. 1) Starting Wednesday there were DNS lookup failures which have since gone away. See LF-IT ticket [0] for details. 2) Yesterday & today there have been lots of 'Connection Resets". I opened a Vexxhost ticket [1] this morning for this issue. To date, there has not been a direct correlation identified to the move on Tues/Wed of some of the CSIT and Nomad servers but investigations are continuing to determine the root cause. Thank you for your patience as folks work to fix the CI. -daw- [0] https://jira.linuxfoundation.org/plugins/servlet/theme/portal/2/IT-21660 [1] https://secure.vexxhost.com/billing/viewticket.php?tid=BGH-086778=Q8VPulfR -=-=-=-=-=-=-=-=-=-=-=- Links: You receive all messages sent to this group. View/Reply Online (#18854): https://lists.fd.io/g/vpp-dev/message/18854 Mute This Topic: https://lists.fd.io/mt/81090962/21656 Group Owner: vpp-dev+ow...@lists.fd.io Unsubscribe: https://lists.fd.io/g/vpp-dev/unsub [arch...@mail-archive.com] -=-=-=-=-=-=-=-=-=-=-=-
