Re: Ongoing partial outage on ci.jenkins.io

2019-08-16 Thread Oleg Nenashev
Revert PRs: * https://github.com/jenkins-infra/pipeline-library/pull/108 * https://github.com/jenkinsci/jenkins/pull/4155 BR, Oleg On Friday, August 16, 2019 at 2:38:31 PM UTC+2, Olblak wrote: > > Hi Everybody, > > Some updates from my side. > > ci.jenkins.io seems to be back to normal and my th

Re: Ongoing partial outage on ci.jenkins.io

2019-08-16 Thread Olblak
Hi Everybody, Some updates from my side. ci.jenkins.io seems to be back to normal and my theory is the outage was related to two independent issues and one is still not resolved. Wednesday afternoon (utc +2), I noticed that ci.jenkins.io was in a bad state. The build queue was huge (+-700 item

Re: Ongoing partial outage on ci.jenkins.io

2019-08-16 Thread Oleg Nenashev
Some extra updates: - We restored publishing of Incrementals in plugins by moving the code to ACI agents (thanks Jesse!) - We restored Jenkins Core CI runs. Windows builds and ATH are temporarily disabled there Best regards, Oleg On Thursday, August 15, 2019 at 6:24:37 PM UTC+2, Ol

Re: Ongoing partial outage on ci.jenkins.io

2019-08-15 Thread Oleg Nenashev
Hi all, Just heads-up, we have applied a hotfix to Jenkins Pipeline library in order to stabilize **SOME** of the plugin Pipelines. https://github.com/jenkins-infra/pipeline-library/releases/tag/1.2.0. What does the patch do? - buildPlugin() now enforces ACI for Linux flows - buildPlugin

Ongoing partial outage on ci.jenkins.io

2019-08-15 Thread R. Tyler Croy
I'm writing this to let you all know that we're experiencing on on-going partial outage on ci.jenkins.io which is affecting the ability of the system to process pull requests and merges to plugins, core, etc. Starting sometime yesterday (2019-08-14), all attempts to provision Azure VM agents began