Re: [Cloud] [Cloud-announce] [Toolforge] New Kubernetes cluster open for beta testers

Per that ticket, I no longer think there is any issue with the images for python at least. There was an issue with some nodes (that is being/mostly fixed). I’ll take a look at glamtools Brooke Storm Senior SRE Wikimedia Cloud Services bst...@wikimedia.org IRC: bsto

Re: [Cloud] [Cloud-announce] [Toolforge] New Kubernetes cluster open for beta testers

I’ve created Phabricator task T242632 to track this. Please coordinate there as well for anyone with information and time. Brooke Storm Senior SRE Wikimedia Cloud Services bst...@wikimedia.org IRC: bstorm_ > On Jan 13, 2020, at 9:10 AM, Brooke Storm wrote: > > I

Re: [Cloud] [Cloud-announce] [Toolforge] New Kubernetes cluster open for beta testers

I suspect this will affect containers that run Debian Buster packages. I see php7.3 and python3.7. I’d suggest not even restarting web services on those runtimes until we have it fixed. For anyone who has done so, we are working on it. Any logs could be helpful. Brooke Storm Senior SRE Wikim

Re: [Cloud] [Cloud-announce] [Toolforge] New Kubernetes cluster open for beta testers

I see a problem with at least one container image (which has nothing to do with the new cluster, I can see it on the old cluster as well). It looks like I’m going to be trying to fix that now. (Magnus, this is probably what you are seeing as well). Brooke Storm Senior SRE Wikimedia Cloud Servic

Re: [Cloud] [Cloud-announce] [Toolforge] New Kubernetes cluster open for beta testers

And now I can't switch back: ...switch back commands... tools.glamtools@tools-sgebastion-07:~$ unalias kubectl tools.glamtools@tools-sgebastion-07:~$ webservice --backend=kubernetes php7.3 start Your job is already running tools.glamtools@tools-sgebastion-07:~$ webservice stop Your webservice is

Re: [Cloud] [Cloud-announce] [Toolforge] New Kubernetes cluster open for beta testers

I switched a few "big ones" successfully, but ran into one that doesn't work: glamtools https://tools.wmflabs.org/glamtools/ is 503 but `webservice status` says "Your webservice of type php7.3 is running". On Thu, Jan 9, 2020 at 9:58 PM Bryan Davis wrote: > I am happy to announce that a new and