[Cloud-announce] Toolforge kubernetes upgrade to 1.24

Hello! today we are upgrading Toolforge kubernetes to version 1.24. We are not expecting any outage, but some jobs and webservices may be automagically restarted as they get scheduled on different worker nodes. Please report any disruption that you may observe. This is tracked in

[Cloud] Network maintenance happening now

Hi, there is a network maintenance work happening at the moment. For the next few minutes, expect some brief network connectivity problems. See also: https://phabricator.wikimedia.org/T347469 regards. -- Arturo Borrero Gonzalez Senior SRE / Wikimedia Cloud Services Wikimedia Foundation

[Cloud-announce] Network maintenance happening now

Hi, there is a network maintenance work happening at the moment. For the next few minutes, expect some brief network connectivity problems. See also: https://phabricator.wikimedia.org/T347469 regards. -- Arturo Borrero Gonzalez Senior SRE / Wikimedia Cloud Services Wikimedia Foundation

[Cloud] Cloud VPS maintenance today 2023-09-20

during the operations. Virtual machines should keep running unaffected, and the same for Toolforge tools. See also: https://phabricator.wikimedia.org/T346439 regards. -- Arturo Borrero Gonzalez Senior SRE / Wikimedia Cloud Services Wikimedia Foundation

[Cloud-announce] Cloud VPS maintenance today 2023-09-20

during the operations. Virtual machines should keep running unaffected, and the same for Toolforge tools. See also: https://phabricator.wikimedia.org/T346439 regards. -- Arturo Borrero Gonzalez Senior SRE / Wikimedia Cloud Services Wikimedia Foundation

[Cloud] Cloud VPS DNS resolver on some unmaintained virtual machines

g/wiki/Help:Cloud_Services_introduction#Communication_and_support -- Arturo Borrero Gonzalez Senior SRE / Wikimedia Cloud Services Wikimedia Foundation ___ Cloud mailing list -- cloud@lists.wikimedia.org List information: https://lists.wikimedia.org/postorius

[Cloud-announce] Cloud VPS DNS resolver on some unmaintained virtual machines

g/wiki/Help:Cloud_Services_introduction#Communication_and_support -- Arturo Borrero Gonzalez Senior SRE / Wikimedia Cloud Services Wikimedia Foundation ___ Cloud-announce mailing list -- cloud-announce@lists.wikimedia.org List information:

[Cloud-announce] Cloud VPS DNS operations today

/T342621 eqiad1: cloudlb: transition DNS clients (VMs) to the new BGP-based recursor VIP regards. -- Arturo Borrero Gonzalez Senior SRE / Wikimedia Cloud Services Wikimedia Foundation ___ Cloud-announce mailing list -- cloud-announce@lists.wikimedia.org List

[Cloud] Cloud VPS DNS operations today

/T342621 eqiad1: cloudlb: transition DNS clients (VMs) to the new BGP-based recursor VIP regards. -- Arturo Borrero Gonzalez Senior SRE / Wikimedia Cloud Services Wikimedia Foundation ___ Cloud mailing list -- cloud@lists.wikimedia.org List information: https

[Cloud-announce] Re: Toolforge Kubernetes upgrade on 2023-04-03 (new date: 2023-04-10)

On 3/30/23 12:42, Arturo Borrero Gonzalez wrote: On 3/28/23 00:13, Taavi Väänänen wrote: Hi, We will be upgrading the Toolforge Kubernetes cluster next Monday (2023-04-03) starting at around 10:00 UTC. The expected impact is that tools running on the Kubernetes cluster will get restarted

[Cloud] [Cloud-announce] Re: Toolforge Kubernetes upgrade on 2023-04-03 (new date: 2023-04-10)

on the latest available versions. The vast majority of tools that are only using the Jobs framework and/or the webservice command are not affected by these changes. This has been rescheduled to Monday 2023-04-10 to leave room for the other operations we have. regards. -- Arturo Borrero Gonzalez Senior

[Cloud-announce] Re: Toolforge Kubernetes upgrade on 2023-04-03 (new date: 2023-04-10)

on the latest available versions. The vast majority of tools that are only using the Jobs framework and/or the webservice command are not affected by these changes. This has been rescheduled to Monday 2023-04-10 to leave room for the other operations we have. regards. -- Arturo Borrero Gonzalez Senior

[Cloud] Toolforge: brief network maintenance today 2023-03-06

. [0] https://phabricator.wikimedia.org/T328539 -- Arturo Borrero Gonzalez Senior SRE / Wikimedia Cloud Services Wikimedia Foundation ___ Cloud mailing list -- cloud@lists.wikimedia.org List information: https://lists.wikimedia.org/postorius/lists

[Cloud-announce] Toolforge: brief network maintenance today 2023-03-06

. [0] https://phabricator.wikimedia.org/T328539 -- Arturo Borrero Gonzalez Senior SRE / Wikimedia Cloud Services Wikimedia Foundation ___ Cloud-announce mailing list -- cloud-announce@lists.wikimedia.org List information: https://lists.wikimedia.org

[Cloud] New toolforge-jobs features

, in particular Taavi (community member) and Raymond (WMF contractor). Happy `toolforging`. Regards. -- Arturo Borrero Gonzalez Senior SRE / Wikimedia Cloud Services Wikimedia Foundation ___ Cloud mailing list -- cloud@lists.wikimedia.org List information

[Cloud-announce] New toolforge-jobs features

, in particular Taavi (community member) and Raymond (WMF contractor). Happy `toolforging`. Regards. -- Arturo Borrero Gonzalez Senior SRE / Wikimedia Cloud Services Wikimedia Foundation ___ Cloud-announce mailing list -- cloud-announce@lists.wikimedia.org List

[Cloud-announce] Toolforge jobs: briefly maintenance today 2023-01-10 @ 11:30 UTC

less). During that time, using the toolforge-jobs command line interface will most likely fail. regards. [0] https://wikitech.wikimedia.org/wiki/Help:Toolforge/Jobs_framework -- Arturo Borrero Gonzalez Senior SRE / Wikimedia Cloud Services Wikimedia Foundation

[Cloud] Toolforge jobs: briefly maintenance today 2023-01-10 @ 11:30 UTC

less). During that time, using the toolforge-jobs command line interface will most likely fail. regards. [0] https://wikitech.wikimedia.org/wiki/Help:Toolforge/Jobs_framework -- Arturo Borrero Gonzalez Senior SRE / Wikimedia Cloud Services Wikimedia Foundation

[Cloud] Puppet error emails on 2022-11-28

urces", and "No exceptions happened". There was a problem in the way the puppet errors were calculated that has been now fixed [0]. This does not affect Toolforge. sorry for the noise, regards. [0] https://gerrit.wikimedia.org/r/c/operations/puppet/+/861805/ -- Arturo Borrero Gonzalez Sen

[Cloud-announce] Puppet error emails on 2022-11-28

urces", and "No exceptions happened". There was a problem in the way the puppet errors were calculated that has been now fixed [0]. This does not affect Toolforge. sorry for the noise, regards. [0] https://gerrit.wikimedia.org/r/c/operations/puppet/+/861805/ -- Arturo Borrero Gonzalez Sen

[Cloud] Some Cloud VPS virtual machines briefly unavailable today (and rebooted)

Name: toolsbeta-docker-imagebuilder-01 - ID: 416f445a-cad4-45c2-b32e-f17100f93eac Name: cloud-puppetmaster-05 - ID: 4e492051-25a3-4442-b8b9-1959f42917fe Name: tools-k8s-worker-76 - ID: df18863a-2da7-4951-aa69-936b3d889592 Name: deployment-docker-cpjobqueue01 -- Arturo Borrero Gonzalez Senior

[Cloud-announce] Some Cloud VPS virtual machines briefly unavailable today (and rebooted)

Name: toolsbeta-docker-imagebuilder-01 - ID: 416f445a-cad4-45c2-b32e-f17100f93eac Name: cloud-puppetmaster-05 - ID: 4e492051-25a3-4442-b8b9-1959f42917fe Name: tools-k8s-worker-76 - ID: df18863a-2da7-4951-aa69-936b3d889592 Name: deployment-docker-cpjobqueue01 -- Arturo Borrero Gonzalez Senior

[Cloud] [Cloud-announce] Re: Network maintenance

On 10/6/22 12:04, Arturo Borrero Gonzalez wrote: Hi there, We are currently working on replacing older hardware servers with newer ones, in particular those dedicated to cloud networking [0]. We have discovered a few shortcomings related mostly to network interface naming in the newer

[Cloud-announce] Re: Network maintenance

On 10/6/22 12:04, Arturo Borrero Gonzalez wrote: Hi there, We are currently working on replacing older hardware servers with newer ones, in particular those dedicated to cloud networking [0]. We have discovered a few shortcomings related mostly to network interface naming in the newer

[Cloud] [Cloud-announce] Network maintenance

of the transition. I'll send another note when we finish this network maintenance is over. regards. [0] https://phabricator.wikimedia.org/T316284 [1] https://bugs.debian.org/989162 -- Arturo Borrero Gonzalez Senior Site Reliability Engineer Wikimedia Cloud Services Wikimedia Foundation

[Cloud-announce] Network maintenance

of the transition. I'll send another note when we finish this network maintenance is over. regards. [0] https://phabricator.wikimedia.org/T316284 [1] https://bugs.debian.org/989162 -- Arturo Borrero Gonzalez Senior Site Reliability Engineer Wikimedia Cloud Services Wikimedia Foundation

[Cloud-announce] Network operations today 2022-04-06

notice), and some unexpected hiccups occurred. That's why the email today. regards. -- Arturo Borrero Gonzalez Site Reliability Engineer Wikimedia Cloud Services Wikimedia Foundation ___ Cloud-announce mailing list -- cloud-announce@lists.wikimedia.org

[Cloud] Network operations today 2022-04-06

notice), and some unexpected hiccups occurred. That's why the email today. regards. -- Arturo Borrero Gonzalez Site Reliability Engineer Wikimedia Cloud Services Wikimedia Foundation ___ Cloud mailing list -- cloud@lists.wikimedia.org List information

[Cloud] [Toolforge] some updates on toolforge-jobs command line interface

will exists, and you will see a warning if you use `containers`. 3) when listing images, the table header no longer mentions "Docker". These changes should be mostly cosmetic, and no functional or behavioral change is expected. Please report any problems you may find. regards. -- Artu

[Cloud] Re: Kubernetes-based jobs engine -- how to use Python virtual environments?

. -- Arturo Borrero Gonzalez Site Reliability Engineer Wikimedia Cloud Services Wikimedia Foundation ___ Cloud mailing list -- cloud@lists.wikimedia.org List information: https://lists.wikimedia.org/postorius/lists/cloud.lists.wikimedia.org/

[Cloud] Re: [Cloud-announce] [IMPORTANT] Announcing Toolforge Debian Stretch Grid Engine deprecation

to the image? See some documentation here: https://wikitech.wikimedia.org/wiki/Help:Toolforge/Python#Kubernetes_python_jobs I just created it, and may need some polishing, but it should work! We will review pywikibot specific workflows and documents soon. regards. -- Arturo Borrero Gonzalez

[Cloud] Re: [Cloud-announce] [IMPORTANT] Announcing Toolforge Debian Stretch Grid Engine deprecation

ave been much slower and difficult for us. Your concern about doing the migration dance twice is 100% valid, and the only way to future-proof your tool is to remove dependency on GridEngine and migrate it to the Kubernetes backend. regards. -- Arturo Borrero Gonzalez Site Reliability Engin

[Cloud] Re: preferred proxy

larification. It is true, wmcloud.org is the current domain and wmflabs.org is considered 'legacy' and in the [slow] process of being removed. Hey @Tim, can you point to documentation or some information that needs updates that could be source of confusion in the future? thanks, regards. -- Arturo Borr

[Cloud] [Cloud-announce] 2021-11-02: Cloud VPS network outage

://phabricator.wikimedia.org/T294853 Sorry for the inconvenience. regards. -- Arturo Borrero Gonzalez SRE / Wikimedia Cloud Services Wikimedia Foundation ___ Cloud-announce mailing list -- cloud-annou...@lists.wikimedia.org List information: https

[Cloud-announce] 2021-11-02: Cloud VPS network outage

://phabricator.wikimedia.org/T294853 Sorry for the inconvenience. regards. -- Arturo Borrero Gonzalez SRE / Wikimedia Cloud Services Wikimedia Foundation ___ Cloud-announce mailing list -- cloud-announce@lists.wikimedia.org List information: https

[Cloud] [Cloud-announce] wiki replicas maintenance on 2021-07-22

including Toolforge tools, PAWS, and any other Cloud VPS project using them. More information can be found on phabricator: https://phabricator.wikimedia.org/T286614 regards. -- Arturo Borrero Gonzalez SRE / Wikimedia Cloud Services Wikimedia Foundation

[Cloud-announce] wiki replicas maintenance on 2021-07-22

including Toolforge tools, PAWS, and any other Cloud VPS project using them. More information can be found on phabricator: https://phabricator.wikimedia.org/T286614 regards. -- Arturo Borrero Gonzalez SRE / Wikimedia Cloud Services Wikimedia Foundation

Re: [Cloud] Expired certificates for wmflabs.org and wmcloud.org

On 5/7/21 7:40 AM, Sascha Brawer wrote: Curious, does the Wikimedia cloud have some kind of monitoring system that could have noticed and send an alert? Yeah, we have monitoring. We could always do better with monitoring in general, of course. regards. -- Arturo Borrero Gonzalez SRE

Re: [Cloud] CloudVPS / Toolforge edge network maintenance 2021-05-06 @ 15:00 UTC

On 5/6/21 5:00 PM, Arturo Borrero Gonzalez wrote: Reminder, this is happening now! See you on the other side :-) Hello from the other side. This is now done. Sorry for the bumpy ride in Toolforge bastions. regards -- Arturo Borrero Gonzalez SRE / Wikimedia Cloud Services Wikimedia

Re: [Cloud-announce] CloudVPS / Toolforge edge network maintenance 2021-05-06 @ 15:00 UTC

On 5/6/21 5:00 PM, Arturo Borrero Gonzalez wrote: Reminder, this is happening now! See you on the other side :-) Hello from the other side. This is now done. Sorry for the bumpy ride in Toolforge bastions. regards -- Arturo Borrero Gonzalez SRE / Wikimedia Cloud Services Wikimedia

Re: [Cloud] CloudVPS / Toolforge edge network maintenance 2021-05-06 @ 15:00 UTC

On 5/3/21 11:27 AM, Arturo Borrero Gonzalez wrote: Hello there, We will be doing an upgrade to the CloudVPS edge network Thursday 2021-05-06 @ 15:00 UTC that will likely impact user experience, including Toolforge. We scheduled an 1h operation window. During that time, intermittent network

Re: [Cloud-announce] CloudVPS / Toolforge edge network maintenance 2021-05-06 @ 15:00 UTC

On 5/3/21 11:27 AM, Arturo Borrero Gonzalez wrote: Hello there, We will be doing an upgrade to the CloudVPS edge network Thursday 2021-05-06 @ 15:00 UTC that will likely impact user experience, including Toolforge. We scheduled an 1h operation window. During that time, intermittent network

Re: [Cloud] Expired certificates for wmflabs.org and wmcloud.org

rything worked. regards. -- Arturo Borrero Gonzalez SRE / Wikimedia Cloud Services Wikimedia Foundation ___ Wikimedia Cloud Services mailing list Cloud@lists.wikimedia.org (formerly lab...@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/cloud

[Cloud] CloudVPS / Toolforge edge network maintenance 2021-05-06 @ 15:00 UTC

on the operation can be found in phabricator [0] and in wikitech [1]. Regards. [0]https://phabricator.wikimedia.org/T270704 [1] https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/2020_Network_refresh -- Arturo Borrero Gonzalez SRE / Wikimedia Cloud Services

[Cloud-announce] CloudVPS / Toolforge edge network maintenance 2021-05-06 @ 15:00 UTC

on the operation can be found in phabricator [0] and in wikitech [1]. Regards. [0]https://phabricator.wikimedia.org/T270704 [1] https://wikitech.wikimedia.org/wiki/Wikimedia_Cloud_Services_team/EnhancementProposals/2020_Network_refresh -- Arturo Borrero Gonzalez SRE / Wikimedia Cloud Services

Re: [Cloud] [Cloud-announce] cloud-vps maintenance at 14:00 UTC

domain. regards. -- Arturo Borrero Gonzalez SRE / Wikimedia Cloud Services Wikimedia Foundation ___ Wikimedia Cloud Services mailing list Cloud@lists.wikimedia.org (formerly lab...@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/cloud

[Cloud] Network change for VMs contacting NFS dumps

/Help:Cloud_Services_Introduction#Communication_and_support [2] https://phabricator.wikimedia.org/T272397 -- Arturo Borrero Gonzalez SRE / Wikimedia Cloud Services Wikimedia Foundation ___ Wikimedia Cloud Services mailing list Cloud@lists.wikimedia.org (formerly lab

[Cloud-announce] Network change for VMs contacting NFS dumps

/Help:Cloud_Services_Introduction#Communication_and_support [2] https://phabricator.wikimedia.org/T272397 -- Arturo Borrero Gonzalez SRE / Wikimedia Cloud Services Wikimedia Foundation ___ Wikimedia Cloud Services announce mailing list Cloud-announce@lists.wikimedia.org

Re: [Cloud] Change to how Cloud VPS and Toolforge contact Wikis

On 1/25/21 11:55 AM, Arturo Borrero Gonzalez wrote: Hello, we are planning to change how Cloud VPS instances and Toolforge tools contact WMF-hosted wikis, in particular the source IP address for the network connection. The new IP address that wikis will see is 185.15.56.1. The change

Re: [Cloud-announce] Change to how Cloud VPS and Toolforge contact Wikis

On 1/25/21 11:55 AM, Arturo Borrero Gonzalez wrote: Hello, we are planning to change how Cloud VPS instances and Toolforge tools contact WMF-hosted wikis, in particular the source IP address for the network connection. The new IP address that wikis will see is 185.15.56.1. The change

Re: [Cloud] [Ops] Change to how Cloud VPS and Toolforge contact Wikis

share a link to gerrit so I can have such patch in my radar? regards. -- Arturo Borrero Gonzalez SRE / Wikimedia Cloud Services Wikimedia Foundation ___ Wikimedia Cloud Services mailing list Cloud@lists.wikimedia.org (formerly lab...@lists.wikimed

Re: [Cloud] [Ops] Change to how Cloud VPS and Toolforge contact Wikis

measures, somehow? Hi, do you know where this limit configuration can be found? thanks for the heads up. regards. -- Arturo Borrero Gonzalez SRE / Wikimedia Cloud Services Wikimedia Foundation ___ Wikimedia Cloud Services mailing list Cloud

[Cloud-announce] Change to how Cloud VPS and Toolforge contact Wikis

. Thanks, best regards. -- Arturo Borrero Gonzalez SRE / Wikimedia Cloud Services Wikimedia Foundation ___ Wikimedia Cloud Services announce mailing list Cloud-announce@lists.wikimedia.org (formerly labs-annou...@lists.wikimedia.org) https

[Cloud] Change to how Cloud VPS and Toolforge contact Wikis

. Thanks, best regards. -- Arturo Borrero Gonzalez SRE / Wikimedia Cloud Services Wikimedia Foundation ___ Wikimedia Cloud Services mailing list Cloud@lists.wikimedia.org (formerly lab...@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo

Re: [Cloud] Toolforge kubernetes maintenance today 2020-12-10 @ 15:30 UTC

On 12/10/20 1:33 PM, Arturo Borrero Gonzalez wrote: Hi there! Today 2020-12-10 @ 15:30 UTC we will perform an upgrade of the Toolforge kubernetes cluster [0]. We don't expect any major disruption of the service, but we detected in past upgrades that some components might be restarted

Re: [Cloud-announce] Toolforge kubernetes maintenance today 2020-12-10 @ 15:30 UTC

On 12/10/20 1:33 PM, Arturo Borrero Gonzalez wrote: Hi there! Today 2020-12-10 @ 15:30 UTC we will perform an upgrade of the Toolforge kubernetes cluster [0]. We don't expect any major disruption of the service, but we detected in past upgrades that some components might be restarted

[Cloud-announce] Toolforge kubernetes maintenance today 2020-12-10 @ 15:30 UTC

-cloud or in the cl...@lists.wikimedia.org [1] mailing list. regards. [0] https://phabricator.wikimedia.org/T263284 [1] https://lists.wikimedia.org/mailman/listinfo/cloud -- Arturo Borrero Gonzalez SRE / Wikimedia Cloud Services Wikimedia Foundation

[Cloud-announce] PAWS kubernetes upgrade

://phabricator.wikimedia.org/T268669 The operation may take something between 30 minutes and 1 hours, and we are starting soon after I finish sending this email. Please, ping us if you see anything wrong. regards. -- Arturo Borrero Gonzalez SRE / Wikimedia Cloud Services Wikimedia Foundation

[Cloud] PAWS kubernetes upgrade

://phabricator.wikimedia.org/T268669 The operation may take something between 30 minutes and 1 hours, and we are starting soon after I finish sending this email. Please, ping us if you see anything wrong. regards. -- Arturo Borrero Gonzalez SRE / Wikimedia Cloud Services Wikimedia Foundation

[Cloud-announce] General CloudVPS network maintenance on 2020-11-09 (today)

the CloudVPS network to the internet. Sorry for the short notice, we couldn't avoid scheduling this to today. regards. [0] https://phabricator.wikimedia.org/T265288 -- Arturo Borrero Gonzalez SRE / Wikimedia Cloud Services Wikimedia Foundation

[Cloud] General CloudVPS network maintenance on 2020-11-09 (today)

the CloudVPS network to the internet. Sorry for the short notice, we couldn't avoid scheduling this to today. regards. [0] https://phabricator.wikimedia.org/T265288 -- Arturo Borrero Gonzalez SRE / Wikimedia Cloud Services Wikimedia Foundation

Re: [Cloud] General CloudVPS network maintenance on 2020-10-29

On 2020-10-30 00:04, Maarten Dammers wrote: > Hi Arturo, > > On 29-10-2020 18:30, Arturo Borrero Gonzalez wrote: >> Let us know if you see anything weird matching the timing or somehow related >> to >> this operation window. > > This was announced as n

Re: [Cloud-announce] General CloudVPS network maintenance on 2020-10-29

On 2020-10-29 16:59, Arturo Borrero Gonzalez wrote: > On 2020-10-22 17:41, Arturo Borrero Gonzalez wrote: >> Hi! >> >> There will be a general CloudVPS network maintenance on 20202-10-29, from >> 16:00 >> UTC to 17:00 UTC. >> >> During t

Re: [Cloud] General CloudVPS network maintenance on 2020-10-29

On 2020-10-29 16:59, Arturo Borrero Gonzalez wrote: > On 2020-10-22 17:41, Arturo Borrero Gonzalez wrote: >> Hi! >> >> There will be a general CloudVPS network maintenance on 20202-10-29, from >> 16:00 >> UTC to 17:00 UTC. >> >> During t

Re: [Cloud] General CloudVPS network maintenance on 2020-10-29

On 2020-10-22 17:41, Arturo Borrero Gonzalez wrote: > Hi! > > There will be a general CloudVPS network maintenance on 20202-10-29, from > 16:00 > UTC to 17:00 UTC. > > During the operation window, all cloud services might be intermittently down, > inaccessible. > &

Re: [Cloud-announce] General CloudVPS network maintenance on 2020-10-29

On 2020-10-22 17:41, Arturo Borrero Gonzalez wrote: > Hi! > > There will be a general CloudVPS network maintenance on 20202-10-29, from > 16:00 > UTC to 17:00 UTC. > > During the operation window, all cloud services might be intermittently down, > inaccessible. > &

[Cloud] unscheduled keystone maintenance

Hi there, we need to perform some unscheduled keystone maintenance right now. Authentication to some cloud services, in particular Horizon, might be interrupted during this maintenance period. We expect such maintenance to don't last more than 1h. regards. -- Arturo Borrero Gonzalez SRE

[Cloud-announce] unscheduled keystone maintenance

Hi there, we need to perform some unscheduled keystone maintenance right now. Authentication to some cloud services, in particular Horizon, might be interrupted during this maintenance period. We expect such maintenance to don't last more than 1h. regards. -- Arturo Borrero Gonzalez SRE

Re: [Cloud] Toolforge: new domain toolforge.org

On 2020-07-06 17:59, Arturo Borrero Gonzalez wrote: > Hi there! > > Tomorrow 2020-07-06 at about 10:00 UTC we will enable the legacy redirector > and > this migration will be completed. > > All requests to tools.wmflabs.org/ will be permanently redirected to > .toolfor

Re: [Cloud-announce] Toolforge: new domain toolforge.org

On 2020-07-06 17:59, Arturo Borrero Gonzalez wrote: > Hi there! > > Tomorrow 2020-07-06 at about 10:00 UTC we will enable the legacy redirector > and > this migration will be completed. > > All requests to tools.wmflabs.org/ will be permanently redirected to > .toolfor

Re: [Cloud-announce] Toolforge: new domain toolforge.org

://wikitech.wikimedia.org/wiki/News/Toolforge.org Please reach out if you need help or have doubts. regards. -- Arturo Borrero Gonzalez SRE / Wikimedia Cloud Services Wikimedia Foundation ___ Wikimedia Cloud Services announce mailing list Cloud-announce@lists.wikimedia.org

Re: [Cloud] Toolforge: new domain toolforge.org

://wikitech.wikimedia.org/wiki/News/Toolforge.org Please reach out if you need help or have doubts. regards. -- Arturo Borrero Gonzalez SRE / Wikimedia Cloud Services Wikimedia Foundation ___ Wikimedia Cloud Services mailing list Cloud@lists.wikimedia.org (formerly lab

[Cloud] [Cloud-announce] Toolforge email server now enforcing ratelimiting

] https://en.wikipedia.org/wiki/Message_transfer_agent -- Arturo Borrero Gonzalez SRE / Wikimedia Cloud Services Wikimedia Foundation ___ Wikimedia Cloud Services announce mailing list cloud-annou...@lists.wikimedia.org (formerly labs-annou

[Cloud-announce] Toolforge email server now enforcing ratelimiting

] https://en.wikipedia.org/wiki/Message_transfer_agent -- Arturo Borrero Gonzalez SRE / Wikimedia Cloud Services Wikimedia Foundation ___ Wikimedia Cloud Services announce mailing list Cloud-announce@lists.wikimedia.org (formerly labs-annou

Re: [Cloud] Screen sessions

https://wikitech.wikimedia.org/wiki/Help:Toolforge/Grid Run your script with jsub and it will be scheduled in a grid worker node to run until it finishes. regards. -- Arturo Borrero Gonzalez SRE / Wikimedia Cloud Services Wikimedia Foundation ___ Wikime

Re: [Cloud-announce] Toolforge: new domain toolforge.org

. -- Arturo Borrero Gonzalez SRE / Wikimedia Cloud Services Wikimedia Foundation ___ Wikimedia Cloud Services announce mailing list Cloud-announce@lists.wikimedia.org (formerly labs-annou...@lists.wikimedia.org) https://lists.wikimedia.org/mailman

Re: [Cloud] Toolforge: new domain toolforge.org

://xtools.toolforge.org/ https://ytcleaner.toolforge.org/ https://zppixbot.toolforge.org/ -- Arturo Borrero Gonzalez SRE / Wikimedia Cloud Services Wikimedia Foundation ___ Wikimedia Cloud Services mailing list Cloud@lists.wikimedia.org (formerly lab

Re: [Cloud-announce] Toolforge: new domain toolforge.org

://xtools.toolforge.org/ https://ytcleaner.toolforge.org/ https://zppixbot.toolforge.org/ -- Arturo Borrero Gonzalez SRE / Wikimedia Cloud Services Wikimedia Foundation ___ Wikimedia Cloud Services announce mailing list Cloud-announce@lists.wikimedia.org (formerly

[Cloud-announce] Toolforge grid now using tesseract-ocr 4.1.1

Hi there! We just deployed tesseract-ocr v4.1.1 in the Toolforge grid. The context of this update is the phabricator task T247422 [0]. Please report any issue you may find. regards! [0] https://phabricator.wikimedia.org/T247422 -- Arturo Borrero Gonzalez SRE / Wikimedia Cloud Services

[Cloud] Toolforge grid now using tesseract-ocr 4.1.1

Hi there! We just deployed tesseract-ocr v4.1.1 in the Toolforge grid. The context of this update is the phabricator task T247422 [0]. Please report any issue you may find. regards! [0] https://phabricator.wikimedia.org/T247422 -- Arturo Borrero Gonzalez SRE / Wikimedia Cloud Services

Re: [Cloud-announce] Toolforge: new domain toolforge.org

://signatures.toolforge.org https://templatedata-filler.toolforge.org https://wordcount.toolforge.org Please reach out for any comments, doubts or questions. regards. -- Arturo Borrero Gonzalez SRE / Wikimedia Cloud Services Wikimedia Foundation

Re: [Cloud-announce] Changes to CloudVPS web proxy (XFF) on 2020-04-15

On 4/1/20 2:16 PM, Arturo Borrero Gonzalez wrote: > Hi there! > > If you use a CloudVPS web proxy, this email is for you. Toolforge > developers/users can ignore this email. > > We are introducing a change to eliminate the 'X-Forwarded-For' HTTP header > that > the Clou

Re: [Cloud] Changes to CloudVPS web proxy (XFF) on 2020-04-15

On 4/1/20 2:16 PM, Arturo Borrero Gonzalez wrote: > Hi there! > > If you use a CloudVPS web proxy, this email is for you. Toolforge > developers/users can ignore this email. > > We are introducing a change to eliminate the 'X-Forwarded-For' HTTP header > that > the Clou

Re: [Cloud] [Cloud-announce] Changes to CloudVPS web proxy (XFF) on 2020-04-15

lease contact us. regards. -- Arturo Borrero Gonzalez SRE / Wikimedia Cloud Services Wikimedia Foundation ___ Wikimedia Cloud Services mailing list Cloud@lists.wikimedia.org (formerly lab...@lists.wikimedia.org) https://lists.wikimedia.org/mailman/listinfo/cloud

Re: [Cloud] Toolforge: new domain toolforge.org

re secure approach to host each tool webservice, from an all-shared domain to a domain per tool. -- Arturo Borrero Gonzalez SRE / Wikimedia Cloud Services Wikimedia Foundation ___ Wikimedia Cloud Services mailing list Cloud@lists.wikimedia.org (for

[Cloud-announce] Toolforge: new domain toolforge.org

serving legacy URLs forever, by means of redirections to the new URLs. More information on the redirections can also be found in the wikitech page. The toolforge.org domain is finally here! <3 -- Arturo Borrero Gonzalez SRE / Wikimedia Cloud Services Wikimedia Foundat

[Cloud] Toolforge: new domain toolforge.org

serving legacy URLs forever, by means of redirections to the new URLs. More information on the redirections can also be found in the wikitech page. The toolforge.org domain is finally here! <3 -- Arturo Borrero Gonzalez SRE / Wikimedia Cloud Services Wikimedia Foundat

Re: [Cloud-announce] CloudVPS network change (routing source IP) on 2020-04-13

On 4/6/20 8:00 PM, Arturo Borrero Gonzalez wrote: > Hi there! > > In a few days from now (2020-04-13), the CloudVPS network will see a change > happening that will likely go unnoticed, but it is important enough to share > it > with you beforehand. > > We will be c

Re: [Cloud] CloudVPS network change (routing source IP) on 2020-04-13

On 4/6/20 8:00 PM, Arturo Borrero Gonzalez wrote: > Hi there! > > In a few days from now (2020-04-13), the CloudVPS network will see a change > happening that will likely go unnoticed, but it is important enough to share > it > with you beforehand. > > We will be c

[Cloud] CloudVPS network change (routing source IP) on 2020-04-13

details: https://wikitech.wikimedia.org/wiki/News/CloudVPS_NAT_change Please reach out if you have any doubts, questions, or any other issue. regards. -- Arturo Borrero Gonzalez SRE / Wikimedia Cloud Services Wikimedia Foundation ___ Wikimedia Cloud

[Cloud-announce] CloudVPS network change (routing source IP) on 2020-04-13

details: https://wikitech.wikimedia.org/wiki/News/CloudVPS_NAT_change Please reach out if you have any doubts, questions, or any other issue. regards. -- Arturo Borrero Gonzalez SRE / Wikimedia Cloud Services Wikimedia Foundation ___ Wikimedia Cloud

[Cloud] Changes to CloudVPS web proxy (XFF) on 2020-04-15

ach out for any questions or comments. regards. [0] https://phabricator.wikimedia.org/T135046 [1] https://openstack-browser.toolforge.org/project/project-proxy [2] https://gerrit.wikimedia.org/r/c/operations/puppet/+/583098 -- Arturo Borrero Gonzalez SRE / Wikimedia Cloud Services Wikime

[Cloud-announce] Changes to CloudVPS web proxy (XFF) on 2020-04-15

ach out for any questions or comments. regards. [0] https://phabricator.wikimedia.org/T135046 [1] https://openstack-browser.toolforge.org/project/project-proxy [2] https://gerrit.wikimedia.org/r/c/operations/puppet/+/583098 -- Arturo Borrero Gonzalez SRE / Wikimedia Cloud Services Wikime

Re: [Cloud] [Cloud-announce] [Toolforge] 2020 Kubernetes cluster automatic migration phase beginning

rg/wiki/News/2020_Kubernetes_cluster_migration#Lower_default_resource_limits_for_webservice hope that helps. regards. -- Arturo Borrero Gonzalez SRE / Wikimedia Cloud Services Wikimedia Foundation ___ Wikimedia Cloud Services mailing list Cloud@lists.w

Re: [Cloud] [Cloud-announce] [Toolforge] 2020 Kubernetes cluster automatic migration phase beginning

email, we don't have any particular metrics or insights on proxies performances and this is something we could explore in the near future (create a specific grafana dashboard or something). regards. -- Arturo Borrero Gonzalez SRE / Wikimedia Cloud Servi

Re: [Cloud-announce] cloud-vps maintenance Tuesday, 2019-01-14

disabled (probably for 20 to > 30 > minutes.)  There may also be brief network interruptions during the upgrade. > > Toolforge and existing VMs should be largely unaffected apart from possible > network hiccups. > Reminder, this will be happening in about 30 minutes! regar

Re: [Cloud] [Cloud-announce] cloud-vps maintenance Tuesday, 2019-01-14

disabled (probably for 20 to > 30 > minutes.)  There may also be brief network interruptions during the upgrade. > > Toolforge and existing VMs should be largely unaffected apart from possible > network hiccups. > Reminder, this will be happening in about 30 minutes! regar

Re: [Cloud] [Cloud-announce] MOSTLY COMPLETE cloud-vps maintenance Thursday, 2019-12-12

ries corresponding to the window of this operation. Other CloudVPS projects users of NFS (dumps shares, maps, etc) might also require some checking. Please get in touch if you are a project admin of such project. regards. -- Arturo Borrero Gonzalez SRE / Wikimedia Cloud Services Wi

Re: [Cloud-announce] MOSTLY COMPLETE cloud-vps maintenance Thursday, 2019-12-12

ries corresponding to the window of this operation. Other CloudVPS projects users of NFS (dumps shares, maps, etc) might also require some checking. Please get in touch if you are a project admin of such project. regards. -- Arturo Borrero Gonzalez SRE / Wikimedia Cloud Services Wi

Re: [Cloud] [Toolforge] Proxy maintenance operation next Monday 2019-10-28 @ 14:30 UTC

On 10/21/19 12:16 PM, Arturo Borrero Gonzalez wrote: > Hi there! > > Next Monday 2019-10-28 @ 14:30 UTC we will do a maintenance operation on > Toolforge which consists in rebuilding the main front proxy [0] used to serve > webservices. We expect this to be done within a 30

  1   2   >