[Cloud-announce] [Toolforge][GRID SHUTDOWN] Toolforge Grid Engine has been shutdown

#Timeline [3]: https://techblog.wikimedia.org/2022/03/14/toolforge-and-grid-engine/ [4]: https://lists.wikimedia.org/pipermail/labs-l/2015-August/003955.html Bryan, on behalf of the Toolforge administrators -- Bryan DavisWikimedia Foundation Principal

[Cloud-announce] ORES API endpoints deprecated; Lift Wing API endpoints available as replacement

with the process [1]. [0]: https://lists.wikimedia.org/hyperkitty/list/wikitec...@lists.wikimedia.org/thread/EK65B7QCQHEG37C2ERPIUSP64OX3ZEUJ/ [1]: https://wikitech.wikimedia.org/wiki/ORES Bryan -- Bryan Davis Technical Engagement Wikimedia Foundation Principal Software Engineer

[Cloud-announce] [Toolforge] Self-service tool deletion finally arrives!

tor.wikimedia.org/T133777 [1]: https://phabricator.wikimedia.org/T170355 [2]: https://phabricator.wikimedia.org/T285403 [3]: https://gerrit.wikimedia.org/r/plugins/gitiles/cloud/toolforge/disable-tool/ [[WP:BOLD]]: https://en.wikipedia.org/wiki/Wikipedia:Be_bold Bryan, on behalf of the Toolforge

[Cloud-announce] Re: [Toolforge] Moving git repos from Diffusion to GitLab starting 2022-09-06

On Tue, Sep 6, 2022 at 4:38 PM Bryan Davis wrote: > > On Thu, Sep 1, 2022 at 4:26 PM Bryan Davis wrote: > > > > What: Diffusion git hosting moving to GitLab [0][1] > > When: Tuesday 2022-09-06 between 15:00 - 23:00 UTC > > Why: Unblocking sunsetting work

[Cloud-announce] Re: [Toolforge] Moving git repos from Diffusion to GitLab starting 2022-09-06

On Thu, Sep 1, 2022 at 4:26 PM Bryan Davis wrote: > > What: Diffusion git hosting moving to GitLab [0][1] > When: Tuesday 2022-09-06 between 15:00 - 23:00 UTC > Why: Unblocking sunsetting work for Differential/Diffusion [2] > > What you can do: If you have not l

[Cloud-announce] [Toolforge] Moving git repos from Diffusion to GitLab starting 2022-09-06

in order to grant you access [3]. [0]: https://phabricator.wikimedia.org/T296893 [1]: https://phabricator.wikimedia.org/T315706 [2]: https://phabricator.wikimedia.org/T191182 [3]: https://phabricator.wikimedia.org/T313366#8203450 Bryan, on behalf of the Toolforge administrato

[Cloud-announce] [Toolforge] Toolforge tool maintainers are eligible to vote in current Board election

https://phabricator.wikimedia.org/T309754 Bryan -- Bryan Davis Technical Engagement Wikimedia Foundation Principal Software Engineer Boise, ID USA [[m:User:BDavis_(WMF)]] irc: bd808 ___

[Cloud-announce] [Toolforge] Some tools broken by upstream Let's Encrypt certificate changes

stions + grid engine failing. We do not yet have a fix for this. It will require us to compile and install a newer version of mono for everyone who is using it. Interested folks can follow progress of our infrastructure updates in response to this issue at T291387 [3]. [0]: https://letsencrypt.org/ [1]: http

[Cloud-announce] Re: #wikimedia-cloud IRC channel available on libera.chat

On Thu, May 20, 2021 at 2:59 PM Bryan Davis wrote: > > TL;DR: > * The #wikimedia-cloud IRC channel is moving from Freenode to Libera.Chat. > * Register an account on Libera.Chat and join us there! > > [...snip...] > > A new #wikimedia-cloud channel has been cr

[Cloud-announce] [Toolforge] Outbound emails were stuck from 2021-03-31T14:56Z to 2021-04-20T21:52Z

to catch problems similar to this more quickly in the future. Bryan, on behalf of the Toolforge admin team -- Bryan Davis Technical Engagement Wikimedia Foundation Principal Software Engineer Boise, ID USA [[m:User:BDavis_(WMF)]]

[Cloud-announce] [Cloud VPS] TLS encryption fully enforced for *.wmflabs.org & *.wmcloud.org

On Tue, Aug 18, 2020 at 9:03 AM Bryan Davis wrote: > > TL;DR: > * HTTP -> HTTPS redirection is live (finally!) > * Currently allowing a "POST loophole" > * "POST loophole" will be closed on 2021-02-01 > > Today we merged a small change [0] to the

[Cloud-announce] Clarification: database service names still use eqiad.wmflabs, not eqiad1.wikimedia.cloud

7 for more details [0]. The preferred service name for ToolsDB is tools.db.svc.eqiad.wmflabs. [0]: https://phabricator.wikimedia.org/phame/post/view/70/new_wiki_replica_servers_ready_for_use/ Bryan, on behalf of the Cloud Services team -- Bryan Davis Technical Engagement

[Cloud-announce] [Toolforge] New features in toolsadmin.wikimedia.org

[1]: https://wikitech.wikimedia.org/wiki/Toolsadmin.wikimedia.org/Deployments#2020-09-02 Bryan, on behalf of the Toolforge admin team -- Bryan Davis Technical Engagement Wikimedia Foundation Principal Software Engineer Boise, ID USA

[Cloud-announce] [Toolforge] Default /favicon.ico and /robots.txt for toolforge.org webservices

rnetes ingress layer. Previously the /robots.txt and /favicon.ico from the "admin" tool were served for all tools due to the use of a shared hostname. [0]: https://phabricator.wikimedia.org/T251628 Bryan, on behalf of the Toolforge admin team -- Bryan Davis Technical Engagement

[Cloud-announce] [Cloud VPS] TLS encryption partially enforced for *.wmflabs.org & *.wmcloud.org

/listinfo/cloud Bryan, on behalf of the Cloud VPS admin team -- Bryan Davis Technical Engagement Wikimedia Foundation Principal Software Engineer Boise, ID USA [[m:User:BDavis_(WMF)]] irc: bd808 _

[Cloud-announce] [Cloud VPS] Puppet labs/private.git data loss incident affecting some projects

change logs where available. More information will be collected at <https://phabricator.wikimedia.org/T254491> and an incident report will also be prepared once the initial response is complete. Bryan -- Bryan Davis Technical Engagement Wikimedia Foundation Principal So

[Cloud-announce] Disk failure on cloudvirt1004 OpenStack host

kidata-autodesc.eqiad.wmflabs * wikilink ** wikilink-prod.wikilink.eqiad.wmflabs Bryan, on behalf of the Cloud VPS admins and Cloud Services team -- Bryan Davis Technical Engagement Wikimedia Foundation Principal Software Engineer Boise, ID USA [[m:User:BDavi

[Cloud-announce] [Toolforge] 2020 Kubernetes cluster migration complete

://phabricator.wikimedia.org/T214513 Bryan, on behalf of the Toolforge admin team and the Wikimedia Cloud Services team -- Bryan Davis Technical Engagement Wikimedia Foundation Principal Software Engineer Boise, ID USA [[m:User:BDavis_(WMF

[Cloud-announce] [Toolforge] 2020 Kubernetes cluster automatic migration phase beginning

and the Cloud Services team) -- Bryan Davis Technical Engagement Wikimedia Foundation Principal Software Engineer Boise, ID USA [[m:User:BDavis_(WMF)]] irc: bd808

[Cloud-announce] [Toolforge] 2020 Kubernetes cluster open for general use

0-January/000247.html [2]: https://tools.wmflabs.org/k8s-status/ [3]: https://wikitech.wikimedia.org/wiki/Help:Toolforge/Kubernetes#Available_container_types Bryan (on behalf of the Toolforge admins and the Cloud Services team) -- Bryan Davis Technical Engagement Wikimedia Foun

[Cloud-announce] [Toolforge] New Kubernetes cluster open for beta testers

bs.org/k8s-status/ [2]: https://tools.wmflabs.org/sge-status/ Bryan (on behalf of the Toolforge admins and the Cloud Services team) -- Bryan Davis Technical Engagement Wikimedia Foundation Principal Software Engineer Boise, ID USA [[m:User:B

[Cloud-announce] [Wiki replicas] query killer time limit reduced to 1 hour for .analytics.db.svc.eqiad.wmflabs

some stress on the shared servers and allow us more time to look into other changes to restore stability. Ideally we will be able to increase the limit again after making other changes to these systems. Bryan, on behalf of the Cloud Services team -- Bryan Davis Technical Engagement

[Cloud-announce] [Toolforge] Lots and lots of cronspam, probably safe to ignore

we fixed the mail server thousands of queued messages started going out. There are still a few emails sending as I write this, but the queue is almost empty. As far as we can tell, cronjobs are starting as expected now and the emails are just left over noise. Bryan -- Bryan Davis

[Cloud-announce] Debian Jessie deprecation plans

an - on behalf of the Cloud VPS admin team -- Bryan Davis Technical Engagement Wikimedia Foundation Principal Software Engineer Boise, ID USA [[m:User:BDavis_(WMF)]]

[Cloud-announce] Toolforge Kubernetes disrupted from 2019-09-10T18:54 to 2019-09-11T01:30

and unfortunate coincidence. See https://phabricator.wikimedia.org/T232536 for follow up documentation (when we write it during the coming US business day). Bryan - on behalf of the Toolforge admin team -- Bryan Davis Technical Engagement Wikimedia Foundation Principal Software

[Cloud-announce] DNS errors early 2019-09-09 UTC may have affected jobs and servers

a "SERVFAIL" response. The issue appears to be resolved now. We will share more information about what happened and how the problem was corrected when we are sure that doing so will not cause additional issues. Bryan, on behalf of the Cloud VPS admin team -- Bryan Davis Technical

[Cloud-announce] Docker images used by Toolforge's Kubernetes cluster updated

rge admins -- Bryan Davis Technical Engagement Wikimedia Foundation Principal Software Engineer Boise, ID USA [[m:User:BDavis_(WMF)]] irc: bd808 ___ Wikimedia Cloud Service

[Cloud-announce] [Mediawiki-api-announce] BREAKING CHANGE: Improved timestamp support

Cross-posting from the mediawiki-api-annou...@lists.wikimedia.org list. -- Forwarded message - From: Brad Jorsch (Anomie) Date: Fri, Jun 21, 2019 at 8:30 AM Subject: [Mediawiki-api-announce] BREAKING CHANGE: Improved timestamp support To: An upgrade to the timestamp library

[Cloud-announce] [Toolforge] Node.js 10 and Python 3.5 types now available for use by Kubernetes webservices

stopped. Session cannot be resumed. Bryan, on behalf of the Toolforge admin team -- Bryan Davis Wikimedia Foundation [[m:User:BDavis_(WMF)]] Manager, Technical EngagementBoise, ID USA irc: bd808v:415.839.6885 x6855

[Cloud-announce] [Breaking change] Important for Wikidata tools maintainers: wb_terms table to be dropped at the end of May

schema * Migration will start on 2019-05-29 * A test system will be available starting 2019-05-15 * Details are available in Phabricator [1] [0]: https://lists.wikimedia.org/pipermail/wikidata/2019-April/012987.html [1]: https://phabricator.wikimedia.org/T221764 Bryan -- Bryan Davis

[Cloud-announce] Change to Wikitech logins: Username now case-sensitive

for more details. Bryan, on behalf of the Cloud Services team -- Bryan Davis Wikimedia Foundation [[m:User:BDavis_(WMF)]] Manager, Technical EngagementBoise, ID USA irc: bd808v:415.839.6885 x6855 _

[Cloud-announce] [Toolforge] Trusty job grid has been shutdown

n, on behalf of the Toolforge admin team -- Bryan Davis Wikimedia Foundation [[m:User:BDavis_(WMF)]] Manager, Technical EngagementBoise, ID USA irc: bd808v:415.839.6885 x6855 ___ Wikimedia Cloud Servi

Re: [Cloud-announce] [Toolforge] Ubuntu Trusty job grid will be shutdown Monday 2019-03-25

On Fri, Mar 22, 2019 at 2:38 PM Bryan Davis wrote: > > As previously announced on this list [0][1] we are in the process of > replacing the old Ubuntu Trusty instances in Toolforge with fancy new > Debian Stretch instances. > > This process is reaching its next major milestone o

[Cloud-announce] [Toolforge] Ubuntu Trusty job grid will be shutdown Monday 2019-03-25

Bryan, on behalf of the Toolforge admin team -- Bryan Davis Wikimedia Foundation [[m:User:BDavis_(WMF)]] Manager, Technical EngagementBoise, ID USA irc: bd808v:415.839.6885 x6855 ___ Wikimedi

[Cloud-announce] Toolforge: Bastion changes and Trusty deprecation final steps

H_Fingerprints/tools-dev.wmflabs.org Bryan, on behalf of the Toolforge admin team -- Bryan Davis Wikimedia Foundation [[m:User:BDavis_(WMF)]] Manager, Technical EngagementBoise, ID USA irc: bd808v:415.839.6885 x6855 _

[Cloud-announce] DSA (ssh-dss) SSH keys deprecated for Cloud VPS and Toolforge users

he Wikimedia Cloud Services team -- Bryan Davis Wikimedia Foundation [[m:User:BDavis_(WMF)]] Manager, Technical EngagementBoise, ID USA irc: bd808v:415.839.6885 x6855 ___ Wikimedia Cloud Service

[Cloud-announce] [Toolforge] max_user_connections = 20 set for ToolsDB

/en/library/server-system-variables/#max_user_connections Bryan, on behalf of the Toolforge administration team -- Bryan Davis Wikimedia Foundation [[m:User:BDavis_(WMF)]] Manager, Technical EngagementBoise, ID USA irc: bd808v

[Cloud-announce] Toolforge: Trusty deprecation and grid engine migration

/form/1/?title=Stretch+grid+problem%3A+(your+description)==While+migrating+(my+tool)+to+the+Stretch+job+grid+I+ran+into+this+problem%3A=toolforge%2C+cloud-services-team=triage Bryan -- Bryan Davis Wikimedia Foundation [[m:User:BDavis_(WMF)]] Manager, Technical EngagementBoise, ID

[Cloud-announce] Addshore and Legoktm granted Toolforge admin rights

of PHP to the Toolforge Kubernetes cluster [0]. [0]: https://phabricator.wikimedia.org/T195689 Bryan -- Bryan Davis Wikimedia Foundation [[m:User:BDavis_(WMF)]] Manager, Technical EngagementBoise, ID USA irc: bd808v:415.839.6885 x6855

Re: [Cloud-announce] c1.labsdb (labsdb1001) hardware failure

On Wed, Nov 1, 2017 at 9:42 AM, Bryan Davis <bd...@wikimedia.org> wrote: > TL;DR: > * c1.labsdb (labsdb1001.eqiad.wmnet) is down due to hardware issues > * *.labsdb are pointing to c3.labsdb (labsdb1003.eqiad.wmnet) Manuel (one of our awesome DBAs) was able to get the MySQL serve

[Cloud-announce] c1.labsdb (labsdb1001) hardware failure

g/wiki/Wiki_Replica_c1_and_c3_shutdown Bryan -- Bryan Davis Wikimedia Foundation<bd...@wikimedia.org> [[m:User:BDavis_(WMF)]] Manager, Cloud Services Boise, ID USA irc: bd808v:415.83

[Cloud-announce] Wiki Replica c1.labsdb to be rebooted Monday 2017-10-30 14:30 UTC

step before the complete shutdown of the server on Wednesday 2017-12-13. See <https://wikitech.wikimedia.org/wiki/Wiki_Replica_c1_and_c3_shutdown> for more information. Bryan (on behalf of the Wikimedia Cloud Services and DBA teams) -- Bryan Davis Wikimedia Foundation&l