[Cloud] [Cloud-announce] Re: Horizon weirdness tomorrow

/T374123 On 9/4/24 12:25 PM, Andrew Bogott wrote: tl;dr: Horizon login might be broken and/or look different off and on tomorrow. As part of ongoing gradual work to turn wikitech into an SUL wiki[0], tomorrow we'll be switching Horizon over to use the WMF's single-sign-on platform[

[Cloud-announce] Re: Horizon weirdness tomorrow

/T374123 On 9/4/24 12:25 PM, Andrew Bogott wrote: tl;dr: Horizon login might be broken and/or look different off and on tomorrow. As part of ongoing gradual work to turn wikitech into an SUL wiki[0], tomorrow we'll be switching Horizon over to use the WMF's single-sign-on platform[

[Cloud] [Cloud-announce] Horizon weirdness tomorrow

tl;dr: Horizon login might be broken and/or look different off and on tomorrow. As part of ongoing gradual work to turn wikitech into an SUL wiki[0], tomorrow we'll be switching Horizon over to use the WMF's single-sign-on platform[1]. Here's what to expect: - We probably won't get it right

[Cloud-announce] Horizon weirdness tomorrow

tl;dr: Horizon login might be broken and/or look different off and on tomorrow. As part of ongoing gradual work to turn wikitech into an SUL wiki[0], tomorrow we'll be switching Horizon over to use the WMF's single-sign-on platform[1]. Here's what to expect: - We probably won't get it right

[Cloud] [Cloud-announce] small hardware outage just now affected a few cloud-vps VMs

Just now one of our hypervisors crashed and left several VMs shut down for around 45 minutes. I have rebooted the host and service has been restored. The affected VMs were:  web01  tools-k8s-worker-nfs-55  tools-k8s-worker-nfs-24  toolsbeta-test-k8s-worker-nfs-2  opensearch2  traffic-acmechief

[Cloud-announce] small hardware outage just now affected a few cloud-vps VMs

Just now one of our hypervisors crashed and left several VMs shut down for around 45 minutes. I have rebooted the host and service has been restored. The affected VMs were:  web01  tools-k8s-worker-nfs-55  tools-k8s-worker-nfs-24  toolsbeta-test-k8s-worker-nfs-2  opensearch2  traffic-acmechief

[Cloud] [Cloud-announce] openstack upgrades Thursday, 2024-08-22

I will be upgrading the cloud-vps openstack install on Thursday, beginning around 16:00 UTC. Here's what to expect: - Intermittent Horizon and API downtime (maybe an hour or two total) - Inability to schedule new VMs (also for an hour or two) Toolforge users will be unaffected by this outage.

[Cloud-announce] openstack upgrades Thursday, 2024-08-22

I will be upgrading the cloud-vps openstack install on Thursday, beginning around 16:00 UTC. Here's what to expect: - Intermittent Horizon and API downtime (maybe an hour or two total) - Inability to schedule new VMs (also for an hour or two) Toolforge users will be unaffected by this outage.

[Cloud] [Cloud-announce] Re: New cinder volumes may fail for the next day or two

This maintenance is now done and cloud capacity is back to normal. On 8/13/24 12:43 PM, Andrew Bogott wrote: Due to a serious hardware failure[0] we've had to take much of our file storage cluster offline. This should not affect any existing toolforge or cloud-vps usage, but new file-inte

[Cloud-announce] Re: New cinder volumes may fail for the next day or two

This maintenance is now done and cloud capacity is back to normal. On 8/13/24 12:43 PM, Andrew Bogott wrote: Due to a serious hardware failure[0] we've had to take much of our file storage cluster offline. This should not affect any existing toolforge or cloud-vps usage, but new file-inte

[Cloud] [Cloud-announce] New cinder volumes may fail for the next day or two

Due to a serious hardware failure[0] we've had to take much of our file storage cluster offline. This should not affect any existing toolforge or cloud-vps usage, but new file-intensive work (e.g. creating a big new database or volume) may fail due to lack of space. We hope to have things rest

[Cloud-announce] New cinder volumes may fail for the next day or two

Due to a serious hardware failure[0] we've had to take much of our file storage cluster offline. This should not affect any existing toolforge or cloud-vps usage, but new file-intensive work (e.g. creating a big new database or volume) may fail due to lack of space. We hope to have things rest

[Yahoo-eng-team] [Bug 2076122] [NEW] dns integration: support multiple domains per instance

Public bug reported: Right now the designate/dns integration extension only allows specifying a single domain during resource creation, or a single domain to associate with a network. Ideally this would instead support N domains. For instance, I'd like my newly created VMs to have a dns entry tha

[Cloud] [Cloud-announce] Still using tools-login.wmflabs.org?

If you are a toolforge user and your workflow still relies on tools-login.wmflabs.org, there are a few things to be aware of: 1) Until yesterday, tools-login.wmflabs.org pointed to a login host running Debian10(buster), which is no longer a supported operation system. I adjusted it to point to

[Cloud-announce] Still using tools-login.wmflabs.org?

If you are a toolforge user and your workflow still relies on tools-login.wmflabs.org, there are a few things to be aware of: 1) Until yesterday, tools-login.wmflabs.org pointed to a login host running Debian10(buster), which is no longer a supported operation system. I adjusted it to point to

[Cloud] [Cloud-announce] Re: Brief toolforge build service outage Monday, 2024-07-29 @ 14:00 UTC

This is done. If you were unlucky enough to see a failure during this very short window, try again now and all should be well. -Andrew On 7/23/24 10:00 AM, Andrew Bogott wrote: On Monday I'll be upgrading the database that backs toolforge's Harbor service. Any attempts to do

[Cloud-announce] Re: Brief toolforge build service outage Monday, 2024-07-29 @ 14:00 UTC

This is done. If you were unlucky enough to see a failure during this very short window, try again now and all should be well. -Andrew On 7/23/24 10:00 AM, Andrew Bogott wrote: On Monday I'll be upgrading the database that backs toolforge's Harbor service. Any attempts to do

[Cloud] [Cloud-announce] Re: Trove database upgrades + downtime next week

. -Andrew On 7/16/24 5:49 PM, Andrew Bogott wrote: Next week (starting 2024-07-22) I'll be updating Trove database servers[0] to use more up-to-date VM images and guest agents. This will involve a minute or two of downtime (in the best case) and possibly an hour or more of downtime for troubl

[Cloud-announce] Re: Trove database upgrades + downtime next week

. -Andrew On 7/16/24 5:49 PM, Andrew Bogott wrote: Next week (starting 2024-07-22) I'll be updating Trove database servers[0] to use more up-to-date VM images and guest agents. This will involve a minute or two of downtime (in the best case) and possibly an hour or more of downtime for troubl

[Cloud] [Cloud-announce] Brief toolforge build service outage Monday, 2024-07-29 @ 14:00 UTC

On Monday I'll be upgrading the database that backs toolforge's Harbor service. Any attempts to download new container images during this window will fail. Existing, running tools will not be affected, and periodically scheduled jobs should also be fine, but any brand new jobs may fail, depend

[Cloud-announce] Brief toolforge build service outage Monday, 2024-07-29 @ 14:00 UTC

On Monday I'll be upgrading the database that backs toolforge's Harbor service. Any attempts to download new container images during this window will fail. Existing, running tools will not be affected, and periodically scheduled jobs should also be fine, but any brand new jobs may fail, depend

[Cloud] [Cloud-announce] Please associate your developer account with an SUL account

Many of you have either received or are about to get an email from Komla about connecting your developer account with an SUL account. The action necessary is very simple, just log in to https://idm.wikimedia.org and gill in the Wikimedia Global Account (SUL) field. Please update this field as

[Cloud-announce] Please associate your developer account with an SUL account

Many of you have either received or are about to get an email from Komla about connecting your developer account with an SUL account. The action necessary is very simple, just log in to https://idm.wikimedia.org and gill in the Wikimedia Global Account (SUL) field. Please update this field as

[Cloud] [Cloud-announce] Trove database upgrades + downtime next week

Next week (starting 2024-07-22) I'll be updating Trove database servers[0] to use more up-to-date VM images and guest agents. This will involve a minute or two of downtime (in the best case) and possibly an hour or more of downtime for troublesome (and unpredictable) edge cases. The complete l

[Cloud-announce] Trove database upgrades + downtime next week

Next week (starting 2024-07-22) I'll be updating Trove database servers[0] to use more up-to-date VM images and guest agents. This will involve a minute or two of downtime (in the best case) and possibly an hour or more of downtime for troublesome (and unpredictable) edge cases. The complete l

[Cloud] [Cloud-announce] No Friday plans? Spend your weekend replacing Buster VMs!

Cloud-vps users: There are now a mere two weeks remaining before Debian Buster ends its period of long term support. After June 30th, security upgrades will no longer be available for this release and VMs running Buster will become ever more risky and difficult to maintain. As of today there

[Cloud-announce] No Friday plans? Spend your weekend replacing Buster VMs!

Cloud-vps users: There are now a mere two weeks remaining before Debian Buster ends its period of long term support. After June 30th, security upgrades will no longer be available for this release and VMs running Buster will become ever more risky and difficult to maintain. As of today there

[Wikitech-l] No Friday plans? Spend your weekend replacing Buster VMs!

Cloud-vps users: There are now a mere two weeks remaining before Debian Buster ends its period of long term support. After June 30th, security upgrades will no longer be available for this release and VMs running Buster will become ever more risky and difficult to maintain. As of today there

[Cloud] [Cloud-announce] Re: cloud-vps and toolforge outage in progress -- RESOLVED

a followup email. -Andrew + wmcs team On 6/11/24 10:15 AM, Andrew Bogott wrote: There is as-of-yet undiagnosed issue with our storage system (ceph) which is causing serious failures throughout cloud-vps and toolforge. Multiple people are working on the issue, so watch this list for updates. 

[Cloud-announce] Re: cloud-vps and toolforge outage in progress -- RESOLVED

a followup email. -Andrew + wmcs team On 6/11/24 10:15 AM, Andrew Bogott wrote: There is as-of-yet undiagnosed issue with our storage system (ceph) which is causing serious failures throughout cloud-vps and toolforge. Multiple people are working on the issue, so watch this list for updates. 

[Cloud] [Cloud-announce] cloud-vps and toolforge outage in progress

There is as-of-yet undiagnosed issue with our storage system (ceph) which is causing serious failures throughout cloud-vps and toolforge. Multiple people are working on the issue, so watch this list for updates.  Sorry for the downtime! -Andrew + wmcs team

[Cloud-announce] cloud-vps and toolforge outage in progress

There is as-of-yet undiagnosed issue with our storage system (ceph) which is causing serious failures throughout cloud-vps and toolforge. Multiple people are working on the issue, so watch this list for updates.  Sorry for the downtime! -Andrew + wmcs team

[Cloud] [Cloud-announce] Cloud-vps users: please claim your projects

If you are a user of cloud-vps, please visit the following page and mark any projects that are still in use: https://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge There are currently 95 unmarked projects on that page; any that remain unclaimed will be deemed abandoned and subject to sh

[Cloud-announce] Cloud-vps users: please claim your projects

If you are a user of cloud-vps, please visit the following page and mark any projects that are still in use: https://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge There are currently 95 unmarked projects on that page; any that remain unclaimed will be deemed abandoned and subject to sh

[Wikitech-l] Cloud-vps users: please claim your projects

If you are a user of cloud-vps, please visit the following page and mark any projects that are still in use: https://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge There are currently 95 unmarked projects on that page; any that remain unclaimed will be deemed abandoned and subject to sh

[Cloud] [Cloud-announce] Re: openstack upgrades Thursday, 2024-04-25

This is done. As always, we are interested in hearing about any possible regressions resulting from the upgrade. -Andrew On 4/23/24 10:18 AM, Andrew Bogott wrote: I will be upgrading the cloud-vps openstack install on Thursday, beginning around 16:00 UTC. Here's what to e

[Cloud-announce] Re: openstack upgrades Thursday, 2024-04-25

This is done. As always, we are interested in hearing about any possible regressions resulting from the upgrade. -Andrew On 4/23/24 10:18 AM, Andrew Bogott wrote: I will be upgrading the cloud-vps openstack install on Thursday, beginning around 16:00 UTC. Here's what to e

[Cloud] [Cloud-announce] openstack upgrades Thursday, 2024-04-25

I will be upgrading the cloud-vps openstack install on Thursday, beginning around 16:00 UTC. Here's what to expect: - Intermittent Horizon and API downtime (maybe an hour or two total) - Inability to schedule new VMs (also for an hour or two) Toolforge users will be unaffected by this outage.

[Cloud-announce] openstack upgrades Thursday, 2024-04-25

I will be upgrading the cloud-vps openstack install on Thursday, beginning around 16:00 UTC. Here's what to expect: - Intermittent Horizon and API downtime (maybe an hour or two total) - Inability to schedule new VMs (also for an hour or two) Toolforge users will be unaffected by this outage.

[Cloud] [Cloud-announce] cloud-vps upgrade to puppet 7

TL;DR: If you start to notice new or noisy puppet failures on your VMs, please notify me directly or open a phab ticket and assign it to me (Andrew). == What's happening: Over the last few weeks I've been upgrading cloud-vps puppet servers to newer builds that support the latest version of t

[Cloud-announce] cloud-vps upgrade to puppet 7

TL;DR: If you start to notice new or noisy puppet failures on your VMs, please notify me directly or open a phab ticket and assign it to me (Andrew). == What's happening: Over the last few weeks I've been upgrading cloud-vps puppet servers to newer builds that support the latest version of t

[Cloud] [Cloud-announce] Cloud-vps users: please claim your projects, and start replacing Debian Buster

Hello! In order to conserve resources and prevent bot-net hijacking, cloud-vps users have a few maintenance responsibilities. This spring two of these duties have come due: an easy one and a hard one. Tl;dr: visit https://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge, claim your proje

[Cloud-announce] Cloud-vps users: please claim your projects, and start replacing Debian Buster

Hello! In order to conserve resources and prevent bot-net hijacking, cloud-vps users have a few maintenance responsibilities. This spring two of these duties have come due: an easy one and a hard one. Tl;dr: visit https://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2024_Purge, claim your proje

[Wikimedia-l] Re: We need more interactive content: we are doing it wrong

On 1/26/24 12:05 PM, geni wrote: On Tue, 23 Jan 2024 at 22:24, Ivan Martínez wrote: By not having a Youtube 2.0 we are avoiding a Wikipedia 2.0 with pure encyclopaedic videos. I see a false dilemma there. Creating good encyclopaedic videos is from a video production point of view a far harde

[Cloud] [Cloud-announce] partial Toolforge outage

Toolforge just now suffered a partial grid-engine outage. All grid services should be back to normal as of this email; some k8s services may misbehave for the next hour or two. NFS misbehavior resulted in grid control mechanisms timing out, which meant that no new jobs could be scheduled for t

[Cloud-announce] partial Toolforge outage

Toolforge just now suffered a partial grid-engine outage. All grid services should be back to normal as of this email; some k8s services may misbehave for the next hour or two. NFS misbehavior resulted in grid control mechanisms timing out, which meant that no new jobs could be scheduled for t

[Cloud] [Cloud-announce] Object storage (swift and s3) now available for some projects on Cloud VPS

CloudVPSnow offersobject storage, using both the S3 and the OpenStack Swift APIs. Horizon includes an 'Object store' tab which supports creation of containers and uploading of files. Some basic user documentation can be found on Wikitech[0]. For detailed API documentation, please consult the u

[Cloud-announce] Object storage (swift and s3) now available for some projects on Cloud VPS

CloudVPSnow offersobject storage, using both the S3 and the OpenStack Swift APIs. Horizon includes an 'Object store' tab which supports creation of containers and uploading of files. Some basic user documentation can be found on Wikitech[0]. For detailed API documentation, please consult the u

[Cloud] [Cloud-announce] Re: Updated WMCS terms of use

ses where the law is in conflict with our human rights principles. Thank you for your comments! -Andrew On 5/26/23 8:46 AM, Andrew Bogott wrote: After nearly a decade of mishap and delay, we have updated the WMCS terms of use. The updated document for toolforge and cloud-vps admins can be

[Cloud-announce] Re: Updated WMCS terms of use

ses where the law is in conflict with our human rights principles. Thank you for your comments! -Andrew On 5/26/23 8:46 AM, Andrew Bogott wrote: After nearly a decade of mishap and delay, we have updated the WMCS terms of use. The updated document for toolforge and cloud-vps admins can be

[Cloud] [Cloud-announce] Brief toolsdb outage just now, 2023-08-15 at 23:10 UTC

Just now the toolsdb database server ran out of memory and died[0] -- it took us a few minutes to get things rolling again but all service should be restored. The service first went down Aug 15 23:09:12; RO only service was restored about 45 minutes later and RW service shortly after that. P

[Cloud-announce] Brief toolsdb outage just now, 2023-08-15 at 23:10 UTC

Just now the toolsdb database server ran out of memory and died[0] -- it took us a few minutes to get things rolling again but all service should be restored. The service first went down Aug 15 23:09:12; RO only service was restored about 45 minutes later and RW service shortly after that. P

[ceph-users] Re: radosgw + keystone breaks when projects have - in their names

64585 On 7/10/23 2:59 PM, Andrew Bogott wrote: I'm in the process of adding the radosgw service to our OpenStack cloud and hoping to re-use keystone for discovery and auth. Things seem to work fine with many keystone tenants, but as soon as we try to do something in a project with a '

[ceph-users] radosgw + keystone breaks when projects have - in their names

I'm in the process of adding the radosgw service to our OpenStack cloud and hoping to re-use keystone for discovery and auth. Things seem to work fine with many keystone tenants, but as soon as we try to do something in a project with a '-' in its name everything fails. Here's an example, usin

[Cloud] [Cloud-announce] Debian 12.0 Bookworm now available on cloud-vps

The latest Debian release was finalized on Saturday[0] and today the Debian cloud team released their first post-release daily[1]. I've built a base image customized for WMCS cloud-vps and it is now available for all projects. Please give it a try and report any surprises that you run into. On

[Cloud-announce] Debian 12.0 Bookworm now available on cloud-vps

The latest Debian release was finalized on Saturday[0] and today the Debian cloud team released their first post-release daily[1]. I've built a base image customized for WMCS cloud-vps and it is now available for all projects. Please give it a try and report any surprises that you run into. On

[Cloud] Re: [Cloud-announce] Updated WMCS terms of use

top should also make clear that developer email addresses are public to the Internet, not merely to other WMCS users (for example, at <https://ldap.toolforge.org/user/anticomposite>). The overall layout of the Terms is also confusing, with very short sections referring to other v

[Cloud] [Cloud-announce] Updated WMCS terms of use

After nearly a decade of mishap and delay, we have updated the WMCS terms of use. The updated document for toolforge and cloud-vps admins can be found here: https://wikitech.wikimedia.org/wiki/Wikitech:Cloud_Services_Terms_of_use and the terms of use for visitors to WMCS sites can be found he

[Cloud-announce] Updated WMCS terms of use

After nearly a decade of mishap and delay, we have updated the WMCS terms of use. The updated document for toolforge and cloud-vps admins can be found here: https://wikitech.wikimedia.org/wiki/Wikitech:Cloud_Services_Terms_of_use and the terms of use for visitors to WMCS sites can be found he

[Cloud] [Cloud-announce] (Another) toolforge outage coming Thursday

On Thursday we will be migrating most toolforge databases to a new server. Thiswill take place on Thursday at 17:00UTC. During this window ToolsDBwill be read-only and most tools that rely on writing to the database will fail. This migration should take about an hour but unexpected side-effect

[Cloud-announce] (Another) toolforge outage coming Thursday

On Thursday we will be migrating most toolforge databases to a new server. Thiswill take place on Thursday at 17:00UTC. During this window ToolsDBwill be read-only and most tools that rely on writing to the database will fail. This migration should take about an hour but unexpected side-effect

[Wikitech-l] (Another) toolforge outage coming Thursday

On Thursday we will be migrating most toolforge databases to a new server. Thiswill take place on Thursday at 17:00UTC. During this window ToolsDBwill be read-only and most tools that rely on writing to the database will fail. This migration should take about an hour but unexpected side-effect

[Cloud] [Cloud-announce] Re: Two toolforge outages coming next week, Monday and Thursday

s are still not running properly after an hour or two then a simple restart should get things back to normal. Thank you for your patience with this long outage. And remember, a database outage is coming up later in the week! -Andrew On 4/2/23 6:24 PM, Andrew Bogott wrote: Reminder:  The

[Cloud-announce] Re: Two toolforge outages coming next week, Monday and Thursday

s are still not running properly after an hour or two then a simple restart should get things back to normal. Thank you for your patience with this long outage. And remember, a database outage is coming up later in the week! -Andrew On 4/2/23 6:24 PM, Andrew Bogott wrote: Reminder:  The

[Cloud] [Cloud-announce] Re: Two toolforge outages coming next week, Monday and Thursday

Reminder:  The first of these outages will start in about 30 minutes. Toolforge NFS will be read-only for as long as 18-19 hours. On 3/29/23 2:17 PM, Andrew Bogott wrote: There will be two major Toolforge outages this coming week. Each outage will cause tool downtime and may require manual

[Cloud-announce] Re: Two toolforge outages coming next week, Monday and Thursday

Reminder:  The first of these outages will start in about 30 minutes. Toolforge NFS will be read-only for as long as 18-19 hours. On 3/29/23 2:17 PM, Andrew Bogott wrote: There will be two major Toolforge outages this coming week. Each outage will cause tool downtime and may require manual

[Cloud] Re: [Cloud-announce] Toolforge Kubernetes upgrade on 2023-04-03 (new date: 2023-04-10)

On 3/30/23 8:24 AM, Roy Smith wrote: Just to make sure I'm clear, the downtime announced yesterday  is still happening? That's correct, the upcoming downtimes are still happ

[Cloud-announce] Re: [Cloud] Re: Toolforge Kubernetes upgrade on 2023-04-03 (new date: 2023-04-10)

On 3/30/23 8:24 AM, Roy Smith wrote: Just to make sure I'm clear, the downtime announced yesterday  is still happening? That's correct, the upcoming downtimes are still happ

[Cloud] [Cloud-announce] Two toolforge outages coming next week, Monday and Thursday

There will be two major Toolforge outages this coming week. Each outage will cause tool downtime and may require manual restarts afterwards. The first outage is an NFS migration [0] and will take place on Monday, beginning at around 0:00 UTC and lasting well into the day, possibly as late as 1

[Cloud-announce] Two toolforge outages coming next week, Monday and Thursday

There will be two major Toolforge outages this coming week. Each outage will cause tool downtime and may require manual restarts afterwards. The first outage is an NFS migration [0] and will take place on Monday, beginning at around 0:00 UTC and lasting well into the day, possibly as late as 1

[Cloud] [Cloud-announce] Re: partial wmcs outage tomorrow, 2022-03-28 between 14:00 and 16:00 UTC DONE

This maintenance is now complete, services should be back to normal. On 3/27/23 9:15 AM, Andrew Bogott wrote: Due to unavoidable network switch maintenance[0], some WMCS services will be offline briefly tomorrow. The downtime will last for 20-30 minutes and take place sometime between 14:00

[Cloud-announce] Re: partial wmcs outage tomorrow, 2022-03-28 between 14:00 and 16:00 UTC DONE

This maintenance is now complete, services should be back to normal. On 3/27/23 9:15 AM, Andrew Bogott wrote: Due to unavoidable network switch maintenance[0], some WMCS services will be offline briefly tomorrow. The downtime will last for 20-30 minutes and take place sometime between 14:00

[Cloud] [Cloud-announce] partial wmcs outage tomorrow, 2022-03-28 between 14:00 and 16:00 UTC

Due to unavoidable network switch maintenance[0], some WMCS services will be offline briefly tomorrow. The downtime will last for 20-30 minutes and take place sometime between 14:00 and 16:00 UTC. Here is what to expect during the downtime: * *Toolsdb will be unavailable and all queries will

[Cloud-announce] partial wmcs outage tomorrow, 2022-03-28 between 14:00 and 16:00 UTC

Due to unavoidable network switch maintenance[0], some WMCS services will be offline briefly tomorrow. The downtime will last for 20-30 minutes and take place sometime between 14:00 and 16:00 UTC. Here is what to expect during the downtime: * *Toolsdb will be unavailable and all queries will

[Cloud] Re: [Cloud-announce] Re: Cloud VPS users, please claim your projects

- but searching through my email I never did. I'm so sad for my work, but mainly for the community users that relied on humaniki.wmcloud.org <http://humaniki.wmcloud.org>. Make a great day, Max Klein ‽ http://notconfusing.com/ On Thu, 12 Jan 2023 at 08:13, Andrew Bogott wrote:

[Cloud] [Cloud-announce] role renames in cloud-vps

I am in the process of standardizing[0] the role names in WMCS cloud-vps to conform with upstream conventions[1]. That requires me to rename two existing user roles, 'user' and 'projectadmin': - The role previously called 'user' will now be called 'reader' - The role previously called 'project

[Cloud-announce] role renames in cloud-vps

I am in the process of standardizing[0] the role names in WMCS cloud-vps to conform with upstream conventions[1]. That requires me to rename two existing user roles, 'user' and 'projectadmin': - The role previously called 'user' will now be called 'reader' - The role previously called 'project

[Cloud] [Cloud-announce] Re: cloud-vps outage (RESOLVED)

vior. Toolforge should be back to normal. PAWS is still complaining but we hope to have it stabilized shortly. Please follow up here or on IRC if you encounter unexpected issues. -Andrew On 2/13/23 10:55 AM, Andrew Bogott wrote: We are having some very concerning instability with the cloud-v

[Cloud-announce] Re: cloud-vps outage (RESOLVED)

vior. Toolforge should be back to normal. PAWS is still complaining but we hope to have it stabilized shortly. Please follow up here or on IRC if you encounter unexpected issues. -Andrew On 2/13/23 10:55 AM, Andrew Bogott wrote: We are having some very concerning instability with the cloud-v

[Cloud] [Cloud-announce] cloud-vps outage

We are having some very concerning instability with the cloud-vps file system. Out of an abundance of caution I have shut off EVERYTHING in cloud-vps to prevent rampant data corruption. I don't expect this outage to last long but will notify when things start up again. Very sorry for the downt

[Cloud-announce] cloud-vps outage

We are having some very concerning instability with the cloud-vps file system. Out of an abundance of caution I have shut off EVERYTHING in cloud-vps to prevent rampant data corruption. I don't expect this outage to last long but will notify when things start up again. Very sorry for the downt

[Cloud] [Cloud-announce] OpenStreetMaps database (osmdb.eqiad.wmnet) is going away

Thanks largely to dschwen's hard work, we are about to move the long-neglected postgres osmdb to a volunteer-managed project. Most workloads have already moved to the new service. As far as anyone can tell there is only a single tool still hitting osmdb.eqiad.wmnet. Later in the week, that too

[Cloud-announce] OpenStreetMaps database (osmdb.eqiad.wmnet) is going away

Thanks largely to dschwen's hard work, we are about to move the long-neglected postgres osmdb to a volunteer-managed project. Most workloads have already moved to the new service. As far as anyone can tell there is only a single tool still hitting osmdb.eqiad.wmnet. Later in the week, that too

[Cloud] [Cloud-announce] Upcoming shutdown of osmdb.eqiad.wmnet

The hardware that hosts osmdb.eqiad.wmnet is long past its end of life and will be shut down on February 12th. WMF staff do not plan to support that database after that date, and the domain will be shut down. I am pretty sure that we have already made arrangements with all current users of the

[Wikitech-l] Upcoming shutdown of osmdb.eqiad.wmnet

The hardware that hosts osmdb.eqiad.wmnet is long past its end of life and will be shut down on February 12th. WMF staff do not plan to support that database after that date, and the domain will be shut down. I am pretty sure that we have already made arrangements with all current users of the

[Cloud-announce] Upcoming shutdown of osmdb.eqiad.wmnet

The hardware that hosts osmdb.eqiad.wmnet is long past its end of life and will be shut down on February 12th. WMF staff do not plan to support that database after that date, and the domain will be shut down. I am pretty sure that we have already made arrangements with all current users of the

[Cloud] [Cloud-announce] Re: cloud-vps openstack upgrades Tuesday, 2023-01-17

I have a few pieces of this left to do, but Horizon is re-enabled and everything should be working as expected. -Andrew On 1/13/23 3:14 PM, Andrew Bogott wrote: I will be upgrading the cloud-vps openstack install on Tuesday, beginning around 17:00 UTC. Horizon will be disabled during the

[Cloud-announce] Re: cloud-vps openstack upgrades Tuesday, 2023-01-17

I have a few pieces of this left to do, but Horizon is re-enabled and everything should be working as expected. -Andrew On 1/13/23 3:14 PM, Andrew Bogott wrote: I will be upgrading the cloud-vps openstack install on Tuesday, beginning around 17:00 UTC. Horizon will be disabled during the

[Cloud] [Cloud-announce] cloud-vps openstack upgrades Tuesday, 2023-01-17

I will be upgrading the cloud-vps openstack install on Tuesday, beginning around 17:00 UTC. Horizon will be disabled during the upgrade, which should take about an hour. Toolforge users will be unaffected by this outage. Existing, running services and VMs on cloud-vps should also be unaffected

[Cloud-announce] cloud-vps openstack upgrades Tuesday, 2023-01-17

I will be upgrading the cloud-vps openstack install on Tuesday, beginning around 17:00 UTC. Horizon will be disabled during the upgrade, which should take about an hour. Toolforge users will be unaffected by this outage. Existing, running services and VMs on cloud-vps should also be unaffected

[Cloud] [Cloud-announce] Re: Cloud VPS users, please claim your projects

Thank you to all of you who have marked your projects. We're now down to 48 candidates for deletion, listed below. Please look again and mark projects which you are using. Komla will we follow up individually on unclaimed projects but let's try to keep his workload under control! baserow ca

[Cloud-announce] Re: Cloud VPS users, please claim your projects

Thank you to all of you who have marked your projects. We're now down to 48 candidates for deletion, listed below. Please look again and mark projects which you are using. Komla will we follow up individually on unclaimed projects but let's try to keep his workload under control! baserow ca

[Wikitech-l] Re: Cloud VPS users, please claim your projects

Thank you to all of you who have marked your projects. We're now down to 48 candidates for deletion, listed below. Please look again and mark projects which you are using. Komla will we follow up individually on unclaimed projects but let's try to keep his workload under control! baserow ca

[Cloud] [Cloud-announce] Re: Cloud VPS users, please claim your projects

Happy new year! There are still 86 unclaimed cloud-vps projects in danger of shutdown come February. Please take a moment to review this page and mark any projects that you are using: https://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge Here's the complete list of unmarked projects:

[Wikitech-l] Re: Cloud VPS users, please claim your projects

Happy new year! There are still 86 unclaimed cloud-vps projects in danger of shutdown come February. Please take a moment to review this page and mark any projects that you are using: https://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge Here's the complete list of unmarked projects:

[Cloud-announce] Re: Cloud VPS users, please claim your projects

Happy new year! There are still 86 unclaimed cloud-vps projects in danger of shutdown come February. Please take a moment to review this page and mark any projects that you are using: https://wikitech.wikimedia.org/wiki/News/Cloud_VPS_2022_Purge Here's the complete list of unmarked projects:

[Cloud] [Cloud-announce] Cloud VPS users, please claim your projects

Hello cloud-vps users! It's time for our annual cleanup of unused projects and resources. Every year or so the Cloud Services team tries to identify and clean up unused projects and VMs.  We do this via an opt-in process: anyone can mark a project as 'in use,' and that project will be preserve

[Wikitech-l] Cloud VPS users, please claim your projects

Hello cloud-vps users! It's time for our annual cleanup of unused projects and resources. Every year or so the Cloud Services team tries to identify and clean up unused projects and VMs.  We do this via an opt-in process: anyone can mark a project as 'in use,' and that project will be preserve

[Cloud-announce] Cloud VPS users, please claim your projects

Hello cloud-vps users! It's time for our annual cleanup of unused projects and resources. Every year or so the Cloud Services team tries to identify and clean up unused projects and VMs.  We do this via an opt-in process: anyone can mark a project as 'in use,' and that project will be preserve

[Cloud] [Cloud-announce] Limited WMCS staff availability 2022-12-22 through 2023-01-03

Due to Foundation holidays + personal time off, WMCS staff will be hard to reach during the end of December and beginning of January. We /may/ be reachable during serious outages or emergencies, but I recommend a light touch on any existing, working projects. For those of you who also have tim

  1   2   3   4   5   6   7   8   9   10   >