[Cloud] Re: How to run golang jobs with Toolforge Build Service?

2024-04-30 Thread Bryan Davis
This can be useful in debugging things. We have another task in the backlog about making this shell functionality a bit more discoverable now that we also have need for it with the jobs framework (<https://phabricator.wikimedia.org/T311917>). I hope that all helps a bit. It is frustrating to b

[Cloud] [Cloud-announce] [Toolforge][GRID SHUTDOWN] Toolforge Grid Engine has been shutdown

2024-03-14 Thread Bryan Davis
#Timeline [3]: https://techblog.wikimedia.org/2022/03/14/toolforge-and-grid-engine/ [4]: https://lists.wikimedia.org/pipermail/labs-l/2015-August/003955.html Bryan, on behalf of the Toolforge administrators -- Bryan DavisWikimedia Foundation Principal

[Cloud-announce] [Toolforge][GRID SHUTDOWN] Toolforge Grid Engine has been shutdown

2024-03-14 Thread Bryan Davis
#Timeline [3]: https://techblog.wikimedia.org/2022/03/14/toolforge-and-grid-engine/ [4]: https://lists.wikimedia.org/pipermail/labs-l/2015-August/003955.html Bryan, on behalf of the Toolforge administrators -- Bryan DavisWikimedia Foundation Principal

[Cloud] [Cloud-announce] ORES API endpoints deprecated; Lift Wing API endpoints available as replacement

2023-08-03 Thread Bryan Davis
with the process [1]. [0]: https://lists.wikimedia.org/hyperkitty/list/wikitec...@lists.wikimedia.org/thread/EK65B7QCQHEG37C2ERPIUSP64OX3ZEUJ/ [1]: https://wikitech.wikimedia.org/wiki/ORES Bryan -- Bryan Davis Technical Engagement Wikimedia Foundation Principal Software Engineer

[Cloud-announce] ORES API endpoints deprecated; Lift Wing API endpoints available as replacement

2023-08-03 Thread Bryan Davis
with the process [1]. [0]: https://lists.wikimedia.org/hyperkitty/list/wikitec...@lists.wikimedia.org/thread/EK65B7QCQHEG37C2ERPIUSP64OX3ZEUJ/ [1]: https://wikitech.wikimedia.org/wiki/ORES Bryan -- Bryan Davis Technical Engagement Wikimedia Foundation Principal Software Engineer

[Cloud] Re: Rotating logs on Toolforge

2023-07-20 Thread Bryan Davis
xploratory testing, or even plan and execute a complete deployment of a solution. [0]: https://phabricator.wikimedia.org/T152235 [1]: https://phabricator.wikimedia.org/T97861 [2]: https://phabricator.wikimedia.org/T127367 [3]: https://phabricator.wikimedia.org/T50846 Bryan -- Bryan Davis

[Cloud] Re: Migrating to a newer VPS image?

2023-01-03 Thread Bryan Davis
s it host-specific? Copy it over. You would have copied it from a Toolforge tool originally as we do not have a mechanism for creating database credentials for Cloud VPS projects/instances. Bryan -- Bryan Davis Technical Engagement Wikimedia Foundation Principal

[Cloud] [Cloud-announce] [Toolforge] Self-service tool deletion finally arrives!

2022-10-31 Thread Bryan Davis
tor.wikimedia.org/T133777 [1]: https://phabricator.wikimedia.org/T170355 [2]: https://phabricator.wikimedia.org/T285403 [3]: https://gerrit.wikimedia.org/r/plugins/gitiles/cloud/toolforge/disable-tool/ [[WP:BOLD]]: https://en.wikipedia.org/wiki/Wikipedia:Be_bold Bryan, on behalf of the Toolforge

[Cloud-announce] [Toolforge] Self-service tool deletion finally arrives!

2022-10-31 Thread Bryan Davis
tor.wikimedia.org/T133777 [1]: https://phabricator.wikimedia.org/T170355 [2]: https://phabricator.wikimedia.org/T285403 [3]: https://gerrit.wikimedia.org/r/plugins/gitiles/cloud/toolforge/disable-tool/ [[WP:BOLD]]: https://en.wikipedia.org/wiki/Wikipedia:Be_bold Bryan, on behalf of the Toolforge

[Cloud] Re: WMCS team work transparency (was: New servers don't show up on grafana-labs.wikimedia.org)

2022-10-07 Thread Bryan Davis
so that interested parties could see the discussions that were held here. Bryan -- Bryan Davis Technical Engagement Wikimedia Foundation Principal Software Engineer Boise, ID USA [[m:User:BDavis_(WMF)]]

[Cloud] Re: WMCS team work transparency (was: New servers don't show up on grafana-labs.wikimedia.org)

2022-10-06 Thread Bryan Davis
dia.org/T310435#8288848 [1]: https://gerrit.wikimedia.org/r/c/operations/docker-images/toollabs-images/+/488764 Bryan -- Bryan Davis Technical Engagement Wikimedia Foundation Principal Software Engineer Boise, ID USA [[m:User:BDavis_(WMF)]]

[Cloud] Re: New servers don't show up on grafana-labs.wikimedia.org

2022-10-05 Thread Bryan Davis
has time and motivation, but currently there is no timeline for completion. Bryan -- Bryan Davis Technical Engagement Wikimedia Foundation Principal Software Engineer Boise, ID USA [[m:User:BDavis_(WMF)]] irc:

[Cloud] [Cloud-announce] Re: [Toolforge] Moving git repos from Diffusion to GitLab starting 2022-09-06

2022-09-07 Thread Bryan Davis
On Tue, Sep 6, 2022 at 4:38 PM Bryan Davis wrote: > > On Thu, Sep 1, 2022 at 4:26 PM Bryan Davis wrote: > > > > What: Diffusion git hosting moving to GitLab [0][1] > > When: Tuesday 2022-09-06 between 15:00 - 23:00 UTC > > Why: Unblocking sunsetting work

[Cloud-announce] Re: [Toolforge] Moving git repos from Diffusion to GitLab starting 2022-09-06

2022-09-07 Thread Bryan Davis
On Tue, Sep 6, 2022 at 4:38 PM Bryan Davis wrote: > > On Thu, Sep 1, 2022 at 4:26 PM Bryan Davis wrote: > > > > What: Diffusion git hosting moving to GitLab [0][1] > > When: Tuesday 2022-09-06 between 15:00 - 23:00 UTC > > Why: Unblocking sunsetting work

[Cloud] [Cloud-announce] Re: [Toolforge] Moving git repos from Diffusion to GitLab starting 2022-09-06

2022-09-06 Thread Bryan Davis
On Thu, Sep 1, 2022 at 4:26 PM Bryan Davis wrote: > > What: Diffusion git hosting moving to GitLab [0][1] > When: Tuesday 2022-09-06 between 15:00 - 23:00 UTC > Why: Unblocking sunsetting work for Differential/Diffusion [2] > > What you can do: If you have not l

[Cloud-announce] Re: [Toolforge] Moving git repos from Diffusion to GitLab starting 2022-09-06

2022-09-06 Thread Bryan Davis
On Thu, Sep 1, 2022 at 4:26 PM Bryan Davis wrote: > > What: Diffusion git hosting moving to GitLab [0][1] > When: Tuesday 2022-09-06 between 15:00 - 23:00 UTC > Why: Unblocking sunsetting work for Differential/Diffusion [2] > > What you can do: If you have not l

[Cloud] Re: [Cloud-announce] [Toolforge] Moving git repos from Diffusion to GitLab starting 2022-09-06

2022-09-06 Thread Bryan Davis
.wikimedia.org/T305984#8210132 Bryan -- Bryan Davis Technical Engagement Wikimedia Foundation Principal Software Engineer Boise, ID USA [[m:User:BDavis_(WMF)]] irc: bd808 __

[Cloud] [Cloud-announce] [Toolforge] Moving git repos from Diffusion to GitLab starting 2022-09-06

2022-09-01 Thread Bryan Davis
in order to grant you access [3]. [0]: https://phabricator.wikimedia.org/T296893 [1]: https://phabricator.wikimedia.org/T315706 [2]: https://phabricator.wikimedia.org/T191182 [3]: https://phabricator.wikimedia.org/T313366#8203450 Bryan, on behalf of the Toolforge administrato

[Cloud-announce] [Toolforge] Moving git repos from Diffusion to GitLab starting 2022-09-06

2022-09-01 Thread Bryan Davis
in order to grant you access [3]. [0]: https://phabricator.wikimedia.org/T296893 [1]: https://phabricator.wikimedia.org/T315706 [2]: https://phabricator.wikimedia.org/T191182 [3]: https://phabricator.wikimedia.org/T313366#8203450 Bryan, on behalf of the Toolforge administrato

[Cloud] [Cloud-announce] [Toolforge] Toolforge tool maintainers are eligible to vote in current Board election

2022-08-23 Thread Bryan Davis
https://phabricator.wikimedia.org/T309754 Bryan -- Bryan Davis Technical Engagement Wikimedia Foundation Principal Software Engineer Boise, ID USA [[m:User:BDavis_(WMF)]] irc: bd808 ___

[Cloud-announce] [Toolforge] Toolforge tool maintainers are eligible to vote in current Board election

2022-08-23 Thread Bryan Davis
https://phabricator.wikimedia.org/T309754 Bryan -- Bryan Davis Technical Engagement Wikimedia Foundation Principal Software Engineer Boise, ID USA [[m:User:BDavis_(WMF)]] irc: bd808 ___

[Cloud] Re: New Toolforge admin: LucasWerkmeister

2022-08-22 Thread Bryan Davis
[1] https://phabricator.wikimedia.org/T314527 > > > > -- Legoktm [2]: https://wikitech.wikimedia.org/wiki/Help:Access_policies#Application_Process Bryan -- Bryan Davis Technical Engagement Wikimedia Foundation Principal Software Engineer

[Cloud] Re: Login notifications for bot account running on Toolforge

2022-02-16 Thread Bryan Davis
expect my account to connect from this range of IPs", but maybe someone else knows a trick? Bryan -- Bryan Davis Technical Engagement Wikimedia Foundation Principal Software Engineer Boise, ID USA [[m:User:BDavis_(WMF)]]

[Cloud] Re: How many kubernetes jobs is too many?

2022-01-10 Thread Bryan Davis
mp processing jobs it would almost certainly lead to resource starvation across the entirety of the Toolforge Kubernetes cluster and make many sad SREs. Bryan -- Bryan Davis Technical Engagement Wikimedia Foundation Principal Software Engineer

[Cloud] [Cloud-announce] [Toolforge] Some tools broken by upstream Let's Encrypt certificate changes

2021-09-30 Thread Bryan Davis
stions + grid engine failing. We do not yet have a fix for this. It will require us to compile and install a newer version of mono for everyone who is using it. Interested folks can follow progress of our infrastructure updates in response to this issue at T291387 [3]. [0]: https://letsencrypt.org/ [1]: http

[Cloud-announce] [Toolforge] Some tools broken by upstream Let's Encrypt certificate changes

2021-09-30 Thread Bryan Davis
stions + grid engine failing. We do not yet have a fix for this. It will require us to compile and install a newer version of mono for everyone who is using it. Interested folks can follow progress of our infrastructure updates in response to this issue at T291387 [3]. [0]: https://letsencrypt.org/ [1]: http

[Cloud] Re: Validating multiple usernames?

2021-09-05 Thread Bryan Davis
cludes/user/UserNameUtils.php#L244-L317 [1]: https://github.com/wikimedia/mediawiki/blob/02f7392231ef40a0f928fbd5ec791effc24361ff/includes/title/MediaWikiTitleCodec.php#L333-L579 [2]: https://github.com/wikimedia/mediawiki/blob/02f7392231ef40a0f928fbd5ec791effc24361ff/includes/api

[Cloud] Re: Validating multiple usernames?

2021-08-19 Thread Bryan Davis
chcomplete": true, "query": { "users": [ { "name": "Bryan Davis", "missing": true }, { "userid&q

[Cloud-announce] Re: #wikimedia-cloud IRC channel available on libera.chat

2021-05-26 Thread Bryan Davis
On Thu, May 20, 2021 at 2:59 PM Bryan Davis wrote: > > TL;DR: > * The #wikimedia-cloud IRC channel is moving from Freenode to Libera.Chat. > * Register an account on Libera.Chat and join us there! > > [...snip...] > > A new #wikimedia-cloud channel has been cr

[Cloud] [Cloud-announce] #wikimedia-cloud IRC channel available on libera.chat

2021-05-20 Thread Bryan Davis
/Migrating_to_Libera_Chat [6]: https://phabricator.wikimedia.org/T283247 [7]: https://www.mediawiki.org/wiki/Wikimedia_Hackathon_2021 Bryan, on behalf of the WMCS team and the Cloud VPS and Toolforge admins -- Bryan Davis Technical Engagement Wikimedia Foundation Principal Software Engineer

[Cloud] Re: Porting the output of qstat to a web page

2021-05-11 Thread Bryan Davis
not done it for a single tool, but I did it for all tools: * https://sge-status.toolforge.org/ * https://sge-jobs.toolforge.org/ The source for both are linked from their page footers. You can fetch the current grid job status as json too via https://sge-status.toolforge.org/api/v1/ Brya

Re: [Cloud] Help with a MediaWiki instance on WMCloud - spammers

2021-04-25 Thread Bryan Davis
Your `$wgOAuthRedirectUri` should use the https protocol, but I don't think this is you root problem. https://annotation.wmcloud.org/w/index.php?title=Special:PluggableAuthLogin says "No such special page" and https://annotation.wmcloud.org/wiki/Special:Version shows no extension

Re: [Cloud] Help with a MediaWiki instance on WMCloud - spammers

2021-04-23 Thread Bryan Davis
a role::wsoauth::oauth_key "the key for the new grant" $ vagrant hiera role::wsoauth::oauth_secret "the secret for the new grant" $ vagrant provision Bryan -- Bryan Davis Technical Engagement Wikimedia Foundation Principal Software Engineer

Re: [Cloud] Help with a MediaWiki instance on WMCloud - spammers

2021-04-23 Thread Bryan Davis
et process that is executed by `vagrant up` and `vagrant provision`. Bryan -- Bryan Davis Technical Engagement Wikimedia Foundation Principal Software Engineer Boise, ID USA [[m:User:BDavis_(WMF)]]

Re: [Cloud] Help with a MediaWiki instance on WMCloud - spammers

2021-04-21 Thread Bryan Davis
he has setup https://wikispore.wmflabs.org/wiki/Main_Page with OAuth for account registration. I have a hunch that is also possible by adding the correct mw-vagrant role and settings. Bryan -- Bryan Davis Technical Engagement Wikimedia Foundation Principal Software Engineer

[Cloud] [Cloud-announce] [Toolforge] Outbound emails were stuck from 2021-03-31T14:56Z to 2021-04-20T21:52Z

2021-04-20 Thread Bryan Davis
to catch problems similar to this more quickly in the future. Bryan, on behalf of the Toolforge admin team -- Bryan Davis Technical Engagement Wikimedia Foundation Principal Software Engineer Boise, ID USA [[m:User:BDavis_(WMF)]]

[Cloud-announce] [Toolforge] Outbound emails were stuck from 2021-03-31T14:56Z to 2021-04-20T21:52Z

2021-04-20 Thread Bryan Davis
to catch problems similar to this more quickly in the future. Bryan, on behalf of the Toolforge admin team -- Bryan Davis Technical Engagement Wikimedia Foundation Principal Software Engineer Boise, ID USA [[m:User:BDavis_(WMF)]]

Re: [Cloud] Problem on linking Wikimedia account and LDAP account

2021-03-05 Thread Bryan Davis
using Striker on 2020-12-29 10:12:12 UTC. That Developer account has never been "attached" on Wikitech, meaning that the account has never logged in there, so it will show as unregistered on Wikitech. It is using the same email address as the [[User:KirkLU]] Developer account which was created

Re: [Cloud] Removing myself from Horizon projects

2021-02-18 Thread Bryan Davis
.wikimedia.org/tools/id/sonarqubebot tool there. Removing membership in the project would effectively also remove your maintainer access for this tool. Bryan -- Bryan Davis Technical Engagement Wikimedia Foundation Principal Software Engine

Re: [Cloud] X_REQUEST_ID?

2021-02-16 Thread Bryan Davis
when an existing header is not found in the inbound request as it traverses the ingress. Brooke tracked down <https://github.com/kubernetes/ingress-nginx/issues/2546> upstream as a documented way that we could disable this default behavior if desired by the community or the Toolforge

[Cloud] [Cloud-announce] [Cloud VPS] TLS encryption fully enforced for *.wmflabs.org & *.wmcloud.org

2021-02-02 Thread Bryan Davis
On Tue, Aug 18, 2020 at 9:03 AM Bryan Davis wrote: > > TL;DR: > * HTTP -> HTTPS redirection is live (finally!) > * Currently allowing a "POST loophole" > * "POST loophole" will be closed on 2021-02-01 > > Today we merged a small change [0] to the

[Cloud-announce] [Cloud VPS] TLS encryption fully enforced for *.wmflabs.org & *.wmcloud.org

2021-02-02 Thread Bryan Davis
On Tue, Aug 18, 2020 at 9:03 AM Bryan Davis wrote: > > TL;DR: > * HTTP -> HTTPS redirection is live (finally!) > * Currently allowing a "POST loophole" > * "POST loophole" will be closed on 2021-02-01 > > Today we merged a small change [0] to the

Re: [Cloud] URL length limit for toolforge?

2020-12-16 Thread Bryan Davis
onse. The uwsgi log shows "generated 12347121 bytes in 111280 msecs". With the larger uwsgi buffer setting, the original long url with an unauthenticated session works as well. I do not have an explanation for why the buffer overflow message was not logged for your tests or my first

Re: [Cloud] password for thanos?

2020-12-15 Thread Bryan Davis
e extended backlog with wishes that folks have made about such things. <https://phabricator.wikimedia.org/T194333> is one that has some really high level ideas on it and some more concrete subtasks. Bryan -- Bryan Davis Technical Engagement Wikimedia Foundation Pri

Re: [Cloud] password for thanos?

2020-12-15 Thread Bryan Davis
gone through the https://wikitech.wikimedia.org/wiki/Volunteer_NDA process. Bryan -- Bryan Davis Technical Engagement Wikimedia Foundation Principal Software Engineer Boise, ID USA [[m:User:BDavis_(WMF)]]

Re: [Cloud] Url redirect

2020-10-20 Thread Bryan Davis
m; to a list, and through with Cname > record + DNS server. It is not essential, but as I bought the domain a few > months ago... No, Toolforge does not currently have any native system for using vanity domain names. Bryan -- Bryan Davis Technical Engagement Wikime

Re: [Cloud] Python3.7

2020-10-07 Thread Bryan Davis
On Wed, Oct 7, 2020 at 4:16 PM Roy Smith wrote: > > > On Oct 7, 2020, at 4:04 PM, Bryan Davis wrote: > > > > Use a `webservice python3.7 shell` session as your dev/test > > environment and you will a) get the same python version as the > > "production

Re: [Cloud] Python3.7

2020-10-07 Thread Bryan Davis
to first enter a python3.7 container running on the Kubernetes cluster. This can be done using the `webservice python3.7 shell` command. See <https://wikitech.wikimedia.org/wiki/Help:Toolforge/Web/Python#Virtual_Environments_and_Packages> for related information. Bryan -- Bryan Davis

Re: [Cloud] Procfile

2020-10-02 Thread Bryan Davis
r webservice. There is however currently no Toolforge provided tooling to manage the state of that Deployment in conjunction with your webservice. Bryan -- Bryan Davis Technical Engagement Wikimedia Foundation Principal Software Engineer

[Cloud] [Cloud-announce] Clarification: database service names still use eqiad.wmflabs, not eqiad1.wikimedia.cloud

2020-09-11 Thread Bryan Davis
7 for more details [0]. The preferred service name for ToolsDB is tools.db.svc.eqiad.wmflabs. [0]: https://phabricator.wikimedia.org/phame/post/view/70/new_wiki_replica_servers_ready_for_use/ Bryan, on behalf of the Cloud Services team -- Bryan Davis Technical Engagement

[Cloud-announce] Clarification: database service names still use eqiad.wmflabs, not eqiad1.wikimedia.cloud

2020-09-11 Thread Bryan Davis
7 for more details [0]. The preferred service name for ToolsDB is tools.db.svc.eqiad.wmflabs. [0]: https://phabricator.wikimedia.org/phame/post/view/70/new_wiki_replica_servers_ready_for_use/ Bryan, on behalf of the Cloud Services team -- Bryan Davis Technical Engagement

[Cloud-announce] [Toolforge] New features in toolsadmin.wikimedia.org

2020-09-02 Thread Bryan Davis
[1]: https://wikitech.wikimedia.org/wiki/Toolsadmin.wikimedia.org/Deployments#2020-09-02 Bryan, on behalf of the Toolforge admin team -- Bryan Davis Technical Engagement Wikimedia Foundation Principal Software Engineer Boise, ID USA

[Cloud] [Cloud-announce] [Toolforge] New features in toolsadmin.wikimedia.org

2020-09-02 Thread Bryan Davis
[1]: https://wikitech.wikimedia.org/wiki/Toolsadmin.wikimedia.org/Deployments#2020-09-02 Bryan, on behalf of the Toolforge admin team -- Bryan Davis Technical Engagement Wikimedia Foundation Principal Software Engineer Boise, ID USA

[Cloud] [Cloud-announce] [Toolforge] Default /favicon.ico and /robots.txt for toolforge.org webservices

2020-08-26 Thread Bryan Davis
rnetes ingress layer. Previously the /robots.txt and /favicon.ico from the "admin" tool were served for all tools due to the use of a shared hostname. [0]: https://phabricator.wikimedia.org/T251628 Bryan, on behalf of the Toolforge admin team -- Bryan Davis Technical Engagement

[Cloud-announce] [Toolforge] Default /favicon.ico and /robots.txt for toolforge.org webservices

2020-08-26 Thread Bryan Davis
rnetes ingress layer. Previously the /robots.txt and /favicon.ico from the "admin" tool were served for all tools due to the use of a shared hostname. [0]: https://phabricator.wikimedia.org/T251628 Bryan, on behalf of the Toolforge admin team -- Bryan Davis Technical Engagement

[Cloud-announce] [Cloud VPS] TLS encryption partially enforced for *.wmflabs.org & *.wmcloud.org

2020-08-18 Thread Bryan Davis
/listinfo/cloud Bryan, on behalf of the Cloud VPS admin team -- Bryan Davis Technical Engagement Wikimedia Foundation Principal Software Engineer Boise, ID USA [[m:User:BDavis_(WMF)]] irc: bd808 _

[Cloud] [Cloud-announce] [Cloud VPS] TLS encryption partially enforced for *.wmflabs.org & *.wmcloud.org

2020-08-18 Thread Bryan Davis
/listinfo/cloud Bryan, on behalf of the Cloud VPS admin team -- Bryan Davis Technical Engagement Wikimedia Foundation Principal Software Engineer Boise, ID USA [[m:User:BDavis_(WMF)]] irc: bd808 _

Re: [Cloud] Fwd: [GitHub API] Deprecation notice for authentication via URL query parameters

2020-08-13 Thread Bryan Davis
till there, but being deprecated), but in T249461 we switched to just fetching the phar file from getcomposer.org and verifying its published sha256 hash. Bryan -- Bryan Davis Technical Engagement Wikimedia Foundation Principal Software Engineer

Re: [Cloud] Fwd: [GitHub API] Deprecation notice for authentication via URL query parameters

2020-08-13 Thread Bryan Davis
t; GitHub sends me this mail below. The version of composer installed on your discordwiki.srwiki-dev.eqiad.wmflabs instance is: Composer 1.8.4 2019-02-11 10:52:10 You need Composer 1.9.3 or later to comply with the upstream API change at GitHub (<https://github.com/composer/composer/issues/858

Re: [Cloud] Logging vis-a-vis WMF privacy policy?

2020-07-28 Thread Bryan Davis
if you need to find a helper library or tutorial. Bryan -- Bryan Davis Technical Engagement Wikimedia Foundation Principal Software Engineer Boise, ID USA [[m:User:BDavis_(WMF)]] irc: bd808 ___

[Cloud] [Cloud-announce] [Toolforge] TLS encryption now enforced for all tools at all times

2020-07-17 Thread Bryan Davis
imedia.org/phame/post/view/132/migrating_tools.wmflabs.org_to_https/ Bryan -- Bryan Davis Technical Engagement Wikimedia Foundation Principal Software Engineer Boise, ID USA [[m:User:BDavis_(WMF)]]

Re: [Cloud] Where to look up my oauth tokens?

2020-07-09 Thread Bryan Davis
dia.org/wiki/Special:OAuthConsumerRegistration/list Bryan -- Bryan Davis Technical Engagement Wikimedia Foundation Principal Software Engineer Boise, ID USA [[m:User:BDavis_(WMF)]] irc: bd808 _

Re: [Cloud] Toolforge: new domain toolforge.org

2020-07-06 Thread Bryan Davis
as announced. The redirect service will keep the old interwiki links working indefinitely, but we will want to update things so that new tools which are not covered by the redirector service can use interwiki links. Bryan -- Bryan Davis Technical Engagement Wikimedia Foundation Princi

Re: [Cloud] [Wikitech-l] Gerrit v3.2.2 is live [was: Re: Gerrit upgrade on Saturday, 27th of June]

2020-07-01 Thread Bryan Davis
w DOM presence. I'm sure there are more elegant implementations (my javascript fu is not the best), but this one is working for now and does not seem to cause any significant load issues in my browser. Bryan -- Bryan Davis Technical Engagement Wikimedia Foundation Principal Softwa

Re: [Cloud] Need help with selectize.js

2020-06-24 Thread Bryan Davis
ud Services proxy is privacy respecting, but again this is a defense in depth protection against any possible rogue activity at that proxy. Bryan -- Bryan Davis Technical Engagement Wikimedia Foundation Principal Software Engineer Boise, ID USA [[m

[Cloud-announce] [Cloud VPS] Puppet labs/private.git data loss incident affecting some projects

2020-06-04 Thread Bryan Davis
change logs where available. More information will be collected at <https://phabricator.wikimedia.org/T254491> and an incident report will also be prepared once the initial response is complete. Bryan -- Bryan Davis Technical Engagement Wikimedia Foundation Principal So

Re: [Cloud] python web container - how to start locally?

2020-06-03 Thread Bryan Davis
sorts of useful but less mainstream tips. That is something that we need to work on and would be happy to hear ideas about. Luckily wiki's are pretty good at dealing with splitting and merging content over time, so we do not have to get things perfect the first time. :) Bryan -- Bryan Dav

Re: [Cloud] Error setting up MediaWiki-Vagrant: RPC Error: Unable to receive

2020-06-03 Thread Bryan Davis
ously empty directory. Manually restarting the apache2 process after fixing the mounts should make things happy again. Bryan -- Bryan Davis Technical Engagement Wikimedia Foundation Principal Software Engineer Boise, ID USA [[m:User:BDavis_(WMF)]]

Re: [Cloud] python web container - how to start locally?

2020-06-02 Thread Bryan Davis
ervice`. [0]: https://gerrit.wikimedia.org/r/plugins/gitiles/operations/software/tools-webservice/+/master/toolsws/wstypes/uwsgi.py#18 Bryan -- Bryan Davis Technical Engagement Wikimedia Foundation Principal Software Engineer Boise, ID USA

Re: [Cloud] Error setting up MediaWiki-Vagrant: RPC Error: Unable to receive

2020-05-25 Thread Bryan Davis
container followed by `sudo mount -t nfs 192.168.122.1:/srv/mediawiki-vagrant /vagrant` and the share mounted correctly. I can't guarantee that things will work correctly following a restart of the LXC container or the hosting instance, but for now it is working. Sorry I don't have a more sa

Re: [Cloud] User tables

2020-05-11 Thread Bryan Davis
ses replication lag. Bryan -- Bryan Davis Technical Engagement Wikimedia Foundation Principal Software Engineer Boise, ID USA [[m:User:BDavis_(WMF)]] irc: bd808 ___ Wikimedia

[Cloud] Maintainers wanted: wikistream

2020-04-30 Thread Bryan Davis
on the Toolforge Kubernetes cluster. If you have experience using Toolforge and nodejs, see <https://phabricator.wikimedia.org/T251555> and apply to become a co-maintainer. Bryan -- Bryan Davis Technical Engagement Wikimedia Foundation Principal Software En

[Cloud] [Cloud-announce] Disk failure on cloudvirt1004 OpenStack host

2020-04-21 Thread Bryan Davis
kidata-autodesc.eqiad.wmflabs * wikilink ** wikilink-prod.wikilink.eqiad.wmflabs Bryan, on behalf of the Cloud VPS admins and Cloud Services team -- Bryan Davis Technical Engagement Wikimedia Foundation Principal Software Engineer Boise, ID USA [[m:User:BDavi

[Cloud-announce] Disk failure on cloudvirt1004 OpenStack host

2020-04-21 Thread Bryan Davis
kidata-autodesc.eqiad.wmflabs * wikilink ** wikilink-prod.wikilink.eqiad.wmflabs Bryan, on behalf of the Cloud VPS admins and Cloud Services team -- Bryan Davis Technical Engagement Wikimedia Foundation Principal Software Engineer Boise, ID USA [[m:User:BDavi

Re: [Cloud] [Cloud-announce] Changes to CloudVPS web proxy (XFF) on 2020-04-15

2020-04-16 Thread Bryan Davis
ments and helping folks deal with things that break as a result. [0]: https://phabricator.wikimedia.org/phame/post/view/132/migrating_tools.wmflabs.org_to_https/ Bryan -- Bryan Davis Technical Engagement Wikimedia Foundation Principal Software Engineer

Re: [Cloud] Toolforge: new domain toolforge.org

2020-04-16 Thread Bryan Davis
either of https://whois.toolforge.org/whois/8.4.4.8/lookup/json or https://tools.wmflabs.org/whois/8.4.4.8/lookup/json. Is this a regression you are seeing from using the tools.wmflabs.org URL to access the tool or just a general question? [0]: https://developer.mozilla.org/en-US/docs

Re: [Cloud] Loading wikipedia dump onto Clouds

2020-04-13 Thread Bryan Davis
On Mon, Apr 13, 2020 at 3:03 PM Huji Lee wrote: > > On Mon, Apr 13, 2020 at 4:42 PM Bryan Davis wrote: >> >> On Sun, Apr 12, 2020 at 7:48 AM Huji Lee wrote: >> > >> > One possible solution is to create a script which is scheduled to run once >> >

Re: [Cloud] Loading wikipedia dump onto Clouds

2020-04-13 Thread Bryan Davis
ed not even remotely considered a "large" project, meaning I am > being overly cautious? <https://phabricator.wikimedia.org/project/view/2875/> Bryan -- Bryan Davis Technical Engagement Wikimedia Foundation Principal Software Engineer

Re: [Cloud] Toolforge: new domain toolforge.org

2020-04-13 Thread Bryan Davis
that point in time. This will be similar in spirit if not implementation to the service we run which redirects toolserver.org/$WHATEVER URLs to tools.wmflabs.org URLs today. Bryan -- Bryan Davis Technical Engagement Wikimedia Foundation Principal Software Engineer

[Cloud] [Cloud-announce] [Toolforge] 2020 Kubernetes cluster migration complete

2020-03-06 Thread Bryan Davis
://phabricator.wikimedia.org/T214513 Bryan, on behalf of the Toolforge admin team and the Wikimedia Cloud Services team -- Bryan Davis Technical Engagement Wikimedia Foundation Principal Software Engineer Boise, ID USA [[m:User:BDavis_(WMF

[Cloud-announce] [Toolforge] 2020 Kubernetes cluster migration complete

2020-03-06 Thread Bryan Davis
://phabricator.wikimedia.org/T214513 Bryan, on behalf of the Toolforge admin team and the Wikimedia Cloud Services team -- Bryan Davis Technical Engagement Wikimedia Foundation Principal Software Engineer Boise, ID USA [[m:User:BDavis_(WMF

Re: [Cloud] [Cloud-announce] Planned NFS maintenance 2020-02-26@1800 UTC

2020-02-27 Thread Bryan Davis
ervice. Bryan -- Bryan Davis Technical Engagement Wikimedia Foundation Principal Software Engineer Boise, ID USA [[m:User:BDavis_(WMF)]] irc: bd808 ___ Wikimedia

Re: [Cloud] [Cloud-announce] [Toolforge] 2020 Kubernetes cluster automatic migration phase beginning

2020-02-25 Thread Bryan Davis
file. `webservice restart` is the only command which uses that state data directly. Bryan -- Bryan Davis Technical Engagement Wikimedia Foundation Principal Software Engineer Boise, ID USA [[m:User:BDavis_(WMF)]]

[Cloud] [Cloud-announce] [Toolforge] 2020 Kubernetes cluster automatic migration phase beginning

2020-02-20 Thread Bryan Davis
and the Cloud Services team) -- Bryan Davis Technical Engagement Wikimedia Foundation Principal Software Engineer Boise, ID USA [[m:User:BDavis_(WMF)]] irc: bd808

[Cloud-announce] [Toolforge] 2020 Kubernetes cluster automatic migration phase beginning

2020-02-20 Thread Bryan Davis
and the Cloud Services team) -- Bryan Davis Technical Engagement Wikimedia Foundation Principal Software Engineer Boise, ID USA [[m:User:BDavis_(WMF)]] irc: bd808

Re: [Cloud] wm-bot instance moved + static movable VIP address question

2020-02-20 Thread Bryan Davis
e to introduce a "Load Balancer as a Service" system in the future, but we need to finish work on some other infrastructure changes before we are ready to look into that seriously. Bryan -- Bryan Davis Technical Engagement Wikimedia Foundation Principal Software Enginee

[Cloud] [Cloud-announce] [Toolforge] 2020 Kubernetes cluster open for general use

2020-01-24 Thread Bryan Davis
0-January/000247.html [2]: https://tools.wmflabs.org/k8s-status/ [3]: https://wikitech.wikimedia.org/wiki/Help:Toolforge/Kubernetes#Available_container_types Bryan (on behalf of the Toolforge admins and the Cloud Services team) -- Bryan Davis Technical Engagement Wikimedia Foun

[Cloud-announce] [Toolforge] 2020 Kubernetes cluster open for general use

2020-01-24 Thread Bryan Davis
0-January/000247.html [2]: https://tools.wmflabs.org/k8s-status/ [3]: https://wikitech.wikimedia.org/wiki/Help:Toolforge/Kubernetes#Available_container_types Bryan (on behalf of the Toolforge admins and the Cloud Services team) -- Bryan Davis Technical Engagement Wikimedia Foun

Re: [Cloud] cache control on tools-static.wmflabs.org?

2020-01-19 Thread Bryan Davis
cess to publish on tools-static, so if there is a lot of demand for customizations we may need to find another way to provide them. Bryan -- Bryan Davis Technical Engagement Wikimedia Foundation Principal Software Engineer Boise, ID USA [[m:U

[Cloud-announce] [Toolforge] New Kubernetes cluster open for beta testers

2020-01-09 Thread Bryan Davis
bs.org/k8s-status/ [2]: https://tools.wmflabs.org/sge-status/ Bryan (on behalf of the Toolforge admins and the Cloud Services team) -- Bryan Davis Technical Engagement Wikimedia Foundation Principal Software Engineer Boise, ID USA [[m:User:B

Re: [Cloud] Access Wikimedia commons file in Toolforge/CloudVPS

2020-01-08 Thread Bryan Davis
the Swift cluster that stores all of the Commons media are within several meters of each other so download speeds should be high. Bryan -- Bryan Davis Technical Engagement Wikimedia Foundation Principal Software Engineer B

Re: [Cloud] Umlaut issue

2019-12-29 Thread Bryan Davis
try to find a solution. [0]: https://phabricator.wikimedia.org/T229227 Bryan -- Bryan Davis Technical Engagement Wikimedia Foundation Principal Software Engineer Boise, ID USA [[m:User:BDavis_(WMF)]] irc: bd808 _

[Cloud] [Toolforge] New tool to browse the Toolforge Docker registry

2019-12-20 Thread Bryan Davis
the Docker containers used in the Wikimedia CI and production environments, there is a tool for that too! -- https://tools.wmflabs.org/dockerregistry/ (Thanks to Tyler on the Release Engineering team at the Wikimedia Foundation.) Bryan -- Bryan Davis Technical Engagement Wikimedia

Re: [Cloud] help! my toolforge webservice is freezing up, can't figure out why?

2019-12-17 Thread Bryan Davis
ver that handles routing requests for https://tools.wmflabs.org/ to the backend Kubernetes pod or grid engine job. These changes should be transparent to you however. The change was adding in support for routing requests to pods running on a new Kubernetes cluster that folks will learn more about in

Re: [Cloud] Intermittent hangs on tools-sgebastion-07?

2019-11-22 Thread Bryan Davis
olks who are using the "main" bastion. [0]: https://wikitech.wikimedia.org/wiki/Portal:Toolforge/About_Toolforge#Bastion_hosts Bryan -- Bryan Davis Technical Engagement Wikimedia Foundation Principal Software Engineer Boise,

Re: [Cloud] Intermittent hangs on tools-sgebastion-07?

2019-11-22 Thread Bryan Davis
imedia.org/wiki/Help:Toolforge/Grid [1]: https://wikitech.wikimedia.org/wiki/Help:Toolforge/Kubernetes Bryan -- Bryan Davis Technical Engagement Wikimedia Foundation Principal Software Engineer Boise, ID USA [[m:U

Re: [Cloud] [Cloud-announce] Brief ToolsDB Outage - probably over!

2019-10-24 Thread Bryan Davis
when things will be stable. Bryan -- Bryan Davis Technical Engagement Wikimedia Foundation Principal Software Engineer Boise, ID USA [[m:User:BDavis_(WMF)]] irc: bd808 _

[Cloud] [Toolforge] annoying bug affecting webservices running on grid engine fixed

2019-10-18 Thread Bryan Davis
ikimedia.org/T217815 [1]: https://phabricator.wikimedia.org/T225966 [2]: https://phabricator.wikimedia.org/T217815#5577987 [3]: https://phabricator.wikimedia.org/T190185 Bryan -- Bryan Davis Technical Engagement Wikimedia Foundation Principal Software Engineer

[Cloud] [Cloud-announce] [Wiki replicas] query killer time limit reduced to 1 hour for .analytics.db.svc.eqiad.wmflabs

2019-10-08 Thread Bryan Davis
some stress on the shared servers and allow us more time to look into other changes to restore stability. Ideally we will be able to increase the limit again after making other changes to these systems. Bryan, on behalf of the Cloud Services team -- Bryan Davis Technical Engagement

[Cloud-announce] [Wiki replicas] query killer time limit reduced to 1 hour for .analytics.db.svc.eqiad.wmflabs

2019-10-08 Thread Bryan Davis
some stress on the shared servers and allow us more time to look into other changes to restore stability. Ideally we will be able to increase the limit again after making other changes to these systems. Bryan, on behalf of the Cloud Services team -- Bryan Davis Technical Engagement

  1   2   >