[Wikidata-bugs] [Maniphest] T365735: Consider creating a separate WDQS server type for categories

2024-05-23 Thread RKemper
RKemper updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T365735 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: RKemper Cc: bking, Aklapper, Danny_Benjafield_WMDE, S8321414, Astuthiodit_1, AWesterinen, BTullis

[Wikidata-bugs] [Maniphest] T316876: wdqs: replace git-fat with git-lfs

2024-05-08 Thread RKemper
RKemper added a comment. @dancy Should be fixed now. Here's a previously failing patch I ran a recheck on: https://gerrit.wikimedia.org/r/c/operations/puppet/+/1028565/4#message-8d03a9f159d1ec58172e8606d84deaf43bbcbbb0 TASK DETAIL https://phabricator.wikimedia.org/T316876 EMAIL

[Wikidata-bugs] [Maniphest] T364368: Create separate pybal pools for wdqs graph split (main vs scholarly)

2024-05-07 Thread RKemper
RKemper created this task. RKemper added projects: Wikidata, Wikidata-Query-Service, Epic, Discovery-Search (Current work). TASK DESCRIPTION Context --- Currently we've got one pybal pool per-DC for public `wdqs` (https://config-master.wikimedia.org/pybal/eqiad/wdqs) corresponding

[Wikidata-bugs] [Maniphest] T364367: Create dedicated UIs for wdqs graph split endpoints

2024-05-07 Thread RKemper
RKemper created this task. RKemper added projects: Wikidata, Wikidata-Query-Service, Epic, Discovery-Search (Current work). TASK DESCRIPTION Context --- The UI for wdqs (e.g. query.wikidata.org) lives on `miscweb`. We'll want to create slightly different UIs for the two types

[Wikidata-bugs] [Maniphest] T364366: Implement puppet logic for wdqs graph split

2024-05-07 Thread RKemper
RKemper created this task. RKemper added projects: Wikidata, Wikidata-Query-Service, Epic, Discovery-Search (Current work). TASK DESCRIPTION Context --- Currently our graph split hosts are just `wdqs-test` hosts, which are only exposed via dedicated temporary endpoints

[Wikidata-bugs] [Maniphest] T364364: Provision DNS and certificates for wdqs graph split domains

2024-05-07 Thread RKemper
RKemper created this task. RKemper added projects: Wikidata, Wikidata-Query-Service, Epic, Discovery-Search (Current work). TASK DESCRIPTION Acceptance Criteria --- - DNS records in place - Certs provisioned via CFSSL TASK DETAIL https://phabricator.wikimedia.org

[Wikidata-bugs] [Maniphest] T364363: [Epic] Productionize federated wdqs graph-split endpoints

2024-05-07 Thread RKemper
RKemper created this task. RKemper added projects: Wikidata, Wikidata-Query-Service, Epic, Discovery-Search (Current work). TASK DESCRIPTION This epic tracks the SRE operational work to get at least a couple wdqs hosts fully in production with the new graph split way of doing things (`main

[Wikidata-bugs] [Maniphest] T362920: Benchmark Blazegraph import with increased buffer capacity (and other factors)

2024-05-07 Thread RKemper
RKemper added a comment. Kicked off the second run like so: (1) `vi /etc/wdqs/RWStore.wikidata.properties` (added a trailing 0 to buffersize) (2) `date | tee /home/ryankemper/loadData2.log; time sudo /home/ryankemper/loadData.sh -n wdq -d /srv/T362920/nt_wd_schol -s 0 -e 0 2>

[Wikidata-bugs] [Maniphest] T362920: Benchmark Blazegraph import with increased buffer capacity (and other factors)

2024-05-07 Thread RKemper
RKemper added a comment. @dr0ptp4kt > we saw that this took about 3702 minutes, or about 2.57 //hours// Typo you'll want to fix here and in the original: 2.57 **days** TASK DETAIL https://phabricator.wikimedia.org/T362920 EMAIL PREFERENCES https://phabricator.wikimedia.

[Wikidata-bugs] [Maniphest] T362920: Benchmark Blazegraph import with increased buffer capacity (and other factors)

2024-05-02 Thread RKemper
RKemper added a subscriber: dcausse. RKemper added a comment. I'm realizing I don't remember enough about how we load specific graph splits (scholarly vs main). But it's possible we won't need the above nfs patch if our previous process was to manually download the relevant dump file

[Wikidata-bugs] [Maniphest] T362920: Benchmark Blazegraph import with increased buffer capacity (and other factors)

2024-05-02 Thread RKemper
RKemper added a comment. Actually we'll use `wdqs1021` since we're not confident NFS will work seamlessly between eqiad and codfw (we use nsf to procure the dumps that the data-reload is run from). Gearing up to kick off a data reload on `wdqs1021` after a quick patch to enable NFS

[Wikidata-bugs] [Maniphest] T362920: Benchmark Blazegraph import with increased buffer capacity (and other factors)

2024-05-01 Thread RKemper
RKemper added a comment. We'll use wdqs2023 to compare against wdqs1023 (same hardware). 1023 is scholarly-articles so that's what we'll want to load 2023 with. TASK DETAIL https://phabricator.wikimedia.org/T362920 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel

[Wikidata-bugs] [Maniphest] T346455: Allow federated queries with the NFDI4Culture Knowledge Graph

2024-04-26 Thread RKemper
RKemper moved this task from Needs Review to Done on the Data-Platform-SRE (2024.04.15 - 2024.05.05) board. RKemper closed this task as "Resolved". RKemper added a comment. Here's an example CURL command we can use to verify when the service is properly supporting `application/spar

[Wikidata-bugs] [Maniphest] T339347: qlever dblp endpoint for wikidata federated query nomination

2024-04-15 Thread RKemper
RKemper added a comment. In T339347#9565775 <https://phabricator.wikimedia.org/T339347#9565775>, @Hannah_Bast wrote: > @RKemper Is your point that the queries should return a result? Neither DBLP nor Wikidata have the predicate `foaf:name`, so it's clear that both `SERVICE

[Wikidata-bugs] [Maniphest] T357533: Allow federated queries with the Iconclass sparql endpoint

2024-04-02 Thread RKemper
RKemper closed this task as "Resolved". TASK DETAIL https://phabricator.wikimedia.org/T357533 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: RKemper Cc: Aklapper, Loz.ross, Danny_Benjafield_WMDE, S8321414, Astuthiodit_1, AWesterine

[Wikidata-bugs] [Maniphest] T351488: Allow federated queries with the MiMoTextBase SPARQL endpoint

2024-02-21 Thread RKemper
RKemper added a comment. @HinMar Okay, I think we've got the endpoints properly allowed. Queries appear to be working for me. Are you seeing the same? TASK DETAIL https://phabricator.wikimedia.org/T351488 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel

[Wikidata-bugs] [Maniphest] T339347: qlever dblp endpoint for wikidata federated query nomination

2024-02-21 Thread RKemper
RKemper added a comment. @Hannah_Bast Okay, we figured out what was making the allowed endpoints not updated properly. https://w.wiki/6q2i doesn't get an error message anymore, although the query itself returns no results. TASK DETAIL https://phabricator.wikimedia.org/T339347 EMAIL

[Wikidata-bugs] [Maniphest] T346455: Allow federated queries with the NFDI4Culture Knowledge Graph

2024-02-21 Thread RKemper
RKemper added a comment. @Loz.ross Yes the change to allowed endpoints did not get properly deployed; we've fixed that now. However there's another issue now that we've gotten past the Service URI not being allowed: > Unknown error: Could not identify format for service respo

[Wikidata-bugs] [Maniphest] T357533: Allow federated queries with the Iconclass sparql endpoint

2024-02-21 Thread RKemper
RKemper claimed this task. TASK DETAIL https://phabricator.wikimedia.org/T357533 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: RKemper Cc: Aklapper, Loz.ross, Danny_Benjafield_WMDE, Astuthiodit_1, AWesterinen, BTullis, karapayneWMDE, Invadibot

[Wikidata-bugs] [Maniphest] T351488: Allow federated queries with the MiMoTextBase SPARQL endpoint

2024-02-01 Thread RKemper
RKemper added a comment. In T351488#9505091 <https://phabricator.wikimedia.org/T351488#9505091>, @HinMar wrote: > @RKemper : Thank you for your message. The project has ended, but we still kindly ask you to whitelist this endpoint. We at the Trier Center for Digital H

[Wikidata-bugs] [Maniphest] T339347: qlever dblp endpoint for wikidata federated query nomination

2024-02-01 Thread RKemper
RKemper added a comment. In T339347#9504488 <https://phabricator.wikimedia.org/T339347#9504488>, @Hannah_Bast wrote: > Yes, https://qlever.cs.uni-freiburg.de/api/dblp is the URL for API calls, whereas https://qlever.cs.uni-freiburg.de/dblp (without the /api) is the URL of the

[Wikidata-bugs] [Maniphest] T339347: qlever dblp endpoint for wikidata federated query nomination

2024-01-31 Thread RKemper
RKemper added a comment. In T339347#9431527 <https://phabricator.wikimedia.org/T339347#9431527>, @Nikki wrote: > Could https://qlever.cs.uni-freiburg.de/api/wikimedia-commons also be added? > > It looks like https://qlever.cs.uni-freiburg.de/api/wikidata is work

[Wikidata-bugs] [Maniphest] T346455: Allow federated queries with the NFDI4Culture Knowledge Graph

2024-01-31 Thread RKemper
RKemper added a comment. @Loz.ross Sorry for the delay, we've added the endpoint. Can you confirm it's working with an example query? TASK DETAIL https://phabricator.wikimedia.org/T346455 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: RKemper

[Wikidata-bugs] [Maniphest] T351488: Allow federated queries with the MiMoTextBase SPARQL endpoint

2024-01-31 Thread RKemper
RKemper added a comment. @HinMar Sorry for missing this request - our bad! I see your earlier comment mentioned the project expiring by end of 2023. Is the project still ongoing and therefore we should still whitelist this new endpoint or should I instead close this ticket out? TASK DETAIL

[Wikidata-bugs] [Maniphest] T351650: Expose 3 new dedicated WDQS endpoints

2024-01-23 Thread RKemper
RKemper closed subtask T355593: Re-generate webserver-misc-apps.discovery.wmnet cergen certificate as Resolved. TASK DETAIL https://phabricator.wikimedia.org/T351650 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: RKemper Cc: Gehel, bking, dcausse

[Wikidata-bugs] [Maniphest] T350464: Expose SPARQL endpoints with full wikidata data set and with split graph to enable experimentation on federation with a split graph

2024-01-23 Thread RKemper
RKemper moved this task from Blocked/Waiting to Needs Reporting on the Discovery-Search (Current work) board. RKemper added a comment. This should be all done, with the new experimental services accessible at: https://query-full-experimental.wikidata.org/ https://query-main

[Wikidata-bugs] [Maniphest] T350464: Expose SPARQL endpoints with full wikidata data set and with split graph to enable experimentation on federation with a split graph

2024-01-23 Thread RKemper
RKemper updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T350464 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: RKemper Cc: Gehel, Aklapper, Danny_Benjafield_WMDE, Astuthiodit_1, AWesterinen, karapayneWMDE, Invadibot

[Wikidata-bugs] [Maniphest] T354658: Create 3 microsites for wdqs full graph, main graph, & scholarly articles

2024-01-23 Thread RKemper
RKemper moved this task from In Progress to Done on the Data-Platform-SRE (2024.01.22 - 2024.02.11) board. RKemper added a comment. Experimental microsites are up and externally reachable: https://query-full-experimental.wikidata.org/ https://query-main-experimental.wikidata.org

[Wikidata-bugs] [Maniphest] T354658: Create 3 microsites for wdqs full graph, main graph, & scholarly articles

2024-01-23 Thread RKemper
RKemper updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T354658 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: RKemper Cc: Aklapper, Gehel, RKemper, Danny_Benjafield_WMDE, Isabelladantes1983, Themindcoder, Adamm71

[Wikidata-bugs] [Maniphest] T351650: Expose 3 new dedicated WDQS endpoints

2024-01-23 Thread RKemper
RKemper updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T351650 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: RKemper Cc: Gehel, bking, dcausse, dr0ptp4kt, RKemper, Aklapper, Danny_Benjafield_WMDE, Astuthiodit_1

[Wikidata-bugs] [Maniphest] T350464: Expose SPARQL endpoints with full wikidata data set and with split graph to enable experimentation on federation with a split graph

2024-01-22 Thread RKemper
RKemper added a subtask: T355593: Re-generate webserver-misc-apps.discovery.wmnet cergen certificate. TASK DETAIL https://phabricator.wikimedia.org/T350464 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: RKemper Cc: Gehel, Aklapper

[Wikidata-bugs] [Maniphest] T354661: Generate TLS certs for new WDQS endpoints

2024-01-22 Thread RKemper
RKemper moved this task from In Progress to Done on the Data-Platform-SRE (2024.01.22 - 2024.02.11) board. RKemper added a comment. These 3 new services have their internal certs working with Envoy. Moving to Done and spun off https://phabricator.wikimedia.org/T355593 for the last cert

[Wikidata-bugs] [Maniphest] T354662: Create DNS records for 3 new WDQS endpoints

2024-01-18 Thread RKemper
RKemper added a comment. Deployed the following changes via `sudo -i authdns-update`: diff --git templates/wikidata.org templates/wikidata.org index cbd99942..1d356985 100644 --- templates/wikidata.org +++ templates/wikidata.org @@ -31,7 +31,10 @@ ; Servers

[Wikidata-bugs] [Maniphest] T354658: Create 3 microsites for wdqs full graph, main graph, & scholarly articles

2024-01-16 Thread RKemper
RKemper added a comment. We'll need to add 3 entries to https://gerrit.wikimedia.org/r/c/operations/puppet/+/668543/4/modules/profile/manifests/microsites/wdqs.pp following the model in https://gerrit.wikimedia.org/r/c/operations/puppet/+/668543/ And then we'll also need to add 3 new

[Wikidata-bugs] [Maniphest] T354661: Generate TLS certs for new WDQS endpoints

2024-01-16 Thread RKemper
RKemper added a comment. Talked with gehel, ebernhardson, and inflatador. We're going to start with `full-experimental.wikidata.org`, `main-experimental.wikidata.org`, `scholarly-experimental.wikidata.org` to get these 3 test endpoints up. Meanwhile, we can open up the convo

[Wikidata-bugs] [Maniphest] T354661: Generate TLS certs for new WDQS endpoints

2024-01-16 Thread RKemper
RKemper added a comment. We did the initial work to get envoy via PKI / cfssl operational in https://phabricator.wikimedia.org/T354555#9454855. Next up is adding specific alt-names for the three new endpoints. Here's a few different proposals for naming scheme

[Wikidata-bugs] [Maniphest] T354662: Create DNS records for 3 new WDQS endpoints

2024-01-09 Thread RKemper
RKemper created this task. RKemper added projects: Wikidata, Wikidata-Query-Service, Discovery-Search (Current work), Data-Platform-SRE (2023/24 Q3 Milestone 1). TASK DESCRIPTION AC: - One DNS record each, for: - full-graph - main-graph - scholarly-articles TASK DETAIL

[Wikidata-bugs] [Maniphest] T354661: Generate TLS certs for new WDQS endpoints

2024-01-09 Thread RKemper
RKemper created this task. RKemper added projects: Wikidata, Wikidata-Query-Service, Discovery-Search (Current work), Data-Platform-SRE (2023/24 Q3 Milestone 1). TASK DESCRIPTION AC: - One TLS cert each, generated via cergen, for: - full-graph - main-graph - scholarly-articles

[Wikidata-bugs] [Maniphest] T350464: Expose SPARQL endpoints with full wikidata data set and with split graph to enable experimentation on federation with a split graph

2024-01-09 Thread RKemper
RKemper removed a subtask: T354658: Create 3 microsites for wdqs full graph, main graph, & scholarly articles. TASK DETAIL https://phabricator.wikimedia.org/T350464 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: RKemper Cc: Gehel, Akla

[Wikidata-bugs] [Maniphest] T351650: Expose 3 new dedicated WDQS endpoints

2024-01-09 Thread RKemper
RKemper added a subtask: T354658: Create 3 microsites for wdqs full graph, main graph, & scholarly articles. TASK DETAIL https://phabricator.wikimedia.org/T351650 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: RKemper Cc: Gehel, bking, dca

[Wikidata-bugs] [Maniphest] T354658: Create 3 microsites for wdqs full graph, main graph, & scholarly articles

2024-01-09 Thread RKemper
RKemper edited parent tasks, added: T351650: Expose 3 new dedicated WDQS endpoints; removed: T350464: Expose SPARQL endpoints with full wikidata data set and with split graph to enable experimentation on federation with a split graph. TASK DETAIL https://phabricator.wikimedia.org/T354658

[Wikidata-bugs] [Maniphest] T351650: Expose 3 new dedicated WDQS endpoints

2024-01-09 Thread RKemper
RKemper updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T351650 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: RKemper Cc: Gehel, bking, dcausse, dr0ptp4kt, RKemper, Aklapper, Danny_Benjafield_WMDE, Astuthiodit_1

[Wikidata-bugs] [Maniphest] T354658: Create 3 microsites for wdqs full graph, main graph, & scholarly articles

2024-01-09 Thread RKemper
RKemper created this task. RKemper added projects: Wikidata-Query-Service, Wikidata, Discovery-Search (Current work). TASK DESCRIPTION Query service uses a microsite that runs on `miscweb*` as the UI. AC: [ ] 3 microsites created TASK DETAIL https://phabricator.wikimedia.org

[Wikidata-bugs] [Maniphest] T350464: Expose SPARQL endpoints with full wikidata data set and with split graph to enable experimentation on federation with a split graph

2024-01-08 Thread RKemper
RKemper updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T350464 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: RKemper Cc: Gehel, Aklapper, Danny_Benjafield_WMDE, Astuthiodit_1, AWesterinen, karapayneWMDE, Invadibot

[Wikidata-bugs] [Maniphest] T351650: Expose 3 new dedicated WDQS endpoints

2023-12-19 Thread RKemper
RKemper added a comment. Current status: - Met again with Traffic team last week and got approval for our proposal to spin up these 3 new endpoints [after december vacation], and address the longer-term questions around whether WDQS needs to be in the caching layer afterwards. - Data

[Wikidata-bugs] [Maniphest] T332314: Service implementation for wdqs20[13-22]

2023-12-08 Thread RKemper
RKemper renamed this task from "Configure new WDQS servers in codfw (wdqs20[13-22])" to "Service implementation for wdqs20[13-22]". TASK DETAIL https://phabricator.wikimedia.org/T332314 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/

[Wikidata-bugs] [Maniphest] T350106: Implement a spark job that converts a RDF triples table into a RDF file format

2023-12-07 Thread RKemper
RKemper added a comment. Here's some extra notes with some of the commands we ran/used: P54284 <https://phabricator.wikimedia.org/P54284> TASK DETAIL https://phabricator.wikimedia.org/T350106 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailprefe

[Wikidata-bugs] [Maniphest] T351650: Expose 3 new dedicated WDQS endpoints

2023-12-05 Thread RKemper
RKemper added a comment. Alright, I had an initial meeting with Traffic team (Brandon & Valentin). Traffic team meeting summary The primary concern they had was related to the potential impact on the ATS side of things; in a scenario where Blazeg

[Wikidata-bugs] [Maniphest] T351650: Launch 3 new dedicated WDQS endpoints

2023-11-20 Thread RKemper
RKemper updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T351650 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: RKemper Cc: bking, dcausse, dr0ptp4kt, RKemper, Aklapper, Danny_Benjafield_WMDE, Astuthiodit_1, AWesterinen

[Wikidata-bugs] [Maniphest] T351650: Launch two new dedicated WDQS endpoints

2023-11-20 Thread RKemper
RKemper created this task. RKemper added projects: Wikidata, Wikidata-Query-Service, Epic, Discovery-Search (Current work). Restricted Application added a subscriber: Aklapper. TASK DESCRIPTION We'll be launching two net-new services, `wdqs-main-graph` and `wdqs-scholarly-articles` (real

[Wikidata-bugs] [Maniphest] T346885: BUG Partially persistent authentication on WCQS after revoking permissions

2023-10-02 Thread RKemper
RKemper renamed this task from "BUG Partially persisten authentication on WCQS after revoking permissions" to "BUG Partially persistent authentication on WCQS after revoking permissions". TASK DETAIL https://phabricator.wikimedia.org/T346885 EMAIL

[Wikidata-bugs] [Maniphest] T347284: Restore service for https://query.wikidata.org/bigdata/ldf

2023-09-25 Thread RKemper
RKemper added a comment. Just to explain what happened here, we switched <https://phabricator.wikimedia.org/T344198> the ldf endpoint from 1003 to 1016, which at the time was a public host. However for separate reasons <https://phabricator.wikimedia.org/T314890#9147715> we la

[Wikidata-bugs] [Maniphest] T344284: Rename usages of whitelist to allowlist in query service rdf repo

2023-08-15 Thread RKemper
RKemper updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T344284 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: RKemper Cc: Aklapper, bking, Reedy, Gehel, RKemper, Danny_Benjafield_WMDE, Astuthiodit_1, AWesterinen

[Wikidata-bugs] [Maniphest] T344284: Rename usages of whitelist to allowlist in query service rdf repo

2023-08-15 Thread RKemper
RKemper created this task. RKemper added projects: Data-Platform-SRE, Wikidata-Query-Service, Wikidata, Discovery-Search. TASK DESCRIPTION Currently the rdf repo reads a `whitelist.txt` file. Refactor this to `allowlist.txt` and replace any instances of the word `whitelist

[Wikidata-bugs] [Maniphest] T316876: wdqs: replace git-fat with git-lfs

2023-08-14 Thread RKemper
RKemper added a comment. Patch was merged here: https://gerrit.wikimedia.org/r/947928 TASK DETAIL https://phabricator.wikimedia.org/T316876 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: RKemper Cc: RKemper, bking, demon, Aklapper

[Wikidata-bugs] [Maniphest] T324788: Create WDQS/WCQS update lag SLO dashboard in Grizzly

2023-08-08 Thread RKemper
RKemper updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T324788 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: RKemper Cc: RKemper, Aklapper, Danny_Benjafield_WMDE, Astuthiodit_1, AWesterinen, karapayneWMDE, Invadibot

[Wikidata-bugs] [Maniphest] T339347: qlever dblp endpoint for wikidata federated query nomination

2023-08-08 Thread RKemper
RKemper added a comment. Looks like we lost track of this a bit. @bking and I can work this this week. TASK DETAIL https://phabricator.wikimedia.org/T339347 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: RKemper Cc: RKemper, bking, Aklapper

[Wikidata-bugs] [Maniphest] T332314: Configure new WDQS servers in codfw (wdqs20[13-22])

2023-07-20 Thread RKemper
RKemper moved this task from In Progress to Needs Reporting on the Data-Platform-SRE board. RKemper added a comment. `wdqs202[1-2]` have been brought into service. With teh merging of https://gerrit.wikimedia.org/r/c/operations/puppet/+/940272, all hosts are now in service and have alerting

[Wikidata-bugs] [Maniphest] T332314: Configure new WDQS servers in codfw (wdqs20[13-22])

2023-07-20 Thread RKemper
RKemper updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T332314 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: bking, RKemper Cc: RKemper, Gehel, Aklapper, Isabelladantes1983, Themindcoder, Adamm71, Jersione, Hellket777

[Wikidata-bugs] [Maniphest] T332314: Configure new WDQS servers in codfw (wdqs20[13-22])

2023-07-20 Thread RKemper
RKemper added a comment. All of these hosts except `wdqs202[1-2]` are in service. Those last two hosts will be brought in service after a final data xfer (ongoing). TASK DETAIL https://phabricator.wikimedia.org/T332314 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel

[Wikidata-bugs] [Maniphest] T324811: Create WDQS Lag SLO dashboard with Grizzly && documentation

2023-07-17 Thread RKemper
RKemper updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T324811 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: RKemper Cc: RKemper, Gehel, Aklapper, Isabelladantes1983, Themindcoder, Adamm71, Jersione, Hellket777

[Wikidata-bugs] [Maniphest] T301167: Service implementation for wdqs20[09,10,11,12]

2023-07-12 Thread RKemper
RKemper updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T301167 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: bking, RKemper Cc: jcrespo, bking, Aklapper, RKemper, Astuthiodit_1, AWesterinen, karapayneWMDE, Invadibot

[Wikidata-bugs] [Maniphest] T332314: Configure new WDQS servers in codfw (wdqs20[13-22])

2023-06-29 Thread RKemper
RKemper added a comment. Merged patch (had wrong ticket in commit message): https://gerrit.wikimedia.org/r/c/operations/puppet/+/934403 TASK DETAIL https://phabricator.wikimedia.org/T332314 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: bking

[Wikidata-bugs] [Maniphest] T334823: Add https://opendata.aragon.es/sparql to the list of federated endpoints for WDQS and WCQS

2023-05-30 Thread RKemper
RKemper moved this task from To Be Deployed to Needs Reporting on the Discovery-Search (Current work) board. RKemper added a comment. Should be deployed as of today. TASK DETAIL https://phabricator.wikimedia.org/T334823 WORKBOARD https://phabricator.wikimedia.org/project/board/1227

[Wikidata-bugs] [Maniphest] T335994: Allow federated queries to the UNESCO SPARQL endpoint

2023-05-22 Thread RKemper
RKemper added a comment. Thanks for the patience on this! This is getting deployed today. TASK DETAIL https://phabricator.wikimedia.org/T335994 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: RKemper Cc: RKemper, Olea, PKM, Aklapper, dcausse

[Wikidata-bugs] [Maniphest] T324811: Create WDQS Lag SLO dashboard with Grizzly && documentation

2023-05-22 Thread RKemper
RKemper added a comment. Documentation aspect of this ticket's already done. Basically two things left to do to close this ticket out: - Understand the current non-grizzly dashboard (https://grafana-rw.wikimedia.org/d/yCBd7Tdnk/wdqs-wcqs-lag-slo?forceLogin=1=2); we saw some numbers

[Wikidata-bugs] [Maniphest] T324811: Create WDQS Lag SLO dashboard with Grizzly && documentation

2023-05-22 Thread RKemper
RKemper changed the point value for this task from "3" to "5". TASK DETAIL https://phabricator.wikimedia.org/T324811 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: RKemper Cc: RKemper, Gehel, Aklapper, Astuthiodit_1, kara

[Wikidata-bugs] [Maniphest] T324811: Create WDQS Lag SLO dashboard with Grizzly && documentation

2023-05-22 Thread RKemper
RKemper updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T324811 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: RKemper Cc: RKemper, Gehel, Aklapper, Astuthiodit_1, karapayneWMDE, Invadibot, MPhamWMF, maantietaja

[Wikidata-bugs] [Maniphest] T336577: Update WDQS Runbook following update lag incident

2023-05-15 Thread RKemper
RKemper updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T336577 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: RKemper Cc: Gehel, Aklapper, Astuthiodit_1, AWesterinen, karapayneWMDE, Invadibot, Zabe, MPhamWMF

[Wikidata-bugs] [Maniphest] T303134: Should wdqs LVS checks page

2023-05-09 Thread RKemper
RKemper updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T303134 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: RKemper Cc: bking, RKemper, jbond, Aklapper, Astuthiodit_1, AWesterinen, karapayneWMDE, Invadibot, MPhamWMF

[Wikidata-bugs] [Maniphest] T313751: Create WDQS uptime SLO

2023-05-09 Thread RKemper
RKemper moved this task from In Progress to Needs Reporting on the Discovery-Search (Current work) board. RKemper added a comment. With https://gerrit.wikimedia.org/r/c/operations/grafana-grizzly/+/917938, we now have the grizzly dashboard where we want it. That was the last blocker

[Wikidata-bugs] [Maniphest] T323064: Create WDQS Uptime SLO dashboard in Grizzly

2023-05-09 Thread RKemper
RKemper added a comment. Forgot to link patch but here's the (hopefully final) grizzly patch to get this where we want it: https://gerrit.wikimedia.org/r/c/operations/grafana-grizzly/+/917938 (patch already merged & deployed) TASK DETAIL https://phabricator.wikimedia.org/T32

[Wikidata-bugs] [Maniphest] T333656: Decommission query-preview.wikidata.org

2023-05-04 Thread RKemper
RKemper updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T333656 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: RKemper Cc: Lydia_Pintscher, Dzahn, RKemper, Aklapper, Gehel, Astuthiodit_1, AWesterinen, karapayneWMDE

[Wikidata-bugs] [Maniphest] T303134: Should wdqs LVS checks page

2023-04-17 Thread RKemper
RKemper updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T303134 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: RKemper Cc: bking, RKemper, jbond, Aklapper, Astuthiodit_1, AWesterinen, karapayneWMDE, Invadibot, MPhamWMF

[Wikidata-bugs] [Maniphest] T333656: Decommission query-preview.wikidata.org

2023-04-13 Thread RKemper
RKemper updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T333656 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Dzahn, RKemper Cc: Lydia_Pintscher, Dzahn, RKemper, Aklapper, Gehel, Themindcoder, Adamm71, Jersione

[Wikidata-bugs] [Maniphest] T333656: Decommission query-preview.wikidata.org

2023-04-13 Thread RKemper
RKemper updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T333656 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Dzahn, RKemper Cc: Lydia_Pintscher, Dzahn, RKemper, Aklapper, Gehel, Themindcoder, Adamm71, Jersione

[Wikidata-bugs] [Maniphest] T333656: Decommission query-preview.wikidata.org

2023-04-12 Thread RKemper
RKemper added a comment. In T333656#8773505 <https://phabricator.wikimedia.org/T333656#8773505>, @Dzahn wrote: > hi @RKemper was wondering if you can bring this one up in your team meeting or so (no rush, but would be nice to have): https://gerrit.wikimedia.org/r/c/opera

[Wikidata-bugs] [Maniphest] T333656: Decommission query-preview.wikidata.org

2023-04-03 Thread RKemper
RKemper renamed this task from "Decommission query-preview.wikdiata.org" to "Decommission query-preview.wikidata.org". TASK DETAIL https://phabricator.wikimedia.org/T333656 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To:

[Wikidata-bugs] [Maniphest] T301167: Service implementation for wdqs20[09,10,11,12]

2023-03-02 Thread RKemper
RKemper added a comment. Decom ticket for dc-ops: T331074 <https://phabricator.wikimedia.org/T331074> TASK DETAIL https://phabricator.wikimedia.org/T301167 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: bking, RKemper Cc: jcrespo,

[Wikidata-bugs] [Maniphest] T303134: Should wdqs LVS checks page

2023-02-28 Thread RKemper
RKemper added a parent task: T325324: Evaluate options to soften wdqs paging. TASK DETAIL https://phabricator.wikimedia.org/T303134 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: RKemper Cc: bking, RKemper, jbond, Aklapper, Astuthiodit_1

[Wikidata-bugs] [Maniphest] T313751: Create WDQS uptime SLO

2023-02-28 Thread RKemper
RKemper added a subtask: T325324: Evaluate options to soften wdqs paging. TASK DETAIL https://phabricator.wikimedia.org/T313751 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: RKemper Cc: RLazarus, Gehel, MPhamWMF, Aklapper, Astuthiodit_1

[Wikidata-bugs] [Maniphest] T313751: Create WDQS uptime SLO

2023-02-28 Thread RKemper
RKemper updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T313751 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: RKemper Cc: RLazarus, Gehel, MPhamWMF, Aklapper, Astuthiodit_1, AWesterinen, karapayneWMDE, Invadibot

[Wikidata-bugs] [Maniphest] T324811: Create WDQS Lag SLO dashboard with Grizzly && documentation

2023-02-28 Thread RKemper
RKemper moved this task from Ready for Dev -- SRE/Ops to Needs Reporting on the Discovery-Search (Current work) board. RKemper claimed this task. TASK DETAIL https://phabricator.wikimedia.org/T324811 WORKBOARD https://phabricator.wikimedia.org/project/board/1227/ EMAIL PREFERENCES https

[Wikidata-bugs] [Maniphest] T324811: Create WDQS Lag SLO dashboard with Grizzly && documentation

2023-02-28 Thread RKemper
RKemper added a comment. Fully deployed latest (working) dashboard: ryankemper@grafana1002:~/grafana-grizzly$ grr diff slo_dashboards.jsonnet Dashboard/slo-WDQS changes detected: --- Remote +++ Local @@ -86,7 +86,7 @@ "span": 6,

[Wikidata-bugs] [Maniphest] T324811: Create WDQS Lag SLO dashboard with Grizzly && documentation

2023-02-28 Thread RKemper
RKemper updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T324811 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: RKemper Cc: RKemper, Gehel, Aklapper, Astuthiodit_1, karapayneWMDE, Invadibot, MPhamWMF, maantietaja, CBogen

[Wikidata-bugs] [Maniphest] T301167: Service implementation for wdqs20[09,10,11,12]

2023-02-28 Thread RKemper
RKemper updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T301167 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: bking, RKemper Cc: jcrespo, bking, Aklapper, RKemper, Themindcoder, Adamm71, Jersione, Hellket777

[Wikidata-bugs] [Maniphest] T301167: Service implementation for wdqs20[09,10,11,12]

2023-02-27 Thread RKemper
RKemper updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T301167 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: bking, RKemper Cc: jcrespo, bking, Aklapper, RKemper, Themindcoder, Adamm71, Jersione, Hellket777

[Wikidata-bugs] [Maniphest] T301167: Service implementation for wdqs20[09,10,11,12]

2023-02-27 Thread RKemper
RKemper added a comment. In T301167#8650988 <https://phabricator.wikimedia.org/T301167#8650988>, @RKemper wrote: > Arbitrarily chosen `wdqs2012` is happy as seen by our query test suite: > > F36875227: image.png <https://phabricator.wikimedia.org/F36875227>

[Wikidata-bugs] [Maniphest] T301167: Service implementation for wdqs20[09,10,11,12]

2023-02-27 Thread RKemper
RKemper added a comment. Arbitrarily chosen `wdqs2012` is happy as seen by our query test suite: F36875227: image.png <https://phabricator.wikimedia.org/F36875227> All that should be left is decoming wdqs200[1-3] TASK DETAIL https://phabricator.wikimedia.org/T301167

[Wikidata-bugs] [Maniphest] T301167: Service implementation for wdqs20[09,10,11,12]

2023-02-27 Thread RKemper
RKemper updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T301167 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: bking, RKemper Cc: jcrespo, bking, Aklapper, RKemper, Themindcoder, Adamm71, Jersione, Hellket777

[Wikidata-bugs] [Maniphest] T301167: Service implementation for wdqs20[09,10,11,12]

2023-02-27 Thread RKemper
RKemper updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T301167 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: bking, RKemper Cc: jcrespo, bking, Aklapper, RKemper, Themindcoder, Adamm71, Jersione, Hellket777

[Wikidata-bugs] [Maniphest] T324811: Create WDQS Lag SLO dashboard with Grizzly && documentation

2023-02-01 Thread RKemper
RKemper renamed this task from "Create WDQS Lag SLO dashboard with Grizzly" to "Create WDQS Lag SLO dashboard with Grizzly && documentation". RKemper updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T324811 EMAIL PREFERENCES https

[Wikidata-bugs] [Maniphest] T324788: Create WDQS/WCQS update lag SLO dashboard in Grizzly

2023-02-01 Thread RKemper
RKemper updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T324788 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: RKemper Cc: RKemper, Aklapper, Astuthiodit_1, AWesterinen, karapayneWMDE, Invadibot, MPhamWMF, maantietaja

[Wikidata-bugs] [Maniphest] T327210: Very high maxlag on Wikidata

2023-01-17 Thread RKemper
RKemper closed this task as "Resolved". RKemper claimed this task. RKemper added a comment. A WDQS server's blazegraph was deadlocked, and I restarted it. Leaving the deadlock let the server "realize" how far behind it was. I forgot to depool the server after the res

[Wikidata-bugs] [Maniphest] T301167: Service implementation for wdqs20[09,10,11,12]

2023-01-17 Thread RKemper
RKemper added a comment. In T301167#8516140 <https://phabricator.wikimedia.org/T301167#8516140>, @jcrespo wrote: > One tip to avoid having people on call (like me) worrying about pending implementation services is to add the hiera key `profile::monitoring::notifications_enabl

[Wikidata-bugs] [Maniphest] T323064: Create WDQS Uptime SLO dashboard in Grizzly

2022-12-08 Thread RKemper
RKemper updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T323064 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: RKemper Cc: Aklapper, Gehel, RKemper, Adamm71, Jersione, Hellket777, LisafBia6531, Astuthiodit_1, AWesterinen

[Wikidata-bugs] [Maniphest] T323064: Create WDQS Uptime SLO dashboard in Grizzly

2022-12-08 Thread RKemper
RKemper renamed this task from "Create WDQS Uptime SLO && WDQS/WCQS update lag SLO dashboards in Grizzly" to "Create WDQS Uptime SLO dashboard in Grizzly". RKemper updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T32306

[Wikidata-bugs] [Maniphest] T323064: Create WDQS Uptime SLO && WDQS/WCQS update lag SLO dashboards in Grizzly

2022-12-08 Thread RKemper
RKemper added a comment. ryankemper@grafana1002:/srv/grafana-grizzly$ grr diff slo_dashboards.jsonnet Dashboard/slo-logstash-tmpl no differences Dashboard/slo-trafficserver-tmpl no differences Dashboard/slo-varnish-tmpl no differences Dashboard/slo-wdqs-tmpl not present

[Wikidata-bugs] [Maniphest] T301167: Service implementation for wdqs20[09,10,11,12]

2022-12-07 Thread RKemper
RKemper moved this task from Prioritized to Blocked/Waiting on the Discovery-Search (Current work) board. RKemper added a comment. Waiting for data reload to complete on `wdqs2009` (or another host) before we finish data transfers and pool these hosts TASK DETAIL https

[Wikidata-bugs] [Maniphest] T316236: Reload WCQS from dumps

2022-12-06 Thread RKemper
RKemper reopened this task as "Open". RKemper added a comment. In T316236#8415706 <https://phabricator.wikimedia.org/T316236#8415706>, @RKemper wrote: > Moved to `Needs Reporting`. Usually we leave tickets open but move them to needs reporting and then gehel closes a

  1   2   3   >