[Wikidata-bugs] [Maniphest] T258590: Decide on HTTP vs HTTPS for concept URIs on Commons

2020-07-22 Thread Gehel
Gehel created this task. Gehel added projects: Wikidata, Wikidata-Query-Service. Restricted Application added a subscriber: Aklapper. TASK DESCRIPTION As a Commons user, I want a decision to be made on using HTTP or HTTPS for concept URIs to have a consistent usage across SPARQL, dumps

[Wikidata-bugs] [Maniphest] T258508: WDQS | Prefix showing http instead of https

2020-07-22 Thread Gehel
Gehel added a comment. This is related to T226453 <https://phabricator.wikimedia.org/T226453>. TASK DETAIL https://phabricator.wikimedia.org/T258508 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel Cc: Gehel, Headingtona, Aklapper,

[Wikidata-bugs] [Maniphest] T255399: Prepare wdqs1009 to run the streaming updater

2020-07-22 Thread Gehel
Gehel updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T255399 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: RKemper, Gehel Cc: Ottomata, Aklapper, dcausse, CBogen, Akuckartz, darthmon_wmde, Nandana, Namenlos314, Lahi

[Wikidata-bugs] [Maniphest] T246345: Service implementation on wdqs101[1-3].eqiad.wmnet

2020-07-22 Thread Gehel
Gehel triaged this task as "High" priority. TASK DETAIL https://phabricator.wikimedia.org/T246345 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: RKemper, Gehel Cc: Gehel, Aklapper, CBogen, Akuckartz, darthmon_wmde, Nandana, Namenlos314,

[Wikidata-bugs] [Maniphest] T240831: Sometimes Q77104211 shows up in sparql query as having a wrong value for P2397, however item is deleted since December 3rd 2019

2020-07-20 Thread Gehel
Gehel closed this task as "Resolved". Gehel claimed this task. Gehel added a comment. This should be fixed by latest data reload (T252068 <https://phabricator.wikimedia.org/T252068>). Feelf ree to reopen if that's not the case. TASK DETAIL https://phabricator.wikimedia.or

[Wikidata-bugs] [Maniphest] T245135: Too many values for wikibase:geoLatitude and wikibase:geoLongitude in WDQS

2020-07-20 Thread Gehel
Gehel closed this task as "Resolved". Gehel claimed this task. Gehel added a comment. This has been fixed by the latest WDQS data reload (T252068 <https://phabricator.wikimedia.org/T252068>). TASK DETAIL https://phabricator.wikimedia.org/T245135 EMAIL PRE

[Wikidata-bugs] [Maniphest] T258269: Add query result to the current WDQS event logging

2020-07-17 Thread Gehel
Gehel created this task. Gehel added a project: Wikidata-Query-Service. Restricted Application added a subscriber: Aklapper. Restricted Application added a project: Wikidata. TASK DESCRIPTION As part of the analysis of WDQS queries, knowing about the query results as well as the queries

[Wikidata-bugs] [Maniphest] T257045: [Epic] Better understanding of WDQS users and use cases

2020-07-17 Thread Gehel
Gehel added subscribers: JAllemandou, Addshore. Gehel updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T257045 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel Cc: Addshore, JAllemandou, darthmon_wmde, Gehel, Aklapper

[Wikidata-bugs] [Maniphest] T257045: [Epic] Better understanding of WDQS users and use cases

2020-07-17 Thread Gehel
Gehel updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T257045 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel Cc: Addshore, JAllemandou, darthmon_wmde, Gehel, Aklapper, NavinRizwi, CBogen, Akuckartz, DannyS712

[Wikidata-bugs] [Maniphest] T246345: Service implementation on wdqs101[1-3].eqiad.wmnet

2020-07-17 Thread Gehel
Gehel reassigned this task from Gehel to RKemper. TASK DETAIL https://phabricator.wikimedia.org/T246345 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: RKemper, Gehel Cc: Gehel, Aklapper, CBogen, Akuckartz, darthmon_wmde, Nandana, Namenlos314, Lahi

[Wikidata-bugs] [Maniphest] T221632: Storage capacity upgrade for WDQS

2020-07-17 Thread Gehel
Gehel merged a task: T221882: WDQS public cluster capacity upgrade. TASK DETAIL https://phabricator.wikimedia.org/T221632 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel Cc: wiki_willy, mark, RobH, faidon, Smalyshev, Aklapper, Gehel, CBogen

[Wikidata-bugs] [Maniphest] T221882: WDQS public cluster capacity upgrade

2020-07-17 Thread Gehel
Gehel closed this task as a duplicate of T221632: Storage capacity upgrade for WDQS. TASK DETAIL https://phabricator.wikimedia.org/T221882 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel Cc: Aklapper, Gehel, Smalyshev, CBogen, Akuckartz

[Wikidata-bugs] [Maniphest] T236884: [Recurring task] Upstream changes to Blazegraph that we have in our own fork

2020-07-17 Thread Gehel
Gehel removed a project: Discovery-Search (Current work). TASK DETAIL https://phabricator.wikimedia.org/T236884 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel Cc: Lucas_Werkmeister_WMDE, dcausse, Igorkim78, Gehel, Aklapper, NavinRizwi, CBogen

[Wikidata-bugs] [Maniphest] T244341: Stop using blank nodes for encoding SomeValue and OWL constraints in WDQS

2020-07-13 Thread Gehel
Gehel closed subtask T245533: Add a custom function wikibase:isSomeValue to identify wikibase somevalue as Resolved. TASK DETAIL https://phabricator.wikimedia.org/T244341 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel Cc: TomT0m, Gehel

[Wikidata-bugs] [Maniphest] T245533: Add a custom function wikibase:isSomeValue to identify wikibase "somevalue"

2020-07-13 Thread Gehel
Gehel closed this task as "Resolved". TASK DETAIL https://phabricator.wikimedia.org/T245533 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: dcausse, Gehel Cc: Lucas_Werkmeister_WMDE, Aklapper, dcausse, CBogen, Akuckartz, darthmon_wmd

[Wikidata-bugs] [Maniphest] T244590: EPIC: Rework the WDQS updater as an event driven application

2020-07-13 Thread Gehel
Gehel closed subtask T251275: [WDQS Streaming Updater] Update blazegraph based on the content present in the streaming updater output kafka stream as Resolved. TASK DETAIL https://phabricator.wikimedia.org/T244590 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel

[Wikidata-bugs] [Maniphest] T251275: [WDQS Streaming Updater] Update blazegraph based on the content present in the streaming updater output kafka stream

2020-07-13 Thread Gehel
Gehel closed this task as "Resolved". TASK DETAIL https://phabricator.wikimedia.org/T251275 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: dcausse, Gehel Cc: dcausse, Aklapper, CBogen, Akuckartz, darthmon_wmde, Nandana, Namenlos314,

[Wikidata-bugs] [Maniphest] T244590: EPIC: Rework the WDQS updater as an event driven application

2020-07-13 Thread Gehel
Gehel closed subtask T251270: The streaming updater should produce its events to kafka as Resolved. TASK DETAIL https://phabricator.wikimedia.org/T244590 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel Cc: revi, Mholloway, Ladsgroup

[Wikidata-bugs] [Maniphest] T245541: Add a new munge option to do blank node skolemization

2020-07-13 Thread Gehel
Gehel closed this task as "Resolved". TASK DETAIL https://phabricator.wikimedia.org/T245541 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: dcausse, Gehel Cc: Addshore, Aklapper, Lucas_Werkmeister_WMDE, mkroetzsch, Daniel_Mietchen, Jheal

[Wikidata-bugs] [Maniphest] T244341: Stop using blank nodes for encoding SomeValue and OWL constraints in WDQS

2020-07-13 Thread Gehel
Gehel closed subtask T245541: Add a new munge option to do blank node skolemization as Resolved. TASK DETAIL https://phabricator.wikimedia.org/T244341 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel Cc: TomT0m, Gehel, Multichill, Pfps, Mmarx

[Wikidata-bugs] [Maniphest] T251270: The streaming updater should produce its events to kafka

2020-07-13 Thread Gehel
Gehel closed this task as "Resolved". TASK DETAIL https://phabricator.wikimedia.org/T251270 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: dcausse, Gehel Cc: Aklapper, dcausse, Alter-paule, Beast1978, CBogen, Un1tY, Akuckartz

[Wikidata-bugs] [Maniphest] T237089: Create CQS puppet configs by applying query_service module

2020-07-13 Thread Gehel
Gehel closed this task as "Resolved". TASK DETAIL https://phabricator.wikimedia.org/T237089 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: EBernhardson, Gehel Cc: Aklapper, Igorkim78, Gehel, Liuxinyu970226, Mathew.onipe, lmata, A

[Wikidata-bugs] [Maniphest] T251488: [epic] Create minimal SPARQL Endpoint for Commons on WMCS

2020-07-13 Thread Gehel
Gehel closed subtask T237089: Create CQS puppet configs by applying query_service module as Resolved. TASK DETAIL https://phabricator.wikimedia.org/T251488 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel Cc: Zbyszko, Smalyshev, Ramsey-WMF

[Wikidata-bugs] [Maniphest] T244590: EPIC: Rework the WDQS updater as an event driven application

2020-07-13 Thread Gehel
Gehel closed subtask T245728: Add a component to generate a diff between two entity revisions as Resolved. TASK DETAIL https://phabricator.wikimedia.org/T244590 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel Cc: revi, Mholloway, Ladsgroup

[Wikidata-bugs] [Maniphest] T245728: Add a component to generate a diff between two entity revisions

2020-07-13 Thread Gehel
Gehel closed this task as "Resolved". TASK DETAIL https://phabricator.wikimedia.org/T245728 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: dcausse, Gehel Cc: Gehel, Zbyszko, Aklapper, dcausse, CBogen, Akuckartz, darthmon_wmde, Nandana, N

[Wikidata-bugs] [Maniphest] T244590: EPIC: Rework the WDQS updater as an event driven application

2020-07-13 Thread Gehel
Gehel closed subtask T248464: [WDQS Streaming Updater] Implement ouput format in Streaming Updater as Resolved. TASK DETAIL https://phabricator.wikimedia.org/T244590 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel Cc: revi, Mholloway

[Wikidata-bugs] [Maniphest] T248452: [WDQS Streaming Updater] Deploy and configure Streaming Updater Hadoop YARN

2020-07-13 Thread Gehel
Gehel closed this task as "Resolved". Gehel claimed this task. Gehel added a comment. Streaming updater is deployed and working on Hadoop / Yarn. TASK DETAIL https://phabricator.wikimedia.org/T248452 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailp

[Wikidata-bugs] [Maniphest] T244590: EPIC: Rework the WDQS updater as an event driven application

2020-07-13 Thread Gehel
Gehel closed subtask T248452: [WDQS Streaming Updater] Deploy and configure Streaming Updater Hadoop YARN as Resolved. TASK DETAIL https://phabricator.wikimedia.org/T244590 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel Cc: revi, Mholloway

[Wikidata-bugs] [Maniphest] T248464: [WDQS Streaming Updater] Implement ouput format in Streaming Updater

2020-07-13 Thread Gehel
Gehel closed this task as "Resolved". TASK DETAIL https://phabricator.wikimedia.org/T248464 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: dcausse, Gehel Cc: Aklapper, Zbyszko, CBogen, Akuckartz, darthmon_wmde, Nandana, Namenlos314,

[Wikidata-bugs] [Maniphest] T255753: Wikidata Query Service MWAPI calls with bd:serviceParam wikibase:limit "once" execute 2 API calls instead of 1

2020-07-13 Thread Gehel
Gehel closed this task as "Resolved". Gehel added a comment. The fix has been deployed, please re-open if you still see the issue. TASK DETAIL https://phabricator.wikimedia.org/T255753 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailp

[Wikidata-bugs] [Maniphest] T251488: [epic] Create minimal SPARQL Endpoint for Commons on WMCS

2020-07-13 Thread Gehel
Gehel closed subtask T251490: Load data into the SPARQL Endpoint for Commons as Resolved. TASK DETAIL https://phabricator.wikimedia.org/T251488 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel Cc: Zbyszko, Smalyshev, Ramsey-WMF, Cparle

[Wikidata-bugs] [Maniphest] T251490: Load data into the SPARQL Endpoint for Commons

2020-07-13 Thread Gehel
Gehel closed this task as "Resolved". Gehel claimed this task. Gehel added a comment. Data loaded, no obvious problem seen. TASK DETAIL https://phabricator.wikimedia.org/T251490 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel Cc

[Wikidata-bugs] [Maniphest] T243270: Test commons RDF dumps on sdcquery.wmflabs.org

2020-07-13 Thread Gehel
Gehel added a comment. Dumps have been loaded on the test server, no problem seen except the prefix mismatched which is tracked on T251496 <https://phabricator.wikimedia.org/T251496> TASK DETAIL https://phabricator.wikimedia.org/T243270 EMAIL PREFERENCES

[Wikidata-bugs] [Maniphest] T243270: Test commons RDF dumps on sdcquery.wmflabs.org

2020-07-13 Thread Gehel
Gehel closed this task as "Resolved". Gehel claimed this task. TASK DETAIL https://phabricator.wikimedia.org/T243270 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel Cc: Zbyszko, Addshore, WMDE-leszek, dcausse, Aklapper, CBogen,

[Wikidata-bugs] [Maniphest] T251496: Validate and fix TTL dumps of SDoC

2020-07-13 Thread Gehel
Gehel added a comment. Rename of the dumps in the prefixes needs to be corrected. See https://gerrit.wikimedia.org/r/c/operations/mediawiki-config/+/609987 TASK DETAIL https://phabricator.wikimedia.org/T251496 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel

[Wikidata-bugs] [Maniphest] T251500: oAuth authentication for SPARQL Endpoint for Commons

2020-07-13 Thread Gehel
Gehel closed this task as "Resolved". TASK DETAIL https://phabricator.wikimedia.org/T251500 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Zbyszko, Gehel Cc: Mstyles, Aklapper, Gehel, Alter-paule, Beast1978, CBogen, Un1tY, Akuckartz

[Wikidata-bugs] [Maniphest] T251497: Adapt munging process for SDoC

2020-07-13 Thread Gehel
Gehel moved this task from SDAW to Current work on the Wikidata-Query-Service board. Gehel added a project: Discovery-Search (Current work). TASK DETAIL https://phabricator.wikimedia.org/T251497 WORKBOARD https://phabricator.wikimedia.org/project/board/891/ EMAIL PREFERENCES https

[Wikidata-bugs] [Maniphest] T251498: Access restriction for SPARQL Endpoint for Commons

2020-07-13 Thread Gehel
Gehel closed subtask T251500: oAuth authentication for SPARQL Endpoint for Commons as Resolved. TASK DETAIL https://phabricator.wikimedia.org/T251498 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel Cc: Akuckartz, Lea_Lacroix_WMDE, Aklapper

[Wikidata-bugs] [Maniphest] T251490: Load data into the SPARQL Endpoint for Commons

2020-07-13 Thread Gehel
Gehel moved this task from SDAW to Current work on the Wikidata-Query-Service board. Gehel added a project: Discovery-Search (Current work). TASK DETAIL https://phabricator.wikimedia.org/T251490 WORKBOARD https://phabricator.wikimedia.org/project/board/891/ EMAIL PREFERENCES https

[Wikidata-bugs] [Maniphest] T251500: oAuth authentication for SPARQL Endpoint for Commons

2020-07-13 Thread Gehel
Gehel moved this task from SDAW to Current work on the Wikidata-Query-Service board. Gehel added a project: Discovery-Search (Current work). TASK DETAIL https://phabricator.wikimedia.org/T251500 WORKBOARD https://phabricator.wikimedia.org/project/board/891/ EMAIL PREFERENCES https

[Wikidata-bugs] [Maniphest] T251496: Validate and fix TTL dumps of SDoC

2020-07-13 Thread Gehel
Gehel moved this task from SDAW to Current work on the Wikidata-Query-Service board. Gehel added a project: Discovery-Search (Current work). TASK DETAIL https://phabricator.wikimedia.org/T251496 WORKBOARD https://phabricator.wikimedia.org/project/board/891/ EMAIL PREFERENCES https

[Wikidata-bugs] [Maniphest] [Unblock] T141602: [Objective Fiscal 19-20/Q4] (9) Provide a Proof of Concept SPARQL endpoint in support of SDoC project

2020-07-09 Thread Gehel
Gehel closed subtask T221917: Create RDF dump of structured data on Commons as Resolved. TASK DETAIL https://phabricator.wikimedia.org/T141602 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel Cc: danshick-wmde, Gamaliel, Lea_Lacroix_WMDE

[Wikidata-bugs] [Maniphest] [Closed] T221917: Create RDF dump of structured data on Commons

2020-07-09 Thread Gehel
Gehel closed this task as "Resolved". Gehel added a comment. The dumps are now lived! And it has been communicated on wikidata-l. TASK DETAIL https://phabricator.wikimedia.org/T221917 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To:

[Wikidata-bugs] [Maniphest] [Edited] T257055: WDQS - Planning for disaster (significant failure of the project)

2020-07-09 Thread Gehel
Gehel updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T257055 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel Cc: Gehel, Aklapper, CBogen, Akuckartz, darthmon_wmde, Nandana, Namenlos314, Lahi, Gq86

[Wikidata-bugs] [Maniphest] [Updated] T161240: Expose wikidata query service LDF endpoint in a scalable and available way

2020-07-06 Thread Gehel
Gehel added a subtask: T256948: Evaluate using LinkedDataFragments/Server.js instead of custom blazegraph integration. TASK DETAIL https://phabricator.wikimedia.org/T161240 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel Cc: Smalyshev, Gehel

[Wikidata-bugs] [Maniphest] [Updated] T256948: Evaluate using LinkedDataFragments/Server.js instead of custom blazegraph integration

2020-07-06 Thread Gehel
Gehel added a parent task: T161240: Expose wikidata query service LDF endpoint in a scalable and available way. TASK DETAIL https://phabricator.wikimedia.org/T256948 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel Cc: dcausse, Aklapper, CBogen

[Wikidata-bugs] [Maniphest] [Created] T257055: WDQS - Planning for disaster (significant failure of the project)

2020-07-03 Thread Gehel
Gehel created this task. Gehel added a project: Wikidata-Query-Service. Restricted Application added a subscriber: Aklapper. Restricted Application added a project: Wikidata. TASK DESCRIPTION We know that WDQS is getting close to the scaling limits. While we want to make WDQS scale, we need

[Wikidata-bugs] [Maniphest] [Created] T257045: [Epic] Better understanding of WDQS users and use cases

2020-07-03 Thread Gehel
Gehel created this task. Gehel added projects: Wikidata-Query-Service, Epic. Restricted Application added a subscriber: Aklapper. Restricted Application added a project: Wikidata. TASK DESCRIPTION To better understand how WDQS can be improved (particularly in terms of scaling) we need a better

[Wikidata-bugs] [Maniphest] [Reassigned] T240328: Slow indexing for wbsearchentities

2020-07-03 Thread Gehel
Gehel reassigned this task from Fnielsen to dcausse. Gehel added a comment. @dcausse could you have another look into this? Looking at job queue stats <https://grafana.wikimedia.org/d/LSeAShkGz/jobqueue?panelId=2=1>, the rate of the various Cirrus jobs seems stable, but I'm not fa

[Wikidata-bugs] [Maniphest] [Block] T141602: [Objective Fiscal 19-20/Q4] (9) Provide a Proof of Concept SPARQL endpoint in support of SDoC project

2020-07-01 Thread Gehel
Gehel reopened subtask T221921: Provision search endpoint for SDC. Requirements from Product Team. as Open. TASK DETAIL https://phabricator.wikimedia.org/T141602 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel Cc: danshick-wmde, Gamaliel

[Wikidata-bugs] [Maniphest] [Reopened] T221921: Provision search endpoint for SDC. Requirements from Product Team.

2020-07-01 Thread Gehel
Gehel reopened this task as "Open". TASK DETAIL https://phabricator.wikimedia.org/T221921 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel Cc: David_Haskiya_WMSE, CBogen, Gamaliel, Keegan, Jane023, Spinster, Fuzheado, Jarekt, Husky, T

[Wikidata-bugs] [Maniphest] [Merged] T251488: [epic] Create minimal SPARQL Endpoint for Commons on WMCS

2020-07-01 Thread Gehel
Gehel merged a task: T221921: Provision search endpoint for SDC. Requirements from Product Team.. Gehel added subscribers: Nuria, David_Haskiya_WMSE, CBogen, Gamaliel, Keegan, Jane023, Spinster, Fuzheado, Jarekt, Husky, Tagishsimon, Multichill, Tnegrin, Abbe98, Marsupium, Tpt

[Wikidata-bugs] [Maniphest] [Updated] T221921: Provision search endpoint for SDC. Requirements from Product Team.

2020-07-01 Thread Gehel
Gehel closed this task as a duplicate of T251488: [epic] Create minimal SPARQL Endpoint for Commons on WMCS. TASK DETAIL https://phabricator.wikimedia.org/T221921 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel Cc: David_Haskiya_WMSE, CBogen

[Wikidata-bugs] [Maniphest] [Closed] T232743: JavaScript parts of query service UI not working on Commons Query Service (Beta)

2020-07-01 Thread Gehel
Gehel closed this task as "Resolved". Gehel claimed this task. Gehel added a comment. This has been fixed on the new prototype WCQS. TASK DETAIL https://phabricator.wikimedia.org/T232743 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To

[Wikidata-bugs] [Maniphest] [Closed] T251489: Validate that we have enough resources on WMCS for a SPARQL Endpoint for Commons

2020-07-01 Thread Gehel
Gehel closed this task as "Resolved". Gehel added a comment. We have enough space and a partial prototype running on WMCS TASK DETAIL https://phabricator.wikimedia.org/T251489 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: EBernhardson

[Wikidata-bugs] [Maniphest] [Retitled] T251488: [epic] Create minimal SPARQL Endpoint for Commons on WMCS

2020-07-01 Thread Gehel
Gehel renamed this task from "Create minimal SPARQL Endpoint for Commons on WMCS" to "[epic] Create minimal SPARQL Endpoint for Commons on WMCS". TASK DETAIL https://phabricator.wikimedia.org/T251488 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/pa

[Wikidata-bugs] [Maniphest] [Updated] T251488: [epic] Create minimal SPARQL Endpoint for Commons on WMCS

2020-07-01 Thread Gehel
Gehel added a project: Epic. TASK DETAIL https://phabricator.wikimedia.org/T251488 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel Cc: Lea_Lacroix_WMDE, Aklapper, Gehel, NavinRizwi, CBogen, darthmon_wmde, DannyS712, Nandana, Namenlos314, Lahi

[Wikidata-bugs] [Maniphest] [Unblock] T251488: [epic] Create minimal SPARQL Endpoint for Commons on WMCS

2020-07-01 Thread Gehel
Gehel closed subtask T251489: Validate that we have enough resources on WMCS for a SPARQL Endpoint for Commons as Resolved. TASK DETAIL https://phabricator.wikimedia.org/T251488 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel Cc

[Wikidata-bugs] [Maniphest] [Updated] T251489: Validate that we have enough resources on WMCS for a SPARQL Endpoint for Commons

2020-06-30 Thread Gehel
Gehel added a project: Discovery-Search (Current work). TASK DETAIL https://phabricator.wikimedia.org/T251489 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: EBernhardson, Gehel Cc: Gehel, Aklapper, CBogen, darthmon_wmde, Nandana, Namenlos314, Lahi

[Wikidata-bugs] [Maniphest] [Updated] T244341: Stop using blank nodes for encoding SomeValue and OWL constraints in WDQS

2020-06-25 Thread Gehel
Gehel added a project: Epic. TASK DETAIL https://phabricator.wikimedia.org/T244341 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel Cc: TomT0m, Gehel, Multichill, Pfps, Mmarx, Dipsacus_fullonum, Luitzen, VladimirAlexiev, Lea_Lacroix_WMDE

[Wikidata-bugs] [Maniphest] [Updated] T248452: [WDQS Streaming Updater] Deploy and configure Streaming Updater Hadoop YARN

2020-06-24 Thread Gehel
Gehel added a project: Discovery-Search (Current work). TASK DETAIL https://phabricator.wikimedia.org/T248452 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel Cc: Aklapper, Zbyszko, CBogen, darthmon_wmde, Nandana, Namenlos314, Lahi, Gq86

[Wikidata-bugs] [Maniphest] [Closed] T249099: [WDQS Streaming Updater] Error during munging process

2020-06-24 Thread Gehel
Gehel closed this task as "Resolved". TASK DETAIL https://phabricator.wikimedia.org/T249099 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Zbyszko, Gehel Cc: dcausse, Aklapper, Zbyszko, CBogen, darthmon_wmde, Nandana, Namenlos314,

[Wikidata-bugs] [Maniphest] [Unblock] T244590: EPIC: Rework the WDQS updater as an event driven application

2020-06-24 Thread Gehel
Gehel closed subtask T249099: [WDQS Streaming Updater] Error during munging process as Resolved. TASK DETAIL https://phabricator.wikimedia.org/T244590 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel Cc: revi, Mholloway, Ladsgroup, Multichill

[Wikidata-bugs] [Maniphest] [Updated] T241128: EPIC: Reduce the time needed to do the initial WDQS import

2020-06-24 Thread Gehel
Gehel added a project: Epic. TASK DETAIL https://phabricator.wikimedia.org/T241128 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel Cc: Addshore, dcausse, Aklapper, NavinRizwi, CBogen, darthmon_wmde, DannyS712, Nandana, Namenlos314, Lahi, Gq86

[Wikidata-bugs] [Maniphest] [Closed] T198078: Extra xsd:decimal triples for some(?) globe coordinate values

2020-06-24 Thread Gehel
Gehel closed this task as "Resolved". Gehel claimed this task. Gehel added a comment. Full dataset has been reloaded, this should fix all similar issues. If you find other duplicated coordinates, please re-open! TASK DETAIL https://phabricator.wikimedia.org/T198078 EMAIL P

[Wikidata-bugs] [Maniphest] [Declined] T208014: Restore polling page-properties-change

2020-06-24 Thread Gehel
Gehel closed this task as "Declined". Gehel added a comment. This is going to be obsolete with the new streaming updater TASK DETAIL https://phabricator.wikimedia.org/T208014 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel

[Wikidata-bugs] [Maniphest] [Commented On] T255044: Many new metrics in Graphite for WDQS-Streaming-Updater-POC

2020-06-17 Thread Gehel
Gehel added a comment. Metrics have been disabled. The urgent issue reported here is fixed, but we still a better way to publish those metrics. TASK DETAIL https://phabricator.wikimedia.org/T255044 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences

[Wikidata-bugs] [Maniphest] [Updated] T255044: Many new metrics in Graphite for WDQS-Streaming-Updater-POC

2020-06-17 Thread Gehel
Gehel added a project: Discovery-Search (Current work). TASK DETAIL https://phabricator.wikimedia.org/T255044 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel Cc: Ladsgroup, Addshore, dcausse, Aklapper, colewhite, CBogen, darthmon_wmde, ET4Eva

[Wikidata-bugs] [Maniphest] [Triaged] T255657: Strange result in Wikidata query

2020-06-17 Thread Gehel
Gehel triaged this task as "High" priority. Gehel moved this task from All WDQS-related tasks to Small Bugs on the Wikidata-Query-Service board. TASK DETAIL https://phabricator.wikimedia.org/T255657 WORKBOARD https://phabricator.wikimedia.org/project/board/891/ EMAIL PREFERENC

[Wikidata-bugs] [Maniphest] [Updated] T254315: entitysources: Directly create entitySources config for WMF production wikis

2020-06-15 Thread Gehel
Gehel added a project: Discovery-Search (Current work). TASK DETAIL https://phabricator.wikimedia.org/T254315 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Addshore, Gehel Cc: Addshore, Aklapper, WMDE-leszek, Blissjay007, Oblanco79, Alter-paule

[Wikidata-bugs] [Maniphest] [Declined] T207837: wdqs updater should be better isolated from blazegraph and common workload should be shared between servers

2020-06-08 Thread Gehel
Gehel closed this task as "Declined". Gehel added a comment. This is being addressed as part of T244590 <https://phabricator.wikimedia.org/T244590> TASK DETAIL https://phabricator.wikimedia.org/T207837 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/

[Wikidata-bugs] [Maniphest] [Unblock] T207817: WDQS Updater ran into issue and stopped working

2020-06-08 Thread Gehel
Gehel closed subtask T207837: wdqs updater should be better isolated from blazegraph and common workload should be shared between servers as Declined. TASK DETAIL https://phabricator.wikimedia.org/T207817 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences

[Wikidata-bugs] [Maniphest] [Commented On] T228709: Make statistics of throttled/denied WDQS clients

2020-06-08 Thread Gehel
Gehel added a comment. We do have a Kibana dashboard that could be used as a basis. We might add a way to filter log for banned / throttled requests. We already have aggregation in place for UA and IP. Implied in the description of this ticket is that we don't just want the dashboards

[Wikidata-bugs] [Maniphest] [Closed] T249701: maps: traffic to maps2004 dropped by iptables

2020-06-03 Thread Gehel
Gehel closed this task as "Resolved". Gehel claimed this task. TASK DETAIL https://phabricator.wikimedia.org/T249701 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel Cc: Gehel, ayounsi, Aklapper, CBogen, Alilje, darthmon_wmd

[Wikidata-bugs] [Maniphest] [Changed Subscribers] T254232: New clusters for SPARQL Endpoint for Commons

2020-06-03 Thread Gehel
Gehel added a subscriber: dcausse. Gehel added a comment. After discussion with @dcausse, we agree that the Ganeti option seems the best at this point. The 16G RAM limit should not be an issue with the data size we have at this point. TASK DETAIL https://phabricator.wikimedia.org/T254232

[Wikidata-bugs] [Maniphest] [Closed] T246497: WDQS Categories update lag alert

2020-06-03 Thread Gehel
Gehel closed this task as "Resolved". TASK DETAIL https://phabricator.wikimedia.org/T246497 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel Cc: dcausse, ayounsi, Aklapper, CBogen, darthmon_wmde, Legado_Shulgin, Nandana, N

[Wikidata-bugs] [Maniphest] [Changed Project Column] T249701: maps: traffic to maps2004 dropped by iptables

2020-06-03 Thread Gehel
Gehel moved this task from Waiting to Done on the Discovery-Search (Current work) board. Gehel added a comment. maps reload is complete and firewall rules have been rolled back TASK DETAIL https://phabricator.wikimedia.org/T249701 WORKBOARD https://phabricator.wikimedia.org/project

[Wikidata-bugs] [Maniphest] [Edited] T254232: New clusters for SPARQL Endpoint for Commons

2020-06-02 Thread Gehel
Gehel updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T254232 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel Cc: akosiaris, Addshore, Aklapper, Gehel, CBogen, darthmon_wmde, Nandana, Namenlos314, Lahi, Gq86

[Wikidata-bugs] [Maniphest] [Edited] T254232: New clusters for SPARQL Endpoint for Commons

2020-06-02 Thread Gehel
Gehel added a subscriber: akosiaris. Gehel updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T254232 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel Cc: akosiaris, Addshore, Aklapper, Gehel, CBogen, darthmon_wmde

[Wikidata-bugs] [Maniphest] [Edited] T254232: New clusters for SPARQL Endpoint for Commons

2020-06-02 Thread Gehel
Gehel updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T254232 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel Cc: Addshore, Aklapper, Gehel, CBogen, darthmon_wmde, Nandana, Namenlos314, Lahi, Gq86

[Wikidata-bugs] [Maniphest] [Edited] T254232: New clusters for SPARQL Endpoint for Commons

2020-06-02 Thread Gehel
Gehel updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T254232 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel Cc: Addshore, Aklapper, Gehel, CBogen, darthmon_wmde, Nandana, Namenlos314, Lahi, Gq86

[Wikidata-bugs] [Maniphest] [Edited] T254232: New clusters for SPARQL Endpoint for Commons

2020-06-02 Thread Gehel
Gehel updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T254232 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel Cc: Addshore, Aklapper, Gehel, CBogen, darthmon_wmde, Nandana, Namenlos314, Lahi, Gq86

[Wikidata-bugs] [Maniphest] [Edited] T254232: New clusters for SPARQL Endpoint for Commons

2020-06-02 Thread Gehel
Gehel updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T254232 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel Cc: Aklapper, Gehel, CBogen, darthmon_wmde, Nandana, Namenlos314, Lahi, Gq86, Lucas_Werkmeister_WMDE

[Wikidata-bugs] [Maniphest] [Created] T254232: New clusters for SPARQL Endpoint for Commons

2020-06-02 Thread Gehel
Gehel created this task. Gehel added a project: Wikidata-Query-Service. Restricted Application added a subscriber: Aklapper. Restricted Application added a project: Wikidata. TASK DESCRIPTION We need a production service for a SPARQL Endpoint for Commons. Estimates on hardware needs

[Wikidata-bugs] [Maniphest] [Triaged] T253718: WDQ should reject invalid datetime literals

2020-05-27 Thread Gehel
Gehel triaged this task as "Low" priority. Gehel moved this task from All WDQS-related tasks to Blazegraph on the Wikidata-Query-Service board. TASK DETAIL https://phabricator.wikimedia.org/T253718 WORKBOARD https://phabricator.wikimedia.org/project/board/891/ EMAIL PREFERENC

[Wikidata-bugs] [Maniphest] [Assigned] T221917: Create RDF dump of structured data on Commons

2020-05-26 Thread Gehel
Gehel assigned this task to ArielGlenn. Gehel added a comment. We've loaded the dump on a test server and it looks fine. We can start scheduling the dumps regularly. TASK DETAIL https://phabricator.wikimedia.org/T221917 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel

[Wikidata-bugs] [Maniphest] [Commented On] T243701: Wikidata maxlag repeatedly over 5s since Jan20, 2020 (primarily caused by the query service)

2020-05-20 Thread Gehel
Gehel added a comment. In T243701#5985617 <https://phabricator.wikimedia.org/T243701#5985617>, @Ladsgroup wrote: > I think this would be a decision by @Lydia_Pintscher plus we need more info from Search platform to know if the issue of WDQS is going to get fixed soon or not (o

[Wikidata-bugs] [Maniphest] [Changed Subscribers] T252739: Define a hard upper limit of query service based maxlag

2020-05-20 Thread Gehel
Gehel added a subscriber: Addshore. Gehel added a comment. Looking at WDQS lag <https://grafana.wikimedia.org/d/00489/wikidata-query-service?panelId=8=1=1m=now-10d=now> and [[ URL | Wikidata lag ]] in parallel, I don't see a clear correlation between the 2. There have been a fe

[Wikidata-bugs] [Maniphest] [Commented On] T252068: WQDS Data Reload

2020-05-15 Thread Gehel
Gehel added a comment. Note: there was a bug (now fixed <https://gerrit.wikimedia.org/r/c/operations/cookbooks/+/596645>) in the cookbook that transferred categories namespace mappings even when no categories were transferred. We need to actually transfer the categories

[Wikidata-bugs] [Maniphest] [Commented On] T252503: Create automatically updated CI test environment

2020-05-13 Thread Gehel
Gehel added a comment. We could use wdqs1009, which at the moment automatically deploys the deploy repo. Instead, we could deploy the current master. TASK DETAIL https://phabricator.wikimedia.org/T252503 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences

[Wikidata-bugs] [Maniphest] [Updated] T252068: WQDS Data Reload

2020-05-11 Thread Gehel
Gehel added a parent task: T246568: Deepcategory returns only very few results. TASK DETAIL https://phabricator.wikimedia.org/T252068 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: RKemper, Gehel Cc: RKemper, Aklapper, CBogen, darthmon_wmde

[Wikidata-bugs] [Maniphest] [Updated] T252068: WQDS Data Reload

2020-05-11 Thread Gehel
Gehel added a parent task: T245135: Too many values for wikibase:geoLatitude and wikibase:geoLongitude in WDQS. TASK DETAIL https://phabricator.wikimedia.org/T252068 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: RKemper, Gehel Cc: RKemper

[Wikidata-bugs] [Maniphest] [Updated] T252068: WQDS Data Reload

2020-05-11 Thread Gehel
Gehel added a parent task: T240831: Sometimes Q77104211 shows up in sparql query as having a wrong value for P2397, however item is deleted since December 3rd 2019. TASK DETAIL https://phabricator.wikimedia.org/T252068 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel

[Wikidata-bugs] [Maniphest] [Updated] T240831: Sometimes Q77104211 shows up in sparql query as having a wrong value for P2397, however item is deleted since December 3rd 2019

2020-05-11 Thread Gehel
Gehel added a subtask: T252068: WQDS Data Reload. TASK DETAIL https://phabricator.wikimedia.org/T240831 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel Cc: Gehel, Aklapper, Mbch331, CBogen, darthmon_wmde, Nandana, Lahi, Gq86

[Wikidata-bugs] [Maniphest] [Updated] T245135: Too many values for wikibase:geoLatitude and wikibase:geoLongitude in WDQS

2020-05-11 Thread Gehel
Gehel added a subtask: T252068: WQDS Data Reload. TASK DETAIL https://phabricator.wikimedia.org/T245135 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel Cc: Lucas_Werkmeister_WMDE, Aklapper, Dipsacus_fullonum, CBogen, darthmon_wmde, Nandana

[Wikidata-bugs] [Maniphest] [Updated] T252068: WQDS Data Reload

2020-05-11 Thread Gehel
Gehel added a parent task: T230588: Wikidata Query Service is swapping items and properties. TASK DETAIL https://phabricator.wikimedia.org/T252068 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: RKemper, Gehel Cc: RKemper, Aklapper, CBogen

[Wikidata-bugs] [Maniphest] [Updated] T230588: Wikidata Query Service is swapping items and properties

2020-05-11 Thread Gehel
Gehel added a subtask: T252068: WQDS Data Reload. TASK DETAIL https://phabricator.wikimedia.org/T230588 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Zbyszko, Gehel Cc: Ghuron, Nikki, Toni_001, Dipsacus_fullonum, Larske, Mathew.onipe, Esc3300

[Wikidata-bugs] [Maniphest] [Commented On] T251467: "Malformed query: QName 'ontolex:lexicalForm' uses an undefined prefix" when running WDQS Updater on Amazon Neptune

2020-05-08 Thread Gehel
Gehel added a comment. In T251467#6099080 <https://phabricator.wikimedia.org/T251467#6099080>, @Harej wrote: > I don't believe I am. I am using the updater script that ships with the wikibase docker image (0.3.6). I'm not sure if the docker version numbers are aligned

[Wikidata-bugs] [Maniphest] [Updated] T252124: Scap configuration for WDQS should get server groups from a known source or truth

2020-05-07 Thread Gehel
Gehel added a project: Scap. TASK DETAIL https://phabricator.wikimedia.org/T252124 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Gehel Cc: Aklapper, RKemper, Gehel, CBogen, darthmon_wmde, Legado_Shulgin, Nandana, Davinaclare77, Qtn1293

[Wikidata-bugs] [Maniphest] [Created] T252124: Scap configuration for WDQS should get server groups from a known source or truth

2020-05-07 Thread Gehel
Gehel created this task. Gehel added projects: Wikidata-Query-Service, Operations. Restricted Application added a subscriber: Aklapper. Restricted Application added a project: Wikidata. TASK DESCRIPTION At the moment, the various wdqs servers are explicitly listed in the scap configuration

<    12   13   14   15   16   17   18   19   20   21   >