[Wikidata-bugs] [Maniphest] T290989: switchdc cache warmup should include URLs that warmup relevant Wikidata caches

2021-09-15 Thread Legoktm
Legoktm added a comment. In T290989#7354905 , @Addshore wrote: > Correct me if I am wrong, but this would also be solved by this cache using WANCache rather than just a BagOStuff? My understanding is that WANCache only sets values

[Wikidata-bugs] [Maniphest] T252443: Create dashboard to show growth of structured data on Commons over time

2021-09-15 Thread kzimmerman
kzimmerman added subscribers: nettrom_WMF, kzimmerman. kzimmerman reassigned this task from nettrom_WMF to cchen. kzimmerman added a comment. Reassigning to Connie as she's now supporting Structured Data TASK DETAIL https://phabricator.wikimedia.org/T252443 EMAIL PREFERENCES

[Wikidata-bugs] [Maniphest] T291089: Proposal: Generate Wikidata JSON & RDF dumps from Hadoop

2021-09-15 Thread Addshore
Addshore added a comment. From IRC > 7:32 PM <+dcausse> addshore: I'm not convinced that RecentChanges is more reliable than the revision-create stream, using this stream did improve consistency of wdqs IIRC This is indeed true, RC is also not a totally reliable thing. Really

[Wikidata-bugs] [Maniphest] T284319: Improve Query Service Updater on WBstack

2021-09-15 Thread toan
toan added a comment. And a screenshot from k8s F34644227: image.png TASK DETAIL https://phabricator.wikimedia.org/T284319 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: toan Cc: toan,

[Wikidata-bugs] [Maniphest] T284319: Improve Query Service Updater on WBstack

2021-09-15 Thread toan
toan added a comment. Pasting a screenshot from the heap too F34644214: image.png TASK DETAIL https://phabricator.wikimedia.org/T284319 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: toan Cc:

[Wikidata-bugs] [Maniphest] T290839: Evaluate a double backend strategy for WDQS

2021-09-15 Thread Hannah_Bast
Hannah_Bast added a comment. > Wikibase doesn’t store data in RDF, so dumping the data set means parsing the native representation (JSON) and writing it out again as RDF, including some metadata for each page. That is what I expected. But converting less than 100 GB of data from one

[Wikidata-bugs] [Maniphest] T291089: Proposal: Generate Wikidata JSON & RDF dumps from Hadoop

2021-09-15 Thread Addshore
Addshore added a comment. > Perhaps the existing logic in the WDQS updater to generate its RDF stream could be factored out into its own service? Or, at least, it could emit its RDF stream as a side output into a Kafka topic? This relies on the kafka event streams right now, thus also

[Wikidata-bugs] [Maniphest] T291089: Proposal: Generate Wikidata JSON & RDF dumps from Hadoop

2021-09-15 Thread Ottomata
Ottomata added a comment. > I imagine other sources like https://wikitech.wikimedia.org/wiki/Event_Platform/EventStreams would all have the same problems? Yes, EventStreams uses the same data. TASK DETAIL https://phabricator.wikimedia.org/T291089 EMAIL PREFERENCES

[Wikidata-bugs] [Maniphest] T291089: Proposal: Generate Wikidata JSON & RDF dumps from Hadoop

2021-09-15 Thread Ottomata
Ottomata added a comment. > And the new query service flink updater could also make use of the RDF stream Perhaps the existing logic in the WDQS updater to generate its RDF stream could be factored out into its own service? Or, at least, it could emit its RDF stream as a side output

[Wikidata-bugs] [Maniphest] T291089: Proposal: Generate Wikidata JSON & RDF dumps from Hadoop

2021-09-15 Thread Addshore
Addshore added a comment. In T291089#7356181 , @Ottomata wrote: >> a reliable and consistent input (such as MediaWiki recent changes) > > I guess by this you mean polling the MW RecentChanges API? Yes I imagine that is the only

[Wikidata-bugs] [Maniphest] T291089: Proposal: Generate Wikidata JSON & RDF dumps from Hadoop

2021-09-15 Thread Ottomata
Ottomata added a comment. > a reliable and consistent input (such as MediaWiki recent changes) I guess by this you mean polling the MW RecentChanges API? TASK DETAIL https://phabricator.wikimedia.org/T291089 EMAIL PREFERENCES

[Wikidata-bugs] [Maniphest] T236893: Tag all edits made via Wikibase View and Wikibase Client

2021-09-15 Thread Addshore
Addshore added a comment. In T236893#7330529 , @Ladsgroup wrote: > Oh I saw that when deploying. I honestly think we should do it the other way around and move everything to the new script instead. The old code calls the API of

[Wikidata-bugs] [Maniphest] T290839: Evaluate a double backend strategy for WDQS

2021-09-15 Thread Justin0x2004
Justin0x2004 added a comment. @Lucas_Werkmeister_WMDE What is the relationship between Blazegraph and Wikibase? It seems like Blazegraph would have some export functionality. TASK DETAIL https://phabricator.wikimedia.org/T290839 EMAIL PREFERENCES

[Wikidata-bugs] [Maniphest] T290985: Enable new dispatching mechanism on beta

2021-09-15 Thread Ladsgroup
Ladsgroup closed this task as "Resolved". Ladsgroup assigned this task to Michael. Restricted Application added a project: User-Michael. TASK DETAIL https://phabricator.wikimedia.org/T290985 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Michael,

[Wikidata-bugs] [Maniphest] T48643: [Story] Dispatching via job queue (instead of cron script)

2021-09-15 Thread Ladsgroup
Ladsgroup closed subtask T290985: Enable new dispatching mechanism on beta as Resolved. TASK DETAIL https://phabricator.wikimedia.org/T48643 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Ladsgroup Cc: toan, Tarrow, jijiki, alaa_wmde, Ladsgroup,

[Wikidata-bugs] [Maniphest] T291091: Snapshots for saved queries

2021-09-15 Thread Bugreporter
Bugreporter added a project: Wikidata. TASK DETAIL https://phabricator.wikimedia.org/T291091 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Bugreporter Cc: Aklapper, Bugreporter, Invadibot, MPhamWMF, maantietaja, CBogen, Akuckartz, Nandana,

[Wikidata-bugs] [Maniphest] T291091: Snapshots for saved queries

2021-09-15 Thread Bugreporter
Bugreporter updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T291091 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Bugreporter Cc: Aklapper, Bugreporter, MPhamWMF, CBogen, Namenlos314, Gq86, Lucas_Werkmeister_WMDE,

[Wikidata-bugs] [Maniphest] T290961: rewrite KrBot to publish Constraint Violation pages

2021-09-15 Thread Bugreporter
Bugreporter added a comment. So: T291091: Snapshots for saved queries . In T290961#7352669 , @Tacsipacsi wrote: > For me, one of the best features of KrBot that it actually edits wiki

[Wikidata-bugs] [Maniphest] T291091: Snapshots for saved queries

2021-09-15 Thread Bugreporter
Bugreporter changed the task status from "Open" to "Stalled". TASK DETAIL https://phabricator.wikimedia.org/T291091 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Bugreporter Cc: Aklapper, Bugreporter, MPhamWMF, CBogen, Namenlos314, Gq86,

[Wikidata-bugs] [Maniphest] T291091: Snapshots for saved queries

2021-09-15 Thread Bugreporter
Bugreporter created this task. Bugreporter added projects: Wikidata-Query-Service, Automated list generation. Restricted Application added a subscriber: Aklapper. TASK DESCRIPTION (This is basically a scaled-down version of T157231 /T192870

[Wikidata-bugs] [Maniphest] T291064: Pass json response from backend into the Results Page component

2021-09-15 Thread ItamarWMDE
ItamarWMDE renamed this task from "Pass json response from backend into the Vue component" to "Pass json response from backend into the Results Page component". TASK DETAIL https://phabricator.wikimedia.org/T291064 EMAIL PREFERENCES

[Wikidata-bugs] [Maniphest] T291064: Pass json response from backend into the Vue component

2021-09-15 Thread ItamarWMDE
ItamarWMDE added a comment. Removed dependency, since this can be done in parallel, this task is mostly about querying the database to retrieve mismatches for items TASK DETAIL https://phabricator.wikimedia.org/T291064 EMAIL PREFERENCES

[Wikidata-bugs] [Maniphest] T244590: [Epic] Rework the WDQS updater as an event driven application

2021-09-15 Thread Lydia_Pintscher
Lydia_Pintscher merged a task: T290061: improve WD update performance. Lydia_Pintscher added subscribers: VladimirAlexiev, Lydia_Pintscher, So9q, Mohammed_Sadat_WMDE. TASK DETAIL https://phabricator.wikimedia.org/T244590 EMAIL PREFERENCES

[Wikidata-bugs] [Maniphest] T291064: Pass json response from backend into the Vue component

2021-09-15 Thread ItamarWMDE
ItamarWMDE updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T291064 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: ItamarWMDE Cc: Lydia_Pintscher, Aklapper, Mattia_Capozzi_WMDE, guergana.tzatchkova, ItamarWMDE,

[Wikidata-bugs] [Maniphest] T291089: Proposal: Generate Wikidata JSON & RDF dumps from Hadoop

2021-09-15 Thread Addshore
Addshore updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T291089 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Addshore Cc: Ladsgroup, dcausse, ArielGlenn, Ottomata, Addshore, Invadibot, maantietaja, jannee_e,

[Wikidata-bugs] [Maniphest] T291089: Proposal: Generate Wikidata JSON & RDF dumps from Hadoop

2021-09-15 Thread Addshore
Addshore added a comment. Cross linking to T290839: Evaluate a double backend strategy for WDQS which I was reading when I decided to write this down, particularly when reading T290839#7354690

[Wikidata-bugs] [Maniphest] T285987: Do not generate full html parser output at the end of Wikibase edit requests

2021-09-15 Thread Addshore
Addshore closed this task as "Resolved". TASK DETAIL https://phabricator.wikimedia.org/T285987 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Ladsgroup, Addshore Cc: danshick-wmde, RShigapov, Kormat, Marostegui, LSobanski, Ladsgroup, tstarling,

[Wikidata-bugs] [Maniphest] T287231: Consider moving WDQS "munging" of RDF into Wikibase RDF output code

2021-09-15 Thread Addshore
Addshore added a comment. Also relevant to T291089: Proposal: Generate Wikidata JSON & RDF dumps from Hadoop TASK DETAIL https://phabricator.wikimedia.org/T287231 EMAIL PREFERENCES

[Wikidata-bugs] [Maniphest] T291089: Proposal: Generate Wikidata JSON & RDF dumps from Hadoop

2021-09-15 Thread Addshore
Addshore created this task. Addshore added projects: Analytics, Dumps-Generation, Wikidata, wdwb-tech. TASK DESCRIPTION Wikidata dumps currently come directly from the SQL servers. The general process here is iterate through all pages, and slowly write all content to files (possibly in

[Wikidata-bugs] [Maniphest] T257405: wdreconcile.toolforge.org acting as though HTTP 502 Gateway errors are cached

2021-09-15 Thread Pintoch
Pintoch added a comment. @Spinster I'd rather keep this open since this is a problem that is likely to be relevant to other tools and still has not been solved as far as I can tell. It seems similar to T282732 which is current apparently. TASK

[Wikidata-bugs] [Maniphest] T201150: Regularly run constraint checks for all items

2021-09-15 Thread Lucas_Werkmeister_WMDE
Lucas_Werkmeister_WMDE added a comment. Then I think I misunderstood your question? We certainly don’t have 155 million violations “of a certain kind”. I’m guessing most reports that users would want would be much smaller; on Wikidata:Database reports/Constraint violations/Summary

[Wikidata-bugs] [Maniphest] T278674: Creating an item with 18 claims corresponding to 18 datatypes in a third-party Wikibase instance

2021-09-15 Thread RShigapov
RShigapov added a comment. I still had problems with lexemes, forms and senses for that version of the wikibase-docker. But may be they are resolved in the new version. TASK DETAIL https://phabricator.wikimedia.org/T278674 EMAIL PREFERENCES

[Wikidata-bugs] [Maniphest] T287231: Consider moving WDQS "munging" of RDF into Wikibase RDF output code

2021-09-15 Thread Addshore
Addshore added a comment. Cross posting from T245542: Make rdfDump.php export in WDQS-ready format In T245542#7355621 , @Addshore wrote: > This is probably strongly related to T287231:

[Wikidata-bugs] [Maniphest] T245542: Make rdfDump.php export in WDQS-ready format

2021-09-15 Thread Addshore
Addshore added a comment. This is probably strongly related to T287231: Consider moving WDQS "munging" of RDF into Wikibase RDF output code If the desired output for wdqs was held within Wikibase or a PHP extension, then: 1. dumpRdf could

[Wikidata-bugs] [Maniphest] T290976: decide on future of dispatch lag

2021-09-15 Thread Addshore
Addshore added a project: wdwb-tech. TASK DETAIL https://phabricator.wikimedia.org/T290976 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Addshore Cc: Addshore, Michael, Aklapper, Lydia_Pintscher, Invadibot, maantietaja, Akuckartz, Nandana, Lahi,

[Wikidata-bugs] [Maniphest] T220823: Use ElasticSearch for bulk Wikidata entity term lookup

2021-09-15 Thread Thadguidry
Thadguidry added a comment. @Addshore That's what I figured. :-) This issue did feel old and sort of in a dustbin. Agree it should be closed. TASK DETAIL https://phabricator.wikimedia.org/T220823 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To:

[Wikidata-bugs] [Maniphest] T241415: Add PropertySuggester documentation to doc.wikimedia.org

2021-09-15 Thread Addshore
Addshore added a project: wdwb-tech. TASK DETAIL https://phabricator.wikimedia.org/T241415 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Addshore Cc: Addshore, Aklapper, Invadibot, maantietaja, Akuckartz, apaskulin, Nandana, Cpaulf30, Lahi, Gq86,

[Wikidata-bugs] [Maniphest] T289332: Importing a Wikibase entity via XML breaks creating new entites

2021-09-15 Thread Addshore

[Wikidata-bugs] [Maniphest] T220823: Use ElasticSearch for bulk Wikidata entity term lookup

2021-09-15 Thread Addshore
Addshore closed this task as "Declined". Addshore added a comment. We could still want this in the future, but right now the other changes that we made in the past years are more than sufficient. TASK DETAIL https://phabricator.wikimedia.org/T220823 EMAIL PREFERENCES

[Wikidata-bugs] [Maniphest] T212282: Timeout in Special Page Constraints check for France (Q142)

2021-09-15 Thread Addshore
Addshore added a comment. In T212282#7294054 , @Ladsgroup wrote: > The middle one is resolved but I got server time out with Q124 Yeah, really this needs the persistent storage TASK DETAIL

[Wikidata-bugs] [Maniphest] T278674: Creating an item with 18 claims corresponding to 18 datatypes in a third-party Wikibase instance

2021-09-15 Thread Addshore
Addshore added a comment. Can we consider this one resolved? TASK DETAIL https://phabricator.wikimedia.org/T278674 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Addshore Cc: WMDE-leszek, Addshore, danshick-wmde, RShigapov, Aklapper, Invadibot,

[Wikidata-bugs] [Maniphest] T278962: do not follow sitelink redirects when redirect badge is used

2021-09-15 Thread William_Cheselden
William_Cheselden added a comment. @Lydia_Pintscher what is the status of this issue? TASK DETAIL https://phabricator.wikimedia.org/T278962 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: William_Cheselden Cc: William_Cheselden, Pokechu22,

[Wikidata-bugs] [Maniphest] T215623: Problem with docker-compose2 (behind proxy)

2021-09-15 Thread Addshore
Addshore closed this task as "Resolved". Addshore claimed this task. Addshore added a comment. Restricted Application added a project: User-Addshore. Great! TASK DETAIL https://phabricator.wikimedia.org/T215623 EMAIL PREFERENCES

[Wikidata-bugs] [Maniphest] T201150: Regularly run constraint checks for all items

2021-09-15 Thread Addshore
Addshore added a comment. In T201150#7355393 , @Lucas_Werkmeister_WMDE wrote: > That would suggest some 155 million constraint violations in total (almost all of them on items): > > $ units -t '((853 + 806 + 811) * 94504342 /

[Wikidata-bugs] [Maniphest] T280684: Query Builder doesn't show labels when following a 'sharable link'

2021-09-15 Thread Lucas_Werkmeister_WMDE
Lucas_Werkmeister_WMDE claimed this task. Lucas_Werkmeister_WMDE moved this task from To Do (prioritised from top to bottom) to Doing on the Wikidata-Campsite (Wikidata-Campsite-Iteration-∞) board. TASK DETAIL https://phabricator.wikimedia.org/T280684 WORKBOARD

[Wikidata-bugs] [Maniphest] T290950: Tag edits made via WikibaseLexeme

2021-09-15 Thread gerritbot
gerritbot added a project: Patch-For-Review. TASK DETAIL https://phabricator.wikimedia.org/T290950 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: toan, gerritbot Cc: Lydia_Pintscher, Aklapper, So9q, kzimmerman, Salgo60, Lucas_Werkmeister_WMDE,

[Wikidata-bugs] [Maniphest] T290950: Tag edits made via WikibaseLexeme

2021-09-15 Thread gerritbot
gerritbot added a comment. Change 721330 had a related patch set uploaded (by Tobias Andersson; author: Tobias Andersson): [mediawiki/extensions/WikibaseLexeme@master] Use tags when making ui edits https://gerrit.wikimedia.org/r/721330 TASK DETAIL

[Wikidata-bugs] [Maniphest] T235292: Add P4224 and P360 to wgWBQualityConstraintsPropertiesWithViolatingQualifiers

2021-09-15 Thread Addshore
Addshore closed this task as "Resolved". Addshore claimed this task. Restricted Application added a project: User-Addshore. TASK DETAIL https://phabricator.wikimedia.org/T235292 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Addshore Cc: Esc3300,

[Wikidata-bugs] [Maniphest] T277855: Support "separators" parameter for distinct value constraints

2021-09-15 Thread Addshore
Addshore closed this task as "Resolved". TASK DETAIL https://phabricator.wikimedia.org/T277855 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: toan, Addshore Cc: WMDE-leszek, Lucas_Werkmeister_WMDE, Manuel, Esc3300, Moebeus, Nikki, Aklapper,

[Wikidata-bugs] [Maniphest] T289654: Netlify deploy URLs posted to PRs as a comment are broken

2021-09-15 Thread Addshore
Addshore closed this task as "Resolved". TASK DETAIL https://phabricator.wikimedia.org/T289654 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Ladsgroup, Addshore Cc: Ladsgroup, Michael, Aklapper, ItamarWMDE, Invadibot, maantietaja, Hazizibinmahdi,

[Wikidata-bugs] [Maniphest] T283087: Include SyntaxHighlight in the Fall 2021 Wikibase Docker release

2021-09-15 Thread Addshore
Addshore closed this task as "Resolved". TASK DETAIL https://phabricator.wikimedia.org/T283087 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: toan, Addshore Cc: Aklapper, Samantha_Alipio_WMDE, Invadibot, maantietaja, Akuckartz, Iflorez, alaa_wmde,

[Wikidata-bugs] [Maniphest] T276210: Add ‘Query Builder’ Button + tooltip to Query Service Interface

2021-09-15 Thread Addshore
Addshore closed this task as "Resolved". Addshore added a comment. Looks like it is there! F34644019: image.png TASK DETAIL https://phabricator.wikimedia.org/T276210 EMAIL PREFERENCES

[Wikidata-bugs] [Maniphest] T289433: Display link to (or integrate) Query Builder from query.wikidata.org in a prominent place

2021-09-15 Thread Addshore
Addshore closed subtask T276210: Add ‘Query Builder’ Button + tooltip to Query Service Interface as Resolved. TASK DETAIL https://phabricator.wikimedia.org/T289433 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Addshore Cc: Aklapper, Bugreporter,

[Wikidata-bugs] [Maniphest] T272702: (MS 7) Link from Query Service UI to Query Builder

2021-09-15 Thread Addshore
Addshore closed subtask T276210: Add ‘Query Builder’ Button + tooltip to Query Service Interface as Resolved. TASK DETAIL https://phabricator.wikimedia.org/T272702 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Erdinc_Ciftci_WMDE, Addshore Cc:

[Wikidata-bugs] [Maniphest] T288443: Create a new wdio-wikibase release and update usages

2021-09-15 Thread Addshore
Addshore closed this task as "Resolved". TASK DETAIL https://phabricator.wikimedia.org/T288443 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: dang, Addshore Cc: toan, zeljkofilipin, Aklapper, Michael, Suran38, Biggs657, Invadibot, Lalamarie69,

[Wikidata-bugs] [Maniphest] T284319: Improve Query Service Updater on WBstack

2021-09-15 Thread Addshore
Addshore closed this task as "Resolved". Addshore reassigned this task from Addshore to toan. Addshore added a comment. As part of this task we essentially rewrote the java wrapper around the query updater. https://github.com/wbstack/queryservice-updater/compare/0.3.6_2.2...0.3.84_3.6

[Wikidata-bugs] [Maniphest] T289417: Wrong date values for day and month precision

2021-09-15 Thread Lydia_Pintscher
Lydia_Pintscher added a project: Wikidata-Campsite. TASK DETAIL https://phabricator.wikimedia.org/T289417 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Lydia_Pintscher Cc: Wikidata-bugs, Ivan_A_Krestinin, Aklapper, Invadibot, maantietaja,

[Wikidata-bugs] [Maniphest] T290839: Evaluate a double backend strategy for WDQS

2021-09-15 Thread Lucas_Werkmeister_WMDE
Lucas_Werkmeister_WMDE added a comment. Wikibase doesn’t store data in RDF, so dumping the data set means parsing the native representation (JSON) and writing it out again as RDF, including some metadata for each page. TASK DETAIL https://phabricator.wikimedia.org/T290839 EMAIL

[Wikidata-bugs] [Maniphest] T232927: Update the code behind the Wikimedia Commons link in the sidebar to use P910 and P1754 instead of P373

2021-09-15 Thread gerritbot
gerritbot added a comment. Change 721305 had a related patch set uploaded (by Lucas Werkmeister (WMDE); author: Lucas Werkmeister (WMDE)): [operations/mediawiki-config@master] Add new WikimediaBadges config https://gerrit.wikimedia.org/r/721305 TASK DETAIL

[Wikidata-bugs] [Maniphest] T290989: switchdc cache warmup should include URLs that warmup relevant Wikidata caches

2021-09-15 Thread Marostegui
Marostegui triaged this task as "Medium" priority. Marostegui moved this task from Triage to Blocked on the DBA board. Marostegui added a comment. Just to mention that this is a nice-to-have indeed but not something that brought us down or anything close to that - it just required some load

[Wikidata-bugs] [Maniphest] T201150: Regularly run constraint checks for all items

2021-09-15 Thread Lucas_Werkmeister_WMDE
Lucas_Werkmeister_WMDE added a comment. > Do you have a picture of how many violations, and violations split by type / kind exist on Wikidata at any given time? Looks like we’re averaging about 1⅔ constraint violations per item (excluding redirects, if I’m not mistaken): $ curl

[Wikidata-bugs] [Maniphest] T291064: Pass json response from backend into the Vue component

2021-09-15 Thread guergana.tzatchkova
guergana.tzatchkova updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T291064 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: guergana.tzatchkova Cc: Lydia_Pintscher, Aklapper, Mattia_Capozzi_WMDE, guergana.tzatchkova,

[Wikidata-bugs] [Maniphest] T289556: Results page - first view of mismatches

2021-09-15 Thread Lydia_Pintscher
Lydia_Pintscher added a comment. In T289556#7354688 , @Silvan_WMDE wrote: > NOTE: Check back with @Mattia_Capozzi_WMDE: > - External source: Where do we get that name and the URL from? Mattia and I discussed it. This was

[Wikidata-bugs] [Maniphest] T288231: Deploy the wdqs streaming updater to production

2021-09-15 Thread dcausse
dcausse updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T288231 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: dcausse Cc: Aklapper, dcausse, Suran38, Biggs657, Invadibot, Lalamarie69, MPhamWMF, maantietaja, Juan90264,

[Wikidata-bugs] [Maniphest] T280627: Investigation of remaining page_props update issue [timebox: 2 days]

2021-09-15 Thread Maintenance_bot
Maintenance_bot removed a project: Patch-For-Review. TASK DETAIL https://phabricator.wikimedia.org/T280627 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Michael, Maintenance_bot Cc: Tarrow, Krinkle, daniel, Jakob_WMDE, Mike_Peel, Aklapper, Jheald,

[Wikidata-bugs] [Maniphest] T290950: Tag edits made via WikibaseLexeme

2021-09-15 Thread toan
toan claimed this task. TASK DETAIL https://phabricator.wikimedia.org/T290950 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: toan Cc: Lydia_Pintscher, Aklapper, So9q, kzimmerman, Salgo60, Lucas_Werkmeister_WMDE, Addshore, matej_suchanek, David,

[Wikidata-bugs] [Maniphest] T290951: Add tags parameter to WikibaseLexeme editing APIs

2021-09-15 Thread gerritbot
gerritbot added a comment. Change 721020 had a related patch set uploaded (by Tobias Andersson; author: Tobias Andersson): [mediawiki/extensions/WikibaseLexeme@master] Add tags parameter to editing api modules https://gerrit.wikimedia.org/r/721020 TASK DETAIL

[Wikidata-bugs] [Maniphest] T290839: Evaluate a double backend strategy for WDQS

2021-09-15 Thread Hannah_Bast
Hannah_Bast added a comment. Can you or anyone else explain why the data dump takes so long, Lukas? One would expect that it is much easier to dump a (snapshot of a) dataset than to build a complex data structure from it. Also, dumping and compression are easily parallelized. And the pure

[Wikidata-bugs] [Maniphest] T286260: APCu caches are set to expire in 2073 instead of an hour if exptime is a unix timestamp

2021-09-15 Thread gerritbot
gerritbot added a comment. Change 721306 **merged** by jenkins-bot: [mediawiki/extensions/Wikibase@REL1_36] Send TTL instead of expiry in unix timestamp in calling BagOStuff https://gerrit.wikimedia.org/r/721306 TASK DETAIL https://phabricator.wikimedia.org/T286260 EMAIL

[Wikidata-bugs] [Maniphest] T215623: Problem with docker-compose2 (behind proxy)

2021-09-15 Thread Phaebz
Phaebz added a comment. Following your advice, we use proper FQDN now instead of IP. Further, following your post here: https://addshore.com/2019/11/changing-the-concept-uri-of-an-existing-wikibase-with-data/, esp. dumpRdf.php, munge.sh and loadData.sh with the correct conceptUri, we

[Wikidata-bugs] [Maniphest] T233520: Wikidata changes do not get sent to client sites on initial sitelink addition (in some cases), leading to things such as missing page props in page_props table

2021-09-15 Thread gerritbot
gerritbot added a comment. Change 721083 **merged** by jenkins-bot: [mediawiki/extensions/Wikibase@REL1_36] Fix: When a sitelink change happens, always dispatch to the site https://gerrit.wikimedia.org/r/721083 TASK DETAIL https://phabricator.wikimedia.org/T233520 EMAIL

[Wikidata-bugs] [Maniphest] T280627: Investigation of remaining page_props update issue [timebox: 2 days]

2021-09-15 Thread gerritbot
gerritbot added a comment. Change 721083 **merged** by jenkins-bot: [mediawiki/extensions/Wikibase@REL1_36] Fix: When a sitelink change happens, always dispatch to the site https://gerrit.wikimedia.org/r/721083 TASK DETAIL https://phabricator.wikimedia.org/T280627 EMAIL

[Wikidata-bugs] [Maniphest] T286260: APCu caches are set to expire in 2073 instead of an hour if exptime is a unix timestamp

2021-09-15 Thread gerritbot
gerritbot added a project: Patch-For-Review. TASK DETAIL https://phabricator.wikimedia.org/T286260 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Ladsgroup, gerritbot Cc: R1CH, RhinosF1, jijiki, Addshore, Michael, Lucas_Werkmeister_WMDE, aaron,

[Wikidata-bugs] [Maniphest] T286260: APCu caches are set to expire in 2073 instead of an hour if exptime is a unix timestamp

2021-09-15 Thread gerritbot
gerritbot added a comment. Restricted Application added a project: Performance-Team. Change 721306 had a related patch set uploaded (by Addshore; author: Ladsgroup): [mediawiki/extensions/Wikibase@REL1_36] Send TTL instead of expiry in unix timestamp in calling BagOStuff

[Wikidata-bugs] [Maniphest] T285156: Add termbox language code mul

2021-09-15 Thread Manuel
Manuel removed a project: patch-welcome. Manuel updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T285156 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Manuel Cc: Lucas_Werkmeister_WMDE, So9q, Ainali, Epidosis, Shushugah,

[Wikidata-bugs] [Maniphest] T204439: new constraint level for suggestions

2021-09-15 Thread ReleaseTaggerBot
ReleaseTaggerBot added a project: MW-1.38-notes (1.38.0-wmf.1; 2021-09-21). TASK DETAIL https://phabricator.wikimedia.org/T204439 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Lucas_Werkmeister_WMDE, ReleaseTaggerBot Cc: Michael, noarave,

[Wikidata-bugs] [Maniphest] T233520: Wikidata changes do not get sent to client sites on initial sitelink addition (in some cases), leading to things such as missing page props in page_props table

2021-09-15 Thread gerritbot
gerritbot added a comment. Change 721083 had a related patch set uploaded (by Addshore; author: Addshore): [mediawiki/extensions/Wikibase@REL1_36] Fix: When a sitelink change happens, always dispatch to the site https://gerrit.wikimedia.org/r/721083 TASK DETAIL

[Wikidata-bugs] [Maniphest] T280627: Investigation of remaining page_props update issue [timebox: 2 days]

2021-09-15 Thread gerritbot
gerritbot added a project: Patch-For-Review. TASK DETAIL https://phabricator.wikimedia.org/T280627 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Michael, gerritbot Cc: Tarrow, Krinkle, daniel, Jakob_WMDE, Mike_Peel, Aklapper, Jheald,

[Wikidata-bugs] [Maniphest] T280627: Investigation of remaining page_props update issue [timebox: 2 days]

2021-09-15 Thread gerritbot
gerritbot added a comment. Change 721083 had a related patch set uploaded (by Addshore; author: Addshore): [mediawiki/extensions/Wikibase@REL1_36] Fix: When a sitelink change happens, always dispatch to the site https://gerrit.wikimedia.org/r/721083 TASK DETAIL

[Wikidata-bugs] [Maniphest] T288231: Deploy the wdqs streaming updater to production

2021-09-15 Thread dcausse
dcausse updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T288231 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: dcausse Cc: Aklapper, dcausse, Suran38, Biggs657, Invadibot, Lalamarie69, MPhamWMF, maantietaja, Juan90264,

[Wikidata-bugs] [Maniphest] T291074: Wikit: Move Table Component to Wikit

2021-09-15 Thread guergana.tzatchkova
guergana.tzatchkova renamed this task from "Move Table Component to Wikit" to "Wikit: Move Table Component to Wikit". TASK DETAIL https://phabricator.wikimedia.org/T291074 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: guergana.tzatchkova Cc:

[Wikidata-bugs] [Maniphest] T291079: Replace table component in Mismatch finder with text area from Wikit

2021-09-15 Thread guergana.tzatchkova
guergana.tzatchkova created this task. guergana.tzatchkova added projects: Wikidata, Mismatch Finder (Mismatch Finder - sprint 7). TASK DESCRIPTION This task depends on T291078: WiKit: Make a pre-release that includes the Table component As the

[Wikidata-bugs] [Maniphest] T196057: Dispatching of Wikidata changes to clients sometimes stucks

2021-09-15 Thread Michael
Michael closed this task as "Resolved". Michael added a comment. I think this has been resolved by now. TASK DETAIL https://phabricator.wikimedia.org/T196057 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Michael Cc: Michael, Aklapper, Mahir256,

[Wikidata-bugs] [Maniphest] T291078: WiKit: Make a pre-release that includes the Table component

2021-09-15 Thread guergana.tzatchkova
guergana.tzatchkova created this task. guergana.tzatchkova added projects: Wikidata, Mismatch Finder (Mismatch Finder - sprint 7). TASK DESCRIPTION This task depends on T291074: Move Table Component to Wikit In order to use the table component in

[Wikidata-bugs] [Maniphest] T204439: new constraint level for suggestions

2021-09-15 Thread gerritbot
gerritbot added a comment. Change 721266 **merged** by jenkins-bot: [mediawiki/extensions/WikibaseQualityConstraints@master] Add suggestion status to API documentation https://gerrit.wikimedia.org/r/721266 TASK DETAIL https://phabricator.wikimedia.org/T204439 EMAIL PREFERENCES

[Wikidata-bugs] [Maniphest] T291077: WiKit: Create a story file for the Table component

2021-09-15 Thread guergana.tzatchkova
guergana.tzatchkova created this task. guergana.tzatchkova added projects: Wikidata, Mismatch Finder (Mismatch Finder - sprint 7). TASK DESCRIPTION This task depends on T291074 Move Table Component to Wikit Create a story file for the moved

[Wikidata-bugs] [Maniphest] T288231: Deploy the wdqs streaming updater to production

2021-09-15 Thread gerritbot
gerritbot added a comment. Change 721281 had a related patch set uploaded (by DCausse; author: DCausse): [operations/puppet@production] wdqs: activate the streaming_updater role on wdqs2008 https://gerrit.wikimedia.org/r/721281 TASK DETAIL

[Wikidata-bugs] [Maniphest] T288231: Deploy the wdqs streaming updater to production

2021-09-15 Thread gerritbot
gerritbot added a project: Patch-For-Review. TASK DETAIL https://phabricator.wikimedia.org/T288231 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: gerritbot Cc: Aklapper, dcausse, Suran38, Biggs657, Invadibot, Lalamarie69, MPhamWMF, maantietaja,

[Wikidata-bugs] [Maniphest] T288231: Deploy the wdqs streaming updater to production

2021-09-15 Thread gerritbot
gerritbot added a comment. Change 721280 had a related patch set uploaded (by DCausse; author: DCausse): [operations/puppet@production] wdqs: Add a streaming updater profile https://gerrit.wikimedia.org/r/721280 TASK DETAIL https://phabricator.wikimedia.org/T288231 EMAIL

[Wikidata-bugs] [Maniphest] T291074: Move Table Component to Wikit

2021-09-15 Thread guergana.tzatchkova
guergana.tzatchkova updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T291074 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: guergana.tzatchkova Cc: Lydia_Pintscher, Aklapper, Mattia_Capozzi_WMDE, ItamarWMDE, Silvan_WMDE,

[Wikidata-bugs] [Maniphest] T235292: Add P4224 and P360 to wgWBQualityConstraintsPropertiesWithViolatingQualifiers

2021-09-15 Thread Lucas_Werkmeister_WMDE
Lucas_Werkmeister_WMDE edited projects, added Wikidata-Campsite (Wikidata-Campsite-Iteration-∞); removed Wikidata-Campsite. TASK DETAIL https://phabricator.wikimedia.org/T235292 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Lucas_Werkmeister_WMDE

[Wikidata-bugs] [Maniphest] T291074: Move Table Component to Wikit

2021-09-15 Thread guergana.tzatchkova
guergana.tzatchkova updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T291074 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: guergana.tzatchkova Cc: Lydia_Pintscher, Aklapper, Mattia_Capozzi_WMDE, ItamarWMDE, Silvan_WMDE,

[Wikidata-bugs] [Maniphest] T291054: wcqs-beta.wmflabs.org SPARQL endpoint is down (500 server error)

2021-09-15 Thread Lucas_Werkmeister_WMDE
Lucas_Werkmeister_WMDE added a project: Discovery-Search. TASK DETAIL https://phabricator.wikimedia.org/T291054 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Lucas_Werkmeister_WMDE Cc: Ainali, Alicia_Fagerving_WMSE, Zache, Aklapper, Invadibot,

[Wikidata-bugs] [Maniphest] T283333: Add dependabot change mirroring to Wikidata / Wikibase gerrit repositories

2021-09-15 Thread Addshore
Addshore added a comment. The required secret is now available to all of these repos (taken from the list of our repos on gerrit) F34643847: image.png Let me (or another admin of the wikimedia github org) know if more need to be added.

[Wikidata-bugs] [Maniphest] T291054: wcqs-beta.wmflabs.org SPARQL endpoint is down (500 server error)

2021-09-15 Thread Lucas_Werkmeister_WMDE
Lucas_Werkmeister_WMDE added a project: SDC General. TASK DETAIL https://phabricator.wikimedia.org/T291054 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Lucas_Werkmeister_WMDE Cc: Alicia_Fagerving_WMSE, Zache, Aklapper, Invadibot, GFontenelle_WMF,

[Wikidata-bugs] [Maniphest] T235292: Add P4224 and P360 to wgWBQualityConstraintsPropertiesWithViolatingQualifiers

2021-09-15 Thread Stashbot
Stashbot added a comment. Mentioned in SAL (#wikimedia-operations) [2021-09-15T11:10:36Z] Synchronized wmf-config/InitialiseSettings.php: Config: [[gerrit:583407|Don’t check constraints on two property qualifiers (T235292 )]] (duration: 01m 11s)

[Wikidata-bugs] [Maniphest] T235292: Add P4224 and P360 to wgWBQualityConstraintsPropertiesWithViolatingQualifiers

2021-09-15 Thread Maintenance_bot
Maintenance_bot removed a project: Patch-For-Review. TASK DETAIL https://phabricator.wikimedia.org/T235292 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Maintenance_bot Cc: Esc3300, Manuel, abian, DannyS712, Lucas_Werkmeister_WMDE, Lydia_Pintscher,

[Wikidata-bugs] [Maniphest] T235292: Add P4224 and P360 to wgWBQualityConstraintsPropertiesWithViolatingQualifiers

2021-09-15 Thread Lucas_Werkmeister_WMDE
Lucas_Werkmeister_WMDE added a comment. The given example item stopped showing a constraint violation in the meantime, but I found another one (with this query

[Wikidata-bugs] [Maniphest] T104750: Make low year numbers less ambiguous

2021-09-15 Thread Manuel
Manuel updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T104750 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Manuel Cc: Lucas_Werkmeister_WMDE, Manuel, Ainali, Bugreporter, RhinosF1, So9q, Liuxinyu970226, aude,

[Wikidata-bugs] [Maniphest] T104750: Make low year numbers less ambiguous

2021-09-15 Thread Manuel
Manuel renamed this task from "[Bug] Low year numbers can be confused with days of the month" to "Make low year numbers less ambiguous ". TASK DETAIL https://phabricator.wikimedia.org/T104750 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Manuel

  1   2   >