[Wikidata-bugs] [Maniphest] [Commented On] T207837: wdqs updater should be better isolated from blazegraph and common workload should be shared between servers
Smalyshev added a comment. Huh this is a big one. I've thought about it a bunch lately and here's roughly what I've got: There are several way we can save some work on updating. I will list them here all though some of them more practical than others. A. Blazegraph master-slave replication. Updater works on one node and updates are propagated on DB level to other nodes. This is possible in theory (Blazegraph has infrastructure to do that) but would require a lot of work as Blazegraph does not have protocols to do that. B. Filter Kafka stream to exclude junk messages and provide "clean" update stream. This should not be very hard to do, but we should not put too many hopes into this one, as deduplication capabilities here are limited because we never know which timestamp which client starts with, so it's hard to make any serious deduplication in streaming mode. Basically, if events E1 and E2 happen for same ID within time T, deduplicating between them means holding issuing E1 for time T, which creates delay of T in the stream. Since we can not have long delay in the stream, T must be short. If we could when we've got E2 go back and revoke E1, then it could work better (though then the clients won't get E1's entity updated until E2 time but we can live with that since such client is behind anyway) but I don't think kafka allows to do such things. Ideas are welcome here. If we saw whole stream at once we could probably save a bit of work, but that's not how updaters are working, and I am not sure how to create any real benefit from it. We could maybe have some cache of ID->last revision to quickly filter stale updates, but I am not sure we'd be saving a lot here, as we already have such filter against the database. We could save downloading updates for other wikis that we don't care about, but my feeling is that does not change matters substantially. This would also require running another service, with all dependencies and single point-of-failure scenarios that come from that. C. We could cache data downloads from Wikidata more actively. Right now each poller basically fetches data un-cached. This is because we want to have the latest one. But if other host already fetched the latest one and it's in cache, we're not benefitting from it then. We could probably try to use some kind of "cache only if the content is not older than this timestamp" but I am not sure our Varnish knows how fresh Wikidata data is. We could probably try to create proper headers when sending RDF data and then try to use them when reading. This would require a lot of careful matching and will be a nightmare to debug if something goes wrong. D. Fetching RDF data while pre-processing the Kafka stream is possible, but currently we check against the DB and not fetch the data for items that are already in the DB with latest version, and do not fetch twice for duplicates. However, since we can not substantially deduplicate in a generic stream (see above), this means a lot of data fetched and stored for active items. Again, if we had some kind of smart storage, we could probably make it so that the RDF data would be stored once-per-ID and updated on consequent fetches, but this already sounds as reinventing Varnish. Here some ideas may be welcome too. As we can see, it's still kinda vaporous and vague and could use some work to define what can work and what can't.TASK DETAILhttps://phabricator.wikimedia.org/T207837EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Smalyshev, Aklapper, Joe, Gehel, Nandana, thifranc, AndyTan, Davinaclare77, Qtn1293, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Th3d3v1ls, Hfbn0, QZanden, EBjune, merbst, LawExplorer, Zppix, Jonas, Xmlizer, Wong128hk, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, faidon, Mbch331, Jay8g, fgiunchedi___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T207817: WDQS Updater ran into issue and stopped working
Smalyshev added a project: Discovery-Wikidata-Query-Service-Sprint. TASK DETAILhttps://phabricator.wikimedia.org/T207817EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Ottomata, Pchelolo, Tarrow, WMDE-leszek, Addshore, mmodell, Stashbot, 20after4, TerraCodes, Liuxinyu970226, gerritbot, Gehel, Smalyshev, Mathew.onipe, Aklapper, Dzahn, CucyNoiD, Nandana, NebulousIris, thifranc, AndyTan, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Davinaclare77, Adrian1985, Qtn1293, Cpaulf30, Imarlier, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Adik2382, Th3d3v1ls, Hfbn0, Ramalepe, Liugev6, QZanden, EBjune, merbst, LawExplorer, Lewizho99, Zppix, Maathavan, Jonas, Xmlizer, Wong128hk, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, ArielGlenn, faidon, He7d3r, Jdforrester-WMF, Mbch331, Jay8g, fgiunchedi, greg___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T206961: Upgrade jetty in Blazegraph to 9.3 or 9.4
Smalyshev added a project: Discovery-Wikidata-Query-Service-Sprint. TASK DETAILhttps://phabricator.wikimedia.org/T206961EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Aklapper, Smalyshev, Nandana, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, Jonas, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T207834: Cleanup Wikidata Query Service logging configuration
Smalyshev added a project: Discovery-Wikidata-Query-Service-Sprint. TASK DETAILhttps://phabricator.wikimedia.org/T207834EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Smalyshev, gerritbot, Gehel, Aklapper, CucyNoiD, Nandana, NebulousIris, thifranc, AndyTan, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Davinaclare77, Adrian1985, Qtn1293, Cpaulf30, Imarlier, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Adik2382, Th3d3v1ls, Hfbn0, Ramalepe, Liugev6, QZanden, EBjune, merbst, LawExplorer, Lewizho99, Zppix, Maathavan, Jonas, Xmlizer, Wong128hk, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, ArielGlenn, faidon, He7d3r, Jdforrester-WMF, Mbch331, Jay8g, fgiunchedi, greg___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T207873: Make Kafka updater understand "dt" timestamp with microseconds
Smalyshev added a project: Discovery-Wikidata-Query-Service-Sprint. TASK DETAILhttps://phabricator.wikimedia.org/T207873EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: gerritbot, Aklapper, Gehel, Smalyshev, CucyNoiD, Nandana, NebulousIris, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Imarlier, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, EBjune, merbst, LawExplorer, Lewizho99, Maathavan, Jonas, Xmlizer, Wong128hk, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, ArielGlenn, He7d3r, Jdforrester-WMF, Mbch331, Jay8g, greg___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T204364: Rate limit wdqs logs
Smalyshev added a project: Discovery-Wikidata-Query-Service-Sprint. TASK DETAILhttps://phabricator.wikimedia.org/T204364EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Gehel, SmalyshevCc: gerritbot, Smalyshev, fgiunchedi, Gehel, Aklapper, CucyNoiD, Nandana, NebulousIris, thifranc, AndyTan, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Davinaclare77, Adrian1985, Qtn1293, Cpaulf30, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Adik2382, Th3d3v1ls, Hfbn0, Ramalepe, Liugev6, QZanden, EBjune, merbst, LawExplorer, Lewizho99, Zppix, Maathavan, Jonas, Xmlizer, Wong128hk, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, faidon, Mbch331, Jay8g, jeremyb___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T207843: increase restart interval of wdqs updater
Smalyshev added a project: Discovery-Wikidata-Query-Service-Sprint. TASK DETAILhttps://phabricator.wikimedia.org/T207843EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: gerritbot, Aklapper, Gehel, CucyNoiD, Nandana, NebulousIris, thifranc, AndyTan, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Davinaclare77, Adrian1985, Qtn1293, Cpaulf30, Imarlier, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Adik2382, Th3d3v1ls, Hfbn0, Ramalepe, Liugev6, QZanden, EBjune, merbst, LawExplorer, Lewizho99, Zppix, Maathavan, Jonas, Xmlizer, Wong128hk, jkroll, Smalyshev, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, ArielGlenn, faidon, He7d3r, Jdforrester-WMF, Mbch331, Jay8g, fgiunchedi, greg___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Closed] T207720: Create integration tests for lexeme updating
Smalyshev closed this task as "Resolved".Smalyshev claimed this task. TASK DETAILhttps://phabricator.wikimedia.org/T207720EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: gerritbot, Aklapper, Smalyshev, CucyNoiD, Nandana, NebulousIris, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, EBjune, merbst, LawExplorer, Lewizho99, Maathavan, Jonas, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Created] T207908: add interlanguage links does not work on Commons
Robby created this task.Robby added projects: Commons, Wikidata.Restricted Application added a subscriber: Aklapper. TASK DESCRIPTIONWhen i try for any element 8e.g.: https://commons.wikimedia.org/wiki/Category:Croatian_Fraternal_Union_Building ) on Commons to add interlanguage links I manage to find the corresponding element on other language versions (e.g. en:Croatian Fraternal Union Building) when I then click on LInk with page nothing happens. I use by now Firefox 63.0 (64-bit) on Windows 10 pro 1803 this issue did not happen on Firefox 62TASK DETAILhttps://phabricator.wikimedia.org/T207908EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: RobbyCc: Aklapper, Robby, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, Poyekhali, Wong128hk, Wikidata-bugs, aude, El_Grafo, Dinoguy1000, Steinsplitter, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Created] T207906: Should blocking a user from a Wikibase property also block them from using the property?
dbarratt created this task.dbarratt added projects: Anti-Harassment, MediaWiki-extensions-WikibaseRepository.Restricted Application added subscribers: MGChecker, Aklapper.Restricted Application added a project: Wikidata. TASK DESCRIPTIONIf an admin partially blocks a user from Property:P18, currently they wont be able to edit the claims on that property. However, they will be able to to use the property. For instance if they want to edit the image (Property:P18) statement on Q4757092 they would be able to do so. Should partially blocking a Property also block usage of that property? The way this would work, is if you go to add/edit/remove a claim, Wikibase would execute User::isBlockedFrom on the entity they are trying to edit (Q4757092) as well as the property of the claim they are trying to edit (Property:P18). They must not be blocked from either one in order to make the edit.TASK DETAILhttps://phabricator.wikimedia.org/T207906EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: dbarrattCc: Aklapper, MGChecker, dbarratt, Nandana, aezell, Lahi, Gq86, dmaza, GoranSMilovanovic, SPoore, TBolliger, QZanden, LawExplorer, JJMC89, PEarleyWMF, RuyP, jrbs, Wong128hk, Bsadowski1, Wikidata-bugs, aude, Dinoguy1000, Mbch331, Jay8g___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T207817: WDQS Updater ran into issue and stopped working
Smalyshev added a comment. With T207873 deployed (planned next Monday) Updater should be able to parse such timestamps, but I'd appreciate announcement upfront, so I could test it. If it can wait till Nov 6 when I am back from vacation, even better.TASK DETAILhttps://phabricator.wikimedia.org/T207817EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Ottomata, Pchelolo, Tarrow, WMDE-leszek, Addshore, mmodell, Stashbot, 20after4, TerraCodes, Liuxinyu970226, gerritbot, Gehel, Smalyshev, Mathew.onipe, Aklapper, Dzahn, CucyNoiD, Nandana, NebulousIris, thifranc, AndyTan, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Davinaclare77, Adrian1985, Qtn1293, Cpaulf30, Imarlier, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Adik2382, Th3d3v1ls, Hfbn0, Ramalepe, Liugev6, QZanden, EBjune, merbst, LawExplorer, Lewizho99, Zppix, Maathavan, Jonas, Xmlizer, Wong128hk, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, ArielGlenn, faidon, He7d3r, Jdforrester-WMF, Mbch331, Jay8g, fgiunchedi, greg___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Created] T207902: TitlesMultiselectWidget does not use entity labels Wikibase entities
dbarratt created this task.dbarratt added projects: MediaWiki-extensions-WikibaseRepository, Anti-Harassment.Restricted Application added subscribers: MGChecker, Aklapper.Restricted Application added a project: Wikidata. TASK DESCRIPTIONProblem The TitlesMultiselectWidget does not use entity labels on Wikibase entities F26777158: Screen Shot 2018-10-24 at 4.22.50 PM.png Solution Wikibase should hook into the widget to use the label (like it does everywhere else a Title is used). This may require some modifiecations to the widget to allow Wikibase to override the title.TASK DETAILhttps://phabricator.wikimedia.org/T207902EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: dbarrattCc: Aklapper, MGChecker, dbarratt, Nandana, aezell, Lahi, Gq86, dmaza, GoranSMilovanovic, SPoore, TBolliger, QZanden, LawExplorer, JJMC89, PEarleyWMF, RuyP, jrbs, Wong128hk, Bsadowski1, Wikidata-bugs, aude, Dinoguy1000, Mbch331, Jay8g___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T207817: WDQS Updater ran into issue and stopped working
ReleaseTaggerBot edited projects, added MW-1.33-notes (1.33.0-wmf.2; 2018-10-30); removed MW-1.33-notes (1.33.0-wmf.1; 2018-10-23). TASK DETAILhttps://phabricator.wikimedia.org/T207817EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: ReleaseTaggerBotCc: Ottomata, Pchelolo, Tarrow, WMDE-leszek, Addshore, mmodell, Stashbot, 20after4, TerraCodes, Liuxinyu970226, gerritbot, Gehel, Smalyshev, Mathew.onipe, Aklapper, Dzahn, CucyNoiD, Nandana, NebulousIris, thifranc, AndyTan, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Davinaclare77, Adrian1985, Qtn1293, Cpaulf30, Imarlier, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Adik2382, Th3d3v1ls, Hfbn0, Ramalepe, Liugev6, QZanden, EBjune, merbst, LawExplorer, Lewizho99, Zppix, Maathavan, Jonas, Xmlizer, Wong128hk, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, ArielGlenn, faidon, He7d3r, Jdforrester-WMF, Mbch331, Jay8g, fgiunchedi, greg___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Retitled] T207902: TitlesMultiselectWidget does not use entity labels on Wikibase entities
dbarratt renamed this task from "TitlesMultiselectWidget does not use entity labels Wikibase entities" to "TitlesMultiselectWidget does not use entity labels on Wikibase entities". TASK DETAILhttps://phabricator.wikimedia.org/T207902EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: dbarrattCc: Aklapper, MGChecker, dbarratt, Nandana, aezell, Lahi, Gq86, dmaza, GoranSMilovanovic, SPoore, TBolliger, QZanden, LawExplorer, JJMC89, PEarleyWMF, RuyP, jrbs, Wong128hk, Bsadowski1, Wikidata-bugs, aude, Dinoguy1000, Mbch331, Jay8g___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T207817: WDQS Updater ran into issue and stopped working
gerritbot added a comment. Change 469449 merged by jenkins-bot: [mediawiki/extensions/EventBus@master] Revert "Set event datetime with microsecond resolution." https://gerrit.wikimedia.org/r/469449TASK DETAILhttps://phabricator.wikimedia.org/T207817EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: gerritbotCc: Ottomata, Pchelolo, Tarrow, WMDE-leszek, Addshore, mmodell, Stashbot, 20after4, TerraCodes, Liuxinyu970226, gerritbot, Gehel, Smalyshev, Mathew.onipe, Aklapper, Dzahn, CucyNoiD, Nandana, NebulousIris, thifranc, AndyTan, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Davinaclare77, Adrian1985, Qtn1293, Cpaulf30, Imarlier, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Adik2382, Th3d3v1ls, Hfbn0, Ramalepe, Liugev6, QZanden, EBjune, merbst, LawExplorer, Lewizho99, Zppix, Maathavan, Jonas, Xmlizer, Wong128hk, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, ArielGlenn, faidon, He7d3r, Jdforrester-WMF, Mbch331, Jay8g, fgiunchedi, greg___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T138208: Connections to all db servers for wikidata as wikiadmin from snapshot, terbium
hoo added a comment. One thing we could possibly do next: Add a hook in getConnection (or somewhere close) that let's us kill the connection attempt (or the entire script) in case an unwanted replica is selected.TASK DETAILhttps://phabricator.wikimedia.org/T138208EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hooCc: Lydia_Pintscher, daniel, hoo, ArielGlenn, jcrespo, Zppix, Nandana, Lahi, Gq86, GoranSMilovanovic, Lunewa, QZanden, LawExplorer, gnosygnu, Wikidata-bugs, aude, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T138208: Connections to all db servers for wikidata as wikiadmin from snapshot, terbium
hoo added a comment. In T138208#4679458, @jcrespo wrote: From another thread, from TimS: It sounds like the snapshot hosts were in fact needing and using the host. It's not LoadBalancer's fault if some maintenance script calls wfGetDB() without specifying a query group. Throwing an exception is the correct thing to do if the MW configuration is incorrect, since it allows the maintenance script to terminate and be restarted with different configuration. Given we set $wgDBDefaultGroup* to dump for these scripts, LoadBalancer should only ever use the "default group" in case the dump host(s) are not available. Given this (probably) didn't happen here, we're almost certainly facing some other problem. * $wgDBDefaultGroup configures the DB group to use per default (if no other group is explicitely given), thus wfGetDB (and others) will not connect to the default hosts.TASK DETAILhttps://phabricator.wikimedia.org/T138208EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hooCc: Lydia_Pintscher, daniel, hoo, ArielGlenn, jcrespo, Zppix, Nandana, Lahi, Gq86, GoranSMilovanovic, Lunewa, QZanden, LawExplorer, gnosygnu, Wikidata-bugs, aude, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Edited] T207893: Partial Blocks are enforced as Sitewide blocks in Wikibase entities
dbarratt updated the task description. (Show Details) CHANGES TO TASK DESCRIPTION...`SpecialWikibasePage::checkBlocked` needs to be updated to use `User::isBlockedFrom()` with the title of the page in order to determine if the user can create or edit the entity. The full title should be passed into that method (i.e. `Q2` or `Property:P18`). For creation, use the reserved `0` for the entity (i.e. `Q0` or `Property:P0`).TASK DETAILhttps://phabricator.wikimedia.org/T207893EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: dbarrattCc: Aklapper, dbarratt, MGChecker, Nandana, aezell, Lahi, Gq86, dmaza, GoranSMilovanovic, SPoore, TBolliger, QZanden, LawExplorer, JJMC89, PEarleyWMF, RuyP, jrbs, Wong128hk, Bsadowski1, Wikidata-bugs, aude, Dinoguy1000, Mbch331, Jay8g___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Edited] T207893: Partial Blocks are enforced as Sitewide blocks in Wikibase entities
dbarratt updated the task description. (Show Details) CHANGES TO TASK DESCRIPTION...`SpecialWikibasePage::checkBlocked` needs to be updated to use `User::isBlockedFrom()` with the title of the page in order to determine if the user can create or edit the entity. The full title should be passed into that method (i.e. `Property:P18`). For creation, use the reserved `0` for the entity (i.e. `Property:P0`).TASK DETAILhttps://phabricator.wikimedia.org/T207893EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: dbarrattCc: Aklapper, dbarratt, MGChecker, Nandana, aezell, Lahi, Gq86, dmaza, GoranSMilovanovic, SPoore, TBolliger, QZanden, LawExplorer, JJMC89, PEarleyWMF, RuyP, jrbs, Wong128hk, Bsadowski1, Wikidata-bugs, aude, Dinoguy1000, Mbch331, Jay8g___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T206961: Upgrade jetty in Blazegraph to 9.3 or 9.4
Smalyshev added a parent task: Restricted Task. TASK DETAILhttps://phabricator.wikimedia.org/T206961EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Aklapper, Smalyshev, Nandana, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, Jonas, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T207720: Create integration tests for lexeme updating
gerritbot added a comment. Change 469259 merged by jenkins-bot: [wikidata/query/rdf@master] Test lexeme updating https://gerrit.wikimedia.org/r/469259TASK DETAILhttps://phabricator.wikimedia.org/T207720EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: gerritbotCc: gerritbot, Aklapper, Smalyshev, CucyNoiD, Nandana, NebulousIris, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, EBjune, merbst, LawExplorer, Lewizho99, Maathavan, Jonas, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Created] T207893: Partial Blocks are enforced as Sitewide blocks in Wikibase entities
dbarratt created this task.dbarratt added projects: Anti-Harassment, MediaWiki-extensions-WikibaseRepository.Restricted Application added subscribers: MGChecker, Aklapper.Restricted Application added a project: Wikidata. TASK DESCRIPTIONProblem When creating or modifying a Wikibase Entity, Partial Blocks are enforced as if they were sitewide blocks. Without fixing this problem, Partial Blocks do not work on #wikidata. Solution SpecialWikibasePage::checkBlocked needs to be updated to use User::isBlockedFrom() with the title of the page in order to determine if the user can create or edit the entity.TASK DETAILhttps://phabricator.wikimedia.org/T207893EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: dbarrattCc: Aklapper, dbarratt, MGChecker, Nandana, aezell, Lahi, Gq86, dmaza, GoranSMilovanovic, SPoore, TBolliger, QZanden, LawExplorer, JJMC89, PEarleyWMF, RuyP, jrbs, Wong128hk, Bsadowski1, Wikidata-bugs, aude, Dinoguy1000, Mbch331, Jay8g___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T207873: Make Kafka updater understand "dt" timestamp with microseconds
gerritbot added a comment. Change 469477 merged by jenkins-bot: [wikidata/query/rdf@master] Make Kafka event parser understand dates with microseconds https://gerrit.wikimedia.org/r/469477TASK DETAILhttps://phabricator.wikimedia.org/T207873EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: gerritbotCc: gerritbot, Aklapper, Gehel, Smalyshev, CucyNoiD, Nandana, NebulousIris, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Imarlier, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, EBjune, merbst, LawExplorer, Lewizho99, Maathavan, Jonas, Xmlizer, Wong128hk, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, ArielGlenn, He7d3r, Jdforrester-WMF, Mbch331, Jay8g, greg___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T207843: increase restart interval of wdqs updater
Smalyshev added a project: Wikimedia-Incident. TASK DETAILhttps://phabricator.wikimedia.org/T207843EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: gerritbot, Aklapper, Gehel, CucyNoiD, Nandana, NebulousIris, thifranc, AndyTan, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Davinaclare77, Adrian1985, Qtn1293, Cpaulf30, Imarlier, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Adik2382, Th3d3v1ls, Hfbn0, Ramalepe, Liugev6, QZanden, EBjune, merbst, LawExplorer, Lewizho99, Zppix, Maathavan, Jonas, Xmlizer, Wong128hk, jkroll, Smalyshev, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, ArielGlenn, faidon, He7d3r, Jdforrester-WMF, Mbch331, Jay8g, fgiunchedi, greg___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T207834: Cleanup Wikidata Query Service logging configuration
Smalyshev added a project: Wikimedia-Incident. TASK DETAILhttps://phabricator.wikimedia.org/T207834EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Smalyshev, gerritbot, Gehel, Aklapper, CucyNoiD, Nandana, NebulousIris, thifranc, AndyTan, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Davinaclare77, Adrian1985, Qtn1293, Cpaulf30, Imarlier, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Adik2382, Th3d3v1ls, Hfbn0, Ramalepe, Liugev6, QZanden, EBjune, merbst, LawExplorer, Lewizho99, Zppix, Maathavan, Jonas, Xmlizer, Wong128hk, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, ArielGlenn, faidon, He7d3r, Jdforrester-WMF, Mbch331, Jay8g, fgiunchedi, greg___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Closed] T207433: uselang=sr-cyrl causes fatal exception of type "MWException"
Jdforrester-WMF removed a project: Patch-For-Review.Jdforrester-WMF closed this task as "Resolved".Jdforrester-WMF claimed this task.Jdforrester-WMF added a comment. Fixed in 1.32 and 1.33.0-wmf.1; good enough.TASK DETAILhttps://phabricator.wikimedia.org/T207433EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Jdforrester-WMFCc: Jdforrester-WMF, gerritbot, Nikerabbit, cscott, Aklapper, Fomafix, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, Wikidata-bugs, aude, Mbch331, Jay8g, Krenair, CucyNoiD, NebulousIris, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Baloch007, Darkminds3113, Bsandipan, Lordiis, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, Lewizho99, Maathavan___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T207878: Triage federation failures
Smalyshev added a project: User-Smalyshev. TASK DETAILhttps://phabricator.wikimedia.org/T207878EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Aklapper, Smalyshev, Nandana, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, Jonas, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Created] T207878: Triage federation failures
Smalyshev created this task.Smalyshev added a project: Wikidata-Query-Service.Restricted Application added a subscriber: Aklapper.Restricted Application added a project: Wikidata. TASK DESCRIPTIONIn https://www.wikidata.org/wiki/Wikidata:SPARQL_query_service/Federation_report, we have several endpoints failing tests. We should evaluate why this happens and either attempt to fix it or remove it from the docs. They may stay in whitelist, it doesn't hurt, but no point in advertising broken federation point. Known problems will be listed at https://www.wikidata.org/wiki/Wikidata:SPARQL_query_service/Federation_report/issuesTASK DETAILhttps://phabricator.wikimedia.org/T207878EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Aklapper, Smalyshev, Nandana, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, Jonas, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T207873: Make Kafka updater understand "dt" timestamp with microseconds
gerritbot added a project: Patch-For-Review. TASK DETAILhttps://phabricator.wikimedia.org/T207873EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: gerritbotCc: gerritbot, Aklapper, Gehel, Smalyshev, CucyNoiD, Nandana, NebulousIris, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Imarlier, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, EBjune, merbst, LawExplorer, Lewizho99, Maathavan, Jonas, Xmlizer, Wong128hk, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, ArielGlenn, He7d3r, Jdforrester-WMF, Mbch331, Jay8g, greg___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T207873: Make Kafka updater understand "dt" timestamp with microseconds
gerritbot added a comment. Change 469477 had a related patch set uploaded (by Smalyshev; owner: Smalyshev): [wikidata/query/rdf@master] Make Kafka event parser understand dates with microseconds https://gerrit.wikimedia.org/r/469477TASK DETAILhttps://phabricator.wikimedia.org/T207873EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: gerritbotCc: gerritbot, Aklapper, Gehel, Smalyshev, Nandana, Imarlier, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, Jonas, Xmlizer, Wong128hk, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, ArielGlenn, He7d3r, Jdforrester-WMF, Mbch331, Jay8g, greg___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T207817: WDQS Updater ran into issue and stopped working
Smalyshev removed a parent task: T206655: 1.33.0-wmf.1 deployment blockers. TASK DETAILhttps://phabricator.wikimedia.org/T207817EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Ottomata, Pchelolo, Tarrow, WMDE-leszek, Addshore, mmodell, Stashbot, 20after4, TerraCodes, Liuxinyu970226, gerritbot, Gehel, Smalyshev, Mathew.onipe, Aklapper, Dzahn, CucyNoiD, Nandana, NebulousIris, thifranc, AndyTan, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Davinaclare77, Adrian1985, Qtn1293, Cpaulf30, Imarlier, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Adik2382, Th3d3v1ls, Hfbn0, Ramalepe, Liugev6, QZanden, EBjune, merbst, LawExplorer, Lewizho99, Zppix, Maathavan, Jonas, Xmlizer, Wong128hk, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, ArielGlenn, faidon, He7d3r, Jdforrester-WMF, Mbch331, Jay8g, fgiunchedi, greg___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Created] T207873: Make Kafka updater understand "dt" timestamp with microseconds
Smalyshev created this task.Smalyshev triaged this task as "High" priority.Smalyshev added projects: Wikidata, Wikidata-Query-Service, Wikimedia-Incident.Restricted Application added a subscriber: Aklapper. TASK DESCRIPTIONUpdater should be able to grok timestamp like this: "dt": "2018-10-24T00:28:24.162300+00:00" The old one: "dt": "2018-10-24T00:28:24+00:00", Should still be supported.TASK DETAILhttps://phabricator.wikimedia.org/T207873EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Aklapper, Gehel, Smalyshev, Nandana, Imarlier, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, Jonas, Xmlizer, Wong128hk, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, ArielGlenn, He7d3r, Jdforrester-WMF, Mbch331, Jay8g, greg___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Lowered Priority] T207837: wdqs updater should be better isolated from blazegraph and common workload should be shared between servers
Smalyshev lowered the priority of this task from "High" to "Normal". TASK DETAILhttps://phabricator.wikimedia.org/T207837EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Aklapper, Joe, Gehel, Nandana, thifranc, AndyTan, Davinaclare77, Qtn1293, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Th3d3v1ls, Hfbn0, QZanden, EBjune, merbst, LawExplorer, Zppix, Jonas, Xmlizer, Wong128hk, jkroll, Smalyshev, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, faidon, Mbch331, Jay8g, fgiunchedi___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T207817: WDQS Updater ran into issue and stopped working
Smalyshev added a comment. @Pchelolo I think a public notification on Kafka format change would be a great idea. Since various tools may use Kafka streams (and streams derived from them), and some tools may be sensitive to exact formats. The spec at https://github.com/wikimedia/mediawiki-event-schemas/blob/master/jsonschema/resource_change/1.yaml defines "dt" as: format: date-time description: the time stamp of the event, in ISO8601 format But I'm not sure what "ISO8601 format" specifically means - ISO 8601 allows many format variations. Maybe we should specify it more strictly.TASK DETAILhttps://phabricator.wikimedia.org/T207817EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Ottomata, Pchelolo, Tarrow, WMDE-leszek, Addshore, mmodell, Stashbot, 20after4, TerraCodes, Liuxinyu970226, gerritbot, Gehel, Smalyshev, Mathew.onipe, Aklapper, Dzahn, CucyNoiD, Nandana, NebulousIris, thifranc, AndyTan, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Davinaclare77, Adrian1985, Qtn1293, Cpaulf30, Imarlier, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Adik2382, Th3d3v1ls, Hfbn0, Ramalepe, Liugev6, QZanden, EBjune, merbst, LawExplorer, Lewizho99, Zppix, Maathavan, Jonas, Xmlizer, Wong128hk, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, ArielGlenn, faidon, He7d3r, Jdforrester-WMF, Mbch331, Jay8g, fgiunchedi, greg___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T189333: Changing Kibana filters is ridiculously slow
Krinkle added a project: Wikidata-Campsite.Restricted Application added a project: Wikidata. TASK DETAILhttps://phabricator.wikimedia.org/T189333EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: KrinkleCc: Addshore, Krinkle, ssastry, tstarling, Aklapper, Tgr, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, Jonas, Wikidata-bugs, aude, Lydia_Pintscher, Mbch331, fgiunchedi, jeremyb___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Edited] T180981: Deploy WikibaseMediaInfo extension to beta
Jdforrester-WMF updated the task description. (Show Details) CHANGES TO TASK DESCRIPTION...[x ] Load (but keep disabled) the extension on Commons: [[https://gerrit.wikimedia.org/r/c/operations/mediawiki-config/+/446844/|InitialiseSettings.php]]...TASK DETAILhttps://phabricator.wikimedia.org/T180981EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Jdforrester-WMFCc: Stashbot, Jdforrester-WMF, gerritbot, Lydia_Pintscher, Aklapper, Ricordisamoa, Addshore, CucyNoiD, Nandana, NebulousIris, JKSTNK, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, PDrouin-WMF, Gq86, Baloch007, E1presidente, Ramsey-WMF, Cparle, Darkminds3113, Anooprao, SandraF_WMF, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Jayprakash12345, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Tramullas, Acer, V4switch, LawExplorer, Lewizho99, Maathavan, Urbanecm, Susannaanas, Wong128hk, Luke081515, Jane023, Wikidata-bugs, Base, matthiasmullie, aude, Wesalius, Fabrice_Florin, Raymond, Steinsplitter, Matanya, Mbch331, Jay8g, Krenair___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T180981: Deploy WikibaseMediaInfo extension to beta
Stashbot added a comment. Mentioned in SAL (#wikimedia-operations) [2018-10-24T17:04:16Z] Synchronized wmf-config/InitialiseSettings-labs.php: [Beta Cluster] Re-disable WBMI on Beta Commons for now T180981 (duration: 00m 54s)TASK DETAILhttps://phabricator.wikimedia.org/T180981EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Jdforrester-WMF, StashbotCc: Stashbot, Jdforrester-WMF, gerritbot, Lydia_Pintscher, Aklapper, Ricordisamoa, Addshore, CucyNoiD, Nandana, NebulousIris, JKSTNK, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, PDrouin-WMF, Gq86, Baloch007, E1presidente, Ramsey-WMF, Cparle, Darkminds3113, Anooprao, SandraF_WMF, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Jayprakash12345, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Tramullas, Acer, V4switch, LawExplorer, Lewizho99, Maathavan, Urbanecm, Susannaanas, Wong128hk, Luke081515, Jane023, Wikidata-bugs, Base, matthiasmullie, aude, Wesalius, Fabrice_Florin, Raymond, Steinsplitter, Matanya, Mbch331, Jay8g, Krenair___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Lowered Priority] T201204: Discuss a mock-up of displaying a structured license statement from Wikidata on Commons
Elitre lowered the priority of this task from "High" to "Normal".Elitre added a comment. No need for survey here I think.TASK DETAILhttps://phabricator.wikimedia.org/T201204EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Keegan, ElitreCc: Elitre, Qgil, SandraF_WMF, Abit, Ramsey-WMF, Slaporte, Aklapper, PDrouin-WMF, Astinson, Keegan, Nandana, JKSTNK, Lahi, Gq86, E1presidente, Cparle, Anooprao, GoranSMilovanovic, QZanden, Tramullas, Acer, V4switch, LawExplorer, Susannaanas, Wong128hk, Jane023, Wikidata-bugs, Base, matthiasmullie, aude, Ricordisamoa, Wesalius, Lydia_Pintscher, Fabrice_Florin, Raymond, Steinsplitter, Matanya, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Lowered Priority] T182672: [Epic] Facilitate community conversations and feedback about prototypes and designs for Structured Data on Wikimedia Commons
Elitre lowered the priority of this task from "High" to "Low".Elitre added a comment. (moving to Evaluated since we'll send a survey for this I believe.)TASK DETAILhttps://phabricator.wikimedia.org/T182672EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Keegan, ElitreCc: Elitre, Keegan, Ramsey-WMF, Abit, SandraF_WMF, Aklapper, Nandana, JKSTNK, Lahi, PDrouin-WMF, Gq86, E1presidente, Cparle, Anooprao, GoranSMilovanovic, QZanden, Tramullas, Acer, LawExplorer, Susannaanas, Jane023, Wikidata-bugs, Base, matthiasmullie, aude, Ricordisamoa, Wesalius, Lydia_Pintscher, Fabrice_Florin, Raymond, Steinsplitter, Mbch331, Qgil___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Raised Priority] T182672: [Epic] Facilitate community conversations and feedback about prototypes and designs for Structured Data on Wikimedia Commons
Elitre moved this task from Started to Evaluated on the CommRel-Specialists-Support (Jul-Sep-2018) board.Elitre raised the priority of this task from "Low" to "High". TASK DETAILhttps://phabricator.wikimedia.org/T182672WORKBOARDhttps://phabricator.wikimedia.org/project/board/3453/EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Keegan, ElitreCc: Elitre, Keegan, Ramsey-WMF, Abit, SandraF_WMF, Aklapper, Nandana, JKSTNK, Lahi, PDrouin-WMF, Gq86, E1presidente, Cparle, Anooprao, GoranSMilovanovic, QZanden, Tramullas, Acer, LawExplorer, Susannaanas, Jane023, Wikidata-bugs, Base, matthiasmullie, aude, Ricordisamoa, Wesalius, Lydia_Pintscher, Fabrice_Florin, Raymond, Steinsplitter, Mbch331, Qgil___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Raised Priority] T201204: Discuss a mock-up of displaying a structured license statement from Wikidata on Commons
Elitre moved this task from Backlog to Evaluated on the CommRel-Specialists-Support (Jul-Sep-2018) board.Elitre raised the priority of this task from "Normal" to "High". TASK DETAILhttps://phabricator.wikimedia.org/T201204WORKBOARDhttps://phabricator.wikimedia.org/project/board/3453/EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Keegan, ElitreCc: Qgil, SandraF_WMF, Abit, Ramsey-WMF, Slaporte, Aklapper, PDrouin-WMF, Astinson, Keegan, Nandana, JKSTNK, Lahi, Gq86, E1presidente, Cparle, Anooprao, GoranSMilovanovic, QZanden, Tramullas, Acer, V4switch, LawExplorer, Susannaanas, Wong128hk, Jane023, Wikidata-bugs, Base, matthiasmullie, aude, Ricordisamoa, Wesalius, Lydia_Pintscher, Fabrice_Florin, Raymond, Steinsplitter, Matanya, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Edited] T180981: Deploy WikibaseMediaInfo extension to beta
Jdforrester-WMF updated the task description. (Show Details) CHANGES TO TASK DESCRIPTION...[ x] Load (but keep disabled) the extension on Commons: [[https://gerrit.wikimedia.org/r/c/operations/mediawiki-config/+/446844/|InitialiseSettings.php]]...TASK DETAILhttps://phabricator.wikimedia.org/T180981EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Jdforrester-WMFCc: Stashbot, Jdforrester-WMF, gerritbot, Lydia_Pintscher, Aklapper, Ricordisamoa, Addshore, CucyNoiD, Nandana, NebulousIris, JKSTNK, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, PDrouin-WMF, Gq86, Baloch007, E1presidente, Ramsey-WMF, Cparle, Darkminds3113, Anooprao, SandraF_WMF, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Jayprakash12345, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Tramullas, Acer, V4switch, LawExplorer, Lewizho99, Maathavan, Urbanecm, Susannaanas, Wong128hk, Luke081515, Jane023, Wikidata-bugs, Base, matthiasmullie, aude, Wesalius, Fabrice_Florin, Raymond, Steinsplitter, Matanya, Mbch331, Jay8g, Krenair___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T180981: Deploy WikibaseMediaInfo extension to beta
Stashbot added a comment. Mentioned in SAL (#wikimedia-operations) [2018-10-24T16:36:56Z] Synchronized wmf-config/InitialiseSettings-labs.php: [Beta Cluster] Re-disable WBMI on Beta Commons for now T180981 (duration: 00m 54s)TASK DETAILhttps://phabricator.wikimedia.org/T180981EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Jdforrester-WMF, StashbotCc: Stashbot, Jdforrester-WMF, gerritbot, Lydia_Pintscher, Aklapper, Ricordisamoa, Addshore, CucyNoiD, Nandana, NebulousIris, JKSTNK, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, PDrouin-WMF, Gq86, Baloch007, E1presidente, Ramsey-WMF, Cparle, Darkminds3113, Anooprao, SandraF_WMF, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Jayprakash12345, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Tramullas, Acer, V4switch, LawExplorer, Lewizho99, Maathavan, Urbanecm, Susannaanas, Wong128hk, Luke081515, Jane023, Wikidata-bugs, Base, matthiasmullie, aude, Wesalius, Fabrice_Florin, Raymond, Steinsplitter, Matanya, Mbch331, Jay8g, Krenair___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T207767: Re-structure Wikibase-related configuration to be cleaner, and easier to adjust
Addshore added a project: wikidata-tech-focus. TASK DETAILhttps://phabricator.wikimedia.org/T207767EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: AddshoreCc: Addshore, Aklapper, Jdforrester-WMF, Nandana, Lahi, Gq86, GoranSMilovanovic, Jayprakash12345, QZanden, Zoranzoki21, LawExplorer, DatGuy, Devwaker, Niklitov, Urbanecm, JEumerus, Tulsi_Bhagat, Izno, Wong128hk, Luke081515, SimmeD, Wikidata-bugs, Snowolf, aude, Dcljr, Dinoguy1000, Matanya, Mbch331, Rxy, Jay8g, Krenair___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T180981: Deploy WikibaseMediaInfo extension to beta
gerritbot added a comment. Change 469059 merged by jenkins-bot: [operations/mediawiki-config@master] Revert "[Beta Cluster] Re-disable WBMI on Beta Commons for now" https://gerrit.wikimedia.org/r/469059TASK DETAILhttps://phabricator.wikimedia.org/T180981EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Jdforrester-WMF, gerritbotCc: Stashbot, Jdforrester-WMF, gerritbot, Lydia_Pintscher, Aklapper, Ricordisamoa, Addshore, CucyNoiD, Nandana, NebulousIris, JKSTNK, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, PDrouin-WMF, Gq86, Baloch007, E1presidente, Ramsey-WMF, Cparle, Darkminds3113, Anooprao, SandraF_WMF, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Jayprakash12345, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Tramullas, Acer, V4switch, LawExplorer, Lewizho99, Maathavan, Urbanecm, Susannaanas, Wong128hk, Luke081515, Jane023, Wikidata-bugs, Base, matthiasmullie, aude, Wesalius, Fabrice_Florin, Raymond, Steinsplitter, Matanya, Mbch331, Jay8g, Krenair___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T207834: Cleanup Wikidata Query Service logging configuration
Gehel added a comment. My current patch is trying to put all that logic into logback.xml, but it is definitely starting to be unreadable. And coding ifs in XML just seems wrong :/ I think that instead we should have different static logback.xml files and have a flag to switch between them. Similarly to what is done with the current -v option of the updater, but via system properties. We could even have a default config in packaged in the jar (similar to the current verbose config) under the control of the application, and override it only when run as a service.TASK DETAILhttps://phabricator.wikimedia.org/T207834EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: GehelCc: Smalyshev, gerritbot, Gehel, Aklapper, CucyNoiD, Nandana, NebulousIris, thifranc, AndyTan, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Davinaclare77, Adrian1985, Qtn1293, Cpaulf30, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Adik2382, Th3d3v1ls, Hfbn0, Ramalepe, Liugev6, QZanden, EBjune, merbst, LawExplorer, Lewizho99, Zppix, Maathavan, Jonas, Xmlizer, Wong128hk, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, faidon, Mbch331, Jay8g, fgiunchedi___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T207705: Implement the Extended Date/Time Format Specification
Jc3s5h added a comment. In T207705#4691973, @Pigsonthewing wrote: In T207705#4690349, @Jc3s5h wrote: ISO 8601 being one of the rare exceptions As noted above: "ISO 8601-2019, due in the middle of that year, is expected to support all of the features of EDTF." Furthermore, as you can read at the linked page: "the EDTF specification is included as a profile of ISO 8601." My meaning was that nearly all notations, such as "July 1, 2018", "1 July 2018" "1 VII 2018" or "Solis Kandis Juliis MMXVIII" can refer to either the Gregorian or Julian calendar; this has been so for 400 years and that is what people are used to. ISO 8601 is one of the few notations that isn't supposed to be used with Julian dates; EDTF is another.TASK DETAILhttps://phabricator.wikimedia.org/T207705EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Lydia_Pintscher, Jc3s5hCc: Jc3s5h, Mvolz, Liuxinyu970226, Pigsonthewing, Aklapper, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, Wikidata-bugs, aude, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T207834: Cleanup Wikidata Query Service logging configuration
Smalyshev added a comment. My ideal situation for Updater logs is as follows: Updater which is run from service logs to files, and logs important stuff (that would be mostly exceptions) to logstash. Routine stuff (INFO level) not necessary to keep in logstash. The log files should be accessible without root access, at least to blazegraph user, ideally to all users inside wdqs-admins group. Updater invoked from command-line logs by default to console on INFO level (it's OK to have separate option for it). logstash logging is ok but not really necessary here. Updater invoked from command-line has an option to go to DEBUG level and another to go to TRACE level. Neither DEBUG nor TRACE logs go to logstash. The options above are accessible without root/sudo and not require editing config files. For Blazegraph, we probably want everything from INFO level up into both logstash and log files. Option to run at DEBUG level would be nice but I've not used it too much in the past. We probably should get rid of both services sending anything to journald, I am disappointed in its performance and I think we should avoid putting anything there.TASK DETAILhttps://phabricator.wikimedia.org/T207834EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Smalyshev, gerritbot, Gehel, Aklapper, CucyNoiD, Nandana, NebulousIris, thifranc, AndyTan, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Davinaclare77, Adrian1985, Qtn1293, Cpaulf30, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Adik2382, Th3d3v1ls, Hfbn0, Ramalepe, Liugev6, QZanden, EBjune, merbst, LawExplorer, Lewizho99, Zppix, Maathavan, Jonas, Xmlizer, Wong128hk, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, faidon, Mbch331, Jay8g, fgiunchedi___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T207817: WDQS Updater ran into issue and stopped working
Pchelolo added a comment. Judging by the quick skim of the Jackson code it supports DateTimeFormatter.ISO_INSTANT format that should support fractional seconds parsing. However, this incident raises a question whether the change applied to EventBus was indeed backward-compatible. We've checked the known consumers (one we apparently forgot to check) that they at least don't cripple on parsing fractional seconds in ISO 8601, but maybe there exist more things introducing the fractional seconds into the dt will break. Maybe our initial approach was incorrect @Ottomata ?TASK DETAILhttps://phabricator.wikimedia.org/T207817EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: PcheloloCc: Ottomata, Pchelolo, Tarrow, WMDE-leszek, Addshore, mmodell, Stashbot, 20after4, TerraCodes, Liuxinyu970226, gerritbot, Gehel, Smalyshev, Mathew.onipe, Aklapper, Dzahn, CucyNoiD, Nandana, NebulousIris, thifranc, AndyTan, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Davinaclare77, Adrian1985, Qtn1293, Cpaulf30, Imarlier, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Adik2382, Th3d3v1ls, Hfbn0, Ramalepe, Liugev6, QZanden, EBjune, merbst, LawExplorer, Lewizho99, Zppix, Maathavan, Jonas, Xmlizer, Wong128hk, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, ArielGlenn, faidon, He7d3r, Jdforrester-WMF, Mbch331, Jay8g, fgiunchedi, greg___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T207705: Implement the Extended Date/Time Format Specification
Pigsonthewing added a comment. In T207705#4690349, @Jc3s5h wrote: ISO 8601 being one of the rare exceptions As noted above: "ISO 8601-2019, due in the middle of that year, is expected to support all of the features of EDTF."TASK DETAILhttps://phabricator.wikimedia.org/T207705EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Lydia_Pintscher, PigsonthewingCc: Jc3s5h, Mvolz, Liuxinyu970226, Pigsonthewing, Aklapper, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, Wikidata-bugs, aude, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T207817: WDQS Updater ran into issue and stopped working
ReleaseTaggerBot added a project: MW-1.33-notes (1.33.0-wmf.1; 2018-10-23). TASK DETAILhttps://phabricator.wikimedia.org/T207817EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: ReleaseTaggerBotCc: Ottomata, Pchelolo, Tarrow, WMDE-leszek, Addshore, mmodell, Stashbot, 20after4, TerraCodes, Liuxinyu970226, gerritbot, Gehel, Smalyshev, Mathew.onipe, Aklapper, Dzahn, CucyNoiD, Nandana, NebulousIris, thifranc, AndyTan, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Davinaclare77, Adrian1985, Qtn1293, Cpaulf30, Imarlier, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Adik2382, Th3d3v1ls, Hfbn0, Ramalepe, Liugev6, QZanden, EBjune, merbst, LawExplorer, Lewizho99, Zppix, Maathavan, Jonas, Xmlizer, Wong128hk, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, ArielGlenn, faidon, He7d3r, Jdforrester-WMF, Mbch331, Jay8g, fgiunchedi, greg___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T207817: WDQS Updater ran into issue and stopped working
Stashbot added a comment. Mentioned in SAL (#wikimedia-operations) [2018-10-24T16:00:33Z] 15:59:06 Synchronized php-1.33.0-wmf.1/extensions/EventBus/: revert "Set event datetime with microsecond resolution." on 1.33.0-wmf.1 refs T207817 (duration: 00m 56s)TASK DETAILhttps://phabricator.wikimedia.org/T207817EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: StashbotCc: Ottomata, Pchelolo, Tarrow, WMDE-leszek, Addshore, mmodell, Stashbot, 20after4, TerraCodes, Liuxinyu970226, gerritbot, Gehel, Smalyshev, Mathew.onipe, Aklapper, Dzahn, CucyNoiD, Nandana, NebulousIris, thifranc, AndyTan, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Davinaclare77, Adrian1985, Qtn1293, Cpaulf30, Imarlier, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Adik2382, Th3d3v1ls, Hfbn0, Ramalepe, Liugev6, QZanden, EBjune, merbst, LawExplorer, Lewizho99, Zppix, Maathavan, Jonas, Xmlizer, Wong128hk, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, ArielGlenn, faidon, He7d3r, Jdforrester-WMF, Mbch331, Jay8g, fgiunchedi, greg___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Lowered Priority] T207817: WDQS Updater ran into issue and stopped working
Smalyshev lowered the priority of this task from "Unbreak Now!" to "High".Smalyshev added a comment. Maybe jackson just can't parse this microsecond stuff? Maybe milliseconds are fine? I hope Jackson parsing format is configurable. I'll look into it today. Hopefully I can make it parse both.TASK DETAILhttps://phabricator.wikimedia.org/T207817EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Ottomata, Pchelolo, Tarrow, WMDE-leszek, Addshore, mmodell, Stashbot, 20after4, TerraCodes, Liuxinyu970226, gerritbot, Gehel, Smalyshev, Mathew.onipe, Aklapper, Dzahn, CucyNoiD, Nandana, NebulousIris, thifranc, AndyTan, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Davinaclare77, Adrian1985, Qtn1293, Cpaulf30, Imarlier, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Adik2382, Th3d3v1ls, Hfbn0, Ramalepe, Liugev6, QZanden, EBjune, merbst, LawExplorer, Lewizho99, Zppix, Maathavan, Jonas, Xmlizer, Wong128hk, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, ArielGlenn, faidon, He7d3r, Jdforrester-WMF, Mbch331, Jay8g, fgiunchedi, greg___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T207817: WDQS Updater ran into issue and stopped working
Smalyshev added a project: Wikimedia-Incident. TASK DETAILhttps://phabricator.wikimedia.org/T207817EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Ottomata, Pchelolo, Tarrow, WMDE-leszek, Addshore, mmodell, Stashbot, 20after4, TerraCodes, Liuxinyu970226, gerritbot, Gehel, Smalyshev, Mathew.onipe, Aklapper, Dzahn, CucyNoiD, Nandana, NebulousIris, thifranc, AndyTan, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Davinaclare77, Adrian1985, Qtn1293, Cpaulf30, Imarlier, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Adik2382, Th3d3v1ls, Hfbn0, Ramalepe, Liugev6, QZanden, EBjune, merbst, LawExplorer, Lewizho99, Zppix, Maathavan, Jonas, Xmlizer, Wong128hk, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, ArielGlenn, faidon, He7d3r, Jdforrester-WMF, Mbch331, Jay8g, fgiunchedi, greg___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T207817: WDQS Updater ran into issue and stopped working
gerritbot added a comment. Change 469451 merged by jenkins-bot: [mediawiki/extensions/EventBus@wmf/1.33.0-wmf.1] Revert "Set event datetime with microsecond resolution." https://gerrit.wikimedia.org/r/469451TASK DETAILhttps://phabricator.wikimedia.org/T207817EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: gerritbotCc: Ottomata, Pchelolo, Tarrow, WMDE-leszek, Addshore, mmodell, Stashbot, 20after4, TerraCodes, Liuxinyu970226, gerritbot, Gehel, Smalyshev, Mathew.onipe, Aklapper, Dzahn, CucyNoiD, Nandana, NebulousIris, thifranc, AndyTan, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Davinaclare77, Adrian1985, Qtn1293, Cpaulf30, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Adik2382, Th3d3v1ls, Hfbn0, Ramalepe, Liugev6, QZanden, EBjune, merbst, LawExplorer, Lewizho99, Zppix, Maathavan, Jonas, Xmlizer, Wong128hk, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, faidon, Mbch331, Jay8g, fgiunchedi___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T207817: WDQS Updater ran into issue and stopped working
mmodell added a comment. ok anyone care to give the ol' +2 to revert this on the branch? https://gerrit.wikimedia.org/r/#/c/mediawiki/extensions/EventBus/+/469451/TASK DETAILhttps://phabricator.wikimedia.org/T207817EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: mmodellCc: Ottomata, Pchelolo, Tarrow, WMDE-leszek, Addshore, mmodell, Stashbot, 20after4, TerraCodes, Liuxinyu970226, gerritbot, Gehel, Smalyshev, Mathew.onipe, Aklapper, Dzahn, CucyNoiD, Nandana, NebulousIris, thifranc, AndyTan, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Davinaclare77, Adrian1985, Qtn1293, Cpaulf30, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Adik2382, Th3d3v1ls, Hfbn0, Ramalepe, Liugev6, QZanden, EBjune, merbst, LawExplorer, Lewizho99, Zppix, Maathavan, Jonas, Xmlizer, Wong128hk, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, faidon, Mbch331, Jay8g, fgiunchedi___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T207817: WDQS Updater ran into issue and stopped working
Pchelolo added a comment. Maybe jackson just can't parse this microsecond stuff? Maybe milliseconds are fine? Judging by the error message, it cripples on the . after seconds. @Smalyshev Also please note we're only including microseconds and not milliseconds because of the HHVM incompatibility with PHP and the need to support HHVM for now. For all our purposes milliseconds should be enough, but seems like Jackson will not like them either out of the box.TASK DETAILhttps://phabricator.wikimedia.org/T207817EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: PcheloloCc: Ottomata, Pchelolo, Tarrow, WMDE-leszek, Addshore, mmodell, Stashbot, 20after4, TerraCodes, Liuxinyu970226, gerritbot, Gehel, Smalyshev, Mathew.onipe, Aklapper, Dzahn, CucyNoiD, Nandana, NebulousIris, thifranc, AndyTan, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Davinaclare77, Adrian1985, Qtn1293, Cpaulf30, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Adik2382, Th3d3v1ls, Hfbn0, Ramalepe, Liugev6, QZanden, EBjune, merbst, LawExplorer, Lewizho99, Zppix, Maathavan, Jonas, Xmlizer, Wong128hk, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, faidon, Mbch331, Jay8g, fgiunchedi___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T207817: WDQS Updater ran into issue and stopped working
gerritbot added a comment. Change 469451 had a related patch set uploaded (by 20after4; owner: 20after4): [mediawiki/extensions/EventBus@wmf/1.33.0-wmf.1] Revert "Set event datetime with microsecond resolution." https://gerrit.wikimedia.org/r/469451TASK DETAILhttps://phabricator.wikimedia.org/T207817EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: gerritbotCc: Ottomata, Pchelolo, Tarrow, WMDE-leszek, Addshore, mmodell, Stashbot, 20after4, TerraCodes, Liuxinyu970226, gerritbot, Gehel, Smalyshev, Mathew.onipe, Aklapper, Dzahn, CucyNoiD, Nandana, NebulousIris, thifranc, AndyTan, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Davinaclare77, Adrian1985, Qtn1293, Cpaulf30, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Adik2382, Th3d3v1ls, Hfbn0, Ramalepe, Liugev6, QZanden, EBjune, merbst, LawExplorer, Lewizho99, Zppix, Maathavan, Jonas, Xmlizer, Wong128hk, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, faidon, Mbch331, Jay8g, fgiunchedi___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T207817: WDQS Updater ran into issue and stopped working
Gehel added a comment. In T207817#4691885, @Ottomata wrote: Interesting! I checked Jodatime stuff to make sure one of our Java based pipeline handled the timestamp format change, I'm surprised that Jackson can't parse this! We can definitely parse that format if we wanted to, but we do have a fixed format configured. We could enable some magic, but it seems very bad form to autodetect a time format. There are too many ways to get it wrong. Side note, technically, this change has introduced a timezone, which should change the semantic from a LocalDate to an Instance in Joda time terminology :) so either it was technically wrong before or it is now :)TASK DETAILhttps://phabricator.wikimedia.org/T207817EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: GehelCc: Ottomata, Pchelolo, Tarrow, WMDE-leszek, Addshore, mmodell, Stashbot, 20after4, TerraCodes, Liuxinyu970226, gerritbot, Gehel, Smalyshev, Mathew.onipe, Aklapper, Dzahn, CucyNoiD, Nandana, NebulousIris, thifranc, AndyTan, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Davinaclare77, Adrian1985, Qtn1293, Cpaulf30, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Adik2382, Th3d3v1ls, Hfbn0, Ramalepe, Liugev6, QZanden, EBjune, merbst, LawExplorer, Lewizho99, Zppix, Maathavan, Jonas, Xmlizer, Wong128hk, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, faidon, Mbch331, Jay8g, fgiunchedi___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T207817: WDQS Updater ran into issue and stopped working
Ottomata added a comment. Maybe jackson just can't parse this microsecond stuff? Maybe milliseconds are fine?TASK DETAILhttps://phabricator.wikimedia.org/T207817EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: OttomataCc: Ottomata, Pchelolo, Tarrow, WMDE-leszek, Addshore, mmodell, Stashbot, 20after4, TerraCodes, Liuxinyu970226, gerritbot, Gehel, Smalyshev, Mathew.onipe, Aklapper, Dzahn, CucyNoiD, Nandana, NebulousIris, thifranc, AndyTan, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Davinaclare77, Adrian1985, Qtn1293, Cpaulf30, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Adik2382, Th3d3v1ls, Hfbn0, Ramalepe, Liugev6, QZanden, EBjune, merbst, LawExplorer, Lewizho99, Zppix, Maathavan, Jonas, Xmlizer, Wong128hk, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, faidon, Mbch331, Jay8g, fgiunchedi___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T207817: WDQS Updater ran into issue and stopped working
gerritbot added a comment. Change 469449 had a related patch set uploaded (by 20after4; owner: 20after4): [mediawiki/extensions/EventBus@master] Revert "Set event datetime with microsecond resolution." https://gerrit.wikimedia.org/r/469449TASK DETAILhttps://phabricator.wikimedia.org/T207817EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: gerritbotCc: Ottomata, Pchelolo, Tarrow, WMDE-leszek, Addshore, mmodell, Stashbot, 20after4, TerraCodes, Liuxinyu970226, gerritbot, Gehel, Smalyshev, Mathew.onipe, Aklapper, Dzahn, CucyNoiD, Nandana, NebulousIris, thifranc, AndyTan, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Davinaclare77, Adrian1985, Qtn1293, Cpaulf30, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Adik2382, Th3d3v1ls, Hfbn0, Ramalepe, Liugev6, QZanden, EBjune, merbst, LawExplorer, Lewizho99, Zppix, Maathavan, Jonas, Xmlizer, Wong128hk, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, faidon, Mbch331, Jay8g, fgiunchedi___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T207817: WDQS Updater ran into issue and stopped working
Smalyshev added a comment. @Pchelolo I can look into how to make Jackson parse it, it's probably possible, but I'd appreciate rolling it back for now until that is done.TASK DETAILhttps://phabricator.wikimedia.org/T207817EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Ottomata, Pchelolo, Tarrow, WMDE-leszek, Addshore, mmodell, Stashbot, 20after4, TerraCodes, Liuxinyu970226, gerritbot, Gehel, Smalyshev, Mathew.onipe, Aklapper, Dzahn, CucyNoiD, Nandana, NebulousIris, thifranc, AndyTan, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Davinaclare77, Adrian1985, Qtn1293, Cpaulf30, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Adik2382, Th3d3v1ls, Hfbn0, Ramalepe, Liugev6, QZanden, EBjune, merbst, LawExplorer, Lewizho99, Zppix, Maathavan, Jonas, Xmlizer, Wong128hk, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, faidon, Mbch331, Jay8g, fgiunchedi___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T207386: Typo in docstring of wikibase js file causes file to be miscategorised in doc.wikimedia.org
gerritbot added a project: Patch-For-Review. TASK DETAILhttps://phabricator.wikimedia.org/T207386EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: gerritbotCc: gerritbot, Liuxinyu970226, Aklapper, Mvolz, CucyNoiD, Nandana, NebulousIris, Kieubinhtb, Wonnral, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Asad_Ali_Palijo, Cpaulf30, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, Ivana_Isadora, Adik2382, Soteriaspace, RazeSoldier, Jayprakash12345, Th3d3v1ls, JakeTheDeveloper, Ramalepe, Liugev6, QZanden, LawExplorer, Lewizho99, Maathavan, TerraCodes, MuhammadShuaib, srodlund, SimmeD, Wikidata-bugs, aude, Dinoguy1000, jayvdb, Mbch331, Jay8g___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T207386: Typo in docstring of wikibase js file causes file to be miscategorised in doc.wikimedia.org
gerritbot added a comment. Change 469430 had a related patch set uploaded (by JasMich.de; owner: JasMich.de): [mediawiki/extensions/Wikibase@master] jQuery snackview variation: Fixed typo error https://gerrit.wikimedia.org/r/469430TASK DETAILhttps://phabricator.wikimedia.org/T207386EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: gerritbotCc: gerritbot, Liuxinyu970226, Aklapper, Mvolz, Nandana, Kieubinhtb, Wonnral, Asad_Ali_Palijo, Cpaulf30, Lahi, Gq86, GoranSMilovanovic, Ivana_Isadora, Soteriaspace, RazeSoldier, Jayprakash12345, JakeTheDeveloper, QZanden, LawExplorer, TerraCodes, MuhammadShuaib, srodlund, SimmeD, Wikidata-bugs, aude, Dinoguy1000, jayvdb, Mbch331, Jay8g___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T207817: WDQS Updater ran into issue and stopped working
Pchelolo added a comment. We could rollback https://gerrit.wikimedia.org/r/#/c/mediawiki/extensions/EventBus/+/468482/ - we can workaround it in change-prop and the issue fixed by that is much rarer, but eventually, we'd want to include millisecond resolution into the dt of the events.TASK DETAILhttps://phabricator.wikimedia.org/T207817EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: PcheloloCc: Ottomata, Pchelolo, Tarrow, WMDE-leszek, Addshore, mmodell, Stashbot, 20after4, TerraCodes, Liuxinyu970226, gerritbot, Gehel, Smalyshev, Mathew.onipe, Aklapper, Dzahn, CucyNoiD, Nandana, NebulousIris, thifranc, AndyTan, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Davinaclare77, Adrian1985, Qtn1293, Cpaulf30, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Adik2382, Th3d3v1ls, Hfbn0, Ramalepe, Liugev6, QZanden, EBjune, merbst, LawExplorer, Lewizho99, Zppix, Maathavan, Jonas, Xmlizer, Wong128hk, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, faidon, Mbch331, Jay8g, fgiunchedi___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T206863: Enable mobile-specific html to be rendered within Wikibase
gerritbot added a comment. Change 469448 had a related patch set uploaded (by Jakob; owner: Jakob): [mediawiki/extensions/Wikibase@master] Reduce Item/Property specific code used in EntityParserOutputGenerator https://gerrit.wikimedia.org/r/469448TASK DETAILhttps://phabricator.wikimedia.org/T206863EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Jakob_WMDE, gerritbotCc: gerritbot, Aklapper, Jakob_WMDE, CucyNoiD, Nandana, NebulousIris, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, LawExplorer, Lewizho99, Maathavan, Wikidata-bugs, aude, Lydia_Pintscher, Addshore, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T207817: WDQS Updater ran into issue and stopped working
Ottomata added subscribers: Pchelolo, Ottomata.Ottomata added a comment. Ping @Pchelolo. This is happening because of https://gerrit.wikimedia.org/r/#/c/mediawiki/extensions/EventBus/+/468482/ as part of a fix for T207329: Clear watchlist on enwiki only removes 50 items at a time. Interesting! I checked Jodatime stuff to make sure one of our Java based pipeline handled the timestamp format change, I'm surprised that Jackson can't parse this!TASK DETAILhttps://phabricator.wikimedia.org/T207817EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: OttomataCc: Ottomata, Pchelolo, Tarrow, WMDE-leszek, Addshore, mmodell, Stashbot, 20after4, TerraCodes, Liuxinyu970226, gerritbot, Gehel, Smalyshev, Mathew.onipe, Aklapper, Dzahn, CucyNoiD, Nandana, NebulousIris, thifranc, AndyTan, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Davinaclare77, Adrian1985, Qtn1293, Cpaulf30, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Adik2382, Th3d3v1ls, Hfbn0, Ramalepe, Liugev6, QZanden, EBjune, merbst, LawExplorer, Lewizho99, Zppix, Maathavan, Jonas, Xmlizer, Wong128hk, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, faidon, Mbch331, Jay8g, fgiunchedi___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T207843: increase restart interval of wdqs updater
gerritbot added a project: Patch-For-Review. TASK DETAILhttps://phabricator.wikimedia.org/T207843EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: gerritbotCc: gerritbot, Aklapper, Gehel, CucyNoiD, Nandana, NebulousIris, thifranc, AndyTan, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Davinaclare77, Adrian1985, Qtn1293, Cpaulf30, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Adik2382, Th3d3v1ls, Hfbn0, Ramalepe, Liugev6, QZanden, EBjune, merbst, LawExplorer, Lewizho99, Zppix, Maathavan, Jonas, Xmlizer, Wong128hk, jkroll, Smalyshev, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, faidon, Mbch331, Jay8g, fgiunchedi___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T207843: increase restart interval of wdqs updater
gerritbot added a comment. Change 469447 had a related patch set uploaded (by Gehel; owner: Gehel): [operations/puppet@production] wdqs: increase restart interval of wdqs-updater https://gerrit.wikimedia.org/r/469447TASK DETAILhttps://phabricator.wikimedia.org/T207843EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: gerritbotCc: gerritbot, Aklapper, Gehel, Nandana, thifranc, AndyTan, Davinaclare77, Qtn1293, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Th3d3v1ls, Hfbn0, QZanden, EBjune, merbst, LawExplorer, Zppix, Jonas, Xmlizer, Wong128hk, jkroll, Smalyshev, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, faidon, Mbch331, Jay8g, fgiunchedi___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Created] T207855: QualityConstraints \Api\CheckConstraintsRdf is missing tests
Tarrow created this task.Tarrow added a project: Wikidata-Campsite.Restricted Application added a subscriber: Aklapper.Restricted Application added a project: Wikidata. TASK DESCRIPTIONThere doesn't appear to be any tests relating to the CheckConstraintsRdf Action. We should probably have some.TASK DETAILhttps://phabricator.wikimedia.org/T207855WORKBOARDhttps://phabricator.wikimedia.org/project/board/3402/EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: TarrowCc: Aklapper, Tarrow, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, Jonas, Wikidata-bugs, aude, Lydia_Pintscher, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Created] T207854: Set QualityConstraints global WBQualityConstraintsCacheCheckConstraintsResults default true
Tarrow created this task.Tarrow added projects: Wikidata-Campsite, Wikidata.Restricted Application added a subscriber: Aklapper. TASK DESCRIPTIONCurrently this false everywhere by default except in production where it is true. It would probably be good to now have it default to true. @Lucas_Werkmeister_WMDE suggests there is no reason not to in T206205#4691482 change in extension.json remove true setting from production config TASK DETAILhttps://phabricator.wikimedia.org/T207854WORKBOARDhttps://phabricator.wikimedia.org/project/board/3402/EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: TarrowCc: Aklapper, Tarrow, Lucas_Werkmeister_WMDE, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, Jonas, Wikidata-bugs, aude, Lydia_Pintscher, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T207817: WDQS Updater ran into issue and stopped working
Gehel added a comment. In T207817#4691569, @mmodell wrote: Do we have a patch or should we roll back group0? We have a workaround on the WDQS side (switching back to recent changes instead of kafka events). But the root cause isn't fixed, and it is unclear to me what change caused that issue. IMHO, this should be treated as a contract change and either needs to be communicated accordingly as a breaking change or rolled back.TASK DETAILhttps://phabricator.wikimedia.org/T207817EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: GehelCc: mmodell, Stashbot, 20after4, TerraCodes, Liuxinyu970226, gerritbot, Gehel, Smalyshev, Mathew.onipe, Aklapper, Dzahn, CucyNoiD, Nandana, NebulousIris, thifranc, AndyTan, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Davinaclare77, Adrian1985, Qtn1293, Cpaulf30, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Adik2382, Th3d3v1ls, Hfbn0, Ramalepe, Liugev6, QZanden, EBjune, merbst, LawExplorer, Lewizho99, Zppix, Maathavan, Jonas, Xmlizer, Wong128hk, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, faidon, Mbch331, Jay8g, fgiunchedi___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Claimed] T207839: Batch add WO II war memorials to Wikidata
Pintoch claimed this task.Pintoch added a comment. I would be interested in helping with this - I can guide you through the uploading process with OpenRefine. If you want to prepare for this, I feel free to download OpenRefine have a look at tutorials, like these: https://www.wikidata.org/wiki/Wikidata:Tools/OpenRefine/Editing/Tutorials/Basic_editing https://www.wikidata.org/wiki/Wikidata:Tools/OpenRefine/Editing/Tutorials/Video The videos at http://openrefine.org/ are also useful to get an idea of what OpenRefine does (with no reference to Wikidata).TASK DETAILhttps://phabricator.wikimedia.org/T207839EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: PintochCc: Pintoch, RonnieV, SIryn, Elvalente, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, DDJJ, Harmonia_Amanda, Spinster, Jane023, Wikidata-bugs, aude, Mbch331, valhallasw___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Triaged] T207850: Consolidate the log groups used within Wikibase & Wikibase extensions.
Addshore triaged this task as "Normal" priority.Addshore updated the task description. (Show Details) CHANGES TO TASK DESCRIPTIONEG. wfDebugLog( __CLASS__ should instead log to a more generic log channel that we actually see in production, such as "Wikibase" (TBA actually make sure this is configured in prod). The level should also be checked, perhaps we don't want to log debug level to logstash for example? Maybe some of these log positions could also be removed?TASK DETAILhttps://phabricator.wikimedia.org/T207850EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: AddshoreCc: Krinkle, Addshore, Aklapper, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, Wikidata-bugs, aude, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Created] T207850: Consolidate the log groups used within Wikibase & Wikibase extensions.
Addshore created this task.Addshore added a project: Wikidata.Restricted Application added a subscriber: Aklapper.Restricted Application added a project: User-Addshore. TASK DESCRIPTIONTASK DETAILhttps://phabricator.wikimedia.org/T207850EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: AddshoreCc: Krinkle, Addshore, Aklapper, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, Wikidata-bugs, aude, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T206743: S8 replication issues leading to rows missing during eqiad -> codfw switch (Was: "A few lexemes disappeared")
Addshore added a comment. In T206743#4691328, @jcrespo wrote: @Addshore I thought you had communicated to wikidata users about that? Apparently not, or @Pigsonthewing didn't see it, could you link your messages to him? I'll leave that to @Lea_Lacroix_WMDE. This is still on the needs announcement column for us. The related pages that I created can be found @ https://www.wikidata.org/wiki/User:Addshore/2018/10/DC_Switch_IssueTASK DETAILhttps://phabricator.wikimedia.org/T206743EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: jcrespo, AddshoreCc: ArielGlenn, Banyek, Pigsonthewing, Nikerabbit, gerritbot, WMDE-leszek, jcrespo, mark, Stashbot, Nikki, Marostegui, daniel, TerraCodes, Liuxinyu970226, Addshore, Ladsgroup, Lea_Lacroix_WMDE, Lexicographical data, KaMan, CucyNoiD, Nandana, NebulousIris, jijiki, Mringgaard, AndyTan, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Imarlier, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, LawExplorer, Lewizho99, Minhnv-2809, Volans, Maathavan, Jonas, Johan, Wong128hk, Luke081515, Wikidata-bugs, aude, Lydia_Pintscher, Darkdadaah, He7d3r, TheDJ, Jdforrester-WMF, Mbch331, Jay8g, Krenair, akosiaris, greg, Aklapper___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T85414: wikibase: synchronize schema on production with what is created on install
Marostegui added a comment. In T85414#4661580, @WMDE-leszek wrote: wb_terms_entity_id only uses the "old", numeric-only term_entity_id column, hence it probably has been kind of replaced by term_full_entity index. As mentioned above by @Marostegui it dos not seem used, so I would guess it would be fine to just drop it from production. But sure, let's re-add to the git repo, and have it removed once we've dropped from the production DBs. This seems a sane way of proceeding to me. I am not sure if it is worth the time and specially the risk, if wb_terms is going to disappear at some pointTASK DETAILhttps://phabricator.wikimedia.org/T85414EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: MarosteguiCc: WMDE-leszek, Marostegui, Addshore, hoo, Ladsgroup, JanZerebecki, aude, Aklapper, daniel, Nandana, Banyek, AndyTan, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, Minhnv-2809, Luke081515, Wikidata-bugs, Mbch331, Jay8g, Krenair___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T207817: WDQS Updater ran into issue and stopped working
mmodell added a comment. Do we have a patch or should we roll back group0?TASK DETAILhttps://phabricator.wikimedia.org/T207817EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: mmodellCc: mmodell, Stashbot, 20after4, TerraCodes, Liuxinyu970226, gerritbot, Gehel, Smalyshev, Mathew.onipe, Aklapper, Dzahn, CucyNoiD, Nandana, NebulousIris, thifranc, AndyTan, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Davinaclare77, Adrian1985, Qtn1293, Cpaulf30, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Adik2382, Th3d3v1ls, Hfbn0, Ramalepe, Liugev6, QZanden, EBjune, merbst, LawExplorer, Lewizho99, Zppix, Maathavan, Jonas, Xmlizer, Wong128hk, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, faidon, Mbch331, Jay8g, fgiunchedi___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T206205: WBQC_ResultsSource ConstraintsServices not tested in CI for WikibaseQualityConstraints
Lucas_Werkmeister_WMDE added a comment. Ah, I see. I figure we could default that config variable to true by now, anyways… any reason not to?TASK DETAILhttps://phabricator.wikimedia.org/T206205EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Tarrow, Lucas_Werkmeister_WMDECc: gerritbot, Tarrow, Lucas_Werkmeister_WMDE, Addshore, Aklapper, CucyNoiD, Nandana, NebulousIris, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, LawExplorer, Lewizho99, Maathavan, Agabi10, Jonas, Wikidata-bugs, aude, Lydia_Pintscher, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T206205: WBQC_ResultsSource ConstraintsServices not tested in CI for WikibaseQualityConstraints
Tarrow added a comment. It's not tested because the erroring codepath is only hit if WBQualityConstraintsCacheCheckConstraintsResults config option is set to trueTASK DETAILhttps://phabricator.wikimedia.org/T206205EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: TarrowCc: gerritbot, Tarrow, Lucas_Werkmeister_WMDE, Addshore, Aklapper, CucyNoiD, Nandana, NebulousIris, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, LawExplorer, Lewizho99, Maathavan, Agabi10, Jonas, Wikidata-bugs, aude, Lydia_Pintscher, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Created] T207843: increase restart interval of wdqs updater
Gehel created this task.Gehel triaged this task as "High" priority.Gehel added projects: Wikidata, Wikidata-Query-Service, Discovery-Search (Current work), Operations.Restricted Application added a subscriber: Aklapper. TASK DESCRIPTIONwdqs updater is expected to exit on a number of failures. When those failures are not transient (as seen in parent task), the high restart rate is not helping in any way. We should increase "RestartSec" in its systemd unit to have some wait time between restarts.TASK DETAILhttps://phabricator.wikimedia.org/T207843EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: GehelCc: Aklapper, Gehel, Nandana, thifranc, AndyTan, Davinaclare77, Qtn1293, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Th3d3v1ls, Hfbn0, QZanden, EBjune, merbst, LawExplorer, Zppix, Jonas, Xmlizer, Wong128hk, jkroll, Smalyshev, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, faidon, Mbch331, Jay8g, fgiunchedi___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Edited] T207484: API to efficiently format large numbers of entity IDs
LucasWerkmeister updated the task description. (Show Details) CHANGES TO TASK DESCRIPTION...* TABernacle (entity ID cells) * Wikidata Image Positions (depicted items) * possibly some other tools that currently use `wb_terms` for this, see T197161...TASK DETAILhttps://phabricator.wikimedia.org/T207484EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: LucasWerkmeisterCc: Aklapper, LucasWerkmeister, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, Wikidata-bugs, aude, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T206743: S8 replication issues leading to rows missing during eqiad -> codfw switch (Was: "A few lexemes disappeared")
jcrespo added a comment. @Addshore I thought you had communicated to wikidata users about that? Apparently not, or @Pigsonthewing didn't see it, could you link your messages to him?TASK DETAILhttps://phabricator.wikimedia.org/T206743EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: jcrespoCc: ArielGlenn, Banyek, Pigsonthewing, Nikerabbit, gerritbot, WMDE-leszek, jcrespo, mark, Stashbot, Nikki, Marostegui, daniel, TerraCodes, Liuxinyu970226, Addshore, Ladsgroup, Lea_Lacroix_WMDE, Lexicographical data, KaMan, CucyNoiD, Nandana, NebulousIris, jijiki, Mringgaard, AndyTan, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Imarlier, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, LawExplorer, Lewizho99, Minhnv-2809, Volans, Maathavan, Jonas, Johan, Wong128hk, Luke081515, Wikidata-bugs, aude, Lydia_Pintscher, Darkdadaah, He7d3r, TheDJ, Jdforrester-WMF, Mbch331, Jay8g, Krenair, akosiaris, greg, Aklapper___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Created] T207839: Batch add WO II war memorials to Wikidata
SIryn created this task.SIryn added projects: Wikistorm, Wikidata. TASK DESCRIPTIONIt would be great if one of you could help me out with the following: The Dutch network war resources (netwerkoorlogsbronnen) wants to make their collected information on Dutch war memorials and lieu de memoire available through Wikidata. In my beginners Wikidata point of view that would involve adding new WD items for the places that don't have an ID yet, and adding properties for war memorial to existing places. Please see the attached file (in Dutch) to get an idea of the data involved. F26765683: Kopie van NOB - Lijst Monumenten Gelderland - Waardenkaart.xlsx F26765682: Kopie van Erfgoed van Strijd Bevrijding Verzet.xlsx F26765681: organisaties.htm Any help on getting this info on Wikidata or first steps on how to go about this are much appreciated! Cheers and thanks so much in advance, Michelle (SIryn)TASK DETAILhttps://phabricator.wikimedia.org/T207839WORKBOARDhttps://phabricator.wikimedia.org/project/board/3613/EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SIrynCc: SIryn, Elvalente, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, DDJJ, Harmonia_Amanda, Spinster, Jane023, Wikidata-bugs, aude, Mbch331, valhallasw___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Created] T207837: wdqs updater should be better isolated from blazegraph and common workload should be shared between servers
Gehel created this task.Gehel triaged this task as "High" priority.Gehel added projects: Wikidata-Query-Service, Discovery-Search (Current work), Operations.Restricted Application added a subscriber: Aklapper.Restricted Application added a project: Wikidata. TASK DESCRIPTIONWe've had a number of cases where wdqs-updater was either lagging because of load on blazegraph or causing issues on its own, affecting blazegraph, or at least the shared servers. A number of operations done by updater could be shared between servers, thus reducing the processing power needed and reducing the load on other services. At high level, the updater process is: get a stream of wikidata changes (either from Recent Changes API or by filtering Kafka events) deduplicate those events over a period of time enrich them with the actual data changed by querying Wikidata API batching the enriched changes to apply them to blazegraph All this is a fairly standard event sourcing pattern. The event stream is the same for all servers, so step 1), 2) and 3) could be shared, and they don't have any direct dependency on blazegraph. Step 4) needs to be done for each wdqs blazegraph instance. Additional constraints: we need to be able to replay events over some period of time (~2 weeks) during data load, data is loaded from a wikidata dump, and then updater process is used to catch up on event occurring after the dump some level of ordering is required It looks like k8s would be a reasonable place to run such a service. A single instance of the service would be needed as some shared state is required for deduplication and ordering. After step 3), events could be sent to another kafka topic. Step 4) would be a simplified updater, running on each wdqs node. I'm probably missing a few things, feedback on the proposal is welcomed!TASK DETAILhttps://phabricator.wikimedia.org/T207837EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: GehelCc: Aklapper, Joe, Gehel, Nandana, thifranc, AndyTan, Davinaclare77, Qtn1293, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Th3d3v1ls, Hfbn0, QZanden, EBjune, merbst, LawExplorer, Zppix, Jonas, Xmlizer, Wong128hk, jkroll, Smalyshev, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, faidon, Mbch331, Jay8g, fgiunchedi___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T206743: S8 replication issues leading to rows missing during eqiad -> codfw switch (Was: "A few lexemes disappeared")
Marostegui added a comment. I guess it is because what @Addshore described at T206743#4662054 ?TASK DETAILhttps://phabricator.wikimedia.org/T206743EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: jcrespo, MarosteguiCc: ArielGlenn, Banyek, Pigsonthewing, Nikerabbit, gerritbot, WMDE-leszek, jcrespo, mark, Stashbot, Nikki, Marostegui, daniel, TerraCodes, Liuxinyu970226, Addshore, Ladsgroup, Lea_Lacroix_WMDE, Lexicographical data, KaMan, CucyNoiD, Nandana, NebulousIris, jijiki, Mringgaard, AndyTan, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Imarlier, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, LawExplorer, Lewizho99, Minhnv-2809, Volans, Maathavan, Jonas, Johan, Wong128hk, Luke081515, Wikidata-bugs, aude, Lydia_Pintscher, Darkdadaah, He7d3r, TheDJ, Jdforrester-WMF, Mbch331, Jay8g, Krenair, akosiaris, greg, Aklapper___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T207834: Cleanup Wikidata Query Service logging configuration
gerritbot added a project: Patch-For-Review. TASK DETAILhttps://phabricator.wikimedia.org/T207834EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: gerritbotCc: gerritbot, Gehel, Aklapper, CucyNoiD, Nandana, NebulousIris, thifranc, AndyTan, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Davinaclare77, Adrian1985, Qtn1293, Cpaulf30, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Adik2382, Th3d3v1ls, Hfbn0, Ramalepe, Liugev6, QZanden, EBjune, merbst, LawExplorer, Lewizho99, Zppix, Maathavan, Jonas, Xmlizer, Wong128hk, jkroll, Smalyshev, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, faidon, Mbch331, Jay8g, fgiunchedi___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T207834: Cleanup Wikidata Query Service logging configuration
gerritbot added a comment. Change 463254 had a related patch set uploaded (by Gehel; owner: Gehel): [operations/puppet@production] wdqs: cleanup logback configuration https://gerrit.wikimedia.org/r/463254TASK DETAILhttps://phabricator.wikimedia.org/T207834EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: gerritbotCc: gerritbot, Gehel, Aklapper, Nandana, thifranc, AndyTan, Davinaclare77, Qtn1293, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Th3d3v1ls, Hfbn0, QZanden, EBjune, merbst, LawExplorer, Zppix, Jonas, Xmlizer, Wong128hk, jkroll, Smalyshev, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, faidon, Mbch331, Jay8g, fgiunchedi___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Created] T207834: Cleanup Wikidata Query Service logging configuration
Gehel created this task.Gehel triaged this task as "High" priority.Gehel added projects: Wikidata-Query-Service, Discovery-Search (Current work), Operations.Restricted Application added a subscriber: Aklapper.Restricted Application added a project: Wikidata. TASK DESCRIPTIONAt the moment, wdqs logging is managed by logback and is basically: send all logs to console, to be managed by journald and sent to file send all logs to logstash What we should have: immediately actionable logs should be sent to console / journald (loglevel >= WARN or ERROR) logback should log directly to files at level => INFO for wdqs and WARN for others logback should log directly to logstash at level => INFO for wdqs and WARN for others wdqs-updater needs to be run manually in some cases, those logs should be identifiable (different log files / application name suffix) TASK DETAILhttps://phabricator.wikimedia.org/T207834EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: GehelCc: Gehel, Aklapper, Nandana, thifranc, AndyTan, Davinaclare77, Qtn1293, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Th3d3v1ls, Hfbn0, QZanden, EBjune, merbst, LawExplorer, Zppix, Jonas, Xmlizer, Wong128hk, jkroll, Smalyshev, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, faidon, Mbch331, Jay8g, fgiunchedi___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Reopened] T206743: S8 replication issues leading to rows missing during eqiad -> codfw switch (Was: "A few lexemes disappeared")
Pigsonthewing reopened this task as "Open".Pigsonthewing added a comment. The issue with https://www.wikidata.org/wiki/Q2058295 which I described on 14 October, persists.TASK DETAILhttps://phabricator.wikimedia.org/T206743EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: jcrespo, PigsonthewingCc: ArielGlenn, Banyek, Pigsonthewing, Nikerabbit, gerritbot, WMDE-leszek, jcrespo, mark, Stashbot, Nikki, Marostegui, daniel, TerraCodes, Liuxinyu970226, Addshore, Ladsgroup, Lea_Lacroix_WMDE, Lexicographical data, KaMan, CucyNoiD, Nandana, NebulousIris, jijiki, Mringgaard, AndyTan, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Imarlier, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, LawExplorer, Lewizho99, Minhnv-2809, Volans, Maathavan, Jonas, Johan, Wong128hk, Luke081515, Wikidata-bugs, aude, Lydia_Pintscher, Darkdadaah, He7d3r, TheDJ, Jdforrester-WMF, Mbch331, Jay8g, Krenair, akosiaris, greg, Aklapper___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Closed] T206743: S8 replication issues leading to rows missing during eqiad -> codfw switch (Was: "A few lexemes disappeared")
Marostegui closed this task as "Resolved".Marostegui reassigned this task from Marostegui to jcrespo.Marostegui added a comment. So the scope of this ticket is all done. All the tables have been fixed and checked to ensure they are. This has been a complicated work, specially for those hosts that were not easy to reclone (the master and the labs infra). I would like to give a big thank you to @jcrespo who's done a tremendous work on getting those fixed row by row. Thanks also @Addshore for all the help. Really appreciate it. Next steps are: Finish the incident report we started at: https://wikitech.wikimedia.org/wiki/Incident_documentation/20181016-Replication_gap_on_s8_eqiad_hosts If we can reproduce this, file a bug upstream (hard to reproduce) Get to work on the action item which will help to prevent this kind of thing again: T207253 TASK DETAILhttps://phabricator.wikimedia.org/T206743EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: jcrespo, MarosteguiCc: ArielGlenn, Banyek, Pigsonthewing, Nikerabbit, gerritbot, WMDE-leszek, jcrespo, mark, Stashbot, Nikki, Marostegui, daniel, TerraCodes, Liuxinyu970226, Addshore, Ladsgroup, Lea_Lacroix_WMDE, Lexicographical data, KaMan, CucyNoiD, Nandana, NebulousIris, jijiki, Mringgaard, AndyTan, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Imarlier, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, LawExplorer, Lewizho99, Minhnv-2809, Volans, Maathavan, Jonas, Johan, Wong128hk, Luke081515, Wikidata-bugs, aude, Lydia_Pintscher, Darkdadaah, He7d3r, TheDJ, Jdforrester-WMF, Mbch331, Jay8g, Krenair, akosiaris, greg, Aklapper___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T206743: S8 replication issues leading to rows missing during eqiad -> codfw switch (Was: "A few lexemes disappeared")
Marostegui added a comment. Final round of tables that have been checked and are clean: abuse_filter_action abuse_filter_history betafeatures_user_counts content content_models global_block_whitelist ipblocks math mathoid ores_model protected_titles querycache_info revision_comment_temp securepoll_elections securepoll_entity securepoll_lists securepoll_msgs securepoll_voters securepoll_properties sites site_identifiers site_stats slot_roles templatelinks translate_metadata user_former_groups user_groups At this point, all the tables in s8 have been checked and confirmed clean.TASK DETAILhttps://phabricator.wikimedia.org/T206743EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: MarosteguiCc: ArielGlenn, Banyek, Pigsonthewing, Nikerabbit, gerritbot, WMDE-leszek, jcrespo, mark, Stashbot, Nikki, Marostegui, daniel, TerraCodes, Liuxinyu970226, Addshore, Ladsgroup, Lea_Lacroix_WMDE, Lexicographical data, KaMan, CucyNoiD, Nandana, NebulousIris, jijiki, Mringgaard, AndyTan, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Imarlier, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, LawExplorer, Lewizho99, Minhnv-2809, Volans, Maathavan, Jonas, Johan, Wong128hk, Luke081515, Wikidata-bugs, aude, Lydia_Pintscher, Darkdadaah, He7d3r, TheDJ, Jdforrester-WMF, Mbch331, Jay8g, Krenair, akosiaris, greg, Aklapper___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Edited] T206743: S8 replication issues leading to rows missing during eqiad -> codfw switch (Was: "A few lexemes disappeared")
Marostegui updated the task description. (Show Details) CHANGES TO TASK DESCRIPTION...Empty tables that need no checking: T206743#4690844 All tables checked and confirmed consistent: T206743#4691048TASK DETAILhttps://phabricator.wikimedia.org/T206743EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: MarosteguiCc: ArielGlenn, Banyek, Pigsonthewing, Nikerabbit, gerritbot, WMDE-leszek, jcrespo, mark, Stashbot, Nikki, Marostegui, daniel, TerraCodes, Liuxinyu970226, Addshore, Ladsgroup, Lea_Lacroix_WMDE, Lexicographical data, KaMan, CucyNoiD, Nandana, NebulousIris, jijiki, Mringgaard, AndyTan, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Adrian1985, Cpaulf30, Imarlier, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, LawExplorer, Lewizho99, Minhnv-2809, Volans, Maathavan, Jonas, Johan, Wong128hk, Luke081515, Wikidata-bugs, aude, Lydia_Pintscher, Darkdadaah, He7d3r, TheDJ, Jdforrester-WMF, Mbch331, Jay8g, Krenair, akosiaris, greg, Aklapper___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T207817: WDQS Updater ran into issue and stopped working
Gehel added a subtask: T207656: WDQS logging to logstash should be rate limited. TASK DETAILhttps://phabricator.wikimedia.org/T207817EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: GehelCc: Stashbot, 20after4, TerraCodes, Liuxinyu970226, gerritbot, Gehel, Smalyshev, Mathew.onipe, Aklapper, Dzahn, CucyNoiD, Nandana, NebulousIris, thifranc, AndyTan, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Davinaclare77, Adrian1985, Qtn1293, Cpaulf30, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Adik2382, Th3d3v1ls, Hfbn0, Ramalepe, Liugev6, QZanden, EBjune, merbst, LawExplorer, Lewizho99, Zppix, Maathavan, Jonas, Xmlizer, Wong128hk, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, faidon, Mbch331, Jay8g, fgiunchedi___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T207817: WDQS Updater ran into issue and stopped working
Stashbot added a comment. Mentioned in SAL (#wikimedia-operations) [2018-10-24T07:33:26Z] powercycling wdqs1010 - T207817TASK DETAILhttps://phabricator.wikimedia.org/T207817EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: StashbotCc: Stashbot, 20after4, TerraCodes, Liuxinyu970226, gerritbot, Gehel, Smalyshev, Mathew.onipe, Aklapper, Dzahn, CucyNoiD, Nandana, NebulousIris, thifranc, AndyTan, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Davinaclare77, Adrian1985, Qtn1293, Cpaulf30, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Adik2382, Th3d3v1ls, Hfbn0, Ramalepe, Liugev6, QZanden, EBjune, merbst, LawExplorer, Lewizho99, Zppix, Maathavan, Jonas, Xmlizer, Wong128hk, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, faidon, Mbch331, Jay8g, fgiunchedi___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Created] T207826: Weird reference message in WDQS updater
Smalyshev created this task.Smalyshev added a project: Wikidata-Query-Service.Restricted Application added a subscriber: Aklapper.Restricted Application added a project: Wikidata. TASK DESCRIPTIONLog messages: Oct 24 07:28:14 wdqs1009 wdqs-updater[2368]: 07:28:14.382 [update 0] INFO o.wikidata.query.rdf.tool.rdf.Munger - Weird reference http://www.wikidata.org/reference/ea16b92820b22ef8f95e001afa3bbaacf1fd5cb8: unknown value http://www.wikidata.org/value/a843a14d6be3111e93a253fd623f18cf for http://www.wikidata.org/entity/Q49642420 appear very often, frequently with the same value ID. We need to check why it happens, may be some data corrution?TASK DETAILhttps://phabricator.wikimedia.org/T207826EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Aklapper, Smalyshev, Nandana, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, LawExplorer, Jonas, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T207817: WDQS Updater ran into issue and stopped working
Smalyshev added a comment. The message that comes from mediawiki.org looks like: {"comment": "Stabl", "database": "mediawikiwiki", "meta": {"domain": "www.mediawiki.org", "dt": "2018-10-24T00:28:24.162300+00:00", "id": "b7aa095a-d723-11e8-be6d-1418776134a1", "request_id": "23e8fa7b-8c07-4ffc-ba43-d30e025b65cb", "schema_uri": "mediawiki/revision/create/3", "topic": "mediawiki.revision-create", "uri": "https://www.mediawiki.org/wiki/Extension:EditSubpages"}, "page_id": 22458, "page_is_redirect": false, "page_namespace": 102, "page_title": "Extension:EditSubpages", "parsedcomment": "Stabl", "performer": {"user_groups": ["*"], "user_is_bot": false, "user_text": "2001:56A:76EC:E800:3C6D:9381:428E:ACE5"}, "rev_content_changed": true, "rev_content_format": "text/x-wiki", "rev_content_model": "wikitext", "rev_id": 2930951, "rev_len": 6582, "rev_minor_edit": false, "rev_parent_id": 2930950, "rev_sha1": "7sk6l1w8g56i7aiff8kuursjb4p7goj", "rev_timestamp": "2018-10-24T00:28:06Z"} Note the different format for "dt" timestamp. Timestamps from all other sources are normal, all timestamps from mediawiki.org are in weird format.TASK DETAILhttps://phabricator.wikimedia.org/T207817EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: 20after4, TerraCodes, Liuxinyu970226, gerritbot, Gehel, Smalyshev, Mathew.onipe, Aklapper, Dzahn, CucyNoiD, Nandana, NebulousIris, thifranc, AndyTan, Gaboe420, Versusxo, Majesticalreaper22, Giuliamocci, Davinaclare77, Adrian1985, Qtn1293, Cpaulf30, Lahi, Gq86, Baloch007, Darkminds3113, Bsandipan, Lordiis, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Adik2382, Th3d3v1ls, Hfbn0, Ramalepe, Liugev6, QZanden, EBjune, merbst, LawExplorer, Lewizho99, Zppix, Maathavan, Jonas, Xmlizer, Wong128hk, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, faidon, Mbch331, Jay8g, fgiunchedi___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs