[Wikidata-bugs] [Maniphest] [Updated] T178153: make disabledUsageAspects coarse graining
ReleaseTaggerBot added a project: MW-1.31-release-notes (WMF-deploy-2017-10-24 (1.31.0-wmf.5)). TASK DETAILhttps://phabricator.wikimedia.org/T178153EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hoo, ReleaseTaggerBotCc: gerritbot, Lydia_Pintscher, hoo, daniel, Aklapper, eranroz, GoranSMilovanovic, QZanden, Wikidata-bugs, aude, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Edited] T172914: mw.wikibase.entity: Use __index to lazy register entity usages
hoo updated the task description. (Show Details) CHANGES TO TASK DESCRIPTIONWe should only track an all usage for an entity table loaded via [[ https://www.mediawiki.org/wiki/Extension:Wikibase_Client/Lua#mw.wikibase.getEntity | `mw.wikibase.getEntity` ]], if the data on it is actually used. This can (later on?) be expanded, along with T151717, to track the most specific usages only. Note: This is very similar to {T76156} and might be doable in one patch, but has a different purposeSteps to get this enabled in production: [x] Merge {T178153} [] Deploy T178153 (27cb7f6e1615db26460d035bc8ee372f1ec15f8e) [] Change the `disabledUsageAspects` setting [] Enable this in the settings for all statement usage test wikis [] Deploy this [] Gradually enable this on all wikis Note: This is similar to {T76156}.TASK DETAILhttps://phabricator.wikimedia.org/T172914EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: eranroz, hooCc: Bawolff, thiemowmde, gerritbot, Halfak, Aklapper, daniel, Lydia_Pintscher, aude, Liuxinyu970226, CennoxX, Scott_WUaS, Ltrlg, Oliv0, Izno, eranroz, PokestarFan, Doc_James, hoo, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Wikidata-bugs, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T178445: flapping monitoring for recommendation_api on scb
mobrovac added subscribers: Gehel, Smalyshev, mobrovac.mobrovac edited projects, added Services (watching), Recommendation-API, Wikidata-Query-Service; removed Services.mobrovac added a comment.Herald added projects: Wikidata, Discovery. The 429 coming from WDQS. @Gehel, @Smalyshev would it be possible to split WDQS' rate limiting for internal and external requests?TASK DETAILhttps://phabricator.wikimedia.org/T178445EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: mobrovacCc: mobrovac, Smalyshev, Gehel, Stashbot, Aklapper, Dzahn, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Th3d3v1ls, Hfbn0, QZanden, EBjune, merbst, Avner, Zppix, Volans, debt, Jonas, FloNight, Xmlizer, Eevans, jkroll, Hardikj, Wikidata-bugs, Jdouglas, aude, Tobias1984, Capt_Swing, Manybubbles, faidon, Mbch331, Jay8g, fgiunchedi___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T178445: flapping monitoring for recommendation_api on scb
Smalyshev added a comment. @mborovac what's the rate the requests are currently sent at? IIRC the limits we have are pretty generous, but depends on the use case of course.TASK DETAILhttps://phabricator.wikimedia.org/T178445EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: mobrovac, Smalyshev, Gehel, Stashbot, Aklapper, Dzahn, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Th3d3v1ls, Hfbn0, QZanden, EBjune, merbst, Avner, Zppix, Volans, debt, Jonas, FloNight, Xmlizer, Eevans, jkroll, Hardikj, Wikidata-bugs, Jdouglas, aude, Tobias1984, Capt_Swing, Manybubbles, faidon, Mbch331, Jay8g, fgiunchedi___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T178445: flapping monitoring for recommendation_api on scb
Gehel added a comment. @mobrovac it is possible if we can identify internal traffic. The throttling we apply is bucketed by user agent / IP, so I suspect that all the recommendation API traffic end up in the same bucket. We could add an exception for specific user agent. Or have Recommendation API propagate some way to bucket by end user. This needs a little bit of thinking.TASK DETAILhttps://phabricator.wikimedia.org/T178445EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: GehelCc: mobrovac, Smalyshev, Gehel, Stashbot, Aklapper, Dzahn, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Th3d3v1ls, Hfbn0, QZanden, EBjune, merbst, Avner, Zppix, Volans, debt, Jonas, FloNight, Xmlizer, Eevans, jkroll, Hardikj, Wikidata-bugs, Jdouglas, aude, Tobias1984, Capt_Swing, Manybubbles, faidon, Mbch331, Jay8g, fgiunchedi___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T138371: WordPress plugin to associate tags with Wikidata IDs
Zeko added a comment. Include a field on the term edit screen (e.g. Posts > Tags > [Tag] > Edit). There is a term meta API for this in WordPress (see add_term_meta()) This is really nice to know and will save a lot of work =) My feeling is that many site owners would find that to be undesirable - taking people away from their site to a page that might not necessarily add more to their experience. The average user is unlikely to care much for that wikidata page :) That is something that worried me off, that could be a little intrussive I'm not sure we can avoid the manual effort that requires of the user without interrupting the save post flow, which could be frustrating. But what if the user has already set the associations? He can just focus on his post and forget them, that is the point of the setup page, however we could add some kind of setup during the edition of posts for new tags. Anyway I don't know how frequent is to add new tags ior how many of them can be added in a row. The code up to this time is at https://github.com/zeko3991/Wikidata-references that is NOT the official repository. Later on I will upload to an official repository of the University of Zaragoza. Don't freak out if you see strange things in the code, I'm quite new at wordpress developing and still have to try trivial things to see how it works =) everything will be clean at the end. Also I'd want to insist about the license topic I asked before. Thank you!TASK DETAILhttps://phabricator.wikimedia.org/T138371EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: ZekoCc: Philipjohn21, Liuxinyu970226, Samwilson, Mbch331, Framawiki, DanBri, Esh77, Lydia_Pintscher, abian, Tramullas, Zeko, Aklapper, Pigsonthewing, Zppix, GoranSMilovanovic, QZanden, Psychoslave, Wikidata-bugs, aude___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Claimed] T138371: WordPress plugin to associate tags with Wikidata IDs
Zeko claimed this task. TASK DETAILhttps://phabricator.wikimedia.org/T138371EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: ZekoCc: Philipjohn21, Liuxinyu970226, Samwilson, Mbch331, Framawiki, DanBri, Esh77, Lydia_Pintscher, abian, Tramullas, Zeko, Aklapper, Pigsonthewing, Zppix, GoranSMilovanovic, QZanden, Psychoslave, Wikidata-bugs, aude___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T178445: flapping monitoring for recommendation_api on scb
mobrovac added a comment. In T178445#3692895, @Smalyshev wrote: @mobrovac what's the rate the requests are currently sent at? IIRC the limits we have are pretty generous, but depends on the use case of course. This is the part that I don't understand - the rate of the public end point is 0, which means that the Recommendation API service contacts WDQS on;y 4 times every 60 seconds due to the automatic monitoring script sending health-check requests to it, which doesn't seem like something that should trigger rate limiting. In T178445#3692899, @Gehel wrote: We could add an exception for specific user agent. Or have Recommendation API propagate some way to bucket by end user. This needs a little bit of thinking. The latter would be ideal. We could forward the client's IP via the x-client-ip header.TASK DETAILhttps://phabricator.wikimedia.org/T178445EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: mobrovacCc: mobrovac, Smalyshev, Gehel, Stashbot, Aklapper, Dzahn, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Th3d3v1ls, Hfbn0, QZanden, EBjune, merbst, Avner, Zppix, Volans, debt, Jonas, FloNight, Xmlizer, Eevans, jkroll, Hardikj, Wikidata-bugs, Jdouglas, aude, Tobias1984, Capt_Swing, Manybubbles, faidon, Mbch331, Jay8g, fgiunchedi___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Block] T138371: WordPress plugin to associate tags with Wikidata IDs
Zeko created subtask T178455: Disambiguation for Wikidata search from tags terms in wordpress. TASK DETAILhttps://phabricator.wikimedia.org/T138371EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: ZekoCc: Philipjohn21, Liuxinyu970226, Samwilson, Mbch331, Framawiki, DanBri, Esh77, Lydia_Pintscher, abian, Tramullas, Zeko, Aklapper, Pigsonthewing, Zppix, GoranSMilovanovic, QZanden, Psychoslave, Wikidata-bugs, aude___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Created] T178455: Disambiguation for Wikidata search from tags terms in wordpress
Zeko created this task.Zeko added projects: Wikimania-Hackathon-2016, Wikidata. TASK DESCRIPTION To add a list of the tags of the blog in the plugin setup page Add a form to each tag in that setup page in which the user can add manually a wikidata ID Develop a _javascript_ function to automatically search for the tag term in wikidata and return a list of wikidata items (and their related wikidata ID) to let the user choose the most accurate to the tag he is using. Save all in Wordpress setup Working on this right now =) https://github.com/zeko3991/Wikidata-referencesTASK DETAILhttps://phabricator.wikimedia.org/T178455EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: ZekoCc: Zppix, Pigsonthewing, Aklapper, Tramullas, abian, Lydia_Pintscher, Esh77, DanBri, Framawiki, Mbch331, Samwilson, Liuxinyu970226, Philipjohn21, Zeko, GoranSMilovanovic, QZanden, Psychoslave, Wikidata-bugs, aude___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T177155: Find test wiki(s) for new description usage and enable there
gerritbot added a comment. Change 384003 merged by jenkins-bot: [operations/mediawiki-config@master] Enable description usage tracking on a few test wikis https://gerrit.wikimedia.org/r/384003TASK DETAILhttps://phabricator.wikimedia.org/T177155EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hoo, gerritbotCc: gerritbot, Marostegui, Aklapper, jcrespo, revi, hoo, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Minhnv-2809, Maathavan, Luke081515, Wikidata-bugs, aude, Mbch331, Jay8g, Krenair___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T177155: Find test wiki(s) for new description usage and enable there
Stashbot added a comment. Mentioned in SAL (#wikimedia-operations) [2017-10-18T08:09:34Z] Synchronized wmf-config/InitialiseSettings.php: Enable description usage tracking on a few test wikis (T177155) (duration: 00m 50s)TASK DETAILhttps://phabricator.wikimedia.org/T177155EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hoo, StashbotCc: Stashbot, gerritbot, Marostegui, Aklapper, jcrespo, revi, hoo, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Minhnv-2809, Maathavan, Luke081515, Wikidata-bugs, aude, Mbch331, Jay8g, Krenair___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T178445: flapping monitoring for recommendation_api on scb
Gehel added a comment. Looking at logs in logstash, it seems we throttled Recommendation API only when WDQS was overwhelmed by another user. Throttling is done on overall request time and the service was most probably already not responding correctly, or in a reasonable time. My understanding at this point is that the flapping and alerting was reasonable. WDQS was returning 429 (throttling), but without throttling, it would probably have timed out. Forwarding x-client-ip might still make sense. Or sending a user-agent combining the current UA and the end user UA.TASK DETAILhttps://phabricator.wikimedia.org/T178445EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: GehelCc: mobrovac, Smalyshev, Gehel, Stashbot, Aklapper, Dzahn, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Th3d3v1ls, Hfbn0, QZanden, EBjune, merbst, Avner, Zppix, Volans, debt, Jonas, FloNight, Xmlizer, Eevans, jkroll, Hardikj, Wikidata-bugs, Jdouglas, aude, Tobias1984, Capt_Swing, Manybubbles, faidon, Mbch331, Jay8g, fgiunchedi___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Unblock] T106287: [Task] Track descriptions usages separately (Create a new description usage aspect "D")
hoo closed subtask T177155: Find test wiki(s) for new description usage and enable there as "Resolved". TASK DETAILhttps://phabricator.wikimedia.org/T106287EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hooCc: thiemowmde, gerritbot, eranroz, PokestarFan, jmadler, hoo, daniel, zhuyifei1999, Eloquence, Lydia_Pintscher, Sannita, Ainali, Liuxinyu970226, MZMcBride, Ricordisamoa, Micru, jayvdb, Daniel_Mietchen, Tobi_WMDE_SW, Legoktm, Abraham, greg, Wikidata-bugs, liangent, jeremyb, aude, Bianjiang, Aklapper, GoranSMilovanovic, QZanden, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Edited] T106287: [Task] Track descriptions usages separately (Create a new description usage aspect "D")
hoo updated the task description. (Show Details) CHANGES TO TASK DESCRIPTION...[x] Remove `'D'` from `$wgWBClientSettings['disabledUsageAspects']` test-wise on a few wikis (all small wikis, `elwiki`, …) (T177155) [] Evaluate statistics from T177155 [] Remove `'D'` from `$wgWBClientSettings['disabledUsageAspects']` on commons (Which should be the wiki where this has the biggest effect)...TASK DETAILhttps://phabricator.wikimedia.org/T106287EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hooCc: thiemowmde, gerritbot, eranroz, PokestarFan, jmadler, hoo, daniel, zhuyifei1999, Eloquence, Lydia_Pintscher, Sannita, Ainali, Liuxinyu970226, MZMcBride, Ricordisamoa, Micru, jayvdb, Daniel_Mietchen, Tobi_WMDE_SW, Legoktm, Abraham, greg, Wikidata-bugs, liangent, jeremyb, aude, Bianjiang, Aklapper, GoranSMilovanovic, QZanden, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Closed] T177155: Find test wiki(s) for new description usage and enable there
hoo closed this task as "Resolved".hoo removed a project: Patch-For-Review. TASK DETAILhttps://phabricator.wikimedia.org/T177155EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hooCc: Stashbot, gerritbot, Marostegui, Aklapper, jcrespo, revi, hoo, GoranSMilovanovic, QZanden, Minhnv-2809, Luke081515, Wikidata-bugs, aude, Mbch331, Jay8g, Krenair___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T151717: Usage tracking: record which statement group is used
gerritbot added a comment. Change 384592 merged by jenkins-bot: [operations/mediawiki-config@master] Re-enable Statement usage tracking on cawiki https://gerrit.wikimedia.org/r/384592TASK DETAILhttps://phabricator.wikimedia.org/T151717EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hoo, gerritbotCc: Marostegui, Bawolff, eranroz, Ottomata, PokestarFan, Ladsgroup, Stashbot, gerritbot, Halfak, jcrespo, TomT0m, Hall1467, hoo, zhuyifei1999, Eloquence, Lydia_Pintscher, Sannita, Ainali, Liuxinyu970226, MZMcBride, Ricordisamoa, Micru, jayvdb, Daniel_Mietchen, Tobi_WMDE_SW, Legoktm, Abraham, Wikidata-bugs, liangent, jeremyb, aude, Bianjiang, Aklapper, DixonD, daniel, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Minhnv-2809, Maathavan, Luke081515, Mbch331, Jay8g, Krenair___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T151717: Usage tracking: record which statement group is used
Stashbot added a comment. Mentioned in SAL (#wikimedia-operations) [2017-10-18T08:41:48Z] Synchronized wmf-config/InitialiseSettings.php: Re-enable Statement usage tracking on cawiki (T151717) (duration: 00m 50s)TASK DETAILhttps://phabricator.wikimedia.org/T151717EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hoo, StashbotCc: Marostegui, Bawolff, eranroz, Ottomata, PokestarFan, Ladsgroup, Stashbot, gerritbot, Halfak, jcrespo, TomT0m, Hall1467, hoo, zhuyifei1999, Eloquence, Lydia_Pintscher, Sannita, Ainali, Liuxinyu970226, MZMcBride, Ricordisamoa, Micru, jayvdb, Daniel_Mietchen, Tobi_WMDE_SW, Legoktm, Abraham, Wikidata-bugs, liangent, jeremyb, aude, Bianjiang, Aklapper, DixonD, daniel, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Minhnv-2809, Maathavan, Luke081515, Mbch331, Jay8g, Krenair___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Triaged] T178144: Clarify licensing status of data on Structured Commons
Qgil triaged this task as "Normal" priority.Qgil added a comment. (Assuming Normal priority, please correct if this is wrong.)TASK DETAILhttps://phabricator.wikimedia.org/T178144EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Slaporte, QgilCc: Qgil, Ricordisamoa, Lydia_Pintscher, Abit, Slaporte, SandraF_WMF, Aklapper, E1presidente, Ramsey-WMF, Jmmuguerza, GoranSMilovanovic, Ivana_Isadora, QZanden, Acer, Jseddon, FloNight, Trizek-WMF, Susannaanas, ZhouZ, Mpaulson, Wikidata-bugs, PKM, Base, matthiasmullie, aude, jayvdb, Fabrice_Florin, Raymond, Steinsplitter, Mbch331, Jay8g, Keegan, Elitre___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Changed Subscribers] T178445: flapping monitoring for recommendation_api on scb
mobrovac added subscribers: Volans, Joe.mobrovac added a comment. The amount of requests from the Recommendation API service actually makes sense. On each service checker script run, 3 requests are sent to WDQS from the service. Accounting for the number of hosts and frequency of the checks, we get to 0.5 requests per second. However, because the checker script does not receive the expected status, it retries multiple times, which brings us to the observed rate of approximately 1.5 reqs/s. @Joe, @Volans should perhaps some back-off policy be implemented in the checker script, especially when it receives 429s?TASK DETAILhttps://phabricator.wikimedia.org/T178445EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: mobrovacCc: Joe, Volans, mobrovac, Smalyshev, Gehel, Stashbot, Aklapper, Dzahn, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Th3d3v1ls, Hfbn0, QZanden, EBjune, merbst, Avner, Zppix, debt, Jonas, FloNight, Xmlizer, Eevans, jkroll, Hardikj, Wikidata-bugs, Jdouglas, aude, Tobias1984, Capt_Swing, Manybubbles, faidon, Mbch331, Jay8g, fgiunchedi___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Closed] T173747: Migrate the back end code to a separate repository
Hjfocs closed this task as "Resolved".Hjfocs moved this task from Doing to Done on the Wikidata-primary-sources board.Hjfocs added a comment. Standalone module based on WDQS release 0.2.5: https://github.com/marfox/pst-backend ; WDQS fork that integrates the above repo as a submodule: https://github.com/marfox/wikidata-query-rdf/tree/release4pst ; original primary sources tool repo now uses the WDQS fork as a submodule: https://github.com/Wikidata/primarysources/tree/towards-v2 . TASK DETAILhttps://phabricator.wikimedia.org/T173747WORKBOARDhttps://phabricator.wikimedia.org/project/board/2788/EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: HjfocsCc: Hjfocs, Aklapper, Smalyshev, GoranSMilovanovic, Kiailandi, QZanden, dachary, Wikidata-bugs, aude, Ricordisamoa, Sjoerddebruin, Tpt, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Created] T178476: Integrate code review patch sets
Hjfocs created this task.Hjfocs added projects: Wikidata-primary-sources, Wikidata.Herald added a subscriber: Aklapper. TASK DESCRIPTIONTASK DETAILhttps://phabricator.wikimedia.org/T178476EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: HjfocsCc: Aklapper, Hjfocs, GoranSMilovanovic, Kiailandi, QZanden, dachary, Wikidata-bugs, aude, Ricordisamoa, Sjoerddebruin, Tpt, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Raised Priority] T178187: Support Javascript-based tools on Wikimedia Commons in the transition to structured data
SandraF_WMF raised the priority of this task from "Low" to "Normal".SandraF_WMF added a comment. I'd say it's normal priority. Will probably not be solved in one quarter though.TASK DETAILhttps://phabricator.wikimedia.org/T178187EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SandraF_WMFCc: Qgil, Legoktm, Steinsplitter, SandraF_WMF, Aklapper, E1presidente, Ramsey-WMF, Jmmuguerza, GoranSMilovanovic, Ivana_Isadora, QZanden, enigmaeth, rohitt, Acer, Jseddon, FloNight, Dixtosa, Trizek-WMF, Susannaanas, Wikidata-bugs, PKM, Base, matthiasmullie, aude, Ricordisamoa, Fabrice_Florin, Raymond, Mbch331, Keegan, Elitre___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T178455: Disambiguation for Wikidata search from tags terms in wordpress
Zeko added a comment. F10293586: image.png Created a setup page and added a list with a tag list (please ignore the tag names), in each one its possible to add a wiki id manually (won't be saved yet) or just press the "search" button that later on will call a _javascript_ function that will open a dialog with a list of results to select.TASK DETAILhttps://phabricator.wikimedia.org/T178455EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: ZekoCc: Zppix, Pigsonthewing, Aklapper, Tramullas, abian, Lydia_Pintscher, Esh77, DanBri, Framawiki, Mbch331, Samwilson, Liuxinyu970226, Philipjohn21, Zeko, GoranSMilovanovic, QZanden, Psychoslave, Wikidata-bugs, aude___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T178445: flapping monitoring for recommendation_api on scb
Gehel added a comment. I'm not sure why we have a retry in the first place. An exponential back-off would be good, or to honor the "Retry-After" HTTP header sent by WDQS on 429 errors.TASK DETAILhttps://phabricator.wikimedia.org/T178445EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: GehelCc: Joe, Volans, mobrovac, Smalyshev, Gehel, Stashbot, Aklapper, Dzahn, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Th3d3v1ls, Hfbn0, QZanden, EBjune, merbst, Avner, Zppix, debt, Jonas, FloNight, Xmlizer, Eevans, jkroll, Hardikj, Wikidata-bugs, Jdouglas, aude, Tobias1984, Capt_Swing, Manybubbles, faidon, Mbch331, Jay8g, fgiunchedi___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Created] T178491: Make WDQS throttling more aggressive
Gehel created this task.Gehel added projects: Wikidata-Query-Service, Discovery-Wikidata-Query-Service-Sprint, Operations, Wikimedia-Incident.Herald added a subscriber: Aklapper.Herald added projects: Wikidata, Discovery. TASK DESCRIPTIONA recent incident on WDQS show that our throttling is not aggressive enough. The current throttling starts tracking users only once they make a request which takes more than 10 seconds to complete. This does not prevent a single user from generating enough short request to overload the system. We should reduce this threshold (or even remove it entirely), without changing the current limits. For the record, the current limits are: 60 seconds of processing time per minute (peak at 120 seconds) 30 errors per minute (peak at 60) TASK DETAILhttps://phabricator.wikimedia.org/T178491EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: GehelCc: Smalyshev, Gehel, Aklapper, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Th3d3v1ls, Hfbn0, QZanden, EBjune, merbst, Avner, Zppix, debt, Jonas, FloNight, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, ArielGlenn, faidon, He7d3r, Mbch331, Jay8g, fgiunchedi, greg, mmodell___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T178447: Make semantic choices for clarity between Commons items and Wikidata items ("labels" vs. "captions", etc.)
matthiasmullie removed a project: Easy. TASK DETAILhttps://phabricator.wikimedia.org/T178447EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: matthiasmullieCc: Aklapper, MBinder_WMF, Cparle, MarkTraceur, Ramsey-WMF, TerraCodes, E1presidente, Jmmuguerza, SandraF_WMF, GoranSMilovanovic, QZanden, Acer, V4switch, Susannaanas, Wong128hk, Wikidata-bugs, PKM, Base, matthiasmullie, aude, Bawolff, Ricordisamoa, Fabrice_Florin, Raymond, Steinsplitter, Matanya, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Created] T178492: Create a more controlled WDQS cluster
Gehel created this task.Gehel added projects: Wikidata-Query-Service, Discovery-Wikidata-Query-Service-Sprint, Structured-Data-Commons.Herald added a subscriber: Aklapper.Herald added projects: Wikidata, Discovery. TASK DESCRIPTIONWDQS is by design a fragile service. We allow arbitrary users to run arbitrary SPARQL queries. This is similar to allow any user direct access to our production MySQL databases. This is fine as long as the expectations are managed. It is definitely wrong when services from which we expect stable response time and availability start depending on it. Splitting WDQS in a public, do whatever you want service and a different more controlled service make sense. This would be similar to what we do with MySQL, splitting it between a production service and labs replicas, with different expectations. My understanding is that the structured data on commons project will rely on WDQS for some of its functionalities. If we want that project to be stable, we need to address the WDQS stability issues.TASK DETAILhttps://phabricator.wikimedia.org/T178492EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: GehelCc: Aklapper, debt, Smalyshev, Gehel, Gq86, E1presidente, Ramsey-WMF, Jmmuguerza, SandraF_WMF, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, Acer, merbst, Avner, Jonas, FloNight, Xmlizer, Susannaanas, jkroll, Wikidata-bugs, Jdouglas, PKM, Base, matthiasmullie, aude, Tobias1984, Manybubbles, Ricordisamoa, Fabrice_Florin, Raymond, Steinsplitter, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T178491: Make WDQS throttling more aggressive
gerritbot added a comment. Change 384986 had a related patch set uploaded (by Gehel; owner: Gehel): [wikidata/query/rdf@master] Make throttling more aggressive https://gerrit.wikimedia.org/r/384986TASK DETAILhttps://phabricator.wikimedia.org/T178491EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Gehel, gerritbotCc: gerritbot, Smalyshev, Gehel, Aklapper, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Th3d3v1ls, Hfbn0, QZanden, EBjune, merbst, Avner, Zppix, debt, Jonas, FloNight, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, ArielGlenn, faidon, He7d3r, Mbch331, Jay8g, fgiunchedi, greg, mmodell___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T178491: Make WDQS throttling more aggressive
gerritbot added a project: Patch-For-Review. TASK DETAILhttps://phabricator.wikimedia.org/T178491EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Gehel, gerritbotCc: gerritbot, Smalyshev, Gehel, Aklapper, Gq86, Lordiis, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Adik2382, Th3d3v1ls, Hfbn0, Ramalepe, Liugev6, QZanden, EBjune, merbst, Avner, Lewizho99, Zppix, Maathavan, debt, Jonas, FloNight, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, ArielGlenn, faidon, He7d3r, Mbch331, Jay8g, fgiunchedi, greg, mmodell___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T178492: Create a more controlled WDQS cluster
Jonas added a comment. My understanding is that the structured data on commons project will rely on WDQS for some of its functionalities. If we want that project to be stable, we need to address the WDQS stability issues. In what form does it rely on it? What I can say is that #wikibase-quality-constraints depends on WDQS and also on short response times. Could we maybe create an official list?TASK DETAILhttps://phabricator.wikimedia.org/T178492EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: JonasCc: Jonas, Aklapper, debt, Smalyshev, Gehel, Gq86, E1presidente, Ramsey-WMF, Jmmuguerza, SandraF_WMF, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, Acer, merbst, Avner, FloNight, Xmlizer, Susannaanas, jkroll, Wikidata-bugs, Jdouglas, PKM, Base, matthiasmullie, aude, Tobias1984, Manybubbles, Ricordisamoa, Fabrice_Florin, Raymond, Steinsplitter, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T177022: Add an API module for querying MediaInfo entities by file page title
gerritbot added a comment. Change 384996 had a related patch set uploaded (by MarkTraceur; owner: MarkTraceur): [mediawiki/extensions/WikibaseMediaInfo@master] [WIP] Add lookup services for title <--> ID https://gerrit.wikimedia.org/r/384996TASK DETAILhttps://phabricator.wikimedia.org/T177022EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: MarkTraceur, gerritbotCc: Aleksey_WMDE, thiemowmde, Lydia_Pintscher, Addshore, gerritbot, Cparle, MBinder_WMF, Ramsey-WMF, Aklapper, MarkTraceur, E1presidente, Jmmuguerza, SandraF_WMF, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Acer, V4switch, Lewizho99, Maathavan, Susannaanas, Wong128hk, Wikidata-bugs, PKM, Base, matthiasmullie, aude, Bawolff, Ricordisamoa, Fabrice_Florin, Raymond, Steinsplitter, Matanya, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Triaged] T178491: Make WDQS throttling more aggressive
debt triaged this task as "High" priority. TASK DETAILhttps://phabricator.wikimedia.org/T178491EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Gehel, debtCc: gerritbot, Smalyshev, Gehel, Aklapper, Gq86, Lordiis, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Adik2382, Th3d3v1ls, Hfbn0, Ramalepe, Liugev6, QZanden, EBjune, merbst, Avner, Lewizho99, Zppix, Maathavan, debt, Jonas, FloNight, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, ArielGlenn, faidon, He7d3r, Mbch331, Jay8g, fgiunchedi, greg, mmodell___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T178491: Make WDQS throttling more aggressive
debt added a parent task: Restricted Task. TASK DETAILhttps://phabricator.wikimedia.org/T178491EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Gehel, debtCc: gerritbot, Smalyshev, Gehel, Aklapper, Gq86, Lordiis, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Adik2382, Th3d3v1ls, Hfbn0, Ramalepe, Liugev6, QZanden, EBjune, merbst, Avner, Lewizho99, Zppix, Maathavan, debt, Jonas, FloNight, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, ArielGlenn, faidon, He7d3r, Mbch331, Jay8g, fgiunchedi, greg, mmodell___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Edited] T151717: Usage tracking: record which statement group is used
hoo updated the task description. (Show Details) CHANGES TO TASK DESCRIPTION...[x] https://gerrit.wikimedia.org/r/384592TASK DETAILhttps://phabricator.wikimedia.org/T151717EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hooCc: Marostegui, Bawolff, eranroz, Ottomata, PokestarFan, Ladsgroup, Stashbot, gerritbot, Halfak, jcrespo, TomT0m, Hall1467, hoo, zhuyifei1999, Eloquence, Lydia_Pintscher, Sannita, Ainali, Liuxinyu970226, MZMcBride, Ricordisamoa, Micru, jayvdb, Daniel_Mietchen, Tobi_WMDE_SW, Legoktm, Abraham, Wikidata-bugs, liangent, jeremyb, aude, Bianjiang, Aklapper, DixonD, daniel, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Minhnv-2809, Maathavan, Luke081515, Mbch331, Jay8g, Krenair___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Claimed] T177353: Metrics for SDoC: look at search hits based on which element the search is hitting
chelsyx claimed this task.chelsyx edited projects, added Discovery-Analysis (Current work); removed Discovery-Analysis. TASK DETAILhttps://phabricator.wikimedia.org/T177353EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: chelsyxCc: Aklapper, mpopov, chelsyx, Abit, SandraF_WMF, Ramsey-WMF, Capt_Swing, debt, E1presidente, Jmmuguerza, GoranSMilovanovic, QZanden, EBjune, Acer, Avner, Gehel, FloNight, Susannaanas, Wikidata-bugs, PKM, Base, matthiasmullie, aude, Ricordisamoa, Fabrice_Florin, Raymond, Steinsplitter, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Block] T106287: [Task] Track descriptions usages separately (Create a new description usage aspect "D")
hoo created subtask T178515: Enable description usage tracking on further wikis. TASK DETAILhttps://phabricator.wikimedia.org/T106287EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hooCc: thiemowmde, gerritbot, eranroz, PokestarFan, jmadler, hoo, daniel, zhuyifei1999, Eloquence, Lydia_Pintscher, Sannita, Ainali, Liuxinyu970226, MZMcBride, Ricordisamoa, Micru, jayvdb, Daniel_Mietchen, Tobi_WMDE_SW, Legoktm, Abraham, greg, Wikidata-bugs, liangent, jeremyb, aude, Bianjiang, Aklapper, GoranSMilovanovic, QZanden, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Created] T178515: Enable description usage tracking on further wikis
hoo created this task.hoo added projects: Wikidata, MediaWiki-extensions-WikibaseClient.Herald added a subscriber: Aklapper. TASK DESCRIPTIONI suggest to also enable description usage tracking on further wikis. Currently we don't have a single description usage, even though the usage type is active on several wikis. After some mwgreping for wikis which potentially use descriptions, I identified the following wikis: `` `` `` `` TASK DETAILhttps://phabricator.wikimedia.org/T178515EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hooCc: Aklapper, hoo, GoranSMilovanovic, QZanden, Wikidata-bugs, aude, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Edited] T178515: Enable description usage tracking on further wikis
hoo updated the task description. (Show Details)Herald added subscribers: jeblad, Cosine02. CHANGES TO TASK DESCRIPTION...* `dewiki` * `hewiki` * `lvwiki` * `mediawikiwiki` * `metawiki` * `nnwiki` * `nowiki` * `ruwikinews` * ``* `zhwiki` Also I suggest `ruwiki`: It has so many usages that there just have to be some description usages (you would think…).TASK DETAILhttps://phabricator.wikimedia.org/T178515EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hooCc: Cosine02, jeblad, Aklapper, hoo, GoranSMilovanovic, QZanden, Wikidata-bugs, aude, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Edited] T106287: [Task] Track descriptions usages separately (Create a new description usage aspect "D")
hoo updated the task description. (Show Details) CHANGES TO TASK DESCRIPTION...[x] Evaluate statistics from T177155data from T177155 [] Remove `'D'` from `$wgWBClientSettings['disabledUsageAspects']` on a few more wikis (T178515) [] Remove `'D'` from `$wgWBClientSettings['disabledUsageAspects']` on commons (Which shouldthis might be the wiki where this has the biggest effect)...TASK DETAILhttps://phabricator.wikimedia.org/T106287EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hooCc: thiemowmde, gerritbot, eranroz, PokestarFan, jmadler, hoo, daniel, zhuyifei1999, Eloquence, Lydia_Pintscher, Sannita, Ainali, Liuxinyu970226, MZMcBride, Ricordisamoa, Micru, jayvdb, Daniel_Mietchen, Tobi_WMDE_SW, Legoktm, Abraham, greg, Wikidata-bugs, liangent, jeremyb, aude, Bianjiang, Aklapper, GoranSMilovanovic, QZanden, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T178515: Enable description usage tracking on further wikis
hoo added subscribers: Marostegui, jcrespo.hoo added a project: DBA. TASK DETAILhttps://phabricator.wikimedia.org/T178515EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hooCc: jcrespo, Marostegui, Cosine02, jeblad, Aklapper, hoo, GoranSMilovanovic, QZanden, Minhnv-2809, Luke081515, Wikidata-bugs, aude, Mbch331, Jay8g, Krenair___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T151717: Usage tracking: record which statement group is used
hoo removed a project: Patch-For-Review.hoo added a comment. We're already at 6,213,948 statement usages on cawiki (this is a lot). The number of usages is still growing strong there, but it seems to be within sane bounds.TASK DETAILhttps://phabricator.wikimedia.org/T151717EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hooCc: Marostegui, Bawolff, eranroz, Ottomata, PokestarFan, Ladsgroup, Stashbot, gerritbot, Halfak, jcrespo, TomT0m, Hall1467, hoo, zhuyifei1999, Eloquence, Lydia_Pintscher, Sannita, Ainali, Liuxinyu970226, MZMcBride, Ricordisamoa, Micru, jayvdb, Daniel_Mietchen, Tobi_WMDE_SW, Legoktm, Abraham, Wikidata-bugs, liangent, jeremyb, aude, Bianjiang, Aklapper, DixonD, daniel, GoranSMilovanovic, QZanden, Minhnv-2809, Luke081515, Mbch331, Jay8g, Krenair___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Changed Subscribers] T178492: Create a more controlled WDQS cluster
Smalyshev added a subscriber: mobrovac.Smalyshev added a comment. I am not familiar with the details of dependent services (would be nice to document it somewhere? or point me to the place where it is already documented :) but in general unless you need an instant response, 429 should not be a cause for immediate failure. For offline functionality, 429 should cause retry within prescribed time. For online, it'd depend on the case, but if it's a secondary UI element, the script can just try and load it later, maybe?TASK DETAILhttps://phabricator.wikimedia.org/T178492EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: mobrovac, Jonas, Aklapper, debt, Smalyshev, Gehel, Gq86, E1presidente, Ramsey-WMF, Jmmuguerza, SandraF_WMF, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, Acer, merbst, Avner, FloNight, Xmlizer, Susannaanas, jkroll, Wikidata-bugs, Jdouglas, PKM, Base, matthiasmullie, aude, Tobias1984, Manybubbles, Ricordisamoa, Fabrice_Florin, Raymond, Steinsplitter, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T178530: Improve field mapping for nginx logstash
Smalyshev added a project: Wikidata-Query-Service.Smalyshev added subscribers: EBernhardson, Gehel, dcausse.Herald added projects: Wikidata, Discovery. TASK DETAILhttps://phabricator.wikimedia.org/T178530EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: dcausse, Gehel, EBernhardson, Aklapper, Smalyshev, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, Avner, debt, Jonas, FloNight, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T178530: Improve field mapping for nginx logstash
Smalyshev added a comment. My checks show that request_time and upstream_time only used by nginx, but response_size is also used by webrequest. While it is used in the same meaning, I wonder if changing the type won't disrupt anything. response_size is less important for me than the rest, so if it proves a problem, we could omit it.TASK DETAILhttps://phabricator.wikimedia.org/T178530EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: dcausse, Gehel, EBernhardson, Aklapper, Smalyshev, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, Avner, debt, Jonas, FloNight, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Closed] T178315: munge.sh error on latest-all.ttl.gz: "java.lang.RuntimeException: Error switching chunks"
Smalyshev closed this task as "Resolved".Smalyshev claimed this task. TASK DETAILhttps://phabricator.wikimedia.org/T178315EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Gehel, gerritbot, Smalyshev, Framawiki, Donglixp, Aklapper, Gq86, Lordiis, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, EBjune, merbst, Avner, Lewizho99, Maathavan, debt, Jonas, FloNight, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T177734: License mismatch in wikidata-query-gui
Smalyshev added a comment. Hmm I think GUI should be Apache, as it does not rely directly on any GPL code AFAIK. And main docs in WDQS repo says so. I'm not sure why the code has GPL tags, maybe some confusion. My preference is to take it to Apache, but if it's for some reason is impossible, GPL I guess would work too.TASK DETAILhttps://phabricator.wikimedia.org/T177734EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Smalyshev, Lucas_Werkmeister_WMDE, Aklapper, Yurik, GoranSMilovanovic, QZanden, EBjune, merbst, Avner, debt, Gehel, Jonas, FloNight, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T178530: Improve field mapping for nginx logstash
EBernhardson added a comment. There might be other opinions, but i think hard coding specific fields to specific types in the logstash config is reasonable as long as it's documented. The primary problem we run into is that without coordination different types can be sent to fields by different applications. While documenting and expecting applications to conform to types for all parameters is not going to happen, doing it for some limited set of useful fields seems acceptable to me.TASK DETAILhttps://phabricator.wikimedia.org/T178530EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: EBernhardsonCc: dcausse, Gehel, EBernhardson, Aklapper, Smalyshev, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, Avner, debt, Jonas, FloNight, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Claimed] T178211: Using Munge script in standalone WDQS: Fatal error munging RDF: RDFParseException: Illegal language tag char: ':'
Smalyshev claimed this task.Smalyshev added a project: User-Smalyshev. TASK DETAILhttps://phabricator.wikimedia.org/T178211EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Aklapper, Caliuser, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, Avner, debt, Gehel, Jonas, FloNight, Xmlizer, jkroll, Smalyshev, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T178530: Improve field mapping for nginx logstash
EBernhardson added a project: Wikimedia-Logstash. TASK DETAILhttps://phabricator.wikimedia.org/T178530EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: EBernhardsonCc: dcausse, Gehel, EBernhardson, Aklapper, Smalyshev, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, Avner, debt, Jonas, FloNight, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331, fgiunchedi, jeremyb___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T175948: Add normalized predicates to Blazegraph vocabulary
Smalyshev added a comment. In this case, if I understand correctly, we need something like: Yes, that sounds correct.TASK DETAILhttps://phabricator.wikimedia.org/T175948EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: gerritbot, Gehel, Aklapper, Smalyshev, Gq86, Lordiis, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, EBjune, merbst, Avner, Lewizho99, Maathavan, debt, Jonas, FloNight, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T178530: Improve field mapping for nginx logstash
Smalyshev added a project: User-Smalyshev. TASK DETAILhttps://phabricator.wikimedia.org/T178530EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: dcausse, Gehel, EBernhardson, Aklapper, Smalyshev, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, Avner, debt, Jonas, FloNight, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331, fgiunchedi, jeremyb___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T176515: More flexible user experience for monitoring Wikidata changes from client, using new filters
jmatazzoni edited projects, added Collaboration-Team-Triage; removed Collaboration-Team-Triage (Collab-Team-Q2-Oct-Dec-2017). TASK DETAILhttps://phabricator.wikimedia.org/T176515EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: jmatazzoniCc: Petar.petkovic, Liuxinyu970226, Tbayer, Zache, Noella94, hoo, Trizek-WMF, Lea_Lacroix_WMDE, Elitre, RP88, Catrope, SBisson, Mattflaschen-WMF, Aklapper, eranroz, GoranSMilovanovic, QZanden, Iniquity, jmatazzoni, Wikidata-bugs, aude, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Created] T178533: Find out why nginx log in logstash has no 429s
Smalyshev created this task.Smalyshev added a project: Wikidata-Query-Service.Herald added a subscriber: Aklapper.Herald added projects: Wikidata, Discovery. TASK DESCRIPTIONLooking at nginx log in logstash, I notice that it does not have any entries with status 429, while other error statuses (500, 400, etc.) are present. This looks anomalous - 429 should be appearing in the logs too. We need to figure out why it happens and fix it if possible.TASK DETAILhttps://phabricator.wikimedia.org/T178533EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Gehel, Aklapper, Smalyshev, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, merbst, Avner, debt, Jonas, FloNight, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T138371: WordPress plugin to associate tags with Wikidata IDs
abian added a comment. In T138371#3689998, @Zeko wrote: Quick but non trivial question here: I am considering using external libraries for some things, as I intend to release the plugin under a GPL, can somebody tell me what kind of problems can we have if I use libraries as bootstrap?? "MIT licensed software can be integrated into GPL software, but not the other way around". If you want to publish the plugin under a GPL, I think there will be no problem. The MIT and the GPL are free software licenses and, therefore, compatible with the Wikimedia movement.TASK DETAILhttps://phabricator.wikimedia.org/T138371EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Zeko, abianCc: Philipjohn21, Liuxinyu970226, Samwilson, Mbch331, Framawiki, DanBri, Esh77, Lydia_Pintscher, abian, Tramullas, Zeko, Aklapper, Pigsonthewing, Zppix, GoranSMilovanovic, QZanden, Psychoslave, Wikidata-bugs, aude___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T170281: Raise PHP version requirement of Wikibase (and its related extensions) to 5.6
Jdforrester-WMF added a subtask: T178538: Bump PHP requirement to 5.6 in 1.31. TASK DETAILhttps://phabricator.wikimedia.org/T170281EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Jdforrester-WMFCc: Ricordisamoa, PokestarFan, thiemowmde, Reedy, Lucas_Werkmeister_WMDE, aude, hoo, ArielGlenn, daniel, Lydia_Pintscher, Jonas, Aleksey_WMDE, WMDE-leszek, Aklapper, GoranSMilovanovic, QZanden, Wikidata-bugs, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T178515: Enable description usage tracking on further wikis
Shizhao added a project: Chinese-Sites. TASK DETAILhttps://phabricator.wikimedia.org/T178515EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hoo, ShizhaoCc: jcrespo, Marostegui, Cosine02, jeblad, Aklapper, hoo, GoranSMilovanovic, QZanden, Minhnv-2809, Luke081515, Fuzheado, Cwek, Wikidata-bugs, aude, zhuyifei1999, Shizhao, Mbch331, Liuxinyu970226, Jay8g, Krenair___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T177772: Purge 90% of rows from recentchanges (and posibly defragment) from commonswiki and ruwiki (the ones with source:wikidata)
Stashbot added a comment. Mentioned in SAL (#wikimedia-operations) [2017-10-19T05:45:12Z] Optimize recentchanges, pagelinks and templatelinks on db1064 - T174509 T12TASK DETAILhttps://phabricator.wikimedia.org/T12EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: jcrespo, StashbotCc: gerritbot, Stashbot, Jdforrester-WMF, Bawolff, Lydia_Pintscher, hoo, Ladsgroup, Base, Aklapper, TerraCodes, Jay8g, Marostegui, jcrespo, Lordiis, GoranSMilovanovic, Adik2382, Abiyoyo, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Jack_who_built_the_house, Lewizho99, Minhnv-2809, Maathavan, Iniquity, Luke081515, Wikidata-bugs, aude, putnik, Mbch331, Krenair___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T177772: Purge 90% of rows from recentchanges (and posibly defragment) from commonswiki and ruwiki (the ones with source:wikidata)
Stashbot added a comment. Mentioned in SAL (#wikimedia-operations) [2017-10-19T05:46:43Z] Optimize recentchanges, pagelinks and templatelinks on db1102 for s6 - T174509 T12TASK DETAILhttps://phabricator.wikimedia.org/T12EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: jcrespo, StashbotCc: gerritbot, Stashbot, Jdforrester-WMF, Bawolff, Lydia_Pintscher, hoo, Ladsgroup, Base, Aklapper, TerraCodes, Jay8g, Marostegui, jcrespo, Lordiis, GoranSMilovanovic, Adik2382, Abiyoyo, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Jack_who_built_the_house, Lewizho99, Minhnv-2809, Maathavan, Iniquity, Luke081515, Wikidata-bugs, aude, putnik, Mbch331, Krenair___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Updated] T178515: Enable description usage tracking on further wikis
Marostegui added a comment. That is fine by me - let's leave ruwiki aside for now while we finish purging up its recentchanges table (T12) on all the pending hosts. Please keep giving us a heads up on the irc channel before you enable it on those new wikis. Thanks!TASK DETAILhttps://phabricator.wikimedia.org/T178515EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hoo, MarosteguiCc: Liuxinyu970226, jcrespo, Marostegui, Cosine02, jeblad, Aklapper, hoo, GoranSMilovanovic, QZanden, Minhnv-2809, Luke081515, Fuzheado, Cwek, Wikidata-bugs, aude, zhuyifei1999, Shizhao, Mbch331, Jay8g, Krenair___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs