[Wikidata-bugs] [Maniphest] [Commented On] T177414: Maintenance scripts exit with 0 when an (uncaught) exception is encountered

2017-10-04 Thread gerritbot
gerritbot added a comment.
Change 382181 merged by jenkins-bot:
[mediawiki/core@master] CLI: Make sure we don't exit with 0 when an exception is encountered

https://gerrit.wikimedia.org/r/382181TASK DETAILhttps://phabricator.wikimedia.org/T177414EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: gerritbotCc: gerritbot, Aklapper, ArielGlenn, hoo, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Izno, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T171564: interface Hebrew in left to right from written is query

2017-10-04 Thread eranroz
eranroz added a comment.
BTW it is so broken that it would be better to de-feature it for now.TASK DETAILhttps://phabricator.wikimedia.org/T171564EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: eranrozCc: Lucas_Werkmeister_WMDE, Smalyshev, Jonas, Aklapper, eranroz, PokestarFan, GoranSMilovanovic, Soteriaspace, Jayprakash12345, JakeTheDeveloper, Rafisamra2016, QZanden, EBjune, Tal-WMIL, Zoranzoki21, merbst, Avner, debt, Gehel, Tzafrir, Srdjan_m, FloNight, Xmlizer, MuhammadShuaib, Izno, LNDDYL, Psychoslave, IKhitron, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Huji, Manybubbles, Amire80, Gryllida, Shizhao, Arrbee, TheDJ, Matanya, Mbch331, Jay8g___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T99531: [Task] move wikiba.se webhosting to wikimedia misc-cluster

2017-10-04 Thread Dzahn
Dzahn added a comment.
We have the repo, and i see your change Amir, thank you! Before i merge the content itself i started with puppet code to install Apache site and git pull the static files. I was thinking we test that role class first on a cloud VPS with something like wikibase.wmflabs.org or whatever until we are happy to move it to prod. I also started it as a profile following the new puppet style guide lines, so that jenkins-bot likes it now also with the new style check. I made the server name and admin email variable and in templates/Hiera, so it will be easy to change for labs (just a wiki page edit in Hiera: namespace, not even a commit) and also to move it to prod and the actual domain name.TASK DETAILhttps://phabricator.wikimedia.org/T99531EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: DzahnCc: gerritbot, Dzahn, Lydia_Pintscher, mark, greg, PokestarFan, faidon, Ladsgroup, Ivanhercaz, Addshore, Jonas, JeroenDeDauw, thiemowmde, hoo, JanZerebecki, Aklapper, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Hfbn0, Ramalepe, Liugev6, QZanden, Lewizho99, Zppix, Maathavan, Izno, Wikidata-bugs, aude, Mbch331, Jay8g, fgiunchedi___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T99531: [Task] move wikiba.se webhosting to wikimedia misc-cluster

2017-10-04 Thread gerritbot
gerritbot added a comment.
Change 382355 had a related patch set uploaded (by Dzahn; owner: Dzahn):
[operations/puppet@production] start profile for wikiba.se web hosting

https://gerrit.wikimedia.org/r/382355TASK DETAILhttps://phabricator.wikimedia.org/T99531EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Dzahn, gerritbotCc: gerritbot, Dzahn, Lydia_Pintscher, mark, greg, PokestarFan, faidon, Ladsgroup, Ivanhercaz, Addshore, Jonas, JeroenDeDauw, thiemowmde, hoo, JanZerebecki, Aklapper, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Hfbn0, Ramalepe, Liugev6, QZanden, Lewizho99, Zppix, Maathavan, Izno, Wikidata-bugs, aude, Mbch331, Jay8g, fgiunchedi___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T142903: Get sitelink from Item without loading the full Item (via Lua).

2017-10-04 Thread hoo
hoo added a project: Wikidata-Sprint.
TASK DETAILhttps://phabricator.wikimedia.org/T142903EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hooCc: gerritbot, zhuyifei1999, PokestarFan, hoo, Jarekt, Zolo, Aklapper, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Izno, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T142903: Get sitelink from Item without loading the full Item (via Lua).

2017-10-04 Thread gerritbot
gerritbot added a comment.
Change 382334 had a related patch set uploaded (by Hoo man; owner: Hoo man):
[mediawiki/extensions/Wikibase@master] Allow getting the sitelink to an arbitrary site with mw.wikibase.sitelink

https://gerrit.wikimedia.org/r/382334TASK DETAILhttps://phabricator.wikimedia.org/T142903EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: gerritbotCc: gerritbot, zhuyifei1999, PokestarFan, hoo, Jarekt, Zolo, Aklapper, GoranSMilovanovic, QZanden, Izno, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T142903: Get sitelink from Item without loading the full Item (via Lua).

2017-10-04 Thread gerritbot
gerritbot added a project: Patch-For-Review.
TASK DETAILhttps://phabricator.wikimedia.org/T142903EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: gerritbotCc: gerritbot, zhuyifei1999, PokestarFan, hoo, Jarekt, Zolo, Aklapper, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Izno, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T90436: Improve usage tracking granularity to avoid irrelevant changes showing in the watchlist.

2017-10-04 Thread hoo
hoo added a subtask: T113468: [Task] Use compact representation of diffs in EntityChange..
TASK DETAILhttps://phabricator.wikimedia.org/T90436EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hooCc: Zache, Elitre, Mattflaschen-WMF, jmatazzoni, Raymond, FriedhelmW, AndrewSu, Capankajsmilyo, Fuzheado, Bawolff, Tbayer, jeremyb, Agabi10, RP88, Halfak, Doc_James, hoo, PokestarFan, IKhitron, eranroz, Izno, Oliv0, Ltrlg, Scott_WUaS, Danmichaelo, CennoxX, Liuxinyu970226, aude, Lydia_Pintscher, daniel, Aklapper, GoranSMilovanovic, Rafisamra2016, QZanden, Tal-WMIL, Avner, Tzafrir, Wikidata-bugs, Amire80, Matanya, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T113468: [Task] Use compact representation of diffs in EntityChange.

2017-10-04 Thread hoo
hoo added a parent task: T90436: Improve usage tracking granularity to avoid irrelevant changes showing in the watchlist..
TASK DETAILhttps://phabricator.wikimedia.org/T113468EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hooCc: PokestarFan, hoo, gerritbot, aude, Aklapper, daniel, GoranSMilovanovic, QZanden, Izno, Wikidata-bugs, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Created] T177453: Add wikibase client support for searching wikidata items

2017-10-04 Thread Smalyshev
Smalyshev created this task.Smalyshev added projects: ArticlePlaceholder, Wikidata, CirrusSearch, Discovery-Search.Herald added a subscriber: Aklapper.Herald added a project: Discovery.
TASK DESCRIPTIONRight now, Wikibase Client provides access to searching Wikidata items, e.g. via newTermSearchInteractor(). It is used in ArticlePlaceholder. It may make sense to make ElasticSearch  searching available via this API too, possibly by implementing TermSearchInteractor that uses ElasticSearch.TASK DETAILhttps://phabricator.wikimedia.org/T177453EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Aklapper, Smalyshev, GoranSMilovanovic, QZanden, EBjune, cmadeo, Avner, debt, Gehel, FloNight, Izno, Wikidata-bugs, aude, jayvdb, Ricordisamoa, Mbch331, jeremyb___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Unblock] T49288: [Epic] Track Wikidata entity usage on client pages

2017-10-04 Thread hoo
hoo closed subtask T73498: [Task] benchmark database performance of usage tracking as "Invalid".
TASK DETAILhttps://phabricator.wikimedia.org/T49288EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hooCc: PokestarFan, DixonD, Aklapper, Bianjiang, aude, jeremyb, liangent, Wikidata-bugs, greg, Abraham, Legoktm, Tobi_WMDE_SW, Daniel_Mietchen, jayvdb, Micru, Ricordisamoa, MZMcBride, Liuxinyu970226, Ainali, Sannita, Lydia_Pintscher, Eloquence, zhuyifei1999, daniel, hoo, GoranSMilovanovic, QZanden, Izno, Mbch331, Jay8g___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Closed] T73498: [Task] benchmark database performance of usage tracking

2017-10-04 Thread hoo
hoo closed this task as "Invalid".hoo added a comment.Herald removed a subscriber: Liuxinyu970226.
I don't think this task is useful, we're already in a constant loop with the DBAs (eg. T176273), so I don't think there's any value in keeping this open.TASK DETAILhttps://phabricator.wikimedia.org/T73498EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hooCc: hoo, Aklapper, Wikidata-bugs, Springle, aaron, Lydia_Pintscher, daniel, GoranSMilovanovic, QZanden, Izno, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T176515: More flexible user experience for monitoring Wikidata changes from client, using new filters

2017-10-04 Thread Tbayer
Tbayer added a comment.
Related: T141866: Provide a way to filter Wikidata's recent changes for language-dependent content in specific languagesTASK DETAILhttps://phabricator.wikimedia.org/T176515EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: TbayerCc: Tbayer, Zache, Noella94, hoo, Trizek-WMF, Lea_Lacroix_WMDE, Elitre, RP88, Catrope, SBisson, Mattflaschen-WMF, Aklapper, eranroz, GoranSMilovanovic, QZanden, Iniquity, jmatazzoni, Izno, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Edited] T173196: Client term access in user language should track all labels/ descriptions as being used on multilingual wikis

2017-10-04 Thread hoo
hoo updated the task description. (Show Details)
CHANGES TO TASK DESCRIPTION...For performance reasons and completeness, we might want to track such a thing as `L.*``L` (without modifier).TASK DETAILhttps://phabricator.wikimedia.org/T173196EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hooCc: gerritbot, Jarekt, Multichill, eranroz, Halfak, Lydia_Pintscher, Aklapper, daniel, PokestarFan, hoo, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Izno, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T177311: 2% of /w/load.php spent in WebStart/onBeforeCreateEchoEvent for Wikibase

2017-10-04 Thread hoo
hoo added a comment.
This should probably indeed be split up into different handlers, which might solve some of the problems here.

Also we could probably make WikibaseClient faster by lazy-creating the SiteLookup.

Regarding the NamespaceChecker construction: This is in parts so expensive due to the closure in mediawiki-config ($wgWBClientSettings['excludeNamespaces'] = function () { … } in wmf-config/Wikibase.php). We should try to avoid getting this setting if possible, but I don't see a nice way to make this faster.TASK DETAILhttps://phabricator.wikimedia.org/T177311EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hooCc: hoo, aude, thiemowmde, Krinkle, Aklapper, GoranSMilovanovic, QZanden, Vali.matei, Izno, Wikidata-bugs, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T177311: 2% of /w/load.php spent in WebStart/onBeforeCreateEchoEvent for Wikibase

2017-10-04 Thread Krinkle
Krinkle added a comment.
The above flame graph is from HHVM profiling samples over 24 hours from production traffic. While useful to see the overall impact on average, it does not provide timings (due to being sampled). Here two profiles from XHGui for an individual request (including flamegraph).

https://performance.wikimedia.org/xhgui/run/flamegraph?id=59d4a63a3f3dfacf5d63a6ab (total: 1.3s)


EchoNotificationsHandlers::onBeforeCreateEchoEvent (111ms, 8%)


https://performance.wikimedia.org/xhgui/run/flamegraph?id=59d4a5ef3f3dfacf5daf6f40 (total: 45s)


EchoNotificationsHandlers::onBeforeCreateEchoEvent (231ms, 1%)
TASK DETAILhttps://phabricator.wikimedia.org/T177311EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: KrinkleCc: aude, thiemowmde, Krinkle, Aklapper, GoranSMilovanovic, QZanden, Vali.matei, Izno, Wikidata-bugs, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Retitled] T173196: Client term access in user language should track all labels/ descriptions as being used on multilingual wikis

2017-10-04 Thread hoo
hoo renamed this task from "Client term access in user language should track all labels as being used on multilingual wikis" to "Client term access in user language should track all labels/ descriptions as being used on multilingual wikis".hoo added a project: Wikidata-Sprint.
TASK DETAILhttps://phabricator.wikimedia.org/T173196EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hooCc: gerritbot, Jarekt, Multichill, eranroz, Halfak, Lydia_Pintscher, Aklapper, daniel, PokestarFan, hoo, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Izno, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T173196: Client term access in user language should track all labels as being used on multilingual wikis

2017-10-04 Thread gerritbot
gerritbot added a comment.
Change 382326 had a related patch set uploaded (by Hoo man; owner: Hoo man):
[mediawiki/extensions/Wikibase@master] Track all label/description languages as used on multilingual wikis

https://gerrit.wikimedia.org/r/382326TASK DETAILhttps://phabricator.wikimedia.org/T173196EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: gerritbotCc: gerritbot, Jarekt, Multichill, eranroz, Halfak, Lydia_Pintscher, Aklapper, daniel, PokestarFan, hoo, GoranSMilovanovic, QZanden, Izno, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T173196: Client term access in user language should track all labels as being used on multilingual wikis

2017-10-04 Thread gerritbot
gerritbot added a project: Patch-For-Review.
TASK DETAILhttps://phabricator.wikimedia.org/T173196EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: gerritbotCc: gerritbot, Jarekt, Multichill, eranroz, Halfak, Lydia_Pintscher, Aklapper, daniel, PokestarFan, hoo, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Izno, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Retitled] T177357: Metrics for SDoC: future work of interest (templates and licensing)

2017-10-04 Thread debt
debt renamed this task from "Metrics for SDoC: future work of interest" to "Metrics for SDoC: future work of interest (templates and licensing)".
TASK DETAILhttps://phabricator.wikimedia.org/T177357EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: debtCc: Aklapper, mpopov, chelsyx, Abit, SandraF_WMF, Ramsey-WMF, Capt_Swing, debt, E1presidente, Jmmuguerza, GoranSMilovanovic, QZanden, EBjune, Acer, Avner, Gehel, FloNight, Susannaanas, Izno, Wikidata-bugs, PKM, Base, matthiasmullie, aude, Ricordisamoa, Fabrice_Florin, Raymond, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T132839: [RfC] Property suggester suggests human properties for non-human items

2017-10-04 Thread Stashbot
Stashbot added a comment.
Mentioned in SAL (#wikimedia-operations) [2017-10-04T21:07:26Z]  Updated the Wikidata property suggester with data from Monday's JSON dump and applied the T132839 workaroundsTASK DETAILhttps://phabricator.wikimedia.org/T132839EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hoo, StashbotCc: PokestarFan, aude, Jonas, Esc3300, AnjaJentzsch, Ladsgroup, Tobi_WMDE_SW, daniel, mkroetzsch, Stashbot, thiemowmde, JanZerebecki, Lydia_Pintscher, hoo, Sjoerddebruin, Nikki, Aklapper, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Izno, Luke081515, Wikidata-bugs, fbstj, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T176841: Create wikibase/wikiba.se-deploy repo

2017-10-04 Thread Ladsgroup
Ladsgroup added a comment.
Thank you :)TASK DETAILhttps://phabricator.wikimedia.org/T176841EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: QChris, LadsgroupCc: QChris, hashar, Aklapper, JanZerebecki, hoo, thiemowmde, JeroenDeDauw, Jonas, Addshore, Ivanhercaz, faidon, PokestarFan, greg, mark, Lydia_Pintscher, Dzahn, Ladsgroup, GoranSMilovanovic, Th3d3v1ls, Hfbn0, QZanden, Zppix, Izno, Wikidata-bugs, aude, Mbch331, Jay8g, fgiunchedi___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T99531: [Task] move wikiba.se webhosting to wikimedia misc-cluster

2017-10-04 Thread gerritbot
gerritbot added a project: Patch-For-Review.
TASK DETAILhttps://phabricator.wikimedia.org/T99531EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Dzahn, gerritbotCc: gerritbot, Dzahn, Lydia_Pintscher, mark, greg, PokestarFan, faidon, Ladsgroup, Ivanhercaz, Addshore, Jonas, JeroenDeDauw, thiemowmde, hoo, JanZerebecki, Aklapper, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Hfbn0, Ramalepe, Liugev6, QZanden, Lewizho99, Zppix, Maathavan, Izno, Wikidata-bugs, aude, Mbch331, Jay8g, fgiunchedi___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T99531: [Task] move wikiba.se webhosting to wikimedia misc-cluster

2017-10-04 Thread gerritbot
gerritbot added a comment.
Change 382277 had a related patch set uploaded (by Ladsgroup; owner: Amir Sarabadani):
[wikibase/wikiba.se-deploy@master] Start the repo

https://gerrit.wikimedia.org/r/382277TASK DETAILhttps://phabricator.wikimedia.org/T99531EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Dzahn, gerritbotCc: gerritbot, Dzahn, Lydia_Pintscher, mark, greg, PokestarFan, faidon, Ladsgroup, Ivanhercaz, Addshore, Jonas, JeroenDeDauw, thiemowmde, hoo, JanZerebecki, Aklapper, GoranSMilovanovic, Th3d3v1ls, Hfbn0, QZanden, Zppix, Izno, Wikidata-bugs, aude, Mbch331, Jay8g, fgiunchedi___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Changed Project Column] T177311: 2% of /w/load.php spent in WebStart/onBeforeCreateEchoEvent for Wikibase

2017-10-04 Thread Gilles
Gilles moved this task from Inbox to Radar on the Performance-Team board.Gilles edited projects, added Performance-Team (Radar); removed Performance-Team.
TASK DETAILhttps://phabricator.wikimedia.org/T177311WORKBOARDhttps://phabricator.wikimedia.org/project/board/1212/EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: GillesCc: aude, thiemowmde, Krinkle, Aklapper, GoranSMilovanovic, QZanden, Vali.matei, Izno, Wikidata-bugs, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T176841: Create wikibase/wikiba.se-deploy repo

2017-10-04 Thread Dzahn
Dzahn added a comment.
Heh, that worked ! Thanks @QChris :)TASK DETAILhttps://phabricator.wikimedia.org/T176841EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: QChris, DzahnCc: QChris, hashar, Aklapper, JanZerebecki, hoo, thiemowmde, JeroenDeDauw, Jonas, Addshore, Ivanhercaz, faidon, PokestarFan, greg, mark, Lydia_Pintscher, Dzahn, Ladsgroup, GoranSMilovanovic, Th3d3v1ls, Hfbn0, QZanden, Zppix, Izno, Wikidata-bugs, aude, Mbch331, Jay8g, fgiunchedi___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T175919: investigate GC times on wikidata query service

2017-10-04 Thread Smalyshev
Smalyshev added a comment.
The -XX:MaxTenuringThreshold flag may have been set too low.

I'd try to see if this one helps, because BG work pattern would be allocating tons of stuff when query is processed, and then releasing it after it's done. But the query can be processed for a whole minute, so I imagine some of this stuff would get into old gen.

This looks suspicious... and indicates that other applications are competing for resources.

The only other app there is updater, which spends most of it's time waiting for either Blazegraph or Wikidata. Weird.TASK DETAILhttps://phabricator.wikimedia.org/T175919EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Stashbot, gerritbot, Smalyshev, Gehel, Aklapper, Gq86, Lordiis, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, EBjune, merbst, Avner, Lewizho99, Maathavan, debt, Jonas, FloNight, Xmlizer, Izno, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Edited] T164371: Respect units when checking “Range” and “Diff within range” constraints

2017-10-04 Thread Lucas_Werkmeister_WMDE
Lucas_Werkmeister_WMDE updated the task description. (Show Details)
CHANGES TO TASK DESCRIPTION`RangeChecker` and `DiffWithinRange` checker need to account for units. Hopefully, it won’t be too hard to calculate and return the normalized value (which we already have for the query service) in `RangeCheckerHelper`.

#patch-for-review:
- [ ] https://gerrit.wikimedia.org/r/#/c/352162
- [ ] https://gerrit.wikimedia.org/r/#/c/382204TASK DETAILhttps://phabricator.wikimedia.org/T164371EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Lucas_Werkmeister_WMDECc: PokestarFan, gerritbot, Lucas_Werkmeister_WMDE, Aklapper, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Agabi10, Izno, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T164371: Respect units when checking “Range” and “Diff within range” constraints

2017-10-04 Thread gerritbot
gerritbot added a comment.
Change 382204 had a related patch set uploaded (by Lucas Werkmeister (WMDE); owner: Lucas Werkmeister (WMDE)):
[mediawiki/extensions/WikibaseQualityConstraints@master] Add support for “year” ranges

https://gerrit.wikimedia.org/r/382204TASK DETAILhttps://phabricator.wikimedia.org/T164371EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: gerritbotCc: PokestarFan, gerritbot, Lucas_Werkmeister_WMDE, Aklapper, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Agabi10, Izno, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T176124: Lua: Make it possible to load all statements for only one property of an entity using mw.wikibase

2017-10-04 Thread ReleaseTaggerBot
ReleaseTaggerBot edited projects, added MW-1.31-release-notes (WMF-deploy-2017-10-10 (1.31.0-wmf.3)); removed MW-1.31-release-notes (WMF-deploy-2017-10-03 (1.31.0-wmf.2)).
TASK DETAILhttps://phabricator.wikimedia.org/T176124EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hoo, ReleaseTaggerBotCc: gerritbot, Lydia_Pintscher, eranroz, Aklapper, hoo, Andrei_Stroe, GoranSMilovanovic, QZanden, Izno, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Unblock] T99531: [Task] move wikiba.se webhosting to wikimedia misc-cluster

2017-10-04 Thread QChris
QChris closed subtask T176841: Create wikibase/wikiba.se-deploy repo as "Resolved".
TASK DETAILhttps://phabricator.wikimedia.org/T99531EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Dzahn, QChrisCc: Dzahn, Lydia_Pintscher, mark, greg, PokestarFan, faidon, Ladsgroup, Ivanhercaz, Addshore, Jonas, JeroenDeDauw, thiemowmde, hoo, JanZerebecki, Aklapper, GoranSMilovanovic, Th3d3v1ls, Hfbn0, QZanden, Zppix, Izno, Wikidata-bugs, aude, Mbch331, Jay8g, fgiunchedi___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Closed] T176841: Create wikibase/wikiba.se-deploy repo

2017-10-04 Thread QChris
QChris closed this task as "Resolved".QChris claimed this task.QChris added a comment.
Done.

Gerrit repo is at https://gerrit.wikimedia.org/r/#/admin/projects/wikibase/wikiba.se-deploy
Github repo is at https://github.com/wikimedia/wikibase-wikiba.se-deploy
Differential is at rWWSDTASK DETAILhttps://phabricator.wikimedia.org/T176841EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: QChrisCc: QChris, hashar, Aklapper, JanZerebecki, hoo, thiemowmde, JeroenDeDauw, Jonas, Addshore, Ivanhercaz, faidon, PokestarFan, greg, mark, Lydia_Pintscher, Dzahn, Ladsgroup, GoranSMilovanovic, Th3d3v1ls, Hfbn0, QZanden, Zppix, Izno, Wikidata-bugs, aude, Mbch331, Jay8g, fgiunchedi___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Changed Subscribers] T176841: Create wikibase/wikiba.se-deploy repo

2017-10-04 Thread Dzahn
Dzahn added a subscriber: QChris.Dzahn added a comment.
Looks good, thanks. When i needed one in the past i always got a response from that wiki page and usually @QChris did them.TASK DETAILhttps://phabricator.wikimedia.org/T176841EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: DzahnCc: QChris, hashar, Aklapper, JanZerebecki, hoo, thiemowmde, JeroenDeDauw, Jonas, Addshore, Ivanhercaz, faidon, PokestarFan, greg, mark, Lydia_Pintscher, Dzahn, Ladsgroup, GoranSMilovanovic, Th3d3v1ls, Hfbn0, QZanden, Zppix, Izno, Wikidata-bugs, aude, Mbch331, Jay8g, fgiunchedi___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Closed] T176124: Lua: Make it possible to load all statements for only one property of an entity using mw.wikibase

2017-10-04 Thread hoo
hoo closed this task as "Resolved".hoo moved this task from Review to Done on the Wikidata-Sprint board.hoo removed a project: Patch-For-Review.
TASK DETAILhttps://phabricator.wikimedia.org/T176124WORKBOARDhttps://phabricator.wikimedia.org/project/board/2351/EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hooCc: gerritbot, Lydia_Pintscher, eranroz, Aklapper, hoo, Andrei_Stroe, GoranSMilovanovic, QZanden, Izno, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Unblock] T90436: Improve usage tracking granularity to avoid irrelevant changes showing in the watchlist.

2017-10-04 Thread hoo
hoo closed subtask T176124: Lua: Make it possible to load all statements for only one property of an entity using mw.wikibase as "Resolved".
TASK DETAILhttps://phabricator.wikimedia.org/T90436EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hooCc: Zache, Elitre, Mattflaschen-WMF, jmatazzoni, Raymond, FriedhelmW, AndrewSu, Capankajsmilyo, Fuzheado, Bawolff, Tbayer, jeremyb, Agabi10, RP88, Halfak, Doc_James, hoo, PokestarFan, IKhitron, eranroz, Izno, Oliv0, Ltrlg, Scott_WUaS, Danmichaelo, CennoxX, Liuxinyu970226, aude, Lydia_Pintscher, daniel, Aklapper, GoranSMilovanovic, Rafisamra2016, QZanden, Tal-WMIL, Avner, Tzafrir, Wikidata-bugs, Amire80, Matanya, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T176124: Lua: Make it possible to load all statements for only one property of an entity using mw.wikibase

2017-10-04 Thread gerritbot
gerritbot added a comment.
Change 376838 merged by jenkins-bot:
[mediawiki/extensions/Wikibase@master] Update documentation of getBestStatements/getAllStatements in Lua

https://gerrit.wikimedia.org/r/376838TASK DETAILhttps://phabricator.wikimedia.org/T176124EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hoo, gerritbotCc: gerritbot, Lydia_Pintscher, eranroz, Aklapper, hoo, Andrei_Stroe, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Izno, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T175919: investigate GC times on wikidata query service

2017-10-04 Thread gerritbot
gerritbot added a comment.
Change 382195 had a related patch set uploaded (by Gehel; owner: Gehel):
[operations/puppet@production] wdqs: GC tuning

https://gerrit.wikimedia.org/r/382195TASK DETAILhttps://phabricator.wikimedia.org/T175919EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: gerritbotCc: Stashbot, gerritbot, Smalyshev, Gehel, Aklapper, Gq86, Lordiis, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, EBjune, merbst, Avner, Lewizho99, Maathavan, debt, Jonas, FloNight, Xmlizer, Izno, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T175919: investigate GC times on wikidata query service

2017-10-04 Thread Gehel
Gehel added a comment.
Transparent huge pages seem to be disabled:

gehel@wdqs1004:~$ cat /sys/kernel/mm/transparent_hugepage/enabled 
always [madvise] never

Patch coming up to test other options.TASK DETAILhttps://phabricator.wikimedia.org/T175919EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: GehelCc: Stashbot, gerritbot, Smalyshev, Gehel, Aklapper, Gq86, Lordiis, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, EBjune, merbst, Avner, Lewizho99, Maathavan, debt, Jonas, FloNight, Xmlizer, Izno, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T175919: investigate GC times on wikidata query service

2017-10-04 Thread Gehel
Gehel added a comment.
A thread on Friends of JClarity suggests:


adding  -XX:+ParallelRefProcEnabled (since we seem to have really high Reference processing times
turn off PrintTenuringThreshold, since it is rarely useful with G1.
check transparent huge pages are disabled
activate PrintAdaptiveSizePolicy and PrintReferenceGC to get more information
not reducing the size of the heap (this one is counter intuitive to me...)
TASK DETAILhttps://phabricator.wikimedia.org/T175919EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: GehelCc: Stashbot, gerritbot, Smalyshev, Gehel, Aklapper, Gq86, Lordiis, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, EBjune, merbst, Avner, Lewizho99, Maathavan, debt, Jonas, FloNight, Xmlizer, Izno, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Closed] T171446: Frontend Architecture Session

2017-10-04 Thread Lydia_Pintscher
Lydia_Pintscher closed this task as "Resolved".Lydia_Pintscher claimed this task.
TASK DETAILhttps://phabricator.wikimedia.org/T171446EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Lydia_PintscherCc: Ladsgroup, Aklapper, christophneuroth, Wikidata-bugs___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Closed] T171459: Fix audio issues in conversations with Amir

2017-10-04 Thread Lydia_Pintscher
Lydia_Pintscher closed this task as "Resolved".
TASK DETAILhttps://phabricator.wikimedia.org/T171459EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Ladsgroup, Lydia_PintscherCc: christophneuroth, Aklapper, Wikidata-bugs___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T177414: Maintenance scripts exit with 0 when an (uncaught) exception is encountered

2017-10-04 Thread gerritbot
gerritbot added a project: Patch-For-Review.
TASK DETAILhttps://phabricator.wikimedia.org/T177414EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: gerritbotCc: gerritbot, Aklapper, ArielGlenn, hoo, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Izno, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T177414: Maintenance scripts exit with 0 when an (uncaught) exception is encountered

2017-10-04 Thread gerritbot
gerritbot added a comment.
Change 382181 had a related patch set uploaded (by Hoo man; owner: Hoo man):
[mediawiki/core@master] CLI: Make sure we don't exit with 0 when an exception is encountered

https://gerrit.wikimedia.org/r/382181TASK DETAILhttps://phabricator.wikimedia.org/T177414EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: gerritbotCc: gerritbot, Aklapper, ArielGlenn, hoo, GoranSMilovanovic, QZanden, Izno, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Created] T177414: Maintenance scripts exit with 0 when an (uncaught) exception is encountered

2017-10-04 Thread hoo
hoo created this task.hoo added projects: Wikidata, MediaWiki-Maintenance-scripts.Herald added a subscriber: Aklapper.
TASK DESCRIPTIONMaintenance scripts exit with 0 when they fail due to an exception, as I just discovered on the snapshot hosts (Wikidata dumps failed there, but exited with 0).

Can be easily reproduced: Take any maintenance script and put throw new \Exception(); at the top of its execute function (I tested it with maintenance/refreshLinks.php but any script should work). It will exit with 0 (success).

This happens as MW sets its own exception handler (set_exception_handler):

$ cat test.php 


throw new Exception();

echo 1;
$ php test.php 
PHP Fatal error:  Uncaught Exception in /home/hoch_m/tmp/test.php:5
Stack trace:
#0 {main}
  thrown in /home/hoch_m/tmp/test.php on line 5
$ echo $?
255

but once we add an exception handler:

$ cat test.php 


set_exception_handler(function($e) {echo "ACK\n";});

throw new Exception();

echo 1;
$ php test.php 
ACK
$ echo $?
0TASK DETAILhttps://phabricator.wikimedia.org/T177414EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hooCc: Aklapper, ArielGlenn, hoo, GoranSMilovanovic, QZanden, Izno, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T175919: investigate GC times on wikidata query service

2017-10-04 Thread Gehel
Gehel added a comment.
Using a demo version of Jclarity Censum, I see the following:

Problems

Premature promotion:

There are a number of possible causes for this problem:


Survivor spaces are too small.
Young gen is too small.
The -XX:MaxTenuringThreshold flag may have been set too low.




There a number of possible solutions for this problem:


Alter the size of the young space via the -XX:NewRatio property.
Alter the size of Survivor Spaces (relative to Eden) via the -XX:SurvivorRatio= property using the information provided by the Tenuring graphs. This flag works to divide Young into N + 2 chunks. N chunks will be assigned to Eden and 1 chunk each will be assigned to the To and From spaces respectively.
Alter the -XX:MaxTenuringThreshold property.




Application Throughput:

The recommendation is a bit generic:

How you tune will depend upon your performance requirements and the environment into which the application is deployed in. In general terms, smaller live set sizes combined with smaller memory pools will reduce GC pause times. However, small memory pools will increase the frequency of garbage collections. Additionally, smaller memory pool sizes will result in more frequent collections and place you at risk of running out of memory. High rates of allocation will also result in more frequent collections and place you at risk of running out of memory. Consequently, the general recommendation is to first work to minimize allocation rates and the volume of data that needs to be retained in Java heap. The second step is to tune the garbage collector to reduce GC overhead and minimize pause times.

Minimizing allocation rate looks like a good idea, but not something easy to do :)

High kernel times:

This looks suspicious... and indicates that other applications are competing for resources. Surprisingly it seems that IO contention can be an issue during GC, but it could be something else.

Informative

Heap Too Small Indicators

4 To space exhausted event were seen. 1 is just after application startup and is probably not significant. The other 3 are at roughly the same time, preceding a full GC. It looks like there is a change of pattern at that time, which probably indicate that we have to problems:


high GC overhead all the time
sudden rise in allocation at specific times, probably related to more expensive queries (I might be entirely wrong with this one)


F1336: G1 Failure Events.png

There is an allocation rate graph in the report, but I have no idea how to read it...
F1332: allocation rate.pngTASK DETAILhttps://phabricator.wikimedia.org/T175919EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: GehelCc: Stashbot, gerritbot, Smalyshev, Gehel, Aklapper, Gq86, Lordiis, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, EBjune, merbst, Avner, Lewizho99, Maathavan, debt, Jonas, FloNight, Xmlizer, Izno, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T163910: Show geoshapes in Map view

2017-10-04 Thread gerritbot
gerritbot added a project: Patch-For-Review.
TASK DETAILhttps://phabricator.wikimedia.org/T163910EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: gerritbotCc: gerritbot, Daniel_Mietchen, VIGNERON, Abbe98, Liuxinyu970226, PokestarFan, Arsfiqball, Jonas, jayvdb, Lea_Lacroix_WMDE, Lucas_Werkmeister_WMDE, Aklapper, Jheald, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, EBjune, merbst, Avner, Lewizho99, Maathavan, debt, Gehel, FloNight, Xmlizer, Izno, jkroll, Smalyshev, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T163910: Show geoshapes in Map view

2017-10-04 Thread gerritbot
gerritbot added a comment.
Change 382168 had a related patch set uploaded (by Lucas Werkmeister (WMDE); owner: Lucas Werkmeister (WMDE)):
[wikidata/query/gui@master] WIP: show geoshapes in Map view

https://gerrit.wikimedia.org/r/382168TASK DETAILhttps://phabricator.wikimedia.org/T163910EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: gerritbotCc: gerritbot, Daniel_Mietchen, VIGNERON, Abbe98, Liuxinyu970226, PokestarFan, Arsfiqball, Jonas, jayvdb, Lea_Lacroix_WMDE, Lucas_Werkmeister_WMDE, Aklapper, Jheald, GoranSMilovanovic, QZanden, EBjune, merbst, Avner, debt, Gehel, FloNight, Xmlizer, Izno, jkroll, Smalyshev, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T176852: Redirects should not be in wb_terms table

2017-10-04 Thread Ladsgroup
Ladsgroup added a project: Wikidata-Sprint.
TASK DETAILhttps://phabricator.wikimedia.org/T176852EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: LadsgroupCc: WMDE-leszek, daniel, Aklapper, Ladsgroup, GoranSMilovanovic, QZanden, Izno, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Edited] T114903: Migrate wb_terms to using prefixed entity IDs instead of numeric IDs

2017-10-04 Thread Ladsgroup
Ladsgroup updated the task description. (Show Details)
CHANGES TO TASK DESCRIPTION...[ x] Switch to updating both, the old and the new column {T167229}, {T165197}
[ x] Populate new column using maintenance script: {T171460}...TASK DETAILhttps://phabricator.wikimedia.org/T114903EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: LadsgroupCc: PokestarFan, Pasleim, Ricordisamoa, JanZerebecki, hoo, daniel, Aklapper, GoranSMilovanovic, QZanden, Marostegui, Minhnv-2809, Izno, Luke081515, Wikidata-bugs, aude, Mbch331, Jay8g, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T177154: Make "mw.wikibase.description" and "mw.wikibase.getDescriptionWithLang" add description usages

2017-10-04 Thread gerritbot
gerritbot added a comment.
Change 382167 had a related patch set uploaded (by Thiemo Mättig (WMDE); owner: Thiemo Mättig (WMDE)):
[mediawiki/extensions/Wikibase@master] Minor fixups to UsageTrackingLanguageFallbackLabelDescriptionLookup

https://gerrit.wikimedia.org/r/382167TASK DETAILhttps://phabricator.wikimedia.org/T177154EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hoo, gerritbotCc: gerritbot, Aklapper, hoo, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Izno, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T176852: Redirects should not be in wb_terms table

2017-10-04 Thread Ladsgroup
Ladsgroup added a comment.
Cleaned them manuallyTASK DETAILhttps://phabricator.wikimedia.org/T176852EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: LadsgroupCc: WMDE-leszek, daniel, Aklapper, Ladsgroup, GoranSMilovanovic, QZanden, Izno, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T176841: Create wikibase/wikiba.se-deploy repo

2017-10-04 Thread Ladsgroup
Ladsgroup added a comment.
Made an entry there https://www.mediawiki.org/w/index.php?title=Gerrit/New_repositories/Requests/Entries&diff=prev&oldid=2577484 
 just to be sureTASK DETAILhttps://phabricator.wikimedia.org/T176841EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: LadsgroupCc: hashar, Aklapper, JanZerebecki, hoo, thiemowmde, JeroenDeDauw, Jonas, Addshore, Ivanhercaz, faidon, PokestarFan, greg, mark, Lydia_Pintscher, Dzahn, Ladsgroup, GoranSMilovanovic, Th3d3v1ls, Hfbn0, QZanden, Zppix, Izno, Wikidata-bugs, aude, Mbch331, Jay8g, fgiunchedi___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T175919: investigate GC times on wikidata query service

2017-10-04 Thread Gehel
Gehel added a comment.
for reference:

JVM:

gehel@wdqs1004:~$ java -version
openjdk version "1.8.0_141"
OpenJDK Runtime Environment (build 1.8.0_141-8u141-b15-1~bpo8+1-b15)
OpenJDK 64-Bit Server VM (build 25.141-b15, mixed mode)

JVM options (full command line):

java -server -XX:+UseG1GC -Xms12g -Xmx12g
-Xloggc:/var/log/wdqs/wdqs-blazegraph_jvm_gc.%p.log -XX:+PrintGCDetails -XX:+PrintGCDateStamps -XX:+PrintGCTimeStamps -XX:+PrintTenuringDistribution
-XX:+PrintGCCause -XX:+PrintGCApplicationStoppedTime -XX:+UseGCLogFileRotation -XX:NumberOfGCLogFiles=10 -XX:GCLogFileSize=20M
-Dlogback.configurationFile=/etc/wdqs/logback-wdqs-blazegraph.xml
-Dcom.bigdata.rdf.sail.webapp.ConfigParams.propertyFile=/etc/wdqs/RWStore.properties
-Dorg.eclipse.jetty.server.Request.maxFormContentSize=2
-Dcom.bigdata.rdf.sparql.ast.QueryHints.analytic=true
-Dcom.bigdata.rdf.sparql.ast.QueryHints.analyticMaxMemoryPerQuery=1073741824
-DASTOptimizerClass=org.wikidata.query.rdf.blazegraph.WikibaseOptimizers
-Dorg.wikidata.query.rdf.blazegraph.inline.literal.WKTSerializer.noGlobe=2
-Dcom.bigdata.rdf.sail.webapp.client.RemoteRepository.maxRequestURLLength=7168
-Dcom.bigdata.rdf.sail.sparql.PrefixDeclProcessor.additionalDeclsFile=/srv/deployment/wdqs/wdqs/prefixes.conf
-Dorg.wikidata.query.rdf.blazegraph.mwapi.MWApiServiceFactory.config=/srv/deployment/wdqs/wdqs/mwservices.json
-Dcom.bigdata.rdf.sail.webapp.client.HttpClientConfigurator=org.wikidata.query.rdf.blazegraph.ProxiedHttpConnectionFactory
-Dhttp.userAgent=Wikidata Query Service; https://query.wikidata.org/
-Dhttp.proxyHost=webproxy.eqiad.wmnet -Dhttp.proxyPort=8080
-XX:+ExitOnOutOfMemoryError
-jar jetty-runner-9.2.3.v20140905.jar --host localhost --port  --path /bigdata blazegraph-service-0.2.5-SNAPSHOT.warTASK DETAILhttps://phabricator.wikimedia.org/T175919EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: GehelCc: Stashbot, gerritbot, Smalyshev, Gehel, Aklapper, Gq86, Lordiis, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, EBjune, merbst, Avner, Lewizho99, Maathavan, debt, Jonas, FloNight, Xmlizer, Izno, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T177388: Check “type” constraint on qualifiers and references

2017-10-04 Thread gerritbot
gerritbot added a comment.
Change 382157 had a related patch set uploaded (by Lucas Werkmeister (WMDE); owner: Lucas Werkmeister (WMDE)):
[mediawiki/extensions/WikibaseQualityConstraints@master] Don’t skip “type” constraints on non-statement contexts

https://gerrit.wikimedia.org/r/382157TASK DETAILhttps://phabricator.wikimedia.org/T177388EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Lucas_Werkmeister_WMDE, gerritbotCc: gerritbot, Lucas_Werkmeister_WMDE, Aklapper, GoranSMilovanovic, QZanden, Agabi10, Izno, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T177388: Check “type” constraint on qualifiers and references

2017-10-04 Thread gerritbot
gerritbot added a project: Patch-For-Review.
TASK DETAILhttps://phabricator.wikimedia.org/T177388EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Lucas_Werkmeister_WMDE, gerritbotCc: gerritbot, Lucas_Werkmeister_WMDE, Aklapper, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Agabi10, Izno, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T175562: Check “conflicts with” and “item requires claim” constraints on qualifiers and references?

2017-10-04 Thread Lucas_Werkmeister_WMDE
Lucas_Werkmeister_WMDE added a comment.
It looks like at least from the current usage of those constraint types on properties with “used as qualifier” constraints, the “sibling snaks” interpretation doesn’t make much sense: properties like “date of taxon name publication” use “item requires claim” constraints to require “taxon name”, “parent taxon” and “taxon rank” on the item.

On the other hand, I think those (along with many other “item requires claim” constraints, and also some “conflicts with” constraints) are kind of workarounds for our lack of per-type constraints: we can’t directly formulate a constraint that “all items with instance of: taxon must have a taxon name”, so instead we say that “all items with taxon rank must have a taxon name”, because the sets of items with instance of: taxon and those with taxon rank should be mostly overlapping.TASK DETAILhttps://phabricator.wikimedia.org/T175562EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Lucas_Werkmeister_WMDECc: Aklapper, Lydia_Pintscher, Ivan_A_Krestinin, abian, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, Agabi10, Izno, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Created] T177388: Check “type” constraint on qualifiers and references

2017-10-04 Thread Lucas_Werkmeister_WMDE
Lucas_Werkmeister_WMDE created this task.Lucas_Werkmeister_WMDE added projects: Wikidata, Wikibase-Quality, Wikibase-Quality-Constraints, Wikidata-Sprint.Herald added a subscriber: Aklapper.
TASK DESCRIPTIONIn T175570: Don’t check some constraint types on non-statement contexts, I thought it didn’t make sense to check “type” constraints on qualifiers and references. Turns out that’s rubbish – “type constraint” is the most common constraint type in conjunction with “used as qualifier constraint” (query), and many of the examples (electoral district, taxon author, decay mode, plea) are entirely reasonable. So let’s enable those checks after all.TASK DETAILhttps://phabricator.wikimedia.org/T177388EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Lucas_Werkmeister_WMDECc: Lucas_Werkmeister_WMDE, Aklapper, GoranSMilovanovic, QZanden, Agabi10, Izno, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Block] T168532: Check constraints on qualifiers and references

2017-10-04 Thread Lucas_Werkmeister_WMDE
Lucas_Werkmeister_WMDE created subtask T177388: Check “type” constraint on qualifiers and references.
TASK DETAILhttps://phabricator.wikimedia.org/T168532EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Lucas_Werkmeister_WMDECc: abian, Ivan_A_Krestinin, gerritbot, PokestarFan, Lydia_Pintscher, Lucas_Werkmeister_WMDE, Aklapper, GoranSMilovanovic, QZanden, Agabi10, Izno, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Changed Project Column] T171459: Fix audio issues in conversations with Amir

2017-10-04 Thread christophneuroth
christophneuroth moved this task from Backlog to Done on the Wikidata-Sprint board.christophneuroth added a comment.
Recent hangouts have been improved and we also have a new tablet and a little external webcam in the new office so this should be better now.TASK DETAILhttps://phabricator.wikimedia.org/T171459WORKBOARDhttps://phabricator.wikimedia.org/project/board/2351/EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Ladsgroup, christophneurothCc: christophneuroth, Aklapper, Wikidata-bugs___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Changed Project Column] T171446: Frontend Architecture Session

2017-10-04 Thread christophneuroth
christophneuroth moved this task from Doing to Done on the Wikidata-Sprint board.christophneuroth added a comment.
It's been scheduled, so we can move this :)TASK DETAILhttps://phabricator.wikimedia.org/T171446WORKBOARDhttps://phabricator.wikimedia.org/project/board/2351/EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: christophneurothCc: Ladsgroup, Aklapper, christophneuroth, Wikidata-bugs___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T159787: Add Wikidata to new RC Filters UI

2017-10-04 Thread Zache
Zache added a comment.
Propagated 'Wikidata edits' with Experience level filters are using local wiki editcount/activity for experience level and so propagated edits are marked  as newcomer edits. It would be more useful to use source wikis (eg. Wikidata) editcount/activity for getting the experience level.TASK DETAILhttps://phabricator.wikimedia.org/T159787EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Mattflaschen-WMF, ZacheCc: Zache, Trizek-WMF, PokestarFan, jmatazzoni, Etonkovidova, Liuxinyu970226, Catrope, gerritbot, Aklapper, Mattflaschen-WMF, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Iniquity, Izno, SBisson, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T175919: investigate GC times on wikidata query service

2017-10-04 Thread Gehel
Gehel added a comment.
See F9995047: wdqs gc logs for an example of problematic GC log.TASK DETAILhttps://phabricator.wikimedia.org/T175919EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: GehelCc: Stashbot, gerritbot, Smalyshev, Gehel, Aklapper, Gq86, Lordiis, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, EBjune, merbst, Avner, Lewizho99, Maathavan, debt, Jonas, FloNight, Xmlizer, Izno, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T174565: Gather first community input and create focus groups for Structured Data on Wikimedia Commons

2017-10-04 Thread Qgil
Qgil added a project: Goal.
TASK DETAILhttps://phabricator.wikimedia.org/T174565EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SandraF_WMF, QgilCc: Abit, Aklapper, SandraF_WMF, E1presidente, Ramsey-WMF, Jmmuguerza, GoranSMilovanovic, Ivana_Isadora, QZanden, Acer, Jseddon, FloNight, Trizek-WMF, Susannaanas, Izno, Wikidata-bugs, PKM, Base, matthiasmullie, aude, Ricordisamoa, Fabrice_Florin, Raymond, Mbch331, Keegan, Elitre, Qgil___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T173820: Cleanup and update drive of information pages / portal about Structured Data on Commons

2017-10-04 Thread Qgil
Qgil added a project: Goal.
TASK DETAILhttps://phabricator.wikimedia.org/T173820EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SandraF_WMF, QgilCc: Abit, Ramsey-WMF, Aklapper, Elitre, PokestarFan, SandraF_WMF, E1presidente, Jmmuguerza, GoranSMilovanovic, Ivana_Isadora, QZanden, Acer, Jseddon, FloNight, Trizek-WMF, Susannaanas, Izno, Wikidata-bugs, PKM, Base, matthiasmullie, aude, Ricordisamoa, Fabrice_Florin, Raymond, Mbch331, Jay8g, Keegan, Qgil___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs