[Wikidata-bugs] [Maniphest] [Commented On] T174298: Figure out a way for WDQS example parsing not rely on parsoid

2017-11-01 Thread Yurik
Yurik added a comment.
@Lucas_Werkmeister_WMDE I don't think it needs parsoid - OSM wiki doesn't have it as far as I can see, and this approach works there.  @Addshore correct, this approach does require visual editor extension.  I wonder if it would be possible to use action=""> instead.TASK DETAILhttps://phabricator.wikimedia.org/T174298EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: YurikCc: Lucas_Werkmeister_WMDE, Addshore, Wikidata-Query-Service, Aklapper, Yurik, Lahi, GoranSMilovanovic, QZanden, EBjune, merbst, Avner, debt, Gehel, Jonas, FloNight, Xmlizer, jkroll, Smalyshev, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T179428: Can not enable old SQL prefix search mode on wikidata

2017-11-01 Thread ReleaseTaggerBot
ReleaseTaggerBot edited projects, added MW-1.31-release-notes (WMF-deploy-2017-10-31 (1.31.0-wmf.6)); removed MW-1.31-release-notes (WMF-deploy-2017-11-07 (1.31.0-wmf.7)).
TASK DETAILhttps://phabricator.wikimedia.org/T179428EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Smalyshev, ReleaseTaggerBotCc: Stashbot, gerritbot, EBernhardson, dcausse, Aklapper, Smalyshev, Lahi, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, EBjune, Lewizho99, Maathavan, Jdrewniak, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Changed Project Column] T170779: Wikidata search suggestions do not display on screen if character whose decomposition contains nukta is present in search query

2017-11-01 Thread Smalyshev
Smalyshev moved this task from Up Next to Current work on the Discovery-Search board.Smalyshev edited projects, added Discovery-Search (Current work); removed Discovery-Search.
TASK DETAILhttps://phabricator.wikimedia.org/T170779WORKBOARDhttps://phabricator.wikimedia.org/project/board/1849/EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: gerritbot, hoo, Smalyshev, debt, Liuxinyu970226, TJones, daniel, thiemowmde, Aftabuzzaman, Mahir256, Aklapper, Lahi, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, EBjune, Lewizho99, Maathavan, Jdrewniak, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Closed] T179428: Can not enable old SQL prefix search mode on wikidata

2017-11-01 Thread Smalyshev
Smalyshev closed this task as "Resolved".
TASK DETAILhttps://phabricator.wikimedia.org/T179428EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Stashbot, gerritbot, EBernhardson, dcausse, Aklapper, Smalyshev, Lahi, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, EBjune, Lewizho99, Maathavan, Jdrewniak, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T179428: Can not enable old SQL prefix search mode on wikidata

2017-11-01 Thread Stashbot
Stashbot added a comment.
Mentioned in SAL (#wikimedia-operations) [2017-11-01T23:25:01Z]  Synchronized php-1.31.0-wmf.6/extensions/Wikibase/repo/Wikibase.hooks.php: SWAT: [[gerrit:387662|Allow turning Cirrus usage off from query]] T179428 (duration: 00m 49s)TASK DETAILhttps://phabricator.wikimedia.org/T179428EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Smalyshev, StashbotCc: Stashbot, gerritbot, EBernhardson, dcausse, Aklapper, Smalyshev, Lahi, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, EBjune, Lewizho99, Maathavan, Jdrewniak, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T179428: Can not enable old SQL prefix search mode on wikidata

2017-11-01 Thread Stashbot
Stashbot added a comment.
Mentioned in SAL (#wikimedia-operations) [2017-11-01T23:23:26Z]  Synchronized php-1.31.0-wmf.6/extensions/Wikidata/extensions/Wikibase/repo/Wikibase.hooks.php: SWAT: [[gerrit:387749|Allow turning Cirrus usage off from query]] T179428 (duration: 00m 51s)TASK DETAILhttps://phabricator.wikimedia.org/T179428EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Smalyshev, StashbotCc: Stashbot, gerritbot, EBernhardson, dcausse, Aklapper, Smalyshev, Lahi, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, EBjune, Lewizho99, Maathavan, Jdrewniak, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T170779: Wikidata search suggestions do not display on screen if character whose decomposition contains nukta is present in search query

2017-11-01 Thread gerritbot
gerritbot added a project: Patch-For-Review.
TASK DETAILhttps://phabricator.wikimedia.org/T170779EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: gerritbotCc: gerritbot, hoo, Smalyshev, debt, Liuxinyu970226, TJones, daniel, thiemowmde, Aftabuzzaman, Mahir256, Aklapper, Lahi, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, EBjune, Lewizho99, Maathavan, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T170779: Wikidata search suggestions do not display on screen if character whose decomposition contains nukta is present in search query

2017-11-01 Thread gerritbot
gerritbot added a comment.
Change 387959 had a related patch set uploaded (by Smalyshev; owner: Smalyshev):
[data-values/value-view@master] Normalize search term before matching against result

https://gerrit.wikimedia.org/r/387959TASK DETAILhttps://phabricator.wikimedia.org/T170779EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: gerritbotCc: gerritbot, hoo, Smalyshev, debt, Liuxinyu970226, TJones, daniel, thiemowmde, Aftabuzzaman, Mahir256, Aklapper, Lahi, GoranSMilovanovic, QZanden, EBjune, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T179428: Can not enable old SQL prefix search mode on wikidata

2017-11-01 Thread gerritbot
gerritbot added a comment.
Change 387662 merged by jenkins-bot:
[mediawiki/extensions/Wikibase@wmf/1.31.0-wmf.6] Allow turning Cirrus usage off from query

https://gerrit.wikimedia.org/r/387662TASK DETAILhttps://phabricator.wikimedia.org/T179428EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Smalyshev, gerritbotCc: gerritbot, EBernhardson, dcausse, Aklapper, Smalyshev, Lahi, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, EBjune, Lewizho99, Maathavan, Jdrewniak, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T179428: Can not enable old SQL prefix search mode on wikidata

2017-11-01 Thread gerritbot
gerritbot added a comment.
Change 387749 merged by jenkins-bot:
[mediawiki/extensions/Wikidata@wmf/1.31.0-wmf.6] Allow turning Cirrus usage off from query

https://gerrit.wikimedia.org/r/387749TASK DETAILhttps://phabricator.wikimedia.org/T179428EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Smalyshev, gerritbotCc: gerritbot, EBernhardson, dcausse, Aklapper, Smalyshev, Lahi, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, EBjune, Lewizho99, Maathavan, Jdrewniak, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Unblock] T46529: Wikidata search problems (tracking)

2017-11-01 Thread Smalyshev
Smalyshev closed subtask T148411: Item search for statements ranks disambiguation items too highly as "Resolved".
TASK DETAILhttps://phabricator.wikimedia.org/T46529EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: PokestarFan, Smalyshev, Wikidata-bugs, Nemo_bis, Aklapper, Lahi, GoranSMilovanovic, QZanden, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Closed] T148411: Item search for statements ranks disambiguation items too highly

2017-11-01 Thread Smalyshev
Smalyshev closed this task as "Resolved".
TASK DETAILhttps://phabricator.wikimedia.org/T148411EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Stashbot, gerritbot, EBernhardson, PokestarFan, Smalyshev, Izno, Nikki, Aklapper, Lahi, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T148411: Item search for statements ranks disambiguation items too highly

2017-11-01 Thread Stashbot
Stashbot added a comment.
Mentioned in SAL (#wikimedia-operations) [2017-11-01T23:09:42Z]  Synchronized wmf-config/Wikibase-production.php: SWAT: [[gerrit:386554|Revert "Revert "Add negative weight to disambig entities""]] T148411 (duration: 00m 51s)TASK DETAILhttps://phabricator.wikimedia.org/T148411EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Smalyshev, StashbotCc: Stashbot, gerritbot, EBernhardson, PokestarFan, Smalyshev, Izno, Nikki, Aklapper, Lahi, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T148411: Item search for statements ranks disambiguation items too highly

2017-11-01 Thread gerritbot
gerritbot added a comment.
Change 386554 merged by jenkins-bot:
[operations/mediawiki-config@master] Revert "Revert "Add negative weight to disambig entities""

https://gerrit.wikimedia.org/r/386554TASK DETAILhttps://phabricator.wikimedia.org/T148411EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Smalyshev, gerritbotCc: gerritbot, EBernhardson, PokestarFan, Smalyshev, Izno, Nikki, Aklapper, Lahi, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T170779: Wikidata search suggestions do not display on screen if character whose decomposition contains nukta is present in search query

2017-11-01 Thread Smalyshev
Smalyshev added a project: ValueView.
TASK DETAILhttps://phabricator.wikimedia.org/T170779EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: hoo, Smalyshev, debt, Liuxinyu970226, TJones, daniel, thiemowmde, Aftabuzzaman, Mahir256, Aklapper, Lahi, GoranSMilovanovic, QZanden, EBjune, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T170779: Wikidata search suggestions do not display on screen if character whose decomposition contains nukta is present in search query

2017-11-01 Thread Smalyshev
Smalyshev added a comment.
In jquery.ui.suggester.js we've got this:

			if ( typeof requestTerm === 'string' && requestTerm !== self._term ) {
// Skip request since it does not correspond to the current search term.
return;
			}

So looks like the term we get from the result may not be the original one but normalized one, because this check fails for the search above, thus ensuring no results.TASK DETAILhttps://phabricator.wikimedia.org/T170779EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Smalyshev, debt, Liuxinyu970226, TJones, daniel, thiemowmde, Aftabuzzaman, Mahir256, Aklapper, Lahi, GoranSMilovanovic, QZanden, EBjune, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T177486: [Tracking] Wikidata entity dumpers need to cope with the immense Wikidata growth recently

2017-11-01 Thread daniel
daniel added a comment.
@hoo we should really look into generating RDF from JSON. Can probably be done in a week.

That would mean moving a lot less data from storage over the network. Should be faster. How much, I can't say...TASK DETAILhttps://phabricator.wikimedia.org/T177486EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hoo, danielCc: Sjoerddebruin, gerritbot, thiemowmde, Aklapper, ezachte, daniel, Lydia_Pintscher, mark, ArielGlenn, bd808, Liuxinyu970226, aude, JanZerebecki, Jimkont, Denis.bykov, Ricordisamoa, PokestarFan, hoo, Lahi, GoranSMilovanovic, QZanden, Wikidata-bugs, Svick, Mbch331, jeremyb___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T170779: Wikidata search suggestions do not display on screen if character whose decomposition contains nukta is present in search query

2017-11-01 Thread Smalyshev
Smalyshev added a comment.
Looking at the network trace when searching for ଡ଼, the result is returned (Q31441900) but for some reason is not displayed. The warning is there, but does not prevent the display of the result. I suspect the frontend, but will dig deeper.TASK DETAILhttps://phabricator.wikimedia.org/T170779EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: Smalyshev, debt, Liuxinyu970226, TJones, daniel, thiemowmde, Aftabuzzaman, Mahir256, Aklapper, Lahi, GoranSMilovanovic, QZanden, EBjune, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Created] T179535: Not possible to change tabs in code popup on Safari

2017-11-01 Thread Sjoerddebruin
Sjoerddebruin created this task.Sjoerddebruin added projects: Wikidata Query UI, Browser-Support-Apple-Safari.Herald added a subscriber: Aklapper.
TASK DESCRIPTIONI'm not able to navigate to the other tabs of the recently added code popup on Safari. The _javascript_ console doesn't give an error.

Using Safari 11 on macOS High Sierra.TASK DETAILhttps://phabricator.wikimedia.org/T179535EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SjoerddebruinCc: Sjoerddebruin, Aklapper, Lucas_Werkmeister_WMDE, EBjune, merbst, Jonas, Xmlizer, jkroll, Smalyshev, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T106287: [Tracking] Track descriptions usages separately (Create a new description usage aspect "D")

2017-11-01 Thread eranroz
eranroz added a comment.
See also: https://en.wikipedia.org/wiki/Wikipedia_talk:Wikidata/2017_State_of_affairsTASK DETAILhttps://phabricator.wikimedia.org/T106287EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hoo, eranrozCc: Richard_Nevell_WMUK, thiemowmde, gerritbot, eranroz, PokestarFan, jmadler, hoo, daniel, zhuyifei1999, Eloquence, Lydia_Pintscher, Sannita, Ainali, Liuxinyu970226, MZMcBride, Ricordisamoa, Micru, jayvdb, Daniel_Mietchen, Tobi_WMDE_SW, Legoktm, Abraham, greg, Wikidata-bugs, liangent, jeremyb, aude, Bianjiang, Aklapper, Lahi, GoranSMilovanovic, QZanden, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Triaged] T179428: Can not enable old SQL prefix search mode on wikidata

2017-11-01 Thread Smalyshev
Smalyshev triaged this task as "Normal" priority.
TASK DETAILhttps://phabricator.wikimedia.org/T179428EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SmalyshevCc: gerritbot, EBernhardson, dcausse, Aklapper, Smalyshev, Lahi, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, EBjune, Lewizho99, Maathavan, Jdrewniak, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Edited] T177486: [Tracking] Wikidata entity dumpers need to cope with the immense Wikidata growth recently

2017-11-01 Thread hoo
hoo updated the task description. (Show Details)
CHANGES TO TASK DESCRIPTION...[] Conclude {T178247}
[] Deploy 3164215d0d790f37cc1cf386ef22a188e81a10d0

I consider this task done when the dumps finish no later than mid-Thursday again and don't run well into the weekend.TASK DETAILhttps://phabricator.wikimedia.org/T177486EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hooCc: Sjoerddebruin, gerritbot, thiemowmde, Aklapper, ezachte, daniel, Lydia_Pintscher, mark, ArielGlenn, bd808, Liuxinyu970226, aude, JanZerebecki, Jimkont, Denis.bykov, Ricordisamoa, PokestarFan, hoo, Lahi, GoranSMilovanovic, QZanden, Wikidata-bugs, Svick, Mbch331, jeremyb___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Edited] T177486: [Tracking] Wikidata entity dumpers need to cope with the immense Wikidata growth recently

2017-11-01 Thread hoo
hoo updated the task description. (Show Details)
CHANGES TO TASK DESCRIPTION...[] Deploy 3164215d0d790f37cc1cf386ef22a188e81a10d056906993f95067ec156cf3412f2dabaefce282ad

I consider this task done when the dumps finish no later than mid-Thursday again and don't run well into the weekend.TASK DETAILhttps://phabricator.wikimedia.org/T177486EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hooCc: Sjoerddebruin, gerritbot, thiemowmde, Aklapper, ezachte, daniel, Lydia_Pintscher, mark, ArielGlenn, bd808, Liuxinyu970226, aude, JanZerebecki, Jimkont, Denis.bykov, Ricordisamoa, PokestarFan, hoo, Lahi, GoranSMilovanovic, QZanden, Wikidata-bugs, Svick, Mbch331, jeremyb___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T177486: [Tracking] Wikidata entity dumpers need to cope with the immense Wikidata growth recently

2017-11-01 Thread hoo
hoo added a comment.

In T177486#3727830, @hoo wrote:
This also indicates that our current changes had a huge impact… but also that ad332804b1fea069043d14d0195f6fe2ed5a6f4b and/ or 3164215d0d790f37cc1cf386ef22a188e81a10d0 might have a huge negative impact here :/


I just quickly looked at both and found some room for some tiny micro-optimizations, but I doubt they're worth it.

56906993f95067ec156cf3412f2dabaefce282ad will probably help here as well (once deployed).TASK DETAILhttps://phabricator.wikimedia.org/T177486EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hooCc: Sjoerddebruin, gerritbot, thiemowmde, Aklapper, ezachte, daniel, Lydia_Pintscher, mark, ArielGlenn, bd808, Liuxinyu970226, aude, JanZerebecki, Jimkont, Denis.bykov, Ricordisamoa, PokestarFan, hoo, Lahi, GoranSMilovanovic, QZanden, Wikidata-bugs, Svick, Mbch331, jeremyb___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T177486: [Tracking] Wikidata entity dumpers need to cope with the immense Wikidata growth recently

2017-11-01 Thread hoo
hoo added a comment.
Run time for the full TTL dump (the data diff is from the gzipped file):

20170918: 25:30h (5 shards)
20170925: 26:30h (5 shards) (~ +3.7% data)
20171009: 30:30h (5 shards) (~ +6.7% data)
20171016: 36:30h (6 shards) (~ +1.9% data) (contains ad332804b1fea069043d14d0195f6fe2ed5a6f4b and 3164215d0d790f37cc1cf386ef22a188e81a10d0)
20171023: 43:10h (6 shards) (~ +0.8% data)
20171030: 26:00h (6 shards) (~ +1.6% data)

This also indicates that our current changes had a huge impact… but also that ad332804b1fea069043d14d0195f6fe2ed5a6f4b and/ or 3164215d0d790f37cc1cf386ef22a188e81a10d0 might have a huge negative impact here :/TASK DETAILhttps://phabricator.wikimedia.org/T177486EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hooCc: Sjoerddebruin, gerritbot, thiemowmde, Aklapper, ezachte, daniel, Lydia_Pintscher, mark, ArielGlenn, bd808, Liuxinyu970226, aude, JanZerebecki, Jimkont, Denis.bykov, Ricordisamoa, PokestarFan, hoo, Lahi, GoranSMilovanovic, QZanden, Wikidata-bugs, Svick, Mbch331, jeremyb___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Triaged] T114904: Migrate wb_items_per_site to using prefixed entity IDs instead of numeric IDs

2017-11-01 Thread Multichill
Multichill added subscribers: Lydia_Pintscher, Sjoerddebruin, Multichill.Multichill triaged this task as "High" priority.Multichill added a comment.
So wb_entity_per_page was killed:

MariaDB [wikidatawiki_p]> SELECT * FROM wb_entity_per_page LIMIT 1;
ERROR 1356 (HY000): View 'wikidatawiki_p.wb_entity_per_page' references invalid table(s) or column(s) or function(s) or definer/invoker of view lack rights to use them

The wb_terms table offers a good alternative to change queries to:

MariaDB [wikidatawiki_p]> SELECT * FROM wb_terms LIMIT 1;
+-++-+--+---+---++-+-+


term_row_idterm_entity_idterm_full_entity_idterm_entity_typeterm_languageterm_typeterm_textterm_search_keyterm_weight



+-++-+--+---+---++-+-+


36347450445Q50445itemen-gblabelJungwon-gujungwon-gu0



+-++-+--+---+---++-+-+
1 row in set (0.00 sec)

The wb_items_per_site offers no such option:

MariaDB [wikidatawiki_p]> SELECT * FROM wb_items_per_site LIMIT 1;
++-+-+--+


ips_row_idips_item_idips_site_idips_site_page



++-+-+--+


553596065abwikiЏьгьарда



++-+-+--+
1 row in set (0.01 sec)

The killing of wb_entity_per_page broke all sorts of tools with no alternative available.TASK DETAILhttps://phabricator.wikimedia.org/T114904EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: MultichillCc: Multichill, Sjoerddebruin, Lydia_Pintscher, Pasleim, Ricordisamoa, hoo, daniel, Aklapper, Lahi, GoranSMilovanovic, QZanden, Marostegui, Minhnv-2809, Luke081515, Wikidata-bugs, aude, Mbch331, Jay8g, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T150136: multiple items with identical coordinates not discoverable in map view?

2017-11-01 Thread gerritbot
gerritbot added a comment.
Change 387842 had a related patch set uploaded (by Lucas Werkmeister (WMDE); owner: Lucas Werkmeister (WMDE)):
[wikidata/query/gui@master] Optionally use leaflet.markercluster for map

https://gerrit.wikimedia.org/r/387842TASK DETAILhttps://phabricator.wikimedia.org/T150136EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: gerritbotCc: Jonas, gerritbot, Yurik, Aklapper, Esc3300, Lahi, Lordiis, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, EBjune, merbst, Lewizho99, Maathavan, Xmlizer, jkroll, Smalyshev, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T178088: Turn pseudo-extension wikibase/javascript-api into a npm package

2017-11-01 Thread gerritbot
gerritbot added a project: Patch-For-Review.
TASK DETAILhttps://phabricator.wikimedia.org/T178088EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: WMDE-leszek, gerritbotCc: gerritbot, Aklapper, Addshore, Lydia_Pintscher, WMDE-leszek, Lahi, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T178088: Turn pseudo-extension wikibase/javascript-api into a npm package

2017-11-01 Thread gerritbot
gerritbot added a comment.
Change 387816 had a related patch set uploaded (by Legoktm; owner: Legoktm):
[integration/config@master] Treat WikibaseJavaScriptApi as an independent library, not an extension

https://gerrit.wikimedia.org/r/387816TASK DETAILhttps://phabricator.wikimedia.org/T178088EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: WMDE-leszek, gerritbotCc: gerritbot, Aklapper, Addshore, Lydia_Pintscher, WMDE-leszek, Lahi, GoranSMilovanovic, QZanden, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T177698: AuthorityControl doesn't provide links to non-files on Commons and coordinates anymore

2017-11-01 Thread Jarekt
Jarekt added a comment.
I reported this issue on Wikidata:Project_chat. I have no idea why AuthorityControl.js would be related to links to Commons. I thought it only does links for  identifiers and coordinates. I have problems with Commons category (P373) and Commons creator (P1472). Usually it took a long time for those links to show up, like it was last on  initialization order, and if it did not show up than reloading the page usually worked. But now for many items it does not work no matter how many times you reload or how long you wait. Although in some cases after you add some new statement to some other property than the link would show up.TASK DETAILhttps://phabricator.wikimedia.org/T177698EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: JarektCc: Jarekt, Ayack, Robby, Liuxinyu970226, Lucas_Werkmeister_WMDE, Sjoerddebruin, Aklapper, Lahi, GoranSMilovanovic, Jrbranaa, QZanden, dachary, Wikidata-bugs, aude, Ricordisamoa, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T178576: Include wikibase-data-values-value-view npm package as a submodule of Wikibase git repo

2017-11-01 Thread ReleaseTaggerBot
ReleaseTaggerBot added a project: MW-1.31-release-notes (WMF-deploy-2017-11-07 (1.31.0-wmf.7)).
TASK DETAILhttps://phabricator.wikimedia.org/T178576EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: WMDE-leszek, ReleaseTaggerBotCc: gerritbot, Aklapper, Addshore, Lydia_Pintscher, WMDE-leszek, Lahi, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T178576: Include wikibase-data-values-value-view npm package as a submodule of Wikibase git repo

2017-11-01 Thread gerritbot
gerritbot added a comment.
Change 384943 merged by jenkins-bot:
[mediawiki/extensions/Wikibase@master] Install value-view lib as git submodule, not as composer dependency

https://gerrit.wikimedia.org/r/384943TASK DETAILhttps://phabricator.wikimedia.org/T178576EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: WMDE-leszek, gerritbotCc: gerritbot, Aklapper, Addshore, Lydia_Pintscher, WMDE-leszek, Lahi, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T167432: Run Wikibase daily browser tests on Jenkins

2017-11-01 Thread gerritbot
gerritbot added a comment.
Change 386416 had a related patch set uploaded (by WMDE-leszek; owner: WMDE-leszek):
[mediawiki/extensions/Wikibase@master] Do not fail on browser tests when browser errors are expected to happen

https://gerrit.wikimedia.org/r/386416TASK DETAILhttps://phabricator.wikimedia.org/T167432EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: zeljkofilipin, gerritbotCc: Ladsgroup, hoo, Addshore, aude, gerritbot, PokestarFan, Tobi_WMDE_SW, Jonas, thiemowmde, WMDE-leszek, zeljkofilipin, hashar, Aleksey_WMDE, Aklapper, Lahi, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Liudvikas, Luke081515, thcipriani, Wikidata-bugs, Mbch331, Jay8g, greg___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T178757: Add diff support for Lexeme

2017-11-01 Thread ReleaseTaggerBot
ReleaseTaggerBot edited projects, added MW-1.31-release-notes (WMF-deploy-2017-11-07 (1.31.0-wmf.7)); removed MW-1.31-release-notes (WMF-deploy-2017-10-31 (1.31.0-wmf.6)).
TASK DETAILhttps://phabricator.wikimedia.org/T178757EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Ladsgroup, ReleaseTaggerBotCc: PokestarFan, Bugreporter, Jakob_WMDE, Jonas, WMDE-leszek, thiemowmde, gerritbot, Aklapper, Ladsgroup, Lahi, Lordiis, Cinemantique, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Wikidata-bugs, aude, Darkdadaah, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T175919: investigate GC times on wikidata query service

2017-11-01 Thread gerritbot
gerritbot added a comment.
Change 384663 abandoned by Gehel:
wdqs: cleanup JVM options

https://gerrit.wikimedia.org/r/384663TASK DETAILhttps://phabricator.wikimedia.org/T175919EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: gerritbotCc: Stashbot, gerritbot, Smalyshev, Gehel, Aklapper, Lahi, Lordiis, Lucas_Werkmeister_WMDE, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, EBjune, merbst, Avner, Lewizho99, Maathavan, debt, Jonas, FloNight, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T178757: Add diff support for Lexeme

2017-11-01 Thread gerritbot
gerritbot added a comment.
Change 386227 merged by jenkins-bot:
[mediawiki/extensions/Wikibase@master] Move diffing visualizer stuff related to items to its dedicated classes

https://gerrit.wikimedia.org/r/386227TASK DETAILhttps://phabricator.wikimedia.org/T178757EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Ladsgroup, gerritbotCc: PokestarFan, Bugreporter, Jakob_WMDE, Jonas, WMDE-leszek, thiemowmde, gerritbot, Aklapper, Ladsgroup, Lahi, Lordiis, Cinemantique, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Wikidata-bugs, aude, Darkdadaah, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Closed] T179465: Installing npm package phantomjs-prebuilt failing for WikibaseJavaScriptApi builds

2017-11-01 Thread hashar
hashar closed this task as "Resolved".hashar claimed this task.hashar added a comment.
Yup we can follow up on T179360TASK DETAILhttps://phabricator.wikimedia.org/T179465EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hasharCc: gerritbot, hashar, Legoktm, WMDE-leszek, Aklapper, Lahi, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T55619: API module to copy a claim from one item to another

2017-11-01 Thread WMDE-leszek
WMDE-leszek removed projects: Patch-For-Review, Wikidata-Sprint.WMDE-leszek added a comment.
https://gerrit.wikimedia.org/r/379582 is a working proof of concept. Once decided, work on the new API module will continue.TASK DETAILhttps://phabricator.wikimedia.org/T55619EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Ladsgroup, WMDE-leszekCc: WMDE-leszek, gerritbot, PokestarFan, Liuxinyu970226, Snipre, Lydia_Pintscher, Esc3300, Nikki, Gareth, Aklapper, Ricordisamoa, Wikidata-bugs, Legoktm, Micru, JohnLewis, Lahi, GoranSMilovanovic, QZanden, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T167432: Run Wikibase daily browser tests on Jenkins

2017-11-01 Thread WMDE-leszek
WMDE-leszek added a comment.
@zeljkofilipin: I don't have rights to see the config of the job, so I am not sure if the user factory is now enabled or not?

Looks like most failures of that last run of yours were because of not finding items/properties. This seems odd, and also does appear to me locally. Maybe there were some search issues on beta recently?
Now I re-run the job and got only 2 failures. For those two I actually have a fix prepared. But as I don't know if my run was using user factory or not, I am not sure if there is a problem with the user factory or not.TASK DETAILhttps://phabricator.wikimedia.org/T167432EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: zeljkofilipin, WMDE-leszekCc: Ladsgroup, hoo, Addshore, aude, gerritbot, PokestarFan, Tobi_WMDE_SW, Jonas, thiemowmde, WMDE-leszek, zeljkofilipin, hashar, Aleksey_WMDE, Aklapper, Lahi, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Liudvikas, Luke081515, thcipriani, Wikidata-bugs, Mbch331, Jay8g, greg___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Retitled] T179450: Documentation of SDoC findings

2017-11-01 Thread Aklapper
Aklapper renamed this task from "Documentation of findings" to "Documentation of SDoC findings".
TASK DETAILhttps://phabricator.wikimedia.org/T179450EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: AklapperCc: Aklapper, mpopov, chelsyx, Abit, SandraF_WMF, Capt_Swing, Liuxinyu970226, debt, Nuria, Ramsey-WMF, Lahi, E1presidente, GoranSMilovanovic, QZanden, EBjune, Acer, Avner, Gehel, FloNight, Susannaanas, Jane023, Wikidata-bugs, PKM, Base, matthiasmullie, aude, Ricordisamoa, Fabrice_Florin, Raymond, Steinsplitter, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T179465: Installing npm package phantomjs-prebuilt failing for WikibaseJavaScriptApi builds

2017-11-01 Thread WMDE-leszek
WMDE-leszek added a comment.
Thanks @hashar! So could this be closed or do you want to use it for tracking making this decision?TASK DETAILhttps://phabricator.wikimedia.org/T179465EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: WMDE-leszekCc: gerritbot, hashar, Legoktm, WMDE-leszek, Aklapper, Lahi, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T178492: Create a more controlled WDQS cluster

2017-11-01 Thread Gehel
Gehel added a comment.

In T178492#3726074, @mobrovac wrote:
Perhaps a viable solution for the short- to mid-term is to have two LVS end points in each DC: one that serves external traffic, and another one internal, much like we have api.svc.{site}.wmnet and api-async.svc.{site}.wmnet for the MW API, respectively,


But if those 2 LVS endpoints are served by the same cluster, we've not achieved anything in term of isolation...TASK DETAILhttps://phabricator.wikimedia.org/T178492EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: GehelCc: Volans, mobrovac, Jonas, Aklapper, debt, Smalyshev, Gehel, Lahi, Gq86, E1presidente, Ramsey-WMF, SandraF_WMF, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, Acer, merbst, Avner, FloNight, Xmlizer, Susannaanas, Eevans, Jane023, jkroll, Hardikj, Wikidata-bugs, Jdouglas, PKM, Base, matthiasmullie, aude, Tobias1984, Manybubbles, Ricordisamoa, Fabrice_Florin, Raymond, Steinsplitter, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T178492: Create a more controlled WDQS cluster

2017-11-01 Thread mobrovac
mobrovac added a comment.

In T178492#3725811, @Gehel wrote:

Since we have 2 active / active WDQS clusters (eqiad / codfw), we could use one of them to serve internal traffic and one as external endpoint. This defeats the purpose of having a backup datacenter, so that's not a long term solution.



Perhaps a viable solution for the short- to mid-term is to have two LVS end points in each DC: one that serves external traffic, and another one internal, much like we have api.svc.{site}.wmnet and api-async.svc.{site}.wmnet for the MW API, respectively,TASK DETAILhttps://phabricator.wikimedia.org/T178492EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: mobrovacCc: Volans, mobrovac, Jonas, Aklapper, debt, Smalyshev, Gehel, Lahi, Gq86, E1presidente, Ramsey-WMF, SandraF_WMF, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, Acer, merbst, Avner, FloNight, Xmlizer, Susannaanas, Eevans, Jane023, jkroll, Hardikj, Wikidata-bugs, Jdouglas, PKM, Base, matthiasmullie, aude, Tobias1984, Manybubbles, Ricordisamoa, Fabrice_Florin, Raymond, Steinsplitter, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T174298: Figure out a way for WDQS example parsing not rely on parsoid

2017-11-01 Thread Addshore
Addshore added a comment.
And requires VisualEditor which wouldn't really help with T179262TASK DETAILhttps://phabricator.wikimedia.org/T174298EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: AddshoreCc: Lucas_Werkmeister_WMDE, Addshore, Wikidata-Query-Service, Aklapper, Yurik, Lahi, GoranSMilovanovic, QZanden, EBjune, merbst, Avner, debt, Gehel, Jonas, FloNight, Xmlizer, jkroll, Smalyshev, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T179328: Structured Commons newsletter - Nov-Dec 2017 edition

2017-11-01 Thread SandraF_WMF
SandraF_WMF edited projects, added Community-Liaisons (Oct-Dec 2017); removed Community-Liaisons.
TASK DETAILhttps://phabricator.wikimedia.org/T179328EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SandraF_WMFCc: Aklapper, Sadads, PokestarFan, Elitre, Qgil, Abit, SandraF_WMF, Lahi, E1presidente, Ramsey-WMF, GoranSMilovanovic, Ivana_Isadora, QZanden, Acer, Jseddon, FloNight, Trizek-WMF, Susannaanas, Jane023, Wikidata-bugs, PKM, Base, matthiasmullie, aude, Ricordisamoa, Fabrice_Florin, Raymond, Steinsplitter, Mbch331, Keegan___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T179328: Structured Commons newsletter - Nov-Dec 2017 edition

2017-11-01 Thread SandraF_WMF
SandraF_WMF removed a project: Epic.
TASK DETAILhttps://phabricator.wikimedia.org/T179328EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: SandraF_WMFCc: Aklapper, Sadads, PokestarFan, Elitre, Qgil, Abit, SandraF_WMF, Lahi, E1presidente, Ramsey-WMF, GoranSMilovanovic, Ivana_Isadora, QZanden, Acer, Jseddon, FloNight, Trizek-WMF, Susannaanas, Jane023, Wikidata-bugs, PKM, Base, matthiasmullie, aude, Ricordisamoa, Fabrice_Florin, Raymond, Steinsplitter, Mbch331, Keegan___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T174298: Figure out a way for WDQS example parsing not rely on parsoid

2017-11-01 Thread Lucas_Werkmeister_WMDE
Lucas_Werkmeister_WMDE added a comment.
It looks like you’re using the visualeditor API action, so doesn’t this still require parsoid to be setup?TASK DETAILhttps://phabricator.wikimedia.org/T174298EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Lucas_Werkmeister_WMDECc: Lucas_Werkmeister_WMDE, Addshore, Wikidata-Query-Service, Aklapper, Yurik, Lahi, GoranSMilovanovic, QZanden, EBjune, merbst, Avner, debt, Gehel, Jonas, FloNight, Xmlizer, jkroll, Smalyshev, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T179465: Installing npm package phantomjs-prebuilt failing for WikibaseJavaScriptApi builds

2017-11-01 Thread hashar
hashar added a comment.
So WikibaseJavaScriptApi is fixed now, as such this task is fixed.

Then it is all about whether we include PhantomJS in wmfreleng/npm-test or switch to a new containers (T179360).TASK DETAILhttps://phabricator.wikimedia.org/T179465EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hasharCc: gerritbot, hashar, Legoktm, WMDE-leszek, Aklapper, Lahi, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T179465: Installing npm package phantomjs-prebuilt failing for WikibaseJavaScriptApi builds

2017-11-01 Thread gerritbot
gerritbot added a comment.
Change 387780 merged by jenkins-bot:
[integration/config@master] Move npm for WikibaseJavaScriptApi back to Nodepool

https://gerrit.wikimedia.org/r/387780TASK DETAILhttps://phabricator.wikimedia.org/T179465EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: gerritbotCc: gerritbot, hashar, Legoktm, WMDE-leszek, Aklapper, Lahi, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T179465: Installing npm package phantomjs-prebuilt failing for WikibaseJavaScriptApi builds

2017-11-01 Thread gerritbot
gerritbot added a comment.
Change 387780 had a related patch set uploaded (by Hashar; owner: Hashar):
[integration/config@master] Move npm for WikibaseJavaScriptApi back to Nodepool

https://gerrit.wikimedia.org/r/387780TASK DETAILhttps://phabricator.wikimedia.org/T179465EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: gerritbotCc: gerritbot, hashar, Legoktm, WMDE-leszek, Aklapper, Lahi, GoranSMilovanovic, QZanden, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T179465: Installing npm package phantomjs-prebuilt failing for WikibaseJavaScriptApi builds

2017-11-01 Thread gerritbot
gerritbot added a project: Patch-For-Review.
TASK DETAILhttps://phabricator.wikimedia.org/T179465EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: gerritbotCc: gerritbot, hashar, Legoktm, WMDE-leszek, Aklapper, Lahi, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T179465: Installing npm package phantomjs-prebuilt failing for WikibaseJavaScriptApi builds

2017-11-01 Thread hashar
hashar added a comment.
The root cause is the tarball is compressed with bzip2 and the Docker container lacks /usr/bin/bz2.

> phantomjs-prebuilt@2.1.15 install /src/node_modules/phantomjs-prebuilt
> node install.js

PhantomJS not found on PATH
Downloading https://github.com/Medium/phantomjs/releases/download/v2.1.1/phantomjs-2.1.1-linux-x86_64.tar.bz2
Saving to /tmp/phantomjs/phantomjs-2.1.1-linux-x86_64.tar.bz2
Receiving...
  [] 0%
Received 22866K total.
Extracting tar contents (via spawned process)
Error extracting archive
Phantom installation failed { Error: Command failed: tar jxf /tmp/phantomjs/phantomjs-2.1.1-linux-x86_64.tar.bz2
tar (child): bzip2: Cannot exec: No such file or directory

I had a similar issue when migrating jobs to Nodepool instances, specially the job running the selenium tests (T137112). From that task:

Just found out that PhantomJS 2.1.1 is available in jessie-backports since March 8th!!! https://packages.debian.org/jessie-backports/phantomjs
 https://gerrit.wikimedia.org/r/#/c/344613/

We should either:

A) add phantomjs to the wmfreleng/npm-test container and phantomjs-prebuilt would be able to find it.  The node module dependency might have to be changed to match the Debian package version (2.1.1). https://packages.debian.org/search?keywords=phantomjs

B) create a different container that extends npm-test and would support PhantomJS / Chromium and with Xvfb. There is T179360

Other repositories that might be affected:


mediawiki/selenium
oojs/ui
unicodejs
wikimedia-portals
TASK DETAILhttps://phabricator.wikimedia.org/T179465EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hasharCc: hashar, Legoktm, WMDE-leszek, Aklapper, Lahi, GoranSMilovanovic, QZanden, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T178492: Create a more controlled WDQS cluster

2017-11-01 Thread Gehel
Gehel added a comment.
Random thoughts gathered in multiple discussion (note that this is very much a brainstorming, nothing written below is an actual decision of a path to follow):


I have heard WDQS mentioned in the context of structured data on commons, but I have no idea how it is going to be used. If anyone has a pointer to some documentation / discussion, please let me know.
Since we have 2 active / active WDQS clusters (eqiad / codfw), we could use one of them to serve internal traffic and one as external endpoint. This defeats the purpose of having a backup datacenter, so that's not a long term solution.
The hard to support use case is the external endpoint, since it is subject to uncontrolled load. Do we want to continue supporting this use case (I very much think we should continue to support it, but it isn't my place to make that decision, that question should be asked, and answered).
TASK DETAILhttps://phabricator.wikimedia.org/T178492EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: GehelCc: Volans, mobrovac, Jonas, Aklapper, debt, Smalyshev, Gehel, Lahi, Gq86, E1presidente, Ramsey-WMF, SandraF_WMF, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, EBjune, Acer, merbst, Avner, FloNight, Xmlizer, Susannaanas, Eevans, Jane023, jkroll, Hardikj, Wikidata-bugs, Jdouglas, PKM, Base, matthiasmullie, aude, Tobias1984, Manybubbles, Ricordisamoa, Fabrice_Florin, Raymond, Steinsplitter, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Closed] T179268: Add ZBW SPARQL endpoints to list of allowed external databases in WDQS

2017-11-01 Thread Jneubert
Jneubert closed this task as "Resolved".Jneubert claimed this task.Jneubert added a comment.
Thanks - I've moved the requests to https://www.wikidata.org/wiki/Wikidata:SPARQL_federation_input#Incoming_nominations and added two endpoints with derived datasets from GNDTASK DETAILhttps://phabricator.wikimedia.org/T179268EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: JneubertCc: Smalyshev, Lucas_Werkmeister_WMDE, Jneubert, Aklapper, Lahi, GoranSMilovanovic, QZanden, EBjune, merbst, Avner, debt, Gehel, Jonas, FloNight, Xmlizer, jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Created] T179465: Installing npm package phantomjs-prebuilt failing for WikibaseJavaScriptApi builds

2017-11-01 Thread WMDE-leszek
WMDE-leszek created this task.WMDE-leszek added projects: Continuous-Integration-Config, Wikidata.Herald added a subscriber: Aklapper.
TASK DESCRIPTIONI might be panicking and it might be just a temporary glitch. Nonetheless, I noticed today morning npm jenkins jobs for patches in extensions/WikibaseJavaScriptApi are failing.
See e.g. failures for https://gerrit.wikimedia.org/r/#/c/387079 or https://gerrit.wikimedia.org/r/#/c/387773

I wonder whether this is somehow related to the recent switch to docker containers for npm jobs?

Possibly relevant part of npm-debug.log below:

64684 silly install phantomjs-prebuilt@2.1.15 /src/node_modules/.staging/phantomjs-prebuilt-e66e8660
 64685 info lifecycle phantomjs-prebuilt@2.1.15~install: phantomjs-prebuilt@2.1.15
 64686 verbose lifecycle phantomjs-prebuilt@2.1.15~install: unsafe-perm in lifecycle true
 64687 verbose lifecycle phantomjs-prebuilt@2.1.15~install: PATH: /usr/local/lib/node_modules/npm/bin/node-gyp-bin:/src/node_modules/phantomjs-prebuilt/node_modules/.bin:/src/node_modules/.bin:/usr/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
 64688 verbose lifecycle phantomjs-prebuilt@2.1.15~install: CWD: /src/node_modules/phantomjs-prebuilt
 64689 silly lifecycle phantomjs-prebuilt@2.1.15~install: Args: [ '-c', 'node install.js' ]
 64690 silly lifecycle phantomjs-prebuilt@2.1.15~install: Returned: code: 1  signal: null
 64691 info lifecycle phantomjs-prebuilt@2.1.15~install: Failed to exec install script
 64692 verbose unlock done using /cache/_locks/staging-1a14545af9ac12d4.lock for /src/node_modules/.staging
 64693 silly rollbackFailedOptional Starting
 64694 silly rollbackFailedOptional Finishing
 64695 silly runTopLevelLifecycles Starting
 64696 silly runTopLevelLifecycles Finishing

64700 verbose stack Error: phantomjs-prebuilt@2.1.15 install: node install.js
 64700 verbose stack Exit status 1
 64700 verbose stack at EventEmitter. (/usr/local/lib/node_modules/npm/lib/utils/lifecycle.js:239:16)
 64700 verbose stack at emitTwo (events.js:106:13)
 64700 verbose stack at EventEmitter.emit (events.js:191:7)
 64700 verbose stack at ChildProcess. (/usr/local/lib/node_modules/npm/lib/utils/spawn.js:24:14)
 64700 verbose stack at emitTwo (events.js:106:13)
 64700 verbose stack at ChildProcess.emit (events.js:191:7)
 64700 verbose stack at maybeClose (internal/child_process.js:891:16)
 64700 verbose stack at Process.ChildProcess._handle.onexit (internal/child_process.js:226:5)
 64701 verbose pkgid phantomjs-prebuilt@2.1.15
 64702 verbose cwd /src
 64703 error Linux 4.9.0-0.bpo.3-amd64
 64704 error argv "/usr/bin/nodejs" "/usr/local/bin/npm" "install" "--no-progress"
 64705 error node v6.11.0
 64706 error npm  v3.8.3
 64707 error code ELIFECYCLE
 64708 error phantomjs-prebuilt@2.1.15 install: node install.js
 64708 error Exit status 1
 64709 error Failed at the phantomjs-prebuilt@2.1.15 install script 'node install.js'.
 64709 error Make sure you have the latest version of node.js and npm installed.
 64709 error If you do, this is most likely a problem with the phantomjs-prebuilt package,
 64709 error not with npm itself.
 64709 error Tell the author that this fails on your system:
 64709 error node install.js
 64709 error You can get information on how to open an issue for this project with:
 64709 error npm bugs phantomjs-prebuilt
 64709 error Or if that isn't available, you can get their info via:
 64709 error npm owner ls phantomjs-prebuilt
 64709 error There is likely additional logging output above.
 64710 verbose exit [ 1, true ]TASK DETAILhttps://phabricator.wikimedia.org/T179465WORKBOARDhttps://phabricator.wikimedia.org/project/board/1208/EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: WMDE-leszekCc: Legoktm, WMDE-leszek, Aklapper, Lahi, GoranSMilovanovic, QZanden, Wikidata-bugs, aude, Mbch331, hashar___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T178661: Drop wb_entity_per_page views in Wiki Replicas

2017-11-01 Thread Marostegui
Marostegui added a comment.

In T178661#3725222, @bd808 wrote:
Actually we probably just need maintain-views --databases wikidatawiki --clean rather than all wikis.


And also for testwikidatawikiTASK DETAILhttps://phabricator.wikimedia.org/T178661EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: MarosteguiCc: bd808, chasemp, Magnus, hoo, daniel, jcrespo, Marostegui, Aklapper, Ladsgroup, Lahi, aborrero, GoranSMilovanovic, QZanden, Tbscho, JJMC89, Luke081515, Wikidata-bugs, aude, Gryllida, scfc, Mbch331, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Edited] T44063: [Epic] Provide a plain linked data interface for accessing entities

2017-11-01 Thread matej_suchanek
matej_suchanek updated the task description. (Show Details)
CHANGES TO TASK DESCRIPTION...Care should be taken to allow caching of this data on the HTTP level, making use of the appropriate Cache-Control, ETag and If-Modified-Since headers.

--
**Version**: unspecified
**Severity**: enhancement
**Whiteboard**: u=dev c=story p=0TASK DETAILhttps://phabricator.wikimedia.org/T44063EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: matej_suchanekCc: Lucas_Werkmeister_WMDE, Prtksxna, gerritbot, PokestarFan, cscott, Liuxinyu970226, intracer, Aklapper, AnjaJentzsch, Abraham, Denny, Lydia_Pintscher, daniel, Lahi, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T175130: Add serialization/serialization to mediawiki-vendor

2017-11-01 Thread Tobi_WMDE_SW
Tobi_WMDE_SW added a project: WMDE-QWERTY-Sprint-2017-11-01.
TASK DETAILhttps://phabricator.wikimedia.org/T175130EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Addshore, Tobi_WMDE_SWCc: gerritbot, Aklapper, Addshore, Lahi, Lordiis, GoranSMilovanovic, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Wikidata-bugs, aude, fbstj, Mbch331, Legoktm___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs