[Wikidata-bugs] [Maniphest] [Changed Subscribers] T163083: ArticlePlaceholder tries to load not existing resources

2017-04-21 Thread Ladsgroup
Ladsgroup added subscribers: aude, daniel.Ladsgroup added a comment.
Okay, this is actually a way bigger problem than it looks. The real problem is "Wikidata extensions can't expose static assets externally in production" because their path is actually prepended by "Wikidata/extensions/" so https://nn.wikipedia.org/w/extensions/ArticlePlaceholder/modules/ext.articleplaceholder.createArticle/ext.articleplaceholder.createArticle.css would give a 404 but https://nn.wikipedia.org/w/extensions/Wikidata/extensions/ArticlePlaceholder/modules/ext.articleplaceholder.createArticle/ext.articleplaceholder.createArticle.css would not.

Unfortunately, I can't think of any simple/robust solution to this problem (it took hours to even find out what's wrong.). Until now, I thought of this solutions:


Move out ArticlePlaceholder from the bundle of Wikidata extensions. This won't solve underlying problem and it will bite us for Wikibase or other extensions
Change config variables. In short $wgResourceModules['ext.articleplaceholder.createArticle']['remoteExtPath'] would be changed from ArticlePlaceholder/modules to Wikidata/extensions/ArticlePlaceholder/modules but we need to do this for *all* modules we register (not extensions). Also, where is the best place to change it? in Wikidata.php in Wikidata extension? or in Wikibase-production.php config? or in InitilizeSettings.php? (Other article placeholder configs are there, I have no idea why)
Change it in extension.json: That's not even an option because it would break third party setups.
Move away from extension.json setup to ArticlePlaceholder.php: I don't like it, it feels like moving back to old ways.


@aude @daniel @hoo: What do you think?TASK DETAILhttps://phabricator.wikimedia.org/T163083EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: LadsgroupCc: daniel, aude, Ladsgroup, Lucie, hoo, Aklapper, Fomafix, QZanden, Izno, Wikidata-bugs, jayvdb, Ricordisamoa, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T162561: Expose geoShapeStorageFrontendUrl through siteinfo

2017-04-21 Thread gerritbot
gerritbot added a comment.
Change 347237 merged by jenkins-bot:
[mediawiki/extensions/Wikibase@master] Expose geoShapeStorageFrontendUrl through siteinfo

https://gerrit.wikimedia.org/r/347237TASK DETAILhttps://phabricator.wikimedia.org/T162561EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Lokal_Profil, gerritbotCc: Jonas, Aleksey_WMDE, thiemowmde, Lydia_Pintscher, gerritbot, Lokal_Profil, Aklapper, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Izno, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


Re: [Wikidata] [Bigdata-developers] Listing named graphs in Wikidata service

2017-04-21 Thread Aidan Hogan

Hi Stas,

On 21-04-2017 15:04, Stas Malyshev wrote:

Hi!


You agree with me that this query :
`select distinct ?g { graph ?g {?s ?p ?o} }` seems to be a valid SPARQL
query, but throws an error in WDQS service [1].


It is a valid SPARQL query, but what you're essentially asking is to
download whole 1.8b triples in a single query. There's no way we can
deliver this in one minute, which is current constraint on queries,
neither we want to enable queries like this - they are very
resource-intensive and serve little purpose.

If you want to work with huge data sets or import the whole data, you
may look either into getting the dump download and processing it with
offline tools like Wikidata Toolkit[2], or using our LDF server[1] which
is lightweight and allows you to work with the data much more efficiently.


While not having a strong opinion on the question of whether or not WDQS 
should support graph queries if it doesn't have named graphs, I disagree 
on the minor technical point that that query requires streaming all 
data. It simply asks for a unique list of all named graphs. Typically 
that will be much smaller than the entire data.


(Of course a naive implementation might stream everything to compute the 
query, but that's another matter I think.)


Cheers,
Aidan

___
Wikidata mailing list
Wikidata@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata


Re: [Wikidata] [Bigdata-developers] Listing named graphs in Wikidata service

2017-04-21 Thread Stas Malyshev
Hi!

> You agree with me that this query :
> `select distinct ?g { graph ?g {?s ?p ?o} }` seems to be a valid SPARQL
> query, but throws an error in WDQS service [1]. 

It is a valid SPARQL query, but what you're essentially asking is to
download whole 1.8b triples in a single query. There's no way we can
deliver this in one minute, which is current constraint on queries,
neither we want to enable queries like this - they are very
resource-intensive and serve little purpose.

If you want to work with huge data sets or import the whole data, you
may look either into getting the dump download and processing it with
offline tools like Wikidata Toolkit[2], or using our LDF server[1] which
is lightweight and allows you to work with the data much more efficiently.

[1]
https://www.mediawiki.org/wiki/Wikidata_query_service/User_Manual#Linked_Data_Fragments_endpoint
[2] https://www.mediawiki.org/wiki/Wikidata_Toolkit
-- 
Stas Malyshev
smalys...@wikimedia.org

___
Wikidata mailing list
Wikidata@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata


[Wikidata-bugs] [Maniphest] [Commented On] T157703: wdqs1003 LDF server fails with class not found exceptions

2017-04-21 Thread gerritbot
gerritbot added a comment.
Change 337244 merged by jenkins-bot:
[wikidata/query/rdf@master] Explicit dependencies on each module

https://gerrit.wikimedia.org/r/337244TASK DETAILhttps://phabricator.wikimedia.org/T157703EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Smalyshev, gerritbotCc: gerritbot, Lydia_Pintscher, Smalyshev, Gehel, Aklapper, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, EBjune, merbst, Avner, Lewizho99, Maathavan, debt, Jonas, FloNight, Xmlizer, Izno, jkroll, Wikidata-bugs, Jdouglas, aude, Deskana, Manybubbles, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Retitled] T163205: De-deploy the PagePreviews extension on Wikidata and English Wiktionary

2017-04-21 Thread Framawiki
Framawiki changed the title from "turn off PagePreviews on Wikidata and English Wiktionary" to "De-deploy the PagePreviews extension on Wikidata and English Wiktionary".
TASK DETAILhttps://phabricator.wikimedia.org/T163205EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: FramawikiCc: Liuxinyu970226, Dereckson, Framawiki, ovasileva, Aklapper, Lydia_Pintscher, QZanden, Winter, Urbanecm, JEumerus, Tulsi_Bhagat, Izno, Luke081515, biplabanand, Wikidata-bugs, Snowolf, aude, Ricordisamoa, Se4598, Matanya, Mbch331, Rxy, Jay8g, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata] Wiki PageID

2017-04-21 Thread Gintautas Sulskus
Hi,

I have a couple of questions regarding the Wiki Page ID. Does it always
stay unique for the page, where the page itself is just a placeholder for
any kind of information that might change over time?

Consider the following cases:
1. The first time someone creates page "Moon" it is assigned ID=1. If at
some point the page is renamed to "The_Moon", the ID=1 remains intact. Is
this correct?
2. What if we have page "Moon" with ID=1. Someone creates a second-page
"The_Moon" with ID=2. Is it possible that page "Moon" is transformed into a
redirect? Then, "Moon" would be redirecting to page "The_Moon"?
3. Is it possible for page "Moon" to become a category "Category:Moon" with
the same ID=1?

Thanks,
Gintas
___
Wikidata mailing list
Wikidata@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata


[Wikidata-bugs] [Maniphest] [Retitled] T163205: turn off PagePreviews on Wikidata and English Wiktionary

2017-04-21 Thread ovasileva
ovasileva changed the title from "turn off PagePreviews on Wikidata and Wiktionary" to "turn off PagePreviews on Wikidata and English Wiktionary".ovasileva edited the task description. (Show Details)
EDIT DETAILSPagePreviews on Wikidata and English Wiktionary were sadly broken with the last rewrite. Please disable them until it is fixed.TASK DETAILhttps://phabricator.wikimedia.org/T163205EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: ovasilevaCc: Liuxinyu970226, Dereckson, Framawiki, ovasileva, Aklapper, Lydia_Pintscher, QZanden, Winter, Urbanecm, JEumerus, Tulsi_Bhagat, Izno, Luke081515, biplabanand, Wikidata-bugs, Snowolf, aude, Ricordisamoa, Se4598, Matanya, Mbch331, Rxy, Jay8g, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T163205: turn off PagePreviews on Wikidata and Wiktionary

2017-04-21 Thread ovasileva
ovasileva added a comment.
@Liuxinyu970226 - sorry about that, I made the change a bit quickly.  For now, we'll only be looking at the English wiktionary while we come up with a plan for the rest.TASK DETAILhttps://phabricator.wikimedia.org/T163205EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: ovasilevaCc: Liuxinyu970226, Dereckson, Framawiki, ovasileva, Aklapper, Lydia_Pintscher, QZanden, Winter, Urbanecm, JEumerus, Tulsi_Bhagat, Izno, Luke081515, biplabanand, Wikidata-bugs, Snowolf, aude, Ricordisamoa, Se4598, Matanya, Mbch331, Rxy, Jay8g, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T58032: create item link on Special:Search assumes ordinary wikitext pages

2017-04-21 Thread gerritbot
gerritbot added a project: Patch-For-Review.
TASK DETAILhttps://phabricator.wikimedia.org/T58032EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Ricordisamoa, gerritbotCc: TerraCodes, daniel, thiemowmde, Ricordisamoa, Aklapper, Wikidata-bugs, aude, Lydia_Pintscher, Adik2382, Soteriaspace, Th3d3v1ls, JakeTheDeveloper, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Abbe98, MuhammadShuaib, Izno, TheDJ, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T58032: create item link on Special:Search assumes ordinary wikitext pages

2017-04-21 Thread gerritbot
gerritbot added a comment.Herald added a subscriber: TerraCodes.
Change 349446 had a related patch set uploaded (by Hoo man):
[mediawiki/core@master] Check supportsDirectEditing when suggesting page creation

https://gerrit.wikimedia.org/r/349446TASK DETAILhttps://phabricator.wikimedia.org/T58032EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Ricordisamoa, gerritbotCc: TerraCodes, daniel, thiemowmde, Ricordisamoa, Aklapper, Wikidata-bugs, aude, Lydia_Pintscher, Soteriaspace, JakeTheDeveloper, QZanden, Abbe98, MuhammadShuaib, Izno, TheDJ, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


Re: [Wikidata] [Bigdata-developers] Listing named graphs in Wikidata service

2017-04-21 Thread Ghislain ATEMEZING
Thanks Stas!
It's clear that a user might ask any type of query from an endpoint
according to her needs.
My concern goes further on whether such queries are valid or not in the
underlying RDF graph (in this case BLZ) regarding SPARQL 1.1 spec.
You agree with me that this query :
`select distinct ?g { graph ?g {?s ?p ?o} }` seems to be a valid SPARQL
query, but throws an error in WDQS service [1].

Any thoughts on this?
Best,
Ghislain
[1] https://goo.gl/hdJwUk


El jue., 20 abr. 2017 a las 21:54, Stas Malyshev ()
escribió:

> Hi!
>
> > I wanted to test the use of the queries below to list named graphs (if
> > any) in wikidata service [a]. I've tried them without success:
>
> We do not use any subgraphs in WDQS, so I don't think that query would
> produce much of a useful result.
>
> --
> Stas Malyshev
> smalys...@wikimedia.org
>
-- 
---
"Love all, trust a few, do wrong to none" (W. Shakespeare)
Web: http://atemezing.org
___
Wikidata mailing list
Wikidata@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata


[Wikidata-bugs] [Maniphest] [Commented On] T163544: Wikibase\TermSqlIndex::getMatchingTerms , Wikibase\TermSqlIndex::fetchTerms have bad performance after codfw failover

2017-04-21 Thread jcrespo
jcrespo added a comment.
I was thinking on https://dev.mysql.com/doc/refman/5.6/en/server-system-variables.html#sysvar_eq_range_index_dive_limit but that is probably more wishful thinking than practical give we are on MariaDB 10.TASK DETAILhttps://phabricator.wikimedia.org/T163544EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hoo, jcrespoCc: gerritbot, hoo, Aklapper, Marostegui, jcrespo, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Izno, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T163544: Wikibase\TermSqlIndex::getMatchingTerms , Wikibase\TermSqlIndex::fetchTerms have bad performance after codfw failover

2017-04-21 Thread hoo
hoo added a comment.
From #wikimedia-databases:

 jynus: For the first query in https://phabricator.wikimedia.org/T163544 how many term_entity_id would be ok?
 Right now we don't batch there at all, but I can add that rather easily
 Would 10 be ok?
 I would say 9
 I thin 10 is the limit to start getting in some cases bad queries
 (approximate cardinality)
 Ok, that's fineTASK DETAILhttps://phabricator.wikimedia.org/T163544EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hooCc: gerritbot, hoo, Aklapper, Marostegui, jcrespo, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Izno, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T157004: Edit summary should include the label of foreign entities

2017-04-21 Thread gerritbot
gerritbot added a comment.
Change 339655 merged by jenkins-bot:
[mediawiki/extensions/Wikibase@master] Move cheap checks up in LinkBeginHookHandler::doOnLinkBegin

https://gerrit.wikimedia.org/r/339655TASK DETAILhttps://phabricator.wikimedia.org/T157004EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: WMDE-leszek, gerritbotCc: thiemowmde, gerritbot, daniel, Aklapper, Lydia_Pintscher, WMDE-leszek, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Izno, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T138295: [Task] Change Special:NewProperty to not have a datatype selected by default

2017-04-21 Thread matej_suchanek
matej_suchanek added a project: Patch-For-Review.matej_suchanek moved this task from incoming to in current sprint on the Wikidata board.
TASK DETAILhttps://phabricator.wikimedia.org/T138295WORKBOARDhttps://phabricator.wikimedia.org/project/board/71/EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Ladsgroup, matej_suchanekCc: Lydia_Pintscher, daniel, Sjoerddebruin, Bugreporter, thiemowmde, Jonas, Aklapper, Zppix, Jan_Dittrich, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, SamanthaNguyen, JGirault, Izno, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T142104: Decide on a nice logo for Echo notifications

2017-04-21 Thread gerritbot
gerritbot added a comment.
Change 349411 merged by jenkins-bot:
[mediawiki/extensions/Wikibase@master] Change client setting 'repoIcon' to 'echoIcon'

https://gerrit.wikimedia.org/r/349411TASK DETAILhttps://phabricator.wikimedia.org/T142104EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: gerritbotCc: gerritbot, Ladsgroup, Izno, thiemowmde, Jan_Dittrich, Charlie_WMDE, Pginer-WMF, Aklapper, Lydia_Pintscher, matej_suchanek, Quiddity, Trizek-WMF, QZanden, SamanthaNguyen, JGirault, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T163544: Wikibase\TermSqlIndex::getMatchingTerms , Wikibase\TermSqlIndex::fetchTerms have bad performance after codfw failover

2017-04-21 Thread gerritbot
gerritbot added a comment.
Change 349429 merged by jenkins-bot:
[mediawiki/extensions/Wikibase@master] Only retrieve up to 2500 terms in TermSqlIndex

https://gerrit.wikimedia.org/r/349429TASK DETAILhttps://phabricator.wikimedia.org/T163544EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hoo, gerritbotCc: gerritbot, hoo, Aklapper, Marostegui, jcrespo, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Izno, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T163548: Drop the useless wb_terms keys "wb_terms_entity_type" and "wb_terms_type" on "wb_terms" table

2017-04-21 Thread Stashbot
Stashbot added a comment.
Mentioned in SAL (#wikimedia-operations) [2017-04-21T13:35:33Z]  Deploy alter table on wikidatawiki.wb_terms on db1092 - T162539 T163548TASK DETAILhttps://phabricator.wikimedia.org/T163548EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Marostegui, StashbotCc: Stashbot, gerritbot, aude, daniel, Aklapper, hoo, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Marostegui, Lewizho99, Minhnv-2809, Maathavan, Izno, Luke081515, Wikidata-bugs, Mbch331, Jay8g, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T162539: Deploy schema change for adding term_full_entity_id column to wb_terms table

2017-04-21 Thread Stashbot
Stashbot added a comment.
Mentioned in SAL (#wikimedia-operations) [2017-04-21T13:35:33Z]  Deploy alter table on wikidatawiki.wb_terms on db1092 - T162539 T163548TASK DETAILhttps://phabricator.wikimedia.org/T162539EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Marostegui, StashbotCc: Stashbot, hoo, jcrespo, Marostegui, WMDE-leszek, Lydia_Pintscher, daniel, Aklapper, gerritbot, aude, Ladsgroup, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Izno, Wikidata-bugs, Mbch331, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T163551: Huge number of duplicate rows in wb_terms

2017-04-21 Thread hoo
hoo removed subscribers: MediaWiki-extensions-WikibaseRepository, Wikidata.hoo added projects: MediaWiki-extensions-WikibaseRepository, Wikidata.
TASK DETAILhttps://phabricator.wikimedia.org/T163551EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hooCc: Aklapper, hoo, QZanden, Izno, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Created] T163551: Huge number of duplicate rows in wb_terms

2017-04-21 Thread hoo
hoo created this task.Herald added a subscriber: Aklapper.
TASK DESCRIPTIONThere's apparently a huge number of duplicate rows in wb_terms, for example:

mysql:wikiadmin@db1045 [wikidatawiki]> SELECT * FROM wb_terms WHERE term_entity_type = 'item' AND term_entity_id = 2807 AND term_language = 'es' AND term_type = 'description'\G 
*** 1. row ***
 term_row_id: 709061768
  term_entity_id: 2807
term_entity_type: item
   term_language: es
   term_type: description
   term_text: ciudad, capital de España
 term_search_key: ciudad, capital de españa
 term_weight: 0.254
*** 2. row ***
 term_row_id: 709061771
  term_entity_id: 2807
term_entity_type: item
   term_language: es
   term_type: description
   term_text: ciudad, capital de España
 term_search_key: ciudad, capital de españa
 term_weight: 0.254
2 rows in set (0.01 sec)

I found the above example merely by looking for a single term, testing other combinations also quickly brought up duplicates, thus I assume there are a lot of these.

I'm currently trying to find out, how many such duplicates we have, but the query is still running.TASK DETAILhttps://phabricator.wikimedia.org/T163551EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hooCc: MediaWiki-extensions-WikibaseRepository, Wikidata, Aklapper, hoo___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T163548: Drop the useless wb_terms keys "wb_terms_entity_type" and "wb_terms_type" on "wb_terms" table

2017-04-21 Thread Stashbot
Stashbot added a comment.
Mentioned in SAL (#wikimedia-operations) [2017-04-21T13:20:29Z]  Synchronized wmf-config/db-eqiad.php: Depool db1092 - T162539 T163548 (duration: 01m 18s)TASK DETAILhttps://phabricator.wikimedia.org/T163548EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Marostegui, StashbotCc: Stashbot, gerritbot, aude, daniel, Aklapper, hoo, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Marostegui, Lewizho99, Minhnv-2809, Maathavan, Izno, Luke081515, Wikidata-bugs, Mbch331, Jay8g, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T162539: Deploy schema change for adding term_full_entity_id column to wb_terms table

2017-04-21 Thread Stashbot
Stashbot added a comment.
Mentioned in SAL (#wikimedia-operations) [2017-04-21T13:20:29Z]  Synchronized wmf-config/db-eqiad.php: Depool db1092 - T162539 T163548 (duration: 01m 18s)TASK DETAILhttps://phabricator.wikimedia.org/T162539EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Marostegui, StashbotCc: Stashbot, hoo, jcrespo, Marostegui, WMDE-leszek, Lydia_Pintscher, daniel, Aklapper, gerritbot, aude, Ladsgroup, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Izno, Wikidata-bugs, Mbch331, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T163548: Drop the useless wb_terms keys "wb_terms_entity_type" and "wb_terms_type" on "wb_terms" table

2017-04-21 Thread gerritbot
gerritbot added a comment.
Change 349430 merged by jenkins-bot:
[operations/mediawiki-config@master] db-eqiad.php: Depool db1092

https://gerrit.wikimedia.org/r/349430TASK DETAILhttps://phabricator.wikimedia.org/T163548EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Marostegui, gerritbotCc: gerritbot, aude, daniel, Aklapper, hoo, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Marostegui, Lewizho99, Minhnv-2809, Maathavan, Izno, Luke081515, Wikidata-bugs, Mbch331, Jay8g, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T162539: Deploy schema change for adding term_full_entity_id column to wb_terms table

2017-04-21 Thread gerritbot
gerritbot added a comment.
Change 349430 merged by jenkins-bot:
[operations/mediawiki-config@master] db-eqiad.php: Depool db1092

https://gerrit.wikimedia.org/r/349430TASK DETAILhttps://phabricator.wikimedia.org/T162539EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Marostegui, gerritbotCc: hoo, jcrespo, Marostegui, WMDE-leszek, Lydia_Pintscher, daniel, Aklapper, gerritbot, aude, Ladsgroup, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Izno, Wikidata-bugs, Mbch331, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T162539: Deploy schema change for adding term_full_entity_id column to wb_terms table

2017-04-21 Thread gerritbot
gerritbot added a project: Patch-For-Review.
TASK DETAILhttps://phabricator.wikimedia.org/T162539EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Marostegui, gerritbotCc: jcrespo, Marostegui, WMDE-leszek, Lydia_Pintscher, daniel, Aklapper, gerritbot, aude, Ladsgroup, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Izno, Wikidata-bugs, Mbch331, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T162539: Deploy schema change for adding term_full_entity_id column to wb_terms table

2017-04-21 Thread gerritbot
gerritbot added a comment.
Change 349430 had a related patch set uploaded (by Marostegui):
[operations/mediawiki-config@master] db-eqiad.php: Depool db1092

https://gerrit.wikimedia.org/r/349430TASK DETAILhttps://phabricator.wikimedia.org/T162539EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Marostegui, gerritbotCc: jcrespo, Marostegui, WMDE-leszek, Lydia_Pintscher, daniel, Aklapper, gerritbot, aude, Ladsgroup, QZanden, Izno, Wikidata-bugs, Mbch331, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T163548: Drop the useless wb_terms keys "wb_terms_entity_type" and "wb_terms_type" on "wb_terms" table

2017-04-21 Thread gerritbot
gerritbot added a project: Patch-For-Review.
TASK DETAILhttps://phabricator.wikimedia.org/T163548EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Marostegui, gerritbotCc: gerritbot, aude, daniel, Aklapper, hoo, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Marostegui, Lewizho99, Minhnv-2809, Maathavan, Izno, Luke081515, Wikidata-bugs, Mbch331, Jay8g, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T163548: Drop the useless wb_terms keys "wb_terms_entity_type" and "wb_terms_type" on "wb_terms" table

2017-04-21 Thread gerritbot
gerritbot added a comment.
Change 349430 had a related patch set uploaded (by Marostegui):
[operations/mediawiki-config@master] db-eqiad.php: Depool db1092

https://gerrit.wikimedia.org/r/349430TASK DETAILhttps://phabricator.wikimedia.org/T163548EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Marostegui, gerritbotCc: gerritbot, aude, daniel, Aklapper, hoo, QZanden, Marostegui, Minhnv-2809, Izno, Luke081515, Wikidata-bugs, Mbch331, Jay8g, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T163544: Wikibase\TermSqlIndex::getMatchingTerms , Wikibase\TermSqlIndex::fetchTerms have bad performance after codfw failover

2017-04-21 Thread gerritbot
gerritbot added a comment.
Change 349429 had a related patch set uploaded (by Hoo man):
[mediawiki/extensions/Wikibase@master] Only retrieve up to 2500 terms in TermSqlIndex

https://gerrit.wikimedia.org/r/349429TASK DETAILhttps://phabricator.wikimedia.org/T163544EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hoo, gerritbotCc: gerritbot, hoo, Aklapper, Marostegui, jcrespo, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Izno, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Claimed] T163548: Drop the useless wb_terms keys "wb_terms_entity_type" and "wb_terms_type" on "wb_terms" table

2017-04-21 Thread Marostegui
Marostegui claimed this task.Marostegui moved this task from Triage to In progress on the DBA board.
TASK DETAILhttps://phabricator.wikimedia.org/T163548WORKBOARDhttps://phabricator.wikimedia.org/project/board/1060/EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: MarosteguiCc: aude, daniel, Aklapper, hoo, QZanden, Marostegui, Minhnv-2809, Izno, Luke081515, Wikidata-bugs, Mbch331, Jay8g, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T163205: turn off PagePreviews on Wikidata and Wiktionary

2017-04-21 Thread Liuxinyu970226
Liuxinyu970226 added a comment.
@ovasileva Why (all) Wiktionaries? I doubt if there isn't any WT pages which Previews can workTASK DETAILhttps://phabricator.wikimedia.org/T163205EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Liuxinyu970226Cc: Liuxinyu970226, Dereckson, Framawiki, ovasileva, Aklapper, Lydia_Pintscher, QZanden, Winter, Urbanecm, JEumerus, Tulsi_Bhagat, Izno, Luke081515, biplabanand, Wikidata-bugs, Snowolf, aude, Ricordisamoa, Se4598, Matanya, Mbch331, Rxy, Jay8g, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T142103: Decide on which clients users should get notifications

2017-04-21 Thread Lydia_Pintscher
Lydia_Pintscher added a comment.
Namespaces: I think any namespace that can have sitelinks should also get the notification. So it shouldn't require a special config.
Which wikis: we can start with Wikivoyage, then Wikipedia and then everyone else.TASK DETAILhttps://phabricator.wikimedia.org/T142103EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Lydia_PintscherCc: Ladsgroup, Aklapper, Lydia_Pintscher, matej_suchanek, QZanden, Izno, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T163544: Wikibase\TermSqlIndex::getMatchingTerms , Wikibase\TermSqlIndex::fetchTerms have bad performance after codfw failover

2017-04-21 Thread gerritbot
gerritbot added a comment.
Change 349424 had a related patch set uploaded (by Hoo man):
[mediawiki/extensions/Wikibase@master] Use smaller batches in TermSqlIndex::getTermsOfEntities

https://gerrit.wikimedia.org/r/349424TASK DETAILhttps://phabricator.wikimedia.org/T163544EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hoo, gerritbotCc: gerritbot, hoo, Aklapper, Marostegui, jcrespo, QZanden, Izno, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T163544: Wikibase\TermSqlIndex::getMatchingTerms , Wikibase\TermSqlIndex::fetchTerms have bad performance after codfw failover

2017-04-21 Thread gerritbot
gerritbot added a project: Patch-For-Review.
TASK DETAILhttps://phabricator.wikimedia.org/T163544EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hoo, gerritbotCc: gerritbot, hoo, Aklapper, Marostegui, jcrespo, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Izno, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Claimed] T163544: Wikibase\TermSqlIndex::getMatchingTerms , Wikibase\TermSqlIndex::fetchTerms have bad performance after codfw failover

2017-04-21 Thread hoo
hoo claimed this task.hoo added a comment.
I'm looking into this and will see what we can do.TASK DETAILhttps://phabricator.wikimedia.org/T163544EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hooCc: hoo, Aklapper, Marostegui, jcrespo, QZanden, Izno, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Closed] T114473: Provide a special page to list all available badges

2017-04-21 Thread Ladsgroup
Ladsgroup closed this task as "Resolved".
TASK DETAILhttps://phabricator.wikimedia.org/T114473EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: thiemowmde, LadsgroupCc: Ladsgroup, gerritbot, Addshore, Legoktm, Victorbarbu, TerraCodes, Bene, StudiesWorld, Aklapper, Beta16, Adik2382, Soteriaspace, harikiran, Th3d3v1ls, SacredWKnight, JakeTheDeveloper, Ramalepe, Liugev6, QZanden, Ptolusque, Sethakill, Lewizho99, Maathavan, Abbe98, D3r1ck01, MuhammadShuaib, Izno, Wikidata-bugs, aude, jayvdb, Mbch331, Jay8g___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Unblock] T96040: Wikibase special pages (tracking)

2017-04-21 Thread Ladsgroup
Ladsgroup closed subtask T114473: Provide a special page to list all available badges as "Resolved".
TASK DETAILhttps://phabricator.wikimedia.org/T96040EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: LadsgroupCc: Luke081515, Liuxinyu970226, aude, Aklapper, QZanden, Ptolusque, Sethakill, Izno, Wikidata-bugs, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Unblock] T42810: Wikibase badges (tracking)

2017-04-21 Thread Ladsgroup
Ladsgroup closed subtask T114473: Provide a special page to list all available badges as "Resolved".
TASK DETAILhttps://phabricator.wikimedia.org/T42810EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: LadsgroupCc: Taketa, DixonD, Aklapper, Liuxinyu970226, Bugreporter, Wikidata-bugs, Lazowik, Bene, jeblad, Legoktm, Nemo_bis, He7d3r, DarTar, Silvonen, Denny, Micru, aude, Ricordisamoa, MZMcBride, Quiddity, Ladsgroup, Lydia_Pintscher, Stryn, zhuyifei1999, Ltrlg, QZanden, Izno, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Claimed] T162539: Deploy schema change for adding term_full_entity_id column to wb_terms table

2017-04-21 Thread Marostegui
Marostegui claimed this task.
TASK DETAILhttps://phabricator.wikimedia.org/T162539EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: MarosteguiCc: jcrespo, Marostegui, WMDE-leszek, Lydia_Pintscher, daniel, Aklapper, gerritbot, aude, Ladsgroup, QZanden, Izno, Wikidata-bugs, Mbch331, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T163545: Come up with better message for SpecialAvailableBadges

2017-04-21 Thread thiemowmde
thiemowmde added a comment.
Note that the same solution should be reused for all special pages and messages that combine a label (being a link or not, with the ID in brackets or not) with a description. By saying this I'm mostly talking about a consistent user experience. We can actually reuse a message in different parts of our code base to achieve this goal, but this does have implications we might want to avoid.TASK DETAILhttps://phabricator.wikimedia.org/T163545EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: thiemowmdeCc: WMDE-leszek, thiemowmde, Amire80, Aklapper, Ladsgroup, QZanden, MuhammadShuaib, Izno, LNDDYL, Psychoslave, Wikidata-bugs, aude, Gryllida, Shizhao, Arrbee, Mbch331, Jay8g___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Retitled] T163548: Drop the useless wb_terms keys "wb_terms_entity_type" and "wb_terms_type" on "wb_terms" table

2017-04-21 Thread Marostegui
Marostegui changed the title from "Drop the useless wb_terms keys "wb_terms_entity_type" and "wb_terms_type"" to "Drop the useless wb_terms keys "wb_terms_entity_type" and "wb_terms_type" on "wb_terms" table".
TASK DETAILhttps://phabricator.wikimedia.org/T163548EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: MarosteguiCc: aude, daniel, Aklapper, hoo, QZanden, Marostegui, Minhnv-2809, Izno, Luke081515, Wikidata-bugs, Mbch331, Jay8g, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T163548: Drop the useless wb_terms keys "wb_terms_entity_type" and "wb_terms_type"

2017-04-21 Thread hoo
hoo removed subscribers: Schema-change, DBA, Wikidata.hoo added projects: Schema-change, DBA, Wikidata.
TASK DETAILhttps://phabricator.wikimedia.org/T163548EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hooCc: Aklapper, hoo, QZanden, Marostegui, Minhnv-2809, Izno, Luke081515, Wikidata-bugs, aude, Mbch331, Jay8g, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Edited] T163548: Drop the useless wb_terms keys "wb_terms_entity_type" and "wb_terms_type"

2017-04-21 Thread hoo
hoo edited the task description. (Show Details)
EDIT DETAILS...```

This concerns all `wikidatawiki` servers, `testwikidatawiki` is not affected.TASK DETAILhttps://phabricator.wikimedia.org/T163548EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hooCc: Aklapper, Schema-change, DBA, Wikidata, hoo___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Edited] T163548: Drop the useless wb_terms keys "wb_terms_entity_type" and "wb_terms_type"

2017-04-21 Thread hoo
hoo edited the task description. (Show Details)
EDIT DETAILSBoth of them are unused (P5306), to no surprise: There are two distinct values in `wb_terms_entity_type` and three distinct values in `wb_terms_type`, thus an index makes no sense. Both indexes don't exist within the Wikibase code, so I don't know why they went into production in the first place as of 4cf8b2fcf35df7fcf8c113cc1020385490009297TASK DETAILhttps://phabricator.wikimedia.org/T163548EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hooCc: Aklapper, Schema-change, DBA, Wikidata, hoo___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T162539: Deploy schema change for adding term_full_entity_id column to wb_terms table

2017-04-21 Thread Marostegui
Marostegui added a comment.
Let's do this alter along with dropping the indexes on: T163548TASK DETAILhttps://phabricator.wikimedia.org/T162539EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: MarosteguiCc: jcrespo, Marostegui, WMDE-leszek, Lydia_Pintscher, daniel, Aklapper, gerritbot, aude, Ladsgroup, QZanden, Izno, Wikidata-bugs, Mbch331, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Created] T163548: Drop the useless wb_terms keys "wb_terms_entity_type" and "wb_terms_type"

2017-04-21 Thread hoo
hoo created this task.Herald added a subscriber: Aklapper.
TASK DESCRIPTIONBoth of them are unused (P5306), to no surprise: There are two distinct values in wb_terms_entity_type and three distinct values in wb_terms_type, thus an index makes no sense. Both indexes don't exist within the Wikibase code, so I don't know why they went into production in the first place.

For reference:

  KEY `wb_terms_entity_type` (`term_entity_type`),
# …
  KEY `wb_terms_type` (`term_type`),TASK DETAILhttps://phabricator.wikimedia.org/T163548EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hooCc: Aklapper, Schema-change, DBA, Wikidata, hoo___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Closed] T42657: [Task] Wikibase: Auto-generate documentation for JavaScript code

2017-04-21 Thread hashar
hashar added subscribers: Ladsgroup, hashar.hashar closed this task as "Resolved".hashar assigned this task to Ladsgroup.hashar added a comment.Herald added a project: User-Ladsgroup.
The _javascript_ documentation is generated with jsduck and published at https://doc.wikimedia.org/Wikibase/master/js/

That has been enabled by @Ladsgroup with bf53cd87c23b0146150fefe89bbfd22afd891379 in October 2016.TASK DETAILhttps://phabricator.wikimedia.org/T42657EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Ladsgroup, hasharCc: hashar, Ladsgroup, Danwe, Rillke, Aklapper, thiemowmde, Spage, Snaterlicious, Wikidata-bugs, AnjaJentzsch, Abraham, Tobi_WMDE_SW, Denny, JeroenDeDauw, DanielFriesen, Lydia_Pintscher, Ivana_Isadora, Soteriaspace, JakeTheDeveloper, QZanden, Izno, aude, TheDJ, Mbch331, Jay8g___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Unblock] T108946: [Epic] Improve the development infrastructure

2017-04-21 Thread hashar
hashar closed subtask T42657: [Task] Wikibase: Auto-generate documentation for _javascript_ code as "Resolved".
TASK DETAILhttps://phabricator.wikimedia.org/T108946EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hasharCc: Liuxinyu970226, Ricordisamoa, Aklapper, Lydia_Pintscher, QZanden, Izno, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T142103: Decide on which clients users should get notifications

2017-04-21 Thread matej_suchanek
matej_suchanek added a comment.
Decide for which wiki families (Wikiquote, Wikisource etc.) and which namespaces it makes sense to enable this feature. Ie. if we should add some additional configuration or so.TASK DETAILhttps://phabricator.wikimedia.org/T142103EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: matej_suchanekCc: Ladsgroup, Aklapper, Lydia_Pintscher, matej_suchanek, QZanden, Izno, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T114473: Provide a special page to list all available badges

2017-04-21 Thread gerritbot
gerritbot added a comment.
Change 349213 merged by jenkins-bot:
[mediawiki/extensions/Wikibase@master] Refactor and fix HTML injection in SpecialAvailableBadges

https://gerrit.wikimedia.org/r/349213TASK DETAILhttps://phabricator.wikimedia.org/T114473EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: thiemowmde, gerritbotCc: Ladsgroup, gerritbot, Addshore, Legoktm, Victorbarbu, TerraCodes, Bene, StudiesWorld, Aklapper, Beta16, Adik2382, Soteriaspace, harikiran, Th3d3v1ls, SacredWKnight, JakeTheDeveloper, Ramalepe, Liugev6, QZanden, Ptolusque, Sethakill, Lewizho99, Maathavan, Abbe98, D3r1ck01, MuhammadShuaib, Izno, Wikidata-bugs, aude, jayvdb, Mbch331, Jay8g___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T142103: Decide on which clients users should get notifications

2017-04-21 Thread Ladsgroup
Ladsgroup added a comment.
@matej_suchanek Can you elaborate more? Without proper context, it's really hard to understand what is the goal of this patch and when we can call this done.TASK DETAILhttps://phabricator.wikimedia.org/T142103EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: LadsgroupCc: Ladsgroup, Aklapper, Lydia_Pintscher, matej_suchanek, QZanden, Izno, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Created] T163545: Come up with better message for SpecialAvailableBadges

2017-04-21 Thread Ladsgroup
Ladsgroup created this task.Ladsgroup added projects: I18n, Wikidata, MediaWiki-extensions-WikibaseRepository.Herald added a subscriber: Aklapper.
TASK DESCRIPTIONRight now, a badge line in Special:AvailableBadges is like this: "Badge (Q3), A fancy badge" It was separated by dash but there is not i18n message for those. There have been some suggestions, for example, using definition list. Each has pros and cons IMO

Context: https://gerrit.wikimedia.org/r/#/c/349213/1/repo/includes/Specials/SpecialAvailableBadges.php (comments)

We should come up with a localizable text that conveys the message properlyTASK DETAILhttps://phabricator.wikimedia.org/T163545EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: LadsgroupCc: WMDE-leszek, thiemowmde, Amire80, Aklapper, Ladsgroup, QZanden, MuhammadShuaib, Izno, LNDDYL, Psychoslave, Wikidata-bugs, aude, Gryllida, Shizhao, Arrbee, Mbch331, Jay8g___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Updated] T142104: Decide on a nice logo for Echo notifications

2017-04-21 Thread Ladsgroup
Ladsgroup added a project: Wikidata-Sprint.
TASK DETAILhttps://phabricator.wikimedia.org/T142104EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: LadsgroupCc: Ladsgroup, Izno, thiemowmde, Jan_Dittrich, Charlie_WMDE, Pginer-WMF, Aklapper, Lydia_Pintscher, matej_suchanek, Quiddity, Trizek-WMF, QZanden, SamanthaNguyen, JGirault, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T142104: Decide on a nice logo for Echo notifications

2017-04-21 Thread Ladsgroup
Ladsgroup added a comment.
I made two patches for this:


https://gerrit.wikimedia.org/r/349412 Add echoIcon.png to client assets
https://gerrit.wikimedia.org/r/349411 Change client setting 'repoIcon' to 'echoIcon'


Once we are done with these. We can proceed to enabling it in test wikis.TASK DETAILhttps://phabricator.wikimedia.org/T142104EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: LadsgroupCc: Ladsgroup, Izno, thiemowmde, Jan_Dittrich, Charlie_WMDE, Pginer-WMF, Aklapper, Lydia_Pintscher, matej_suchanek, Quiddity, Trizek-WMF, QZanden, SamanthaNguyen, JGirault, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Edited] T163544: Wikibase\TermSqlIndex::getMatchingTerms , Wikibase\TermSqlIndex::fetchTerms have bad performance after codfw failover

2017-04-21 Thread jcrespo
jcrespo edited the task description. (Show Details)
EDIT DETAILSthese 2 queries were among the most expensive on datacenter failover or after it- while it is normal to have lower performance than usual due to colder caches, most likely they are surfacing existing issues with improvements, which could be made better even under normal circunstances. It would be nice to have some mitigation in place before the failback happens on the 3 May to avoid the issues mentioned on the parent ticket- even if it is as silly as reducing query batches or job rates:...TASK DETAILhttps://phabricator.wikimedia.org/T163544EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: jcrespoCc: hoo, Aklapper, Marostegui, jcrespo, QZanden, Izno, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Created] T163544: Wikibase\TermSqlIndex::getMatchingTerms , Wikibase\TermSqlIndex::fetchTerms have bad performance after codfw failover

2017-04-21 Thread jcrespo
jcrespo created this task.jcrespo added a project: Wikidata.
TASK DESCRIPTIONthese 2 queries were among the most expensive on datacenter failover or after it- while it is normal to have lower performance than usual due to colder caches, most likely they are surfacing issues with improvements. It would be nice to have some mitigation in place before the failback happens on the 3 May to avoid the issues mentioned on the parent ticket- even if it is as silly as reducing query batches:

https://logstash.wikimedia.org/goto/a94c6c3ffe941fc83616d18adfc372f8

17830	52	7	134,376	db2038, db2045, db2052, db2059, db2066	wikiuser	wikidatawiki
SELECT /* Wikibase\TermSqlIndex::fetchTerms */ term_entity_type, term_type, term_language, term_text, term_entity_id FROM `wb_terms` WHERE term_entity_type = 'item' AND term_entity_id IN ('5682', '11573', '2807', '46857', '119', '96', '34726', '1028', '513', '48278', '235', '8851', '649', '14', '9077', '8027', '38076', '345', '2831', '9933') AND term_language = 'es' AND term_type = 'description' /* 031a7f86378ef40d4240a44ad46a3cbf db2059 wikidatawiki 11s */

253	325	102	25,836	db2038, db2045, db2052, db2059, db2066	wikiuser	wikidatawiki
SELECT /* Wikibase\TermSqlIndex::getMatchingTerms */ term_entity_type, term_type, term_language, term_text, term_entity_id, term_weight FROM `wb_terms` WHERE ((term_language = 'en' AND (term_search_key LIKE 'aut%' ) AND term_type = 'label' AND term_entity_type = 'item') OR (term_language = 'en' AND (term_search_key LIKE 'aut%' ) AND term_type = 'alias' AND term_entity_type = 'item')) LIMIT 5000 /* c4de2b8173b064fb59493feca2567115 db2052 wikidatawiki 7s */TASK DETAILhttps://phabricator.wikimedia.org/T163544EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: jcrespoCc: hoo, Aklapper, Marostegui, jcrespo, QZanden, Izno, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Closed] T162870: Show supported data formats in Special:EntityData

2017-04-21 Thread Ladsgroup
Ladsgroup closed this task as "Resolved".Ladsgroup triaged this task as "Low" priority.
TASK DETAILhttps://phabricator.wikimedia.org/T162870EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: LadsgroupCc: gerritbot, Ladsgroup, abian, Aklapper, QZanden, Izno, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T162870: Show supported data formats in Special:EntityData

2017-04-21 Thread gerritbot
gerritbot added a comment.
Change 349397 merged by jenkins-bot:
[mediawiki/extensions/Wikibase@master] Change Assert type from regex to simple when there is no need

https://gerrit.wikimedia.org/r/349397TASK DETAILhttps://phabricator.wikimedia.org/T162870EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Ladsgroup, gerritbotCc: gerritbot, Ladsgroup, abian, Aklapper, QZanden, Izno, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Created] T163538: [Task] Investigate LabelDescriptionLookup usage and possible refactoring

2017-04-21 Thread thiemowmde
thiemowmde created this task.thiemowmde added projects: Wikidata, Wikibase-DataModel-Services, MediaWiki-extensions-WikibaseRepository, MediaWiki-extensions-WikibaseClient.Herald added a subscriber: Aklapper.
TASK DESCRIPTIONWith the #mediawiki-extensions-wikibasemediainfo and #lexicographical_data extensions we are going to introduce new term types that are not labels, descriptions and aliases. We already phased out all places in our code base that assumed all entity types do have labels, descriptions, and aliases, or made them flexible by type checking against the LabelsProvider, DescriptionsProvider, and AliasesProvider interfaces first.

We figured that the LabelDescriptionLookup interface is one of the central remaining elements still assuming all entity types (might) have these term types. We may rethink this interface and its usages.

Things we already know (from discussions within the team, mostly with @daniel):


We should not phase out the LabelDescriptionLookup interface, and not split it into two independent ones. These two elements belong together, e.g. when rendering search results or links where the description is used as a tooltip to disambiguate Items that have the same label.
It might help to introduce a LabelLookup interface for all use cases that do not need the description.
We might rethink what "label" and "description" mean. Currently, these are the names of two fields on the Item and Property entity types, and we decided to not have identical fields on the other entity types. But what if we auto-generate labels and descriptions for Lexeme and MediaInfo entities, auto-generated from other terms? @daniel named this concept "display label" and "display description" for now. If we go this route and start to distinguish these two meanings, we might need to rename some of the existing providers and lookups into DisplayLabelLookup and so on.


So this is a research and discussion ticket, as well as a place to bikeshed about how to name things. ;-)

#patch-for-review:


 https://github.com/wmde/WikibaseDataModelServices/pull/176
TASK DETAILhttps://phabricator.wikimedia.org/T163538EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: thiemowmdeCc: Jakob_WMDE, WMDE-leszek, Jonas, Aleksey_WMDE, hoo, aude, Lydia_Pintscher, thiemowmde, Aklapper, daniel, QZanden, Izno, Wikidata-bugs, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T151334: [RfC] geoshape datatype and data namespace on Commons

2017-04-21 Thread Lydia_Pintscher
Lydia_Pintscher added a comment.
Geoshape properties can be added from Monday on.TASK DETAILhttps://phabricator.wikimedia.org/T151334EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Lydia_PintscherCc: Yurik, aude, Micru, Rschen7754, daniel, Esc3300, Mbch331, Pasleim, Fralambert, Yair_rand, Aklapper, Lydia_Pintscher, QZanden, Izno, Luke081515, Wikidata-bugs, fbstj___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T159709: Security review for WikibaseMediaInfo extension

2017-04-21 Thread Lydia_Pintscher
Lydia_Pintscher added a comment.
Thanks a lot for the review!TASK DETAILhttps://phabricator.wikimedia.org/T159709EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Bawolff, Lydia_PintscherCc: Bawolff, dpatrick, Ricordisamoa, Aklapper, Lydia_Pintscher, QZanden, Acer, Izno, Luke081515, Wikidata-bugs, Base, matthiasmullie, aude, Deskana, JanZerebecki, Fabrice_Florin, csteipp, Mbch331, Jay8g, Legoktm, Tgr___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T162870: Show supported data formats in Special:EntityData

2017-04-21 Thread gerritbot
gerritbot added a comment.
Change 348110 merged by jenkins-bot:
[mediawiki/extensions/Wikibase@master] Show supported data formats in Special:EntityData

https://gerrit.wikimedia.org/r/348110TASK DETAILhttps://phabricator.wikimedia.org/T162870EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Ladsgroup, gerritbotCc: gerritbot, Ladsgroup, abian, Aklapper, QZanden, Izno, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs


[Wikidata-bugs] [Maniphest] [Commented On] T157004: Edit summary should include the label of foreign entities

2017-04-21 Thread gerritbot
gerritbot added a comment.
Change 339654 merged by WMDE-leszek:
[mediawiki/extensions/Wikibase@master] Refactor foreign EntityId parsing in LinkBeginHookHandler

https://gerrit.wikimedia.org/r/339654TASK DETAILhttps://phabricator.wikimedia.org/T157004EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: WMDE-leszek, gerritbotCc: thiemowmde, gerritbot, daniel, Aklapper, Lydia_Pintscher, WMDE-leszek, Adik2382, Th3d3v1ls, Ramalepe, Liugev6, QZanden, Lewizho99, Maathavan, Izno, Wikidata-bugs, aude, Mbch331___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs