[Wikidata-bugs] [Maniphest] [Commented On] T144687: Change $wgArticleCountMethod in Wikidata from default ('link') to 'any'

2016-10-03 Thread Romaine 
Romaine added a comment.

In T144687#2643669, @Lydia_Pintscher wrote:
I think the question hinges on is an item without a statement useful or not. Right now we have 2.75 Million of them of 23.8 Million items in total. That is quite a lot and we definitely need to get this number down. At the same time the number on the main page is incorrect and several times I had to correct people about it and had people complain to me about it.

So: Let's change it. Redirects should still not be counted but items without statements should be counted.


On many Wikipedia's we periodically have to update the number of items manually in the system, as it is a calculation and not an article/item count.

Maybe it does not fit here, but I would like to know also how many statements are added to Wikidata.TASK DETAILhttps://phabricator.wikimedia.org/T144687EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Urbanecm, RomaineCc: Romaine, Stashbot, Lea_Lacroix_WMDE, Esc3300, YMS, Lydia_Pintscher, hoo, Liuxinyu970226, gerritbot, Matanya, JEumerus, Pasleim, Aklapper, abian, TerraCodes, Urbanecm, D3r1ck01, MuhammadShuaib, Tulsi_Bhagat, Izno, Luke081515, biplabanand, Wikidata-bugs, Snowolf, aude, Mbch331, Jay8g, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T144687: Change $wgArticleCountMethod in Wikidata from default ('link') to 'any'

2016-09-27 Thread hoo 
hoo added a comment.

In T144687#2655095, @Urbanecm wrote:
@hoo What is an article is defined by the config, isn't it? Or at least how Wikidata count them.

But let say an article is a content page or valid item. Is it more clear?


The relevant code is in Wikibase's Item::isCountable (see Content::isCountable in MediaWiki). I think this should have been altered instead (or additionally at least).TASK DETAILhttps://phabricator.wikimedia.org/T144687EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Urbanecm, hooCc: Stashbot, Lea_Lacroix_WMDE, Esc3300, YMS, Lydia_Pintscher, hoo, Liuxinyu970226, gerritbot, Matanya, JEumerus, Pasleim, Aklapper, abian, TerraCodes, Lewizho99, Maathavan, Urbanecm, D3r1ck01, MuhammadShuaib, Tulsi_Bhagat, Izno, Luke081515, biplabanand, Wikidata-bugs, Snowolf, aude, Mbch331, Jay8g, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T144687: Change $wgArticleCountMethod in Wikidata from default ('link') to 'any'

2016-09-20 Thread Urbanecm 
Urbanecm added a comment.
@hoo What is an article is defined by the config, isn't it? Or at least how Wikidata count them.

But let say an article is a content page or valid item. Is it more clear?TASK DETAILhttps://phabricator.wikimedia.org/T144687EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: UrbanecmCc: Stashbot, Lea_Lacroix_WMDE, Esc3300, YMS, Lydia_Pintscher, hoo, Liuxinyu970226, gerritbot, Matanya, JEumerus, Pasleim, Aklapper, abian, TerraCodes, Lewizho99, Maathavan, Urbanecm, D3r1ck01, MuhammadShuaib, Tulsi_Bhagat, Izno, Luke081515, biplabanand, Wikidata-bugs, Snowolf, aude, Mbch331, Jay8g, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T144687: Change $wgArticleCountMethod in Wikidata from default ('link') to 'any'

2016-09-20 Thread Urbanecm 
Urbanecm added a comment.
If anybody see any problem, please reopen and comment this task.TASK DETAILhttps://phabricator.wikimedia.org/T144687EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: UrbanecmCc: Stashbot, Lea_Lacroix_WMDE, Esc3300, YMS, Lydia_Pintscher, hoo, Liuxinyu970226, gerritbot, Matanya, JEumerus, Pasleim, Aklapper, abian, TerraCodes, Lewizho99, Maathavan, Urbanecm, D3r1ck01, MuhammadShuaib, Tulsi_Bhagat, Izno, Luke081515, biplabanand, Wikidata-bugs, Snowolf, aude, Mbch331, Jay8g, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T144687: Change $wgArticleCountMethod in Wikidata from default ('link') to 'any'

2016-09-20 Thread Stashbot 
Stashbot added a comment.
Mentioned in SAL (#wikimedia-operations) [2016-09-20T13:05:33Z]  Synchronized wmf-config/InitialiseSettings.php: SWAT: [[gerrit:308430|Change $wgArticleCountMethod in Wikidata from default (link) to any (T144687)]] (duration: 00m 47s)TASK DETAILhttps://phabricator.wikimedia.org/T144687EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Urbanecm, StashbotCc: Stashbot, Lea_Lacroix_WMDE, Esc3300, YMS, Lydia_Pintscher, hoo, Liuxinyu970226, gerritbot, Matanya, JEumerus, Pasleim, Aklapper, abian, TerraCodes, Lewizho99, Maathavan, Urbanecm, D3r1ck01, MuhammadShuaib, Tulsi_Bhagat, Izno, Luke081515, biplabanand, Wikidata-bugs, Snowolf, aude, Mbch331, Jay8g, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T144687: Change $wgArticleCountMethod in Wikidata from default ('link') to 'any'

2016-09-20 Thread gerritbot 
gerritbot added a comment.
Change 308430 merged by jenkins-bot:
Change $wgArticleCountMethod in Wikidata from default ('link') to 'any'

https://gerrit.wikimedia.org/r/308430TASK DETAILhttps://phabricator.wikimedia.org/T144687EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Urbanecm, gerritbotCc: Lea_Lacroix_WMDE, Esc3300, YMS, Lydia_Pintscher, hoo, Liuxinyu970226, gerritbot, Matanya, JEumerus, Pasleim, Aklapper, abian, TerraCodes, Lewizho99, Maathavan, Urbanecm, D3r1ck01, MuhammadShuaib, Tulsi_Bhagat, Izno, Luke081515, biplabanand, Wikidata-bugs, Snowolf, aude, Mbch331, Jay8g, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T144687: Change $wgArticleCountMethod in Wikidata from default ('link') to 'any'

2016-09-20 Thread Urbanecm 
Urbanecm added a comment.
Will be deployed today, 13:00-14:00 UTC.TASK DETAILhttps://phabricator.wikimedia.org/T144687EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: UrbanecmCc: Esc3300, YMS, Lydia_Pintscher, hoo, Liuxinyu970226, gerritbot, Matanya, JEumerus, Pasleim, Aklapper, abian, TerraCodes, Lewizho99, Maathavan, Urbanecm, D3r1ck01, MuhammadShuaib, Tulsi_Bhagat, Izno, Luke081515, biplabanand, Wikidata-bugs, Snowolf, aude, Mbch331, Jay8g, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T144687: Change $wgArticleCountMethod in Wikidata from default ('link') to 'any'

2016-09-19 Thread Esc3300 
Esc3300 added a comment.
Properties and whatever new types of entities we will be getting should probably be included as well.

Most items without any statements do include sitelinks:  https://www.wikidata.org/wiki/Wikidata:Database_reports/without_claims_by_siteTASK DETAILhttps://phabricator.wikimedia.org/T144687EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Urbanecm, Esc3300Cc: Esc3300, YMS, Lydia_Pintscher, hoo, Liuxinyu970226, gerritbot, Matanya, JEumerus, Pasleim, Aklapper, abian, TerraCodes, Lewizho99, Maathavan, Urbanecm, D3r1ck01, MuhammadShuaib, Tulsi_Bhagat, Izno, Luke081515, biplabanand, Wikidata-bugs, Snowolf, aude, Shizhao, Mbch331, Jay8g, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T144687: Change $wgArticleCountMethod in Wikidata from default ('link') to 'any'

2016-09-19 Thread YMS 
YMS added a comment.
Wikidata items without statements usually still are containers for sitelinks and thus actively used from various Wikimedia projects. We can not call them useless. We should not ignore them and hide them, and if it's only in the count.TASK DETAILhttps://phabricator.wikimedia.org/T144687EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Urbanecm, YMSCc: YMS, Lydia_Pintscher, hoo, Liuxinyu970226, gerritbot, Matanya, JEumerus, Pasleim, Aklapper, abian, TerraCodes, Lewizho99, Maathavan, Urbanecm, D3r1ck01, MuhammadShuaib, Tulsi_Bhagat, Izno, Luke081515, biplabanand, Wikidata-bugs, Snowolf, aude, Shizhao, Mbch331, Jay8g, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T144687: Change $wgArticleCountMethod in Wikidata from default ('link') to 'any'

2016-09-16 Thread Lydia_Pintscher 
Lydia_Pintscher added a comment.
I think the question hinges on is an item without a statement useful or not. Right now we have 2.75 Million of them of 23.8 Million items in total. That is quite a lot and we definitely need to get this number down. At the same time the number on the main page is incorrect and several times I had to correct people about it and had people complain to me about it.

So: Let's change it. Redirects should still not be counted but items without statements should be counted.TASK DETAILhttps://phabricator.wikimedia.org/T144687EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Urbanecm, Lydia_PintscherCc: Lydia_Pintscher, hoo, Liuxinyu970226, gerritbot, Matanya, JEumerus, Pasleim, Aklapper, abian, TerraCodes, Lewizho99, Maathavan, Urbanecm, D3r1ck01, MuhammadShuaib, Tulsi_Bhagat, Izno, Luke081515, biplabanand, Wikidata-bugs, Snowolf, aude, Shizhao, Mbch331, Jay8g, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T144687: Change $wgArticleCountMethod in Wikidata from default ('link') to 'any'

2016-09-05 Thread hoo 
hoo added a comment.
We are using ItemContent::isStub right now which basically checks that the item is not a redirect and has at least one statement (the Item::isEmpty check on line 238 is redundant with the Item::getStatements()->isEmpty() call).TASK DETAILhttps://phabricator.wikimedia.org/T144687EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Urbanecm, hooCc: Lydia_Pintscher, hoo, Liuxinyu970226, gerritbot, Matanya, JEumerus, Pasleim, Aklapper, abian, TerraCodes, Lewizho99, Maathavan, Urbanecm, D3r1ck01, Tulsi_Bhagat, Izno, Luke081515, biplabanand, Wikidata-bugs, Snowolf, aude, Shizhao, Mbch331, Jay8g, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T144687: Change $wgArticleCountMethod in Wikidata from default ('link') to 'any'

2016-09-05 Thread Pasleim 
Pasleim added a comment.

In T144687#2608519, @hoo wrote:
Currently we consider an Item a "valid" (countable) article if it has either at least one statement or at least one sitelink (as far as I remember).


I doubt it's implemented like that. Both the number of items with at least one statement (20,964,244) and the number items with at least one sitelink (20,338,226) are higher than the current returned value by the parser function (20,023,628). Hence, even some items with a claim or sitelink are not considered as valid articles.

Values taken from db replica:

select count(*) from page_props where pp_propname='wb-claims' and pp_value>0;
select count(*) from page_props where pp_propname='wb-sitelinks' and pp_value>0;TASK DETAILhttps://phabricator.wikimedia.org/T144687EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Urbanecm, PasleimCc: Lydia_Pintscher, hoo, Liuxinyu970226, gerritbot, Matanya, JEumerus, Pasleim, Aklapper, abian, TerraCodes, Lewizho99, Maathavan, Urbanecm, D3r1ck01, Tulsi_Bhagat, Izno, Luke081515, biplabanand, Wikidata-bugs, Snowolf, aude, Shizhao, Mbch331, Jay8g, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T144687: Change $wgArticleCountMethod in Wikidata from default ('link') to 'any'

2016-09-05 Thread Urbanecm 
Urbanecm added a comment.
I've descheduled this change. Please gather more consensus.TASK DETAILhttps://phabricator.wikimedia.org/T144687EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: UrbanecmCc: Lydia_Pintscher, hoo, Liuxinyu970226, gerritbot, Matanya, JEumerus, Pasleim, Aklapper, abian, TerraCodes, Lewizho99, Maathavan, Urbanecm, D3r1ck01, Tulsi_Bhagat, Izno, Luke081515, biplabanand, Wikidata-bugs, Snowolf, aude, Mbch331, Jay8g, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T144687: Change $wgArticleCountMethod in Wikidata from default ('link') to 'any'

2016-09-05 Thread Urbanecm 
Urbanecm added a comment.
@hoo Why empty items shouldn't be counted as items? Is there any reason for it?TASK DETAILhttps://phabricator.wikimedia.org/T144687EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: UrbanecmCc: Lydia_Pintscher, hoo, Liuxinyu970226, gerritbot, Matanya, JEumerus, Pasleim, Aklapper, abian, TerraCodes, Lewizho99, Maathavan, Urbanecm, D3r1ck01, Tulsi_Bhagat, Izno, Luke081515, biplabanand, Wikidata-bugs, Snowolf, aude, Mbch331, Jay8g, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T144687: Change $wgArticleCountMethod in Wikidata from default ('link') to 'any'

2016-09-05 Thread hoo 
hoo added a comment.

In T144687#2608517, @abian wrote:
Thanks. Does that mean that $wgArticleCountMethod isn't working in Wikidata as a usual 'link'? Which are those current measurement methods?


Not sure whether it will work, or whether we fully override the behavior. Currently we consider an Item a "valid" (countable) article if it has either at least one statement or at least one sitelink (as far as I remember).TASK DETAILhttps://phabricator.wikimedia.org/T144687EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Urbanecm, hooCc: Lydia_Pintscher, hoo, Liuxinyu970226, gerritbot, Matanya, JEumerus, Pasleim, Aklapper, abian, TerraCodes, Lewizho99, Maathavan, Urbanecm, D3r1ck01, Tulsi_Bhagat, Izno, Luke081515, biplabanand, Wikidata-bugs, Snowolf, aude, Mbch331, Jay8g, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T144687: Change $wgArticleCountMethod in Wikidata from default ('link') to 'any'

2016-09-05 Thread abian 
abian added a comment.
Thanks. Does that mean that $wgArticleCountMethod isn't working in Wikidata as a usual 'link'? Which are those current measurement methods?TASK DETAILhttps://phabricator.wikimedia.org/T144687EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Urbanecm, abianCc: Lydia_Pintscher, hoo, Liuxinyu970226, gerritbot, Matanya, JEumerus, Pasleim, Aklapper, abian, TerraCodes, Lewizho99, Maathavan, Urbanecm, D3r1ck01, Tulsi_Bhagat, Izno, Luke081515, biplabanand, Wikidata-bugs, Snowolf, aude, Mbch331, Jay8g, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T144687: Change $wgArticleCountMethod in Wikidata from default ('link') to 'any'

2016-09-05 Thread hoo 
hoo added a comment.
(Cross-posted from gerrit) Wikibase on purpose counts articles differently than normal MediaWiki. Changing this should only be done after a thorough discussion, I think… this should probably also be changed in Wikibase in case the community no longer agrees to the measurement methods once put in place.TASK DETAILhttps://phabricator.wikimedia.org/T144687EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Urbanecm, hooCc: hoo, Liuxinyu970226, gerritbot, Matanya, JEumerus, Pasleim, Aklapper, abian, TerraCodes, Lewizho99, Maathavan, Urbanecm, D3r1ck01, Tulsi_Bhagat, Izno, Luke081515, biplabanand, Wikidata-bugs, Snowolf, aude, Mbch331, Jay8g, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T144687: Change $wgArticleCountMethod in Wikidata from default ('link') to 'any'

2016-09-04 Thread Urbanecm 
Urbanecm added a comment.
Should be deployed during Morning SWAT window (September 5th, 18:00-19:00 UTC).TASK DETAILhttps://phabricator.wikimedia.org/T144687EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: UrbanecmCc: gerritbot, Matanya, JEumerus, Pasleim, Aklapper, abian, TerraCodes, Lewizho99, Maathavan, Urbanecm, D3r1ck01, Tulsi_Bhagat, Izno, Luke081515, biplabanand, Wikidata-bugs, Snowolf, aude, Mbch331, Jay8g, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs

[Wikidata-bugs] [Maniphest] [Commented On] T144687: Change $wgArticleCountMethod in Wikidata from default ('link') to 'any'

2016-09-04 Thread gerritbot 
gerritbot added a comment.
Change 308430 had a related patch set uploaded (by Urbanecm):
Change $wgArticleCountMethod in Wikidata from default ('link') to 'any'

https://gerrit.wikimedia.org/r/308430TASK DETAILhttps://phabricator.wikimedia.org/T144687EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Urbanecm, gerritbotCc: gerritbot, Matanya, JEumerus, Pasleim, Aklapper, abian, TerraCodes, Urbanecm, D3r1ck01, Tulsi_Bhagat, Izno, Luke081515, biplabanand, Wikidata-bugs, Snowolf, aude, Mbch331, Jay8g, Krenair___
Wikidata-bugs mailing list
Wikidata-bugs@lists.wikimedia.org
https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs