[Wikidata-bugs] [Maniphest] [Commented On] T163475: Populate the page_props table on Wikidata with wb-identifiers
daniel added a comment. Makes sense, and should be fine. However, purging all these pages is quite expensive. We could calculate the number and write it to page_props directly. That's a little bit hackish, but a lot faster, and not too horrible. It does needs more code to be written, but that shouldn't take more than a day or two. Worth it? I don't know.TASK DETAILhttps://phabricator.wikimedia.org/T163475EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: danielCc: daniel, Lydia_Pintscher, Ladsgroup, Aklapper, Multichill, QZanden, Izno, Wikidata-bugs, aude, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T163475: Populate the page_props table on Wikidata with wb-identifiers
Multichill added a comment. In T163475#3208210, @daniel wrote: Makes sense, and should be fine. However, purging all these pages is quite expensive. We could calculate the number and write it to page_props directly. That's a little bit hackish, but a lot faster, and not too horrible. It does needs more code to be written, but that shouldn't take more than a day or two. Worth it? I don't know. Is it worth the effort? Anyone available to actually do this? Sounds nice, but if it means waiting for many months because this has no priority, I rather just run a purge bot.TASK DETAILhttps://phabricator.wikimedia.org/T163475EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: MultichillCc: daniel, Lydia_Pintscher, Ladsgroup, Aklapper, Multichill, QZanden, Izno, Wikidata-bugs, aude, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T163475: Populate the page_props table on Wikidata with wb-identifiers
Lydia_Pintscher added a comment. Yeah in that case let's just run the bot.TASK DETAILhttps://phabricator.wikimedia.org/T163475EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Lydia_PintscherCc: daniel, Lydia_Pintscher, Ladsgroup, Aklapper, Multichill, QZanden, Izno, Wikidata-bugs, aude, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T163475: Populate the page_props table on Wikidata with wb-identifiers
Lydia_Pintscher added a comment. @Multichill You can go ahead with the bot run. The feature is deployed.TASK DETAILhttps://phabricator.wikimedia.org/T163475EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Lydia_PintscherCc: daniel, Lydia_Pintscher, Ladsgroup, Aklapper, Multichill, QZanden, Izno, Wikidata-bugs, aude, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T163475: Populate the page_props table on Wikidata with wb-identifiers
Ladsgroup added a comment. Given codfw database being under pressure right now, I suggest starting the process tomorrow. Especially if it's going to be intense purging. If the speed is low or you are not doing it in peak time, I'd say go ahead.TASK DETAILhttps://phabricator.wikimedia.org/T163475EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: LadsgroupCc: daniel, Lydia_Pintscher, Ladsgroup, Aklapper, Multichill, QZanden, Izno, Wikidata-bugs, aude, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T163475: Populate the page_props table on Wikidata with wb-identifiers
Multichill added a comment. I haven't done anything yet, but quite a few pages already have the page_prop: MariaDB [wikidatawiki_p]> SELECT COUNT(*) FROM page_props WHERE pp_propname='wb-identifiers' LIMIT 1; +--+ COUNT(*) +--+ 673659 +--+ 1 row in set (0.66 sec) Some heavy job running that is updating a lot of pages? I'll take it easy with the run.TASK DETAILhttps://phabricator.wikimedia.org/T163475EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: MultichillCc: daniel, Lydia_Pintscher, Ladsgroup, Aklapper, Multichill, QZanden, Izno, Wikidata-bugs, aude, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T163475: Populate the page_props table on Wikidata with wb-identifiers
Multichill added a comment. Running https://github.com/multichill/toollabs/blob/master/bot/wikidata/page_props_purge.py now.TASK DETAILhttps://phabricator.wikimedia.org/T163475EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: MultichillCc: daniel, Lydia_Pintscher, Ladsgroup, Aklapper, Multichill, QZanden, Izno, Wikidata-bugs, aude, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T163475: Populate the page_props table on Wikidata with wb-identifiers
Multichill added a comment. The bot is slow purging the items. We're now around the 7 million done. No load issues or any other problems detected. I could speed up, but right now it's stable and I don't want to risk any issues.TASK DETAILhttps://phabricator.wikimedia.org/T163475EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: MultichillCc: daniel, Lydia_Pintscher, Ladsgroup, Aklapper, Multichill, QZanden, Izno, Wikidata-bugs, aude, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
