[Wikidata-bugs] [Maniphest] [Commented On] T158430: [Spike] Use suggested properties to get signal for completeness
Halfak added a comment. https://github.com/wikimedia/articlequality/blob/master/articlequality/feature_lists/wikidatawiki.pyTASK DETAILhttps://phabricator.wikimedia.org/T158430EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: HalfakCc: hoo, PokestarFan, daniel, Sjoerddebruin, Ladsgroup, Glorian_Yapinus, Sumit, Ricordisamoa, Aklapper, StudiesWorld, Lydia_Pintscher, samuwmde, Glorian_WD, Halfak, Nandana, Lahi, Gq86, Vacio, Capankajsmilyo, GoranSMilovanovic, Fz-29, QZanden, LawExplorer, D3r1ck01, notconfusing, Wikidata-bugs, aude, Alchimista, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T158430: [Spike] Use suggested properties to get signal for completeness
Halfak added a comment. I just implemented https://github.com/wikimedia/revscoring/pull/414 which will give us a datasource on top of which to build the feature @hoo has been working on.TASK DETAILhttps://phabricator.wikimedia.org/T158430EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: HalfakCc: hoo, PokestarFan, daniel, Sjoerddebruin, Ladsgroup, Glorian_Yapinus, Sumit, Ricordisamoa, Aklapper, StudiesWorld, Lydia_Pintscher, samuwmde, Glorian_WD, Halfak, Nandana, Lahi, Gq86, Vacio, Capankajsmilyo, GoranSMilovanovic, Fz-29, QZanden, LawExplorer, notconfusing, Wikidata-bugs, aude, Alchimista, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T158430: [Spike] Use suggested properties to get signal for completeness
hoo added a comment. I have first shot at this up at https://github.com/mariushoch/revscoring/blob/bug/T158430/T158430.py, but this doesn't yet fully work as the required API change will only be deployed tomorrow.TASK DETAILhttps://phabricator.wikimedia.org/T158430EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hooCc: hoo, PokestarFan, daniel, Sjoerddebruin, Ladsgroup, Glorian_Yapinus, Sumit, Ricordisamoa, Aklapper, StudiesWorld, Lydia_Pintscher, samuwmde, Glorian_WD, Halfak, Nandana, Lahi, Gq86, Vacio, Capankajsmilyo, GoranSMilovanovic, Fz-29, QZanden, LawExplorer, notconfusing, Wikidata-bugs, aude, Alchimista, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T158430: [Spike] Use suggested properties to get signal for completeness
hoo added a comment. (1) Run the set of scripts for generating propertypairs against a database dump. Whenever we (mostly I) run the script for Wikidata we put the results up at https://github.com/wmde/wbs_propertypairs. The last version there is not very recent, so I just started the script for generating a new version (which should be there by Friday).TASK DETAILhttps://phabricator.wikimedia.org/T158430EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: hooCc: hoo, PokestarFan, daniel, Sjoerddebruin, Ladsgroup, Glorian_Yapinus, Sumit, Ricordisamoa, Aklapper, StudiesWorld, Lydia_Pintscher, samuwmde, Glorian_WD, Halfak, Lahi, Gq86, Vacio, Capankajsmilyo, GoranSMilovanovic, Fz-29, QZanden, LawExplorer, notconfusing, Wikidata-bugs, aude, Alchimista, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T158430: [Spike] Use suggested properties to get signal for completeness
Halfak added a comment. @daniel, exactly! I'm not sure if we're understanding each other. I thought my equation would have made things 100% clear. Could you please review the equations in T164994: Enable wbgetsuggestions API to get recommended properties even if they have existed in an item and then respond again?TASK DETAILhttps://phabricator.wikimedia.org/T158430EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Glorian_WD, HalfakCc: daniel, Sjoerddebruin, Ladsgroup, Glorian_Yapinus, Sumit, Ricordisamoa, Aklapper, StudiesWorld, Lydia_Pintscher, samuwmde, Glorian_WD, Halfak, bkowshik, GoranSMilovanovic, QZanden, Avner, Izno, Wikidata-bugs, aude, He7d3r, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T158430: [Spike] Use suggested properties to get signal for completeness
daniel added a comment. In T158430#3352093, @Halfak wrote: If there are few high probability suggestions for an item, we should not punish the score. Why not? I thought that was exactly the point? We can't assess incompleteness without assessing completeness and vise versa. To me, these two are simply inverse of each other...TASK DETAILhttps://phabricator.wikimedia.org/T158430EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Glorian_WD, danielCc: daniel, Sjoerddebruin, Ladsgroup, Glorian_Yapinus, Sumit, Ricordisamoa, Aklapper, StudiesWorld, Lydia_Pintscher, samuwmde, Glorian_WD, Halfak, bkowshik, GoranSMilovanovic, QZanden, Avner, Izno, Wikidata-bugs, aude, He7d3r, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T158430: [Spike] Use suggested properties to get signal for completeness
daniel added a comment. Suggestion: don't try to assess completeness directly, assess incompleteness. The incompleteness score could be defined as the sum (or average, or max) of scores of the suggestions given by the suggestion API. The idea here is that something is more complete if there are few things that can be suggested with high confidence.TASK DETAILhttps://phabricator.wikimedia.org/T158430EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Glorian_WD, danielCc: daniel, Sjoerddebruin, Ladsgroup, Glorian_Yapinus, Sumit, Ricordisamoa, Aklapper, StudiesWorld, Lydia_Pintscher, samuwmde, Glorian_WD, Halfak, bkowshik, GoranSMilovanovic, QZanden, Avner, Izno, Wikidata-bugs, aude, He7d3r, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T158430: [Spike] Use suggested properties to get signal for completeness
Glorian_WD added a comment. For the time being, we've decided to move forward using the existing wbs_propertypair in order to get the signal. I have created a ticket for this: https://phabricator.wikimedia.org/T164994. Moreover, there's already a patch which associated with the mentioned ticket, that is, https://gerrit.wikimedia.org/r/#/c/356043/7.TASK DETAILhttps://phabricator.wikimedia.org/T158430EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Glorian_WDCc: Sjoerddebruin, Ladsgroup, Glorian_Yapinus, Sumit, Ricordisamoa, Aklapper, StudiesWorld, Lydia_Pintscher, samuwmde, Glorian_WD, Halfak, GoranSMilovanovic, QZanden, Avner, Izno, Wikidata-bugs, aude, He7d3r, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T158430: [Spike] Use suggested properties to get signal for completeness
Halfak added a comment. Discussion posted here: https://www.wikidata.org/wiki/User_talk:Glorian_WD/Clustering_Result_v2 TL;DR: this doesn't look like it is going to be fruitful in the short term, so let's move forward using wbs_propertypairTASK DETAILhttps://phabricator.wikimedia.org/T158430EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: HalfakCc: Sjoerddebruin, Ladsgroup, Glorian_Yapinus, Sumit, Ricordisamoa, Aklapper, StudiesWorld, Lydia_Pintscher, samuwmde, Glorian_WD, Halfak, QZanden, Avner, Izno, Wikidata-bugs, aude, He7d3r, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
[Wikidata-bugs] [Maniphest] [Commented On] T158430: [Spike] Use suggested properties to get signal for completeness
Glorian_WD added a comment. @Halfak : The last state of the clustering work is documented on https://www.wikidata.org/wiki/User:Glorian_WD/Clustering_Result_v2.TASK DETAILhttps://phabricator.wikimedia.org/T158430EMAIL PREFERENCEShttps://phabricator.wikimedia.org/settings/panel/emailpreferences/To: Glorian_WDCc: Sjoerddebruin, Ladsgroup, Glorian_Yapinus, Sumit, Ricordisamoa, Aklapper, StudiesWorld, Lydia_Pintscher, samuwmde, Glorian_WD, Halfak, Avner, JJMC89, D3r1ck01, Izno, Wikidata-bugs, aude, He7d3r, Mbch331___ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
