hoo added a comment. Restricted Application added a project: wdwb-tech-focus.
Currently the procedure for updating the table involves a hand-written script, which does data clean up (deletes LOTS of rows) in the database table after the dataset is inserted (which is probably what was causing these issues). See PropertySuggester_update <https://wikitech.wikimedia.org/wiki/WMDE/Wikidata/PropertySuggester_update>. I spent a bit of time today on this and re-wrote this as a small python <https://github.com/mariushoch/wbs_propertypairs-refine> script which can be applied on the dataset before it is inserted into the table (thus no more deletes), effectively solving the issues at hand. For the next update, I will use that and we can closely monitor the logs in order to conclusively close this. TASK DETAIL https://phabricator.wikimedia.org/T272571 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: hoo Cc: Marostegui, hoo, Aklapper, jcrespo, Akuckartz, darthmon_wmde, Nandana, Lahi, Gq86, Pablo-WMDE, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, Verdy_p, Wikidata-bugs, aude, Sjoerddebruin, Jdforrester-WMF, Addshore, Mbch331, Rxy, Jay8g
_______________________________________________ Wikidata-bugs mailing list Wikidata-bugs@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/wikidata-bugs
