[Wikidata-bugs] [Maniphest] T325942: Christmas 2022 wbs_propertypairs table update on Wikidata

[Arian_Bozorg]

Arian_Bozorg added a comment.


  Hi @Multichill, just wanted to see what you were referring to in the link?

TASK DETAIL
  https://phabricator.wikimedia.org/T325942

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Lucas_Werkmeister_WMDE, Arian_Bozorg
Cc: Arian_Bozorg, Lucas_Werkmeister_WMDE, karapayneWMDE, BrokenSegue, Aklapper, 
Lydia_Pintscher, hoo, Multichill, Astuthiodit_1, Invadibot, maantietaja, 
ItamarWMDE, Akuckartz, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, 
LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, 
Sjoerddebruin, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T325942: Christmas 2022 wbs_propertypairs table update on Wikidata

[Multichill]

Multichill added a comment.


  Thanks for the update, see also 
https://www.wikidata.org/w/index.php?title=Wikidata%3AWikiProject_sum_of_all_paintings%2FMost_used_painting_properties=1821925473=1658545667

TASK DETAIL
  https://phabricator.wikimedia.org/T325942

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Lucas_Werkmeister_WMDE, Multichill
Cc: Arian_Bozorg, Lucas_Werkmeister_WMDE, karapayneWMDE, BrokenSegue, Aklapper, 
Lydia_Pintscher, hoo, Multichill, Astuthiodit_1, Invadibot, maantietaja, 
ItamarWMDE, Akuckartz, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, 
LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, 
Sjoerddebruin, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T325942: Christmas 2022 wbs_propertypairs table update on Wikidata

[Arian_Bozorg]

Arian_Bozorg moved this task from Product Verification to Our work done on the 
Wikidata Dev Team (Sprint-∞) board.
Arian_Bozorg closed this task as "Resolved".
Arian_Bozorg added a comment.


  Excellent! Thank you Lucas :)

TASK DETAIL
  https://phabricator.wikimedia.org/T325942

WORKBOARD
  https://phabricator.wikimedia.org/project/board/6017/

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Lucas_Werkmeister_WMDE, Arian_Bozorg
Cc: Arian_Bozorg, Lucas_Werkmeister_WMDE, karapayneWMDE, BrokenSegue, Aklapper, 
Lydia_Pintscher, hoo, Multichill, Astuthiodit_1, Invadibot, maantietaja, 
ItamarWMDE, Akuckartz, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, 
LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, 
Sjoerddebruin, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T325942: Christmas 2022 wbs_propertypairs table update on Wikidata

[Lucas_Werkmeister_WMDE]

Lucas_Werkmeister_WMDE moved this task from Doing to Product Verification on 
the Wikidata Dev Team (Sprint-∞) board.
Lucas_Werkmeister_WMDE added a comment.


lucaswerkmeister-wmde@mwmaint1002:~$ time mwscript 
extensions/PropertySuggester/maintenance/UpdateTable.php --wiki wikidatawiki 
--file wbs_propertypairs.csv # T325942


***
NOTE: Do not run maintenance scripts directly, use maintenance/run.php 
instead!
  Running scripts directly has been deprecated in MediaWiki 1.40.
  It may not work for some (or any) scripts in the future.

***

Removing old entries
Deleting a batch
Deleting a batch
…
Deleting a batch
loading new entries from file
1 rows inserted
2 rows inserted
…
380 rows inserted
381 rows inserted
3813496 rows inserted
... Done loading

real7m55.581s
user0m40.128s
sys 0m2.425s

TASK DETAIL
  https://phabricator.wikimedia.org/T325942

WORKBOARD
  https://phabricator.wikimedia.org/project/board/6017/

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Lucas_Werkmeister_WMDE
Cc: Lucas_Werkmeister_WMDE, karapayneWMDE, BrokenSegue, Aklapper, 
Lydia_Pintscher, hoo, Multichill, Astuthiodit_1, Invadibot, maantietaja, 
ItamarWMDE, Akuckartz, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, 
LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, 
Sjoerddebruin, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T325942: Christmas 2022 wbs_propertypairs table update on Wikidata

[Stashbot]

Stashbot added a comment.


  Mentioned in SAL (#wikimedia-operations) [2023-01-25T11:34:45Z]  
Updated the Wikidata property suggester with data from 20230102's JSON dump 
(T325942 )

TASK DETAIL
  https://phabricator.wikimedia.org/T325942

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Lucas_Werkmeister_WMDE, Stashbot
Cc: Lucas_Werkmeister_WMDE, karapayneWMDE, BrokenSegue, Aklapper, 
Lydia_Pintscher, hoo, Multichill, Astuthiodit_1, Invadibot, maantietaja, 
ItamarWMDE, Akuckartz, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, 
LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, 
Sjoerddebruin, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T325942: Christmas 2022 wbs_propertypairs table update on Wikidata

[Lucas_Werkmeister_WMDE]

Lucas_Werkmeister_WMDE added a comment.


  Pulled to mwmaint:
  
lucaswerkmeister-wmde@mwmaint1002:~$ time 
https_proxy=http://webproxy.eqiad.wmnet:8080 curl -sL 
https://github.com/wmde/wbs_propertypairs/raw/master/20230102/wbs_propertypairs.csv.gz
 | gzip -d > wbs_propertypairs.csv

real0m1.284s
user0m0.850s
sys 0m0.107s
lucaswerkmeister-wmde@mwmaint1002:~$ wc -l wbs_propertypairs.csv
3813497 wbs_propertypairs.csv

TASK DETAIL
  https://phabricator.wikimedia.org/T325942

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Lucas_Werkmeister_WMDE
Cc: Lucas_Werkmeister_WMDE, karapayneWMDE, BrokenSegue, Aklapper, 
Lydia_Pintscher, hoo, Multichill, Astuthiodit_1, Invadibot, maantietaja, 
ItamarWMDE, Akuckartz, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, 
LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, 
Sjoerddebruin, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T325942: Christmas 2022 wbs_propertypairs table update on Wikidata

[Lucas_Werkmeister_WMDE]

Lucas_Werkmeister_WMDE added a comment.


  wbs_propertypairs updated (commit 
):
  
luwe@C380 ~/git/wbs_propertypairs (master|u=) $ mkdir 20230102 && time curl 
-sL 
https://analytics.wikimedia.org/published/datasets/wmde-analytics-engineering/Wikidata/wbs_propertypairs/20230102/analyzed-out.gz
 | gzip -d | python ../wbs_propertypairs-refine/refine.py /dev/stdin 
/dev/stdout | gzip > 20230102/wbs_propertypairs.csv.gz

real1m39,099s
user0m15,550s
sys 0m0,731s
luwe@C380 ~/git/wbs_propertypairs (master|u=) $ git add 
20230102/wbs_propertypairs.csv.gz && git commit -m 'Add propertypairs from the 
20230102 dump' -m 'Bug: T325942'
[master 13b4e8e572] Add propertypairs from the 20230102 dump
 1 file changed, 0 insertions(+), 0 deletions(-)
 create mode 100644 20230102/wbs_propertypairs.csv.gz

TASK DETAIL
  https://phabricator.wikimedia.org/T325942

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Lucas_Werkmeister_WMDE
Cc: Lucas_Werkmeister_WMDE, karapayneWMDE, BrokenSegue, Aklapper, 
Lydia_Pintscher, hoo, Multichill, Astuthiodit_1, Invadibot, maantietaja, 
ItamarWMDE, Akuckartz, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, 
LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, 
Sjoerddebruin, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T325942: Christmas 2022 wbs_propertypairs table update on Wikidata

[Lucas_Werkmeister_WMDE]

Lucas_Werkmeister_WMDE moved this task from Todo/Backlog to Doing on the 
Wikidata Dev Team (Sprint-∞) board.
Lucas_Werkmeister_WMDE claimed this task.

TASK DETAIL
  https://phabricator.wikimedia.org/T325942

WORKBOARD
  https://phabricator.wikimedia.org/project/board/6017/

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Lucas_Werkmeister_WMDE
Cc: Lucas_Werkmeister_WMDE, karapayneWMDE, BrokenSegue, Aklapper, 
Lydia_Pintscher, hoo, Multichill, Astuthiodit_1, Invadibot, maantietaja, 
ItamarWMDE, Akuckartz, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, 
LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, 
Sjoerddebruin, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T325942: Christmas 2022 wbs_propertypairs table update on Wikidata

[Lucas_Werkmeister_WMDE]

Lucas_Werkmeister_WMDE moved this task from Parents/Waiting to Todo/Backlog on 
the Wikidata Dev Team (Sprint-∞) board.
Lucas_Werkmeister_WMDE added a comment.


  Task breakdown notes: We need to follow the steps under PropertySuggester 
update § Each update 
 
(the latest data is from 20230102). Most of the steps need production shell 
access.

TASK DETAIL
  https://phabricator.wikimedia.org/T325942

WORKBOARD
  https://phabricator.wikimedia.org/project/board/6017/

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Lucas_Werkmeister_WMDE
Cc: Lucas_Werkmeister_WMDE, karapayneWMDE, BrokenSegue, Aklapper, 
Lydia_Pintscher, hoo, Multichill, Astuthiodit_1, Invadibot, maantietaja, 
ItamarWMDE, Akuckartz, Nandana, Lahi, Gq86, GoranSMilovanovic, QZanden, 
LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, 
Sjoerddebruin, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T325942: Christmas 2022 wbs_propertypairs table update on Wikidata

[hoo]

hoo added a comment.


  I've just updated PropertySuggester_update 
 
with the latest instructions.
  
  None of this is well polished, but given that we will replace this (soon?), 
investing further effort is probably not worth it.

TASK DETAIL
  https://phabricator.wikimedia.org/T325942

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: hoo
Cc: karapayneWMDE, BrokenSegue, Aklapper, Lydia_Pintscher, hoo, Multichill, 
Astuthiodit_1, Invadibot, maantietaja, ItamarWMDE, Akuckartz, Nandana, Lahi, 
Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, 
Wikidata-bugs, aude, Sjoerddebruin, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T325942: Christmas 2022 wbs_propertypairs table update on Wikidata

[Michael]

Michael moved this task from Unified prioritized backlog to Sprint-∞ on the 
Wikidata Dev Team board.
Michael edited projects, added Wikidata Dev Team (Sprint-∞); removed Wikidata 
Dev Team.

TASK DETAIL
  https://phabricator.wikimedia.org/T325942

WORKBOARD
  https://phabricator.wikimedia.org/project/board/6016/

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Michael
Cc: karapayneWMDE, BrokenSegue, Aklapper, Lydia_Pintscher, hoo, Multichill, 
Astuthiodit_1, Invadibot, maantietaja, ItamarWMDE, Akuckartz, Nandana, Lahi, 
Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, 
Wikidata-bugs, aude, Sjoerddebruin, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T325942: Christmas 2022 wbs_propertypairs table update on Wikidata

[karapayneWMDE]

karapayneWMDE added a comment.


  **2023 sprint 1**
  a/c
  
  [ ] convert into a chore (meaning team-wikidata has the information available 
on how do this independently)
  [ ] update the documentation
  
  **Notes**
  
  - Data is here: 
https://analytics.wikimedia.org/published/datasets/wmde-analytics-engineering/Wikidata/wbs_propertypairs/
 . Just needs to be uploaded by a deployer
  - https://wikitech.wikimedia.org/wiki/WMDE/Wikidata/PropertySuggester_update

TASK DETAIL
  https://phabricator.wikimedia.org/T325942

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: karapayneWMDE
Cc: karapayneWMDE, BrokenSegue, Aklapper, Lydia_Pintscher, hoo, Multichill, 
Astuthiodit_1, Invadibot, maantietaja, ItamarWMDE, Akuckartz, Nandana, Lahi, 
Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, 
Wikidata-bugs, aude, Sjoerddebruin, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T325942: Christmas 2022 wbs_propertypairs table update on Wikidata

[karapayneWMDE]

karapayneWMDE set the point value for this task to "1".

TASK DETAIL
  https://phabricator.wikimedia.org/T325942

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: karapayneWMDE
Cc: karapayneWMDE, BrokenSegue, Aklapper, Lydia_Pintscher, hoo, Multichill, 
Astuthiodit_1, Invadibot, maantietaja, ItamarWMDE, Akuckartz, Nandana, Lahi, 
Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, 
Wikidata-bugs, aude, Sjoerddebruin, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T325942: Christmas 2022 wbs_propertypairs table update on Wikidata

[Lydia_Pintscher]

Lydia_Pintscher triaged this task as "Medium" priority.
Lydia_Pintscher updated the task description.

TASK DETAIL
  https://phabricator.wikimedia.org/T325942

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Lydia_Pintscher
Cc: BrokenSegue, Aklapper, Lydia_Pintscher, hoo, Multichill, Astuthiodit_1, 
karapayneWMDE, Invadibot, maantietaja, ItamarWMDE, Akuckartz, Nandana, Lahi, 
Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, 
Wikidata-bugs, aude, Sjoerddebruin, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T325942: Christmas 2022 wbs_propertypairs table update on Wikidata

[Lydia_Pintscher]

Lydia_Pintscher added a comment.


  @hoo What do you say to @BrokenSegue's suggestion?

TASK DETAIL
  https://phabricator.wikimedia.org/T325942

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Lydia_Pintscher
Cc: BrokenSegue, Aklapper, Lydia_Pintscher, hoo, Multichill, Astuthiodit_1, 
karapayneWMDE, Invadibot, maantietaja, ItamarWMDE, Akuckartz, Nandana, Lahi, 
Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, 
Wikidata-bugs, aude, Sjoerddebruin, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T325942: Christmas 2022 wbs_propertypairs table update on Wikidata

[BrokenSegue]

BrokenSegue added a comment.


  Might I suggest if we're going to re-run it to add occupation (P106 
) to the list of classifying 
properties. it would be useful if it suggested sport for sports people or 
position held for politicians etc

TASK DETAIL
  https://phabricator.wikimedia.org/T325942

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: BrokenSegue
Cc: BrokenSegue, Aklapper, Lydia_Pintscher, hoo, Multichill, Astuthiodit_1, 
karapayneWMDE, Invadibot, maantietaja, ItamarWMDE, Akuckartz, Nandana, Lahi, 
Gq86, GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, 
Wikidata-bugs, aude, Sjoerddebruin, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T325942: Christmas 2022 wbs_propertypairs table update on Wikidata

[Lydia_Pintscher]

Lydia_Pintscher added a project: Wikidata Dev Team.

TASK DETAIL
  https://phabricator.wikimedia.org/T325942

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Lydia_Pintscher
Cc: Aklapper, Lydia_Pintscher, hoo, Multichill, Astuthiodit_1, karapayneWMDE, 
Invadibot, maantietaja, ItamarWMDE, Akuckartz, Nandana, Lahi, Gq86, 
GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, 
Wikidata-bugs, aude, Sjoerddebruin, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T325942: Christmas 2022 wbs_propertypairs table update on Wikidata

[Multichill]

Multichill created this task.
Multichill added projects: Wikidata, MediaWiki-extensions-PropertySuggester.
Restricted Application added a subscriber: Aklapper.

TASK DESCRIPTION
  The looks like the wbs_propertypairs table in the Wikidata database hasn't 
been updated all year. I'm using the table to update 
https://www.wikidata.org/wiki/Wikidata:WikiProject_sum_of_all_paintings/Most_used_painting_properties
 every once in a while. Can you please run whatever script it was again to 
update the table? I recall Marius doing this in the past.

TASK DETAIL
  https://phabricator.wikimedia.org/T325942

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Multichill
Cc: Aklapper, Lydia_Pintscher, hoo, Multichill, Astuthiodit_1, karapayneWMDE, 
Invadibot, maantietaja, ItamarWMDE, Akuckartz, Nandana, Lahi, Gq86, 
GoranSMilovanovic, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, 
Wikidata-bugs, aude, Sjoerddebruin, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org