[Wikidata-bugs] [Maniphest] T294985: Show up-to-date labels in Current Events Dashboard

2021-11-16 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Manuel Changes implemented and deployed https://wikidata-analytics.wmcloud.org/app/CurrentEvents > A delay of up to 1h is allowed. - we do real-time: the missing labels are checked from the dashboard directly; tested, wo

[Wikidata-bugs] [Maniphest] T294983: User interface changes for Current Events Dashboard

2021-11-16 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Manuel UI changes are now deployed, check: https://wikidata-analytics.wmcloud.org/app/CurrentEvents TASK DETAIL https://phabricator.wikimedia.org/T294983 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences

[Wikidata-bugs] [Maniphest] T295396: Redirect deprecated Wikidata Analytics subdomains to the current subdomain

2021-11-10 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. Note: @GoranSMilovanovic find the old Wikitonary-Analytics domain. TASK DETAIL https://phabricator.wikimedia.org/T295396 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: GoranSMilovanovic

[Wikidata-bugs] [Maniphest] T294984: Filter noise out of Current Events (Estimation)

2021-11-10 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. NOTE: filter out bots with `rcshow`. TASK DETAIL https://phabricator.wikimedia.org/T294984 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Aklapper, Manuel, Invadibot, maantietaja

[Wikidata-bugs] [Maniphest] T294975: UX update for Current Events dashboard

2021-11-10 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Manuel T294985 <https://phabricator.wikimedia.org/T294985> and T294986 <https://phabricator.wikimedia.org/T294986> can be solved together; I think it would not take more than 6 - 8 hours max to introduce changes, test, and deploy the desi

[Wikidata-bugs] [Maniphest] T295057: Create redirects for old Wikidata analytics-related URLs

2021-11-05 Thread GoranSMilovanovic
GoranSMilovanovic added a subscriber: Addshore. GoranSMilovanovic added a comment. @Manuel Let's do it, then. Maybe @addshore? TASK DETAIL https://phabricator.wikimedia.org/T295057 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic

[Wikidata-bugs] [Maniphest] T295044: One-time analytics of total entity usage pages

2021-11-04 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Manuel You are looking for a dashboard via the old URL, try: https://wikidata-analytics.wmcloud.org/app/WD_percentUsageDashboard TASK DETAIL https://phabricator.wikimedia.org/T295044 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel

[Wikidata-bugs] [Maniphest] T294983: UI changes for Current Events Dashboard

2021-11-03 Thread GoranSMilovanovic
GoranSMilovanovic added projects: WMDE-Analytics-Engineering, User-GoranSMilovanovic. TASK DETAIL https://phabricator.wikimedia.org/T294983 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Aklapper, Manuel, Invadibot

[Wikidata-bugs] [Maniphest] T282563: User Retention Wikidata: A model for "participating since" patterns in the 2021 Wikidata Community Survey

2021-11-01 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Jan_Dittrich Do we need this ticket anymore? TASK DETAIL https://phabricator.wikimedia.org/T282563 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Esh77, Pablo, Mohammed_Sadat_WMDE

[Wikidata-bugs] [Maniphest] T283574: Wikidata Analytics Data Products: DockerHub/Deployment

2021-10-28 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @WMDE-leszek So, it has been a while since we have discussed this thing. If the possibility to keep our Wikidata Analytics images in the `wikimediade` docker hub will not open anytime soon, I suggest we close this ticket so that I can close its

[Wikidata-bugs] [Maniphest] T282563: User Retention Wikidata: A model for "participating since" patterns in the 2021 Wikidata Community Survey

2021-10-27 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @MGerlach @Jan_Dittrich I have used XGBoost to train a `leave` vs `stay` binary classifier to our data. I did not go into elaborated cross-validation, used only a single train and single test dataset, downsampling by a huge factor (because

[Wikidata-bugs] [Maniphest] T282563: User Retention Wikidata: A model for "participating since" patterns in the 2021 Wikidata Community Survey

2021-10-26 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @MGerlach @Jan_Dittrich It is a power-law (and thus Lindy) after all: "H0: data IS generated from a power law distribution; H1: data IS NOT generated from a power law distribution." (from: Fitting Heavy Tailed Dis

[Wikidata-bugs] [Maniphest] T285739: [Epic] Wikidata content quality analytics

2021-10-24 Thread GoranSMilovanovic
GoranSMilovanovic claimed this task. GoranSMilovanovic added projects: WMDE-Analytics-Engineering, User-GoranSMilovanovic. TASK DETAIL https://phabricator.wikimedia.org/T285739 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc

[Wikidata-bugs] [Maniphest] T285739: [Epic] Wikidata content quality analytics

2021-10-24 Thread GoranSMilovanovic
GoranSMilovanovic added a subtask: T286257: Insights from the Wikidata Languages Landscape project. TASK DETAIL https://phabricator.wikimedia.org/T285739 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Manuel, Aklapper

[Wikidata-bugs] [Maniphest] T286257: Insights from the Wikidata Languages Landscape project

2021-10-24 Thread GoranSMilovanovic
GoranSMilovanovic added a parent task: T285739: [Epic] Wikidata content quality analytics. TASK DETAIL https://phabricator.wikimedia.org/T286257 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Esc3300, Tobi_WMDE_SW, Manuel

[Wikidata-bugs] [Maniphest] T285739: [Epic] Wikidata content quality analytics

2021-10-24 Thread GoranSMilovanovic
GoranSMilovanovic added a subtask: T288611: Number of links to other Wikimedia projects. TASK DETAIL https://phabricator.wikimedia.org/T285739 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Manuel, Aklapper, Invadibot

[Wikidata-bugs] [Maniphest] T288611: Number of links to other Wikimedia projects

2021-10-24 Thread GoranSMilovanovic
GoranSMilovanovic added a parent task: T285739: [Epic] Wikidata content quality analytics. TASK DETAIL https://phabricator.wikimedia.org/T288611 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Mike_Peel, Tobi_WMDE_SW

[Wikidata-bugs] [Maniphest] T285741: [Epic] Wikidata user segmentation

2021-10-24 Thread GoranSMilovanovic
GoranSMilovanovic claimed this task. GoranSMilovanovic added projects: WMDE-Analytics-Engineering, User-GoranSMilovanovic. GoranSMilovanovic added a comment. @Manuel The following Report (compressed `.zip` archive) F34708922: Wikidata_StrategyReport_Users.nb.zip <ht

[Wikidata-bugs] [Maniphest] T285741: [Epic] Wikidata user segmentation

2021-10-24 Thread GoranSMilovanovic
GoranSMilovanovic added a subtask: T287667: Provide Wikidata user behavior data to categorize users by hand. TASK DETAIL https://phabricator.wikimedia.org/T285741 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Aklapper, Manuel

[Wikidata-bugs] [Maniphest] T287667: Provide Wikidata user behavior data to categorize users by hand

2021-10-24 Thread GoranSMilovanovic
GoranSMilovanovic added a parent task: T285741: [Epic] Wikidata user segmentation. TASK DETAIL https://phabricator.wikimedia.org/T287667 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Tobi_WMDE_SW, GoranSMilovanovic, Manuel

[Wikidata-bugs] [Maniphest] T282563: User Retention Wikidata: A model for "participating since" patterns in the 2021 Wikidata Community Survey

2021-10-19 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @MGerlach The authors of the paper that you have cited in T282563#7419722 <https://phabricator.wikimedia.org/T282563#7419722> use a similar - if not the same - approach to feature engineering for the prediction task as I have used in T282563#7

[Wikidata-bugs] [Maniphest] T291170: Global South Contributions to Wikidata

2021-10-19 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Manuel Is there anything else that we need here? TASK DETAIL https://phabricator.wikimedia.org/T291170 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Mohammed_Sadat_WMDE, Aklapper

[Wikidata-bugs] [Maniphest] T282563: User Retention Wikidata: A model for "participating since" patterns in the 2021 Wikidata Community Survey

2021-10-18 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Jan_Dittrich Sound great, but I think @MGerlach and I would like to add some modeling efforts to see if we can predict if a users stays or not. TASK DETAIL https://phabricator.wikimedia.org/T282563 EMAIL PREFERENCES https://phabricator.wikimedia.org

[Wikidata-bugs] [Maniphest] T259105: Qurator: Data about Current Events

2021-10-18 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Manuel By the way, T259105#7436480 <https://phabricator.wikimedia.org/T259105#7436480> > This should not take so many days. Of course it would not take days; it is typically not a question of **how much time**, but **when**, bec

[Wikidata-bugs] [Maniphest] T259105: Qurator: Data about Current Events

2021-10-18 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Manuel Done; changes introduced to the Wikidata Analytics Portal <https://wikidata-analytics.wmcloud.org/>. TASK DETAIL https://phabricator.wikimedia.org/T259105 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailprefe

[Wikidata-bugs] [Maniphest] T259105: Qurator: Data about Current Events

2021-10-18 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Manuel No, no... now worries, see T259105#7436472 <https://phabricator.wikimedia.org/T259105#7436472>; I figured out it can be done easily: the new URLs https://wikidata-analytics.wmcloud.org/app/CuriousFacts https://wi

[Wikidata-bugs] [Maniphest] T259105: Qurator: Data about Current Events

2021-10-18 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Manuel **Wait;** **maybe** it can be done in an easier way than I thought. Give me a couple of hours or so to test. TASK DETAIL https://phabricator.wikimedia.org/T259105 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel

[Wikidata-bugs] [Maniphest] T259105: Qurator: Data about Current Events

2021-10-18 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. No; as described in T259105#7436288 <https://phabricator.wikimedia.org/T259105#7436288> > That will take some time because of the specifics of running R/Shiny in production under Shiny Proxy. TASK DETAIL https://phabricator.wikimedia.or

[Wikidata-bugs] [Maniphest] T259105: Qurator: Data about Current Events

2021-10-18 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Manuel No problem; the change will take place (probably until the end of the week). TASK DETAIL https://phabricator.wikimedia.org/T259105 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic

[Wikidata-bugs] [Maniphest] T259105: Qurator: Data about Current Events

2021-10-18 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Manuel That will take some time because of the specifics of running R/Shiny in production under Shiny Proxy. The Curious Facts - I am debugging something there right now - will also have to change then, because both systems now run

[Wikidata-bugs] [Maniphest] T259105: Qurator: Data about Current Events

2021-10-18 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Manuel The URL of the tool is: https://wikidata-analytics.wmcloud.org/app/QURATOR_CurrentEvents > Right now this main URL is throwing an error. The one that you have listed in T259105#7436093 <https://phabricator.wikimedia.org/T

[Wikidata-bugs] [Maniphest] T282563: User Retention Wikidata: A model for "participating since" patterns in the 2021 Wikidata Community Survey

2021-10-18 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @MGerlach @Jan_Dittrich We also need to decide on the following in order to submit our session proposal <https://pretalx.com/wdcon21/submit/fJyHGM/info/> to WikidataCon 2021: - Proposal title - Session type (please take a look at the subm

[Wikidata-bugs] [Maniphest] T282563: User Retention Wikidata: A model for "participating since" patterns in the 2021 Wikidata Community Survey

2021-10-18 Thread GoranSMilovanovic
GoranSMilovanovic added a subscriber: Esh77. GoranSMilovanovic added a comment. @Esh77 @MGerlach @Jan_Dittrich Martin and Jan: thank you for your readiness to present our findings on Wikidata User Retention in the WikidataCon 2021 Education & science track (see WikidataCon 2021 pro

[Wikidata-bugs] [Maniphest] T291170: Global South Contributions to Wikidata

2021-10-14 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Manuel The Wikidata Global South Report is ready. F34688998: Wikidata_GlobalSouthReport.nb.html <https://phabricator.wikimedia.org/F34688998> The Report is quite extensive and detailed. However, all analyses follow the same methodol

[Wikidata-bugs] [Maniphest] T259105: Qurator: Data about Current Events

2021-10-11 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Manuel We're running in production: https://wikidata-analytics.wmcloud.org/app/QURATOR_CurrentEvents Of course, it will take some time for the 6h, 24h, 48h, and 72h tables to begin to differ - the update engine was restarted. The test dashboard

[Wikidata-bugs] [Maniphest] T259105: Qurator: Data about Current Events

2021-10-10 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Manuel Test successful; deploying to production tomorrow. @So9q Thank you for your insights; all of the typos and similar will be taken care of. Reporting back here as soon as the system is deployed in CloudVPS. TASK DETAIL https

[Wikidata-bugs] [Maniphest] T259105: Qurator: Data about Current Events

2021-10-09 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @So9q > + typo "update the table below each ten minutes" -> "update the table below every ten minutes"? Yes, a typo, thank you... test server... it will run in production (hopefully w/o typos) elsewhere soo

[Wikidata-bugs] [Maniphest] T259105: Qurator: Data about Current Events

2021-10-08 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Manuel - The test dashboard is running here <http://datakolektiv.org/app/QURATOR_CurrentEvents>. - It will take some time before we begin to observe any differences between the 6h, 24h, 48h, and 72h tables; - As soon as this is evalua

[Wikidata-bugs] [Maniphest] T259105: Qurator: Data about Current Events

2021-10-08 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Manuel My estimates say that we should face no problems in our attempt to aggregate revisions across 6h, 24h, 2d and 3d on a virtual instance used for Wikidata Analytics in Cloud VPS. - I will deploy a full version of the update module today

[Wikidata-bugs] [Maniphest] T259105: Qurator: Data about Current Events

2021-10-07 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. - Update module test in CloudVPS successful; - expanding now to `6h, 24h, if possible: 2d, 3d`. TASK DETAIL https://phabricator.wikimedia.org/T259105 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences

[Wikidata-bugs] [Maniphest] T259105: Qurator: Data about Current Events

2021-10-07 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. - New update module tested in local (dev) environment now; - Testing now in CloudVPS. TASK DETAIL https://phabricator.wikimedia.org/T259105 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc

[Wikidata-bugs] [Maniphest] T286277: [Curious Facts] Provide a mode with equiprobability among constraints

2021-10-07 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Lydia_Pintscher Please see T286277#7391041 <https://phabricator.wikimedia.org/T286277#7391041> - can we close this now? TASK DETAIL https://phabricator.wikimedia.org/T286277 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings

[Wikidata-bugs] [Maniphest] T291186: Privacy Policy Review for Global South Wikidata edits and active editors datasets

2021-09-30 Thread GoranSMilovanovic
GoranSMilovanovic closed this task as "Resolved". GoranSMilovanovic added a comment. @Htriedman Hal, thank you very much for your help and guidance around this issue. @Manuel I will share the datasets with you via e-mail. Closing the ticket as resolved. TASK DETA

[Wikidata-bugs] [Maniphest] T291170: Global South Contributions to Wikidata

2021-09-30 Thread GoranSMilovanovic
GoranSMilovanovic closed subtask T291186: Privacy Policy Review for Global South Wikidata edits and active editors datasets as Resolved. TASK DETAIL https://phabricator.wikimedia.org/T291170 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences

[Wikidata-bugs] [Maniphest] T291170: Global South Contributions to Wikidata

2021-09-30 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Manuel Please see T291186#7391957 <https://phabricator.wikimedia.org/T291186#7391957> TASK DETAIL https://phabricator.wikimedia.org/T291170 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovano

[Wikidata-bugs] [Maniphest] T291186: Privacy Policy Review for Global South Wikidata edits and active editors datasets

2021-09-30 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Htriedman Please check `gs_edits_PUBLIC.csv` and `gs_active_editors_PUBLIC.csv` in `/home/goransm/Analytics/adhoc/WD_GlobalSouth_202109/_analytics/`: the datasets should now be in compliance with what is described in T291186#7385786 <ht

[Wikidata-bugs] [Maniphest] T291186: Privacy Policy Review for Global South Wikidata edits and active editors datasets

2021-09-30 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Htriedman @Manuel - Files from `/home/goransm/Analytics/adhoc/WD_GlobalSouth_202109/_analytics/` are now shared with @Manuel who has an NDA signed with the WMF. - Now producing the datasets as described in T291186#7385786 <ht

[Wikidata-bugs] [Maniphest] T286277: [Curious Facts] Provide a mode with equiprobability among constraints

2021-09-30 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Lydia_Pintscher Ooops - amid tons of tickets I must have somehow forgotten that I have already implemented an equiprobable sampling of the anomaly type in Qurator Curious Facts <https://wikidata-analytics.wmcloud.org/app/CuriousFacts>... ple

[Wikidata-bugs] [Maniphest] T286277: [Curious Facts] Provide a mode with equiprobability among constraints

2021-09-29 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Lydia_Pintscher Well, then we have a go for a uniform sampling of anomalies. To be implemented very soon. Thank you. TASK DETAIL https://phabricator.wikimedia.org/T286277 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel

[Wikidata-bugs] [Maniphest] T261906: Qurator: The Wikidata Curious Facts Project

2021-09-28 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. Update fixed; system up and running. TASK DETAIL https://phabricator.wikimedia.org/T261906 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Esc3300, Aklapper, WMDE-leszek, Lydia_Pintscher

[Wikidata-bugs] [Maniphest] T291186: Privacy Policy Review for Global South Wikidata edits and active editors datasets

2021-09-28 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Htriedman Thank you for being so precise, it really matters in this case! Ok - I am getting back in touch here as soon as I have the rework of the datasets in place. TASK DETAIL https://phabricator.wikimedia.org/T291186 EMAIL PREFERENCES

[Wikidata-bugs] [Maniphest] T291186: Privacy Policy Review for Global South Wikidata edits and active editors datasets

2021-09-28 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Htriedman Ok, so just let me check if I understand this perfectly: we will be able to share the files as they are now present in `/home/goransm/Analytics/adhoc/WD_GlobalSouth_202109/_analytics/` on our **stat1005** Analytics Clients following

[Wikidata-bugs] [Maniphest] T291186: Privacy Policy Review for Global South Wikidata edits and active editors datasets

2021-09-28 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Htriedman Maybe I am missing something: > ... even with aggregation that partially obscures data, the privacy team still would mandate the removal of countries from the protection list. but I think that @Manuel has already explained that

[Wikidata-bugs] [Maniphest] T261906: Qurator: The Wikidata Curious Facts Project

2021-09-28 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. As of T261906#7381822 <https://phabricator.wikimedia.org/T261906#7381822> - bug found; - bug fixed; - running a separate, manual update for M1 class anomalies; - deployment follows ASAP. TASK DETAIL https://phabricator.wikimedia.org/T

[Wikidata-bugs] [Maniphest] T286242: [Curious Facts] link to displayed image (if any)

2021-09-28 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Lucas_Werkmeister_WMDE Deployed: Qurator Curious Facts <https://wikidata-analytics.wmcloud.org/app/CuriousFacts>. In the meantime I have spotted a set of problems with the current update, described in T261906#7381822

[Wikidata-bugs] [Maniphest] T261906: Qurator: The Wikidata Curious Facts Project

2021-09-27 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. Some problems were detected in the latest Qurator Curious Facts <https://wikidata-analytics.wmcloud.org/app/CuriousFacts> update, e.g.: > Institute for Colored Youth has a statement "educated at: Frazelia Campbell" but Frazelia Ca

[Wikidata-bugs] [Maniphest] T286242: [Curious Facts] link to displayed image (if any)

2021-09-27 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Lucas_Werkmeister_WMDE - Fixed; - the system will start displaying the Wikimedia Commons filename (linked), and - the license used. Deploying now. TASK DETAIL https://phabricator.wikimedia.org/T286242 EMAIL PREFERENCES https

[Wikidata-bugs] [Maniphest] T286242: [Curious Facts] link to displayed image (if any)

2021-09-27 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Lucas_Werkmeister_WMDE It should definitely be ``, let me see what did go wrong. > But mentioning the file name would probably be a good idea Of course, I will take care of that. TASK DETAIL https://phabricator.wikimedia.org/T286242 EM

[Wikidata-bugs] [Maniphest] T286242: [Curious Facts] link to displayed image (if any)

2021-09-27 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Lucas_Werkmeister_WMDE The Qurator Curious Facts <https://wikidata-analytics.wmcloud.org/app/CuriousFacts> system is now updated to display image attribution information. Please check and let me know if this is in line with your request. Tha

[Wikidata-bugs] [Maniphest] T286242: [Curious Facts] link to displayed image (if any)

2021-09-27 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Lucas_Werkmeister_WMDE - implemented; - tested; - deploying now. TASK DETAIL https://phabricator.wikimedia.org/T286242 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc

[Wikidata-bugs] [Maniphest] T286277: [Curious Facts] Provide a mode with equiprobability among constraints

2021-09-27 Thread GoranSMilovanovic
GoranSMilovanovic closed this task as "Declined". GoranSMilovanovic added a comment. On the grounds presented in T286277#7200018 <https://phabricator.wikimedia.org/T286277#7200018>: > The current sampling of anomalies that would be presented to a user of Curi

[Wikidata-bugs] [Maniphest] T261906: Qurator: The Wikidata Curious Facts Project

2021-09-27 Thread GoranSMilovanovic
GoranSMilovanovic closed subtask T286277: [Curious Facts] Provide a mode with equiprobability among constraints as Declined. TASK DETAIL https://phabricator.wikimedia.org/T261906 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc

[Wikidata-bugs] [Maniphest] T290988: [Curious Facts] update Curious Facts data

2021-09-26 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Lydia_Pintscher The system update is tracked in T283568#7378637 <https://phabricator.wikimedia.org/T283568#7378637> alongside similar developments in Wikidata Analytics. The rest happens under the Qurator Curious Facts umbrella ticket T

[Wikidata-bugs] [Maniphest] T283568: [Epic] Wikidata Analytics Core Codebase Maintenance

2021-09-26 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. Qurator Curious Facts is now in production (repo <https://github.com/wikimedia/analytics-wmde-WD-WikidataAnalytics/tree/master/_engines/_qurator/_curiousFacts>). All rules and standards from Wikidata Analytics are now in place in this project too.

[Wikidata-bugs] [Maniphest] T290988: [Curious Facts] update Curious Facts data

2021-09-25 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Lydia_Pintscher The Qurator Curious Facts <https://wikidata-analytics.wmcloud.org/app/CuriousFacts> system is now updated. - Please check the update before closing this ticket. - The system will be put on a regular **monthly** update sc

[Wikidata-bugs] [Maniphest] T290988: [Curious Facts] update Curious Facts data

2021-09-25 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. Some problems in the Docker production detected, actions: - change the build environment - push to VM (wikidata-analytics.wmde-dashboards.eqiad1.wikimedia.cloud) - test. TASK DETAIL https://phabricator.wikimedia.org/T290988 EMAIL PREFERENCES

[Wikidata-bugs] [Maniphest] T290988: [Curious Facts] update Curious Facts data

2021-09-21 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Lydia_Pintscher The update is on its way, alongside the deployment of new production schema/environment for this system. If everything works out correctly, this system will be put on regular update schedule that will trigger the update engine

[Wikidata-bugs] [Maniphest] T291186: Privacy Policy Review for Global South Wikidata edits and active editors datasets

2021-09-21 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Htriedman I think @Manuel as a Wikidata Analytics PM is the right person to ask. He is currently on a leave, but I guess he will respond as soon as he gets back. Thank you and stay in touch. TASK DETAIL https://phabricator.wikimedia.org

[Wikidata-bugs] [Maniphest] T291170: Global South Contributions to Wikidata

2021-09-17 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Manuel Since you have an NDA signed with the Wikimedia Foundation, I can share the existing datasets with you. The only thing that would be helpful at this point is a list of countries that we consider to be in the "Global South"

[Wikidata-bugs] [Maniphest] T291186: Privacy Policy Review for Global South Wikidata edits and active editors datasets

2021-09-17 Thread GoranSMilovanovic
GoranSMilovanovic added a parent task: T291170: Global South Contributions to Wikidata. TASK DETAIL https://phabricator.wikimedia.org/T291186 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Milimetric, Tobi_WMDE_SW, Ladsgroup

[Wikidata-bugs] [Maniphest] T291170: Global South Contributions to Wikidata

2021-09-17 Thread GoranSMilovanovic
GoranSMilovanovic added a subtask: T291186: Privacy Policy Review for Global South Wikidata edits and active editors datasets. TASK DETAIL https://phabricator.wikimedia.org/T291170 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc

[Wikidata-bugs] [Maniphest] T291170: Global South Contributions to Wikidata

2021-09-16 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. Privacy review ticket is T291186 <https://phabricator.wikimedia.org/T291186>. TASK DETAIL https://phabricator.wikimedia.org/T291170 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Ak

[Wikidata-bugs] [Maniphest] T291186: Privacy Policy Review for Global South Wikidata edits and active editors datasets

2021-09-16 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Milimetric Thank you Dan. TASK DETAIL https://phabricator.wikimedia.org/T291186 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Milimetric, Tobi_WMDE_SW, Ladsgroup, GoranSMilovanovic

[Wikidata-bugs] [Maniphest] T291170: Global South Contributions to Wikidata

2021-09-16 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Ladsgroup @Manuel The code is here <https://github.com/wikimedia/analytics-wmde-WD-WikidataAdHocAnalytics/tree/master/WD_GlobalSouth_202109>. TASK DETAIL https://phabricator.wikimedia.org/T291170 EMAIL PREFERENCES

[Wikidata-bugs] [Maniphest] T291170: Global South Contributions to Wikidata

2021-09-16 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Ladsgroup @Manuel Ok, now we also have the data for > the number of edits in the last 12 months per country The dataset comprises the following fields: - `country_code` - `month` = year/month, the time span is from 2020/09 to 2021

[Wikidata-bugs] [Maniphest] T291170: Global South Contributions to Wikidata

2021-09-16 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Ladsgroup @Manuel Ok, the following dataset: Analytics/Data Lake/Edits/Geoeditors <https://wikitech.wikimedia.org/wiki/Analytics/Data_Lake/Edits/Geoeditors> has everything that we need for this ticket. **NOTE 1. we need a w

[Wikidata-bugs] [Maniphest] T291170: Global South Contributions to Wikidata

2021-09-16 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Ladsgroup @Manuel the following public dataset Analytics/Data Lake/Edits/Geoeditors/Public <https://wikitech.wikimedia.org/wiki/Analytics/Data_Lake/Edits/Geoeditors/Public> will also not going to be of any help, from the docs

[Wikidata-bugs] [Maniphest] T291170: Global South Contributions to Wikidata

2021-09-16 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Ladsgroup @Manuel The API <https://wikitech.wikimedia.org/wiki/Analytics/AQS/Editors_by_country> will not be of any help here to provide an answer on the number of active editors per country; from the docs <https://wikimedia.org/ap

[Wikidata-bugs] [Maniphest] T291170: Global South Contributions to Wikidata

2021-09-16 Thread GoranSMilovanovic
GoranSMilovanovic created this task. GoranSMilovanovic added projects: User-GoranSMilovanovic, Wikidata Analytics, WMDE-Analytics-Engineering, Wikidata. Restricted Application added a subscriber: Aklapper. TASK DESCRIPTION As a Wikidata Analytics PM, and in relation to the Reimagining Wikidata

[Wikidata-bugs] [Maniphest] T290988: [Curious Facts] update Curious Facts data

2021-09-15 Thread GoranSMilovanovic
GoranSMilovanovic claimed this task. GoranSMilovanovic added a project: User-GoranSMilovanovic. GoranSMilovanovic added a comment. @Lydia_Pintscher The update is already planned in the scope of some other changes that are taking place in relation to the production environment/deployment

[Wikidata-bugs] [Maniphest] T261906: Qurator: The Wikidata Curious Facts Project

2021-09-15 Thread GoranSMilovanovic
GoranSMilovanovic added a subtask: T290988: [Curious Facts] update Curious Facts data. TASK DETAIL https://phabricator.wikimedia.org/T261906 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Esc3300, Aklapper, WMDE-leszek

[Wikidata-bugs] [Maniphest] T290988: [Curious Facts] update Curious Facts data

2021-09-15 Thread GoranSMilovanovic
GoranSMilovanovic added a parent task: T261906: Qurator: The Wikidata Curious Facts Project. TASK DETAIL https://phabricator.wikimedia.org/T290988 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Aklapper, Lydia_Pintscher

[Wikidata-bugs] [Maniphest] T285459: What UI vs API based revisions data do we have for Wikidata?

2021-09-08 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @So9q Thank you very much for this insight! TASK DETAIL https://phabricator.wikimedia.org/T285459 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: So9q, Lydia_Pintscher, Manuel, Tobi_WMDE_SW

[Wikidata-bugs] [Maniphest] T283574: Wikidata Analytics Data Products: DockerHub/Deployment

2021-09-08 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @WMDE-leszek Great! In that case, I would say this ticket can be resolved in a rather trivial way - because the `wikimediade` docker hub organisation solves all the related problems! Please let me know about the technical details in our 1:1. TASK

[Wikidata-bugs] [Maniphest] T119976: Track number of stubs on top 20 wikipedias

2021-09-07 Thread GoranSMilovanovic
GoranSMilovanovic removed a project: User-GoranSMilovanovic. TASK DETAIL https://phabricator.wikimedia.org/T119976 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Manuel, alaa, Sunny00217, GoranSMilovanovic, Esc3300

[Wikidata-bugs] [Maniphest] T208569: Get Wikidata clickstream

2021-09-07 Thread GoranSMilovanovic
GoranSMilovanovic removed a project: User-GoranSMilovanovic. TASK DETAIL https://phabricator.wikimedia.org/T208569 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Manuel, GoranSMilovanovic, JAllemandou, Aklapper, Lea_WMDE

[Wikidata-bugs] [Maniphest] T194748: Research: How are bot edits different than human edits on Wikidata?

2021-09-07 Thread GoranSMilovanovic
GoranSMilovanovic removed a project: User-GoranSMilovanovic. TASK DETAIL https://phabricator.wikimedia.org/T194748 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Manuel, GoranSMilovanovic, Aklapper, Hall1467, RazShuty

[Wikidata-bugs] [Maniphest] T283575: Wikidata Analytics: codebase modularization

2021-09-07 Thread GoranSMilovanovic
GoranSMilovanovic closed this task as "Resolved". TASK DETAIL https://phabricator.wikimedia.org/T283575 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Aklapper, WMDE-leszek, Lydia_Pintscher, GoranSMilovanovi

[Wikidata-bugs] [Maniphest] T283568: [Epic] Wikidata Analytics Core Codebase Maintenance

2021-09-07 Thread GoranSMilovanovic
GoranSMilovanovic closed subtask T283575: Wikidata Analytics: codebase modularization as Resolved. TASK DETAIL https://phabricator.wikimedia.org/T283568 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Manuel, Lydia_Pintscher

[Wikidata-bugs] [Maniphest] T283568: [Epic] Wikidata Analytics Core Codebase Maintenance

2021-09-07 Thread GoranSMilovanovic
GoranSMilovanovic closed subtask T283571: Automation of large Wikidata Analytics updates as Resolved. TASK DETAIL https://phabricator.wikimedia.org/T283568 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Manuel, Lydia_Pintscher

[Wikidata-bugs] [Maniphest] T283571: Automation of large Wikidata Analytics updates

2021-09-07 Thread GoranSMilovanovic
GoranSMilovanovic closed this task as "Resolved". TASK DETAIL https://phabricator.wikimedia.org/T283571 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Aklapper, WMDE-leszek, Lydia_Pintscher, GoranSMilovanovic,

[Wikidata-bugs] [Maniphest] T283568: [Epic] Wikidata Analytics Core Codebase Maintenance

2021-09-07 Thread GoranSMilovanovic
GoranSMilovanovic closed subtask T283570: Impose the tidyverse style for R code wherever possible as Resolved. TASK DETAIL https://phabricator.wikimedia.org/T283568 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Manuel

[Wikidata-bugs] [Maniphest] T283570: Impose the tidyverse style for R code wherever possible

2021-09-07 Thread GoranSMilovanovic
GoranSMilovanovic closed this task as "Resolved". TASK DETAIL https://phabricator.wikimedia.org/T283570 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Aklapper, WMDE-leszek, Lydia_Pintscher, GoranSMilovanovi

[Wikidata-bugs] [Maniphest] T285459: What UI vs API based revisions data do we have for Wikidata?

2021-08-31 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Manuel > Let's discuss how we could use these tags in combination with other inf (e.g isBot and the total number of edits). I am currently working on this from SQL, because the august 2021 snapshot of `wmf.mediawiki_history` is not yet produ

[Wikidata-bugs] [Maniphest] T285459: What UI vs API based revisions data do we have for Wikidata?

2021-08-31 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Manuel > Thx Goran! Could you please figure out where the problem is? The tags are already in use. The tags are in use indeed, but you must have seen T285459#7321218 <https://phabricator.wikimedia.org/T285459#7321218> before I had it edi

[Wikidata-bugs] [Maniphest] T285459: What UI vs API based revisions data do we have for Wikidata?

2021-08-31 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Manuel Initial check for **Tag all edits made via Wikibase View and Wikibase Client** T236893 <https://phabricator.wikimedia.org/T236893>: - `data-bridge`: used 279 times; - `client-linkitem-change`: **not found**; - `client-automatic-

[Wikidata-bugs] [Maniphest] T288611: Number of links to other Wikimedia projects

2021-08-26 Thread GoranSMilovanovic
GoranSMilovanovic added a subtask: T289810: Number and proportion of bot edits per projects. TASK DETAIL https://phabricator.wikimedia.org/T288611 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Tobi_WMDE_SW, GoranSMilovanovic

[Wikidata-bugs] [Maniphest] T236893: Tag all edits made via Wikibase View and Wikibase Client

2021-08-24 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. Awesome. TASK DETAIL https://phabricator.wikimedia.org/T236893 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Addshore, GoranSMilovanovic Cc: Ladsgroup, Mohammed_Sadat_WMDE, GoranSMilovanovic, jhsoby, hoo

[Wikidata-bugs] [Maniphest] T283575: Wikidata Analytics: codebase modularization

2021-08-23 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. - WD_percentUsage_PRODUCTION.R <https://github.com/wikimedia/analytics-wmde-WD-WikidataAnalytics/blob/master/_engines/WD_percentUsage_PRODUCTION.R> component of the WD Usage and Coverage <https://wikidata-analytics.wmcloud.org/app/WD_percentUsage

[Wikidata-bugs] [Maniphest] T283575: Wikidata Analytics: codebase modularization

2021-08-22 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. - {WMDEData} <https://github.com/wikimedia/analytics-wmde-WD-WikidataAnalytics/tree/master/_lib/WMDEData> (with renv{}) is now deployed across the WMF Analytics Clients. TASK DETAIL https://phabricator.wikimedia.org/T283575 EMAIL PREFERENCES

<    1   2   3   4   5   6   7   8   9   >