[Wikidata-bugs] [Maniphest] T334951: Wikidata Concepts Monitor ETL Migration to Spark3

2023-05-09 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Manuel It is not that I am very much involved, but the professional situation with me is simply as it is: I can barely find any time besides the responsibilities that I carry. However, I will really make an effort in the end of May to clear up some space

[Wikidata-bugs] [Maniphest] T334951: Wikidata Concepts Monitor ETL Migration to Spark3

2023-05-09 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @BTullis With all the good will I have to help with this, there's no chance I'll be able to help before June 2023. TASK DETAIL https://phabricator.wikimedia.org/T334951 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences

[Wikidata-bugs] [Maniphest] T327922: Most of our Wikidata's ShinyProxy based analytics dashboards have stopped working

2023-03-06 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @MarcoSwart Unfortunately, not yet. I am struggling to find some time and promote my test server to production to serve the dashboards from there at least temporarily, until the CloudVPS issues are resolved. I will let you know as soon as I have something

[Wikidata-bugs] [Maniphest] T327922: Most of our Wikidata's ShinyProxy based analytics dashboards have stopped working

2023-02-18 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Otourly Note: I do not work for WMDE since March 2022, so you will need to see with @Manuel about their plans, but from my side - I will try to set up the Wikidata Analytics dashboards on my server (which is currently a test environment only) as soon

[Wikidata-bugs] [Maniphest] T321666: Wiktionary Cognate Dashboard is not accessible [timeboxed 0.5 days]

2023-01-08 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. What I will probably be able to do in the following weeks is to prepare a production environment on one my (DataKolektiv) server and run Wikidata Analytics and Wiktionary Cognate in a production environment from there, so that the community can have

[Wikidata-bugs] [Maniphest] T321666: Wiktionary Cognate Dashboard is not accessible [timeboxed 0.5 days]

2023-01-07 Thread GoranSMilovanovic
GoranSMilovanovic added subscribers: WMDE-leszek, Lydia_Pintscher. GoranSMilovanovic added a comment. Ok, we have a problem. @Manuel @ItamarWMDE @WMDE-leszek @Lydia_Pintscher After having rebuilt only two of the Wikidata Analytics images on `wikidata-analytics` in the `wmde

[Wikidata-bugs] [Maniphest] T321666: Wiktionary Cognate Dashboard is not accessible [timeboxed 0.5 days]

2023-01-07 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. I have found some time to inspect the problem - and the problem is very strange. All Wikidata Analytics + Wiktionary Analytics Docker images are being rebuild right now in CloudVPS. The services will be unavailable for some time. For a moment, I

[Wikidata-bugs] [Maniphest] T321666: Wiktionary Cognate Dashboard is not accessible [timeboxed 0.5 days]

2022-12-16 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Otourly I am currently focused on my professional obligations. I will have some more time following December 26, but then I will also need to rest and spend time with my family. So, as soon as the time permits, I will take a look at this. Also

[Wikidata-bugs] [Maniphest] T323460: WDCM update missing

2022-11-29 Thread GoranSMilovanovic
GoranSMilovanovic closed this task as "Resolved". TASK DETAIL https://phabricator.wikimedia.org/T323460 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: WMDE-leszek, Manuel, ItamarWMDE, GoranSMilovanovic, Aklapper, Mis

[Wikidata-bugs] [Maniphest] T323975: Puppet failure on several WMDE's CloudVPS projects

2022-11-29 Thread GoranSMilovanovic
GoranSMilovanovic added a subscriber: LucasWerkmeister. GoranSMilovanovic added a comment. @LucasWerkmeister Thank you Lucas! TASK DETAIL https://phabricator.wikimedia.org/T323975 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic

[Wikidata-bugs] [Maniphest] T323975: Puppet failure on several WMDE's CloudVPS projects

2022-11-29 Thread GoranSMilovanovic
GoranSMilovanovic created this task. GoranSMilovanovic added projects: WMDE-Analytics-Engineering, Wikidata, Wikidata Analytics. Restricted Application added a subscriber: Aklapper. TASK DESCRIPTION I have started to receive e-mail warnings on Puppet failures for WMDE's Wikidata, Wiktionary

[Wikidata-bugs] [Maniphest] T323460: WDCM update missing

2022-11-29 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @MisterSynergy @Manuel @WMDE-leszek @ItamarWMDE And the update timestamp is now `Last update: 2022-11-28 09:20:32 UTC` - so, WDCM is updating on the schedule. I think we can close this ticket. Thank you. TASK DETAIL https

[Wikidata-bugs] [Maniphest] T323460: WDCM update missing

2022-11-24 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @MisterSynergy @Manuel @WMDE-leszek @ItamarWMDE I have checked the WDCM dashboards today (November 24, 2022) and the latest update timestamp reported was `Last update: 2022-11-21 11:29:50 UTC` That means that the previous update (the missing

[Wikidata-bugs] [Maniphest] T251792: Wiktionary Cognate Dashboard not updated

2022-11-20 Thread GoranSMilovanovic
GoranSMilovanovic claimed this task. TASK DETAIL https://phabricator.wikimedia.org/T251792 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: ItamarWMDE, Tobi_WMDE_SW, Manuel, Otourly, Addshore, Aklapper, Lydia_Pintscher

[Wikidata-bugs] [Maniphest] T323460: WDCM update missing

2022-11-20 Thread GoranSMilovanovic
GoranSMilovanovic claimed this task. TASK DETAIL https://phabricator.wikimedia.org/T323460 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: WMDE-leszek, Manuel, ItamarWMDE, GoranSMilovanovic, Aklapper, MisterSynergy

[Wikidata-bugs] [Maniphest] T323460: WDCM update missing

2022-11-20 Thread GoranSMilovanovic
GoranSMilovanovic added subscribers: ItamarWMDE, Manuel, WMDE-leszek. GoranSMilovanovic added a comment. Restricted Application added a project: User-ItamarWMDE. @MisterSynergy I need to check that as soon as possible and see why the update failed (if the update failed - or it's something

[Wikidata-bugs] [Maniphest] T321666: Wiktionary Cognate Dashboard is not accessible [timeboxed 0.5 days]

2022-10-31 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @ItamarWMDE @Manuel I will see to take a look at it ASAP. TASK DETAIL https://phabricator.wikimedia.org/T321666 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: GoranSMilovanovic, Otourly

[Wikidata-bugs] [Maniphest] T295396: Redirect deprecated Wikidata Analytics URLs to the current URLs

2022-06-17 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @karapayneWMDE [Also in a recent email to @Manuel] Move WMDE analytics into a new CloudVPS project <https://phabricator.wikimedia.org/T299568> is not a blocker of [[ https://phabricator.wikimedia.org/T295396 | Redirect deprecated Wi

[Wikidata-bugs] [Maniphest] T307763: Wikidata usage and coverage dashboard only shows partial data

2022-05-08 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Lydia_Pintscher @Tobi_WMDE_SW @Manuel @ItamarWMDE I have just checked the dashboard <https://wikidata-analytics.wmcloud.org/app/WikidataAnalytics> and it shows the data for all projects as it did before. Similarly to what recently ha

[Wikidata-bugs] [Maniphest] T307763: Wikidata usage and coverage dashboard only shows partial data

2022-05-06 Thread GoranSMilovanovic
GoranSMilovanovic added subscribers: ItamarWMDE, Manuel, Tobi_WMDE_SW, GoranSMilovanovic. GoranSMilovanovic added a comment. @Lydia_Pintscher @Tobi_WMDE_SW @Manuel This has probably something to do with the ETL module of the dashboard. I will inspect the issue together

[Wikidata-bugs] [Maniphest] T297303: Re-productionize the Wiktionary Cognate Dashboard

2022-02-09 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. The current URL is > https://wiktionary-analytics.wmcloud.org/Wiktionary_CognateDashboard/ In case we keep a separate CloudVPS to run this dashboard it would be: > https://wiktionary-analytics.wmcloud.org/app/Wiktionary_CognateDas

[Wikidata-bugs] [Maniphest] T297303: Re-productionize the Wiktionary Cognate Dashboard

2022-02-09 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. Wiktionary Cognate Dashboard is fully re-productionized now, test server: http://datakolektiv.org/app_direct/WiktionaryCognate/ - Deployment: deployment to CloudVPS will take places as soon as - the changes in the dashboard URL are announced

[Wikidata-bugs] [Maniphest] T297303: Re-productionize the Wiktionary Cognate Dashboard

2022-02-08 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. Wiktionary Cognate Dashboard is being test under the new production approach now on the test server <http://datakolektiv.org/app_direct/WikidataAnalytics/>. - the dashboard update engine is containerized separately (the same approach

[Wikidata-bugs] [Maniphest] T299571: Input on how we could integrate data analytics in our dev team

2022-01-30 Thread GoranSMilovanovic
GoranSMilovanovic added a subscriber: Tobi_WMDE_SW. GoranSMilovanovic added a comment. @Manuel @Tobi_WMDE_SW Here <https://docs.google.com/document/d/1lSvLkfdcHTReQsFs2WNmjWm1INF5bGKHJE_wm82MOFs/edit> is how I think about what WMDE can do in order to address the questions

[Wikidata-bugs] [Maniphest] T297485: Implement regular data backups for our R Shiny dashboards for Wikidata

2022-01-30 Thread GoranSMilovanovic
GoranSMilovanovic added subscribers: JAllemandou, Milimetric, Tobi_WMDE_SW. GoranSMilovanovic added a comment. @Tobi_WMDE_SW #analytics <https://phabricator.wikimedia.org/tag/analytics/> @JAllemandou @Milimetric Our Wikidata Analytics PM @Manuel would like to get in touch with t

[Wikidata-bugs] [Maniphest] T297485: Implement regular data backups for our R Shiny dashboards for Wikidata

2022-01-26 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Manuel The WMF Analytics-Engineering team. TASK DETAIL https://phabricator.wikimedia.org/T297485 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Aklapper, Manuel, Invadibot, maantietaja

[Wikidata-bugs] [Maniphest] T297485: Implement regular data backups for our R Shiny dashboards for Wikidata

2022-01-25 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Manuel As long as my R production scripts on the Analytics Clients <https://wikitech.wikimedia.org/wiki/Analytics/Systems/Clients> are running the data that feed our analytics will be regularly updated. The data are copied to the public dir

[Wikidata-bugs] [Maniphest] T297225: [Current Events] filter out some expected/unneeded Items

2022-01-25 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Manuel - new items out filter out added; - a `CSV` download button is now present at the bottom of each table; - check out the Dashboard <https://wikidata-analytics.wmcloud.org/app/CurrentEvents>. TASK DETAIL https://phabricator.wikimed

[Wikidata-bugs] [Maniphest] T294983: User interface changes for Current Events Dashboard

2022-01-25 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Manuel Fixed, check out the Dashboard <https://wikidata-analytics.wmcloud.org/app/CurrentEvents>. TASK DETAIL https://phabricator.wikimedia.org/T294983 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailprefe

[Wikidata-bugs] [Maniphest] T297225: [Current Events] filter out some expected/unneeded Items

2022-01-24 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Manuel Great, thanks! TASK DETAIL https://phabricator.wikimedia.org/T297225 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: GoranSMilovanovic, Manuel, Aklapper, Lydia_Pintscher, Invadibot

[Wikidata-bugs] [Maniphest] T297225: [Current Events] filter out some expected/unneeded Items

2022-01-23 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Manuel Could you please provide a `.csv` file with a list of all items that need to be filtered our? Thanks. TASK DETAIL https://phabricator.wikimedia.org/T297225 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences

[Wikidata-bugs] [Maniphest] T297305: Ensure preliminary research data sets are accessible

2022-01-23 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Manuel Here you go: Google Drive spreadsheet with research datasets. <https://docs.google.com/spreadsheets/d/13-r6RoIl09H5JXjNksqlqNLOP4mYHyqPYBSaOjuU74A/edit?pli=1#gid=0> TASK DETAIL https://phabricator.wikimedia.org/T297305 EMAIL PREFERENCES

[Wikidata-bugs] [Maniphest] T292862: Create an automatically updated dashboard out of the Wikidata Quality Report

2022-01-19 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. Nope. There are several timestamps and you are looking only at the report timestamp which is indeed update daily because the report automatically re-renders itself every day. Take a look at the text of the report, the very first few paragraphs, and you

[Wikidata-bugs] [Maniphest] T297503: Create knowledge-transfer document about the WMDE analytics infrastructure

2022-01-19 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Manuel The document is useful, I agree, but trust me on this: it will be more useful to our new Data Analyst to go through all the steps in that document with me 1:1. TASK DETAIL https://phabricator.wikimedia.org/T297503 EMAIL PREFERENCES https

[Wikidata-bugs] [Maniphest] T295396: Redirect deprecated Wikidata Analytics URLs to the current URLs

2022-01-17 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @noarave @Manuel @Addshore I would have already added new members but it turns out that I am not authorised to do so in Horizon. TASK DETAIL https://phabricator.wikimedia.org/T295396 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings

[Wikidata-bugs] [Maniphest] T297503: Create knowledge-transfer document about the WMDE analytics infrastructure

2022-01-10 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Manuel Here it is: Wikidata Knowledge Transfer <https://docs.google.com/document/d/1bGV5yHV9AKk2nblIo3AY0LBU3nHC54axZTqP16PsM34/edit>. Our new Data Scientist would also have to take a look at my 2017 Onboarding Document <https://docs.g

[Wikidata-bugs] [Maniphest] T297485: Implement regular data backups for our R Shiny dashboards for Wikidata

2021-12-22 Thread GoranSMilovanovic
GoranSMilovanovic claimed this task. GoranSMilovanovic added a project: User-GoranSMilovanovic. TASK DETAIL https://phabricator.wikimedia.org/T297485 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Aklapper, Manuel, Invadibot

[Wikidata-bugs] [Maniphest] T297303: Re-productionize the Wiktionary Cognate Dashboard

2021-12-22 Thread GoranSMilovanovic
GoranSMilovanovic claimed this task. GoranSMilovanovic added a project: User-GoranSMilovanovic. TASK DETAIL https://phabricator.wikimedia.org/T297303 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Manuel, Aklapper, Invadibot

[Wikidata-bugs] [Maniphest] T283568: [Epic] Wikidata Analytics Core Codebase Maintenance

2021-12-21 Thread GoranSMilovanovic
GoranSMilovanovic added a subtask: T297354: Link Cognate Dashboard from Wikidata Analytics page. TASK DETAIL https://phabricator.wikimedia.org/T283568 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Manuel, Lydia_Pintscher

[Wikidata-bugs] [Maniphest] T297354: Link Cognate Dashboard from Wikidata Analytics page

2021-12-21 Thread GoranSMilovanovic
GoranSMilovanovic added a parent task: T283568: [Epic] Wikidata Analytics Core Codebase Maintenance. TASK DETAIL https://phabricator.wikimedia.org/T297354 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Manuel, Aklapper

[Wikidata-bugs] [Maniphest] T297354: Link Cognate Dashboard from Wikidata Analytics page

2021-12-21 Thread GoranSMilovanovic
GoranSMilovanovic claimed this task. GoranSMilovanovic added a project: User-GoranSMilovanovic. TASK DETAIL https://phabricator.wikimedia.org/T297354 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Manuel, Aklapper

[Wikidata-bugs] [Maniphest] T297285: Ensure documentation of Qurator Curious Facts code and experiences

2021-12-08 Thread GoranSMilovanovic
GoranSMilovanovic claimed this task. GoranSMilovanovic added a project: User-GoranSMilovanovic. TASK DETAIL https://phabricator.wikimedia.org/T297285 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Aklapper, Manuel, Invadibot

[Wikidata-bugs] [Maniphest] T297284: Ensure documentation of essential analytics and editor tools

2021-12-08 Thread GoranSMilovanovic
GoranSMilovanovic claimed this task. GoranSMilovanovic added a project: User-GoranSMilovanovic. TASK DETAIL https://phabricator.wikimedia.org/T297284 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Aklapper, Lydia_Pintscher

[Wikidata-bugs] [Maniphest] T292862: Create an automatically updated dashboard out of the Wikidata Quality Report

2021-12-08 Thread GoranSMilovanovic
GoranSMilovanovic claimed this task. GoranSMilovanovic added a project: User-GoranSMilovanovic. TASK DETAIL https://phabricator.wikimedia.org/T292862 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Aklapper, Lydia_Pintscher

[Wikidata-bugs] [Maniphest] T283568: [Epic] Wikidata Analytics Core Codebase Maintenance

2021-12-08 Thread GoranSMilovanovic
GoranSMilovanovic added a subtask: T297285: Ensure documentation of Qurator Curious Facts code and experiences. TASK DETAIL https://phabricator.wikimedia.org/T283568 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Manuel

[Wikidata-bugs] [Maniphest] T297285: Ensure documentation of Qurator Curious Facts code and experiences

2021-12-08 Thread GoranSMilovanovic
GoranSMilovanovic added a parent task: T283568: [Epic] Wikidata Analytics Core Codebase Maintenance. TASK DETAIL https://phabricator.wikimedia.org/T297285 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Aklapper, Manuel

[Wikidata-bugs] [Maniphest] T283568: [Epic] Wikidata Analytics Core Codebase Maintenance

2021-12-08 Thread GoranSMilovanovic
GoranSMilovanovic added a subtask: T297225: [Current Events] filter out some expected/unneeded Items. TASK DETAIL https://phabricator.wikimedia.org/T283568 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Manuel, Lydia_Pintscher

[Wikidata-bugs] [Maniphest] T297225: [Current Events] filter out some expected/unneeded Items

2021-12-08 Thread GoranSMilovanovic
GoranSMilovanovic added a parent task: T283568: [Epic] Wikidata Analytics Core Codebase Maintenance. TASK DETAIL https://phabricator.wikimedia.org/T297225 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: GoranSMilovanovic

[Wikidata-bugs] [Maniphest] T283568: [Epic] Wikidata Analytics Core Codebase Maintenance

2021-12-08 Thread GoranSMilovanovic
GoranSMilovanovic added a subtask: T297284: Ensure documentation of essential analytics and editor tools. TASK DETAIL https://phabricator.wikimedia.org/T283568 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Manuel

[Wikidata-bugs] [Maniphest] T297284: Ensure documentation of essential analytics and editor tools

2021-12-08 Thread GoranSMilovanovic
GoranSMilovanovic added a parent task: T283568: [Epic] Wikidata Analytics Core Codebase Maintenance. TASK DETAIL https://phabricator.wikimedia.org/T297284 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Aklapper

[Wikidata-bugs] [Maniphest] T283568: [Epic] Wikidata Analytics Core Codebase Maintenance

2021-12-08 Thread GoranSMilovanovic
GoranSMilovanovic added a subtask: T292862: Create an automatically updated dashboard out of the Wikidata Quality Report. TASK DETAIL https://phabricator.wikimedia.org/T283568 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc

[Wikidata-bugs] [Maniphest] T292862: Create an automatically updated dashboard out of the Wikidata Quality Report

2021-12-08 Thread GoranSMilovanovic
GoranSMilovanovic added a parent task: T283568: [Epic] Wikidata Analytics Core Codebase Maintenance. TASK DETAIL https://phabricator.wikimedia.org/T292862 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Aklapper

[Wikidata-bugs] [Maniphest] T296926: Change licensing of Wikidata Analytics repo to BSD 3-Clause

2021-12-08 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Manuel > Sure: There used to be multiple files and with this change, there is now only one. The link in the CurrentEvents footer still says GPL and points to the old file and therefore 404s. (Plus maybe there are other links that need updates as w

[Wikidata-bugs] [Maniphest] T296926: Change licensing of Wikidata Analytics repo to BSD 3-Clause

2021-12-08 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Manuel > One more thing: Could you please update the links to the new URL (e.g. CurrentEvents license link))? Please clarify. There is one LICENSE file for the whole repo. TASK DETAIL https://phabricator.wikimedia.org/T296926 EMAIL PREFEREN

[Wikidata-bugs] [Maniphest] T296926: Change licensing of Wikidata Analytics repo to BSD 3-Clause

2021-12-08 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Manuel Wikidata Analytics <https://github.com/wikimedia/analytics-wmde-WD-WikidataAnalytics> is now BSD 3-Clause licensed <https://github.com/wikimedia/analytics-wmde-WD-WikidataAnalytics/blob/master/LICENSE>. TASK DE

[Wikidata-bugs] [Maniphest] T297225: [Current Events] filter out some expected/unneeded Items

2021-12-07 Thread GoranSMilovanovic
GoranSMilovanovic claimed this task. GoranSMilovanovic added a project: User-GoranSMilovanovic. GoranSMilovanovic added a comment. @Lydia_Pintscher > Example: > The following Items should not show up in the dashboard: > Earth (Q16943273) <- guided tour Item > W

[Wikidata-bugs] [Maniphest] T283574: Wikidata Analytics Data Products: DockerHub/Deployment

2021-12-06 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @WMDE-leszek `docker-compose build` should do (you will find both `docker-compose.yaml` and `Dockerfile` in each directory). **However** I suggest to wait until I merge all the planned changes there (it will happen until the end of December 2021

[Wikidata-bugs] [Maniphest] T283574: Wikidata Analytics Data Products: DockerHub/Deployment

2021-12-06 Thread GoranSMilovanovic
GoranSMilovanovic added a subscriber: Tobi_WMDE_SW. GoranSMilovanovic added a comment. @WMDE-leszek @Tobi_WMDE_SW Please: do we have any feedback here, or do we want to resolve this ticket? Thanks. TASK DETAIL https://phabricator.wikimedia.org/T283574 EMAIL PREFERENCES https

[Wikidata-bugs] [Maniphest] T296926: Change licensing of Wikidata Analytics repo to BSD 3-Clause

2021-12-05 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Manuel Thank you for the clarification! > It also excludes the right to imply that the copyright holder (again, "Wikimedia Deutschland" in this case) or the people involved in creating the original work (e.g. the individu

[Wikidata-bugs] [Maniphest] T296926: Change licensing of Wikidata Analytics repo to BSD 3-Clause

2021-12-05 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Manuel I just mentioned it because the document in relation to WMDE GitHub was referred to in the ticket description, we can change the license anyways I guess. **Q.** As of the following from the BSD 3-Clause <https://opensource.org/licenses/BS

[Wikidata-bugs] [Maniphest] T296926: Change licensing of Wikidata Analytics repo to BSD 3-Clause

2021-12-05 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Manuel **Note.** In relation to > https://docs.google.com/document/d/1ZR5uF7cBUIAmBhkj5AeCkruT7p5fUeJj2qqA-N274pU/edit (internal) The Wikidata Analytics repo is not a WMDE GitHub <https://github.com/wmde> repo. Moreover, I do

[Wikidata-bugs] [Maniphest] T296926: Change licensing to BSD 3-Clause

2021-12-04 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Legoktm Bug? The repo is: https://github.com/wikimedia/analytics-wmde-WD-WikidataAnalytics The system is: https://wikidata-analytics.wmcloud.org TASK DETAIL https://phabricator.wikimedia.org/T296926 EMAIL PREFERENCES https

[Wikidata-bugs] [Maniphest] T294983: User interface changes for Current Events Dashboard

2021-12-03 Thread GoranSMilovanovic
GoranSMilovanovic updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T294983 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Tobi_WMDE_SW, Aklapper, Manuel, Invadibot, maantietaja, Akuckartz, Nandana

[Wikidata-bugs] [Maniphest] T294983: User interface changes for Current Events Dashboard

2021-12-03 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Manuel We are running it in production: https://wikidata-analytics.wmcloud.org/app/CurrentEvents TASK DETAIL https://phabricator.wikimedia.org/T294983 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences

[Wikidata-bugs] [Maniphest] T294983: User interface changes for Current Events Dashboard

2021-12-03 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Manuel Building the Docker image for Current Events is taking some time on macOS (this is due to my inexperience - I should have used my Debian server instead). I will ping back here as soon as the image is rendered and deployed to CloudVPS. Everything

[Wikidata-bugs] [Maniphest] T294983: User interface changes for Current Events Dashboard

2021-12-03 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Manuel We already have a concise README file created yesterday. I am building the image now and deploying the Current Events in production immediately. I will ping back here when the system is online. TASK DETAIL https://phabricator.wikimedia.org

[Wikidata-bugs] [Maniphest] T296387: Some tables show wrong or incomplete information on Current Events dashboard

2021-12-03 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Manuel Following our 1:1 - the criterion to keep the top 100 items per table is in force now in the test environment <http://datakolektiv.org/app/QURATOR_CurrentEvents>; - the table loading times have significantly improved; - I am p

[Wikidata-bugs] [Maniphest] T296387: Some tables show wrong or incomplete information on Current Events dashboard

2021-12-03 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Manuel > Filters: > min 2 editors > max 100 lines per table from top Please be reminded that we already keep items with `min 2 editors`, and if we go for `max 100 lines per table` then we will end up filtering out items that indeed h

[Wikidata-bugs] [Maniphest] T296387: Some tables show wrong or incomplete information on Current Events dashboard

2021-12-03 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Manuel @Tobi_WMDE_SW To clarify a bit: - if we keep the top 100 items per number of editors, then the top 100 in the 72h dataset might encompass all items with at least, say, 7 editors, while in the 6h dataset at the same time we could have

[Wikidata-bugs] [Maniphest] T294983: User interface changes for Current Events Dashboard

2021-12-02 Thread GoranSMilovanovic
GoranSMilovanovic added a subscriber: Tobi_WMDE_SW. GoranSMilovanovic added a comment. @Manuel @Tobi_WMDE_SW > Create a short Current Events README **Done.** N.B. I think we would need to include the description of the filtering criteria used on the dashboard in the README file o

[Wikidata-bugs] [Maniphest] T294983: User interface changes for Current Events Dashboard

2021-12-02 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. > Remove Constraint Violation Checker for now. **Done**: please check in the test environment <http://datakolektiv.org/app/QURATOR_CurrentEvents>. TASK DETAIL https://phabricator.wikimedia.org/T294983 EMAIL PREFERENCE

[Wikidata-bugs] [Maniphest] T294983: User interface changes for Current Events Dashboard

2021-12-02 Thread GoranSMilovanovic
GoranSMilovanovic updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T294983 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Aklapper, Manuel, Invadibot, maantietaja, Akuckartz, Nandana, Lahi, Gq86

[Wikidata-bugs] [Maniphest] T296387: Some tables show wrong or incomplete information on Current Events dashboard

2021-12-02 Thread GoranSMilovanovic
GoranSMilovanovic added a subscriber: Tobi_WMDE_SW. GoranSMilovanovic added a comment. @Manuel @Tobi_WMDE_SW > The code for label lookup can live in the client JS or on the server. Who in the WMDE is our JS specialist so that I can get in touch with them? I don't do JS as you k

[Wikidata-bugs] [Maniphest] T296926: Change licensing to BSD 3-Clause

2021-12-02 Thread GoranSMilovanovic
GoranSMilovanovic claimed this task. GoranSMilovanovic added a project: User-GoranSMilovanovic. TASK DETAIL https://phabricator.wikimedia.org/T296926 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: WMDE-leszek, Tobi_WMDE_SW

[Wikidata-bugs] [Maniphest] T296926: Change licensing to BSD 3-Clause

2021-12-02 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Manuel > We want BSD 3-Clause ideally. To do. Thanks. TASK DETAIL https://phabricator.wikimedia.org/T296926 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: WMDE-les

[Wikidata-bugs] [Maniphest] T296926: Clarify licensing

2021-12-02 Thread GoranSMilovanovic
GoranSMilovanovic added a subscriber: WMDE-leszek. GoranSMilovanovic added a comment. @WMDE-leszek I don't think we really need lawyers to decide upon our licences. However, I really would to hear from @Manuel and others as well. Back then when I've started doing analytics for Wikidata GPLv2

[Wikidata-bugs] [Maniphest] T296926: Clarify licensing

2021-12-02 Thread GoranSMilovanovic
GoranSMilovanovic added a subscriber: Tobi_WMDE_SW. GoranSMilovanovic added a comment. @Manuel > Based on input from iRights.Law: If you're unsure which license to pick, normally choose Modified-BSD(called ‘BSD 3-Clause "New" or "Revised" License’ in the

[Wikidata-bugs] [Maniphest] T294983: User interface changes for Current Events Dashboard

2021-11-30 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. > I need to fix the Current Events README too > What would you suggest? A quick overview should do in this case, right? Exactly. I will take care of it don't worry; I've just mentioned that as a sort of reminder. TASK DETAIL

[Wikidata-bugs] [Maniphest] T296387: Some tables show wrong or incomplete information on Current Events dashboard

2021-11-30 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Manuel > Loading times are a nightmare now.. can you test to cut off each table after the top 100 entries? **To Do** > This would work for now, but the better alternative would be to implement the label lookup in the backend.

[Wikidata-bugs] [Maniphest] T296387: Some tables show wrong or incomplete information on Current Events dashboard

2021-11-28 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Manuel To clarify and help you follow the developments here: I think the whole problem was related to filtering out items based on their revision frequencies ranks, and not absolute revision frequencies. The frequency revision ranks could have

[Wikidata-bugs] [Maniphest] T294983: User interface changes for Current Events Dashboard

2021-11-28 Thread GoranSMilovanovic
GoranSMilovanovic updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T294983 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Aklapper, Manuel, Invadibot, maantietaja, Akuckartz, Nandana, Lahi, Gq86

[Wikidata-bugs] [Maniphest] T294983: User interface changes for Current Events Dashboard

2021-11-28 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Manuel > include “user feedback” for empty tables **Done.** TASK DETAIL https://phabricator.wikimedia.org/T294983 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Aklapper, Man

[Wikidata-bugs] [Maniphest] T296387: Some tables show wrong or incomplete information on Current Events dashboard

2021-11-28 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Manuel This is possibly fixed now in the test environment <http://datakolektiv.org/app/QURATOR_CurrentEvents>, but we need another decision now: - in order to fix this obvious and annoying bug I removed **all filtering** of items tha

[Wikidata-bugs] [Maniphest] T294983: User interface changes for Current Events Dashboard

2021-11-28 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Manuel Reminder on ToDos here: > The browser title reads “Current Events Dashboard” (it currently shows "Qurator...") This will be fixed with the deployment in production; ShinyProxy server settings determine the title of the ap

[Wikidata-bugs] [Maniphest] T294983: User interface changes for Current Events Dashboard

2021-11-28 Thread GoranSMilovanovic
GoranSMilovanovic updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T294983 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Aklapper, Manuel, Invadibot, maantietaja, Akuckartz, Nandana, Lahi, Gq86

[Wikidata-bugs] [Maniphest] T294983: User interface changes for Current Events Dashboard

2021-11-28 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Manuel > Footer in the simple ("Made by the Wikimedia development team" etc) or ideally the new and advanced layout This is implemented in the test environment <http://datakolektiv.org/app/QURATOR_CurrentEvents> now,

[Wikidata-bugs] [Maniphest] T294983: User interface changes for Current Events Dashboard

2021-11-28 Thread GoranSMilovanovic
GoranSMilovanovic updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T294983 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: GoranSMilovanovic Cc: Aklapper, Manuel, Invadibot, maantietaja, Akuckartz, Nandana, Lahi, Gq86

[Wikidata-bugs] [Maniphest] T296387: Some tables show wrong or incomplete information on Current Events dashboard

2021-11-28 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Manuel - Found one possible (and most probable) cause of the anomaly; - fixed; - restarted the update engine in the test environment <http://datakolektiv.org/app_direct/QURATOR_CurrentEvents/>; - monitoring. TASK DETAIL

[Wikidata-bugs] [Maniphest] T296387: Some tables show wrong or incomplete information on Current Events dashboard

2021-11-26 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. The anomaly **is now observed** in the test environment <http://datakolektiv.org/app/QURATOR_CurrentEvents>: complete code evaluation of the dashboard's update engine will take place following the implementation of changes requested in T294983

[Wikidata-bugs] [Maniphest] T296387: Some tables show wrong or incomplete information on Current Events dashboard

2021-11-25 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. > Logic dictates that all 6h should be included in 24h, all 24h should be included in 48h, and all 48h should be included in 72h. This is still not the case, so something *must* be wrong here. This anomaly is not present in the **restarted** t

[Wikidata-bugs] [Maniphest] T294983: User interface changes for Current Events Dashboard

2021-11-25 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. > No "Frequently revised items in the previous 72 hours" shown **Fixed** in the test environment <http://datakolektiv.org/app/QURATOR_CurrentEvents>. TASK DETAIL https://phabricator.wikimedia.org/T294983 EMAIL

[Wikidata-bugs] [Maniphest] T294983: User interface changes for Current Events Dashboard

2021-11-25 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Manuel T294983#7529722 <https://phabricator.wikimedia.org/T294983#7529722> > change the order of the tables from 6h-72h to 72h-6h (so that the first table shown will always be filled) **Fixed** in the test environme

[Wikidata-bugs] [Maniphest] T294983: User interface changes for Current Events Dashboard

2021-11-24 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Manuel Please let's follow the changes in the test environment <http://datakolektiv.org/app/QURATOR_CurrentEvents> first: > As we are sorting for Editors first and Revisions second, they should also appear in that order (as seen in t

[Wikidata-bugs] [Maniphest] T296387: Some tables show wrong or incomplete information on Current Events dashboard

2021-11-24 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. > Logic dictates that all 6h should be included in 24h, all 24h should be included in 48h, and all 48h should be included in 72h. This is still not the case, so something *must* be wrong here. I have restarted the update engine on the test ser

[Wikidata-bugs] [Maniphest] T294983: User interface changes for Current Events Dashboard

2021-11-18 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Manuel Re: T294983#7509866 <https://phabricator.wikimedia.org/T294983#7509866> > The dashboard is currently sorting out its findings by number of revisions - bug fix! Actually, it is not sorting by number of revisions, I have jus

[Wikidata-bugs] [Maniphest] T294985: Show up-to-date labels in Current Events Dashboard

2021-11-18 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Manuel > In addition to that: Let's please also filter out all Items that were edited by only 1 editor. This should significantly improve the delay! Implemented, deployed. TASK DETAIL https://phabricator.wikimedia.org/T294985 EMAIL PREFEREN

[Wikidata-bugs] [Maniphest] T294983: User interface changes for Current Events Dashboard

2021-11-17 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Manuel @GoranSMilovanovic > Can you please check whether the tabs are named correctly? There seems to be a mix-up of some sort. The dashboard is currently sorting out its findings by number of revisions - bug fix! TASK DETAIL ht

[Wikidata-bugs] [Maniphest] T294985: Show up-to-date labels in Current Events Dashboard

2021-11-17 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Manuel > There is a noticeable delay now in my setup. How long is the delay, approximately? > In addition to that: Let's please also filter out all Items that were edited by only 1 editor. This should significantly improve the delay!

[Wikidata-bugs] [Maniphest] T294983: User interface changes for Current Events Dashboard

2021-11-17 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. > Name and title read “Wikidata Current Events Dashboard” (text not picture, if at all possible) Not possible. @Manuel: I am not a web designer. In serving dashboards, I work with limited possibilities offered by the RStudio Shiny framework, wh

[Wikidata-bugs] [Maniphest] T294984: Filter noise out of Current Events

2021-11-16 Thread GoranSMilovanovic
GoranSMilovanovic added a comment. @Manuel - we are filtering all bot revisions now; - the transition is seamless: the old data (including bot edits) will remain on the dashboard until they are washed out by the new data in the following days. TASK DETAIL https

  1   2   3   4   5   6   7   8   9   >