[Wikidata-bugs] [Maniphest] T299571: Input on how we could integrate data analytics in our dev team

[Manuel]

Manuel closed this task as "Resolved".
Manuel added a comment.


  Thank you for your input, it will definitely help!

TASK DETAIL
  https://phabricator.wikimedia.org/T299571

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: GoranSMilovanovic, Manuel
Cc: Tobi_WMDE_SW, GoranSMilovanovic, Manuel, Aklapper, Invadibot, maantietaja, 
Akuckartz, Nandana, Lahi, Gq86, QZanden, LawExplorer, _jensen, rosalieper, 
Scott_WUaS, Wikidata-bugs, aude, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T299571: Input on how we could integrate data analytics in our dev team

[GoranSMilovanovic]

GoranSMilovanovic added a subscriber: Tobi_WMDE_SW.
GoranSMilovanovic added a comment.


  @Manuel @Tobi_WMDE_SW
  
  Here 

 is how I think about what WMDE can do in order to address the questions posed 
in the ticket description.
  
  In short:
  
  - for any analytical report on Wikidata, your formula is: SQL/HiveQL/Pyspark 
(to produce the data) + MediaWiki/JS `D3` library to serve the reports;
  - for time-series dashboards you have the Graphite/Grafana stack already 
running;
  - for more complicate dashboards as I am running in Wikidata Analytics 
: you need 
someone to pick-up the Python/Plotly/Dash/Flask stack if you do not want to 
stay in R and you probably do not (since you need to hire an R specialist like 
me again), and
  - for the Wikidata Analytics Portal 
: you leave it to 
me to maintain it on volunteer basis as of April 2022, which I will gladly do, 
since the transfer of that codebase would ask (a) for another experienced R 
professional for whom (b) it would again take a lot of time to take over the 
whole codebase that is a result of my five-year long development efforts.

TASK DETAIL
  https://phabricator.wikimedia.org/T299571

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: GoranSMilovanovic
Cc: Tobi_WMDE_SW, GoranSMilovanovic, Manuel, Aklapper, Invadibot, maantietaja, 
Akuckartz, Nandana, Lahi, Gq86, QZanden, LawExplorer, _jensen, rosalieper, 
Scott_WUaS, Wikidata-bugs, aude, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T299571: Input on how we could integrate data analytics in our dev team

[Manuel]

Manuel created this task.
Manuel added projects: Wikidata, Wikidata Analytics.
Restricted Application added a subscriber: Aklapper.

TASK DESCRIPTION
  **Problem:**
  Right now our analytics and dev teams and infrastructure seem unnecessarily 
separated. In the past this set-up has sometimes led to redundant work being 
done, a lack of mutual integration, and more centralized knowledge than is 
optimal.
  
  **Solution:**
  In the future, we might move at least a part of the analytics role to the 
Wikidata dev team.
  
  **Acceptance criteria:**
  Please give your input on this and share it with Tobi and Manuel.

TASK DETAIL
  https://phabricator.wikimedia.org/T299571

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: GoranSMilovanovic, Manuel
Cc: GoranSMilovanovic, Manuel, Aklapper, Invadibot, maantietaja, Akuckartz, 
Nandana, Lahi, Gq86, QZanden, LawExplorer, _jensen, rosalieper, Scott_WUaS, 
Wikidata-bugs, aude, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org