[Wikidata-bugs] [Maniphest] T314133: Allow recording Wikibase REST API usage for Wikidata monitoring and metrics

WMDE-leszek closed this task as "Resolved". WMDE-leszek claimed this task. TASK DETAIL https://phabricator.wikimedia.org/T314133 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: WMDE-leszek Cc: Ollie.Shotton_WMDE, Michael, Silvan_WMDE, ItamarWMDE, Manu

[Wikidata-bugs] [Maniphest] T314133: Allow recording Wikibase REST API usage for Wikidata monitoring and metrics

WMDE-leszek removed a parent task: T327154: Create a basic monitoring of usage of Wikibase REST API on wikidata. TASK DETAIL https://phabricator.wikimedia.org/T314133 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: WMDE-leszek Cc: Ollie.Shotton_WMDE,

[Wikidata-bugs] [Maniphest] T314133: Allow recording Wikibase REST API usage for Wikidata monitoring and metrics

Manuel added a comment. > To know ALL request Hadoop is the way to go IMO. Yes, that's true, we will have to keep that in mind! We will be able to measure the gap by comparing the results based on the two sources to see how urgent this is. Also, the Grafana dashboard seems to not se

[Wikidata-bugs] [Maniphest] T314133: Allow recording Wikibase REST API usage for Wikidata monitoring and metrics

WMDE-leszek added a comment. @Manuel as a note, it really depends what one wants to find out. Data which Mediawiki sends to Graphite only records request that made it to mediawiki - will not show that a certain request are made many times more but cached etc. To know ALL request Hadoop i

[Wikidata-bugs] [Maniphest] T314133: Allow recording Wikibase REST API usage for Wikidata monitoring and metrics

Manuel added a comment. Update: Using an approach based on Grafana and Graphite seems more feasible than going the Hive/Hadoop route. For privacy reasons, the relevant data in Hive/Hadoop is limited to the last 30 days. Also, this data is available only in an almost raw and hard-to-use

[Wikidata-bugs] [Maniphest] T314133: Allow recording Wikibase REST API usage for Wikidata monitoring and metrics

Manuel added a parent task: T327154: Create a basic monitoring of usage of Wikibase REST API on wikidata. TASK DETAIL https://phabricator.wikimedia.org/T314133 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Manuel Cc: Michael, Silvan_WMDE, ItamarWMD

[Wikidata-bugs] [Maniphest] T314133: Allow recording Wikibase REST API usage for Wikidata monitoring and metrics

WMDE-leszek added a comment. With confirmed by querying Wikimedia Hadoop that request data is actually being recorded for any visualization or analysis that'd be intended. TASK DETAIL https://phabricator.wikimedia.org/T314133 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/p

[Wikidata-bugs] [Maniphest] T314133: Allow recording Wikibase REST API usage for Wikidata monitoring and metrics

Lydia_Pintscher added a comment. The Wikidata team ticket for visualizing the metrics is now in T326724 . TASK DETAIL https://phabricator.wikimedia.org/T314133 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/

[Wikidata-bugs] [Maniphest] T314133: Allow recording Wikibase REST API usage for Wikidata monitoring and metrics

WMDE-leszek added a parent task: T320470: "Non-functional" blockers of delivering Wikibase REST API to production Wikidata. TASK DETAIL https://phabricator.wikimedia.org/T314133 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: WMDE-leszek Cc: Silvan_W

[Wikidata-bugs] [Maniphest] T314133: Allow recording Wikibase REST API usage for Wikidata monitoring and metrics

Silvan_WMDE added a comment. Notes from Backlog Refinement: 1. Figure out if the relevant data (number of requests and request execution time) can be found in Hadoop logs already and whether it is sufficient for Wikidata's tracking needs 2. If not, define what service interface wikidat

[Wikidata-bugs] [Maniphest] T314133: Allow recording Wikibase REST API usage for Wikidata monitoring and metrics

Manuel added projects: Wikidata Analytics, Wikidata. TASK DETAIL https://phabricator.wikimedia.org/T314133 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: Manuel Cc: ItamarWMDE, Manuel, Lydia_Pintscher, WMDE-leszek, Addshore, Aklapper, Astuthiodit_1,