[Wikidata-bugs] [Maniphest] T294355: Several Wikidata Grafana boards missing data before October 2022

[fgiunchedi]

fgiunchedi added a comment.


  @Lucas_Werkmeister_WMDE thank you for the report. Yes pretty sure the 
graphite bullseye migration is related. We backfilled graphite1004 from 
graphite2003 (which in turn was the first host we reimaged, and backfilled it 
from graphite1004), I suspect some metric files did backfill fully and some 
others didn't (I don't know why exactly yet).
  
  I verified taking one of your examples for mediawiki API 
`/srv/carbon/whisper/MediaWiki/api/query/executeTiming/sample_rate.wsp` has 
historical data on graphite2003 but not graphite1004 (as experienced). So I 
think what's needed is to run a backfill again (on the metrics that we know are 
missing data first), this is a safe operation because data gets merged. I'll 
try that tomorrow and report back my findings.

TASK DETAIL
  https://phabricator.wikimedia.org/T294355

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: fgiunchedi
Cc: fgiunchedi, Aklapper, Lucas_Werkmeister_WMDE, Invadibot, maantietaja, 
Akuckartz, Nandana, Robin.guo, Lahi, Gq86, GoranSMilovanovic, QZanden, 
LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T294355: Several Wikidata Grafana boards missing data before October 2022

[Lucas_Werkmeister_WMDE]

Lucas_Werkmeister_WMDE added a subscriber: fgiunchedi.
Lucas_Werkmeister_WMDE added a comment.


  SAL says  that 
graphite1004 was reimaged to bullseye on 2021-10-21 7:56 UTC. @fgiunchedi do 
you think this could be related? (Though it wouldn’t really explain why some 
other metrics seem to have an earlier cutoff date… I’m just guessing here so 
far.)

TASK DETAIL
  https://phabricator.wikimedia.org/T294355

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Lucas_Werkmeister_WMDE
Cc: fgiunchedi, Aklapper, Lucas_Werkmeister_WMDE, Invadibot, maantietaja, 
Akuckartz, Nandana, Robin.guo, Lahi, Gq86, GoranSMilovanovic, QZanden, 
LawExplorer, _jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T294355: Several Wikidata Grafana boards missing data before October 2022

[Lucas_Werkmeister_WMDE]

Lucas_Werkmeister_WMDE added a comment.


  This might also affect non-Wikidata boards; for example, on API request rate 
(top 10) 
,
 the `query`, `parse` and `stashedit` lines all start 2021-10-21.
  F34712058: Screenshot 2021-10-26 at 16-55-58 API backend summary - 
Grafana.png 

TASK DETAIL
  https://phabricator.wikimedia.org/T294355

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Lucas_Werkmeister_WMDE
Cc: Aklapper, Lucas_Werkmeister_WMDE, Invadibot, maantietaja, Akuckartz, 
Nandana, Robin.guo, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, 
_jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Mbch331, fgiunchedi
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T294355: Several Wikidata Grafana boards missing data before October 2022

[Lucas_Werkmeister_WMDE]

Lucas_Werkmeister_WMDE triaged this task as "High" priority.

TASK DETAIL
  https://phabricator.wikimedia.org/T294355

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Lucas_Werkmeister_WMDE
Cc: Aklapper, Lucas_Werkmeister_WMDE, Invadibot, maantietaja, Akuckartz, 
Nandana, Robin.guo, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, 
_jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Mbch331, fgiunchedi
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T294355: Several Wikidata Grafana boards missing data before October 2022

[Lucas_Werkmeister_WMDE]

Lucas_Werkmeister_WMDE created this task.
Lucas_Werkmeister_WMDE added projects: Graphite, Wikidata.
Restricted Application added a subscriber: Aklapper.

TASK DESCRIPTION
  On several Wikidata-related Grafana dashboards, metrics that should go back 
several years seem to be truncated recently:
  
  - Wikidata Datamodel 
,
 number of Items under Entities by type, Property Size under Average entity 
sizes
  - Wikidata Datamodel Statements 
,
 Item Statements, Average/Max Statements per Item/Property
  - Wikidata Datamodel Lexemes 
,
 many Lexeme languages, Lexemes by lexical category, etc.
  - Wikidata Social Followers 

  
  In many cases the metrics appear to start on 2021-10-22, but there are also 
some other dates, such as 2021-10-12 here:
  F34712050: Screenshot 2021-10-26 at 16-49-02 Wikidata Datamodel Lexemes - 
Grafana.png 
  
  Can we a) figure out why the old data is gone, and b) restore it?

TASK DETAIL
  https://phabricator.wikimedia.org/T294355

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: Lucas_Werkmeister_WMDE
Cc: Aklapper, Lucas_Werkmeister_WMDE, Invadibot, maantietaja, Akuckartz, 
Nandana, Robin.guo, Lahi, Gq86, GoranSMilovanovic, QZanden, LawExplorer, 
_jensen, rosalieper, Scott_WUaS, Wikidata-bugs, aude, Mbch331, fgiunchedi
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org