[Wikidata-bugs] [Maniphest] T323066: Understand meaning of trafficserver wdqs request data vs turnilo webrequest data

2022-12-09 Thread Gehel 
Gehel closed this task as "Resolved".

TASK DETAIL
  https://phabricator.wikimedia.org/T323066

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: RKemper, Gehel
Cc: bking, Aklapper, Gehel, RKemper, Astuthiodit_1, AWesterinen, karapayneWMDE, 
Invadibot, MPhamWMF, maantietaja, CBogen, ItamarWMDE, Akuckartz, Nandana, 
Namenlos314, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, 
EBjune, merbst, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, 
jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T323066: Understand meaning of trafficserver wdqs request data vs turnilo webrequest data

2022-12-06 Thread RKemper 
RKemper moved this task from In Progress to Needs Reporting on the 
Discovery-Search (Current work) board.
RKemper added a comment.


  Given the above, we're pretty confident that after accounting for cache 
misses and bucketing the turnilo vs graphite data similarly, that we see pretty 
much the same numbers.

TASK DETAIL
  https://phabricator.wikimedia.org/T323066

WORKBOARD
  https://phabricator.wikimedia.org/project/board/1227/

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: RKemper
Cc: bking, Aklapper, Gehel, RKemper, Astuthiodit_1, AWesterinen, karapayneWMDE, 
Invadibot, MPhamWMF, maantietaja, CBogen, ItamarWMDE, Akuckartz, Nandana, 
Namenlos314, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, 
EBjune, merbst, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, 
jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T323066: Understand meaning of trafficserver wdqs request data vs turnilo webrequest data

2022-12-06 Thread RKemper 
RKemper added a comment.


  F35842059: image.png 
  
  F35842062: image.png 
  
  Okay so ultimately we got the two data sources to be in alignment by:
  
  - Switching the graphite query to use `last_over_time`: 
`last_over_time((sum(increase(trafficserver_backend_requests_seconds_count{backend="wdqs.discovery.wmnet",
 site="eqiad"}[1h])) / 128)[1h:1h])`
  - Making turnilo filter for `X Cache` = .*miss.*pass; `Uri Path` = `/sparql` 
(the `X Cache` part is the actually important part).
  
  Now looking at the two graphs side-by-side the shape is the same and 
furthermore the raw numbers look very similar.

TASK DETAIL
  https://phabricator.wikimedia.org/T323066

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: RKemper
Cc: bking, Aklapper, Gehel, RKemper, Astuthiodit_1, AWesterinen, karapayneWMDE, 
Invadibot, MPhamWMF, maantietaja, CBogen, ItamarWMDE, Akuckartz, Nandana, 
Namenlos314, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, 
EBjune, merbst, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, 
jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T323066: Understand meaning of trafficserver wdqs request data vs turnilo webrequest data

2022-12-06 Thread RKemper 
RKemper added a comment.


  Looked at 
`sum(increase(trafficserver_backend_requests_seconds_count{status="200", 
backend="wdqs.discovery.wmnet", site="$Datacenter"}[60m]))  / 128` on Graphite 
vs the turnilo data. General shape is mostly the same but the numbers we 
ultimately see are sometimes a bit different, such as a peak of 7.5k for 
turnilo vs ~4.5k for Graphite. Difference might just be cached requests on the 
turnilo side.

TASK DETAIL
  https://phabricator.wikimedia.org/T323066

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: RKemper
Cc: bking, Aklapper, Gehel, RKemper, Astuthiodit_1, AWesterinen, karapayneWMDE, 
Invadibot, MPhamWMF, maantietaja, CBogen, ItamarWMDE, Akuckartz, Nandana, 
Namenlos314, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, 
EBjune, merbst, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, 
jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T323066: Understand meaning of trafficserver wdqs request data vs turnilo webrequest data

2022-11-23 Thread RKemper 
RKemper added a comment.


  Comparing grafana 

 to turnilo 
,
 the graphs seem more or less aligned as far as the shapes of the graphs are 
concerned.
  
  Per 
https://wikitech.wikimedia.org/wiki/Analytics/Data_Lake/Traffic/Webrequest#Pipeline,
 it looks like the turnilo data is ultimately coming from Varnish.
  
  Our data in grafana comes from 
`trafficserver_backend_requests_seconds_count`. I think my interpretation is 
that that means this data is not concerned with the in-memory responses from 
Varnish (the in-memory caching frontend). We're under the impression that there 
are very few cache hits with WDQS, but we might want to validate the assumption.
  
  Currently when we do some math to normalize the turnilo vs grafana data (for 
grafana that means multiplying our requests/sec count by 300 to turn it into a 
5 minute count and then dividing by 128 to account for the sampling turnilo is 
doing), the raw numbers we see for e.g. 200 responses seems to be higher in 
Turnilo by a factor of between 2-8x depending on the time we look at. Not sure 
what this means; there is likely something we don't fully understand about how 
the hits are counted.

TASK DETAIL
  https://phabricator.wikimedia.org/T323066

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: RKemper
Cc: bking, Aklapper, Gehel, RKemper, Astuthiodit_1, AWesterinen, karapayneWMDE, 
Invadibot, MPhamWMF, maantietaja, CBogen, ItamarWMDE, Akuckartz, Nandana, 
Namenlos314, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, 
EBjune, merbst, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, 
jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T323066: Understand meaning of trafficserver wdqs request data vs turnilo webrequest data

2022-11-22 Thread RKemper 
RKemper updated the task description.

TASK DETAIL
  https://phabricator.wikimedia.org/T323066

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: RKemper
Cc: bking, Aklapper, Gehel, RKemper, Astuthiodit_1, AWesterinen, karapayneWMDE, 
Invadibot, MPhamWMF, maantietaja, CBogen, ItamarWMDE, Akuckartz, Nandana, 
Namenlos314, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, 
EBjune, merbst, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, 
jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T323066: Understand meaning of trafficserver wdqs request data vs turnilo webrequest data

2022-11-22 Thread RKemper 
RKemper updated the task description.

TASK DETAIL
  https://phabricator.wikimedia.org/T323066

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: RKemper
Cc: bking, Aklapper, Gehel, RKemper, Astuthiodit_1, AWesterinen, karapayneWMDE, 
Invadibot, MPhamWMF, maantietaja, CBogen, ItamarWMDE, Akuckartz, Nandana, 
Namenlos314, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, 
EBjune, merbst, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, 
jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T323066: Understand meaning of trafficserver wdqs request data vs turnilo webrequest data

2022-11-21 Thread Gehel 
Gehel set the point value for this task to "5".

TASK DETAIL
  https://phabricator.wikimedia.org/T323066

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: RKemper, Gehel
Cc: bking, Aklapper, Gehel, RKemper, Astuthiodit_1, AWesterinen, karapayneWMDE, 
Invadibot, MPhamWMF, maantietaja, CBogen, ItamarWMDE, Akuckartz, Nandana, 
Namenlos314, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, 
EBjune, merbst, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, 
jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T323066: Understand meaning of trafficserver wdqs request data vs turnilo webrequest data

2022-11-21 Thread Gehel 
Gehel updated the task description.

TASK DETAIL
  https://phabricator.wikimedia.org/T323066

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: RKemper, Gehel
Cc: bking, Aklapper, Gehel, RKemper, Astuthiodit_1, AWesterinen, karapayneWMDE, 
Invadibot, MPhamWMF, maantietaja, CBogen, ItamarWMDE, Akuckartz, Nandana, 
Namenlos314, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, 
EBjune, merbst, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, 
jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T323066: Understand meaning of trafficserver wdqs request data vs turnilo webrequest data

2022-11-21 Thread Gehel 
Gehel updated the task description.

TASK DETAIL
  https://phabricator.wikimedia.org/T323066

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: RKemper, Gehel
Cc: bking, Aklapper, Gehel, RKemper, Astuthiodit_1, AWesterinen, karapayneWMDE, 
Invadibot, MPhamWMF, maantietaja, CBogen, ItamarWMDE, Akuckartz, Nandana, 
Namenlos314, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, 
EBjune, merbst, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, 
jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T323066: Understand meaning of trafficserver wdqs request data vs turnilo webrequest data

2022-11-21 Thread Gehel 
Gehel triaged this task as "High" priority.

TASK DETAIL
  https://phabricator.wikimedia.org/T323066

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: RKemper, Gehel
Cc: Aklapper, Gehel, RKemper, Astuthiodit_1, AWesterinen, karapayneWMDE, 
Invadibot, MPhamWMF, maantietaja, CBogen, ItamarWMDE, Akuckartz, Nandana, 
Namenlos314, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, 
EBjune, merbst, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, 
jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org

[Wikidata-bugs] [Maniphest] T323066: Understand meaning of trafficserver wdqs request data vs turnilo webrequest data

2022-11-14 Thread RKemper 
RKemper created this task.
RKemper added projects: Wikidata-Query-Service, Wikidata, Discovery-Search 
(Current work).

TASK DESCRIPTION
  We've got our (WIP) WDQS uptime SLO dashboard 
.
 Separately, there's similar-but-different data in Turnilo here 
. Given that we're relying on this data to create our SLO, 
we should understand the two separate data sources and what they actually mean.

TASK DETAIL
  https://phabricator.wikimedia.org/T323066

EMAIL PREFERENCES
  https://phabricator.wikimedia.org/settings/panel/emailpreferences/

To: RKemper
Cc: Aklapper, Gehel, RKemper, Astuthiodit_1, AWesterinen, karapayneWMDE, 
Invadibot, MPhamWMF, maantietaja, CBogen, ItamarWMDE, Akuckartz, Nandana, 
Namenlos314, Lahi, Gq86, Lucas_Werkmeister_WMDE, GoranSMilovanovic, QZanden, 
EBjune, merbst, LawExplorer, _jensen, rosalieper, Scott_WUaS, Jonas, Xmlizer, 
jkroll, Wikidata-bugs, Jdouglas, aude, Tobias1984, Manybubbles, Mbch331
___
Wikidata-bugs mailing list -- wikidata-bugs@lists.wikimedia.org
To unsubscribe send an email to wikidata-bugs-le...@lists.wikimedia.org