RKemper created this task.
RKemper added a project: Wikidata-Query-Service.
Restricted Application added a subscriber: Aklapper.
Restricted Application added a project: Wikidata.
TASK DESCRIPTION
We have already done the reload on `wdqs1010`, so now we need to xfer to the
various other
RKemper added a comment.
`wdqs1010` is one of our test servers
Therefore can screw up `wdqs1010` as much as we want, but not the others
---
we need to transfer that data to each server
which implies we need to open a port for data transfer
we have 2 primary DC: eqiad and
RKemper added a comment.
should also circle back and fix
https://github.com/wikimedia/puppet/blob/production/manifests/site.pp#L2207-L2242,`
wdqs200[78]` are declared twice
TASK DETAIL
https://phabricator.wikimedia.org/T252068
EMAIL PREFERENCES
https://phabricator.wikimedia.org
RKemper added a comment.
Data transfer is done across all instances as of last friday, along with a
wdqs-categories reload that we tacked on.
Circling back to mark this ticket as done.
TASK DETAIL
https://phabricator.wikimedia.org/T252068
EMAIL PREFERENCES
https
RKemper closed subtask T252068: WQDS Data Reload as "Resolved".
TASK DETAIL
https://phabricator.wikimedia.org/T245135
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: RKemper
Cc: Lucas_Werkmeister_WMDE, Aklapper, Dipsacus_fullon
RKemper closed this task as "Resolved".
RKemper added a comment.
Still need to circle back to dependent tickets and verify that those problems
are solved
TASK DETAIL
https://phabricator.wikimedia.org/T252068
EMAIL PREFERENCES
https://phabricator.wikimedia.org/sett
RKemper closed subtask T252068: WQDS Data Reload as "Resolved".
TASK DETAIL
https://phabricator.wikimedia.org/T240831
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: RKemper
Cc: Gehel, Aklapper, Mbch331, CBogen, darthmon_wmde, Nandana,
RKemper closed subtask T252068: WQDS Data Reload as "Resolved".
TASK DETAIL
https://phabricator.wikimedia.org/T230588
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: Zbyszko, RKemper
Cc: Ghuron, Nikki, Toni_001, Dipsacus_fullon
RKemper renamed this task from "wdqs admins should have access to nginx logs on
wdqs machines" to "wdqs admins should have access to nginx logs, jstack on wdqs
machines".
TASK DETAIL
https://phabricator.wikimedia.org/T258739
EMAIL PREFERENCES
https://phabricator.wi
RKemper added a project: Sustainability (Incident Followup).
TASK DETAIL
https://phabricator.wikimedia.org/T258739
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: RKemper
Cc: RKemper, CDanis, dcausse, Aklapper, Dzahn, lmata, Alter-paule, Beast1978
RKemper added a comment.
We discussed this during this week's SRE meeting and resolved to enable full
root access for wdqs admins, rather than granularly expanding access one file
at a time. This also lines up better with how we currently manage
Elasticsearch, where admins have root a
RKemper added a comment.
dumpsgen 58563 0.0 0.0 4276 700 ?Ss 20:50 0:00 /bin/sh
-c python3 /srv/deployment/dumps/dumps/xmldumps-backup/generatemiscdumps.py
--configfile /etc/dumps/confs/addschanges.conf --dumptype incrdumps --quiet
dumpsgen 58565 0.0 0.0 57976
RKemper moved this task from Needs review to Needs Reporting on the
Discovery-Search (Current work) board.
RKemper added a comment.
We'll want to monitor across the next week to verify all looks good.
TASK DETAIL
https://phabricator.wikimedia.org/T261204
WORKBOARD
RKemper moved this task from Needs Review to Done on the Data-Platform-SRE
(2024.04.15 - 2024.05.05) board.
RKemper closed this task as "Resolved".
RKemper added a comment.
Here's an example CURL command we can use to verify when the service is
properly supporting `application
RKemper added a comment.
We'll use wdqs2023 to compare against wdqs1023 (same hardware). 1023 is
scholarly-articles so that's what we'll want to load 2023 with.
TASK DETAIL
https://phabricator.wikimedia.org/T362920
EMAIL PREFERENCES
https://phabricator.wikimedia.org
RKemper added a comment.
Actually we'll use `wdqs1021` since we're not confident NFS will work
seamlessly between eqiad and codfw (we use nsf to procure the dumps that the
data-reload is run from).
Gearing up to kick off a data reload on `wdqs1021` after a quick patch to
ena
RKemper added a subscriber: dcausse.
RKemper added a comment.
I'm realizing I don't remember enough about how we load specific graph splits
(scholarly vs main). But it's possible we won't need the above nfs patch if our
previous process was to manually download th
RKemper added a comment.
@dr0ptp4kt
> we saw that this took about 3702 minutes, or about 2.57 //hours//
Typo you'll want to fix here and in the original: 2.57 **days**
TASK DETAIL
https://phabricator.wikimedia.org/T362920
EMAIL PREFERENCES
https://phabricator.wikim
RKemper added a comment.
Kicked off the second run like so:
(1) `vi /etc/wdqs/RWStore.wikidata.properties` (added a trailing 0 to
buffersize)
(2) `date | tee /home/ryankemper/loadData2.log; time sudo
/home/ryankemper/loadData.sh -n wdq -d /srv/T362920/nt_wd_schol -s 0 -e 0 2>
RKemper created this task.
RKemper added projects: Wikidata, Wikidata-Query-Service, Epic,
Discovery-Search (Current work).
TASK DESCRIPTION
This epic tracks the SRE operational work to get at least a couple wdqs hosts
fully in production with the new graph split way of doing things (`main
RKemper created this task.
RKemper added projects: Wikidata, Wikidata-Query-Service, Epic,
Discovery-Search (Current work).
TASK DESCRIPTION
Acceptance Criteria
---
- DNS records in place
- Certs provisioned via CFSSL
TASK DETAIL
https://phabricator.wikimedia.org
RKemper created this task.
RKemper added projects: Wikidata, Wikidata-Query-Service, Epic,
Discovery-Search (Current work).
TASK DESCRIPTION
Context
---
Currently our graph split hosts are just `wdqs-test` hosts, which are only
exposed via dedicated temporary endpoints such as
RKemper created this task.
RKemper added projects: Wikidata, Wikidata-Query-Service, Epic,
Discovery-Search (Current work).
TASK DESCRIPTION
Context
---
The UI for wdqs (e.g. query.wikidata.org) lives on `miscweb`. We'll want to
create slightly different UIs for the two typ
RKemper created this task.
RKemper added projects: Wikidata, Wikidata-Query-Service, Epic,
Discovery-Search (Current work).
TASK DESCRIPTION
Context
---
Currently we've got one pybal pool per-DC for public `wdqs`
(https://config-master.wikimedia.org/pybal/eqiad/wdqs) correspo
RKemper added a comment.
@dancy Should be fixed now. Here's a previously failing patch I ran a recheck
on:
https://gerrit.wikimedia.org/r/c/operations/puppet/+/1028565/4#message-8d03a9f159d1ec58172e8606d84deaf43bbcbbb0
TASK DETAIL
https://phabricator.wikimedia.org/T316876
RKemper updated the task description.
TASK DETAIL
https://phabricator.wikimedia.org/T365735
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: RKemper
Cc: bking, Aklapper, Danny_Benjafield_WMDE, S8321414, Astuthiodit_1,
AWesterinen, BTullis
RKemper added a comment.
Aisha has written some Jupyter notebooks to pull together a random selection
from groupings of query by time-to-completion and query structure (which
operators are used, basically).
On the ops side of things we'll need to decide between whether we want to
RKemper added a comment.
Some quick pros/cons of two possible approaches to getting the SLI metrics:
approach #1 is to run a query or set of queries per-dc at a certain frequency,
approach #2 is just to run a query on each host at a certain frequency
* Approach #1: Hit `wdqs.svc.{codfw
RKemper moved this task from Needs review to Needs Reporting on the
Discovery-Search (Current work) board.
RKemper added a comment.
This has been deployed.
TASK DETAIL
https://phabricator.wikimedia.org/T315124
WORKBOARD
https://phabricator.wikimedia.org/project/board/1227/
EMAIL
RKemper added a comment.
Intro (some context for traffic team)
-
Search team is working on creating an SLI to measure uptime of WDQS. We want
our SLI to map as well to the actual user experience as possible, so to that
end we're trying to co
RKemper added a comment.
Gehel and I met with bblack today.
Some highlights:
- Best to use real user traffic if possible, rather than artificial. However
this might be difficult for our use case (given that some subset of queries we
consider invalid/failing)
- If going
RKemper added a comment.
With respect to the SLO itself, our goal is an SLO that captures the promise
we make about service availability: namely, that WDQS is available on a
**best-effort** basis. In practice, this means that if an issue arises out of
"business hours", it'
RKemper added a comment.
The current approach we're trying to work towards is recording the nginx
response codes for requests. That will give us insight into the number of
failures we're seeing.
At a high level, these are the various response codes we expect for different
RKemper added a comment.
With respect to recording nginx request responses:
**Getting direct logs**: One idea is to add `/var/log/nginx/access.log` to
`RollingFileAppender` in `modules/query_service/templates/logback.xml.erb`
(https://github.com/wikimedia/puppet/blob
RKemper removed a subtask: T322037: Data-transfer.py cookbook: stop
prometheus-blazegraph-exporter service.
TASK DETAIL
https://phabricator.wikimedia.org/T316236
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: bking, RKemper
Cc: dcaro, bking
RKemper renamed this task from "Using DISTINCT with VALUES returns more results
that expected" to "Using DISTINCT with VALUES returns more results than
expected".
TASK DETAIL
https://phabricator.wikimedia.org/T321855
EMAIL PREFERENCES
https://phabricator.wikimedi
RKemper created this task.
RKemper added projects: Wikidata-Query-Service, Wikidata, Discovery-Search
(Current work).
TASK DESCRIPTION
We use Grizzly
<https://gerrit.wikimedia.org/r/plugins/gitiles/operations/grafana-grizzly/+/refs/heads/master>
to create org-wide SLO dashboards
RKemper created this task.
RKemper added projects: Wikidata-Query-Service, Wikidata, Discovery-Search
(Current work).
TASK DESCRIPTION
We've got our (WIP) WDQS uptime SLO dashboard
<https://grafana.wikimedia.org/d/l-3CMlN4z/wdqs-uptime-slo?orgId=1&viewPanel=9>.
Separately,
RKemper updated the task description.
TASK DETAIL
https://phabricator.wikimedia.org/T323066
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: RKemper
Cc: bking, Aklapper, Gehel, RKemper, Astuthiodit_1, AWesterinen, karapayneWMDE,
Invadibot, MPhamWMF
RKemper updated the task description.
TASK DETAIL
https://phabricator.wikimedia.org/T323066
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: RKemper
Cc: bking, Aklapper, Gehel, RKemper, Astuthiodit_1, AWesterinen, karapayneWMDE,
Invadibot, MPhamWMF
RKemper moved this task from Needs review to Needs Reporting on the
Discovery-Search (Current work) board.
RKemper added a comment.
Moved to `Needs Reporting`. Usually we leave tickets open but move them to
needs reporting and then gehel closes as resolved after he reviews them, but
I&#x
RKemper added a comment.
Comparing grafana
<https://grafana-rw.wikimedia.org/d/l-3CMlN4z/wdqs-uptime-slo?forceLogin&from=now-2d&orgId=1&to=now&var-Datacenter=eqiad&var-Period_Days=7d&var-SLO_Threshold=.95&viewPanel=10>
to turnilo
<https://turnilo.wi
RKemper added a comment.
In T313751#8388946 <https://phabricator.wikimedia.org/T313751#8388946>,
@Gehel wrote:
> A few comments on the current dashboard
<https://grafana.wikimedia.org/d/l-3CMlN4z/wdqs-uptime-slo?orgId=1&from=now-30d&to=now&var-Datacenter=eqiad&a
RKemper created this task.
RKemper added projects: Wikidata, Discovery-Search.
Restricted Application added a subscriber: Aklapper.
TASK DESCRIPTION
TASK DETAIL
https://phabricator.wikimedia.org/T323935
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences
RKemper added a comment.
Looked at
`sum(increase(trafficserver_backend_requests_seconds_count{status="200",
backend="wdqs.discovery.wmnet", site="$Datacenter"}[60m])) / 128` on Graphite
vs the turnilo data. General shape is mostly the same but the numbers we
RKemper added a comment.
F35842059: image.png <https://phabricator.wikimedia.org/F35842059>
F35842062: image.png <https://phabricator.wikimedia.org/F35842062>
Okay so ultimately we got the two data sources to be in alignment by:
- Switching the graphite
RKemper moved this task from In Progress to Needs Reporting on the
Discovery-Search (Current work) board.
RKemper added a comment.
Given the above, we're pretty confident that after accounting for cache
misses and bucketing the turnilo vs graphite data similarly, that we see pretty
muc
RKemper reopened subtask T316236: Reload WCQS from dumps as "Open".
TASK DETAIL
https://phabricator.wikimedia.org/T314703
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: dcausse, RKemper
Cc: Gehel, RP88, Bugreporter, HenkvD, Aklapper,
RKemper reopened this task as "Open".
RKemper added a comment.
In T316236#8415706 <https://phabricator.wikimedia.org/T316236#8415706>,
@RKemper wrote:
> Moved to `Needs Reporting`. Usually we leave tickets open but move them to
needs reporting and then gehel closes a
RKemper moved this task from Prioritized to Blocked/Waiting on the
Discovery-Search (Current work) board.
RKemper added a comment.
Waiting for data reload to complete on `wdqs2009` (or another host) before we
finish data transfers and pool these hosts
TASK DETAIL
https
RKemper added a comment.
ryankemper@grafana1002:/srv/grafana-grizzly$ grr diff slo_dashboards.jsonnet
Dashboard/slo-logstash-tmpl no differences
Dashboard/slo-trafficserver-tmpl no differences
Dashboard/slo-varnish-tmpl no differences
Dashboard/slo-wdqs-tmpl not present in
RKemper renamed this task from "Create WDQS Uptime SLO && WDQS/WCQS update lag
SLO dashboards in Grizzly" to "Create WDQS Uptime SLO dashboard in Grizzly".
RKemper updated the task description.
TASK DETAIL
https://phabricator.wikimedia.org/T32306
RKemper updated the task description.
TASK DETAIL
https://phabricator.wikimedia.org/T323064
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: RKemper
Cc: Aklapper, Gehel, RKemper, Adamm71, Jersione, Hellket777, LisafBia6531,
Astuthiodit_1, AWesterinen
RKemper added a comment.
In T301167#8516140 <https://phabricator.wikimedia.org/T301167#8516140>,
@jcrespo wrote:
> One tip to avoid having people on call (like me) worrying about pending
implementation services is to add the hiera key
`profile::monitoring::notifications_enabl
RKemper closed this task as "Resolved".
RKemper claimed this task.
RKemper added a comment.
A WDQS server's blazegraph was deadlocked, and I restarted it. Leaving the
deadlock let the server "realize" how far behind it was. I forgot to depool the
server after th
RKemper updated the task description.
TASK DETAIL
https://phabricator.wikimedia.org/T324788
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: RKemper
Cc: RKemper, Aklapper, Astuthiodit_1, AWesterinen, karapayneWMDE, Invadibot,
MPhamWMF, maantietaja
RKemper renamed this task from "Create WDQS Lag SLO dashboard with Grizzly" to
"Create WDQS Lag SLO dashboard with Grizzly && documentation".
RKemper updated the task description.
TASK DETAIL
https://phabricator.wikimedia.org/T324811
EMAIL PREFERENCES
https
RKemper updated the task description.
TASK DETAIL
https://phabricator.wikimedia.org/T301167
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: bking, RKemper
Cc: jcrespo, bking, Aklapper, RKemper, Themindcoder, Adamm71, Jersione,
Hellket777
RKemper updated the task description.
TASK DETAIL
https://phabricator.wikimedia.org/T301167
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: bking, RKemper
Cc: jcrespo, bking, Aklapper, RKemper, Themindcoder, Adamm71, Jersione,
Hellket777
RKemper added a comment.
Arbitrarily chosen `wdqs2012` is happy as seen by our query test suite:
F36875227: image.png <https://phabricator.wikimedia.org/F36875227>
All that should be left is decoming wdqs200[1-3]
TASK DETAIL
https://phabricator.wikimedia.org/T301167
RKemper added a comment.
In T301167#8650988 <https://phabricator.wikimedia.org/T301167#8650988>,
@RKemper wrote:
> Arbitrarily chosen `wdqs2012` is happy as seen by our query test suite:
>
> F36875227: image.png <https://phabricator.wikimedia.org/F36875227>
>
RKemper updated the task description.
TASK DETAIL
https://phabricator.wikimedia.org/T301167
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: bking, RKemper
Cc: jcrespo, bking, Aklapper, RKemper, Themindcoder, Adamm71, Jersione,
Hellket777
RKemper updated the task description.
TASK DETAIL
https://phabricator.wikimedia.org/T301167
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: bking, RKemper
Cc: jcrespo, bking, Aklapper, RKemper, Themindcoder, Adamm71, Jersione,
Hellket777
RKemper updated the task description.
TASK DETAIL
https://phabricator.wikimedia.org/T324811
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: RKemper
Cc: RKemper, Gehel, Aklapper, Astuthiodit_1, karapayneWMDE, Invadibot,
MPhamWMF, maantietaja, CBogen
RKemper added a comment.
Fully deployed latest (working) dashboard:
ryankemper@grafana1002:~/grafana-grizzly$ grr diff slo_dashboards.jsonnet
Dashboard/slo-WDQS changes detected:
--- Remote
+++ Local
@@ -86,7 +86,7 @@
"span": 6,
RKemper moved this task from Ready for Dev -- SRE/Ops to Needs Reporting on the
Discovery-Search (Current work) board.
RKemper claimed this task.
TASK DETAIL
https://phabricator.wikimedia.org/T324811
WORKBOARD
https://phabricator.wikimedia.org/project/board/1227/
EMAIL PREFERENCES
https
RKemper updated the task description.
TASK DETAIL
https://phabricator.wikimedia.org/T313751
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: RKemper
Cc: RLazarus, Gehel, MPhamWMF, Aklapper, Astuthiodit_1, AWesterinen,
karapayneWMDE, Invadibot
RKemper added a subtask: T325324: Evaluate options to soften wdqs paging.
TASK DETAIL
https://phabricator.wikimedia.org/T313751
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: RKemper
Cc: RLazarus, Gehel, MPhamWMF, Aklapper, Astuthiodit_1
RKemper added a parent task: T325324: Evaluate options to soften wdqs paging.
TASK DETAIL
https://phabricator.wikimedia.org/T303134
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: RKemper
Cc: bking, RKemper, jbond, Aklapper, Astuthiodit_1
RKemper added a comment.
Decom ticket for dc-ops: T331074 <https://phabricator.wikimedia.org/T331074>
TASK DETAIL
https://phabricator.wikimedia.org/T301167
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: bking, RKemper
Cc: jcrespo,
RKemper renamed this task from "Decommission query-preview.wikdiata.org" to
"Decommission query-preview.wikidata.org".
TASK DETAIL
https://phabricator.wikimedia.org/T333656
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To:
RKemper added a comment.
In T333656#8773505 <https://phabricator.wikimedia.org/T333656#8773505>,
@Dzahn wrote:
> hi @RKemper was wondering if you can bring this one up in your team meeting
or so (no rush, but would be nice to have):
https://gerrit.wikimedia.org/r/c/opera
RKemper updated the task description.
TASK DETAIL
https://phabricator.wikimedia.org/T333656
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: Dzahn, RKemper
Cc: Lydia_Pintscher, Dzahn, RKemper, Aklapper, Gehel, Themindcoder, Adamm71,
Jersione
RKemper updated the task description.
TASK DETAIL
https://phabricator.wikimedia.org/T333656
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: Dzahn, RKemper
Cc: Lydia_Pintscher, Dzahn, RKemper, Aklapper, Gehel, Themindcoder, Adamm71,
Jersione
RKemper updated the task description.
TASK DETAIL
https://phabricator.wikimedia.org/T303134
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: RKemper
Cc: bking, RKemper, jbond, Aklapper, Astuthiodit_1, AWesterinen, karapayneWMDE,
Invadibot, MPhamWMF
RKemper updated the task description.
TASK DETAIL
https://phabricator.wikimedia.org/T333656
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: RKemper
Cc: Lydia_Pintscher, Dzahn, RKemper, Aklapper, Gehel, Astuthiodit_1,
AWesterinen, karapayneWMDE
RKemper added a comment.
Forgot to link patch but here's the (hopefully final) grizzly patch to get
this where we want it:
https://gerrit.wikimedia.org/r/c/operations/grafana-grizzly/+/917938
(patch already merged & deployed)
TASK DETAIL
https://phabricator.wikimedia.or
RKemper moved this task from In Progress to Needs Reporting on the
Discovery-Search (Current work) board.
RKemper added a comment.
With https://gerrit.wikimedia.org/r/c/operations/grafana-grizzly/+/917938, we
now have the grizzly dashboard where we want it. That was the last blocker for
RKemper updated the task description.
TASK DETAIL
https://phabricator.wikimedia.org/T303134
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: RKemper
Cc: bking, RKemper, jbond, Aklapper, Astuthiodit_1, AWesterinen, karapayneWMDE,
Invadibot, MPhamWMF
RKemper updated the task description.
TASK DETAIL
https://phabricator.wikimedia.org/T336577
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: RKemper
Cc: Gehel, Aklapper, Astuthiodit_1, AWesterinen, karapayneWMDE, Invadibot,
Zabe, MPhamWMF
RKemper updated the task description.
TASK DETAIL
https://phabricator.wikimedia.org/T324811
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: RKemper
Cc: RKemper, Gehel, Aklapper, Astuthiodit_1, karapayneWMDE, Invadibot,
MPhamWMF, maantietaja
RKemper changed the point value for this task from "3" to "5".
TASK DETAIL
https://phabricator.wikimedia.org/T324811
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: RKemper
Cc: RKemper, Gehel, Aklapper, Astuthiodit_1, kara
RKemper added a comment.
Documentation aspect of this ticket's already done. Basically two things left
to do to close this ticket out:
- Understand the current non-grizzly dashboard
(https://grafana-rw.wikimedia.org/d/yCBd7Tdnk/wdqs-wcqs-lag-slo?forceLogin&orgId=1&editPane
RKemper added a comment.
Thanks for the patience on this! This is getting deployed today.
TASK DETAIL
https://phabricator.wikimedia.org/T335994
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: RKemper
Cc: RKemper, Olea, PKM, Aklapper, dcausse
RKemper moved this task from To Be Deployed to Needs Reporting on the
Discovery-Search (Current work) board.
RKemper added a comment.
Should be deployed as of today.
TASK DETAIL
https://phabricator.wikimedia.org/T334823
WORKBOARD
https://phabricator.wikimedia.org/project/board/1227
RKemper added a comment.
Merged patch (had wrong ticket in commit message):
https://gerrit.wikimedia.org/r/c/operations/puppet/+/934403
TASK DETAIL
https://phabricator.wikimedia.org/T332314
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: bking
RKemper added a comment.
[conftool changes following merge of
https://gerrit.wikimedia.org/r/c/operations/puppet/+/713959]
-
Now running conftool-merge to sync any changes to conftool
RKemper added a comment.
[Steps for deploy of https://gerrit.wikimedia.org/r/723254]
---
merge https://gerrit.wikimedia.org/r/c/operations/puppet/+/723254
(on cumin) => sudo cumin 'O:lvs::balancer' 'sud
RKemper added a comment.
~/wmf/rdf/queries [master!]% ./test.sh -s http://localhost:/
Running 1592.sparqlcurl -G --data-urlencode query@1592.sparql --data
format=json --data random=62170 http://localhost://sparql -s
PASSED
$KEEP is no, nuked /tmp/querytest
RKemper added a comment.
[Log of failed authdns-update following https://gerrit.wikimedia.org/r/724520]
--
ryankemper@authdns1001:~$ sudo -i authdns-update
Updating authdns1001.wikimedia.org (self
RKemper added a comment.
[data-transfer cookbook -> kafka offset output]
---
(including this output since it's the first time we've relied on the new
kafka offset part of the data-transfer process; won't be posting t
RKemper updated the task description.
TASK DETAIL
https://phabricator.wikimedia.org/T288231
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: RKemper
Cc: Zbyszko, RKemper, Aklapper, dcausse, Suran38, Biggs657, Invadibot,
Lalamarie69, MPhamWMF
RKemper updated the task description.
TASK DETAIL
https://phabricator.wikimedia.org/T288231
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: RKemper
Cc: Zbyszko, RKemper, Aklapper, dcausse, Suran38, Biggs657, Invadibot,
Lalamarie69, MPhamWMF
RKemper updated the task description.
TASK DETAIL
https://phabricator.wikimedia.org/T288231
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: RKemper
Cc: Zbyszko, RKemper, Aklapper, dcausse, Suran38, Biggs657, Invadibot,
Lalamarie69, MPhamWMF
RKemper updated the task description.
TASK DETAIL
https://phabricator.wikimedia.org/T293638
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: RKemper
Cc: Ottomata, Aklapper, Zbyszko, Invadibot, MPhamWMF, maantietaja, CBogen,
Akuckartz, Nandana
RKemper updated the task description.
TASK DETAIL
https://phabricator.wikimedia.org/T288231
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: RKemper
Cc: elukey, Zbyszko, RKemper, Aklapper, dcausse, Suran38, Biggs657, Invadibot,
Lalamarie69, MPhamWMF
RKemper added a parent task: T260568: [EPIC] Productionize WCQS.
TASK DETAIL
https://phabricator.wikimedia.org/T294865
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: RKemper
Cc: RKemper, Gehel, Aklapper, Suran38, Biggs657, joanna_borun, Invadibot
RKemper added a subtask: T294865: wcqs1002 and wcqs2001 unresponsive.
TASK DETAIL
https://phabricator.wikimedia.org/T260568
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: RKemper
Cc: GFontenelle_WMF, So9q, Fuzheado, Zache, ttaylor, CBogen, Gehel
RKemper added a parent task: T294865: wcqs1002 and wcqs2001 unresponsive.
TASK DETAIL
https://phabricator.wikimedia.org/T294961
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: RKemper
Cc: MoritzMuehlenhoff, RKemper, Aklapper, Gehel, CBogen, ttaylor
RKemper added a subtask: T294961: Resolve kernel hang on wcqs* instances.
TASK DETAIL
https://phabricator.wikimedia.org/T294865
EMAIL PREFERENCES
https://phabricator.wikimedia.org/settings/panel/emailpreferences/
To: RKemper
Cc: RKemper, Gehel, Aklapper, Suran38, Biggs657, joanna_borun
1 - 100 of 270 matches
Mail list logo
