[Wikidata-bugs] [Maniphest] T269204: Some wdqs metrics changed when switching to python3

Gehel closed subtask T269331: wdqs.data-reload cookbook fails when deleting the old namespace as Resolved. TASK DETAIL https://phabricator.wikimedia.org/T269204 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: RKemper, Gehel Cc: Gehel, RKemper,

[Wikidata-bugs] [Maniphest] T269204: Some wdqs metrics changed when switching to python3

Gehel closed this task as "Resolved". TASK DETAIL https://phabricator.wikimedia.org/T269204 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: RKemper, Gehel Cc: Gehel, RKemper, dcausse, Aklapper, MPhamWMF, lmata, CBogen, Akuckartz, Nandana,

[Wikidata-bugs] [Maniphest] T269204: Some wdqs metrics changed when switching to python3

Gehel closed subtask T244753: Migrate WDQS to Debian Buster as Resolved. TASK DETAIL https://phabricator.wikimedia.org/T269204 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: RKemper, Gehel Cc: Gehel, RKemper, dcausse, Aklapper, MPhamWMF, lmata,

[Wikidata-bugs] [Maniphest] T269204: Some wdqs metrics changed when switching to python3

Maintenance_bot removed a project: Patch-For-Review. TASK DETAIL https://phabricator.wikimedia.org/T269204 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: RKemper, Maintenance_bot Cc: Gehel, RKemper, dcausse, Aklapper, lmata, CBogen, Akuckartz,

[Wikidata-bugs] [Maniphest] T269204: Some wdqs metrics changed when switching to python3

RKemper added a comment. Restarting `prometheus-blazegraph-exporter-wdqs-blazegraph.service` after switching from Counter to Gauge now shows the correct `blazegraph_lastupdated` metric when running `curl localhost:9193` (9193 is the port for wdqs-blazegraph). Still waiting to see if

[Wikidata-bugs] [Maniphest] T269204: Some wdqs metrics changed when switching to python3

Stashbot added a comment. Mentioned in SAL (#wikimedia-operations) [2020-12-14T18:25:21Z] T269204 Restarting `wdqs-blazegraph` prometheus exporter across all wdqs instances:`sudo cumin -b 12 'P{wdqs*}' 'sudo systemctl restart

[Wikidata-bugs] [Maniphest] T269204: Some wdqs metrics changed when switching to python3

gerritbot added a comment. Change 646888 **merged** by Ryan Kemper: [operations/puppet@production] wdqs: Switch lag metric to be a gauge https://gerrit.wikimedia.org/r/646888 TASK DETAIL https://phabricator.wikimedia.org/T269204 EMAIL PREFERENCES

[Wikidata-bugs] [Maniphest] T269204: Some wdqs metrics changed when switching to python3

gerritbot added a project: Patch-For-Review. TASK DETAIL https://phabricator.wikimedia.org/T269204 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: RKemper, gerritbot Cc: Gehel, RKemper, dcausse, Aklapper, lmata, Alter-paule, Beast1978, CBogen,

[Wikidata-bugs] [Maniphest] T269204: Some wdqs metrics changed when switching to python3

gerritbot added a comment. Change 646888 had a related patch set uploaded (by Ryan Kemper; owner: Ryan Kemper): [operations/puppet@production] wdqs: Counters now must end in _total https://gerrit.wikimedia.org/r/646888 TASK DETAIL https://phabricator.wikimedia.org/T269204 EMAIL

[Wikidata-bugs] [Maniphest] T269204: Some wdqs metrics changed when switching to python3

ops-monitoring-bot added a comment. Completed auto-reimage of hosts: ['wdqs2007.codfw.wmnet'] and were **ALL** successful. TASK DETAIL https://phabricator.wikimedia.org/T269204 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: RKemper,

[Wikidata-bugs] [Maniphest] T269204: Some wdqs metrics changed when switching to python3

ops-monitoring-bot added a comment. Completed auto-reimage of hosts: ['wdqs2008.codfw.wmnet'] and were **ALL** successful. TASK DETAIL https://phabricator.wikimedia.org/T269204 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: RKemper,

[Wikidata-bugs] [Maniphest] T269204: Some wdqs metrics changed when switching to python3

ops-monitoring-bot added a comment. Completed auto-reimage of hosts: ['wdqs1007.eqiad.wmnet'] and were **ALL** successful. TASK DETAIL https://phabricator.wikimedia.org/T269204 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: RKemper,

[Wikidata-bugs] [Maniphest] T269204: Some wdqs metrics changed when switching to python3

ops-monitoring-bot added a comment. Completed auto-reimage of hosts: ['wdqs1010.eqiad.wmnet'] and were **ALL** successful. TASK DETAIL https://phabricator.wikimedia.org/T269204 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: RKemper,

[Wikidata-bugs] [Maniphest] T269204: Some wdqs metrics changed when switching to python3

Stashbot added a comment. Mentioned in SAL (#wikimedia-operations) [2020-12-08T00:56:09Z] T269204 reimaging the following instances to debian buster: `eqiad public`->`wdqs1007`, `codfw public`->`wdqs2007`, `codfw internal`->`wdqs2008`,

[Wikidata-bugs] [Maniphest] T269204: Some wdqs metrics changed when switching to python3

ops-monitoring-bot added a comment. Script wmf-auto-reimage was launched by ryankemper on cumin1001.eqiad.wmnet for hosts: wdqs1007.eqiad.wmnet The log can be found in `/var/log/wmf-auto-reimage/202012080054_ryankemper_29291_wdqs1007_eqiad_wmnet.log`. TASK DETAIL

[Wikidata-bugs] [Maniphest] T269204: Some wdqs metrics changed when switching to python3

ops-monitoring-bot added a comment. Script wmf-auto-reimage was launched by ryankemper on cumin2001.codfw.wmnet for hosts: wdqs2007.codfw.wmnet The log can be found in `/var/log/wmf-auto-reimage/202012080055_ryankemper_29823_wdqs2007_codfw_wmnet.log`. TASK DETAIL

[Wikidata-bugs] [Maniphest] T269204: Some wdqs metrics changed when switching to python3

ops-monitoring-bot added a comment. Script wmf-auto-reimage was launched by ryankemper on cumin1001.eqiad.wmnet for hosts: wdqs1010.eqiad.wmnet The log can be found in `/var/log/wmf-auto-reimage/202012080054_ryankemper_29304_wdqs1010_eqiad_wmnet.log`. TASK DETAIL

[Wikidata-bugs] [Maniphest] T269204: Some wdqs metrics changed when switching to python3

ops-monitoring-bot added a comment. Script wmf-auto-reimage was launched by ryankemper on cumin2001.codfw.wmnet for hosts: wdqs2008.codfw.wmnet The log can be found in `/var/log/wmf-auto-reimage/202012080055_ryankemper_29846_wdqs2008_codfw_wmnet.log`. TASK DETAIL

[Wikidata-bugs] [Maniphest] T269204: Some wdqs metrics changed when switching to python3

ops-monitoring-bot added a comment. Completed auto-reimage of hosts: ['wdqs2006.codfw.wmnet'] and were **ALL** successful. TASK DETAIL https://phabricator.wikimedia.org/T269204 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: RKemper,

[Wikidata-bugs] [Maniphest] T269204: Some wdqs metrics changed when switching to python3

ops-monitoring-bot added a comment. Completed auto-reimage of hosts: ['wdqs2003.codfw.wmnet'] and were **ALL** successful. TASK DETAIL https://phabricator.wikimedia.org/T269204 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: RKemper,

[Wikidata-bugs] [Maniphest] T269204: Some wdqs metrics changed when switching to python3

ops-monitoring-bot added a comment. Completed auto-reimage of hosts: ['wdqs1009.eqiad.wmnet'] and were **ALL** successful. TASK DETAIL https://phabricator.wikimedia.org/T269204 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: RKemper,

[Wikidata-bugs] [Maniphest] T269204: Some wdqs metrics changed when switching to python3

ops-monitoring-bot added a comment. Completed auto-reimage of hosts: ['wdqs1006.eqiad.wmnet'] and were **ALL** successful. TASK DETAIL https://phabricator.wikimedia.org/T269204 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: RKemper,

[Wikidata-bugs] [Maniphest] T269204: Some wdqs metrics changed when switching to python3

Stashbot added a comment. Mentioned in SAL (#wikimedia-operations) [2020-12-07T19:38:10Z] T269204 reimaging the following instances to debian buster => `eqiad public`:`wdqs1006`, `codfw public`:`wdqs2003`, `codfw internal`:`wdqs2006`,

[Wikidata-bugs] [Maniphest] T269204: Some wdqs metrics changed when switching to python3

ops-monitoring-bot added a comment. Script wmf-auto-reimage was launched by ryankemper on cumin1001.eqiad.wmnet for hosts: wdqs1006.eqiad.wmnet The log can be found in `/var/log/wmf-auto-reimage/202012071937_ryankemper_31916_wdqs1006_eqiad_wmnet.log`. TASK DETAIL

[Wikidata-bugs] [Maniphest] T269204: Some wdqs metrics changed when switching to python3

ops-monitoring-bot added a comment. Script wmf-auto-reimage was launched by ryankemper on cumin1001.eqiad.wmnet for hosts: wdqs1009.eqiad.wmnet The log can be found in `/var/log/wmf-auto-reimage/202012071937_ryankemper_31984_wdqs1009_eqiad_wmnet.log`. TASK DETAIL

[Wikidata-bugs] [Maniphest] T269204: Some wdqs metrics changed when switching to python3

ops-monitoring-bot added a comment. Script wmf-auto-reimage was launched by ryankemper on cumin2001.codfw.wmnet for hosts: wdqs2003.codfw.wmnet The log can be found in `/var/log/wmf-auto-reimage/202012071937_ryankemper_1511_wdqs2003_codfw_wmnet.log`. TASK DETAIL

[Wikidata-bugs] [Maniphest] T269204: Some wdqs metrics changed when switching to python3

ops-monitoring-bot added a comment. Script wmf-auto-reimage was launched by ryankemper on cumin2001.codfw.wmnet for hosts: wdqs2006.codfw.wmnet The log can be found in `/var/log/wmf-auto-reimage/202012071937_ryankemper_1518_wdqs2006_codfw_wmnet.log`. TASK DETAIL

[Wikidata-bugs] [Maniphest] T269204: Some wdqs metrics changed when switching to python3

Gehel added a subtask: T269331: wdqs.data-reload cookbook fails when deleting the old namespace. TASK DETAIL https://phabricator.wikimedia.org/T269204 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: RKemper, Gehel Cc: Gehel, RKemper, dcausse,

[Wikidata-bugs] [Maniphest] T269204: Some wdqs metrics changed when switching to python3

ops-monitoring-bot added a comment. Completed auto-reimage of hosts: ['wdqs2005.codfw.wmnet'] and were **ALL** successful. TASK DETAIL https://phabricator.wikimedia.org/T269204 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: RKemper,

[Wikidata-bugs] [Maniphest] T269204: Some wdqs metrics changed when switching to python3

ops-monitoring-bot added a comment. Completed auto-reimage of hosts: ['wdqs2002.codfw.wmnet'] and were **ALL** successful. TASK DETAIL https://phabricator.wikimedia.org/T269204 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: RKemper,

[Wikidata-bugs] [Maniphest] T269204: Some wdqs metrics changed when switching to python3

ops-monitoring-bot added a comment. Completed auto-reimage of hosts: ['wdqs1005.eqiad.wmnet'] and were **ALL** successful. TASK DETAIL https://phabricator.wikimedia.org/T269204 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: RKemper,

[Wikidata-bugs] [Maniphest] T269204: Some wdqs metrics changed when switching to python3

ops-monitoring-bot added a comment. Completed auto-reimage of hosts: ['wdqs1008.eqiad.wmnet'] and were **ALL** successful. TASK DETAIL https://phabricator.wikimedia.org/T269204 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: RKemper,

[Wikidata-bugs] [Maniphest] T269204: Some wdqs metrics changed when switching to python3

Stashbot added a comment. Mentioned in SAL (#wikimedia-operations) [2020-12-05T04:05:33Z] T269204 reimaging the following instances to debian buster (one each from `[public, internal] x [eqiad, codfw]`): `wdqs1005`, `wdqs2002`, `wdqs1008`,

[Wikidata-bugs] [Maniphest] T269204: Some wdqs metrics changed when switching to python3

ops-monitoring-bot added a comment. Script wmf-auto-reimage was launched by ryankemper on cumin2001.codfw.wmnet for hosts: wdqs2002.codfw.wmnet The log can be found in `/var/log/wmf-auto-reimage/202012050404_ryankemper_7306_wdqs2002_codfw_wmnet.log`. TASK DETAIL

[Wikidata-bugs] [Maniphest] T269204: Some wdqs metrics changed when switching to python3

ops-monitoring-bot added a comment. Script wmf-auto-reimage was launched by ryankemper on cumin1001.eqiad.wmnet for hosts: wdqs1005.eqiad.wmnet The log can be found in `/var/log/wmf-auto-reimage/202012050404_ryankemper_23845_wdqs1005_eqiad_wmnet.log`. TASK DETAIL

[Wikidata-bugs] [Maniphest] T269204: Some wdqs metrics changed when switching to python3

ops-monitoring-bot added a comment. Script wmf-auto-reimage was launched by ryankemper on cumin1001.eqiad.wmnet for hosts: wdqs1008.eqiad.wmnet The log can be found in `/var/log/wmf-auto-reimage/202012050404_ryankemper_23858_wdqs1008_eqiad_wmnet.log`. TASK DETAIL

[Wikidata-bugs] [Maniphest] T269204: Some wdqs metrics changed when switching to python3

ops-monitoring-bot added a comment. Script wmf-auto-reimage was launched by ryankemper on cumin2001.codfw.wmnet for hosts: wdqs2005.codfw.wmnet The log can be found in `/var/log/wmf-auto-reimage/202012050404_ryankemper_7260_wdqs2005_codfw_wmnet.log`. TASK DETAIL

[Wikidata-bugs] [Maniphest] T269204: Some wdqs metrics changed when switching to python3

ops-monitoring-bot added a comment. Completed auto-reimage of hosts: ['wdqs1003.eqiad.wmnet'] and were **ALL** successful. TASK DETAIL https://phabricator.wikimedia.org/T269204 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: RKemper,

[Wikidata-bugs] [Maniphest] T269204: Some wdqs metrics changed when switching to python3

ops-monitoring-bot added a comment. Completed auto-reimage of hosts: ['wdqs2001.codfw.wmnet'] and were **ALL** successful. TASK DETAIL https://phabricator.wikimedia.org/T269204 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: RKemper,

[Wikidata-bugs] [Maniphest] T269204: Some wdqs metrics changed when switching to python3

ops-monitoring-bot added a comment. Completed auto-reimage of hosts: ['wdqs1004.eqiad.wmnet'] and were **ALL** successful. TASK DETAIL https://phabricator.wikimedia.org/T269204 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: RKemper,

[Wikidata-bugs] [Maniphest] T269204: Some wdqs metrics changed when switching to python3

ops-monitoring-bot added a comment. Script wmf-auto-reimage was launched by ryankemper on cumin1001.eqiad.wmnet for hosts: wdqs1003.eqiad.wmnet The log can be found in `/var/log/wmf-auto-reimage/202012050010_ryankemper_15827_wdqs1003_eqiad_wmnet.log`. TASK DETAIL

[Wikidata-bugs] [Maniphest] T269204: Some wdqs metrics changed when switching to python3

Stashbot added a comment. Mentioned in SAL (#wikimedia-operations) [2020-12-05T00:09:52Z] T269204 reimaging the following instances to debian buster: `wdqs1004`, `wdqs2001`, `wdqs1003` TASK DETAIL https://phabricator.wikimedia.org/T269204

[Wikidata-bugs] [Maniphest] T269204: Some wdqs metrics changed when switching to python3

ops-monitoring-bot added a comment. Script wmf-auto-reimage was launched by ryankemper on cumin2001.codfw.wmnet for hosts: wdqs2001.codfw.wmnet The log can be found in `/var/log/wmf-auto-reimage/202012050009_ryankemper_26827_wdqs2001_codfw_wmnet.log`. TASK DETAIL

[Wikidata-bugs] [Maniphest] T269204: Some wdqs metrics changed when switching to python3

ops-monitoring-bot added a comment. Script wmf-auto-reimage was launched by ryankemper on cumin1001.eqiad.wmnet for hosts: wdqs1004.eqiad.wmnet The log can be found in `/var/log/wmf-auto-reimage/202012050009_ryankemper_15678_wdqs1004_eqiad_wmnet.log`. TASK DETAIL

[Wikidata-bugs] [Maniphest] T269204: Some wdqs metrics changed when switching to python3

Gehel added a comment. Note that migrating WDQS to Buster is tracked in T244753 TASK DETAIL https://phabricator.wikimedia.org/T269204 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: RKemper, Gehel Cc:

[Wikidata-bugs] [Maniphest] T269204: Some wdqs metrics changed when switching to python3

Gehel added a subtask: T244753: Migrate WDQS to Debian Buster. TASK DETAIL https://phabricator.wikimedia.org/T269204 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: RKemper, Gehel Cc: Gehel, RKemper, dcausse, Aklapper, lmata, CBogen, Akuckartz,

[Wikidata-bugs] [Maniphest] T269204: Some wdqs metrics changed when switching to python3

dcausse added a project: Discovery-Search (Current work). TASK DETAIL https://phabricator.wikimedia.org/T269204 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: RKemper, dcausse Cc: Gehel, RKemper, dcausse, Aklapper, lmata, CBogen, Akuckartz, Nandana,

[Wikidata-bugs] [Maniphest] T269204: Some wdqs metrics changed when switching to python3

ops-monitoring-bot added a comment. Completed auto-reimage of hosts: ['wdqs2004.codfw.wmnet'] and were **ALL** successful. TASK DETAIL https://phabricator.wikimedia.org/T269204 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: RKemper,

[Wikidata-bugs] [Maniphest] T269204: Some wdqs metrics changed when switching to python3

Stashbot added a comment. Mentioned in SAL (#wikimedia-operations) [2020-12-03T20:08:13Z] T269204 Re-imaging `wdqs2004` to upgrade it to buster: `sudo -i wmf-auto-reimage-host --conftool -p T269204 wdqs2004.codfw.wmnet` TASK DETAIL

[Wikidata-bugs] [Maniphest] T269204: Some wdqs metrics changed when switching to python3

ops-monitoring-bot added a comment. Script wmf-auto-reimage was launched by ryankemper on cumin2001.codfw.wmnet for hosts: wdqs2004.codfw.wmnet The log can be found in `/var/log/wmf-auto-reimage/202012032006_ryankemper_9499_wdqs2004_codfw_wmnet.log`. TASK DETAIL

[Wikidata-bugs] [Maniphest] T269204: Some wdqs metrics changed when switching to python3

RKemper claimed this task. RKemper updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T269204 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: RKemper Cc: Gehel, RKemper, dcausse, Aklapper, lmata, CBogen, Akuckartz, Nandana,

[Wikidata-bugs] [Maniphest] T269204: Some wdqs metrics changed when switching to python3

RKemper added a comment. `sudo -i wmf-auto-reimage-host --conftool -p T269204 wdqs2004.codfw.wmnet` is an example of how to reimage hosts (run from cumin) TASK DETAIL https://phabricator.wikimedia.org/T269204 EMAIL PREFERENCES

[Wikidata-bugs] [Maniphest] T269204: Some wdqs metrics changed when switching to python3

Gehel added a comment. We could also upgrade all nodes to buster. Since the new instances are already running on Buster, this should be easy enough (and needs to be done anyway). TASK DETAIL https://phabricator.wikimedia.org/T269204 EMAIL PREFERENCES

[Wikidata-bugs] [Maniphest] T269204: Some wdqs metrics changed when switching to python3

fgiunchedi added a project: observability. TASK DETAIL https://phabricator.wikimedia.org/T269204 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: fgiunchedi Cc: RKemper, dcausse, Aklapper, lmata, CBogen, Akuckartz, Nandana, Namenlos314, Lahi, Gq86,

[Wikidata-bugs] [Maniphest] T269204: Some wdqs metrics changed when switching to python3

dcausse updated the task description. TASK DETAIL https://phabricator.wikimedia.org/T269204 EMAIL PREFERENCES https://phabricator.wikimedia.org/settings/panel/emailpreferences/ To: dcausse Cc: RKemper, dcausse, Aklapper, CBogen, Akuckartz, Nandana, Namenlos314, Lahi, Gq86,

[Wikidata-bugs] [Maniphest] T269204: Some wdqs metrics changed when switching to python3

dcausse created this task. dcausse added a project: Wikidata-Query-Service. Restricted Application added a subscriber: Aklapper. Restricted Application added a project: Wikidata. TASK DESCRIPTION As WDQS maintainer I want all metrics that wdqs reports to prometheus to have a consistent name no