[Betacluster-alerts] ** PROBLEM alert - Graphite Labs/Mediawiki Error Rate is WARNING **
Notification Type: PROBLEM Service: Mediawiki Error Rate Host: Graphite Labs Address: graphite-labs.wikimedia.org State: WARNING Date/Time: Mon 09 Sep 06:16:00 UTC 2019 Notes URLs: Acknowledged by : Additional Info: WARNING: 60.00% of data above the warning threshold [1.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - Graphite Labs/Mediawiki Error Rate is CRITICAL **
Notification Type: PROBLEM Service: Mediawiki Error Rate Host: Graphite Labs Address: graphite-labs.wikimedia.org State: CRITICAL Date/Time: Mon 09 Sep 06:11:01 UTC 2019 Notes URLs: Acknowledged by : Additional Info: CRITICAL: 20.00% of data above the critical threshold [10.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - Graphite Labs/Mediawiki Error Rate is WARNING **
Notification Type: PROBLEM Service: Mediawiki Error Rate Host: Graphite Labs Address: graphite-labs.wikimedia.org State: WARNING Date/Time: Mon 09 Sep 04:16:02 UTC 2019 Notes URLs: Acknowledged by : Additional Info: WARNING: 60.00% of data above the warning threshold [1.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - Graphite Labs/Mediawiki Error Rate is CRITICAL **
Notification Type: PROBLEM Service: Mediawiki Error Rate Host: Graphite Labs Address: graphite-labs.wikimedia.org State: CRITICAL Date/Time: Mon 09 Sep 04:11:00 UTC 2019 Notes URLs: Acknowledged by : Additional Info: CRITICAL: 20.00% of data above the critical threshold [10.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - Graphite Labs/Mediawiki Error Rate is WARNING **
Notification Type: PROBLEM Service: Mediawiki Error Rate Host: Graphite Labs Address: graphite-labs.wikimedia.org State: WARNING Date/Time: Mon 09 Sep 02:41:02 UTC 2019 Notes URLs: Acknowledged by : Additional Info: WARNING: 40.00% of data above the warning threshold [1.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - Graphite Labs/Mediawiki Error Rate is CRITICAL **
Notification Type: PROBLEM Service: Mediawiki Error Rate Host: Graphite Labs Address: graphite-labs.wikimedia.org State: CRITICAL Date/Time: Mon 09 Sep 02:31:01 UTC 2019 Notes URLs: Acknowledged by : Additional Info: CRITICAL: 20.00% of data above the critical threshold [10.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - Graphite Labs/Mediawiki Error Rate is WARNING **
Notification Type: PROBLEM Service: Mediawiki Error Rate Host: Graphite Labs Address: graphite-labs.wikimedia.org State: WARNING Date/Time: Mon 09 Sep 02:16:01 UTC 2019 Notes URLs: Acknowledged by : Additional Info: WARNING: 60.00% of data above the warning threshold [1.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - Graphite Labs/Mediawiki Error Rate is CRITICAL **
Notification Type: PROBLEM Service: Mediawiki Error Rate Host: Graphite Labs Address: graphite-labs.wikimedia.org State: CRITICAL Date/Time: Mon 09 Sep 02:11:01 UTC 2019 Notes URLs: Acknowledged by : Additional Info: CRITICAL: 20.00% of data above the critical threshold [10.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - deployment-deploy01/Free space - all mounts is WARNING **
Notification Type: PROBLEM Service: Free space - all mounts Host: deployment-deploy01 Address: 172.16.4.18 State: WARNING Date/Time: Mon 09 Sep 01:58:42 UTC 2019 Notes URLs: Acknowledged by : Additional Info: WARNING: deployment-prep.deployment-deploy01.diskspace.root.byte_percentfree (<10.00%) ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] beta-code-update-eqiad - Build # 262939 - Fixed!
beta-code-update-eqiad - Build # 262939 - Fixed: Check console output at https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/262939/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] Host DOWN alert for graphite-labs!
Notification Type: PROBLEM Host: graphite-labs State: DOWN Address: graphite-labs.wikimedia.org Info: check_ping: Invalid hostname/address - graphite-labs.wikimedia.org Date/Time: Mon 09 Sep 00:52:56 UTC 2019 Acknowledged by : ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - deployment-mediawiki-07/App Server Main HTTP Response is CRITICAL **
Notification Type: PROBLEM Service: App Server Main HTTP Response Host: deployment-mediawiki-07 Address: 172.16.4.119 State: CRITICAL Date/Time: Mon 09 Sep 00:59:26 UTC 2019 Notes URLs: Acknowledged by : Additional Info: CRITICAL - Socket timeout after 10 seconds ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-mediawiki-07/App Server Main HTTP Response is OK **
Notification Type: RECOVERY Service: App Server Main HTTP Response Host: deployment-mediawiki-07 Address: 172.16.4.119 State: OK Date/Time: Mon 09 Sep 01:04:21 UTC 2019 Notes URLs: Acknowledged by : Additional Info: HTTP OK: HTTP/1.1 200 OK - 46377 bytes in 4.901 second response time ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] Host DOWN alert for graphite-labs!
Notification Type: PROBLEM Host: graphite-labs State: DOWN Address: graphite-labs.wikimedia.org Info: check_ping: Invalid hostname/address - graphite-labs.wikimedia.org Date/Time: Mon 09 Sep 00:51:58 UTC 2019 Acknowledged by : ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - Generic Beta Cluster/English Wikipedia Main page is CRITICAL **
Notification Type: PROBLEM Service: English Wikipedia Main page Host: Generic Beta Cluster Address: en.wikipedia.beta.wmflabs.org State: CRITICAL Date/Time: Mon 09 Sep 01:14:59 UTC 2019 Notes URLs: Acknowledged by : Additional Info: CRITICAL - Socket timeout after 10 seconds ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - Generic Beta Cluster/English Wikipedia Main page is OK **
Notification Type: RECOVERY Service: English Wikipedia Main page Host: Generic Beta Cluster Address: en.wikipedia.beta.wmflabs.org State: OK Date/Time: Mon 09 Sep 01:19:56 UTC 2019 Notes URLs: Acknowledged by : Additional Info: HTTP OK: HTTP/1.1 200 OK - 46914 bytes in 4.502 second response time ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-aqs02/Free space - all mounts is OK **
Notification Type: RECOVERY Service: Free space - all mounts Host: deployment-aqs02 Address: 172.16.1.5 State: OK Date/Time: Mon 09 Sep 01:38:19 UTC 2019 Notes URLs: Acknowledged by : Additional Info: OK: All targets OK ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-docker-citoid01/Puppet staleness is OK **
Notification Type: RECOVERY Service: Puppet staleness Host: deployment-docker-citoid01 Address: 172.16.4.222 State: OK Date/Time: Mon 09 Sep 01:38:10 UTC 2019 Notes URLs: Acknowledged by : Additional Info: OK: Less than 1.00% above the threshold [3600.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] Host UP alert for graphite-labs!
Notification Type: RECOVERY Host: graphite-labs State: UP Address: graphite-labs.wikimedia.org Info: PING OK - Packet loss = 0%, RTA = 1.95 ms Date/Time: Mon 09 Sep 01:37:59 UTC 2019 Acknowledged by : ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-sessionstore01/Free space - all mounts is OK **
Notification Type: RECOVERY Service: Free space - all mounts Host: deployment-sessionstore01 Address: 172.16.2.178 State: OK Date/Time: Mon 09 Sep 01:38:11 UTC 2019 Notes URLs: Acknowledged by : Additional Info: OK: All targets OK ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-mwmaint01/Puppet staleness is OK **
Notification Type: RECOVERY Service: Puppet staleness Host: deployment-mwmaint01 Address: 172.16.4.16 State: OK Date/Time: Mon 09 Sep 01:38:15 UTC 2019 Notes URLs: Acknowledged by : Additional Info: OK: Less than 1.00% above the threshold [3600.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-mcs01/Puppet staleness is OK **
Notification Type: RECOVERY Service: Puppet staleness Host: deployment-mcs01 Address: 172.16.5.64 State: OK Date/Time: Mon 09 Sep 01:37:55 UTC 2019 Notes URLs: Acknowledged by : Additional Info: OK: Less than 1.00% above the threshold [3600.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-deploy01/Free space - all mounts is OK **
Notification Type: RECOVERY Service: Free space - all mounts Host: deployment-deploy01 Address: 172.16.4.18 State: OK Date/Time: Mon 09 Sep 01:37:39 UTC 2019 Notes URLs: Acknowledged by : Additional Info: OK: All targets OK ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-sca02/Puppet staleness is OK **
Notification Type: RECOVERY Service: Puppet staleness Host: deployment-sca02 Address: 172.16.5.112 State: OK Date/Time: Mon 09 Sep 01:37:16 UTC 2019 Notes URLs: Acknowledged by : Additional Info: OK: Less than 1.00% above the threshold [3600.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-aqs02/Puppet errors is OK **
Notification Type: RECOVERY Service: Puppet errors Host: deployment-aqs02 Address: 172.16.1.5 State: OK Date/Time: Mon 09 Sep 01:37:29 UTC 2019 Notes URLs: Acknowledged by : Additional Info: OK: Less than 1.00% above the threshold [2.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-hadoop-test-1/Puppet staleness is OK **
Notification Type: RECOVERY Service: Puppet staleness Host: deployment-hadoop-test-1 Address: 172.16.4.68 State: OK Date/Time: Mon 09 Sep 01:37:35 UTC 2019 Notes URLs: Acknowledged by : Additional Info: OK: Less than 1.00% above the threshold [3600.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-elastic06/Puppet staleness is OK **
Notification Type: RECOVERY Service: Puppet staleness Host: deployment-elastic06 Address: 172.16.5.131 State: OK Date/Time: Mon 09 Sep 01:37:18 UTC 2019 Notes URLs: Acknowledged by : Additional Info: OK: Less than 1.00% above the threshold [3600.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-chromium02/Puppet staleness is OK **
Notification Type: RECOVERY Service: Puppet staleness Host: deployment-chromium02 Address: 172.16.4.14 State: OK Date/Time: Mon 09 Sep 01:37:29 UTC 2019 Notes URLs: Acknowledged by : Additional Info: OK: Less than 1.00% above the threshold [3600.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-snapshot01/Puppet staleness is OK **
Notification Type: RECOVERY Service: Puppet staleness Host: deployment-snapshot01 Address: 172.16.4.132 State: OK Date/Time: Mon 09 Sep 01:37:20 UTC 2019 Notes URLs: Acknowledged by : Additional Info: OK: Less than 1.00% above the threshold [3600.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-memc07/Free space - all mounts is OK **
Notification Type: RECOVERY Service: Free space - all mounts Host: deployment-memc07 Address: 172.16.5.2 State: OK Date/Time: Mon 09 Sep 01:37:13 UTC 2019 Notes URLs: Acknowledged by : Additional Info: OK: All targets OK ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-ircd/Free space - all mounts is OK **
Notification Type: RECOVERY Service: Free space - all mounts Host: deployment-ircd Address: 172.16.5.68 State: OK Date/Time: Mon 09 Sep 01:37:32 UTC 2019 Notes URLs: Acknowledged by : Additional Info: OK: All targets OK ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-schema-2/Free space - all mounts is OK **
Notification Type: RECOVERY Service: Free space - all mounts Host: deployment-schema-2 Address: 172.16.7.161 State: OK Date/Time: Mon 09 Sep 01:36:58 UTC 2019 Notes URLs: Acknowledged by : Additional Info: OK: All targets OK ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-elastic05/Puppet errors is OK **
Notification Type: RECOVERY Service: Puppet errors Host: deployment-elastic05 Address: 172.16.5.136 State: OK Date/Time: Mon 09 Sep 01:36:42 UTC 2019 Notes URLs: Acknowledged by : Additional Info: OK: Less than 1.00% above the threshold [2.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-logstash2/Puppet errors is OK **
Notification Type: RECOVERY Service: Puppet errors Host: deployment-logstash2 Address: 172.16.5.22 State: OK Date/Time: Mon 09 Sep 01:36:44 UTC 2019 Notes URLs: Acknowledged by : Additional Info: OK: Less than 1.00% above the threshold [2.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-db05/Puppet staleness is OK **
Notification Type: RECOVERY Service: Puppet staleness Host: deployment-db05 Address: 172.16.5.170 State: OK Date/Time: Mon 09 Sep 01:35:56 UTC 2019 Notes URLs: Acknowledged by : Additional Info: OK: Less than 1.00% above the threshold [3600.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-memc04/Free space - all mounts is OK **
Notification Type: RECOVERY Service: Free space - all mounts Host: deployment-memc04 Address: 172.16.5.76 State: OK Date/Time: Mon 09 Sep 01:36:16 UTC 2019 Notes URLs: Acknowledged by : Additional Info: OK: All targets OK ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] Host UP alert for graphite-labs!
Notification Type: RECOVERY Host: graphite-labs State: UP Address: graphite-labs.wikimedia.org Info: PING OK - Packet loss = 0%, RTA = 3.99 ms Date/Time: Mon 09 Sep 01:36:10 UTC 2019 Acknowledged by : ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-jobrunner03/Free space - all mounts is OK **
Notification Type: RECOVERY Service: Free space - all mounts Host: deployment-jobrunner03 Address: 172.16.4.98 State: OK Date/Time: Mon 09 Sep 01:35:54 UTC 2019 Notes URLs: Acknowledged by : Additional Info: OK: All targets OK ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-hadoop-test-3/Puppet errors is OK **
Notification Type: RECOVERY Service: Puppet errors Host: deployment-hadoop-test-3 Address: 172.16.4.76 State: OK Date/Time: Mon 09 Sep 01:35:56 UTC 2019 Notes URLs: Acknowledged by : Additional Info: OK: Less than 1.00% above the threshold [2.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-db05/Puppet errors is OK **
Notification Type: RECOVERY Service: Puppet errors Host: deployment-db05 Address: 172.16.5.170 State: OK Date/Time: Mon 09 Sep 01:36:34 UTC 2019 Notes URLs: Acknowledged by : Additional Info: OK: Less than 1.00% above the threshold [2.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-aqs01/Free space - all mounts is OK **
Notification Type: RECOVERY Service: Free space - all mounts Host: deployment-aqs01 Address: 172.16.1.190 State: OK Date/Time: Mon 09 Sep 01:35:42 UTC 2019 Notes URLs: Acknowledged by : Additional Info: OK: All targets OK ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-elastic07/Puppet staleness is OK **
Notification Type: RECOVERY Service: Puppet staleness Host: deployment-elastic07 Address: 172.16.5.141 State: OK Date/Time: Mon 09 Sep 01:35:24 UTC 2019 Notes URLs: Acknowledged by : Additional Info: OK: Less than 1.00% above the threshold [3600.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-logstash2/Free space - all mounts is OK **
Notification Type: RECOVERY Service: Free space - all mounts Host: deployment-logstash2 Address: 172.16.5.22 State: OK Date/Time: Mon 09 Sep 01:35:22 UTC 2019 Notes URLs: Acknowledged by : Additional Info: OK: deployment-prep.deployment-logstash2.diskspace._mnt.byte_percentfree (No valid datapoints found) deployment-prep.deployment-logstash2.diskspace._var_lib_elasticsearch.byte_percentfree (No valid datapoints found) ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-acme-chief03/Puppet staleness is OK **
Notification Type: RECOVERY Service: Puppet staleness Host: deployment-acme-chief03 Address: 172.16.6.209 State: OK Date/Time: Mon 09 Sep 01:35:17 UTC 2019 Notes URLs: Acknowledged by : Additional Info: OK: Less than 1.00% above the threshold [3600.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-docker-citoid01/Puppet errors is OK **
Notification Type: RECOVERY Service: Puppet errors Host: deployment-docker-citoid01 Address: 172.16.4.222 State: OK Date/Time: Mon 09 Sep 01:35:38 UTC 2019 Notes URLs: Acknowledged by : Additional Info: OK: Less than 1.00% above the threshold [2.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-deploy02/Free space - all mounts is OK **
Notification Type: RECOVERY Service: Free space - all mounts Host: deployment-deploy02 Address: 172.16.4.19 State: OK Date/Time: Mon 09 Sep 01:35:24 UTC 2019 Notes URLs: Acknowledged by : Additional Info: OK: All targets OK ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-acme-chief03/Free space - all mounts is OK **
Notification Type: RECOVERY Service: Free space - all mounts Host: deployment-acme-chief03 Address: 172.16.6.209 State: OK Date/Time: Mon 09 Sep 01:35:40 UTC 2019 Notes URLs: Acknowledged by : Additional Info: OK: All targets OK ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-eventlog05/Puppet staleness is OK **
Notification Type: RECOVERY Service: Puppet staleness Host: deployment-eventlog05 Address: 172.16.4.128 State: OK Date/Time: Mon 09 Sep 01:35:42 UTC 2019 Notes URLs: Acknowledged by : Additional Info: OK: Less than 1.00% above the threshold [3600.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-ms-be05/Puppet errors is OK **
Notification Type: RECOVERY Service: Puppet errors Host: deployment-ms-be05 Address: 172.16.7.114 State: OK Date/Time: Mon 09 Sep 01:35:15 UTC 2019 Notes URLs: Acknowledged by : Additional Info: OK: Less than 1.00% above the threshold [2.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-db06/Free space - all mounts is OK **
Notification Type: RECOVERY Service: Free space - all mounts Host: deployment-db06 Address: 172.16.4.147 State: OK Date/Time: Mon 09 Sep 01:34:47 UTC 2019 Notes URLs: Acknowledged by : Additional Info: OK: All targets OK ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-memc05/Puppet staleness is OK **
Notification Type: RECOVERY Service: Puppet staleness Host: deployment-memc05 Address: 172.16.5.17 State: OK Date/Time: Mon 09 Sep 01:35:03 UTC 2019 Notes URLs: Acknowledged by : Additional Info: OK: Less than 1.00% above the threshold [3600.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-sessionstore02/Puppet staleness is OK **
Notification Type: RECOVERY Service: Puppet staleness Host: deployment-sessionstore02 Address: 172.16.1.166 State: OK Date/Time: Mon 09 Sep 01:34:38 UTC 2019 Notes URLs: Acknowledged by : Additional Info: OK: Less than 1.00% above the threshold [3600.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-ms-fe03/Puppet staleness is OK **
Notification Type: RECOVERY Service: Puppet staleness Host: deployment-ms-fe03 Address: 172.16.5.163 State: OK Date/Time: Mon 09 Sep 01:34:13 UTC 2019 Notes URLs: Acknowledged by : Additional Info: OK: Less than 1.00% above the threshold [3600.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] selenium-daily-betacommons-MediaWiki - Build # 64 - Failure!
FAILURE: selenium-daily-betacommons-MediaWiki Build #64 (Mon, 09 Sep 2019 01:22:00 +) ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] beta-code-update-eqiad - Build # 262933 - Failure!
beta-code-update-eqiad - Build # 262933 - Failure: Check console output at https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/262933/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - Graphite Labs/Mediawiki Error Rate is WARNING **
Notification Type: PROBLEM Service: Mediawiki Error Rate Host: Graphite Labs Address: graphite-labs.wikimedia.org State: WARNING Date/Time: Mon 09 Sep 00:16:00 UTC 2019 Notes URLs: Acknowledged by : Additional Info: WARNING: 60.00% of data above the warning threshold [1.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - Graphite Labs/Mediawiki Error Rate is CRITICAL **
Notification Type: PROBLEM Service: Mediawiki Error Rate Host: Graphite Labs Address: graphite-labs.wikimedia.org State: CRITICAL Date/Time: Mon 09 Sep 00:01:02 UTC 2019 Notes URLs: Acknowledged by : Additional Info: CRITICAL: 20.00% of data above the critical threshold [10.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - deployment-fluorine02/Free space - all mounts is CRITICAL **
Notification Type: PROBLEM Service: Free space - all mounts Host: deployment-fluorine02 Address: 172.16.5.71 State: CRITICAL Date/Time: Sun 08 Sep 22:26:46 UTC 2019 Notes URLs: Acknowledged by : Additional Info: CRITICAL: deployment-prep.deployment-fluorine02.diskspace._srv.byte_percentfree (<20.00%) ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - Graphite Labs/Mediawiki Error Rate is WARNING **
Notification Type: PROBLEM Service: Mediawiki Error Rate Host: Graphite Labs Address: graphite-labs.wikimedia.org State: WARNING Date/Time: Sun 08 Sep 22:16:02 UTC 2019 Notes URLs: Acknowledged by : Additional Info: WARNING: 60.00% of data above the warning threshold [1.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - Graphite Labs/Mediawiki Error Rate is CRITICAL **
Notification Type: PROBLEM Service: Mediawiki Error Rate Host: Graphite Labs Address: graphite-labs.wikimedia.org State: CRITICAL Date/Time: Sun 08 Sep 22:11:00 UTC 2019 Notes URLs: Acknowledged by : Additional Info: CRITICAL: 20.00% of data above the critical threshold [10.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - deployment-fluorine02/Free space - all mounts is WARNING **
Notification Type: PROBLEM Service: Free space - all mounts Host: deployment-fluorine02 Address: 172.16.5.71 State: WARNING Date/Time: Sun 08 Sep 20:21:53 UTC 2019 Notes URLs: Acknowledged by : Additional Info: WARNING: deployment-prep.deployment-fluorine02.diskspace._srv.byte_percentfree (<20.00%) ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - Graphite Labs/Mediawiki Error Rate is WARNING **
Notification Type: PROBLEM Service: Mediawiki Error Rate Host: Graphite Labs Address: graphite-labs.wikimedia.org State: WARNING Date/Time: Sun 08 Sep 20:16:04 UTC 2019 Notes URLs: Acknowledged by : Additional Info: WARNING: 60.00% of data above the warning threshold [1.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - Graphite Labs/Mediawiki Error Rate is CRITICAL **
Notification Type: PROBLEM Service: Mediawiki Error Rate Host: Graphite Labs Address: graphite-labs.wikimedia.org State: CRITICAL Date/Time: Sun 08 Sep 20:11:04 UTC 2019 Notes URLs: Acknowledged by : Additional Info: CRITICAL: 20.00% of data above the critical threshold [10.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - deployment-deploy01/Free space - all mounts is WARNING **
Notification Type: PROBLEM Service: Free space - all mounts Host: deployment-deploy01 Address: 172.16.4.18 State: WARNING Date/Time: Sun 08 Sep 19:17:39 UTC 2019 Notes URLs: Acknowledged by : Additional Info: WARNING: deployment-prep.deployment-deploy01.diskspace.root.byte_percentfree (<10.00%) ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-deploy01/Free space - all mounts is OK **
Notification Type: RECOVERY Service: Free space - all mounts Host: deployment-deploy01 Address: 172.16.4.18 State: OK Date/Time: Sun 08 Sep 19:06:39 UTC 2019 Notes URLs: Acknowledged by : Additional Info: OK: All targets OK ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - Graphite Labs/Mediawiki Error Rate is WARNING **
Notification Type: PROBLEM Service: Mediawiki Error Rate Host: Graphite Labs Address: graphite-labs.wikimedia.org State: WARNING Date/Time: Sun 08 Sep 18:16:00 UTC 2019 Notes URLs: Acknowledged by : Additional Info: WARNING: 60.00% of data above the warning threshold [1.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - Graphite Labs/Mediawiki Error Rate is CRITICAL **
Notification Type: PROBLEM Service: Mediawiki Error Rate Host: Graphite Labs Address: graphite-labs.wikimedia.org State: CRITICAL Date/Time: Sun 08 Sep 18:11:00 UTC 2019 Notes URLs: Acknowledged by : Additional Info: CRITICAL: 20.00% of data above the critical threshold [10.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - Graphite Labs/Mediawiki Error Rate is WARNING **
Notification Type: PROBLEM Service: Mediawiki Error Rate Host: Graphite Labs Address: graphite-labs.wikimedia.org State: WARNING Date/Time: Sun 08 Sep 16:16:01 UTC 2019 Notes URLs: Acknowledged by : Additional Info: WARNING: 60.00% of data above the warning threshold [1.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - Graphite Labs/Mediawiki Error Rate is CRITICAL **
Notification Type: PROBLEM Service: Mediawiki Error Rate Host: Graphite Labs Address: graphite-labs.wikimedia.org State: CRITICAL Date/Time: Sun 08 Sep 16:11:02 UTC 2019 Notes URLs: Acknowledged by : Additional Info: CRITICAL: 20.00% of data above the critical threshold [10.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - deployment-deploy01/Free space - all mounts is WARNING **
Notification Type: PROBLEM Service: Free space - all mounts Host: deployment-deploy01 Address: 172.16.4.18 State: WARNING Date/Time: Sun 08 Sep 16:06:41 UTC 2019 Notes URLs: Acknowledged by : Additional Info: WARNING: deployment-prep.deployment-deploy01.diskspace.root.byte_percentfree (<10.00%) ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-deploy01/Free space - all mounts is OK **
Notification Type: RECOVERY Service: Free space - all mounts Host: deployment-deploy01 Address: 172.16.4.18 State: OK Date/Time: Sun 08 Sep 15:55:40 UTC 2019 Notes URLs: Acknowledged by : Additional Info: OK: All targets OK ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - deployment-deploy01/Free space - all mounts is WARNING **
Notification Type: PROBLEM Service: Free space - all mounts Host: deployment-deploy01 Address: 172.16.4.18 State: WARNING Date/Time: Sun 08 Sep 14:40:42 UTC 2019 Notes URLs: Acknowledged by : Additional Info: WARNING: deployment-prep.deployment-deploy01.diskspace.root.byte_percentfree (<10.00%) ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-deploy01/Free space - all mounts is OK **
Notification Type: RECOVERY Service: Free space - all mounts Host: deployment-deploy01 Address: 172.16.4.18 State: OK Date/Time: Sun 08 Sep 14:29:40 UTC 2019 Notes URLs: Acknowledged by : Additional Info: OK: All targets OK ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - Graphite Labs/Mediawiki Error Rate is WARNING **
Notification Type: PROBLEM Service: Mediawiki Error Rate Host: Graphite Labs Address: graphite-labs.wikimedia.org State: WARNING Date/Time: Sun 08 Sep 14:16:00 UTC 2019 Notes URLs: Acknowledged by : Additional Info: WARNING: 60.00% of data above the warning threshold [1.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - Graphite Labs/Mediawiki Error Rate is CRITICAL **
Notification Type: PROBLEM Service: Mediawiki Error Rate Host: Graphite Labs Address: graphite-labs.wikimedia.org State: CRITICAL Date/Time: Sun 08 Sep 14:11:01 UTC 2019 Notes URLs: Acknowledged by : Additional Info: CRITICAL: 20.00% of data above the critical threshold [10.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - deployment-deploy01/Free space - all mounts is WARNING **
Notification Type: PROBLEM Service: Free space - all mounts Host: deployment-deploy01 Address: 172.16.4.18 State: WARNING Date/Time: Sun 08 Sep 13:49:42 UTC 2019 Notes URLs: Acknowledged by : Additional Info: WARNING: deployment-prep.deployment-deploy01.diskspace.root.byte_percentfree (<10.00%) ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-deploy01/Free space - all mounts is OK **
Notification Type: RECOVERY Service: Free space - all mounts Host: deployment-deploy01 Address: 172.16.4.18 State: OK Date/Time: Sun 08 Sep 13:38:42 UTC 2019 Notes URLs: Acknowledged by : Additional Info: OK: All targets OK ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - Generic Beta Cluster/English Wikipedia Mobile Main page is OK **
Notification Type: RECOVERY Service: English Wikipedia Mobile Main page Host: Generic Beta Cluster Address: en.wikipedia.beta.wmflabs.org State: OK Date/Time: Sun 08 Sep 13:35:34 UTC 2019 Notes URLs: Acknowledged by : Additional Info: HTTP OK: HTTP/1.1 200 OK - 37034 bytes in 8.209 second response time ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - Generic Beta Cluster/English Wikipedia Mobile Main page is CRITICAL **
Notification Type: PROBLEM Service: English Wikipedia Mobile Main page Host: Generic Beta Cluster Address: en.wikipedia.beta.wmflabs.org State: CRITICAL Date/Time: Sun 08 Sep 13:30:34 UTC 2019 Notes URLs: Acknowledged by : Additional Info: (Service Check Timed Out) ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - Graphite Labs/Mediawiki Error Rate is WARNING **
Notification Type: PROBLEM Service: Mediawiki Error Rate Host: Graphite Labs Address: graphite-labs.wikimedia.org State: WARNING Date/Time: Sun 08 Sep 12:16:02 UTC 2019 Notes URLs: Acknowledged by : Additional Info: WARNING: 60.00% of data above the warning threshold [1.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - Graphite Labs/Mediawiki Error Rate is CRITICAL **
Notification Type: PROBLEM Service: Mediawiki Error Rate Host: Graphite Labs Address: graphite-labs.wikimedia.org State: CRITICAL Date/Time: Sun 08 Sep 12:11:01 UTC 2019 Notes URLs: Acknowledged by : Additional Info: CRITICAL: 20.00% of data above the critical threshold [10.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - Graphite Labs/Mediawiki Error Rate is WARNING **
Notification Type: PROBLEM Service: Mediawiki Error Rate Host: Graphite Labs Address: graphite-labs.wikimedia.org State: WARNING Date/Time: Sun 08 Sep 10:16:01 UTC 2019 Notes URLs: Acknowledged by : Additional Info: WARNING: 60.00% of data above the warning threshold [1.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - Graphite Labs/Mediawiki Error Rate is CRITICAL **
Notification Type: PROBLEM Service: Mediawiki Error Rate Host: Graphite Labs Address: graphite-labs.wikimedia.org State: CRITICAL Date/Time: Sun 08 Sep 10:11:03 UTC 2019 Notes URLs: Acknowledged by : Additional Info: CRITICAL: 20.00% of data above the critical threshold [10.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - Graphite Labs/Mediawiki Error Rate is WARNING **
Notification Type: PROBLEM Service: Mediawiki Error Rate Host: Graphite Labs Address: graphite-labs.wikimedia.org State: WARNING Date/Time: Sun 08 Sep 08:16:01 UTC 2019 Notes URLs: Acknowledged by : Additional Info: WARNING: 60.00% of data above the warning threshold [1.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - Graphite Labs/Mediawiki Error Rate is CRITICAL **
Notification Type: PROBLEM Service: Mediawiki Error Rate Host: Graphite Labs Address: graphite-labs.wikimedia.org State: CRITICAL Date/Time: Sun 08 Sep 08:11:02 UTC 2019 Notes URLs: Acknowledged by : Additional Info: CRITICAL: 20.00% of data above the critical threshold [10.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] selenium-daily-beta-MediaWiki - Build # 390 - Failure!
FAILURE: selenium-daily-beta-MediaWiki Build #390 (Sun, 08 Sep 2019 07:40:00 +) Test Result 1 failed, 0 skipped Failed Tests Test NameDurationAge chrome.User.should_be_able_to_log_in_daily21 sec1 All Tests PackageDurationFailSkipTotal chrome53 sec104 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
