[Betacluster-alerts] ** PROBLEM alert - deployment-secureredirexperiment/Puppet errors is CRITICAL **

Notification Type: PROBLEM Service: Puppet errors Host: deployment-secureredirexperiment Address: 10.68.17.132 State: CRITICAL Date/Time: Tue 16 Jan 18:54:27 UTC 2018 Notes URLs: Additional Info: CRITICAL: 100.00% of data above the critical threshold [0.0]

[Betacluster-alerts] ** PROBLEM alert - Graphite Labs/Mediawiki Error Rate is WARNING **

Notification Type: PROBLEM Service: Mediawiki Error Rate Host: Graphite Labs Address: graphite-labs.wikimedia.org State: WARNING Date/Time: Tue 16 Jan 19:11:41 UTC 2018 Notes URLs: Additional Info: WARNING: 20.00% of data above the warning threshold [1.0] _

[Betacluster-alerts] ** RECOVERY alert - Graphite Labs/Mediawiki Error Rate is OK **

Notification Type: RECOVERY Service: Mediawiki Error Rate Host: Graphite Labs Address: graphite-labs.wikimedia.org State: OK Date/Time: Tue 16 Jan 19:16:43 UTC 2018 Notes URLs: Additional Info: OK: Less than 1.00% above the threshold [1.0] ___ Betac

[Betacluster-alerts] ** PROBLEM alert - deployment-tin/Free space - all mounts is WARNING **

Notification Type: PROBLEM Service: Free space - all mounts Host: deployment-tin Address: 10.68.21.205 State: WARNING Date/Time: Tue 16 Jan 19:23:53 UTC 2018 Notes URLs: Additional Info: WARNING: deployment-prep.deployment-tin.diskspace._mnt.byte_percentfree (No valid datapoints found)deplo

[Betacluster-alerts] ** RECOVERY alert - deployment-tin/Free space - all mounts is OK **

Notification Type: RECOVERY Service: Free space - all mounts Host: deployment-tin Address: 10.68.21.205 State: OK Date/Time: Tue 16 Jan 19:33:52 UTC 2018 Notes URLs: Additional Info: OK: deployment-prep.deployment-tin.diskspace._mnt.byte_percentfree (No valid datapoints found) __

[Betacluster-alerts] Host DOWN alert for deployment-sca02!

Notification Type: PROBLEM Host: deployment-sca02 State: DOWN Address: 10.68.20.153 Info: CRITICAL - Host Unreachable (10.68.20.153) Date/Time: Tue 16 Jan 19:48:52 UTC 2018 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https:

[Betacluster-alerts] Host DOWN alert for deployment-kafka03!

Notification Type: PROBLEM Host: deployment-kafka03 State: DOWN Address: 10.68.16.138 Info: CRITICAL - Host Unreachable (10.68.16.138) Date/Time: Tue 16 Jan 19:49:18 UTC 2018 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org http

[Betacluster-alerts] Host DOWN alert for deployment-mathoid!

Notification Type: PROBLEM Host: deployment-mathoid State: DOWN Address: 10.68.23.236 Info: CRITICAL - Host Unreachable (10.68.23.236) Date/Time: Tue 16 Jan 19:49:36 UTC 2018 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org http

[Betacluster-alerts] Host DOWN alert for deployment-changeprop!

Notification Type: PROBLEM Host: deployment-changeprop State: DOWN Address: 10.68.16.88 Info: CRITICAL - Host Unreachable (10.68.16.88) Date/Time: Tue 16 Jan 19:49:39 UTC 2018 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org htt

[Betacluster-alerts] Host DOWN alert for deployment-kafka01!

Notification Type: PROBLEM Host: deployment-kafka01 State: DOWN Address: 10.68.21.219 Info: CRITICAL - Host Unreachable (10.68.21.219) Date/Time: Tue 16 Jan 19:49:38 UTC 2018 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org http

[Betacluster-alerts] Host DOWN alert for deployment-ircd!

Notification Type: PROBLEM Host: deployment-ircd State: DOWN Address: 10.68.20.19 Info: CRITICAL - Host Unreachable (10.68.20.19) Date/Time: Tue 16 Jan 19:51:03 UTC 2018 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://l

[Betacluster-alerts] Host DOWN alert for deployment-elastic05!

Notification Type: PROBLEM Host: deployment-elastic05 State: DOWN Address: 10.68.20.21 Info: CRITICAL - Host Unreachable (10.68.20.21) Date/Time: Tue 16 Jan 19:52:02 UTC 2018 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org http

[Betacluster-alerts] Host UP alert for deployment-elastic05!

Notification Type: RECOVERY Host: deployment-elastic05 State: UP Address: 10.68.20.21 Info: PING OK - Packet loss = 0%, RTA = 2.64 ms Date/Time: Tue 16 Jan 19:57:44 UTC 2018 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https

[Betacluster-alerts] Host UP alert for deployment-changeprop!

Notification Type: RECOVERY Host: deployment-changeprop State: UP Address: 10.68.16.88 Info: PING OK - Packet loss = 0%, RTA = 2.25 ms Date/Time: Tue 16 Jan 19:57:46 UTC 2018 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org http

[Betacluster-alerts] Host UP alert for deployment-kafka03!

Notification Type: RECOVERY Host: deployment-kafka03 State: UP Address: 10.68.16.138 Info: PING OK - Packet loss = 0%, RTA = 3.93 ms Date/Time: Tue 16 Jan 19:58:09 UTC 2018 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https:

[Betacluster-alerts] Host UP alert for deployment-mathoid!

Notification Type: RECOVERY Host: deployment-mathoid State: UP Address: 10.68.23.236 Info: PING OK - Packet loss = 0%, RTA = 2.22 ms Date/Time: Tue 16 Jan 19:58:30 UTC 2018 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https:

[Betacluster-alerts] Host UP alert for deployment-kafka01!

Notification Type: RECOVERY Host: deployment-kafka01 State: UP Address: 10.68.21.219 Info: PING OK - Packet loss = 0%, RTA = 3.73 ms Date/Time: Tue 16 Jan 19:58:39 UTC 2018 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https:

[Betacluster-alerts] Host UP alert for deployment-ircd!

Notification Type: RECOVERY Host: deployment-ircd State: UP Address: 10.68.20.19 Info: PING OK - Packet loss = 0%, RTA = 2.95 ms Date/Time: Tue 16 Jan 19:59:26 UTC 2018 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://li

[Betacluster-alerts] ** PROBLEM alert - deployment-tin/Free space - all mounts is WARNING **

Notification Type: PROBLEM Service: Free space - all mounts Host: deployment-tin Address: 10.68.21.205 State: WARNING Date/Time: Tue 16 Jan 19:59:55 UTC 2018 Notes URLs: Additional Info: WARNING: deployment-prep.deployment-tin.diskspace._mnt.byte_percentfree (No valid datapoints found)deplo

[Betacluster-alerts] Host UP alert for deployment-sca02!

Notification Type: RECOVERY Host: deployment-sca02 State: UP Address: 10.68.20.153 Info: PING OK - Packet loss = 0%, RTA = 3.09 ms Date/Time: Tue 16 Jan 20:01:00 UTC 2018 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://

[Betacluster-alerts] ** PROBLEM alert - deployment-kafka03/Puppet errors is CRITICAL **

Notification Type: PROBLEM Service: Puppet errors Host: deployment-kafka03 Address: 10.68.16.138 State: CRITICAL Date/Time: Tue 16 Jan 20:18:05 UTC 2018 Notes URLs: Additional Info: CRITICAL: 100.00% of data above the critical threshold [0.0] ___ Be

[Betacluster-alerts] ** PROBLEM alert - deployment-pdfrender02/Puppet errors is CRITICAL **

Notification Type: PROBLEM Service: Puppet errors Host: deployment-pdfrender02 Address: 10.68.21.240 State: CRITICAL Date/Time: Tue 16 Jan 20:19:11 UTC 2018 Notes URLs: Additional Info: CRITICAL: 20.00% of data above the critical threshold [0.0] ___

[Betacluster-alerts] ** RECOVERY alert - deployment-kafka03/Puppet staleness is OK **

Notification Type: RECOVERY Service: Puppet staleness Host: deployment-kafka03 Address: 10.68.16.138 State: OK Date/Time: Tue 16 Jan 20:19:33 UTC 2018 Notes URLs: Additional Info: OK: Less than 1.00% above the threshold [3600.0] ___ Betacluster-aler

[Betacluster-alerts] ** PROBLEM alert - deployment-kafka01/Free space - all mounts is CRITICAL **

Notification Type: PROBLEM Service: Free space - all mounts Host: deployment-kafka01 Address: 10.68.21.219 State: CRITICAL Date/Time: Tue 16 Jan 20:19:43 UTC 2018 Notes URLs: Additional Info: CRITICAL: deployment-prep.deployment-kafka01.diskspace.root.byte_percentfree (<100.00%)

[Betacluster-alerts] ** PROBLEM alert - deployment-kafka03/Free space - all mounts is CRITICAL **

Notification Type: PROBLEM Service: Free space - all mounts Host: deployment-kafka03 Address: 10.68.16.138 State: CRITICAL Date/Time: Tue 16 Jan 20:20:31 UTC 2018 Notes URLs: Additional Info: CRITICAL: deployment-prep.deployment-kafka03.diskspace.root.byte_percentfree (<100.00%)

[Betacluster-alerts] Host DOWN alert for deployment-aqs03!

Notification Type: PROBLEM Host: deployment-aqs03 State: DOWN Address: 10.68.17.125 Info: CRITICAL - Host Unreachable (10.68.17.125) Date/Time: Tue 16 Jan 20:23:26 UTC 2018 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https:

[Betacluster-alerts] Host DOWN alert for deployment-cache-upload04!

Notification Type: PROBLEM Host: deployment-cache-upload04 State: DOWN Address: 10.68.18.109 Info: CRITICAL - Host Unreachable (10.68.18.109) Date/Time: Tue 16 Jan 20:23:26 UTC 2018 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.o

[Betacluster-alerts] Host DOWN alert for deployment-logstash2!

Notification Type: PROBLEM Host: deployment-logstash2 State: DOWN Address: 10.68.16.147 Info: CRITICAL - Host Unreachable (10.68.16.147) Date/Time: Tue 16 Jan 20:23:28 UTC 2018 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org ht

[Betacluster-alerts] Host DOWN alert for deployment-eventlogging04!

Notification Type: PROBLEM Host: deployment-eventlogging04 State: DOWN Address: 10.68.23.204 Info: CRITICAL - Host Unreachable (10.68.23.204) Date/Time: Tue 16 Jan 20:23:59 UTC 2018 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.o

[Betacluster-alerts] ** RECOVERY alert - deployment-pdfrender02/Puppet errors is OK **

Notification Type: RECOVERY Service: Puppet errors Host: deployment-pdfrender02 Address: 10.68.21.240 State: OK Date/Time: Tue 16 Jan 20:24:13 UTC 2018 Notes URLs: Additional Info: OK: Less than 1.00% above the threshold [0.0] ___ Betacluster-alerts

[Betacluster-alerts] Host UP alert for deployment-aqs03!

Notification Type: RECOVERY Host: deployment-aqs03 State: UP Address: 10.68.17.125 Info: PING OK - Packet loss = 0%, RTA = 2.56 ms Date/Time: Tue 16 Jan 20:27:25 UTC 2018 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://

[Betacluster-alerts] Host UP alert for deployment-cache-upload04!

Notification Type: RECOVERY Host: deployment-cache-upload04 State: UP Address: 10.68.18.109 Info: PING OK - Packet loss = 0%, RTA = 2.94 ms Date/Time: Tue 16 Jan 20:27:49 UTC 2018 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] Host UP alert for deployment-logstash2!

Notification Type: RECOVERY Host: deployment-logstash2 State: UP Address: 10.68.16.147 Info: PING OK - Packet loss = 0%, RTA = 1.13 ms Date/Time: Tue 16 Jan 20:28:24 UTC 2018 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org http

[Betacluster-alerts] Host UP alert for deployment-eventlogging04!

Notification Type: RECOVERY Host: deployment-eventlogging04 State: UP Address: 10.68.23.204 Info: PING OK - Packet loss = 0%, RTA = 1.97 ms Date/Time: Tue 16 Jan 20:29:32 UTC 2018 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] ** RECOVERY alert - deployment-tin/Free space - all mounts is OK **

Notification Type: RECOVERY Service: Free space - all mounts Host: deployment-tin Address: 10.68.21.205 State: OK Date/Time: Tue 16 Jan 20:32:41 UTC 2018 Notes URLs: Additional Info: OK: deployment-prep.deployment-tin.diskspace._mnt.byte_percentfree (No valid datapoints found) __

[Betacluster-alerts] Host DOWN alert for deployment-parsoid09!

Notification Type: PROBLEM Host: deployment-parsoid09 State: DOWN Address: 10.68.20.142 Info: CRITICAL - Host Unreachable (10.68.20.142) Date/Time: Tue 16 Jan 20:35:57 UTC 2018 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org ht

[Betacluster-alerts] Host DOWN alert for deployment-sca04!

Notification Type: PROBLEM Host: deployment-sca04 State: DOWN Address: 10.68.18.80 Info: CRITICAL - Host Unreachable (10.68.18.80) Date/Time: Tue 16 Jan 20:36:34 UTC 2018 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://

[Betacluster-alerts] beta-scap-eqiad - Build # 191127 - Failure!

beta-scap-eqiad - Build # 191127 - Failure: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/191127/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.or

[Betacluster-alerts] ** PROBLEM alert - Generic Beta Cluster/English Wikipedia Main page is CRITICAL **

Notification Type: PROBLEM Service: English Wikipedia Main page Host: Generic Beta Cluster Address: en.wikipedia.beta.wmflabs.org State: CRITICAL Date/Time: Tue 16 Jan 20:37:09 UTC 2018 Notes URLs: Additional Info: HTTP CRITICAL: HTTP/1.1 503 Backend fetch failed - string 'Wikipedia' not foun

[Betacluster-alerts] ** PROBLEM alert - Generic Beta Cluster/English Wikipedia Mobile Main page is CRITICAL **

Notification Type: PROBLEM Service: English Wikipedia Mobile Main page Host: Generic Beta Cluster Address: en.wikipedia.beta.wmflabs.org State: CRITICAL Date/Time: Tue 16 Jan 20:36:46 UTC 2018 Notes URLs: Additional Info: HTTP CRITICAL: HTTP/1.1 503 Backend fetch failed - string 'Wikipedia' n

[Betacluster-alerts] Host DOWN alert for deployment-mediawiki04!

Notification Type: PROBLEM Host: deployment-mediawiki04 State: DOWN Address: 10.68.19.128 Info: CRITICAL - Host Unreachable (10.68.19.128) Date/Time: Tue 16 Jan 20:37:29 UTC 2018 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] ** PROBLEM alert - deployment-changeprop/Puppet errors is CRITICAL **

Notification Type: PROBLEM Service: Puppet errors Host: deployment-changeprop Address: 10.68.16.88 State: CRITICAL Date/Time: Tue 16 Jan 20:37:44 UTC 2018 Notes URLs: Additional Info: CRITICAL: 30.00% of data above the critical threshold [0.0] ___ B

[Betacluster-alerts] Host DOWN alert for deployment-poolcounter04!

Notification Type: PROBLEM Host: deployment-poolcounter04 State: DOWN Address: 10.68.17.48 Info: CRITICAL - Host Unreachable (10.68.17.48) Date/Time: Tue 16 Jan 20:38:00 UTC 2018 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] ** PROBLEM alert - deployment-ms-be04/Puppet errors is CRITICAL **

Notification Type: PROBLEM Service: Puppet errors Host: deployment-ms-be04 Address: 10.68.16.139 State: CRITICAL Date/Time: Tue 16 Jan 20:38:40 UTC 2018 Notes URLs: Additional Info: CRITICAL: 40.00% of data above the critical threshold [0.0] ___ Bet

[Betacluster-alerts] Host DOWN alert for deployment-mira!

Notification Type: PROBLEM Host: deployment-mira State: DOWN Address: 10.68.20.135 Info: CRITICAL - Host Unreachable (10.68.20.135) Date/Time: Tue 16 Jan 20:39:08 UTC 2018 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https:/

[Betacluster-alerts] Host DOWN alert for deployment-puppetmaster02!

Notification Type: PROBLEM Host: deployment-puppetmaster02 State: DOWN Address: 10.68.21.200 Info: CRITICAL - Host Unreachable (10.68.21.200) Date/Time: Tue 16 Jan 20:39:04 UTC 2018 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.o

[Betacluster-alerts] ** PROBLEM alert - deployment-kafka05/Puppet errors is CRITICAL **

Notification Type: PROBLEM Service: Puppet errors Host: deployment-kafka05 Address: 10.68.21.106 State: CRITICAL Date/Time: Tue 16 Jan 20:39:22 UTC 2018 Notes URLs: Additional Info: CRITICAL: 40.00% of data above the critical threshold [0.0] ___ Bet

[Betacluster-alerts] ** PROBLEM alert - deployment-cumin/Puppet errors is CRITICAL **

Notification Type: PROBLEM Service: Puppet errors Host: deployment-cumin Address: 10.68.21.105 State: CRITICAL Date/Time: Tue 16 Jan 20:40:02 UTC 2018 Notes URLs: Additional Info: CRITICAL: 60.00% of data above the critical threshold [0.0] ___ Betac

[Betacluster-alerts] Host UP alert for deployment-poolcounter04!

Notification Type: RECOVERY Host: deployment-poolcounter04 State: UP Address: 10.68.17.48 Info: PING OK - Packet loss = 0%, RTA = 0.67 ms Date/Time: Tue 16 Jan 20:41:01 UTC 2018 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org h

[Betacluster-alerts] Host UP alert for deployment-parsoid09!

Notification Type: RECOVERY Host: deployment-parsoid09 State: UP Address: 10.68.20.142 Info: PING OK - Packet loss = 0%, RTA = 0.94 ms Date/Time: Tue 16 Jan 20:40:58 UTC 2018 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org http

[Betacluster-alerts] ** PROBLEM alert - deployment-elastic05/Puppet errors is CRITICAL **

Notification Type: PROBLEM Service: Puppet errors Host: deployment-elastic05 Address: 10.68.20.21 State: CRITICAL Date/Time: Tue 16 Jan 20:41:12 UTC 2018 Notes URLs: Additional Info: CRITICAL: 44.44% of data above the critical threshold [0.0] ___ Be

[Betacluster-alerts] ** PROBLEM alert - deployment-sca01/Puppet errors is CRITICAL **

Notification Type: PROBLEM Service: Puppet errors Host: deployment-sca01 Address: 10.68.20.183 State: CRITICAL Date/Time: Tue 16 Jan 20:40:50 UTC 2018 Notes URLs: Additional Info: CRITICAL: 33.33% of data above the critical threshold [0.0] ___ Betac

[Betacluster-alerts] Host UP alert for deployment-mira!

Notification Type: RECOVERY Host: deployment-mira State: UP Address: 10.68.20.135 Info: PING OK - Packet loss = 0%, RTA = 0.56 ms Date/Time: Tue 16 Jan 20:41:00 UTC 2018 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://l

[Betacluster-alerts] Host UP alert for deployment-puppetmaster02!

Notification Type: RECOVERY Host: deployment-puppetmaster02 State: UP Address: 10.68.21.200 Info: PING OK - Packet loss = 0%, RTA = 0.64 ms Date/Time: Tue 16 Jan 20:41:41 UTC 2018 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] Host UP alert for deployment-mediawiki04!

Notification Type: RECOVERY Host: deployment-mediawiki04 State: UP Address: 10.68.19.128 Info: PING OK - Packet loss = 0%, RTA = 1.32 ms Date/Time: Tue 16 Jan 20:41:25 UTC 2018 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org ht

[Betacluster-alerts] Host UP alert for deployment-sca04!

Notification Type: RECOVERY Host: deployment-sca04 State: UP Address: 10.68.18.80 Info: PING OK - Packet loss = 0%, RTA = 0.50 ms Date/Time: Tue 16 Jan 20:41:43 UTC 2018 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://l

[Betacluster-alerts] ** RECOVERY alert - Generic Beta Cluster/English Wikipedia Mobile Main page is OK **

Notification Type: RECOVERY Service: English Wikipedia Mobile Main page Host: Generic Beta Cluster Address: en.wikipedia.beta.wmflabs.org State: OK Date/Time: Tue 16 Jan 20:41:45 UTC 2018 Notes URLs: Additional Info: HTTP OK: HTTP/1.1 200 OK - 35900 bytes in 1.570 second response time ___

[Betacluster-alerts] ** PROBLEM alert - deployment-kafka-jumbo-1/Puppet errors is CRITICAL **

Notification Type: PROBLEM Service: Puppet errors Host: deployment-kafka-jumbo-1 Address: 10.68.23.243 State: CRITICAL Date/Time: Tue 16 Jan 20:42:18 UTC 2018 Notes URLs: Additional Info: CRITICAL: 11.11% of data above the critical threshold [0.0] _

[Betacluster-alerts] ** RECOVERY alert - Generic Beta Cluster/English Wikipedia Main page is OK **

Notification Type: RECOVERY Service: English Wikipedia Main page Host: Generic Beta Cluster Address: en.wikipedia.beta.wmflabs.org State: OK Date/Time: Tue 16 Jan 20:42:08 UTC 2018 Notes URLs: Additional Info: HTTP OK: HTTP/1.1 200 OK - 47380 bytes in 1.242 second response time __

[Betacluster-alerts] ** PROBLEM alert - deployment-memc06/Puppet errors is CRITICAL **

Notification Type: PROBLEM Service: Puppet errors Host: deployment-memc06 Address: 10.68.22.239 State: CRITICAL Date/Time: Tue 16 Jan 20:42:31 UTC 2018 Notes URLs: Additional Info: CRITICAL: 50.00% of data above the critical threshold [0.0] ___ Beta

[Betacluster-alerts] ** PROBLEM alert - deployment-aqs01/Puppet errors is CRITICAL **

Notification Type: PROBLEM Service: Puppet errors Host: deployment-aqs01 Address: 10.68.18.237 State: CRITICAL Date/Time: Tue 16 Jan 20:42:55 UTC 2018 Notes URLs: Additional Info: CRITICAL: 66.67% of data above the critical threshold [0.0] ___ Betac

[Betacluster-alerts] ** PROBLEM alert - deployment-imagescaler02/Puppet errors is CRITICAL **

Notification Type: PROBLEM Service: Puppet errors Host: deployment-imagescaler02 Address: 10.68.18.233 State: CRITICAL Date/Time: Tue 16 Jan 20:43:22 UTC 2018 Notes URLs: Additional Info: CRITICAL: 44.44% of data above the critical threshold [0.0] _

[Betacluster-alerts] ** PROBLEM alert - deployment-urldownloader/Puppet errors is CRITICAL **

Notification Type: PROBLEM Service: Puppet errors Host: deployment-urldownloader Address: 10.68.16.135 State: CRITICAL Date/Time: Tue 16 Jan 20:43:39 UTC 2018 Notes URLs: Additional Info: CRITICAL: 22.22% of data above the critical threshold [0.0] _

[Betacluster-alerts] ** PROBLEM alert - deployment-db04/Puppet errors is CRITICAL **

Notification Type: PROBLEM Service: Puppet errors Host: deployment-db04 Address: 10.68.18.35 State: CRITICAL Date/Time: Tue 16 Jan 20:45:03 UTC 2018 Notes URLs: Additional Info: CRITICAL: 66.67% of data above the critical threshold [0.0] ___ Betaclu

[Betacluster-alerts] ** PROBLEM alert - deployment-mediawiki04/Puppet errors is CRITICAL **

Notification Type: PROBLEM Service: Puppet errors Host: deployment-mediawiki04 Address: 10.68.19.128 State: CRITICAL Date/Time: Tue 16 Jan 20:45:33 UTC 2018 Notes URLs: Additional Info: CRITICAL: 100.00% of data above the critical threshold [0.0] __

[Betacluster-alerts] ** PROBLEM alert - deployment-imagescaler01/Puppet errors is CRITICAL **

Notification Type: PROBLEM Service: Puppet errors Host: deployment-imagescaler01 Address: 10.68.19.158 State: CRITICAL Date/Time: Tue 16 Jan 20:46:39 UTC 2018 Notes URLs: Additional Info: CRITICAL: 60.00% of data above the critical threshold [0.0] _

[Betacluster-alerts] ** PROBLEM alert - deployment-sca04/Puppet errors is CRITICAL **

Notification Type: PROBLEM Service: Puppet errors Host: deployment-sca04 Address: 10.68.18.80 State: CRITICAL Date/Time: Tue 16 Jan 20:46:35 UTC 2018 Notes URLs: Additional Info: CRITICAL: 16.67% of data above the critical threshold [0.0] ___ Betacl

[Betacluster-alerts] beta-scap-eqiad - Build # 191128 - Fixed!

beta-scap-eqiad - Build # 191128 - Fixed: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/191128/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/

[Betacluster-alerts] ** PROBLEM alert - deployment-mediawiki05/App Server Main HTTP Response is CRITICAL **

Notification Type: PROBLEM Service: App Server Main HTTP Response Host: deployment-mediawiki05 Address: 10.68.22.21 State: CRITICAL Date/Time: Tue 16 Jan 20:49:15 UTC 2018 Notes URLs: Additional Info: CRITICAL - Socket timeout after 10 seconds ___ B

[Betacluster-alerts] Host DOWN alert for deployment-elastic07!

Notification Type: PROBLEM Host: deployment-elastic07 State: DOWN Address: 10.68.19.180 Info: CRITICAL - Host Unreachable (10.68.19.180) Date/Time: Tue 16 Jan 20:48:54 UTC 2018 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org ht

[Betacluster-alerts] Host DOWN alert for deployment-prometheus01!

Notification Type: PROBLEM Host: deployment-prometheus01 State: DOWN Address: 10.68.20.247 Info: CRITICAL - Host Unreachable (10.68.20.247) Date/Time: Tue 16 Jan 20:49:45 UTC 2018 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] ** PROBLEM alert - deployment-tin/SSH is CRITICAL **

Notification Type: PROBLEM Service: SSH Host: deployment-tin Address: 10.68.21.205 State: CRITICAL Date/Time: Tue 16 Jan 20:49:34 UTC 2018 Notes URLs: Additional Info: CRITICAL - Socket timeout after 10 seconds ___ Betacluster-alerts mailing list Be

[Betacluster-alerts] ** PROBLEM alert - deployment-mediawiki05/SSH is CRITICAL **

Notification Type: PROBLEM Service: SSH Host: deployment-mediawiki05 Address: 10.68.22.21 State: CRITICAL Date/Time: Tue 16 Jan 20:49:27 UTC 2018 Notes URLs: Additional Info: CRITICAL - Socket timeout after 10 seconds ___ Betacluster-alerts mailing

[Betacluster-alerts] ** PROBLEM alert - deployment-mira/Puppet errors is CRITICAL **

Notification Type: PROBLEM Service: Puppet errors Host: deployment-mira Address: 10.68.20.135 State: CRITICAL Date/Time: Tue 16 Jan 20:50:03 UTC 2018 Notes URLs: Additional Info: CRITICAL: 100.00% of data above the critical threshold [0.0] ___ Betac

[Betacluster-alerts] Host DOWN alert for deployment-db03!

Notification Type: PROBLEM Host: deployment-db03 State: DOWN Address: 10.68.23.30 Info: CRITICAL - Host Unreachable (10.68.23.30) Date/Time: Tue 16 Jan 20:50:00 UTC 2018 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://l

[Betacluster-alerts] Host DOWN alert for deployment-mediawiki05!

Notification Type: PROBLEM Host: deployment-mediawiki05 State: DOWN Address: 10.68.22.21 Info: CRITICAL - Host Unreachable (10.68.22.21) Date/Time: Tue 16 Jan 20:51:07 UTC 2018 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org ht

[Betacluster-alerts] ** RECOVERY alert - deployment-sca04/Puppet errors is OK **

Notification Type: RECOVERY Service: Puppet errors Host: deployment-sca04 Address: 10.68.18.80 State: OK Date/Time: Tue 16 Jan 20:51:36 UTC 2018 Notes URLs: Additional Info: OK: Less than 1.00% above the threshold [0.0] ___ Betacluster-alerts mailin

[Betacluster-alerts] Host DOWN alert for deployment-tin!

Notification Type: PROBLEM Host: deployment-tin State: DOWN Address: 10.68.21.205 Info: CRITICAL - Host Unreachable (10.68.21.205) Date/Time: Tue 16 Jan 20:51:57 UTC 2018 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://

[Betacluster-alerts] Host UP alert for deployment-mediawiki05!

Notification Type: RECOVERY Host: deployment-mediawiki05 State: UP Address: 10.68.22.21 Info: PING OK - Packet loss = 0%, RTA = 0.69 ms Date/Time: Tue 16 Jan 20:54:34 UTC 2018 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org htt

[Betacluster-alerts] Host UP alert for deployment-tin!

Notification Type: RECOVERY Host: deployment-tin State: UP Address: 10.68.21.205 Info: PING OK - Packet loss = 0%, RTA = 1.51 ms Date/Time: Tue 16 Jan 20:55:19 UTC 2018 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://li

[Betacluster-alerts] Host UP alert for deployment-prometheus01!

Notification Type: RECOVERY Host: deployment-prometheus01 State: UP Address: 10.68.20.247 Info: PING OK - Packet loss = 0%, RTA = 5.75 ms Date/Time: Tue 16 Jan 20:55:36 UTC 2018 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org h

[Betacluster-alerts] beta-code-update-eqiad - Build # 189816 - Failure!

beta-code-update-eqiad - Build # 189816 - Failure: Check console output at https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/189816/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://list

[Betacluster-alerts] Host UP alert for deployment-elastic07!

Notification Type: RECOVERY Host: deployment-elastic07 State: UP Address: 10.68.19.180 Info: PING OK - Packet loss = 0%, RTA = 1.44 ms Date/Time: Tue 16 Jan 20:54:56 UTC 2018 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org http

[Betacluster-alerts] ** PROBLEM alert - Graphite Labs/Mediawiki Error Rate is WARNING **

Notification Type: PROBLEM Service: Mediawiki Error Rate Host: Graphite Labs Address: graphite-labs.wikimedia.org State: WARNING Date/Time: Tue 16 Jan 20:55:29 UTC 2018 Notes URLs: Additional Info: WARNING: 40.00% of data above the warning threshold [1.0] _

[Betacluster-alerts] Host UP alert for deployment-db03!

Notification Type: RECOVERY Host: deployment-db03 State: UP Address: 10.68.23.30 Info: PING OK - Packet loss = 0%, RTA = 0.46 ms Date/Time: Tue 16 Jan 20:55:12 UTC 2018 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://li

[Betacluster-alerts] ** RECOVERY alert - deployment-tin/SSH is OK **

Notification Type: RECOVERY Service: SSH Host: deployment-tin Address: 10.68.21.205 State: OK Date/Time: Tue 16 Jan 20:59:24 UTC 2018 Notes URLs: Additional Info: SSH OK - OpenSSH_6.7p1 Debian-5+deb8u4 (protocol 2.0) ___ Betacluster-alerts mailing l

[Betacluster-alerts] ** RECOVERY alert - deployment-mediawiki05/SSH is OK **

Notification Type: RECOVERY Service: SSH Host: deployment-mediawiki05 Address: 10.68.22.21 State: OK Date/Time: Tue 16 Jan 20:59:19 UTC 2018 Notes URLs: Additional Info: SSH OK - OpenSSH_6.7p1 Debian-5+deb8u3 (protocol 2.0) ___ Betacluster-alerts ma

[Betacluster-alerts] ** PROBLEM alert - deployment-mediawiki05/Puppet errors is CRITICAL **

Notification Type: PROBLEM Service: Puppet errors Host: deployment-mediawiki05 Address: 10.68.22.21 State: CRITICAL Date/Time: Tue 16 Jan 20:59:42 UTC 2018 Notes URLs: Additional Info: CRITICAL: 20.00% of data above the critical threshold [0.0] ___

[Betacluster-alerts] Host DOWN alert for deployment-apertium02!

Notification Type: PROBLEM Host: deployment-apertium02 State: DOWN Address: 10.68.22.254 Info: CRITICAL - Host Unreachable (10.68.22.254) Date/Time: Tue 16 Jan 21:00:55 UTC 2018 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org h

[Betacluster-alerts] ** PROBLEM alert - deployment-elastic07/Puppet errors is CRITICAL **

Notification Type: PROBLEM Service: Puppet errors Host: deployment-elastic07 Address: 10.68.19.180 State: CRITICAL Date/Time: Tue 16 Jan 21:00:48 UTC 2018 Notes URLs: Additional Info: CRITICAL: 14.29% of data above the critical threshold [0.0] ___ B

[Betacluster-alerts] Host DOWN alert for deployment-urldownloader!

Notification Type: PROBLEM Host: deployment-urldownloader State: DOWN Address: 10.68.16.135 Info: CRITICAL - Host Unreachable (10.68.16.135) Date/Time: Tue 16 Jan 21:01:43 UTC 2018 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.or

[Betacluster-alerts] Host DOWN alert for deployment-mcs01!

Notification Type: PROBLEM Host: deployment-mcs01 State: DOWN Address: 10.68.17.18 Info: CRITICAL - Host Unreachable (10.68.17.18) Date/Time: Tue 16 Jan 21:01:28 UTC 2018 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://

[Betacluster-alerts] ** PROBLEM alert - deployment-prometheus01/Puppet errors is CRITICAL **

Notification Type: PROBLEM Service: Puppet errors Host: deployment-prometheus01 Address: 10.68.20.247 State: CRITICAL Date/Time: Tue 16 Jan 21:01:55 UTC 2018 Notes URLs: Additional Info: CRITICAL: 12.50% of data above the critical threshold [0.0] __

[Betacluster-alerts] Host DOWN alert for deployment-db04!

Notification Type: PROBLEM Host: deployment-db04 State: DOWN Address: 10.68.18.35 Info: CRITICAL - Host Unreachable (10.68.18.35) Date/Time: Tue 16 Jan 21:01:45 UTC 2018 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://l

[Betacluster-alerts] Host DOWN alert for deployment-mediawiki06!

Notification Type: PROBLEM Host: deployment-mediawiki06 State: DOWN Address: 10.68.19.241 Info: CRITICAL - Host Unreachable (10.68.19.241) Date/Time: Tue 16 Jan 21:02:36 UTC 2018 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] ** PROBLEM alert - deployment-tin/Puppet errors is CRITICAL **

Notification Type: PROBLEM Service: Puppet errors Host: deployment-tin Address: 10.68.21.205 State: CRITICAL Date/Time: Tue 16 Jan 21:02:38 UTC 2018 Notes URLs: Additional Info: CRITICAL: 12.50% of data above the critical threshold [0.0] ___ Betaclu

[Betacluster-alerts] ** PROBLEM alert - Generic Beta Cluster/English Wikipedia Mobile Main page is CRITICAL **

Notification Type: PROBLEM Service: English Wikipedia Mobile Main page Host: Generic Beta Cluster Address: en.wikipedia.beta.wmflabs.org State: CRITICAL Date/Time: Tue 16 Jan 21:02:45 UTC 2018 Notes URLs: Additional Info: HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - 2203 bytes in 2.110

[Betacluster-alerts] ** PROBLEM alert - Generic Beta Cluster/English Wikipedia Main page is CRITICAL **

Notification Type: PROBLEM Service: English Wikipedia Main page Host: Generic Beta Cluster Address: en.wikipedia.beta.wmflabs.org State: CRITICAL Date/Time: Tue 16 Jan 21:03:08 UTC 2018 Notes URLs: Additional Info: HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - 2185 bytes in 1.121 second

[Betacluster-alerts] ** PROBLEM alert - deployment-mediawiki04/App Server Main HTTP Response is CRITICAL **

Notification Type: PROBLEM Service: App Server Main HTTP Response Host: deployment-mediawiki04 Address: 10.68.19.128 State: CRITICAL Date/Time: Tue 16 Jan 21:03:22 UTC 2018 Notes URLs: Additional Info: HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - 1603 bytes in 2.074 second response ti

[Betacluster-alerts] Host DOWN alert for deployment-kafka05!

Notification Type: PROBLEM Host: deployment-kafka05 State: DOWN Address: 10.68.21.106 Info: CRITICAL - Host Unreachable (10.68.21.106) Date/Time: Tue 16 Jan 21:04:06 UTC 2018 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org http

<    1   2   3   >