[Betacluster-alerts] Host DOWN alert for deployment-db2!
Notification Type: PROBLEM Host: deployment-db2 State: DOWN Address: 10.68.17.94 Info: CRITICAL - Host Unreachable (10.68.17.94) Date/Time: Mon 03 Oct 09:42:22 UTC 2016 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] Host DOWN alert for deployment-db1!
Notification Type: PROBLEM Host: deployment-db1 State: DOWN Address: 10.68.16.193 Info: CRITICAL - Host Unreachable (10.68.16.193) Date/Time: Mon 03 Oct 09:43:20 UTC 2016 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] Host DOWN alert for deployment-poolcounter03!
Notification Type: PROBLEM Host: deployment-poolcounter03 State: DOWN Address: 10.68.19.250 Info: CRITICAL - Host Unreachable (10.68.19.250) Date/Time: Mon 03 Oct 10:13:55 UTC 2016 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - deployment-poolcounter04/Puppet run is CRITICAL **
Notification Type: PROBLEM Service: Puppet run Host: deployment-poolcounter04 Address: 10.68.17.48 State: CRITICAL Date/Time: Mon 03 Oct 13:28:27 UTC 2016 Additional Info: CRITICAL: 33.33% of data above the critical threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-poolcounter04/Puppet run is OK **
Notification Type: RECOVERY Service: Puppet run Host: deployment-poolcounter04 Address: 10.68.17.48 State: OK Date/Time: Mon 03 Oct 13:58:28 UTC 2016 Additional Info: OK: Less than 1.00% above the threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - deployment-cache-upload04/Puppet run is CRITICAL **
Notification Type: PROBLEM Service: Puppet run Host: deployment-cache-upload04 Address: 10.68.18.109 State: CRITICAL Date/Time: Mon 03 Oct 15:23:42 UTC 2016 Additional Info: CRITICAL: 20.00% of data above the critical threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - deployment-db03/Puppet run is CRITICAL **
Notification Type: PROBLEM Service: Puppet run Host: deployment-db03 Address: 10.68.23.30 State: CRITICAL Date/Time: Mon 03 Oct 15:31:52 UTC 2016 Additional Info: CRITICAL: 11.11% of data above the critical threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-cache-upload04/Puppet run is OK **
Notification Type: RECOVERY Service: Puppet run Host: deployment-cache-upload04 Address: 10.68.18.109 State: OK Date/Time: Mon 03 Oct 15:38:42 UTC 2016 Additional Info: OK: Less than 1.00% above the threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-db03/Puppet run is OK **
Notification Type: RECOVERY Service: Puppet run Host: deployment-db03 Address: 10.68.23.30 State: OK Date/Time: Mon 03 Oct 16:11:52 UTC 2016 Additional Info: OK: Less than 1.00% above the threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - deployment-prometheus01/Puppet run is CRITICAL **
Notification Type: PROBLEM Service: Puppet run Host: deployment-prometheus01 Address: 10.68.20.247 State: CRITICAL Date/Time: Mon 03 Oct 16:19:34 UTC 2016 Additional Info: CRITICAL: 40.00% of data above the critical threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-prometheus01/Puppet staleness is OK **
Notification Type: RECOVERY Service: Puppet staleness Host: deployment-prometheus01 Address: 10.68.20.247 State: OK Date/Time: Mon 03 Oct 16:25:32 UTC 2016 Additional Info: OK: Less than 1.00% above the threshold [3600.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-prometheus01/Puppet run is OK **
Notification Type: RECOVERY Service: Puppet run Host: deployment-prometheus01 Address: 10.68.20.247 State: OK Date/Time: Mon 03 Oct 16:49:35 UTC 2016 Additional Info: OK: Less than 1.00% above the threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - deployment-apertium01/Puppet run is CRITICAL **
Notification Type: PROBLEM Service: Puppet run Host: deployment-apertium01 Address: 10.68.16.79 State: CRITICAL Date/Time: Mon 03 Oct 17:19:31 UTC 2016 Additional Info: CRITICAL: 100.00% of data above the critical threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - deployment-redis01/Puppet run is CRITICAL **
Notification Type: PROBLEM Service: Puppet run Host: deployment-redis01 Address: 10.68.16.177 State: CRITICAL Date/Time: Mon 03 Oct 18:37:52 UTC 2016 Additional Info: CRITICAL: 60.00% of data above the critical threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - deployment-eventlogging03/Puppet run is CRITICAL **
Notification Type: PROBLEM Service: Puppet run Host: deployment-eventlogging03 Address: 10.68.18.111 State: CRITICAL Date/Time: Mon 03 Oct 18:55:57 UTC 2016 Additional Info: CRITICAL: 50.00% of data above the critical threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-redis01/Puppet run is OK **
Notification Type: RECOVERY Service: Puppet run Host: deployment-redis01 Address: 10.68.16.177 State: OK Date/Time: Mon 03 Oct 19:12:52 UTC 2016 Additional Info: OK: Less than 1.00% above the threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-eventlogging03/Puppet run is OK **
Notification Type: RECOVERY Service: Puppet run Host: deployment-eventlogging03 Address: 10.68.18.111 State: OK Date/Time: Mon 03 Oct 19:30:56 UTC 2016 Additional Info: OK: Less than 1.00% above the threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - deployment-ms-be01/Puppet run is CRITICAL **
Notification Type: PROBLEM Service: Puppet run Host: deployment-ms-be01 Address: 10.68.16.24 State: CRITICAL Date/Time: Mon 03 Oct 20:31:41 UTC 2016 Additional Info: CRITICAL: 40.00% of data above the critical threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-ms-be01/Puppet run is OK **
Notification Type: RECOVERY Service: Puppet run Host: deployment-ms-be01 Address: 10.68.16.24 State: OK Date/Time: Mon 03 Oct 21:11:41 UTC 2016 Additional Info: OK: Less than 1.00% above the threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - deployment-kafka05/Puppet run is CRITICAL **
Notification Type: PROBLEM Service: Puppet run Host: deployment-kafka05 Address: 10.68.21.106 State: CRITICAL Date/Time: Mon 03 Oct 21:24:35 UTC 2016 Additional Info: CRITICAL: 44.44% of data above the critical threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] beta-scap-eqiad - Build # 122775 - Failure!
beta-scap-eqiad - Build # 122775 - Failure: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/122775/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] beta-scap-eqiad - Build # 122776 - Still Failing!
beta-scap-eqiad - Build # 122776 - Still Failing: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/122776/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] beta-scap-eqiad - Build # 122777 - Still Failing!
beta-scap-eqiad - Build # 122777 - Still Failing: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/122777/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] beta-scap-eqiad - Build # 122778 - Still Failing!
beta-scap-eqiad - Build # 122778 - Still Failing: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/122778/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-kafka05/Puppet run is OK **
Notification Type: RECOVERY Service: Puppet run Host: deployment-kafka05 Address: 10.68.21.106 State: OK Date/Time: Mon 03 Oct 22:04:35 UTC 2016 Additional Info: OK: Less than 1.00% above the threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] beta-scap-eqiad - Build # 122779 - Still Failing!
beta-scap-eqiad - Build # 122779 - Still Failing: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/122779/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] beta-scap-eqiad - Build # 122780 - Still Failing!
beta-scap-eqiad - Build # 122780 - Still Failing: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/122780/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] beta-scap-eqiad - Build # 122781 - Still Failing!
beta-scap-eqiad - Build # 122781 - Still Failing: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/122781/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] beta-scap-eqiad - Build # 122782 - Still Failing!
beta-scap-eqiad - Build # 122782 - Still Failing: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/122782/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] beta-scap-eqiad - Build # 122783 - Still Failing!
beta-scap-eqiad - Build # 122783 - Still Failing: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/122783/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - deployment-cache-text04/Puppet run is CRITICAL **
Notification Type: PROBLEM Service: Puppet run Host: deployment-cache-text04 Address: 10.68.18.103 State: CRITICAL Date/Time: Mon 03 Oct 22:42:28 UTC 2016 Additional Info: CRITICAL: 22.22% of data above the critical threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] beta-scap-eqiad - Build # 122784 - Fixed!
beta-scap-eqiad - Build # 122784 - Fixed: Check console output at https://integration.wikimedia.org/ci/job/beta-scap-eqiad/122784/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - deployment-mediawiki05/Puppet run is CRITICAL **
Notification Type: PROBLEM Service: Puppet run Host: deployment-mediawiki05 Address: 10.68.22.21 State: CRITICAL Date/Time: Mon 03 Oct 22:47:26 UTC 2016 Additional Info: CRITICAL: 40.00% of data above the critical threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - deployment-mediawiki05/App Server Main HTTP Response is CRITICAL **
Notification Type: PROBLEM Service: App Server Main HTTP Response Host: deployment-mediawiki05 Address: 10.68.22.21 State: CRITICAL Date/Time: Mon 03 Oct 22:48:06 UTC 2016 Additional Info: HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - 50638 bytes in 0.045 second response time ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - deployment-mediawiki04/App Server Main HTTP Response is CRITICAL **
Notification Type: PROBLEM Service: App Server Main HTTP Response Host: deployment-mediawiki04 Address: 10.68.19.128 State: CRITICAL Date/Time: Mon 03 Oct 22:48:56 UTC 2016 Additional Info: HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - 50638 bytes in 0.042 second response time ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - Generic Beta Cluster/English Wikipedia Main page is CRITICAL **
Notification Type: PROBLEM Service: English Wikipedia Main page Host: Generic Beta Cluster Address: en.wikipedia.beta.wmflabs.org State: CRITICAL Date/Time: Mon 03 Oct 22:50:07 UTC 2016 Additional Info: HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - string 'Wikipedia' not found on 'https://en.wikipedia.beta.wmflabs.org:443/wiki/Main_Page?debug=true' - 929 bytes in 0.054 second response time ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - Generic Beta Cluster/English Wikipedia Mobile Main page is CRITICAL **
Notification Type: PROBLEM Service: English Wikipedia Mobile Main page Host: Generic Beta Cluster Address: en.wikipedia.beta.wmflabs.org State: CRITICAL Date/Time: Mon 03 Oct 22:50:18 UTC 2016 Additional Info: HTTP CRITICAL: HTTP/1.1 503 Service Unavailable - string 'Wikipedia' not found on 'https://en.m.wikipedia.beta.wmflabs.org:443/wiki/Main_Page?debug=true' - 2236 bytes in 0.055 second response time ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - deployment-mediawiki06/App Server Main HTTP Response is CRITICAL **
Notification Type: PROBLEM Service: App Server Main HTTP Response Host: deployment-mediawiki06 Address: 10.68.19.241 State: CRITICAL Date/Time: Mon 03 Oct 22:52:03 UTC 2016 Additional Info: HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - 50638 bytes in 0.042 second response time ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-cache-text04/Puppet run is OK **
Notification Type: RECOVERY Service: Puppet run Host: deployment-cache-text04 Address: 10.68.18.103 State: OK Date/Time: Mon 03 Oct 22:57:28 UTC 2016 Additional Info: OK: Less than 1.00% above the threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-mediawiki05/Puppet run is OK **
Notification Type: RECOVERY Service: Puppet run Host: deployment-mediawiki05 Address: 10.68.22.21 State: OK Date/Time: Mon 03 Oct 23:02:25 UTC 2016 Additional Info: OK: Less than 1.00% above the threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - deployment-eventlogging04/Puppet run is CRITICAL **
Notification Type: PROBLEM Service: Puppet run Host: deployment-eventlogging04 Address: 10.68.23.204 State: CRITICAL Date/Time: Tue 04 Oct 01:05:18 UTC 2016 Additional Info: CRITICAL: 40.00% of data above the critical threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - deployment-mediawiki04/Puppet run is CRITICAL **
Notification Type: PROBLEM Service: Puppet run Host: deployment-mediawiki04 Address: 10.68.19.128 State: CRITICAL Date/Time: Tue 04 Oct 01:08:51 UTC 2016 Additional Info: CRITICAL: 50.00% of data above the critical threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - deployment-mira/Puppet run is CRITICAL **
Notification Type: PROBLEM Service: Puppet run Host: deployment-mira Address: 10.68.20.135 State: CRITICAL Date/Time: Tue 04 Oct 01:09:31 UTC 2016 Additional Info: CRITICAL: 20.00% of data above the critical threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - deployment-mediawiki06/Puppet run is CRITICAL **
Notification Type: PROBLEM Service: Puppet run Host: deployment-mediawiki06 Address: 10.68.19.241 State: CRITICAL Date/Time: Tue 04 Oct 01:12:23 UTC 2016 Additional Info: CRITICAL: 33.33% of data above the critical threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - deployment-mathoid/Puppet run is CRITICAL **
Notification Type: PROBLEM Service: Puppet run Host: deployment-mathoid Address: 10.68.23.236 State: CRITICAL Date/Time: Tue 04 Oct 01:13:42 UTC 2016 Additional Info: CRITICAL: 30.00% of data above the critical threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - deployment-tin/Puppet run is CRITICAL **
Notification Type: PROBLEM Service: Puppet run Host: deployment-tin Address: 10.68.21.205 State: CRITICAL Date/Time: Tue 04 Oct 01:17:05 UTC 2016 Additional Info: CRITICAL: 22.22% of data above the critical threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - deployment-mediawiki05/Puppet run is CRITICAL **
Notification Type: PROBLEM Service: Puppet run Host: deployment-mediawiki05 Address: 10.68.22.21 State: CRITICAL Date/Time: Tue 04 Oct 01:18:24 UTC 2016 Additional Info: CRITICAL: 40.00% of data above the critical threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - deployment-zotero01/Puppet run is CRITICAL **
Notification Type: PROBLEM Service: Puppet run Host: deployment-zotero01 Address: 10.68.17.102 State: CRITICAL Date/Time: Tue 04 Oct 01:19:03 UTC 2016 Additional Info: CRITICAL: 22.22% of data above the critical threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - deployment-parsoid09/Puppet run is CRITICAL **
Notification Type: PROBLEM Service: Puppet run Host: deployment-parsoid09 Address: 10.68.20.142 State: CRITICAL Date/Time: Tue 04 Oct 01:19:33 UTC 2016 Additional Info: CRITICAL: 66.67% of data above the critical threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - deployment-sca03/Puppet run is CRITICAL **
Notification Type: PROBLEM Service: Puppet run Host: deployment-sca03 Address: 10.68.21.183 State: CRITICAL Date/Time: Tue 04 Oct 01:20:46 UTC 2016 Additional Info: CRITICAL: 40.00% of data above the critical threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - deployment-pdfrender/Puppet run is CRITICAL **
Notification Type: PROBLEM Service: Puppet run Host: deployment-pdfrender Address: 10.68.17.167 State: CRITICAL Date/Time: Tue 04 Oct 01:20:56 UTC 2016 Additional Info: CRITICAL: 50.00% of data above the critical threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - deployment-jobrunner02/Puppet run is CRITICAL **
Notification Type: PROBLEM Service: Puppet run Host: deployment-jobrunner02 Address: 10.68.19.42 State: CRITICAL Date/Time: Tue 04 Oct 01:22:34 UTC 2016 Additional Info: CRITICAL: 66.67% of data above the critical threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - deployment-changeprop/Puppet run is CRITICAL **
Notification Type: PROBLEM Service: Puppet run Host: deployment-changeprop Address: 10.68.16.88 State: CRITICAL Date/Time: Tue 04 Oct 01:22:48 UTC 2016 Additional Info: CRITICAL: 55.56% of data above the critical threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - deployment-eventlogging03/Puppet run is CRITICAL **
Notification Type: PROBLEM Service: Puppet run Host: deployment-eventlogging03 Address: 10.68.18.111 State: CRITICAL Date/Time: Tue 04 Oct 01:26:56 UTC 2016 Additional Info: CRITICAL: 50.00% of data above the critical threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-tin/Puppet run is OK **
Notification Type: RECOVERY Service: Puppet run Host: deployment-tin Address: 10.68.21.205 State: OK Date/Time: Tue 04 Oct 01:27:05 UTC 2016 Additional Info: OK: Less than 1.00% above the threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - deployment-sca01/Puppet run is CRITICAL **
Notification Type: PROBLEM Service: Puppet run Host: deployment-sca01 Address: 10.68.20.183 State: CRITICAL Date/Time: Tue 04 Oct 01:28:11 UTC 2016 Additional Info: CRITICAL: 33.33% of data above the critical threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - deployment-aqs01/Puppet run is CRITICAL **
Notification Type: PROBLEM Service: Puppet run Host: deployment-aqs01 Address: 10.68.18.237 State: CRITICAL Date/Time: Tue 04 Oct 01:28:46 UTC 2016 Additional Info: CRITICAL: 66.67% of data above the critical threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-mira/Puppet run is OK **
Notification Type: RECOVERY Service: Puppet run Host: deployment-mira Address: 10.68.20.135 State: OK Date/Time: Tue 04 Oct 01:29:31 UTC 2016 Additional Info: OK: Less than 1.00% above the threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - deployment-sca02/Puppet run is CRITICAL **
Notification Type: PROBLEM Service: Puppet run Host: deployment-sca02 Address: 10.68.20.153 State: CRITICAL Date/Time: Tue 04 Oct 01:30:27 UTC 2016 Additional Info: CRITICAL: 55.56% of data above the critical threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-mediawiki04/Puppet run is OK **
Notification Type: RECOVERY Service: Puppet run Host: deployment-mediawiki04 Address: 10.68.19.128 State: OK Date/Time: Tue 04 Oct 01:33:50 UTC 2016 Additional Info: OK: Less than 1.00% above the threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** PROBLEM alert - deployment-tmh01/Puppet run is CRITICAL **
Notification Type: PROBLEM Service: Puppet run Host: deployment-tmh01 Address: 10.68.16.211 State: CRITICAL Date/Time: Tue 04 Oct 01:34:29 UTC 2016 Additional Info: CRITICAL: 40.00% of data above the critical threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-eventlogging04/Puppet run is OK **
Notification Type: RECOVERY Service: Puppet run Host: deployment-eventlogging04 Address: 10.68.23.204 State: OK Date/Time: Tue 04 Oct 01:45:18 UTC 2016 Additional Info: OK: Less than 1.00% above the threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-mediawiki06/Puppet run is OK **
Notification Type: RECOVERY Service: Puppet run Host: deployment-mediawiki06 Address: 10.68.19.241 State: OK Date/Time: Tue 04 Oct 01:52:22 UTC 2016 Additional Info: OK: Less than 1.00% above the threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-mediawiki05/Puppet run is OK **
Notification Type: RECOVERY Service: Puppet run Host: deployment-mediawiki05 Address: 10.68.22.21 State: OK Date/Time: Tue 04 Oct 01:53:26 UTC 2016 Additional Info: OK: Less than 1.00% above the threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-mathoid/Puppet run is OK **
Notification Type: RECOVERY Service: Puppet run Host: deployment-mathoid Address: 10.68.23.236 State: OK Date/Time: Tue 04 Oct 01:53:41 UTC 2016 Additional Info: OK: Less than 1.00% above the threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-parsoid09/Puppet run is OK **
Notification Type: RECOVERY Service: Puppet run Host: deployment-parsoid09 Address: 10.68.20.142 State: OK Date/Time: Tue 04 Oct 01:54:35 UTC 2016 Additional Info: OK: Less than 1.00% above the threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-pdfrender/Puppet run is OK **
Notification Type: RECOVERY Service: Puppet run Host: deployment-pdfrender Address: 10.68.17.167 State: OK Date/Time: Tue 04 Oct 01:55:56 UTC 2016 Additional Info: OK: Less than 1.00% above the threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-jobrunner02/Puppet run is OK **
Notification Type: RECOVERY Service: Puppet run Host: deployment-jobrunner02 Address: 10.68.19.42 State: OK Date/Time: Tue 04 Oct 01:57:36 UTC 2016 Additional Info: OK: Less than 1.00% above the threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-changeprop/Puppet run is OK **
Notification Type: RECOVERY Service: Puppet run Host: deployment-changeprop Address: 10.68.16.88 State: OK Date/Time: Tue 04 Oct 01:57:47 UTC 2016 Additional Info: OK: Less than 1.00% above the threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-zotero01/Puppet run is OK **
Notification Type: RECOVERY Service: Puppet run Host: deployment-zotero01 Address: 10.68.17.102 State: OK Date/Time: Tue 04 Oct 01:59:03 UTC 2016 Additional Info: OK: Less than 1.00% above the threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-sca03/Puppet run is OK **
Notification Type: RECOVERY Service: Puppet run Host: deployment-sca03 Address: 10.68.21.183 State: OK Date/Time: Tue 04 Oct 02:00:44 UTC 2016 Additional Info: OK: Less than 1.00% above the threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-eventlogging03/Puppet run is OK **
Notification Type: RECOVERY Service: Puppet run Host: deployment-eventlogging03 Address: 10.68.18.111 State: OK Date/Time: Tue 04 Oct 02:01:57 UTC 2016 Additional Info: OK: Less than 1.00% above the threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-aqs01/Puppet run is OK **
Notification Type: RECOVERY Service: Puppet run Host: deployment-aqs01 Address: 10.68.18.237 State: OK Date/Time: Tue 04 Oct 02:03:46 UTC 2016 Additional Info: OK: Less than 1.00% above the threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-sca02/Puppet run is OK **
Notification Type: RECOVERY Service: Puppet run Host: deployment-sca02 Address: 10.68.20.153 State: OK Date/Time: Tue 04 Oct 02:05:27 UTC 2016 Additional Info: OK: Less than 1.00% above the threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-sca01/Puppet run is OK **
Notification Type: RECOVERY Service: Puppet run Host: deployment-sca01 Address: 10.68.20.183 State: OK Date/Time: Tue 04 Oct 02:08:11 UTC 2016 Additional Info: OK: Less than 1.00% above the threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] ** RECOVERY alert - deployment-tmh01/Puppet run is OK **
Notification Type: RECOVERY Service: Puppet run Host: deployment-tmh01 Address: 10.68.16.211 State: OK Date/Time: Tue 04 Oct 02:14:28 UTC 2016 Additional Info: OK: Less than 1.00% above the threshold [0.0] ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] Host DOWN alert for deployment-phab1001!
Notification Type: PROBLEM Host: deployment-phab1001 State: DOWN Address: 10.68.23.160 Info: CRITICAL - Host Unreachable (10.68.23.160) Date/Time: Tue 04 Oct 05:52:40 UTC 2016 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
[Betacluster-alerts] Host DOWN alert for deployment-phab2001!
Notification Type: PROBLEM Host: deployment-phab2001 State: DOWN Address: 10.68.23.140 Info: CRITICAL - Host Unreachable (10.68.23.140) Date/Time: Tue 04 Oct 05:54:52 UTC 2016 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikimedia.org/mailman/listinfo/betacluster-alerts
