[Betacluster-alerts] ** RECOVERY alert - deployment-mediawiki01/App Server Main HTTP Response is OK **

Notification Type: RECOVERY Service: App Server Main HTTP Response Host: deployment-mediawiki01 Address: 10.68.17.170 State: OK Date/Time: Fri 22 Jan 00:43:03 UTC 2016 Additional Info: HTTP OK: HTTP/1.1 200 OK - 39399 bytes in 7.713 second response time _

[Betacluster-alerts] ** PROBLEM alert - deployment-mediawiki01/App Server Main HTTP Response is CRITICAL **

Notification Type: PROBLEM Service: App Server Main HTTP Response Host: deployment-mediawiki01 Address: 10.68.17.170 State: CRITICAL Date/Time: Fri 22 Jan 00:38:05 UTC 2016 Additional Info: CRITICAL - Socket timeout after 10 seconds ___ Betacluster-al

[Betacluster-alerts] Host UP alert for deployment-cache-parsoid05!

Notification Type: RECOVERY Host: deployment-cache-parsoid05 State: UP Address: 10.68.20.102 Info: PING OK - Packet loss = 0%, RTA = 1.28 ms Date/Time: Thu 21 Jan 20:48:32 UTC 2016 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.or

[Betacluster-alerts] Host UP alert for deployment-conf03!

Notification Type: RECOVERY Host: deployment-conf03 State: UP Address: 10.68.20.134 Info: PING OK - Packet loss = 0%, RTA = 1.38 ms Date/Time: Thu 21 Jan 20:48:29 UTC 2016 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https:/

[Betacluster-alerts] Host UP alert for mira!

Notification Type: RECOVERY Host: mira State: UP Address: 10.68.17.215 Info: PING OK - Packet loss = 0%, RTA = 0.84 ms Date/Time: Thu 21 Jan 20:46:13 UTC 2016 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wikime

[Betacluster-alerts] Host UP alert for deployment-ms-fe01!

Notification Type: RECOVERY Host: deployment-ms-fe01 State: UP Address: 10.68.16.96 Info: PING OK - Packet loss = 0%, RTA = 0.84 ms Date/Time: Thu 21 Jan 20:45:52 UTC 2016 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https:/

[Betacluster-alerts] Host UP alert for deployment-puppetmaster!

Notification Type: RECOVERY Host: deployment-puppetmaster State: UP Address: 10.68.16.63 Info: PING OK - Packet loss = 0%, RTA = 0.75 ms Date/Time: Thu 21 Jan 20:46:20 UTC 2016 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org ht

[Betacluster-alerts] Host UP alert for deployment-tin!

Notification Type: RECOVERY Host: deployment-tin State: UP Address: 10.68.20.251 Info: PING OK - Packet loss = 0%, RTA = 0.89 ms Date/Time: Thu 21 Jan 20:44:51 UTC 2016 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://li

[Betacluster-alerts] Host DOWN alert for deployment-conf03!

Notification Type: PROBLEM Host: deployment-conf03 State: DOWN Address: 10.68.20.134 Info: CRITICAL - Host Unreachable (10.68.20.134) Date/Time: Thu 21 Jan 20:43:32 UTC 2016 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https

[Betacluster-alerts] Host DOWN alert for deployment-cache-parsoid05!

Notification Type: PROBLEM Host: deployment-cache-parsoid05 State: DOWN Address: 10.68.20.102 Info: CRITICAL - Host Unreachable (10.68.20.102) Date/Time: Thu 21 Jan 20:43:35 UTC 2016 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.

[Betacluster-alerts] Host DOWN alert for mira!

Notification Type: PROBLEM Host: mira State: DOWN Address: 10.68.17.215 Info: CRITICAL - Host Unreachable (10.68.17.215) Date/Time: Thu 21 Jan 20:41:13 UTC 2016 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.wiki

[Betacluster-alerts] Host DOWN alert for deployment-puppetmaster!

Notification Type: PROBLEM Host: deployment-puppetmaster State: DOWN Address: 10.68.16.63 Info: CRITICAL - Host Unreachable (10.68.16.63) Date/Time: Thu 21 Jan 20:41:21 UTC 2016 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org h

[Betacluster-alerts] Host DOWN alert for deployment-ms-fe01!

Notification Type: PROBLEM Host: deployment-ms-fe01 State: DOWN Address: 10.68.16.96 Info: CRITICAL - Host Unreachable (10.68.16.96) Date/Time: Thu 21 Jan 20:40:49 UTC 2016 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https:

[Betacluster-alerts] Host DOWN alert for deployment-tin!

Notification Type: PROBLEM Host: deployment-tin State: DOWN Address: 10.68.20.251 Info: CRITICAL - Host Unreachable (10.68.20.251) Date/Time: Thu 21 Jan 20:37:22 UTC 2016 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://

[Betacluster-alerts] Host UP alert for deployment-upload!

Notification Type: RECOVERY Host: deployment-upload State: UP Address: 10.68.16.189 Info: PING OK - Packet loss = 0%, RTA = 1.09 ms Date/Time: Thu 21 Jan 20:30:54 UTC 2016 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https:/

[Betacluster-alerts] Host UP alert for deployment-elastic07!

Notification Type: RECOVERY Host: deployment-elastic07 State: UP Address: 10.68.17.187 Info: PING OK - Packet loss = 0%, RTA = 1.75 ms Date/Time: Thu 21 Jan 20:28:52 UTC 2016 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org http

[Betacluster-alerts] Host UP alert for beta-cluster!

Notification Type: RECOVERY Host: beta-cluster State: UP Address: en.wikipedia.beta.wmflabs.org Info: PING OK - Packet loss = 0%, RTA = 0.78 ms Date/Time: Thu 21 Jan 20:26:44 UTC 2016 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia

[Betacluster-alerts] Host UP alert for deployment-restbase02!

Notification Type: RECOVERY Host: deployment-restbase02 State: UP Address: 10.68.17.189 Info: PING OK - Packet loss = 0%, RTA = 1.06 ms Date/Time: Thu 21 Jan 20:26:55 UTC 2016 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org htt

[Betacluster-alerts] Host UP alert for deployment-cache-text04!

Notification Type: RECOVERY Host: deployment-cache-text04 State: UP Address: 10.68.18.103 Info: PING OK - Packet loss = 0%, RTA = 0.64 ms Date/Time: Thu 21 Jan 20:26:56 UTC 2016 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org h

[Betacluster-alerts] Host DOWN alert for deployment-upload!

Notification Type: PROBLEM Host: deployment-upload State: DOWN Address: 10.68.16.189 Info: CRITICAL - Host Unreachable (10.68.16.189) Date/Time: Thu 21 Jan 20:25:52 UTC 2016 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https

[Betacluster-alerts] Host DOWN alert for deployment-elastic07!

Notification Type: PROBLEM Host: deployment-elastic07 State: DOWN Address: 10.68.17.187 Info: CRITICAL - Host Unreachable (10.68.17.187) Date/Time: Thu 21 Jan 20:23:51 UTC 2016 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org ht

[Betacluster-alerts] Host DOWN alert for beta-cluster!

Notification Type: PROBLEM Host: beta-cluster State: DOWN Address: en.wikipedia.beta.wmflabs.org Info: CRITICAL - Host Unreachable (en.wikipedia.beta.wmflabs.org) Date/Time: Thu 21 Jan 20:22:40 UTC 2016 ___ Betacluster-alerts mailing list Betacluster-ale

[Betacluster-alerts] Host DOWN alert for deployment-cache-text04!

Notification Type: PROBLEM Host: deployment-cache-text04 State: DOWN Address: 10.68.18.103 Info: CRITICAL - Host Unreachable (10.68.18.103) Date/Time: Thu 21 Jan 20:21:57 UTC 2016 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] Host DOWN alert for deployment-restbase02!

Notification Type: PROBLEM Host: deployment-restbase02 State: DOWN Address: 10.68.17.189 Info: CRITICAL - Host Unreachable (10.68.17.189) Date/Time: Thu 21 Jan 20:21:56 UTC 2016 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org h

[Betacluster-alerts] Host UP alert for deployment-aqs01!

Notification Type: RECOVERY Host: deployment-aqs01 State: UP Address: 10.68.18.237 Info: PING OK - Packet loss = 0%, RTA = 1.38 ms Date/Time: Thu 21 Jan 20:09:32 UTC 2016 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://

[Betacluster-alerts] Host DOWN alert for deployment-aqs01!

Notification Type: PROBLEM Host: deployment-aqs01 State: DOWN Address: 10.68.18.237 Info: CRITICAL - Host Unreachable (10.68.18.237) Date/Time: Thu 21 Jan 20:04:30 UTC 2016 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https:

[Betacluster-alerts] ** RECOVERY alert - Generic Beta Cluster/English Wikipedia Main page is OK **

Notification Type: RECOVERY Service: English Wikipedia Main page Host: Generic Beta Cluster Address: en.wikipedia.beta.wmflabs.org State: OK Date/Time: Thu 21 Jan 19:46:35 UTC 2016 Additional Info: HTTP OK: HTTP/1.1 200 OK - 39740 bytes in 0.894 second response time

[Betacluster-alerts] Host UP alert for deployment-cache-mobile04!

Notification Type: RECOVERY Host: deployment-cache-mobile04 State: UP Address: 10.68.18.110 Info: PING OK - Packet loss = 0%, RTA = 3.54 ms Date/Time: Thu 21 Jan 19:47:06 UTC 2016 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] Host UP alert for deployment-kafka04!

Notification Type: RECOVERY Host: deployment-kafka04 State: UP Address: 10.68.17.9 Info: PING OK - Packet loss = 0%, RTA = 1.61 ms Date/Time: Thu 21 Jan 19:44:25 UTC 2016 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://

[Betacluster-alerts] Host UP alert for deployment-tmh01!

Notification Type: RECOVERY Host: deployment-tmh01 State: UP Address: 10.68.16.211 Info: PING OK - Packet loss = 0%, RTA = 1.16 ms Date/Time: Thu 21 Jan 19:44:47 UTC 2016 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://

[Betacluster-alerts] Host UP alert for deployment-zotero01!

Notification Type: RECOVERY Host: deployment-zotero01 State: UP Address: 10.68.17.102 Info: PING OK - Packet loss = 0%, RTA = 0.77 ms Date/Time: Thu 21 Jan 19:44:10 UTC 2016 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https

[Betacluster-alerts] Host UP alert for deployment-elastic05!

Notification Type: RECOVERY Host: deployment-elastic05 State: UP Address: 10.68.17.182 Info: PING OK - Packet loss = 0%, RTA = 1.23 ms Date/Time: Thu 21 Jan 19:44:23 UTC 2016 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org http

[Betacluster-alerts] ** RECOVERY alert - Generic Beta Cluster/English Wikipedia Mobile Main page is OK **

Notification Type: RECOVERY Service: English Wikipedia Mobile Main page Host: Generic Beta Cluster Address: en.wikipedia.beta.wmflabs.org State: OK Date/Time: Thu 21 Jan 19:43:37 UTC 2016 Additional Info: HTTP OK: HTTP/1.1 200 OK - 31601 bytes in 0.531 second response time _

[Betacluster-alerts] Host UP alert for deployment-stream!

Notification Type: RECOVERY Host: deployment-stream State: UP Address: 10.68.17.106 Info: PING OK - Packet loss = 0%, RTA = 0.99 ms Date/Time: Thu 21 Jan 19:43:18 UTC 2016 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https:/

[Betacluster-alerts] Host UP alert for deployment-redis02!

Notification Type: RECOVERY Host: deployment-redis02 State: UP Address: 10.68.16.231 Info: PING OK - Packet loss = 0%, RTA = 0.70 ms Date/Time: Thu 21 Jan 19:43:26 UTC 2016 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https:

[Betacluster-alerts] Host UP alert for deployment-jobrunner01!

Notification Type: RECOVERY Host: deployment-jobrunner01 State: UP Address: 10.68.17.96 Info: PING OK - Packet loss = 0%, RTA = 0.80 ms Date/Time: Thu 21 Jan 19:43:03 UTC 2016 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org htt

[Betacluster-alerts] Host UP alert for deployment-mediawiki02!

Notification Type: RECOVERY Host: deployment-mediawiki02 State: UP Address: 10.68.16.127 Info: PING OK - Packet loss = 0%, RTA = 0.97 ms Date/Time: Thu 21 Jan 19:43:01 UTC 2016 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org ht

[Betacluster-alerts] Host UP alert for deployment-apertium01!

Notification Type: RECOVERY Host: deployment-apertium01 State: UP Address: 10.68.16.79 Info: PING OK - Packet loss = 0%, RTA = 1.14 ms Date/Time: Thu 21 Jan 19:42:55 UTC 2016 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org http

[Betacluster-alerts] Host DOWN alert for deployment-cache-mobile04!

Notification Type: PROBLEM Host: deployment-cache-mobile04 State: DOWN Address: 10.68.18.110 Info: CRITICAL - Host Unreachable (10.68.18.110) Date/Time: Thu 21 Jan 19:42:06 UTC 2016 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.o

[Betacluster-alerts] ** PROBLEM alert - Generic Beta Cluster/English Wikipedia Main page is CRITICAL **

Notification Type: PROBLEM Service: English Wikipedia Main page Host: Generic Beta Cluster Address: en.wikipedia.beta.wmflabs.org State: CRITICAL Date/Time: Thu 21 Jan 19:41:40 UTC 2016 Additional Info: HTTP CRITICAL: HTTP/1.1 503 Service Unavailable - string 'Wikipedia' not found on 'http://e

[Betacluster-alerts] Host DOWN alert for deployment-tmh01!

Notification Type: PROBLEM Host: deployment-tmh01 State: DOWN Address: 10.68.16.211 Info: CRITICAL - Host Unreachable (10.68.16.211) Date/Time: Thu 21 Jan 19:39:44 UTC 2016 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https:

[Betacluster-alerts] Host DOWN alert for deployment-kafka04!

Notification Type: PROBLEM Host: deployment-kafka04 State: DOWN Address: 10.68.17.9 Info: CRITICAL - Host Unreachable (10.68.17.9) Date/Time: Thu 21 Jan 19:39:25 UTC 2016 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://

[Betacluster-alerts] Host DOWN alert for deployment-elastic05!

Notification Type: PROBLEM Host: deployment-elastic05 State: DOWN Address: 10.68.17.182 Info: CRITICAL - Host Unreachable (10.68.17.182) Date/Time: Thu 21 Jan 19:39:24 UTC 2016 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org ht

[Betacluster-alerts] Host DOWN alert for deployment-zotero01!

Notification Type: PROBLEM Host: deployment-zotero01 State: DOWN Address: 10.68.17.102 Info: CRITICAL - Host Unreachable (10.68.17.102) Date/Time: Thu 21 Jan 19:39:07 UTC 2016 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org htt

[Betacluster-alerts] Host DOWN alert for deployment-redis02!

Notification Type: PROBLEM Host: deployment-redis02 State: DOWN Address: 10.68.16.231 Info: CRITICAL - Host Unreachable (10.68.16.231) Date/Time: Thu 21 Jan 19:38:25 UTC 2016 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org http

[Betacluster-alerts] Host DOWN alert for deployment-stream!

Notification Type: PROBLEM Host: deployment-stream State: DOWN Address: 10.68.17.106 Info: CRITICAL - Host Unreachable (10.68.17.106) Date/Time: Thu 21 Jan 19:38:15 UTC 2016 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https

[Betacluster-alerts] Host DOWN alert for deployment-jobrunner01!

Notification Type: PROBLEM Host: deployment-jobrunner01 State: DOWN Address: 10.68.17.96 Info: CRITICAL - Host Unreachable (10.68.17.96) Date/Time: Thu 21 Jan 19:38:01 UTC 2016 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org ht

[Betacluster-alerts] Host DOWN alert for deployment-apertium01!

Notification Type: PROBLEM Host: deployment-apertium01 State: DOWN Address: 10.68.16.79 Info: CRITICAL - Host Unreachable (10.68.16.79) Date/Time: Thu 21 Jan 19:34:15 UTC 2016 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org htt

[Betacluster-alerts] ** PROBLEM alert - Generic Beta Cluster/English Wikipedia Mobile Main page is CRITICAL **

Notification Type: PROBLEM Service: English Wikipedia Mobile Main page Host: Generic Beta Cluster Address: en.wikipedia.beta.wmflabs.org State: CRITICAL Date/Time: Thu 21 Jan 19:33:40 UTC 2016 Additional Info: No route to host ___ Betacluster-alerts m

[Betacluster-alerts] Host DOWN alert for deployment-mediawiki02!

Notification Type: PROBLEM Host: deployment-mediawiki02 State: DOWN Address: 10.68.16.127 Info: CRITICAL - Host Unreachable (10.68.16.127) Date/Time: Thu 21 Jan 19:33:12 UTC 2016 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] ** RECOVERY alert - deployment-mediawiki02/App Server Main HTTP Response is OK **

Notification Type: RECOVERY Service: App Server Main HTTP Response Host: deployment-mediawiki02 Address: 10.68.16.127 State: OK Date/Time: Thu 21 Jan 19:28:04 UTC 2016 Additional Info: HTTP OK: HTTP/1.1 200 OK - 39407 bytes in 1.161 second response time _

[Betacluster-alerts] ** RECOVERY alert - deployment-mediawiki03/App Server Main HTTP Response is OK **

Notification Type: RECOVERY Service: App Server Main HTTP Response Host: deployment-mediawiki03 Address: 10.68.17.55 State: OK Date/Time: Thu 21 Jan 19:27:58 UTC 2016 Additional Info: HTTP OK: HTTP/1.1 200 OK - 39406 bytes in 0.601 second response time __

[Betacluster-alerts] ** RECOVERY alert - Generic Beta Cluster/English Wikipedia Mobile Main page is OK **

Notification Type: RECOVERY Service: English Wikipedia Mobile Main page Host: Generic Beta Cluster Address: en.wikipedia.beta.wmflabs.org State: OK Date/Time: Thu 21 Jan 19:27:37 UTC 2016 Additional Info: HTTP OK: HTTP/1.1 200 OK - 31602 bytes in 1.491 second response time _

[Betacluster-alerts] Host UP alert for deployment-zookeeper01!

Notification Type: RECOVERY Host: deployment-zookeeper01 State: UP Address: 10.68.17.157 Info: PING OK - Packet loss = 0%, RTA = 0.92 ms Date/Time: Thu 21 Jan 19:27:06 UTC 2016 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org ht

[Betacluster-alerts] Host UP alert for deployment-mx!

Notification Type: RECOVERY Host: deployment-mx State: UP Address: 10.68.17.78 Info: PING OK - Packet loss = 0%, RTA = 1.87 ms Date/Time: Thu 21 Jan 19:26:59 UTC 2016 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://list

[Betacluster-alerts] Host UP alert for deployment-cxserver03!

Notification Type: RECOVERY Host: deployment-cxserver03 State: UP Address: 10.68.16.150 Info: PING OK - Packet loss = 0%, RTA = 0.87 ms Date/Time: Thu 21 Jan 19:25:40 UTC 2016 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org htt

[Betacluster-alerts] ** RECOVERY alert - Generic Beta Cluster/English Wikipedia Main page is OK **

Notification Type: RECOVERY Service: English Wikipedia Main page Host: Generic Beta Cluster Address: en.wikipedia.beta.wmflabs.org State: OK Date/Time: Thu 21 Jan 19:25:36 UTC 2016 Additional Info: HTTP OK: HTTP/1.1 200 OK - 39741 bytes in 1.376 second response time

[Betacluster-alerts] Host UP alert for deployment-mediawiki01!

Notification Type: RECOVERY Host: deployment-mediawiki01 State: UP Address: 10.68.17.170 Info: PING OK - Packet loss = 0%, RTA = 0.77 ms Date/Time: Thu 21 Jan 19:23:25 UTC 2016 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org ht

[Betacluster-alerts] Host DOWN alert for deployment-zookeeper01!

Notification Type: PROBLEM Host: deployment-zookeeper01 State: DOWN Address: 10.68.17.157 Info: CRITICAL - Host Unreachable (10.68.17.157) Date/Time: Thu 21 Jan 19:22:06 UTC 2016 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] Host DOWN alert for deployment-mx!

Notification Type: PROBLEM Host: deployment-mx State: DOWN Address: 10.68.17.78 Info: CRITICAL - Host Unreachable (10.68.17.78) Date/Time: Thu 21 Jan 19:21:54 UTC 2016 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lis

[Betacluster-alerts] ** PROBLEM alert - deployment-mediawiki03/App Server Main HTTP Response is CRITICAL **

Notification Type: PROBLEM Service: App Server Main HTTP Response Host: deployment-mediawiki03 Address: 10.68.17.55 State: CRITICAL Date/Time: Thu 21 Jan 19:18:01 UTC 2016 Additional Info: HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - 1534 bytes in 3.048 second response time

[Betacluster-alerts] ** PROBLEM alert - deployment-mediawiki02/App Server Main HTTP Response is CRITICAL **

Notification Type: PROBLEM Service: App Server Main HTTP Response Host: deployment-mediawiki02 Address: 10.68.16.127 State: CRITICAL Date/Time: Thu 21 Jan 19:18:04 UTC 2016 Additional Info: HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - 1534 bytes in 1.144 second response time ___

[Betacluster-alerts] ** PROBLEM alert - Generic Beta Cluster/English Wikipedia Mobile Main page is CRITICAL **

Notification Type: PROBLEM Service: English Wikipedia Mobile Main page Host: Generic Beta Cluster Address: en.wikipedia.beta.wmflabs.org State: CRITICAL Date/Time: Thu 21 Jan 19:17:38 UTC 2016 Additional Info: HTTP CRITICAL: HTTP/1.1 503 Service Unavailable - string 'Wikipedia' not found on 'h

[Betacluster-alerts] Host DOWN alert for deployment-cxserver03!

Notification Type: PROBLEM Host: deployment-cxserver03 State: DOWN Address: 10.68.16.150 Info: CRITICAL - Host Unreachable (10.68.16.150) Date/Time: Thu 21 Jan 19:15:52 UTC 2016 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org h

[Betacluster-alerts] Host DOWN alert for deployment-mediawiki01!

Notification Type: PROBLEM Host: deployment-mediawiki01 State: DOWN Address: 10.68.17.170 Info: CRITICAL - Host Unreachable (10.68.17.170) Date/Time: Thu 21 Jan 19:15:58 UTC 2016 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] ** PROBLEM alert - Generic Beta Cluster/English Wikipedia Main page is CRITICAL **

Notification Type: PROBLEM Service: English Wikipedia Main page Host: Generic Beta Cluster Address: en.wikipedia.beta.wmflabs.org State: CRITICAL Date/Time: Thu 21 Jan 19:15:35 UTC 2016 Additional Info: HTTP CRITICAL: HTTP/1.1 500 Internal Server Error - 1938 bytes in 1.163 second response tim

[Betacluster-alerts] ** PROBLEM alert - deployment-cxserver03/Content Translation Server is CRITICAL **

Notification Type: PROBLEM Service: Content Translation Server Host: deployment-cxserver03 Address: 10.68.16.150 State: CRITICAL Date/Time: Thu 21 Jan 19:15:36 UTC 2016 Additional Info: No route to host ___ Betacluster-alerts mailing list Betacluster-

[Betacluster-alerts] Host UP alert for deployment-eventlogging03!

Notification Type: RECOVERY Host: deployment-eventlogging03 State: UP Address: 10.68.18.111 Info: PING OK - Packet loss = 0%, RTA = 1.10 ms Date/Time: Thu 21 Jan 19:00:57 UTC 2016 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org

[Betacluster-alerts] Host UP alert for deployment-elastic06!

Notification Type: RECOVERY Host: deployment-elastic06 State: UP Address: 10.68.17.186 Info: PING OK - Packet loss = 0%, RTA = 1.32 ms Date/Time: Thu 21 Jan 19:00:28 UTC 2016 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org http

[Betacluster-alerts] Host UP alert for deployment-memc04!

Notification Type: RECOVERY Host: deployment-memc04 State: UP Address: 10.68.17.69 Info: PING OK - Packet loss = 0%, RTA = 1.05 ms Date/Time: Thu 21 Jan 18:59:40 UTC 2016 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://

[Betacluster-alerts] Host UP alert for deployment-mathoid!

Notification Type: RECOVERY Host: deployment-mathoid State: UP Address: 10.68.17.222 Info: PING OK - Packet loss = 0%, RTA = 2.07 ms Date/Time: Thu 21 Jan 18:59:38 UTC 2016 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https:

[Betacluster-alerts] Host UP alert for deployment-pdf02!

Notification Type: RECOVERY Host: deployment-pdf02 State: UP Address: 10.68.16.129 Info: PING OK - Packet loss = 0%, RTA = 0.75 ms Date/Time: Thu 21 Jan 18:58:53 UTC 2016 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://

[Betacluster-alerts] Host UP alert for deployment-mediawiki03!

Notification Type: RECOVERY Host: deployment-mediawiki03 State: UP Address: 10.68.17.55 Info: PING OK - Packet loss = 0%, RTA = 0.61 ms Date/Time: Thu 21 Jan 18:57:12 UTC 2016 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org htt

[Betacluster-alerts] Host DOWN alert for deployment-eventlogging03!

Notification Type: PROBLEM Host: deployment-eventlogging03 State: DOWN Address: 10.68.18.111 Info: CRITICAL - Host Unreachable (10.68.18.111) Date/Time: Thu 21 Jan 18:55:59 UTC 2016 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.o

[Betacluster-alerts] Host DOWN alert for deployment-elastic06!

Notification Type: PROBLEM Host: deployment-elastic06 State: DOWN Address: 10.68.17.186 Info: CRITICAL - Host Unreachable (10.68.17.186) Date/Time: Thu 21 Jan 18:55:28 UTC 2016 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org ht

[Betacluster-alerts] Host DOWN alert for deployment-memc04!

Notification Type: PROBLEM Host: deployment-memc04 State: DOWN Address: 10.68.17.69 Info: CRITICAL - Host Unreachable (10.68.17.69) Date/Time: Thu 21 Jan 18:54:39 UTC 2016 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https:/

[Betacluster-alerts] Host DOWN alert for deployment-pdf02!

Notification Type: PROBLEM Host: deployment-pdf02 State: DOWN Address: 10.68.16.129 Info: CRITICAL - Host Unreachable (10.68.16.129) Date/Time: Thu 21 Jan 18:53:55 UTC 2016 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https:

[Betacluster-alerts] Host DOWN alert for deployment-mediawiki03!

Notification Type: PROBLEM Host: deployment-mediawiki03 State: DOWN Address: 10.68.17.55 Info: CRITICAL - Host Unreachable (10.68.17.55) Date/Time: Thu 21 Jan 18:51:02 UTC 2016 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org ht

[Betacluster-alerts] Host DOWN alert for deployment-mathoid!

Notification Type: PROBLEM Host: deployment-mathoid State: DOWN Address: 10.68.17.222 Info: CRITICAL - Host Unreachable (10.68.17.222) Date/Time: Thu 21 Jan 18:49:53 UTC 2016 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org http

[Betacluster-alerts] Host UP alert for deployment-salt!

Notification Type: RECOVERY Host: deployment-salt State: UP Address: 10.68.16.99 Info: PING OK - Packet loss = 0%, RTA = 0.91 ms Date/Time: Thu 21 Jan 18:18:54 UTC 2016 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://li

[Betacluster-alerts] ** RECOVERY alert - deployment-mediawiki03/App Server Main HTTP Response is OK **

Notification Type: RECOVERY Service: App Server Main HTTP Response Host: deployment-mediawiki03 Address: 10.68.17.55 State: OK Date/Time: Thu 21 Jan 18:20:56 UTC 2016 Additional Info: HTTP OK: HTTP/1.1 200 OK - 39399 bytes in 0.695 second response time __

[Betacluster-alerts] Host UP alert for deployment-memc03!

Notification Type: RECOVERY Host: deployment-memc03 State: UP Address: 10.68.16.15 Info: PING OK - Packet loss = 0%, RTA = 0.82 ms Date/Time: Thu 21 Jan 18:17:55 UTC 2016 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://

[Betacluster-alerts] Host UP alert for deployment-parsoid05!

Notification Type: RECOVERY Host: deployment-parsoid05 State: UP Address: 10.68.16.120 Info: PING OK - Packet loss = 0%, RTA = 0.90 ms Date/Time: Thu 21 Jan 18:18:27 UTC 2016 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org http

[Betacluster-alerts] ** RECOVERY alert - deployment-mediawiki02/App Server Main HTTP Response is OK **

Notification Type: RECOVERY Service: App Server Main HTTP Response Host: deployment-mediawiki02 Address: 10.68.16.127 State: OK Date/Time: Thu 21 Jan 18:17:03 UTC 2016 Additional Info: HTTP OK: HTTP/1.1 200 OK - 39391 bytes in 0.603 second response time _

[Betacluster-alerts] ** RECOVERY alert - deployment-mediawiki02/App Server bits response is OK **

Notification Type: RECOVERY Service: App Server bits response Host: deployment-mediawiki02 Address: 10.68.16.127 State: OK Date/Time: Thu 21 Jan 18:17:38 UTC 2016 Additional Info: HTTP OK: HTTP/1.1 200 OK - 3896 bytes in 0.003 second response time ___

[Betacluster-alerts] ** RECOVERY alert - deployment-mediawiki03/App Server bits response is OK **

Notification Type: RECOVERY Service: App Server bits response Host: deployment-mediawiki03 Address: 10.68.17.55 State: OK Date/Time: Thu 21 Jan 18:16:52 UTC 2016 Additional Info: HTTP OK: HTTP/1.1 200 OK - 3896 bytes in 0.002 second response time ___

[Betacluster-alerts] Host DOWN alert for deployment-memc03!

Notification Type: PROBLEM Host: deployment-memc03 State: DOWN Address: 10.68.16.15 Info: CRITICAL - Host Unreachable (10.68.16.15) Date/Time: Thu 21 Jan 18:12:54 UTC 2016 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https:/

[Betacluster-alerts] Host DOWN alert for deployment-parsoid05!

Notification Type: PROBLEM Host: deployment-parsoid05 State: DOWN Address: 10.68.16.120 Info: CRITICAL - Host Unreachable (10.68.16.120) Date/Time: Thu 21 Jan 18:11:36 UTC 2016 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org ht

[Betacluster-alerts] Host DOWN alert for deployment-salt!

Notification Type: PROBLEM Host: deployment-salt State: DOWN Address: 10.68.16.99 Info: CRITICAL - Host Unreachable (10.68.16.99) Date/Time: Thu 21 Jan 18:09:32 UTC 2016 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://l

[Betacluster-alerts] ** PROBLEM alert - deployment-mediawiki02/App Server bits response is CRITICAL **

Notification Type: PROBLEM Service: App Server bits response Host: deployment-mediawiki02 Address: 10.68.16.127 State: CRITICAL Date/Time: Thu 21 Jan 18:02:38 UTC 2016 Additional Info: Connection refused ___ Betacluster-alerts mailing list Betacluster

[Betacluster-alerts] ** PROBLEM alert - deployment-mediawiki02/App Server Main HTTP Response is CRITICAL **

Notification Type: PROBLEM Service: App Server Main HTTP Response Host: deployment-mediawiki02 Address: 10.68.16.127 State: CRITICAL Date/Time: Thu 21 Jan 18:02:04 UTC 2016 Additional Info: Connection refused ___ Betacluster-alerts mailing list Betacl

[Betacluster-alerts] ** PROBLEM alert - deployment-mediawiki03/App Server bits response is CRITICAL **

Notification Type: PROBLEM Service: App Server bits response Host: deployment-mediawiki03 Address: 10.68.17.55 State: CRITICAL Date/Time: Thu 21 Jan 18:01:53 UTC 2016 Additional Info: Connection refused ___ Betacluster-alerts mailing list Betacluster-

[Betacluster-alerts] ** PROBLEM alert - deployment-mediawiki03/App Server Main HTTP Response is CRITICAL **

Notification Type: PROBLEM Service: App Server Main HTTP Response Host: deployment-mediawiki03 Address: 10.68.17.55 State: CRITICAL Date/Time: Thu 21 Jan 17:56:06 UTC 2016 Additional Info: CRITICAL - Socket timeout after 10 seconds ___ Betacluster-ale

[Betacluster-alerts] Host UP alert for deployment-fluorine!

Notification Type: RECOVERY Host: deployment-fluorine State: UP Address: 10.68.16.198 Info: PING OK - Packet loss = 0%, RTA = 2.63 ms Date/Time: Thu 21 Jan 17:18:12 UTC 2016 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https

[Betacluster-alerts] Host UP alert for deployment-logstash2!

Notification Type: RECOVERY Host: deployment-logstash2 State: UP Address: 10.68.16.147 Info: PING OK - Packet loss = 0%, RTA = 1.22 ms Date/Time: Thu 21 Jan 17:17:53 UTC 2016 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org http

[Betacluster-alerts] Host UP alert for deployment-sca02!

Notification Type: RECOVERY Host: deployment-sca02 State: UP Address: 10.68.16.173 Info: PING OK - Packet loss = 0%, RTA = 0.61 ms Date/Time: Thu 21 Jan 17:16:42 UTC 2016 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://

[Betacluster-alerts] Host DOWN alert for deployment-fluorine!

Notification Type: PROBLEM Host: deployment-fluorine State: DOWN Address: 10.68.16.198 Info: CRITICAL - Host Unreachable (10.68.16.198) Date/Time: Thu 21 Jan 17:13:09 UTC 2016 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org htt

[Betacluster-alerts] Host DOWN alert for deployment-logstash2!

Notification Type: PROBLEM Host: deployment-logstash2 State: DOWN Address: 10.68.16.147 Info: CRITICAL - Host Unreachable (10.68.16.147) Date/Time: Thu 21 Jan 17:12:52 UTC 2016 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org ht

[Betacluster-alerts] Host DOWN alert for deployment-sca02!

Notification Type: PROBLEM Host: deployment-sca02 State: DOWN Address: 10.68.16.173 Info: CRITICAL - Host Unreachable (10.68.16.173) Date/Time: Thu 21 Jan 17:05:41 UTC 2016 ___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https:

[Betacluster-alerts] ** PROBLEM alert - deployment-mediawiki03/App Server Main HTTP Response is CRITICAL **

Notification Type: PROBLEM Service: App Server Main HTTP Response Host: deployment-mediawiki03 Address: 10.68.17.55 State: CRITICAL Date/Time: Thu 21 Jan 14:05:06 UTC 2016 Additional Info: CRITICAL - Socket timeout after 10 seconds ___ Betacluster-ale

  1   2   >