[Betacluster-alerts] ** PROBLEM alert - deployment-kafka01/Puppet errors is CRITICAL **

2017-10-18 Thread shinken
Notification Type: PROBLEM Service: Puppet errors Host: deployment-kafka01 Address: 10.68.21.219 State: CRITICAL Date/Time: Thu 19 Oct 06:57:17 UTC 2017 Additional Info: CRITICAL: 100.00% of data above the critical threshold [0.0] ___ Betacluster-aler

[Betacluster-alerts] ** PROBLEM alert - deployment-fluorine02/Free space - all mounts is CRITICAL **

2017-10-18 Thread shinken
Notification Type: PROBLEM Service: Free space - all mounts Host: deployment-fluorine02 Address: 10.68.23.106 State: CRITICAL Date/Time: Thu 19 Oct 05:36:02 UTC 2017 Additional Info: CRITICAL: deployment-prep.deployment-fluorine02.diskspace._srv.byte_percentfree (<10.00%) _

[Betacluster-alerts] ** PROBLEM alert - Graphite Labs/Mediawiki Error Rate is WARNING **

2017-10-18 Thread shinken
Notification Type: PROBLEM Service: Mediawiki Error Rate Host: Graphite Labs Address: graphite-labs.wikimedia.org State: WARNING Date/Time: Thu 19 Oct 05:16:48 UTC 2017 Additional Info: WARNING: 60.00% of data above the warning threshold [1.0] ___ Bet

[Betacluster-alerts] ** RECOVERY alert - Graphite Labs/Mediawiki Error Rate is OK **

2017-10-18 Thread shinken
Notification Type: RECOVERY Service: Mediawiki Error Rate Host: Graphite Labs Address: graphite-labs.wikimedia.org State: OK Date/Time: Thu 19 Oct 05:10:48 UTC 2017 Additional Info: OK: Less than 1.00% above the threshold [1.0] ___ Betacluster-alerts

[Betacluster-alerts] ** PROBLEM alert - Graphite Labs/Mediawiki Error Rate is WARNING **

2017-10-18 Thread shinken
Notification Type: PROBLEM Service: Mediawiki Error Rate Host: Graphite Labs Address: graphite-labs.wikimedia.org State: WARNING Date/Time: Thu 19 Oct 04:45:49 UTC 2017 Additional Info: WARNING: 80.00% of data above the warning threshold [1.0] ___ Bet

[Betacluster-alerts] ** PROBLEM alert - deployment-eventlog02/Free space - all mounts is CRITICAL **

2017-10-18 Thread shinken
Notification Type: PROBLEM Service: Free space - all mounts Host: deployment-eventlog02 Address: 10.68.18.138 State: CRITICAL Date/Time: Thu 19 Oct 02:36:45 UTC 2017 Additional Info: CRITICAL: deployment-prep.deployment-eventlog02.diskspace.root.byte_percentfree (<10.00%) _

[Betacluster-alerts] ** PROBLEM alert - deployment-fluorine02/Free space - all mounts is WARNING **

2017-10-18 Thread shinken
Notification Type: PROBLEM Service: Free space - all mounts Host: deployment-fluorine02 Address: 10.68.23.106 State: WARNING Date/Time: Thu 19 Oct 02:36:00 UTC 2017 Additional Info: WARNING: deployment-prep.deployment-fluorine02.diskspace._srv.byte_percentfree (<50.00%) ___

[Betacluster-alerts] ** RECOVERY alert - deployment-eventlogging04/Puppet errors is OK **

2017-10-18 Thread shinken
Notification Type: RECOVERY Service: Puppet errors Host: deployment-eventlogging04 Address: 10.68.23.204 State: OK Date/Time: Wed 18 Oct 22:13:30 UTC 2017 Additional Info: OK: Less than 1.00% above the threshold [0.0] ___ Betacluster-alerts mailing li

[Betacluster-alerts] ** RECOVERY alert - deployment-eventlog02/Puppet errors is OK **

2017-10-18 Thread shinken
Notification Type: RECOVERY Service: Puppet errors Host: deployment-eventlog02 Address: 10.68.18.138 State: OK Date/Time: Wed 18 Oct 22:12:46 UTC 2017 Additional Info: OK: Less than 1.00% above the threshold [0.0] ___ Betacluster-alerts mailing list B

[Betacluster-alerts] beta-code-update-eqiad - Build # 177456 - Fixed!

2017-10-18 Thread jenkins-bot
beta-code-update-eqiad - Build # 177456 - Fixed: Check console output at https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/177456/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://lists.

[Betacluster-alerts] ** PROBLEM alert - deployment-eventlog02/Puppet errors is CRITICAL **

2017-10-18 Thread shinken
Notification Type: PROBLEM Service: Puppet errors Host: deployment-eventlog02 Address: 10.68.18.138 State: CRITICAL Date/Time: Wed 18 Oct 21:37:46 UTC 2017 Additional Info: CRITICAL: 60.00% of data above the critical threshold [0.0] ___ Betacluster-al

[Betacluster-alerts] beta-code-update-eqiad - Build # 177455 - Failure!

2017-10-18 Thread jenkins-bot
beta-code-update-eqiad - Build # 177455 - Failure: Check console output at https://integration.wikimedia.org/ci/job/beta-code-update-eqiad/177455/ to view the results.___ Betacluster-alerts mailing list Betacluster-alerts@lists.wikimedia.org https://list

[Betacluster-alerts] ** PROBLEM alert - deployment-eventlogging04/Puppet errors is CRITICAL **

2017-10-18 Thread shinken
Notification Type: PROBLEM Service: Puppet errors Host: deployment-eventlogging04 Address: 10.68.23.204 State: CRITICAL Date/Time: Wed 18 Oct 21:33:28 UTC 2017 Additional Info: CRITICAL: 22.22% of data above the critical threshold [0.0] ___ Betacluste

[Betacluster-alerts] ** PROBLEM alert - Graphite Labs/Mediawiki Error Rate is WARNING **

2017-10-18 Thread shinken
Notification Type: PROBLEM Service: Mediawiki Error Rate Host: Graphite Labs Address: graphite-labs.wikimedia.org State: WARNING Date/Time: Wed 18 Oct 19:53:47 UTC 2017 Additional Info: WARNING: 20.00% of data above the warning threshold [1.0] ___ Bet

[Betacluster-alerts] ** RECOVERY alert - Graphite Labs/Mediawiki Error Rate is OK **

2017-10-18 Thread shinken
Notification Type: RECOVERY Service: Mediawiki Error Rate Host: Graphite Labs Address: graphite-labs.wikimedia.org State: OK Date/Time: Wed 18 Oct 19:01:47 UTC 2017 Additional Info: OK: Less than 1.00% above the threshold [1.0] ___ Betacluster-alerts

[Betacluster-alerts] ** PROBLEM alert - Graphite Labs/Mediawiki Error Rate is WARNING **

2017-10-18 Thread shinken
Notification Type: PROBLEM Service: Mediawiki Error Rate Host: Graphite Labs Address: graphite-labs.wikimedia.org State: WARNING Date/Time: Wed 18 Oct 18:51:49 UTC 2017 Additional Info: WARNING: 20.00% of data above the warning threshold [1.0] ___ Bet

[Betacluster-alerts] ** RECOVERY alert - Graphite Labs/Mediawiki Error Rate is OK **

2017-10-18 Thread shinken
Notification Type: RECOVERY Service: Mediawiki Error Rate Host: Graphite Labs Address: graphite-labs.wikimedia.org State: OK Date/Time: Wed 18 Oct 14:55:46 UTC 2017 Additional Info: OK: Less than 1.00% above the threshold [1.0] ___ Betacluster-alerts

[Betacluster-alerts] ** PROBLEM alert - Graphite Labs/Mediawiki Error Rate is WARNING **

2017-10-18 Thread shinken
Notification Type: PROBLEM Service: Mediawiki Error Rate Host: Graphite Labs Address: graphite-labs.wikimedia.org State: WARNING Date/Time: Wed 18 Oct 14:50:48 UTC 2017 Additional Info: WARNING: 40.00% of data above the warning threshold [1.0] ___ Bet

[Betacluster-alerts] ** RECOVERY alert - deployment-videoscaler01/Puppet errors is OK **

2017-10-18 Thread shinken
Notification Type: RECOVERY Service: Puppet errors Host: deployment-videoscaler01 Address: 10.68.19.130 State: OK Date/Time: Wed 18 Oct 14:26:22 UTC 2017 Additional Info: OK: Less than 1.00% above the threshold [0.0] ___ Betacluster-alerts mailing lis

[Betacluster-alerts] ** PROBLEM alert - deployment-videoscaler01/Puppet errors is CRITICAL **

2017-10-18 Thread shinken
Notification Type: PROBLEM Service: Puppet errors Host: deployment-videoscaler01 Address: 10.68.19.130 State: CRITICAL Date/Time: Wed 18 Oct 14:16:21 UTC 2017 Additional Info: CRITICAL: 11.11% of data above the critical threshold [0.0] ___ Betacluster

[Betacluster-alerts] ** PROBLEM alert - deployment-puppetmaster02/Long lived cherry-picks on puppetmaster is CRITICAL **

2017-10-18 Thread shinken
Notification Type: PROBLEM Service: Long lived cherry-picks on puppetmaster Host: deployment-puppetmaster02 Address: 10.68.21.200 State: CRITICAL Date/Time: Wed 18 Oct 12:23:07 UTC 2017 Additional Info: CRITICAL: 100.00% of data above the critical threshold [0.0] ___

[Betacluster-alerts] ** RECOVERY alert - Graphite Labs/Mediawiki Error Rate is OK **

2017-10-18 Thread shinken
Notification Type: RECOVERY Service: Mediawiki Error Rate Host: Graphite Labs Address: graphite-labs.wikimedia.org State: OK Date/Time: Wed 18 Oct 09:41:48 UTC 2017 Additional Info: OK: Less than 1.00% above the threshold [1.0] ___ Betacluster-alerts

[Betacluster-alerts] ** PROBLEM alert - deployment-eventlog02/Free space - all mounts is WARNING **

2017-10-18 Thread shinken
Notification Type: PROBLEM Service: Free space - all mounts Host: deployment-eventlog02 Address: 10.68.18.138 State: WARNING Date/Time: Wed 18 Oct 09:36:46 UTC 2017 Additional Info: WARNING: deployment-prep.deployment-eventlog02.diskspace.root.byte_percentfree (<40.00%) ___

[Betacluster-alerts] ** PROBLEM alert - Graphite Labs/Mediawiki Error Rate is WARNING **

2017-10-18 Thread shinken
Notification Type: PROBLEM Service: Mediawiki Error Rate Host: Graphite Labs Address: graphite-labs.wikimedia.org State: WARNING Date/Time: Wed 18 Oct 09:36:49 UTC 2017 Additional Info: WARNING: 20.00% of data above the warning threshold [1.0] ___ Bet

[Betacluster-alerts] ** RECOVERY alert - Graphite Labs/Mediawiki Error Rate is OK **

2017-10-18 Thread shinken
Notification Type: RECOVERY Service: Mediawiki Error Rate Host: Graphite Labs Address: graphite-labs.wikimedia.org State: OK Date/Time: Wed 18 Oct 09:30:49 UTC 2017 Additional Info: OK: Less than 1.00% above the threshold [1.0] ___ Betacluster-alerts

[Betacluster-alerts] ** PROBLEM alert - Graphite Labs/Mediawiki Error Rate is WARNING **

2017-10-18 Thread shinken
Notification Type: PROBLEM Service: Mediawiki Error Rate Host: Graphite Labs Address: graphite-labs.wikimedia.org State: WARNING Date/Time: Wed 18 Oct 09:25:50 UTC 2017 Additional Info: WARNING: 80.00% of data above the warning threshold [1.0] ___ Bet

[Betacluster-alerts] ** RECOVERY alert - Graphite Labs/Mediawiki Error Rate is OK **

2017-10-18 Thread shinken
Notification Type: RECOVERY Service: Mediawiki Error Rate Host: Graphite Labs Address: graphite-labs.wikimedia.org State: OK Date/Time: Wed 18 Oct 08:59:49 UTC 2017 Additional Info: OK: Less than 1.00% above the threshold [1.0] ___ Betacluster-alerts

[Betacluster-alerts] ** RECOVERY alert - deployment-aqs03/Puppet errors is OK **

2017-10-18 Thread shinken
Notification Type: RECOVERY Service: Puppet errors Host: deployment-aqs03 Address: 10.68.17.125 State: OK Date/Time: Wed 18 Oct 08:43:49 UTC 2017 Additional Info: OK: Less than 1.00% above the threshold [0.0] ___ Betacluster-alerts mailing list Betacl

[Betacluster-alerts] ** RECOVERY alert - deployment-aqs02/Puppet errors is OK **

2017-10-18 Thread shinken
Notification Type: RECOVERY Service: Puppet errors Host: deployment-aqs02 Address: 10.68.17.90 State: OK Date/Time: Wed 18 Oct 08:33:03 UTC 2017 Additional Info: OK: Less than 1.00% above the threshold [0.0] ___ Betacluster-alerts mailing list Betaclu

[Betacluster-alerts] ** RECOVERY alert - deployment-aqs01/Puppet errors is OK **

2017-10-18 Thread shinken
Notification Type: RECOVERY Service: Puppet errors Host: deployment-aqs01 Address: 10.68.18.237 State: OK Date/Time: Wed 18 Oct 08:28:58 UTC 2017 Additional Info: OK: Less than 1.00% above the threshold [0.0] ___ Betacluster-alerts mailing list Betacl

[Betacluster-alerts] ** RECOVERY alert - deployment-mediawiki04/Free space - all mounts is OK **

2017-10-18 Thread shinken
Notification Type: RECOVERY Service: Free space - all mounts Host: deployment-mediawiki04 Address: 10.68.19.128 State: OK Date/Time: Wed 18 Oct 08:07:54 UTC 2017 Additional Info: OK: All targets OK ___ Betacluster-alerts mailing list Betacluster-alert

[Betacluster-alerts] ** PROBLEM alert - deployment-mediawiki04/Free space - all mounts is WARNING **

2017-10-18 Thread shinken
Notification Type: PROBLEM Service: Free space - all mounts Host: deployment-mediawiki04 Address: 10.68.19.128 State: WARNING Date/Time: Wed 18 Oct 07:57:53 UTC 2017 Additional Info: WARNING: deployment-prep.deployment-mediawiki04.diskspace.root.byte_percentfree (<10.00%) _

[Betacluster-alerts] ** PROBLEM alert - Graphite Labs/Mediawiki Error Rate is WARNING **

2017-10-18 Thread shinken
Notification Type: PROBLEM Service: Mediawiki Error Rate Host: Graphite Labs Address: graphite-labs.wikimedia.org State: WARNING Date/Time: Wed 18 Oct 07:49:49 UTC 2017 Additional Info: WARNING: 80.00% of data above the warning threshold [1.0] ___ Bet

[Betacluster-alerts] ** PROBLEM alert - Graphite Labs/Mediawiki Error Rate is CRITICAL **

2017-10-18 Thread shinken
Notification Type: PROBLEM Service: Mediawiki Error Rate Host: Graphite Labs Address: graphite-labs.wikimedia.org State: CRITICAL Date/Time: Wed 18 Oct 07:44:46 UTC 2017 Additional Info: CRITICAL: 40.00% of data above the critical threshold [10.0] ___